2024-09-21T06:52:16.799 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T06:52:16.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:52:16.907 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iozone}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913578' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOpidyCST1/wyIp3nvurkDCtXsFedICvvbzh2wRQHhoLvqBHRABfyA+XbUhj3BwgOmXXaWlgTHD4pGWbOiBouY= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDFRmqvjUgKElefrBf8mDPnL6dCEcZq7OdgiMr14qYmcvxkSyIZE1fT3UiOmZDJx3/6/k06ghGDDnF/qqBmxO5k= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPTWFM2jOU5t3+gbAy0WEGpeCXoDIfBDSVaXxCsSKEx3hnKvJdh6lX1zzltEWMcO5qTzuauvcjn6S5Z0VsYamQg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T06:52:16.908 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T06:52:16.908 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T06:52:16.909 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T06:52:16.910 INFO:teuthology.task.internal:Checking packages... 2024-09-21T06:52:16.930 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T06:52:16.930 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T06:52:16.930 INFO:teuthology.packaging:ref: None 2024-09-21T06:52:16.930 INFO:teuthology.packaging:tag: None 2024-09-21T06:52:16.930 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:52:16.931 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:52:16.931 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:52:17.077 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T06:52:17.078 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T06:52:17.092 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T06:52:17.092 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T06:52:17.130 INFO:teuthology.task.internal:Saving configuration 2024-09-21T06:52:17.151 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T06:52:17.325 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T06:52:17.346 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:47:19.036489', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOpidyCST1/wyIp3nvurkDCtXsFedICvvbzh2wRQHhoLvqBHRABfyA+XbUhj3BwgOmXXaWlgTHD4pGWbOiBouY='} 2024-09-21T06:52:17.366 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:47:19.037914', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDFRmqvjUgKElefrBf8mDPnL6dCEcZq7OdgiMr14qYmcvxkSyIZE1fT3UiOmZDJx3/6/k06ghGDDnF/qqBmxO5k='} 2024-09-21T06:52:17.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:47:19.039047', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPTWFM2jOU5t3+gbAy0WEGpeCXoDIfBDSVaXxCsSKEx3hnKvJdh6lX1zzltEWMcO5qTzuauvcjn6S5Z0VsYamQg='} 2024-09-21T06:52:17.387 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T06:52:17.394 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T06:52:17.394 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T06:52:17.394 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T06:52:17.394 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T06:52:17.473 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f586e844160>, signals=[15]) 2024-09-21T06:52:17.473 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T06:52:17.479 INFO:teuthology.task.internal:Opening connections... 2024-09-21T06:52:17.479 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T06:52:17.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:52:17.555 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-09-21T06:52:17.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:52:17.632 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-09-21T06:52:17.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:52:17.704 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T06:52:17.711 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-09-21T06:52:17.728 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-09-21T06:52:17.728 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:52:17.785 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:52:17.786 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:52:17.786 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:52:17.786 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:52:17.786 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-09-21T06:52:17.810 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-09-21T06:52:17.829 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-09-21T06:52:17.829 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-09-21T06:52:17.888 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-09-21T06:52:17.888 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-09-21T06:52:17.888 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-09-21T06:52:17.888 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:52:17.888 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-09-21T06:52:17.889 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:52:17.889 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:52:17.889 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-09-21T06:52:17.889 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:52:17.889 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:52:17.889 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:52:17.890 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:52:17.890 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:52:17.890 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:52:17.890 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-09-21T06:52:17.910 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-09-21T06:52:17.928 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-09-21T06:52:17.928 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-09-21T06:52:17.986 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-09-21T06:52:17.986 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-09-21T06:52:17.986 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:52:17.987 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:52:17.988 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-09-21T06:52:18.010 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T06:52:18.025 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T06:52:18.058 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T06:52:18.059 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:52:18.061 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:52:18.064 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:52:18.081 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T06:52:18.092 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T06:52:18.093 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:52:18.118 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:52:18.121 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:52:18.236 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T06:52:18.311 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T06:52:18.325 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T06:52:18.325 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T06:52:18.326 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:52:18.326 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:52:18.327 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:52:18.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:52:18.344 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-21T06:52:18.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:52:18.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:52:18.345 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-09-21T06:52:18.346 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-09-21T06:52:18.401 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:52:18.402 INFO:teuthology.task.kernel:Running kernel on smithi092: 5.14.0-503.el9.x86_64 2024-09-21T06:52:18.402 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2024-09-21T06:52:18.403 INFO:teuthology.orchestra.run.smithi169.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:52:18.403 INFO:teuthology.task.kernel:Running kernel on smithi169: 5.14.0-503.el9.x86_64 2024-09-21T06:52:18.403 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum install -y kernel 2024-09-21T06:52:18.404 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:52:18.404 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.14.0-503.el9.x86_64 2024-09-21T06:52:18.404 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2024-09-21T06:52:20.598 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-21T06:52:20.926 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T06:52:21.911 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-21T06:52:22.415 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-21T06:52:23.612 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-21T06:52:24.102 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-21T06:52:26.633 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-21T06:52:28.046 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.5 MB 00:00 2024-09-21T06:52:28.167 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-21T06:52:29.071 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T06:52:29.646 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-21T06:52:29.736 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-21T06:52:30.592 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T06:52:31.228 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-21T06:52:32.332 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T06:52:34.444 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T06:52:35.965 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T06:52:36.333 INFO:teuthology.orchestra.run.smithi169.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:52:36.333 INFO:teuthology.orchestra.run.smithi169.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:52:36.424 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-21T06:52:36.429 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-09-21T06:52:36.429 INFO:teuthology.orchestra.run.smithi169.stdout: Package Architecture Version Repository Size 2024-09-21T06:52:36.429 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout:Install 4 Packages 2024-09-21T06:52:36.430 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T06:52:36.431 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 79 M 2024-09-21T06:52:36.431 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 126 M 2024-09-21T06:52:36.431 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-09-21T06:52:37.053 INFO:teuthology.orchestra.run.smithi169.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 63 kB/s | 36 kB 00:00 2024-09-21T06:52:37.720 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T06:52:37.862 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:52:37.863 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:52:37.870 INFO:teuthology.orchestra.run.smithi169.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T06:52:37.961 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-21T06:52:37.969 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-09-21T06:52:37.970 INFO:teuthology.orchestra.run.smithi175.stdout:Install 4 Packages 2024-09-21T06:52:37.971 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:52:37.972 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 79 M 2024-09-21T06:52:37.972 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 126 M 2024-09-21T06:52:37.972 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-21T06:52:38.537 INFO:teuthology.orchestra.run.smithi169.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-21T06:52:38.582 INFO:teuthology.orchestra.run.smithi175.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 61 kB/s | 36 kB 00:00 2024-09-21T06:52:39.254 INFO:teuthology.orchestra.run.smithi169.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-21T06:52:39.254 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:52:39.255 INFO:teuthology.orchestra.run.smithi169.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-21T06:52:39.383 INFO:teuthology.orchestra.run.smithi175.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T06:52:39.627 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:52:39.627 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:52:39.724 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-21T06:52:39.734 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-21T06:52:39.734 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-21T06:52:39.734 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-21T06:52:39.734 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-21T06:52:39.734 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:52:39.734 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-21T06:52:39.734 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:52:39.734 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:52:39.734 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:52:39.734 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T06:52:39.735 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-21T06:52:39.735 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-21T06:52:39.735 INFO:teuthology.orchestra.run.smithi092.stdout:Install 4 Packages 2024-09-21T06:52:39.735 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T06:52:39.735 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 79 M 2024-09-21T06:52:39.735 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 126 M 2024-09-21T06:52:39.735 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-21T06:52:39.934 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-09-21T06:52:40.033 INFO:teuthology.orchestra.run.smithi175.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-21T06:52:40.072 INFO:teuthology.orchestra.run.smithi092.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 124 kB/s | 36 kB 00:00 2024-09-21T06:52:40.286 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-09-21T06:52:40.287 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-09-21T06:52:41.083 INFO:teuthology.orchestra.run.smithi175.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-21T06:52:41.083 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:52:41.083 INFO:teuthology.orchestra.run.smithi175.stdout:Total 25 MB/s | 79 MB 00:03 2024-09-21T06:52:41.254 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-09-21T06:52:41.254 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-09-21T06:52:41.767 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-21T06:52:42.112 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-21T06:52:42.112 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-21T06:52:43.088 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-21T06:52:43.088 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-21T06:52:43.530 INFO:teuthology.orchestra.run.smithi092.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.2 MB/s | 16 MB 00:03 2024-09-21T06:52:43.702 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-09-21T06:52:44.424 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:52:44.507 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:52:45.537 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-21T06:52:46.154 INFO:teuthology.orchestra.run.smithi092.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.4 MB/s | 35 MB 00:06 2024-09-21T06:52:46.185 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:52:46.266 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:52:47.304 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:52:47.444 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:52:49.031 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:52:49.160 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:52:52.259 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:52:52.294 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:52:54.036 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:52:54.077 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:52:57.144 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:52:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:52:59.477 INFO:teuthology.orchestra.run.smithi092.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 1.5 MB/s | 29 MB 00:19 2024-09-21T06:52:59.478 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:52:59.478 INFO:teuthology.orchestra.run.smithi092.stdout:Total 4.0 MB/s | 79 MB 00:19 2024-09-21T06:53:00.188 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-21T06:53:00.554 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-21T06:53:00.555 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-21T06:53:01.527 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-21T06:53:01.528 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-21T06:53:03.973 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-21T06:53:04.612 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:53:04.694 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:53:07.449 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:53:07.582 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:53:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:53:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:17.356 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:35.748 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:35.788 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:36.147 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:53:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:53:36.148 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:53:36.915 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:36.954 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:37.013 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:37.013 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T06:53:37.013 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-09-21T06:53:37.013 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:53:37.013 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:53:37.013 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:53:37.013 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:53:37.014 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T06:53:37.014 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-21T06:53:37.259 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:37.259 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:53:37.259 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:53:37.259 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:53:37.352 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:53:37.436 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:53:37.437 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:53:37.437 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:53:37.437 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:53:37.437 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:53:37.437 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T06:53:37.437 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:53:37.437 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:53:37.496 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:53:37.497 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:53:37.497 DEBUG:teuthology.orchestra.run.smithi169:> sudo rpm -qi grub2-tools 2024-09-21T06:53:37.538 INFO:teuthology.orchestra.run.smithi169.stdout:Name : grub2-tools 2024-09-21T06:53:37.538 INFO:teuthology.orchestra.run.smithi169.stdout:Epoch : 1 2024-09-21T06:53:37.538 INFO:teuthology.orchestra.run.smithi169.stdout:Version : 2.06 2024-09-21T06:53:37.538 INFO:teuthology.orchestra.run.smithi169.stdout:Release : 82.el9 2024-09-21T06:53:37.538 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: x86_64 2024-09-21T06:53:37.538 INFO:teuthology.orchestra.run.smithi169.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:53:37.538 INFO:teuthology.orchestra.run.smithi169.stdout:Group : Unspecified 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:Size : 8274670 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:License : GPLv3+ 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:Packager : builder@centos.org 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:Vendor : CentOS 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:Summary : Support tools for GRUB. 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:Description : 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:53:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:53:37.540 INFO:teuthology.orchestra.run.smithi169.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:53:37.540 INFO:teuthology.orchestra.run.smithi169.stdout:hardware devices. 2024-09-21T06:53:37.540 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T06:53:37.540 INFO:teuthology.orchestra.run.smithi169.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:53:37.541 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:53:37.541 INFO:teuthology.task.kernel:Updating grub on smithi169 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:53:37.541 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:53:38.109 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:38.109 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:53:38.109 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-21T06:53:38.109 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:53:38.110 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:53:38.110 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:53:38.110 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:53:38.110 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:53:38.110 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-21T06:53:38.165 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2024-09-21T06:53:38.493 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:53:38.574 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:53:38.575 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:53:38.575 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:53:38.575 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:53:38.575 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:53:38.575 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-21T06:53:38.575 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:53:38.575 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:53:38.634 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:53:38.634 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:53:38.634 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -qi grub2-tools 2024-09-21T06:53:38.667 INFO:teuthology.orchestra.run.smithi175.stdout:Name : grub2-tools 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Epoch : 1 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Version : 2.06 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Release : 82.el9 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: x86_64 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Group : Unspecified 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Size : 8274670 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:License : GPLv3+ 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Packager : builder@centos.org 2024-09-21T06:53:38.668 INFO:teuthology.orchestra.run.smithi175.stdout:Vendor : CentOS 2024-09-21T06:53:38.669 INFO:teuthology.orchestra.run.smithi175.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:53:38.669 INFO:teuthology.orchestra.run.smithi175.stdout:Summary : Support tools for GRUB. 2024-09-21T06:53:38.669 INFO:teuthology.orchestra.run.smithi175.stdout:Description : 2024-09-21T06:53:38.669 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:53:38.669 INFO:teuthology.orchestra.run.smithi175.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:53:38.669 INFO:teuthology.orchestra.run.smithi175.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:53:38.669 INFO:teuthology.orchestra.run.smithi175.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:53:38.669 INFO:teuthology.orchestra.run.smithi175.stdout:hardware devices. 2024-09-21T06:53:38.669 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:53:38.669 INFO:teuthology.orchestra.run.smithi175.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:53:38.670 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:53:38.670 INFO:teuthology.task.kernel:Updating grub on smithi175 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:53:38.670 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:53:39.379 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-09-21T06:53:39.476 INFO:teuthology.orchestra.run.smithi169.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:53:39.507 INFO:teuthology.orchestra.run.smithi169.stderr:done 2024-09-21T06:53:39.509 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-09-21T06:53:39.524 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.2TJ3uftg60 2024-09-21T06:53:39.525 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2TJ3uftg60 2024-09-21T06:53:39.596 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.2TJ3uftg60 2024-09-21T06:53:39.740 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.2TJ3uftg60 is 6KB 2024-09-21T06:53:39.760 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.2TJ3uftg60 2024-09-21T06:53:39.775 DEBUG:teuthology.orchestra.run.smithi169:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:53:39.838 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:53:39.838 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:53:39.838 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:53:39.838 INFO:teuthology.orchestra.run.smithi169.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:53:39.839 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:53:39.996 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2024-09-21T06:53:40.758 INFO:teuthology.orchestra.run.smithi175.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:53:40.790 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-09-21T06:53:40.792 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-09-21T06:53:40.807 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.8cFrb9lkEL 2024-09-21T06:53:40.808 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8cFrb9lkEL 2024-09-21T06:53:40.875 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.8cFrb9lkEL 2024-09-21T06:53:41.009 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.8cFrb9lkEL is 6KB 2024-09-21T06:53:41.056 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.8cFrb9lkEL 2024-09-21T06:53:41.071 DEBUG:teuthology.orchestra.run.smithi175:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:53:41.133 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:53:41.134 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:53:41.134 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:53:41.134 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:53:41.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:53:41.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-09-21T06:53:55.721 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:55.761 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:56.072 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:56.072 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:53:56.072 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:53:56.072 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:53:56.910 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:53:56.910 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T06:53:56.910 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-21T06:53:56.910 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:53:56.910 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:53:56.910 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:53:56.910 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:53:56.910 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T06:53:56.910 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-21T06:53:57.267 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:53:57.388 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:53:57.388 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:53:57.388 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:53:57.388 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:53:57.389 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:53:57.389 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T06:53:57.389 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:53:57.389 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:53:57.447 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:53:57.447 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:53:57.448 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2024-09-21T06:53:57.481 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2024-09-21T06:53:57.481 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2024-09-21T06:53:57.481 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.06 2024-09-21T06:53:57.481 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 82.el9 2024-09-21T06:53:57.481 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2024-09-21T06:53:57.481 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:53:57.481 INFO:teuthology.orchestra.run.smithi092.stdout:Group : Unspecified 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 8274670 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : builder@centos.org 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T06:53:57.482 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:53:57.483 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:53:57.483 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:53:57.483 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2024-09-21T06:53:57.483 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T06:53:57.483 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:53:57.484 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:53:57.484 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:53:57.484 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:53:58.135 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2024-09-21T06:53:59.505 INFO:teuthology.orchestra.run.smithi092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:53:59.544 INFO:teuthology.orchestra.run.smithi092.stderr:done 2024-09-21T06:53:59.547 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-09-21T06:53:59.563 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.IUFQpeoSrB 2024-09-21T06:53:59.563 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IUFQpeoSrB 2024-09-21T06:53:59.630 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.IUFQpeoSrB 2024-09-21T06:53:59.769 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.IUFQpeoSrB is 6KB 2024-09-21T06:53:59.817 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.IUFQpeoSrB 2024-09-21T06:53:59.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:53:59.903 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:53:59.904 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:53:59.904 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:53:59.904 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:53:59.905 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:54:00.064 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2024-09-21T06:54:10.006 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T06:54:10.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-21T06:54:10.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:54:11.297 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-21T06:54:11.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-21T06:54:11.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:54:30.086 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T06:54:30.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-21T06:54:30.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:54:44.719 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-09-21T06:54:53.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-21T06:54:53.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:55:11.318 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T06:55:12.111 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-09-21T06:55:20.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-21T06:55:20.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:55:20.822 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-21T06:55:21.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-21T06:55:21.214 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:55:21.214 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-09-21T06:55:21.229 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:55:21.229 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:55:21.229 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:55:21.229 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:55:22.229 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-21T06:55:22.230 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T06:55:22.332 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-09-21T06:55:22.355 DEBUG:teuthology.parallel:result is None 2024-09-21T06:55:24.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-21T06:55:24.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:55:24.549 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-21T06:55:24.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-21T06:55:24.902 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:55:24.902 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-09-21T06:55:24.917 INFO:teuthology.orchestra.run.smithi169.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:55:24.917 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:55:24.917 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:55:24.917 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:55:25.918 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T06:55:25.918 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T06:55:26.013 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-09-21T06:55:26.035 DEBUG:teuthology.parallel:result is None 2024-09-21T06:55:30.090 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T06:55:39.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-21T06:55:39.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:55:39.445 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-21T06:55:39.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-21T06:55:39.796 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:55:39.796 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-21T06:55:39.810 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:55:39.811 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:55:39.811 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:55:39.811 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:55:40.812 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T06:55:40.812 DEBUG:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T06:55:40.889 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2024-09-21T06:55:40.926 DEBUG:teuthology.parallel:result is None 2024-09-21T06:55:40.926 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T06:55:40.940 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T06:55:40.940 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:55:40.942 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:55:40.945 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:55:40.965 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T06:55:40.981 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T06:55:41.009 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T06:55:41.009 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:55:41.012 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:55:41.014 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:55:41.140 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T06:55:41.148 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T06:55:41.149 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:55:41.152 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:55:41.155 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:55:41.175 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:55:41.183 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:55:41.185 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:55:41.187 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:55:41.195 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:55:41.198 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:55:41.200 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T06:55:41.209 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T06:55:41.209 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:55:41.231 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:55:41.239 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:55:41.267 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T06:55:41.275 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T06:55:41.276 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:55:41.296 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:55:41.307 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:55:41.323 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:55:41.392 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:55:41.447 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:55:41.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:55:41.576 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T06:55:41.576 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:55:41.640 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:55:41.682 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:55:41.743 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:55:41.831 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:55:41.869 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T06:55:41.869 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:55:41.935 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:55:41.980 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:55:42.037 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:55:42.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:55:42.166 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:55:42.166 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:55:42.235 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-09-21T06:55:42.241 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-09-21T06:55:42.243 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-09-21T06:55:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:55:42.321 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:55:42.336 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:55:42.681 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T06:55:42.687 INFO:teuthology.task.internal:Starting timer... 2024-09-21T06:55:42.687 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T06:55:42.697 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T06:55:42.704 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T06:55:42.704 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-09-21T06:55:42.814 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-09-21T06:55:42.818 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-09-21T06:55:42.910 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-09-21T06:55:42.912 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-09-21T06:55:42.995 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-09-21T06:55:42.997 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T06:55:42.997 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-09-21T06:55:43.050 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-09-21T06:55:43.050 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-09-21T06:55:43.094 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-09-21T06:55:43.094 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-09-21T06:55:43.115 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-09-21T06:55:43.115 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-09-21T06:55:43.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:55:43.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:55:43.143 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:55:43.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:55:43.171 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:55:43.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:55:43.202 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T06:55:43.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:55:43.246 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:55:43.292 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:55:43.330 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T06:55:43.340 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T06:55:43.343 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T06:55:44.222 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T06:55:44.233 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T06:55:44.234 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi092.front.sepia.ceph.com,smithi169.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T06:59:30.026 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-09-21T06:59:30.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-21T06:59:30.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:59:30.106 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-21T06:59:30.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-21T06:59:30.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-21T06:59:30.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:59:30.264 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-21T06:59:30.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-21T06:59:30.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-21T06:59:30.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:59:30.434 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-21T06:59:30.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-21T06:59:30.516 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T06:59:30.525 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T06:59:30.525 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:59:30.526 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:59:30.528 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:59:30.528 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:59:30.530 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:59:30.530 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:59:30.559 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:59:30.560 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:59:30.575 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:59:30.576 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:59:30.587 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:59:30.601 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-09-21T06:59:30.601 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-09-21T06:59:30.602 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:59:30.612 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-09-21T06:59:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-09-21T06:59:30.627 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:59:30.628 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:59:30.628 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-09-21T06:59:30.640 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-09-21T06:59:30.641 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:59:30.642 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:59:30.654 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:59:30.669 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:59:30.701 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:59:30.701 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:59:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:59:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-21T06:59:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.706 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:59:30.706 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-21T06:59:30.706 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.706 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.706 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.707 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.725 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:59:30.729 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:59:30.729 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-21T06:59:30.729 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.729 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.729 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.729 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:59:30.730 INFO:teuthology.run_tasks:Running task install... 2024-09-21T06:59:30.738 DEBUG:teuthology.task.install:project ceph 2024-09-21T06:59:30.738 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T06:59:30.738 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T06:59:30.739 INFO:teuthology.task.install:Using flavor: default 2024-09-21T06:59:30.744 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T06:59:30.744 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T06:59:30.744 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:59:30.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:59:30.746 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:59:30.746 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:59:30.747 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:59:30.747 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:59:30.889 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:59:30.890 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:59:30.897 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:59:30.897 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:59:30.910 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:59:30.910 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:59:30.998 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:59:30.998 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T06:59:30.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:59:31.008 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:59:31.008 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T06:59:31.008 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:59:31.018 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:59:31.019 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T06:59:31.019 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:59:31.024 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:59:31.024 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:59:31.034 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:59:31.035 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:59:31.045 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:59:31.045 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:59:31.090 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:59:31.100 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:59:31.111 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:59:31.165 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:59:31.176 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:59:31.186 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:59:31.229 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-09-21T06:59:31.231 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-09-21T06:59:31.239 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-09-21T06:59:31.241 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-09-21T06:59:31.250 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-09-21T06:59:31.252 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-09-21T06:59:31.465 INFO:teuthology.orchestra.run.smithi175.stdout:45 files removed 2024-09-21T06:59:31.466 INFO:teuthology.orchestra.run.smithi092.stdout:45 files removed 2024-09-21T06:59:31.485 INFO:teuthology.orchestra.run.smithi169.stdout:45 files removed 2024-09-21T06:59:31.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:59:31.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:59:31.513 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:59:32.051 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-21T06:59:32.065 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 294 kB/s | 84 kB 00:00 2024-09-21T06:59:32.077 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-21T06:59:32.343 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T06:59:32.361 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-21T06:59:32.365 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T06:59:32.619 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T06:59:32.629 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-21T06:59:32.658 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-21T06:59:33.154 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-21T06:59:35.360 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.3 MB 00:02 2024-09-21T06:59:35.508 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.3 MB 00:02 2024-09-21T06:59:37.288 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-21T06:59:41.989 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-21T06:59:42.254 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-09-21T06:59:43.489 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-21T06:59:44.116 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-21T06:59:44.285 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T06:59:47.680 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-21T06:59:49.414 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-21T06:59:49.699 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-21T06:59:49.760 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-21T06:59:50.543 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:01 2024-09-21T06:59:51.903 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:59:51.904 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:59:51.917 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:59:51.918 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:59:51.919 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:59:51.920 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:59:51.922 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:59:51.924 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:59:51.925 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:59:51.985 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-21T06:59:51.988 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-21T06:59:52.007 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-21T06:59:52.007 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-21T06:59:52.007 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-21T06:59:52.007 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-21T06:59:52.007 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:59:52.007 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:59:52.007 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:59:52.007 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:59:52.007 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:59:52.007 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:59:52.008 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:59:52.009 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:59:52.010 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:59:52.011 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:59:52.012 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:59:52.013 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:59:52.014 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:59:52.015 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:59:52.016 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:59:52.017 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:59:52.018 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:59:52.019 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-09-21T06:59:52.020 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:59:52.020 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:59:52.020 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-21T06:59:52.020 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-21T06:59:52.020 INFO:teuthology.orchestra.run.smithi175.stdout:Install 149 Packages 2024-09-21T06:59:52.020 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 8 Packages 2024-09-21T06:59:52.020 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T06:59:52.020 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 228 M 2024-09-21T06:59:52.021 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-21T06:59:52.583 INFO:teuthology.orchestra.run.smithi175.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-09-21T06:59:52.767 INFO:teuthology.orchestra.run.smithi175.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T06:59:52.781 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T06:59:52.842 INFO:teuthology.orchestra.run.smithi175.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T06:59:52.967 INFO:teuthology.orchestra.run.smithi175.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T06:59:53.043 INFO:teuthology.orchestra.run.smithi175.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T06:59:53.085 INFO:teuthology.orchestra.run.smithi175.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 13 MB/s | 1.5 MB 00:00 2024-09-21T06:59:53.569 INFO:teuthology.orchestra.run.smithi175.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T06:59:53.644 INFO:teuthology.orchestra.run.smithi175.stdout:(8/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 8.3 MB/s | 5.0 MB 00:00 2024-09-21T06:59:53.686 INFO:teuthology.orchestra.run.smithi175.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 608 kB/s | 25 kB 00:00 2024-09-21T06:59:54.236 INFO:teuthology.orchestra.run.smithi175.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 15 MB/s | 18 MB 00:01 2024-09-21T06:59:54.345 INFO:teuthology.orchestra.run.smithi175.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 13 MB/s | 10 MB 00:00 2024-09-21T06:59:54.370 INFO:teuthology.orchestra.run.smithi175.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.7 MB/s | 226 kB 00:00 2024-09-21T06:59:54.395 INFO:teuthology.orchestra.run.smithi175.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T06:59:54.420 INFO:teuthology.orchestra.run.smithi175.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 633 kB/s | 32 kB 00:00 2024-09-21T06:59:54.471 INFO:teuthology.orchestra.run.smithi175.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T06:59:54.504 INFO:teuthology.orchestra.run.smithi175.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.9 MB/s | 766 kB 00:00 2024-09-21T06:59:54.529 INFO:teuthology.orchestra.run.smithi175.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T06:59:54.563 INFO:teuthology.orchestra.run.smithi175.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.5 MB/s | 507 kB 00:00 2024-09-21T06:59:54.622 INFO:teuthology.orchestra.run.smithi175.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 774 kB/s | 45 kB 00:00 2024-09-21T06:59:54.680 INFO:teuthology.orchestra.run.smithi175.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.5 MB/s | 148 kB 00:00 2024-09-21T06:59:54.747 INFO:teuthology.orchestra.run.smithi175.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T06:59:54.831 INFO:teuthology.orchestra.run.smithi175.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.3 MB 00:00 2024-09-21T06:59:54.856 INFO:teuthology.orchestra.run.smithi175.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 2.9 MB/s | 321 kB 00:00 2024-09-21T06:59:54.889 INFO:teuthology.orchestra.run.smithi175.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T06:59:54.915 INFO:teuthology.orchestra.run.smithi175.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T06:59:54.940 INFO:teuthology.orchestra.run.smithi175.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:59:54.999 INFO:teuthology.orchestra.run.smithi175.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-21T06:59:55.049 INFO:teuthology.orchestra.run.smithi175.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 689 kB/s | 34 kB 00:00 2024-09-21T06:59:55.108 INFO:teuthology.orchestra.run.smithi175.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 16 MB/s | 3.1 MB 00:00 2024-09-21T06:59:55.133 INFO:teuthology.orchestra.run.smithi175.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.8 MB/s | 154 kB 00:00 2024-09-21T06:59:55.642 INFO:teuthology.orchestra.run.smithi175.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-21T06:59:55.717 INFO:teuthology.orchestra.run.smithi175.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.8 MB/s | 292 kB 00:00 2024-09-21T06:59:55.999 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-21T06:59:56.084 INFO:teuthology.orchestra.run.smithi175.stdout:(33/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T06:59:56.109 INFO:teuthology.orchestra.run.smithi175.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 126 kB/s | 49 kB 00:00 2024-09-21T06:59:56.134 INFO:teuthology.orchestra.run.smithi175.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 330 kB/s | 16 kB 00:00 2024-09-21T06:59:56.276 INFO:teuthology.orchestra.run.smithi175.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T06:59:56.302 INFO:teuthology.orchestra.run.smithi175.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 1.4 MB/s | 285 kB 00:00 2024-09-21T06:59:56.327 INFO:teuthology.orchestra.run.smithi175.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 368 kB/s | 18 kB 00:00 2024-09-21T06:59:56.360 INFO:teuthology.orchestra.run.smithi175.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.4 MB/s | 784 kB 00:00 2024-09-21T06:59:56.452 INFO:teuthology.orchestra.run.smithi175.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-21T06:59:56.478 INFO:teuthology.orchestra.run.smithi175.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-21T06:59:56.520 INFO:teuthology.orchestra.run.smithi175.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-21T06:59:56.545 INFO:teuthology.orchestra.run.smithi175.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-21T06:59:56.570 INFO:teuthology.orchestra.run.smithi175.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T06:59:56.595 INFO:teuthology.orchestra.run.smithi175.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T06:59:56.620 INFO:teuthology.orchestra.run.smithi175.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T06:59:56.646 INFO:teuthology.orchestra.run.smithi175.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T06:59:56.679 INFO:teuthology.orchestra.run.smithi175.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-21T06:59:56.821 INFO:teuthology.orchestra.run.smithi175.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-09-21T06:59:56.847 INFO:teuthology.orchestra.run.smithi175.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-21T06:59:56.872 INFO:teuthology.orchestra.run.smithi175.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-21T06:59:56.898 INFO:teuthology.orchestra.run.smithi175.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-21T06:59:56.914 INFO:teuthology.orchestra.run.smithi175.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 782 kB/s | 33 kB 00:00 2024-09-21T06:59:56.956 INFO:teuthology.orchestra.run.smithi175.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-21T06:59:56.973 INFO:teuthology.orchestra.run.smithi175.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-21T06:59:56.998 INFO:teuthology.orchestra.run.smithi175.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-09-21T06:59:57.024 INFO:teuthology.orchestra.run.smithi175.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T06:59:57.082 INFO:teuthology.orchestra.run.smithi175.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-21T06:59:57.108 INFO:teuthology.orchestra.run.smithi175.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-21T06:59:57.133 INFO:teuthology.orchestra.run.smithi175.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-21T06:59:57.166 INFO:teuthology.orchestra.run.smithi175.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-21T06:59:57.191 INFO:teuthology.orchestra.run.smithi175.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T06:59:57.217 INFO:teuthology.orchestra.run.smithi175.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-21T06:59:57.242 INFO:teuthology.orchestra.run.smithi175.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-21T06:59:57.267 INFO:teuthology.orchestra.run.smithi175.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T06:59:57.301 INFO:teuthology.orchestra.run.smithi175.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 661 kB/s | 38 kB 00:00 2024-09-21T06:59:57.335 INFO:teuthology.orchestra.run.smithi175.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-21T06:59:57.427 INFO:teuthology.orchestra.run.smithi175.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-21T06:59:57.502 INFO:teuthology.orchestra.run.smithi175.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-21T06:59:57.536 INFO:teuthology.orchestra.run.smithi175.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-09-21T06:59:57.561 INFO:teuthology.orchestra.run.smithi175.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T06:59:57.611 INFO:teuthology.orchestra.run.smithi175.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-21T06:59:57.653 INFO:teuthology.orchestra.run.smithi175.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-21T06:59:57.678 INFO:teuthology.orchestra.run.smithi175.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T06:59:57.720 INFO:teuthology.orchestra.run.smithi175.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T06:59:57.796 INFO:teuthology.orchestra.run.smithi175.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-21T06:59:57.821 INFO:teuthology.orchestra.run.smithi175.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T06:59:57.846 INFO:teuthology.orchestra.run.smithi175.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T06:59:57.871 INFO:teuthology.orchestra.run.smithi175.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-21T06:59:57.897 INFO:teuthology.orchestra.run.smithi175.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-21T06:59:57.922 INFO:teuthology.orchestra.run.smithi175.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T06:59:57.947 INFO:teuthology.orchestra.run.smithi175.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-21T06:59:58.022 INFO:teuthology.orchestra.run.smithi175.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-21T06:59:58.048 INFO:teuthology.orchestra.run.smithi175.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-21T06:59:58.073 INFO:teuthology.orchestra.run.smithi175.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T06:59:58.098 INFO:teuthology.orchestra.run.smithi175.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T06:59:58.123 INFO:teuthology.orchestra.run.smithi175.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-21T06:59:58.149 INFO:teuthology.orchestra.run.smithi175.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T06:59:58.182 INFO:teuthology.orchestra.run.smithi175.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T06:59:58.208 INFO:teuthology.orchestra.run.smithi175.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-21T06:59:58.226 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:59:58.227 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:59:58.228 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T06:59:58.233 INFO:teuthology.orchestra.run.smithi175.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T06:59:58.238 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:59:58.239 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:59:58.240 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:59:58.241 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:59:58.242 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:59:58.245 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:59:58.246 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:59:58.258 INFO:teuthology.orchestra.run.smithi175.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T06:59:58.307 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-21T06:59:58.334 INFO:teuthology.orchestra.run.smithi175.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T06:59:58.335 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:59:58.336 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:59:58.337 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:59:58.338 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:59:58.339 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:59:58.340 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:59:58.341 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:59:58.342 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:59:58.343 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:59:58.344 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:59:58.345 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:59:58.346 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:59:58.347 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout:Install 149 Packages 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 8 Packages 2024-09-21T06:59:58.348 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T06:59:58.349 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 228 M 2024-09-21T06:59:58.349 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-09-21T06:59:58.358 INFO:teuthology.orchestra.run.smithi175.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-21T06:59:58.384 INFO:teuthology.orchestra.run.smithi175.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-21T06:59:58.409 INFO:teuthology.orchestra.run.smithi175.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T06:59:58.435 INFO:teuthology.orchestra.run.smithi175.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-21T06:59:58.460 INFO:teuthology.orchestra.run.smithi175.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 939 kB/s | 47 kB 00:00 2024-09-21T06:59:58.494 INFO:teuthology.orchestra.run.smithi175.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T06:59:58.519 INFO:teuthology.orchestra.run.smithi175.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 991 kB/s | 58 kB 00:00 2024-09-21T06:59:58.544 INFO:teuthology.orchestra.run.smithi175.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T06:59:58.569 INFO:teuthology.orchestra.run.smithi175.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T06:59:58.595 INFO:teuthology.orchestra.run.smithi175.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-21T06:59:58.703 INFO:teuthology.orchestra.run.smithi175.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-21T06:59:58.870 INFO:teuthology.orchestra.run.smithi175.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-21T06:59:58.912 INFO:teuthology.orchestra.run.smithi175.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 2.6 MB/s | 548 kB 00:00 2024-09-21T06:59:58.937 INFO:teuthology.orchestra.run.smithi175.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 851 kB/s | 19 kB 00:00 2024-09-21T06:59:58.971 INFO:teuthology.orchestra.run.smithi175.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.1 MB/s | 308 kB 00:00 2024-09-21T06:59:59.005 INFO:teuthology.orchestra.run.smithi175.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-21T06:59:59.033 INFO:teuthology.orchestra.run.smithi169.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-21T06:59:59.038 INFO:teuthology.orchestra.run.smithi175.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-09-21T06:59:59.063 INFO:teuthology.orchestra.run.smithi175.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-21T06:59:59.088 INFO:teuthology.orchestra.run.smithi175.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 580 kB/s | 49 kB 00:00 2024-09-21T06:59:59.114 INFO:teuthology.orchestra.run.smithi175.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-21T06:59:59.156 INFO:teuthology.orchestra.run.smithi175.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T06:59:59.181 INFO:teuthology.orchestra.run.smithi175.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:59:59.206 INFO:teuthology.orchestra.run.smithi175.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:59:59.231 INFO:teuthology.orchestra.run.smithi175.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-21T06:59:59.259 INFO:teuthology.orchestra.run.smithi169.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.8 MB/s | 873 kB 00:00 2024-09-21T06:59:59.265 INFO:teuthology.orchestra.run.smithi175.stdout:(118/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 839 kB 00:00 2024-09-21T06:59:59.290 INFO:teuthology.orchestra.run.smithi175.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T06:59:59.333 INFO:teuthology.orchestra.run.smithi175.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T06:59:59.366 INFO:teuthology.orchestra.run.smithi175.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-21T06:59:59.367 INFO:teuthology.orchestra.run.smithi169.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-21T06:59:59.391 INFO:teuthology.orchestra.run.smithi175.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T06:59:59.392 INFO:teuthology.orchestra.run.smithi169.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.1 MB/s | 148 kB 00:00 2024-09-21T06:59:59.416 INFO:teuthology.orchestra.run.smithi175.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T06:59:59.433 INFO:teuthology.orchestra.run.smithi175.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 646 kB/s | 11 kB 00:00 2024-09-21T06:59:59.459 INFO:teuthology.orchestra.run.smithi175.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-21T06:59:59.476 INFO:teuthology.orchestra.run.smithi175.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T06:59:59.493 INFO:teuthology.orchestra.run.smithi175.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-21T06:59:59.518 INFO:teuthology.orchestra.run.smithi169.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 15 MB/s | 2.3 MB 00:00 2024-09-21T06:59:59.518 INFO:teuthology.orchestra.run.smithi175.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 782 kB/s | 20 kB 00:00 2024-09-21T06:59:59.577 INFO:teuthology.orchestra.run.smithi169.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 8.2 MB/s | 1.5 MB 00:00 2024-09-21T06:59:59.586 INFO:teuthology.orchestra.run.smithi175.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-21T06:59:59.610 INFO:teuthology.orchestra.run.smithi175.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:59:59.635 INFO:teuthology.orchestra.run.smithi175.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:59:59.661 INFO:teuthology.orchestra.run.smithi175.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:59:59.694 INFO:teuthology.orchestra.run.smithi175.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-21T06:59:59.720 INFO:teuthology.orchestra.run.smithi175.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-21T06:59:59.769 INFO:teuthology.orchestra.run.smithi169.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 20 MB/s | 5.0 MB 00:00 2024-09-21T06:59:59.770 INFO:teuthology.orchestra.run.smithi175.stdout:(135/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.0 MB/s | 2.0 MB 00:00 2024-09-21T06:59:59.796 INFO:teuthology.orchestra.run.smithi175.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T06:59:59.821 INFO:teuthology.orchestra.run.smithi175.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-21T06:59:59.854 INFO:teuthology.orchestra.run.smithi175.stdout:(138/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-21T06:59:59.879 INFO:teuthology.orchestra.run.smithi175.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 368 kB/s | 31 kB 00:00 2024-09-21T06:59:59.904 INFO:teuthology.orchestra.run.smithi175.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T06:59:59.930 INFO:teuthology.orchestra.run.smithi175.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-21T06:59:59.955 INFO:teuthology.orchestra.run.smithi175.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T06:59:59.980 INFO:teuthology.orchestra.run.smithi175.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T07:00:00.005 INFO:teuthology.orchestra.run.smithi175.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-21T07:00:00.039 INFO:teuthology.orchestra.run.smithi175.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T07:00:00.065 INFO:teuthology.orchestra.run.smithi175.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-09-21T07:00:00.090 INFO:teuthology.orchestra.run.smithi175.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T07:00:00.115 INFO:teuthology.orchestra.run.smithi175.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T07:00:00.165 INFO:teuthology.orchestra.run.smithi175.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T07:00:00.193 INFO:teuthology.orchestra.run.smithi169.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 25 MB/s | 10 MB 00:00 2024-09-21T07:00:00.357 INFO:teuthology.orchestra.run.smithi175.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T07:00:00.394 INFO:teuthology.orchestra.run.smithi169.stdout:(9/157): ceph-common-19.3.0-5120.g18432218.el9. 13 MB/s | 20 MB 00:01 2024-09-21T07:00:00.419 INFO:teuthology.orchestra.run.smithi169.stdout:(10/157): ceph-selinux-19.3.0-5120.g18432218.el 112 kB/s | 25 kB 00:00 2024-09-21T07:00:00.463 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:00:00.464 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:00:00.476 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:00:00.476 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:00:00.477 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:00:00.478 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:00:00.480 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:00:00.482 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:00:00.483 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:00:00.519 INFO:teuthology.orchestra.run.smithi169.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.2 MB/s | 226 kB 00:00 2024-09-21T07:00:00.540 INFO:teuthology.orchestra.run.smithi175.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.4 MB/s | 3.2 MB 00:00 2024-09-21T07:00:00.545 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-21T07:00:00.564 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-09-21T07:00:00.564 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-21T07:00:00.564 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-09-21T07:00:00.564 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-21T07:00:00.564 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:00:00.564 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:00:00.564 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:00:00.564 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:00:00.565 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:00:00.566 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:00:00.566 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:00:00.566 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:00:00.566 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:00:00.566 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:00:00.566 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:00:00.566 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:00:00.566 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:00:00.566 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:00:00.566 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-09-21T07:00:00.567 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:00:00.568 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:00:00.568 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:00:00.568 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:00:00.568 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:00:00.568 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:00:00.568 INFO:teuthology.orchestra.run.smithi092.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:00:00.568 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:00:00.568 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-21T07:00:00.568 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:00:00.568 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:00:00.569 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:00:00.570 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:00:00.571 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:00:00.571 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:00:00.571 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:00:00.571 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:00:00.571 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:00:00.571 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:00:00.571 INFO:teuthology.orchestra.run.smithi092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:00:00.571 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:00:00.571 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:00:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:00:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:00:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:00:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:00:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:00:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:00:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:00:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:00:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:00:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:00:00.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:00:00.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:00:00.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:00:00.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:00:00.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:00:00.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:00:00.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:00:00.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:00:00.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:00:00.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:00:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:00:00.575 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:00:00.576 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:00:00.577 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:00:00.578 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:00:00.578 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:00:00.578 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-09-21T07:00:00.578 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:00:00.578 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:00:00.578 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-21T07:00:00.578 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-09-21T07:00:00.578 INFO:teuthology.orchestra.run.smithi092.stdout:Install 149 Packages 2024-09-21T07:00:00.578 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 8 Packages 2024-09-21T07:00:00.578 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:00:00.579 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 228 M 2024-09-21T07:00:00.579 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-21T07:00:00.582 INFO:teuthology.orchestra.run.smithi175.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 8.0 MB/s | 1.8 MB 00:00 2024-09-21T07:00:00.603 INFO:teuthology.orchestra.run.smithi169.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 324 kB/s | 27 kB 00:00 2024-09-21T07:00:00.624 INFO:teuthology.orchestra.run.smithi175.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 5.8 MB/s | 249 kB 00:00 2024-09-21T07:00:00.650 INFO:teuthology.orchestra.run.smithi175.stdout:(154/157): NetworkManager-team-1.51.0-1.el9.x86 376 kB/s | 41 kB 00:00 2024-09-21T07:00:00.745 INFO:teuthology.orchestra.run.smithi169.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 382 kB/s | 32 kB 00:00 2024-09-21T07:00:00.745 INFO:teuthology.orchestra.run.smithi175.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-21T07:00:00.834 INFO:teuthology.orchestra.run.smithi175.stdout:(156/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.5 MB/s | 2.3 MB 00:00 2024-09-21T07:00:00.854 INFO:teuthology.orchestra.run.smithi169.stdout:(14/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 14 MB/s | 18 MB 00:01 2024-09-21T07:00:00.896 INFO:teuthology.orchestra.run.smithi169.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 3.6 MB/s | 766 kB 00:00 2024-09-21T07:00:00.921 INFO:teuthology.orchestra.run.smithi169.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T07:00:00.946 INFO:teuthology.orchestra.run.smithi169.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T07:00:00.988 INFO:teuthology.orchestra.run.smithi169.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T07:00:01.055 INFO:teuthology.orchestra.run.smithi169.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 679 kB/s | 45 kB 00:00 2024-09-21T07:00:01.075 INFO:teuthology.orchestra.run.smithi175.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.6 MB/s | 2.4 MB 00:00 2024-09-21T07:00:01.082 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:00:01.082 INFO:teuthology.orchestra.run.smithi175.stdout:Total 25 MB/s | 228 MB 00:09 2024-09-21T07:00:01.155 INFO:teuthology.orchestra.run.smithi169.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 25 MB/s | 5.3 MB 00:00 2024-09-21T07:00:01.171 INFO:teuthology.orchestra.run.smithi092.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 33 kB/s | 6.6 kB 00:00 2024-09-21T07:00:01.180 INFO:teuthology.orchestra.run.smithi169.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 1.2 MB/s | 148 kB 00:00 2024-09-21T07:00:01.206 INFO:teuthology.orchestra.run.smithi169.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T07:00:01.239 INFO:teuthology.orchestra.run.smithi169.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T07:00:01.265 INFO:teuthology.orchestra.run.smithi169.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T07:00:01.290 INFO:teuthology.orchestra.run.smithi169.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T07:00:01.316 INFO:teuthology.orchestra.run.smithi169.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T07:00:01.416 INFO:teuthology.orchestra.run.smithi169.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-21T07:00:01.455 INFO:teuthology.orchestra.run.smithi092.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.0 MB/s | 873 kB 00:00 2024-09-21T07:00:01.483 INFO:teuthology.orchestra.run.smithi169.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 516 kB/s | 34 kB 00:00 2024-09-21T07:00:01.521 INFO:teuthology.orchestra.run.smithi092.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T07:00:01.547 INFO:teuthology.orchestra.run.smithi092.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T07:00:01.550 INFO:teuthology.orchestra.run.smithi169.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 12 MB/s | 3.1 MB 00:00 2024-09-21T07:00:01.575 INFO:teuthology.orchestra.run.smithi169.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.6 MB/s | 154 kB 00:00 2024-09-21T07:00:01.647 INFO:teuthology.orchestra.run.smithi092.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 18 MB/s | 2.3 MB 00:00 2024-09-21T07:00:01.822 INFO:teuthology.orchestra.run.smithi092.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 5.5 MB/s | 1.5 MB 00:00 2024-09-21T07:00:02.134 INFO:teuthology.orchestra.run.smithi169.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-09-21T07:00:02.225 INFO:teuthology.orchestra.run.smithi092.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 8.6 MB/s | 5.0 MB 00:00 2024-09-21T07:00:02.234 INFO:teuthology.orchestra.run.smithi169.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.9 MB/s | 292 kB 00:00 2024-09-21T07:00:02.301 INFO:teuthology.orchestra.run.smithi169.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 742 kB/s | 49 kB 00:00 2024-09-21T07:00:02.333 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-21T07:00:02.376 INFO:teuthology.orchestra.run.smithi169.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 220 kB/s | 16 kB 00:00 2024-09-21T07:00:02.486 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-21T07:00:02.486 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-21T07:00:02.560 INFO:teuthology.orchestra.run.smithi169.stdout:(35/157): ceph-mgr-dashboard-19.3.0-5120.g18432 14 MB/s | 14 MB 00:01 2024-09-21T07:00:02.585 INFO:teuthology.orchestra.run.smithi169.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 1.3 MB/s | 285 kB 00:00 2024-09-21T07:00:02.654 INFO:teuthology.orchestra.run.smithi169.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 8.4 MB/s | 784 kB 00:00 2024-09-21T07:00:02.677 INFO:teuthology.orchestra.run.smithi169.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 200 kB/s | 18 kB 00:00 2024-09-21T07:00:02.881 INFO:teuthology.orchestra.run.smithi092.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 16 MB/s | 10 MB 00:00 2024-09-21T07:00:02.923 INFO:teuthology.orchestra.run.smithi092.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 607 kB/s | 25 kB 00:00 2024-09-21T07:00:03.070 INFO:teuthology.orchestra.run.smithi169.stdout:(39/157): ceph-test-19.3.0-5120.g18432218.el9.x 15 MB/s | 40 MB 00:02 2024-09-21T07:00:03.094 INFO:teuthology.orchestra.run.smithi169.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 180 kB/s | 80 kB 00:00 2024-09-21T07:00:03.254 INFO:teuthology.orchestra.run.smithi169.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-21T07:00:03.394 INFO:teuthology.orchestra.run.smithi092.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 11 MB/s | 18 MB 00:01 2024-09-21T07:00:03.420 INFO:teuthology.orchestra.run.smithi169.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-21T07:00:03.440 INFO:teuthology.orchestra.run.smithi092.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.8 MB/s | 226 kB 00:00 2024-09-21T07:00:03.446 INFO:teuthology.orchestra.run.smithi169.stdout:(43/157): libquadmath-11.5.0-2.el9.x86_64.rpm 508 kB/s | 191 kB 00:00 2024-09-21T07:00:03.471 INFO:teuthology.orchestra.run.smithi169.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T07:00:03.490 INFO:teuthology.orchestra.run.smithi092.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 543 kB/s | 27 kB 00:00 2024-09-21T07:00:03.505 INFO:teuthology.orchestra.run.smithi169.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 4.9 MB/s | 1.2 MB 00:00 2024-09-21T07:00:03.530 INFO:teuthology.orchestra.run.smithi169.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T07:00:03.541 INFO:teuthology.orchestra.run.smithi092.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 634 kB/s | 32 kB 00:00 2024-09-21T07:00:03.555 INFO:teuthology.orchestra.run.smithi169.stdout:(47/157): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-21T07:00:03.580 INFO:teuthology.orchestra.run.smithi169.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-21T07:00:03.624 INFO:teuthology.orchestra.run.smithi092.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 9.0 MB/s | 766 kB 00:00 2024-09-21T07:00:03.683 INFO:teuthology.orchestra.run.smithi092.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.7 MB/s | 158 kB 00:00 2024-09-21T07:00:03.714 INFO:teuthology.orchestra.run.smithi169.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 803 kB/s | 107 kB 00:00 2024-09-21T07:00:03.742 INFO:teuthology.orchestra.run.smithi092.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T07:00:03.756 INFO:teuthology.orchestra.run.smithi169.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-21T07:00:03.781 INFO:teuthology.orchestra.run.smithi169.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-21T07:00:03.809 INFO:teuthology.orchestra.run.smithi092.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T07:00:03.823 INFO:teuthology.orchestra.run.smithi169.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-21T07:00:03.849 INFO:teuthology.orchestra.run.smithi169.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-21T07:00:03.874 INFO:teuthology.orchestra.run.smithi169.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T07:00:03.899 INFO:teuthology.orchestra.run.smithi169.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-21T07:00:03.925 INFO:teuthology.orchestra.run.smithi169.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-21T07:00:03.950 INFO:teuthology.orchestra.run.smithi169.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T07:00:04.008 INFO:teuthology.orchestra.run.smithi169.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-21T07:00:04.025 INFO:teuthology.orchestra.run.smithi169.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-09-21T07:00:04.051 INFO:teuthology.orchestra.run.smithi169.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-21T07:00:04.093 INFO:teuthology.orchestra.run.smithi169.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-21T07:00:04.109 INFO:teuthology.orchestra.run.smithi169.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-21T07:00:04.143 INFO:teuthology.orchestra.run.smithi169.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-21T07:00:04.168 INFO:teuthology.orchestra.run.smithi169.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-21T07:00:04.184 INFO:teuthology.orchestra.run.smithi092.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.3 MB 00:00 2024-09-21T07:00:04.194 INFO:teuthology.orchestra.run.smithi169.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T07:00:04.219 INFO:teuthology.orchestra.run.smithi169.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-21T07:00:04.242 INFO:teuthology.orchestra.run.smithi092.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 775 kB/s | 45 kB 00:00 2024-09-21T07:00:04.244 INFO:teuthology.orchestra.run.smithi169.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-21T07:00:04.345 INFO:teuthology.orchestra.run.smithi169.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-21T07:00:04.420 INFO:teuthology.orchestra.run.smithi169.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-21T07:00:04.462 INFO:teuthology.orchestra.run.smithi169.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-09-21T07:00:04.487 INFO:teuthology.orchestra.run.smithi169.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T07:00:04.521 INFO:teuthology.orchestra.run.smithi169.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-21T07:00:04.563 INFO:teuthology.orchestra.run.smithi169.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T07:00:04.588 INFO:teuthology.orchestra.run.smithi169.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T07:00:04.626 INFO:teuthology.orchestra.run.smithi092.stdout:(20/157): ceph-test-19.3.0-5120.g18432218.el9.x 23 MB/s | 40 MB 00:01 2024-09-21T07:00:04.630 INFO:teuthology.orchestra.run.smithi169.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T07:00:04.659 INFO:teuthology.orchestra.run.smithi092.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 356 kB/s | 148 kB 00:00 2024-09-21T07:00:04.685 INFO:teuthology.orchestra.run.smithi092.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T07:00:04.705 INFO:teuthology.orchestra.run.smithi169.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-21T07:00:04.727 INFO:teuthology.orchestra.run.smithi092.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 4.7 MB/s | 321 kB 00:00 2024-09-21T07:00:04.730 INFO:teuthology.orchestra.run.smithi169.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T07:00:04.739 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-21T07:00:04.740 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-21T07:00:04.752 INFO:teuthology.orchestra.run.smithi092.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T07:00:04.764 INFO:teuthology.orchestra.run.smithi169.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-21T07:00:04.777 INFO:teuthology.orchestra.run.smithi092.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T07:00:04.790 INFO:teuthology.orchestra.run.smithi169.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 433 kB/s | 26 kB 00:00 2024-09-21T07:00:04.803 INFO:teuthology.orchestra.run.smithi092.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T07:00:04.815 INFO:teuthology.orchestra.run.smithi169.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-21T07:00:04.848 INFO:teuthology.orchestra.run.smithi169.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T07:00:04.853 INFO:teuthology.orchestra.run.smithi092.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T07:00:04.874 INFO:teuthology.orchestra.run.smithi169.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-21T07:00:04.895 INFO:teuthology.orchestra.run.smithi092.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 825 kB/s | 34 kB 00:00 2024-09-21T07:00:04.945 INFO:teuthology.orchestra.run.smithi092.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T07:00:04.949 INFO:teuthology.orchestra.run.smithi169.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T07:00:04.974 INFO:teuthology.orchestra.run.smithi169.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-21T07:00:05.000 INFO:teuthology.orchestra.run.smithi169.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T07:00:05.004 INFO:teuthology.orchestra.run.smithi092.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 14 MB/s | 3.1 MB 00:00 2024-09-21T07:00:05.042 INFO:teuthology.orchestra.run.smithi169.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-21T07:00:05.067 INFO:teuthology.orchestra.run.smithi169.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 634 kB/s | 42 kB 00:00 2024-09-21T07:00:05.092 INFO:teuthology.orchestra.run.smithi169.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T07:00:05.117 INFO:teuthology.orchestra.run.smithi169.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T07:00:05.151 INFO:teuthology.orchestra.run.smithi169.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-21T07:00:05.177 INFO:teuthology.orchestra.run.smithi169.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 870 kB/s | 51 kB 00:00 2024-09-21T07:00:05.194 INFO:teuthology.orchestra.run.smithi169.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 54 kB 00:00 2024-09-21T07:00:05.277 INFO:teuthology.orchestra.run.smithi169.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T07:00:05.302 INFO:teuthology.orchestra.run.smithi169.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-21T07:00:05.328 INFO:teuthology.orchestra.run.smithi169.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-21T07:00:05.353 INFO:teuthology.orchestra.run.smithi169.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T07:00:05.378 INFO:teuthology.orchestra.run.smithi169.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-21T07:00:05.404 INFO:teuthology.orchestra.run.smithi169.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-21T07:00:05.437 INFO:teuthology.orchestra.run.smithi169.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T07:00:05.462 INFO:teuthology.orchestra.run.smithi169.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-09-21T07:00:05.488 INFO:teuthology.orchestra.run.smithi169.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T07:00:05.513 INFO:teuthology.orchestra.run.smithi169.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T07:00:05.529 INFO:teuthology.orchestra.run.smithi092.stdout:(31/157): ceph-mgr-dashboard-19.3.0-5120.g18432 24 MB/s | 14 MB 00:00 2024-09-21T07:00:05.530 INFO:teuthology.orchestra.run.smithi169.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-21T07:00:05.597 INFO:teuthology.orchestra.run.smithi169.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-09-21T07:00:05.613 INFO:teuthology.orchestra.run.smithi092.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-21T07:00:05.638 INFO:teuthology.orchestra.run.smithi092.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.6 MB/s | 292 kB 00:00 2024-09-21T07:00:05.663 INFO:teuthology.orchestra.run.smithi092.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 986 kB/s | 49 kB 00:00 2024-09-21T07:00:05.664 INFO:teuthology.orchestra.run.smithi169.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-21T07:00:05.688 INFO:teuthology.orchestra.run.smithi092.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T07:00:05.697 INFO:teuthology.orchestra.run.smithi169.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T07:00:05.722 INFO:teuthology.orchestra.run.smithi092.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 4.7 MB/s | 285 kB 00:00 2024-09-21T07:00:05.723 INFO:teuthology.orchestra.run.smithi169.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-09-21T07:00:05.756 INFO:teuthology.orchestra.run.smithi092.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 11 MB/s | 784 kB 00:00 2024-09-21T07:00:05.756 INFO:teuthology.orchestra.run.smithi169.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-21T07:00:05.783 INFO:teuthology.orchestra.run.smithi092.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 315 kB/s | 18 kB 00:00 2024-09-21T07:00:05.807 INFO:teuthology.orchestra.run.smithi169.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-09-21T07:00:05.832 INFO:teuthology.orchestra.run.smithi169.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T07:00:05.859 INFO:teuthology.orchestra.run.smithi169.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-21T07:00:05.902 INFO:teuthology.orchestra.run.smithi169.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-21T07:00:05.950 INFO:teuthology.orchestra.run.smithi092.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-21T07:00:05.995 INFO:teuthology.orchestra.run.smithi169.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-21T07:00:06.018 INFO:teuthology.orchestra.run.smithi169.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-21T07:00:06.042 INFO:teuthology.orchestra.run.smithi169.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T07:00:06.065 INFO:teuthology.orchestra.run.smithi092.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-21T07:00:06.084 INFO:teuthology.orchestra.run.smithi169.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-21T07:00:06.107 INFO:teuthology.orchestra.run.smithi092.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-21T07:00:06.109 INFO:teuthology.orchestra.run.smithi169.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 482 kB/s | 32 kB 00:00 2024-09-21T07:00:06.134 INFO:teuthology.orchestra.run.smithi169.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T07:00:06.160 INFO:teuthology.orchestra.run.smithi169.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T07:00:06.193 INFO:teuthology.orchestra.run.smithi169.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T07:00:06.207 INFO:teuthology.orchestra.run.smithi092.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-21T07:00:06.219 INFO:teuthology.orchestra.run.smithi169.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T07:00:06.241 INFO:teuthology.orchestra.run.smithi092.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-09-21T07:00:06.244 INFO:teuthology.orchestra.run.smithi169.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T07:00:06.269 INFO:teuthology.orchestra.run.smithi169.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T07:00:06.274 INFO:teuthology.orchestra.run.smithi092.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T07:00:06.295 INFO:teuthology.orchestra.run.smithi169.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T07:00:06.316 INFO:teuthology.orchestra.run.smithi092.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-21T07:00:06.320 INFO:teuthology.orchestra.run.smithi169.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T07:00:06.342 INFO:teuthology.orchestra.run.smithi092.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-21T07:00:06.345 INFO:teuthology.orchestra.run.smithi169.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-21T07:00:06.370 INFO:teuthology.orchestra.run.smithi169.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-21T07:00:06.384 INFO:teuthology.orchestra.run.smithi092.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-21T07:00:06.396 INFO:teuthology.orchestra.run.smithi169.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-21T07:00:06.571 INFO:teuthology.orchestra.run.smithi169.stdout:(129/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-21T07:00:06.613 INFO:teuthology.orchestra.run.smithi169.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-09-21T07:00:06.638 INFO:teuthology.orchestra.run.smithi169.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T07:00:06.664 INFO:teuthology.orchestra.run.smithi169.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T07:00:06.697 INFO:teuthology.orchestra.run.smithi169.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-09-21T07:00:06.723 INFO:teuthology.orchestra.run.smithi169.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-21T07:00:06.764 INFO:teuthology.orchestra.run.smithi169.stdout:(135/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-21T07:00:06.790 INFO:teuthology.orchestra.run.smithi169.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-21T07:00:06.815 INFO:teuthology.orchestra.run.smithi169.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 559 kB/s | 28 kB 00:00 2024-09-21T07:00:06.840 INFO:teuthology.orchestra.run.smithi169.stdout:(138/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-21T07:00:06.857 INFO:teuthology.orchestra.run.smithi169.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 737 kB/s | 31 kB 00:00 2024-09-21T07:00:06.867 INFO:teuthology.orchestra.run.smithi092.stdout:(48/157): ceph-common-19.3.0-5120.g18432218.el9 3.4 MB/s | 20 MB 00:05 2024-09-21T07:00:06.874 INFO:teuthology.orchestra.run.smithi169.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-21T07:00:06.891 INFO:teuthology.orchestra.run.smithi169.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-21T07:00:06.917 INFO:teuthology.orchestra.run.smithi169.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T07:00:06.942 INFO:teuthology.orchestra.run.smithi169.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-21T07:00:06.977 INFO:teuthology.orchestra.run.smithi169.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-21T07:00:07.002 INFO:teuthology.orchestra.run.smithi169.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 809 kB/s | 20 kB 00:00 2024-09-21T07:00:07.036 INFO:teuthology.orchestra.run.smithi169.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-21T07:00:07.110 INFO:teuthology.orchestra.run.smithi169.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-21T07:00:07.136 INFO:teuthology.orchestra.run.smithi169.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.1 MB/s | 427 kB 00:00 2024-09-21T07:00:07.159 INFO:teuthology.orchestra.run.smithi092.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 843 kB/s | 689 kB 00:00 2024-09-21T07:00:07.187 INFO:teuthology.orchestra.run.smithi169.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-21T07:00:07.234 INFO:teuthology.orchestra.run.smithi092.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-21T07:00:07.268 INFO:teuthology.orchestra.run.smithi092.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-21T07:00:07.327 INFO:teuthology.orchestra.run.smithi092.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-21T07:00:07.370 INFO:teuthology.orchestra.run.smithi169.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T07:00:07.377 INFO:teuthology.orchestra.run.smithi092.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-21T07:00:07.402 INFO:teuthology.orchestra.run.smithi092.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-21T07:00:07.486 INFO:teuthology.orchestra.run.smithi092.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-21T07:00:07.511 INFO:teuthology.orchestra.run.smithi092.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-21T07:00:07.537 INFO:teuthology.orchestra.run.smithi169.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.9 MB/s | 3.2 MB 00:00 2024-09-21T07:00:07.611 INFO:teuthology.orchestra.run.smithi092.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-21T07:00:07.637 INFO:teuthology.orchestra.run.smithi092.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-21T07:00:07.687 INFO:teuthology.orchestra.run.smithi169.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 273 kB/s | 41 kB 00:00 2024-09-21T07:00:07.720 INFO:teuthology.orchestra.run.smithi092.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-21T07:00:07.838 INFO:teuthology.orchestra.run.smithi169.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.6 MB/s | 249 kB 00:00 2024-09-21T07:00:07.845 INFO:teuthology.orchestra.run.smithi092.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-21T07:00:07.896 INFO:teuthology.orchestra.run.smithi169.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.3 MB/s | 2.3 MB 00:00 2024-09-21T07:00:07.938 INFO:teuthology.orchestra.run.smithi169.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.2 MB/s | 1.8 MB 00:00 2024-09-21T07:00:07.954 INFO:teuthology.orchestra.run.smithi092.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-21T07:00:08.004 INFO:teuthology.orchestra.run.smithi092.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 2.0 MB/s | 581 kB 00:00 2024-09-21T07:00:08.047 INFO:teuthology.orchestra.run.smithi169.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 1.4 MB 00:00 2024-09-21T07:00:08.055 INFO:teuthology.orchestra.run.smithi092.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-09-21T07:00:08.122 INFO:teuthology.orchestra.run.smithi092.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T07:00:08.172 INFO:teuthology.orchestra.run.smithi092.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T07:00:08.231 INFO:teuthology.orchestra.run.smithi092.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-21T07:00:09.064 INFO:teuthology.orchestra.run.smithi169.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-21T07:00:09.070 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:00:09.070 INFO:teuthology.orchestra.run.smithi169.stdout:Total 21 MB/s | 228 MB 00:10 2024-09-21T07:00:09.556 INFO:teuthology.orchestra.run.smithi092.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.3 MB/s | 3.0 MB 00:02 2024-09-21T07:00:10.297 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-09-21T07:00:10.451 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-09-21T07:00:10.451 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-09-21T07:00:10.548 INFO:teuthology.orchestra.run.smithi092.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-21T07:00:10.740 INFO:teuthology.orchestra.run.smithi092.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 4.4 MB 00:02 2024-09-21T07:00:11.023 INFO:teuthology.orchestra.run.smithi092.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 485 kB/s | 137 kB 00:00 2024-09-21T07:00:11.048 INFO:teuthology.orchestra.run.smithi092.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 1.8 MB/s | 910 kB 00:00 2024-09-21T07:00:11.129 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-21T07:00:11.157 INFO:teuthology.orchestra.run.smithi092.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 1.7 MB/s | 4.9 MB 00:02 2024-09-21T07:00:11.204 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:00:11.243 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:00:11.305 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:00:11.346 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:00:11.371 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:00:11.374 INFO:teuthology.orchestra.run.smithi092.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 404 kB/s | 87 kB 00:00 2024-09-21T07:00:11.422 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:00:11.582 INFO:teuthology.orchestra.run.smithi092.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-09-21T07:00:11.691 INFO:teuthology.orchestra.run.smithi092.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-21T07:00:11.771 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:00:11.816 INFO:teuthology.orchestra.run.smithi092.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-21T07:00:11.881 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:00:11.933 INFO:teuthology.orchestra.run.smithi092.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-21T07:00:12.007 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:00:12.040 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:00:12.083 INFO:teuthology.orchestra.run.smithi092.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 171 kB/s | 26 kB 00:00 2024-09-21T07:00:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:00:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:00:12.184 INFO:teuthology.orchestra.run.smithi092.stdout:(79/157): python3-babel-2.9.1-2.el9.noarch.rpm 7.4 MB/s | 6.0 MB 00:00 2024-09-21T07:00:12.199 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:00:12.209 INFO:teuthology.orchestra.run.smithi092.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-09-21T07:00:12.326 INFO:teuthology.orchestra.run.smithi092.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-21T07:00:12.351 INFO:teuthology.orchestra.run.smithi092.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 245 kB/s | 35 kB 00:00 2024-09-21T07:00:12.386 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:00:12.426 INFO:teuthology.orchestra.run.smithi092.stdout:(83/157): postgresql-server-13.16-1.el9.x86_64. 4.1 MB/s | 5.8 MB 00:01 2024-09-21T07:00:12.442 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:00:12.468 INFO:teuthology.orchestra.run.smithi092.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T07:00:12.470 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:00:12.543 INFO:teuthology.orchestra.run.smithi092.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T07:00:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:00:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:00:12.619 INFO:teuthology.orchestra.run.smithi092.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-21T07:00:12.644 INFO:teuthology.orchestra.run.smithi092.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 440 kB/s | 77 kB 00:00 2024-09-21T07:00:12.669 INFO:teuthology.orchestra.run.smithi092.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 336 kB/s | 42 kB 00:00 2024-09-21T07:00:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:00:12.697 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-09-21T07:00:12.699 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-09-21T07:00:12.705 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:00:12.732 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:00:12.736 INFO:teuthology.orchestra.run.smithi092.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-09-21T07:00:12.761 INFO:teuthology.orchestra.run.smithi092.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T07:00:12.787 INFO:teuthology.orchestra.run.smithi092.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-21T07:00:12.845 INFO:teuthology.orchestra.run.smithi092.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-09-21T07:00:12.871 INFO:teuthology.orchestra.run.smithi092.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 493 kB/s | 54 kB 00:00 2024-09-21T07:00:12.924 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:00:12.963 INFO:teuthology.orchestra.run.smithi092.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 355 kB/s | 42 kB 00:00 2024-09-21T07:00:12.988 INFO:teuthology.orchestra.run.smithi092.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 377 kB/s | 44 kB 00:00 2024-09-21T07:00:13.087 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:00:13.114 INFO:teuthology.orchestra.run.smithi092.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-09-21T07:00:13.139 INFO:teuthology.orchestra.run.smithi092.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 238 kB/s | 36 kB 00:00 2024-09-21T07:00:13.220 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:00:13.222 INFO:teuthology.orchestra.run.smithi092.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 440 kB/s | 47 kB 00:00 2024-09-21T07:00:13.256 INFO:teuthology.orchestra.run.smithi092.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-21T07:00:13.331 INFO:teuthology.orchestra.run.smithi092.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 532 kB/s | 58 kB 00:00 2024-09-21T07:00:13.346 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:00:13.365 INFO:teuthology.orchestra.run.smithi092.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 882 kB/s | 96 kB 00:00 2024-09-21T07:00:13.421 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:00:13.540 INFO:teuthology.orchestra.run.smithi092.stdout:(102/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-21T07:00:13.557 INFO:teuthology.orchestra.run.smithi092.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 233 kB/s | 45 kB 00:00 2024-09-21T07:00:13.574 INFO:teuthology.orchestra.run.smithi092.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 263 kB/s | 64 kB 00:00 2024-09-21T07:00:13.624 INFO:teuthology.orchestra.run.smithi092.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T07:00:13.641 INFO:teuthology.orchestra.run.smithi092.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-21T07:00:13.650 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:00:13.666 INFO:teuthology.orchestra.run.smithi092.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-21T07:00:13.709 INFO:teuthology.orchestra.run.smithi092.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.6 MB/s | 863 kB 00:00 2024-09-21T07:00:13.742 INFO:teuthology.orchestra.run.smithi092.stdout:(109/157): grpc-data-1.46.7-10.el9.noarch.rpm 193 kB/s | 19 kB 00:00 2024-09-21T07:00:13.758 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:00:13.775 INFO:teuthology.orchestra.run.smithi092.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 399 kB/s | 26 kB 00:00 2024-09-21T07:00:13.798 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:00:13.800 INFO:teuthology.orchestra.run.smithi092.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 861 kB/s | 49 kB 00:00 2024-09-21T07:00:13.826 INFO:teuthology.orchestra.run.smithi092.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T07:00:13.834 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:00:13.851 INFO:teuthology.orchestra.run.smithi092.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-21T07:00:13.902 INFO:teuthology.orchestra.run.smithi092.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-21T07:00:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:00:13.935 INFO:teuthology.orchestra.run.smithi092.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-21T07:00:13.960 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:00:13.960 INFO:teuthology.orchestra.run.smithi092.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-09-21T07:00:13.985 INFO:teuthology.orchestra.run.smithi092.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 644 kB/s | 32 kB 00:00 2024-09-21T07:00:13.993 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:00:14.011 INFO:teuthology.orchestra.run.smithi092.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T07:00:14.035 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:00:14.044 INFO:teuthology.orchestra.run.smithi092.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T07:00:14.077 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:00:14.078 INFO:teuthology.orchestra.run.smithi092.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T07:00:14.105 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:00:14.137 INFO:teuthology.orchestra.run.smithi092.stdout:(121/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.5 MB/s | 4.4 MB 00:00 2024-09-21T07:00:14.162 INFO:teuthology.orchestra.run.smithi092.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-09-21T07:00:14.172 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:00:14.187 INFO:teuthology.orchestra.run.smithi092.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.0 MB/s | 220 kB 00:00 2024-09-21T07:00:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-21T07:00:14.226 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:00:14.246 INFO:teuthology.orchestra.run.smithi092.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 181 kB/s | 11 kB 00:00 2024-09-21T07:00:14.266 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:00:14.272 INFO:teuthology.orchestra.run.smithi092.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-21T07:00:14.297 INFO:teuthology.orchestra.run.smithi092.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-21T07:00:14.318 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:00:14.322 INFO:teuthology.orchestra.run.smithi092.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-21T07:00:14.347 INFO:teuthology.orchestra.run.smithi092.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-21T07:00:14.373 INFO:teuthology.orchestra.run.smithi092.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T07:00:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:00:14.398 INFO:teuthology.orchestra.run.smithi092.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T07:00:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:00:14.431 INFO:teuthology.orchestra.run.smithi092.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-21T07:00:14.472 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:00:14.474 INFO:teuthology.orchestra.run.smithi092.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-09-21T07:00:14.500 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:00:14.507 INFO:teuthology.orchestra.run.smithi092.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-21T07:00:14.541 INFO:teuthology.orchestra.run.smithi092.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-09-21T07:00:14.566 INFO:teuthology.orchestra.run.smithi092.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T07:00:14.569 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:00:14.591 INFO:teuthology.orchestra.run.smithi092.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-21T07:00:14.615 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:00:14.616 INFO:teuthology.orchestra.run.smithi092.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-21T07:00:14.642 INFO:teuthology.orchestra.run.smithi092.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T07:00:14.667 INFO:teuthology.orchestra.run.smithi092.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T07:00:14.689 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:00:14.692 INFO:teuthology.orchestra.run.smithi092.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-21T07:00:14.718 INFO:teuthology.orchestra.run.smithi092.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T07:00:14.751 INFO:teuthology.orchestra.run.smithi092.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-21T07:00:14.802 INFO:teuthology.orchestra.run.smithi092.stdout:(144/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-21T07:00:14.827 INFO:teuthology.orchestra.run.smithi092.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-21T07:00:14.828 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:00:14.844 INFO:teuthology.orchestra.run.smithi092.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-09-21T07:00:14.869 INFO:teuthology.orchestra.run.smithi092.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T07:00:14.883 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:00:14.894 INFO:teuthology.orchestra.run.smithi092.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-21T07:00:14.945 INFO:teuthology.orchestra.run.smithi092.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T07:00:15.170 INFO:teuthology.orchestra.run.smithi092.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-21T07:00:15.228 INFO:teuthology.orchestra.run.smithi092.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 9.4 MB/s | 3.4 MB 00:00 2024-09-21T07:00:15.321 INFO:teuthology.orchestra.run.smithi092.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 6.2 MB/s | 2.3 MB 00:00 2024-09-21T07:00:15.388 INFO:teuthology.orchestra.run.smithi092.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.7 MB/s | 249 kB 00:00 2024-09-21T07:00:15.395 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:00:15.412 INFO:teuthology.orchestra.run.smithi092.stdout:(154/157): NetworkManager-team-1.51.0-1.el9.x86 222 kB/s | 41 kB 00:00 2024-09-21T07:00:15.471 INFO:teuthology.orchestra.run.smithi092.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-21T07:00:15.487 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:00:15.525 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:00:15.568 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:00:15.580 INFO:teuthology.orchestra.run.smithi092.stdout:(156/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.4 MB/s | 1.8 MB 00:00 2024-09-21T07:00:15.606 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:00:15.648 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:00:15.688 INFO:teuthology.orchestra.run.smithi092.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.7 MB/s | 2.4 MB 00:00 2024-09-21T07:00:15.694 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:00:15.694 INFO:teuthology.orchestra.run.smithi092.stdout:Total 15 MB/s | 228 MB 00:15 2024-09-21T07:00:15.793 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:00:15.850 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:00:15.948 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:00:16.022 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:00:16.095 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:00:16.127 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:00:16.163 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:00:16.209 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:00:16.245 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:00:16.289 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:00:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:00:16.472 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:00:16.516 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:00:16.791 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:00:16.890 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-21T07:00:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:00:16.942 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:00:16.990 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:00:17.031 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:00:17.044 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-21T07:00:17.044 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-21T07:00:17.056 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:00:17.154 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:00:17.284 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:00:17.325 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:00:17.359 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:00:17.395 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:00:17.434 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:00:17.466 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:00:17.496 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:00:17.538 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:00:17.572 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:00:17.613 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:00:17.648 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:00:17.734 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:00:17.778 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:00:17.810 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:00:17.911 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:00:17.969 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:00:18.682 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:00:18.741 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:00:18.774 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:00:18.880 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:00:18.937 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:00:18.990 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:00:19.037 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-09-21T07:00:19.077 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:00:19.127 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:00:19.184 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:00:19.309 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:00:19.349 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:00:19.377 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:00:19.427 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:00:19.436 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-21T07:00:19.436 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-21T07:00:19.500 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:00:19.535 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:00:19.560 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:00:19.611 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:00:20.026 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:00:20.063 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:00:20.086 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:00:20.179 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:00:20.213 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:00:20.254 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:00:20.346 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:00:20.375 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:00:20.409 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:00:20.591 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:00:20.648 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:00:20.676 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:00:20.765 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:00:20.793 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:00:20.856 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:00:20.886 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:00:20.910 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:00:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:00:21.285 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:00:21.410 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:00:21.415 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:00:21.502 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:00:21.523 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:00:21.530 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:00:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:00:21.603 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:00:21.858 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:00:21.898 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:00:21.943 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:00:21.975 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:00:22.007 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:00:22.034 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:00:22.041 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:00:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:00:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:00:22.114 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:00:22.159 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:00:22.192 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:00:22.235 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:00:22.268 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:00:22.295 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:00:22.373 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:00:22.434 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:00:22.465 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:00:22.509 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:00:22.590 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:00:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:00:22.619 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:00:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:00:22.662 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:00:22.691 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:00:22.716 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:00:22.747 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:00:22.761 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:00:22.814 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:00:22.898 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:00:23.039 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:00:23.092 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:00:23.621 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:00:23.705 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:00:23.733 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:00:23.777 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:00:23.814 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:00:23.856 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:00:24.014 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:00:24.076 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:00:24.177 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:00:24.248 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:00:24.322 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:00:24.352 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:00:24.389 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:00:24.435 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:00:24.580 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:00:24.716 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:00:24.758 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:00:24.896 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:00:24.934 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:00:24.975 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:00:25.094 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:00:25.129 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:00:25.170 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:00:25.202 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:00:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:00:25.327 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:00:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:00:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:00:25.454 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:00:25.501 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:00:25.529 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:00:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:00:25.602 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:00:25.634 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:00:25.664 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:00:25.698 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:00:25.732 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:00:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:00:25.796 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-21T07:00:25.816 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:00:25.900 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:00:25.911 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:00:25.955 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:00:25.959 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:00:25.986 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:00:25.999 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:00:26.005 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:00:26.088 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:00:26.088 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:00:26.088 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:00:26.088 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:26.089 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:00:26.101 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:00:26.131 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:00:26.137 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:00:26.142 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:00:26.168 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:00:26.220 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:00:26.569 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:00:26.693 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:00:26.820 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:00:26.853 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:00:26.880 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:00:26.936 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:00:26.961 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:00:26.969 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:00:26.991 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:00:27.021 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:00:27.071 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:00:27.133 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:00:27.178 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:00:27.204 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:00:27.263 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:00:27.266 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:00:27.291 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:00:27.305 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:00:27.397 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:00:27.426 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:00:27.490 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:00:27.490 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:00:27.518 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:00:27.528 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:00:27.541 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:00:27.606 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:00:27.710 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:00:27.890 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:00:28.018 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:00:28.125 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:00:28.184 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:00:28.256 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:00:28.407 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:00:28.409 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:00:28.513 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:00:28.564 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:00:28.597 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:00:28.670 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:00:28.724 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:00:28.756 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:00:28.799 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:00:28.833 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:00:28.860 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:00:28.929 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:00:28.999 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:00:29.030 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:00:29.082 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:00:29.162 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:00:29.200 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:00:29.244 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:00:29.272 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:00:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:00:29.387 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:00:29.461 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:00:29.593 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:00:29.658 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:00:29.669 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:00:29.775 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:00:29.803 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:00:29.836 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:00:30.170 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:00:30.183 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:00:30.224 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:00:30.259 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:00:30.297 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:00:30.315 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:00:30.346 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:00:30.349 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:00:30.382 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:00:30.386 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:00:30.437 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:00:30.595 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:00:30.648 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:00:30.746 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:00:30.820 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:00:30.880 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:00:30.900 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:00:30.910 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:00:30.933 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:00:30.969 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:00:30.989 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:00:31.016 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:00:31.020 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:00:31.052 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:00:31.094 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:00:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:00:31.271 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:00:31.314 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:00:31.355 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:00:31.483 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:00:31.492 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:00:31.550 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:00:31.583 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:00:31.607 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:00:31.708 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:00:31.832 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:00:31.864 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:00:31.893 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:00:31.926 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:00:31.974 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:00:32.005 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:00:32.036 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:00:32.078 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:00:32.111 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:00:32.153 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:00:32.188 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:00:32.273 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:00:32.318 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:00:32.349 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:00:32.450 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:00:32.508 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:00:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:00:33.278 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:00:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:00:33.309 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:00:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:00:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:00:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:00:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:00:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:00:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:00:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:00:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:00:33.880 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:00:33.920 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:00:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:00:34.011 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:00:34.011 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:00:34.011 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:00:34.011 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:34.063 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:00:34.588 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:00:34.703 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:00:35.961 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:00:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:00:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:00:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:00:36.488 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:00:36.543 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:00:36.633 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:00:36.663 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:00:36.707 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:00:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:00:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:00:37.315 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:00:37.337 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:00:38.082 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:00:38.082 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-09-21T07:00:38.082 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-09-21T07:00:38.082 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-09-21T07:00:38.083 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-09-21T07:00:38.083 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-09-21T07:00:38.083 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-09-21T07:00:38.083 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-09-21T07:00:38.083 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:38.259 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:00:38.275 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:00:38.275 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:38.275 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:00:38.275 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:39.600 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:00:39.635 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:00:39.817 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:00:39.845 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:00:39.845 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:39.845 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:00:39.845 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:00:39.845 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:00:39.845 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:00:40.092 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:00:40.092 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:40.092 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:00:40.092 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:00:40.092 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:00:40.092 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:40.215 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:00:40.439 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:00:40.561 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:00:40.584 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:00:40.584 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:40.584 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:00:40.585 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:00:40.585 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:00:40.585 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:40.682 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:00:40.739 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:00:40.796 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:00:40.796 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:00:40.796 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:00:40.796 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:00:40.802 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:00:40.889 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:00:40.987 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:00:41.036 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:00:41.112 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:00:41.209 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:00:41.347 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:00:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:00:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:00:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:00:41.906 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:00:41.938 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:00:41.968 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:00:42.038 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:00:42.059 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:00:45.214 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:00:45.272 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:00:46.144 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:00:46.144 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-09-21T07:00:46.144 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-09-21T07:00:46.144 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-09-21T07:00:46.144 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-09-21T07:00:46.144 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-09-21T07:00:46.144 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-09-21T07:00:46.144 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-09-21T07:00:46.144 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:46.228 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:00:46.256 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:00:46.317 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:00:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:00:46.332 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:46.332 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:00:46.332 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:46.368 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:00:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:00:46.558 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:00:46.582 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:00:46.582 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:46.582 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:00:46.582 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:00:46.583 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:00:46.583 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:46.633 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:00:46.645 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:00:46.743 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:00:46.799 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:00:47.782 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:00:47.819 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:00:47.843 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:00:47.843 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:47.843 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:00:47.844 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:00:47.844 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:00:47.844 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:47.886 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:00:47.892 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:00:47.910 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:00:47.910 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:47.910 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:00:47.910 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:47.918 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:00:47.918 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:47.919 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:00:47.919 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:00:47.919 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:00:47.919 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:47.962 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:00:47.985 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:00:47.985 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:47.986 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:00:47.986 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:00:47.986 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:00:47.986 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:48.151 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:00:48.174 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:00:48.175 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:48.304 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:00:48.328 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:00:48.328 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:48.328 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:00:48.328 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:00:48.328 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:00:48.328 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:00:48.643 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:00:48.666 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:00:48.667 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:48.667 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:00:48.667 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:00:48.667 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:00:48.667 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:48.774 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:00:48.830 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:00:48.895 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:00:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:00:49.136 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:00:49.231 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:00:49.327 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:00:49.469 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:00:49.519 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:00:49.551 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:00:49.588 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:00:49.988 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:00:50.019 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:00:50.052 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:00:50.126 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:00:50.151 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:00:52.370 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:00:52.407 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:00:52.447 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:00:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:00:52.507 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:00:52.680 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:00:52.681 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-09-21T07:00:52.681 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-09-21T07:00:52.681 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-09-21T07:00:52.681 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-09-21T07:00:52.681 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-09-21T07:00:52.681 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-09-21T07:00:52.681 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-09-21T07:00:52.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:00:52.714 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:00:52.754 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:00:52.784 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:00:52.814 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:00:52.851 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:00:52.860 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:00:52.866 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:00:52.867 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:52.867 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:00:52.867 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:00:53.362 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:00:53.432 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:00:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:00:53.516 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:00:53.536 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:00:54.350 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:00:54.392 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:00:54.424 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:00:54.428 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:00:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:00:54.478 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:00:54.505 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:00:54.505 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:54.505 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:00:54.505 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:00:54.505 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:00:54.506 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:00:54.538 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:00:54.579 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:00:54.615 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:00:54.640 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:00:54.666 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:00:54.666 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:00:54.715 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:00:54.730 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:00:54.743 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:00:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:00:54.750 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:00:54.752 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:00:54.752 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:54.752 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:00:54.752 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:00:54.753 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:00:54.753 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:00:54.766 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:00:54.767 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:54.767 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:00:54.767 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:00:54.767 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:00:54.767 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:54.810 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:00:54.822 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:00:54.842 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:00:54.867 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:00:54.872 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:00:54.872 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:00:54.920 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:00:54.987 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:00:55.061 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:00:55.061 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:00:55.145 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:00:55.210 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:00:55.222 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:00:55.245 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:00:55.245 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:55.245 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:00:55.245 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:00:55.246 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:00:55.246 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:00:55.352 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:00:55.400 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:00:55.455 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:00:55.647 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:00:55.697 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:00:55.767 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:00:55.855 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:00:55.944 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:00:55.971 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:00:55.995 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:56.003 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:00:56.046 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:00:56.047 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:00:56.070 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:56.079 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:00:56.107 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:00:56.122 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:00:56.145 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:00:56.146 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:56.146 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:00:56.146 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:00:56.146 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:00:56.146 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:56.465 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:00:56.488 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:00:56.488 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:00:56.488 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:00:56.488 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:00:56.489 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:00:56.489 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:00:56.558 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:00:56.589 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:00:56.621 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:00:56.687 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:00:56.711 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:00:59.902 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:00:59.967 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:01:00.528 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:01:00.568 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:01:00.609 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:01:00.649 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:01:00.685 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:01:00.891 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:01:00.927 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:01:00.932 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:01:00.962 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:01:00.967 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:01:00.992 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:01:01.029 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:01:01.255 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:01:01.294 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:01:01.318 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:01:01.319 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:01:01.319 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:01:01.319 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:01:01.319 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:01:01.319 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:01:01.370 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:01:01.382 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:01:01.489 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:01:01.541 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:01:01.602 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:01:01.644 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:01:01.664 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:01:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:01:01.745 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:01:01.746 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:01:01.747 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:01:01.748 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:01:01.749 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:01:01.750 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:01:01.751 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:01:01.752 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:01:01.753 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:01:01.754 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:01:01.755 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:01:01.756 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:01:01.756 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:01:01.756 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:01:01.756 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:01:01.756 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:01:01.756 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:01:01.756 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:01:02.502 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:01:02.564 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:01:02.564 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:01:02.564 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:01:02.564 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:01:02.564 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:01:02.564 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:01:02.564 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:01:02.564 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:01:02.582 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:01:02.607 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:01:02.629 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:01:02.630 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:01:02.630 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:01:02.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:01:02.630 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:01:02.674 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:01:02.697 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:01:02.697 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:01:02.697 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:01:02.697 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:01:02.697 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:01:02.697 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:01:02.729 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:01:02.760 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:01:02.786 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:01:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:01:02.812 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:01:02.904 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:01:02.980 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:01:03.004 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:01:03.010 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:01:03.024 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:01:03.047 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:01:03.048 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:01:03.048 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:01:03.048 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:01:03.048 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:01:03.048 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:01:03.199 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:01:03.199 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:01:03.283 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:01:03.349 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:01:04.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:01:04.331 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:01:04.331 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-09-21T07:01:04.331 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.332 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.333 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:01:04.334 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:01:04.335 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:01:04.336 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.337 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:01:04.338 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:01:04.339 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:01:04.340 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:01:04.341 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:01:04.342 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:01:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:01:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:01:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:01:04.343 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:01:04.343 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-21T07:01:04.755 DEBUG:teuthology.parallel:result is None 2024-09-21T07:01:07.071 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:01:07.111 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:01:07.152 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:01:07.184 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:01:07.219 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:01:07.438 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:01:07.491 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:01:07.521 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:01:07.550 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:01:07.606 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:01:08.216 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:01:08.253 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:01:08.273 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:01:09.087 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:01:09.182 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:01:09.234 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:01:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:01:09.369 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:01:09.394 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:01:09.420 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:01:09.420 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:01:09.504 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:01:09.504 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:01:09.588 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:01:09.621 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:01:09.626 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:01:09.626 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:01:09.815 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:01:09.815 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:01:09.876 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:01:09.876 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:01:09.877 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:01:09.878 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:01:09.879 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:01:09.890 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:01:09.890 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:01:09.890 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:01:09.890 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:01:09.890 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:01:09.890 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:01:09.890 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:01:09.890 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:01:09.890 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:01:09.890 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:01:09.891 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:01:09.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:01:09.893 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:01:09.894 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:01:09.895 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:01:09.896 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:01:09.897 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:01:09.898 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:01:09.899 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:01:09.900 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:01:09.900 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:01:09.900 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:01:09.900 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:01:09.900 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:01:09.900 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:01:09.900 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:01:09.900 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:01:09.901 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:01:09.964 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:01:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:01:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:01:12.349 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-09-21T07:01:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:12.349 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.351 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:01:12.352 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:01:12.353 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:01:12.354 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:01:12.355 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:01:12.356 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:01:12.357 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:01:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.359 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:01:12.360 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:01:12.361 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:01:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:01:12.362 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:01:12.362 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-21T07:01:12.815 DEBUG:teuthology.parallel:result is None 2024-09-21T07:01:16.466 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:01:16.466 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:01:16.467 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:01:16.468 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:01:16.469 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:01:16.479 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:01:16.479 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:01:16.479 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:01:16.480 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:01:16.481 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:01:16.482 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:01:16.483 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:01:16.484 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:01:16.485 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:01:16.486 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:01:16.486 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:01:16.486 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:01:16.486 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:01:16.486 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:01:16.486 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:01:16.486 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:01:16.486 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:01:16.486 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:01:16.487 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:01:16.488 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:01:16.489 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:01:16.490 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:01:16.490 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:01:16.490 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:01:16.490 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:01:16.490 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:01:16.490 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:01:16.490 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:01:16.490 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:01:16.490 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:01:19.113 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:01:19.113 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:01:19.113 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-09-21T07:01:19.113 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:19.113 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:19.113 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:19.114 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:01:19.114 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.114 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.114 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:01:19.114 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:01:19.114 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-21T07:01:19.114 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:01:19.114 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:01:19.115 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:01:19.115 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:01:19.115 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.115 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.115 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.115 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.115 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:19.115 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.115 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.116 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.116 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:19.116 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:19.116 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:19.116 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:19.116 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:19.116 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.116 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.117 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:19.117 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.117 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.117 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.117 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:19.117 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:19.117 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.117 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.117 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:01:19.118 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:01:19.118 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:01:19.118 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:01:19.118 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:01:19.118 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:01:19.118 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:01:19.118 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:01:19.118 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:01:19.118 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:01:19.119 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:01:19.119 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:01:19.119 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.119 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.119 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.119 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:01:19.119 INFO:teuthology.orchestra.run.smithi092.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:01:19.119 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:01:19.120 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:01:19.120 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:01:19.120 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:01:19.120 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.120 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.120 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:01:19.120 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.120 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:01:19.120 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:01:19.121 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:01:19.121 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:01:19.121 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:01:19.121 INFO:teuthology.orchestra.run.smithi092.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:01:19.121 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:01:19.121 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:01:19.121 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:01:19.121 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:01:19.121 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:01:19.122 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:01:19.122 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:01:19.122 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:01:19.122 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:01:19.122 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:01:19.122 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:01:19.122 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:01:19.122 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:01:19.123 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:01:19.123 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:01:19.123 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:01:19.123 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:01:19.123 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.123 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.123 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.123 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:01:19.124 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:01:19.125 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:01:19.126 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:01:19.126 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:01:19.126 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:01:19.126 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:01:19.126 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:01:19.126 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:01:19.126 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:01:19.126 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:01:19.127 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:01:19.127 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:01:19.127 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:01:19.127 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:01:19.127 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:01:19.127 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:01:19.127 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:01:19.128 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:01:19.129 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:01:19.130 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:01:19.130 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:01:19.130 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:01:19.130 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:01:19.130 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:01:19.130 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:01:19.130 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-21T07:01:19.558 DEBUG:teuthology.parallel:result is None 2024-09-21T07:01:19.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:01:19.704 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:01:19.727 INFO:teuthology.orchestra.run.smithi092.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:01:19.728 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:01:19.728 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:01:19.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:01:19.878 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:01:19.905 INFO:teuthology.orchestra.run.smithi169.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:01:19.905 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:01:19.905 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:01:19.907 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:01:20.052 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:01:20.079 INFO:teuthology.orchestra.run.smithi175.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:01:20.079 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:01:20.080 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:01:20.081 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T07:01:20.082 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:01:20.082 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:01:20.109 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T07:01:20.109 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:01:20.142 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T07:01:20.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:01:20.173 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T07:01:20.173 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:01:20.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:01:20.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:01:20.264 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T07:01:20.264 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:01:20.295 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:01:20.363 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T07:01:20.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:01:20.394 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:01:20.462 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T07:01:20.462 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:01:20.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:01:20.486 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:01:20.551 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T07:01:20.551 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:01:20.581 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:01:20.650 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T07:01:20.650 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:01:20.679 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:01:20.749 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T07:01:20.749 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:01:20.750 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:01:20.775 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:01:20.839 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T07:01:20.839 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:01:20.867 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:01:20.935 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T07:01:20.935 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:01:20.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:01:21.034 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T07:01:21.133 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T07:01:21.133 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:01:21.133 INFO:tasks.cephadm:Cluster fsid is 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:01:21.134 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T07:01:21.134 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.92', 'mon.b': '172.21.15.169', 'mon.c': '172.21.15.175'} 2024-09-21T07:01:21.134 INFO:tasks.cephadm:First mon is mon.a on smithi092 2024-09-21T07:01:21.134 INFO:tasks.cephadm:First mgr is x 2024-09-21T07:01:21.134 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T07:01:21.134 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname $(hostname -s) 2024-09-21T07:01:21.160 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname $(hostname -s) 2024-09-21T07:01:21.191 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname $(hostname -s) 2024-09-21T07:01:21.221 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T07:01:21.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:01:21.368 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T07:01:21.516 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:01:21.518 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T07:01:21.518 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T07:01:21.518 DEBUG:teuthology.orchestra.run.smithi092:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:01:22.039 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:01 /home/ubuntu/cephtest/cephadm 2024-09-21T07:01:22.040 DEBUG:teuthology.orchestra.run.smithi169:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:01:22.595 INFO:teuthology.orchestra.run.smithi169.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:01 /home/ubuntu/cephtest/cephadm 2024-09-21T07:01:22.595 DEBUG:teuthology.orchestra.run.smithi175:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:01:23.416 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:01 /home/ubuntu/cephtest/cephadm 2024-09-21T07:01:23.417 DEBUG:teuthology.orchestra.run.smithi092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:01:23.436 DEBUG:teuthology.orchestra.run.smithi169:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:01:23.456 DEBUG:teuthology.orchestra.run.smithi175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:01:23.490 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T07:01:23.490 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:01:23.492 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:01:23.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:01:25.035 INFO:teuthology.orchestra.run.smithi169.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:01:25.141 INFO:teuthology.orchestra.run.smithi175.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:01:25.177 INFO:teuthology.orchestra.run.smithi092.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:02:05.193 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-21T07:02:05.193 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:02:05.194 INFO:teuthology.orchestra.run.smithi175.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:02:05.194 INFO:teuthology.orchestra.run.smithi175.stdout: "repo_digests": [ 2024-09-21T07:02:05.194 INFO:teuthology.orchestra.run.smithi175.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:02:05.194 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-09-21T07:02:05.194 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-21T07:02:06.823 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-21T07:02:06.823 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:02:06.824 INFO:teuthology.orchestra.run.smithi169.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:02:06.824 INFO:teuthology.orchestra.run.smithi169.stdout: "repo_digests": [ 2024-09-21T07:02:06.824 INFO:teuthology.orchestra.run.smithi169.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:02:06.824 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-09-21T07:02:06.824 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-21T07:02:07.564 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:02:07.564 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:02:07.564 INFO:teuthology.orchestra.run.smithi092.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:02:07.564 INFO:teuthology.orchestra.run.smithi092.stdout: "repo_digests": [ 2024-09-21T07:02:07.564 INFO:teuthology.orchestra.run.smithi092.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:02:07.564 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:02:07.564 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:02:07.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph 2024-09-21T07:02:07.631 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph 2024-09-21T07:02:07.659 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph 2024-09-21T07:02:07.692 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /etc/ceph 2024-09-21T07:02:07.719 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /etc/ceph 2024-09-21T07:02:07.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /etc/ceph 2024-09-21T07:02:07.771 INFO:tasks.cephadm:Writing seed config... 2024-09-21T07:02:07.772 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T07:02:07.772 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T07:02:07.772 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T07:02:07.772 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T07:02:07.772 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T07:02:07.772 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T07:02:07.772 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T07:02:07.773 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T07:02:07.774 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T07:02:07.774 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T07:02:07.774 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T07:02:07.774 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:02:07.774 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T07:02:07.791 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4e9565c0-77e7-11ef-baf5-efdc52797490 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-09-21T07:02:07.791 DEBUG:teuthology.orchestra.run.smithi092:mon.a> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T07:02:07.833 DEBUG:teuthology.orchestra.run.smithi092:mgr.x> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T07:02:07.875 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T07:02:07.875 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.92 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:02:08.082 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:02:08.082 INFO:teuthology.orchestra.run.smithi092.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.92', '--skip-admin-label'] 2024-09-21T07:02:08.082 INFO:teuthology.orchestra.run.smithi092.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T07:02:08.082 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying podman|docker is present... 2024-09-21T07:02:08.118 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:02:08.118 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying lvm2 is present... 2024-09-21T07:02:08.118 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying time synchronization is in place... 2024-09-21T07:02:08.126 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T07:02:08.126 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T07:02:08.132 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T07:02:08.132 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-21T07:02:08.139 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout enabled 2024-09-21T07:02:08.146 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout active 2024-09-21T07:02:08.146 INFO:teuthology.orchestra.run.smithi092.stdout:Unit chronyd.service is enabled and running 2024-09-21T07:02:08.146 INFO:teuthology.orchestra.run.smithi092.stdout:Repeating the final host check... 2024-09-21T07:02:08.169 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:02:08.169 INFO:teuthology.orchestra.run.smithi092.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T07:02:08.169 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl is present 2024-09-21T07:02:08.169 INFO:teuthology.orchestra.run.smithi092.stdout:lvcreate is present 2024-09-21T07:02:08.176 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T07:02:08.176 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T07:02:08.182 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T07:02:08.182 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-21T07:02:08.189 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout enabled 2024-09-21T07:02:08.196 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout active 2024-09-21T07:02:08.196 INFO:teuthology.orchestra.run.smithi092.stdout:Unit chronyd.service is enabled and running 2024-09-21T07:02:08.196 INFO:teuthology.orchestra.run.smithi092.stdout:Host looks OK 2024-09-21T07:02:08.196 INFO:teuthology.orchestra.run.smithi092.stdout:Cluster fsid: 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:08.196 INFO:teuthology.orchestra.run.smithi092.stdout:Acquiring lock 140711595978368 on /run/cephadm/4e9565c0-77e7-11ef-baf5-efdc52797490.lock 2024-09-21T07:02:08.196 INFO:teuthology.orchestra.run.smithi092.stdout:Lock 140711595978368 acquired on /run/cephadm/4e9565c0-77e7-11ef-baf5-efdc52797490.lock 2024-09-21T07:02:08.197 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying IP 172.21.15.92 port 3300 ... 2024-09-21T07:02:08.197 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying IP 172.21.15.92 port 6789 ... 2024-09-21T07:02:08.197 INFO:teuthology.orchestra.run.smithi092.stdout:Base mon IP(s) is [172.21.15.92:3300, 172.21.15.92:6789], mon addrv is [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-09-21T07:02:08.200 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.92 metric 100 2024-09-21T07:02:08.200 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.92 metric 100 2024-09-21T07:02:08.203 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T07:02:08.203 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T07:02:08.203 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T07:02:08.205 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T07:02:08.205 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T07:02:08.205 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T07:02:08.205 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T07:02:08.206 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-21T07:02:08.206 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T07:02:08.206 INFO:teuthology.orchestra.run.smithi092.stdout:Mon IP `172.21.15.92` is in CIDR network `172.21.0.0/20` 2024-09-21T07:02:08.206 INFO:teuthology.orchestra.run.smithi092.stdout:Mon IP `172.21.15.92` is in CIDR network `172.21.0.0/20` 2024-09-21T07:02:08.206 INFO:teuthology.orchestra.run.smithi092.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T07:02:08.207 INFO:teuthology.orchestra.run.smithi092.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T07:02:08.207 INFO:teuthology.orchestra.run.smithi092.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:02:11.857 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T07:02:11.858 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:02:11.858 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T07:02:11.858 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T07:02:11.858 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T07:02:11.858 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T07:02:11.858 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T07:02:21.275 INFO:teuthology.orchestra.run.smithi092.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T07:02:21.275 INFO:teuthology.orchestra.run.smithi092.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T07:02:21.275 INFO:teuthology.orchestra.run.smithi092.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T07:02:22.213 INFO:teuthology.orchestra.run.smithi092.stdout:stat: stdout 167 167 2024-09-21T07:02:22.213 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial keys... 2024-09-21T07:02:23.135 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQB+b+5mCrtFIRAAHamHmF/4UvA24VraUm2YGA== 2024-09-21T07:02:23.957 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQB/b+5mexujGxAAfT4DoDCOyeiX1ivrg3saEg== 2024-09-21T07:02:24.888 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQCAb+5mWMb9EhAA2r3U96HGE8yXGWfQ50afYA== 2024-09-21T07:02:24.889 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial monmap... 2024-09-21T07:02:25.837 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T07:02:25.837 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T07:02:25.837 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:25.838 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T07:02:25.838 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool for a [v2:172.21.15.92:3300,v1:172.21.15.92:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T07:02:25.838 INFO:teuthology.orchestra.run.smithi092.stdout:setting min_mon_release = quincy 2024-09-21T07:02:25.838 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: set fsid to 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:25.838 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T07:02:25.838 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:02:25.838 INFO:teuthology.orchestra.run.smithi092.stdout:Creating mon... 2024-09-21T07:02:27.441 INFO:teuthology.orchestra.run.smithi092.stdout:create mon.a on 2024-09-21T07:02:27.649 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T07:02:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T07:02:28.011 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4e9565c0-77e7-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-4e9565c0-77e7-11ef-baf5-efdc52797490.target. 2024-09-21T07:02:28.011 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4e9565c0-77e7-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-4e9565c0-77e7-11ef-baf5-efdc52797490.target. 2024-09-21T07:02:28.251 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.a 2024-09-21T07:02:28.251 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T07:02:28.433 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4e9565c0-77e7-11ef-baf5-efdc52797490.target.wants/ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@.service. 2024-09-21T07:02:28.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:28 smithi092 podman[30600]: 2024-09-21 07:02:28.570764133 +0000 UTC m=+0.015822371 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:02:28.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:28 smithi092 podman[30600]: 2024-09-21 07:02:28.68999018 +0000 UTC m=+0.135048404 container create 0057d8ac8c5f96e8d11658002626661d585dfe2d36060eb1ce8a59f3beb21c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T07:02:28.954 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:28 smithi092 podman[30600]: 2024-09-21 07:02:28.900552317 +0000 UTC m=+0.345610542 container init 0057d8ac8c5f96e8d11658002626661d585dfe2d36060eb1ce8a59f3beb21c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T07:02:28.954 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:28 smithi092 podman[30600]: 2024-09-21 07:02:28.903668583 +0000 UTC m=+0.348726815 container start 0057d8ac8c5f96e8d11658002626661d585dfe2d36060eb1ce8a59f3beb21c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T07:02:28.982 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:02:28.982 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-21T07:02:28.989 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:02:28.989 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-21T07:02:28.989 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-21T07:02:28.989 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T07:02:28.990 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mon to start... 2024-09-21T07:02:28.990 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mon... 2024-09-21T07:02:29.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:28 smithi092 ceph-mon[30620]: mkfs 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:29.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:28 smithi092 ceph-mon[30620]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T07:02:29.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:28 smithi092 bash[30600]: 0057d8ac8c5f96e8d11658002626661d585dfe2d36060eb1ce8a59f3beb21c20 2024-09-21T07:02:29.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:28 smithi092 systemd[1]: Started Ceph mon.a for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:02:30.042 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T07:02:30.042 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: monmap epoch 1 2024-09-21T07:02:30.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:30.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: last_changed 2024-09-21T07:02:25.230849+0000 2024-09-21T07:02:30.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: created 2024-09-21T07:02:25.230849+0000 2024-09-21T07:02:30.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: min_mon_release 19 (squid) 2024-09-21T07:02:30.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: election_strategy: 1 2024-09-21T07:02:30.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-21T07:02:30.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: fsmap 2024-09-21T07:02:30.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T07:02:30.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: mgrmap e1: no daemons active 2024-09-21T07:02:30.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:29 smithi092 ceph-mon[30620]: from='client.? 172.21.15.92:0/1837844021' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T07:02:30.046 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout id: 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout services: 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.550865s) 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout data: 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T07:02:30.047 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T07:02:30.048 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:30.048 INFO:teuthology.orchestra.run.smithi092.stdout:mon is available 2024-09-21T07:02:30.048 INFO:teuthology.orchestra.run.smithi092.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T07:02:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:30 smithi092 ceph-mon[30620]: from='client.? 172.21.15.92:0/242172040' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T07:02:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:30 smithi092 ceph-mon[30620]: from='client.? 172.21.15.92:0/242172040' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T07:02:31.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:31.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T07:02:31.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout fsid = 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:31.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T07:02:31.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T07:02:31.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T07:02:31.130 INFO:teuthology.orchestra.run.smithi092.stdout:Generating new minimal ceph.conf... 2024-09-21T07:02:32.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:31 smithi092 ceph-mon[30620]: from='client.? 172.21.15.92:0/1352089905' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:32.216 INFO:teuthology.orchestra.run.smithi092.stdout:Restarting the monitor... 2024-09-21T07:02:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:32 smithi092 systemd[1]: Stopping Ceph mon.a for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:02:33.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:32 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a[30616]: 2024-09-21T07:02:32.782+0000 7f2697582640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:02:33.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:32 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a[30616]: 2024-09-21T07:02:32.782+0000 7f2697582640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T07:02:33.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:32 smithi092 podman[30863]: 2024-09-21 07:02:32.987804867 +0000 UTC m=+0.606280171 container died 0057d8ac8c5f96e8d11658002626661d585dfe2d36060eb1ce8a59f3beb21c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T07:02:33.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:33 smithi092 podman[30863]: 2024-09-21 07:02:33.307308187 +0000 UTC m=+0.925783489 container cleanup 0057d8ac8c5f96e8d11658002626661d585dfe2d36060eb1ce8a59f3beb21c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T07:02:33.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:33 smithi092 bash[30863]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a 2024-09-21T07:02:33.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:33 smithi092 podman[30875]: 2024-09-21 07:02:33.474688925 +0000 UTC m=+0.481819684 container remove 0057d8ac8c5f96e8d11658002626661d585dfe2d36060eb1ce8a59f3beb21c20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T07:02:34.011 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:33 smithi092 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T07:02:34.011 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:33 smithi092 systemd[1]: Stopped Ceph mon.a for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:02:34.011 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:33 smithi092 systemd[1]: Starting Ceph mon.a for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:02:34.011 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:33 smithi092 podman[30968]: 2024-09-21 07:02:33.794816571 +0000 UTC m=+0.016039719 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:02:34.011 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:33 smithi092 podman[30968]: 2024-09-21 07:02:33.900829582 +0000 UTC m=+0.122052779 container create a452205d9dca1fc95cf76ebe1064e6ef8940b953eb3303ac93afb3ed367da69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T07:02:34.184 INFO:teuthology.orchestra.run.smithi092.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T07:02:34.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 podman[30968]: 2024-09-21 07:02:34.103205033 +0000 UTC m=+0.324428176 container init a452205d9dca1fc95cf76ebe1064e6ef8940b953eb3303ac93afb3ed367da69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T07:02:34.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 podman[30968]: 2024-09-21 07:02:34.106290257 +0000 UTC m=+0.327513396 container start a452205d9dca1fc95cf76ebe1064e6ef8940b953eb3303ac93afb3ed367da69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T07:02:34.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T07:02:34.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T07:02:34.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: pidfile_write: ignore empty --pid-file 2024-09-21T07:02:34.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: load: jerasure load: lrc 2024-09-21T07:02:34.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: RocksDB version: 7.9.2 2024-09-21T07:02:34.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Git sha 0 2024-09-21T07:02:34.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T07:02:34.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: DB SUMMARY 2024-09-21T07:02:34.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: DB Session ID: 6UGUE4W2X6X5M6FLV5WP 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: CURRENT file: CURRENT 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94874 ; 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.error_if_exists: 0 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.create_if_missing: 0 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.paranoid_checks: 1 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.env: 0x55dd71cf1d60 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T07:02:34.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.info_log: 0x55dd76d93360 2024-09-21T07:02:34.365 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T07:02:34.366 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.statistics: (nil) 2024-09-21T07:02:34.366 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.use_fsync: 0 2024-09-21T07:02:34.366 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_log_file_size: 0 2024-09-21T07:02:34.366 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T07:02:34.366 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T07:02:34.366 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T07:02:34.366 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T07:02:34.366 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.allow_fallocate: 1 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.use_direct_reads: 0 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.db_log_dir: 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.wal_dir: 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T07:02:34.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.write_buffer_manager: 0x55dd76d97d60 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.unordered_write: 0 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T07:02:34.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.row_cache: None 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.wal_filter: None 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.two_write_queues: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.wal_compression: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.atomic_flush: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.log_readahead_size: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T07:02:34.369 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_background_jobs: 2 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_background_compactions: -1 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_subcompactions: 1 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T07:02:34.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_open_files: -1 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_background_flushes: -1 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Compression algorithms supported: 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: kZSTD supported: 0 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: kXpressCompression supported: 0 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: kBZip2Compression supported: 0 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: kLZ4Compression supported: 1 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: kZlibCompression supported: 1 2024-09-21T07:02:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: kSnappyCompression supported: 1 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.merge_operator: 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_filter: None 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dd76d92fa0) 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout: cache_index_and_filter_blocks: 1 2024-09-21T07:02:34.372 INFO:journalctl@ceph.mon.a.smithi092.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: pin_top_level_index_and_filter: 1 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_type: 0 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: data_block_index_type: 0 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_shortening: 1 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: checksum: 4 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: no_block_cache: 0 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache: 0x55dd72d57610 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_name: BinnedLRUCache 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_options: 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: capacity : 536870912 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: num_shard_bits : 4 2024-09-21T07:02:34.373 INFO:journalctl@ceph.mon.a.smithi092.stdout: strict_capacity_limit : 0 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: high_pri_pool_ratio: 0.000 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_compressed: (nil) 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: persistent_cache: (nil) 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_size: 4096 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_size_deviation: 10 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_restart_interval: 16 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_block_restart_interval: 1 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: metadata_block_size: 4096 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: partition_filters: 0 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: use_delta_encoding: 1 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: filter_policy: bloomfilter 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: whole_key_filtering: 1 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: verify_compression: 0 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: read_amp_bytes_per_bit: 0 2024-09-21T07:02:34.374 INFO:journalctl@ceph.mon.a.smithi092.stdout: format_version: 5 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout: enable_index_compression: 1 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_align: 0 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout: max_auto_readahead_size: 262144 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout: prepopulate_block_cache: 0 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout: initial_auto_readahead_size: 8192 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compression: NoCompression 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.num_levels: 7 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T07:02:34.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T07:02:34.376 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T07:02:34.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T07:02:34.378 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.inplace_update_support: 0 2024-09-21T07:02:34.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.bloom_locality: 0 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.max_successive_merges: 0 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.ttl: 2592000 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T07:02:34.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.enable_blob_files: false 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.min_blob_size: 0 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: aa0b5a3e-147b-4406-9cb8-60173d22d68a 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726902154141708, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T07:02:34.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726902154142908, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91105, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 283, "table_properties": {"data_size": 89153, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11603, "raw_average_key_size": 47, "raw_value_size": 82568, "raw_average_value_size": 341, "num_data_blocks": 12, "num_entries": 242, "num_filter_entries": 242, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726902154, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "aa0b5a3e-147b-4406-9cb8-60173d22d68a", "db_session_id": "6UGUE4W2X6X5M6FLV5WP", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726902154143006, "job": 1, "event": "recovery_finished"} 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dd76db6a80 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: DB pointer 0x55dd77b5c000 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** DB Stats ** 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:02:34.382 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** Compaction Stats [default] ** 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: L0 2/0 90.83 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: Sum 2/0 90.83 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** Compaction Stats [default] ** 2024-09-21T07:02:34.383 INFO:journalctl@ceph.mon.a.smithi092.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 129.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative compaction: 0.00 GB write, 25.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval compaction: 0.00 GB write, 25.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:02:34.384 INFO:journalctl@ceph.mon.a.smithi092.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout: Block cache BinnedLRUCache@0x55dd72d57610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: starting mon.a rank 0 at public addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] at bind addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: mon.a@-1(???) e1 preinit fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: mon.a@-1(???).mds e1 new map 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: mon.a@-1(???).mds e1 print_map 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout: e1 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout: btime 2024-09-21T07:02:28:950840+0000 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout: legacy client fscid: -1 2024-09-21T07:02:34.385 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout: No filesystems configured 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 bash[30968]: a452205d9dca1fc95cf76ebe1064e6ef8940b953eb3303ac93afb3ed367da69e 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 systemd[1]: Started Ceph mon.a for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: monmap epoch 1 2024-09-21T07:02:34.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:34.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: last_changed 2024-09-21T07:02:25.230849+0000 2024-09-21T07:02:34.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: created 2024-09-21T07:02:25.230849+0000 2024-09-21T07:02:34.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: min_mon_release 19 (squid) 2024-09-21T07:02:34.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: election_strategy: 1 2024-09-21T07:02:34.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-21T07:02:34.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: fsmap 2024-09-21T07:02:34.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T07:02:34.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:34 smithi092 ceph-mon[30987]: mgrmap e1: no daemons active 2024-09-21T07:02:35.213 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T07:02:35.235 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:02:35.235 INFO:teuthology.orchestra.run.smithi092.stdout:Creating mgr... 2024-09-21T07:02:35.235 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T07:02:35.236 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T07:02:35.485 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.x 2024-09-21T07:02:35.485 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T07:02:35.642 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4e9565c0-77e7-11ef-baf5-efdc52797490.target.wants/ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@.service. 2024-09-21T07:02:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:35 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/523328607' entity='client.admin' 2024-09-21T07:02:36.196 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:02:36.196 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-21T07:02:36.203 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:02:36.203 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-21T07:02:36.203 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-21T07:02:36.203 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T07:02:36.213 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:02:36.213 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-21T07:02:36.219 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:02:36.220 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-21T07:02:36.220 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-21T07:02:36.220 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T07:02:36.220 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr to start... 2024-09-21T07:02:36.220 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr... 2024-09-21T07:02:37.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:37 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2554375807' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:02:37.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:37.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:02:37.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:02:37.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:02:37.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:02:37.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:02:37.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:02:28:950840+0000", 2024-09-21T07:02:37.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:02:37.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:37.744 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:02:28.951623+0000", 2024-09-21T07:02:37.744 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:02:37.744 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:37.744 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:02:37.744 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:02:37.744 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (1/15)... 2024-09-21T07:02:40.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:40 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2879001339' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:02:40.851 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:40.851 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:02:40.851 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:02:40.851 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:02:40.851 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:02:40.851 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:02:40.851 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:02:40.851 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:02:40.852 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:40.853 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:02:40.853 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:02:40.853 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:02:40.853 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:02:40.853 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:02:40.853 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:02:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:02:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:02:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:02:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:02:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:02:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:02:40.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:02:28:950840+0000", 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:02:40.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:02:28.951623+0000", 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:02:40.858 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (2/15)... 2024-09-21T07:02:41.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: Activating manager daemon x 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: mgrmap e2: x(active, starting, since 0.00373938s) 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: from='mgr.14100 172.21.15.92:0/2215701104' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: from='mgr.14100 172.21.15.92:0/2215701104' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: from='mgr.14100 172.21.15.92:0/2215701104' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: from='mgr.14100 172.21.15.92:0/2215701104' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: from='mgr.14100 172.21.15.92:0/2215701104' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: Manager daemon x is now available 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: from='mgr.14100 172.21.15.92:0/2215701104' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: from='mgr.14100 172.21.15.92:0/2215701104' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: from='mgr.14100 172.21.15.92:0/2215701104' entity='mgr.x' 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: from='mgr.14100 172.21.15.92:0/2215701104' entity='mgr.x' 2024-09-21T07:02:41.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:41 smithi092 ceph-mon[30987]: from='mgr.14100 172.21.15.92:0/2215701104' entity='mgr.x' 2024-09-21T07:02:43.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:43 smithi092 ceph-mon[30987]: mgrmap e3: x(active, since 1.00785s) 2024-09-21T07:02:44.127 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:44.127 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:02:44.127 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:02:44.127 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:02:44.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:02:44.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:02:44.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:02:44.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:44.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:02:44.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:02:44.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:02:44.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:02:44.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:02:44.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:02:44.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:02:44.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:44.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:02:44.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:02:44.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:02:44.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:02:44.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:02:44.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:02:44.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:02:44.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:02:44.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:02:44.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:44.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:02:44.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:44.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:02:28:950840+0000", 2024-09-21T07:02:44.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:02:44.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:02:44.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:44.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:02:28.951623+0000", 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:02:44.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:02:44.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:02:44.133 INFO:teuthology.orchestra.run.smithi092.stdout:mgr is available 2024-09-21T07:02:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:44 smithi092 ceph-mon[30987]: mgrmap e4: x(active, since 2s) 2024-09-21T07:02:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:44 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1215643676' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:02:45.267 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:45 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/196820335' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T07:02:45.271 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:45.271 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout fsid = 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T07:02:45.272 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T07:02:45.273 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T07:02:45.273 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling cephadm module... 2024-09-21T07:02:46.449 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:46 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1208818622' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T07:02:46.449 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:46 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: ignoring --setgroup ceph since I am not root 2024-09-21T07:02:47.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:47 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1208818622' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T07:02:47.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:47 smithi092 ceph-mon[30987]: mgrmap e5: x(active, since 5s) 2024-09-21T07:02:48.017 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:02:48.017 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T07:02:48.017 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:02:48.018 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T07:02:48.018 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T07:02:48.018 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:02:48.018 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for the mgr to restart... 2024-09-21T07:02:48.018 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr epoch 5... 2024-09-21T07:02:48.333 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:48 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4277027760' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T07:02:51.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:51 smithi092 ceph-mon[30987]: Active manager daemon x restarted 2024-09-21T07:02:51.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:51 smithi092 ceph-mon[30987]: Activating manager daemon x 2024-09-21T07:02:51.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:51 smithi092 ceph-mon[30987]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T07:02:51.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:51 smithi092 ceph-mon[30987]: mgrmap e6: x(active, starting, since 0.00351309s) 2024-09-21T07:02:51.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:51 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:51.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:51 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:02:51.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:51 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:02:51.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:51 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:02:51.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:51 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:02:51.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:51 smithi092 ceph-mon[30987]: Manager daemon x is now available 2024-09-21T07:02:52.771 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:02:52.771 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:02:52.771 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: Found migration_current of "None". Setting to last migration. 2024-09-21T07:02:52.771 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:02:52.771 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: mgrmap e7: x(active, since 1.00619s) 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-mon[30987]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:02:52.513+0000 7fe1e367b640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:02:52] ENGINE Error in HTTPServer.serve 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: Traceback (most recent call last): 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self._connections.run(self.expiration_interval) 2024-09-21T07:02:52.772 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self._run(expiration_interval) 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: s = self.context.wrap_socket( 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: return self.sslsocket_class._create( 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self.do_handshake() 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:02:52.773 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self._sslobj.do_handshake() 2024-09-21T07:02:52.774 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:02:52.774 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:02:52.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:02:52.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T07:02:52.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T07:02:52.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:02:52.775 INFO:teuthology.orchestra.run.smithi092.stdout:mgr epoch 5 is available 2024-09-21T07:02:52.775 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying orchestrator module is enabled... 2024-09-21T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:53 smithi092 ceph-mon[30987]: [21/Sep/2024:07:02:52] ENGINE Bus STARTING 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:53 smithi092 ceph-mon[30987]: [21/Sep/2024:07:02:52] ENGINE Serving on https://172.21.15.92:7150 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:53 smithi092 ceph-mon[30987]: [21/Sep/2024:07:02:52] ENGINE Error in HTTPServer.serve 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: Traceback (most recent call last): 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._run(expiration_interval) 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:02:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout: s = self.context.wrap_socket( 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout: return self.sslsocket_class._create( 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout: self.do_handshake() 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._sslobj.do_handshake() 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:53 smithi092 ceph-mon[30987]: [21/Sep/2024:07:02:52] ENGINE Serving on http://172.21.15.92:8765 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:53 smithi092 ceph-mon[30987]: [21/Sep/2024:07:02:52] ENGINE Bus STARTED 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:53 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:53 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2121515338' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T07:02:53.963 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T07:02:53.963 INFO:teuthology.orchestra.run.smithi092.stdout:Setting orchestrator backend to cephadm... 2024-09-21T07:02:54.792 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:54 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2121515338' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T07:02:54.792 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:54 smithi092 ceph-mon[30987]: mgrmap e8: x(active, since 2s) 2024-09-21T07:02:55.663 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:55 smithi092 ceph-mon[30987]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:55.663 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:55 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:02:55.663 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:55 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:56.211 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T07:02:56.211 INFO:teuthology.orchestra.run.smithi092.stdout:Generating ssh key... 2024-09-21T07:02:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-mon[30987]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:57.362 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: Generating public/private rsa key pair. 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: Your identification has been saved in /tmp/tmpv73orpgt/key 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: Your public key has been saved in /tmp/tmpv73orpgt/key.pub 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: The key fingerprint is: 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: SHA256:ChElRB1t31hFdIR8n5dMKmhF+WtYOIRufncrtZadjJI ceph-4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: The key's randomart image is: 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: +---[RSA 3072]----+ 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: | o=ooo o..=+oo| 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: | o. o. +. oo.| 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: | . ...++o +.+| 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: | . =o+.+ +o| 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: | . S = . .| 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: | . . . o + o | 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: | . . + = *| 2024-09-21T07:02:57.363 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: | E o B.| 2024-09-21T07:02:57.364 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: | . o | 2024-09-21T07:02:57.364 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:02:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: +----[SHA256]-----+ 2024-09-21T07:02:58.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:57 smithi092 ceph-mon[30987]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:58.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:57 smithi092 ceph-mon[30987]: Generating ssh key... 2024-09-21T07:02:58.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:57 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:02:58.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:57 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:02:58.706 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmN0NsRSoO87TDPrRla5sBHwaJ0kdnFEz49O+kuaZO1TDxDz/sDTJy5NCULg2Dx8I8XFZ3qfaj1QfA5V3N2QMKjItKvcc2g+vBZQEcwaYVY7vy4i1ag80ErG2pxvlYooibmgMBmRyFmTgZ54zMJOFGCCIPmYihIadWtBdFloj9LHGGeq8BHfZeXjvh1lIiuaqeDQP1GBWSmAueKPBOiETKkTR8TJRL+HZFt47wsEDE7tEewP+Bxp3DmFJzSxbuu+kW+LhLDnejyBDGgWxZ6q58h91Z9Rw9sJ4kkPKK0miTI2EKlTzhkM4gA91UDLG4dVWF/0x0a96Tl3CzUVMDefJ1Wg0aSfBFUFMOuwlALm89HsLpUQ54Vj+yzRXipjr3JRTuavKbhaJyOEB/xc7Y6WPbWwKayTahiBgEh5xAA1UIqpq/nX/c0gpJo6EOTTizbKFuCLKNk0ytwppEu6DyEQVHIQQvWheZWIsD3EFwTI57JbKrPsmfu6MKPaxXXYSkIOs= ceph-4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:02:58.706 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:02:58.706 INFO:teuthology.orchestra.run.smithi092.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T07:02:58.711 INFO:teuthology.orchestra.run.smithi092.stdout:Adding host smithi092... 2024-09-21T07:02:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:02:58 smithi092 ceph-mon[30987]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:00.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:00 smithi092 ceph-mon[30987]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi092", "addr": "172.21.15.92", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:00.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:00 smithi092 ceph-mon[30987]: Deploying cephadm binary to smithi092 2024-09-21T07:03:02.971 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Added host 'smithi092' with addr '172.21.15.92' 2024-09-21T07:03:02.971 INFO:teuthology.orchestra.run.smithi092.stdout:Deploying unmanaged mon service... 2024-09-21T07:03:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:03 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:03:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:03 smithi092 ceph-mon[30987]: Added host smithi092 2024-09-21T07:03:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:03 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:04.371 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T07:03:04.372 INFO:teuthology.orchestra.run.smithi092.stdout:Deploying unmanaged mgr service... 2024-09-21T07:03:04.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:04 smithi092 ceph-mon[30987]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:04.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:04 smithi092 ceph-mon[30987]: Saving service mon spec with placement count:5 2024-09-21T07:03:04.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:04 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:03:06.332 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:06 smithi092 ceph-mon[30987]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:06.332 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:06 smithi092 ceph-mon[30987]: Saving service mgr spec with placement count:2 2024-09-21T07:03:06.332 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:06 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:03:06.332 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:06 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:03:06.335 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T07:03:07.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:07 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:03:07.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:07 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1772253823' entity='client.admin' 2024-09-21T07:03:09.266 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling the dashboard module... 2024-09-21T07:03:09.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:09 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:03:09.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:09 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1269095352' entity='client.admin' 2024-09-21T07:03:11.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:10 smithi092 ceph-mon[30987]: from='mgr.14118 172.21.15.92:0/4153368890' entity='mgr.x' 2024-09-21T07:03:11.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:10 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2042362023' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T07:03:11.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:10 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: ignoring --setuser ceph since I am not root 2024-09-21T07:03:11.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:10 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: ignoring --setgroup ceph since I am not root 2024-09-21T07:03:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:11 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2042362023' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T07:03:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:11 smithi092 ceph-mon[30987]: mgrmap e9: x(active, since 19s) 2024-09-21T07:03:12.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:03:12.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T07:03:12.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:03:12.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T07:03:12.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T07:03:12.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:03:12.719 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for the mgr to restart... 2024-09-21T07:03:12.719 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr epoch 9... 2024-09-21T07:03:13.014 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:12 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3378916222' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T07:03:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:15 smithi092 ceph-mon[30987]: Active manager daemon x restarted 2024-09-21T07:03:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:15 smithi092 ceph-mon[30987]: Activating manager daemon x 2024-09-21T07:03:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:15 smithi092 ceph-mon[30987]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T07:03:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:15 smithi092 ceph-mon[30987]: mgrmap e10: x(active, starting, since 0.00579799s) 2024-09-21T07:03:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:15 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:03:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:15 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:03:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:15 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:03:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:15 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:03:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:15 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:03:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:15 smithi092 ceph-mon[30987]: Manager daemon x is now available 2024-09-21T07:03:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:03:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:03:17.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-mon[30987]: [21/Sep/2024:07:03:16] ENGINE Bus STARTING 2024-09-21T07:03:17.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-mon[30987]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T07:03:17.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-mon[30987]: mgrmap e11: x(active, since 1.00632s) 2024-09-21T07:03:17.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-mon[30987]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T07:03:17.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:03:16.900+0000 7f21d222b640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:03:16] ENGINE Error in HTTPServer.serve 2024-09-21T07:03:17.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: Traceback (most recent call last): 2024-09-21T07:03:17.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:03:17.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self._connections.run(self.expiration_interval) 2024-09-21T07:03:17.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:03:17.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self._run(expiration_interval) 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: s = self.context.wrap_socket( 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: return self.sslsocket_class._create( 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self.do_handshake() 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self._sslobj.do_handshake() 2024-09-21T07:03:17.114 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:03:17.115 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:03:17.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:03:17.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T07:03:17.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T07:03:17.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:03:17.376 INFO:teuthology.orchestra.run.smithi092.stdout:mgr epoch 9 is available 2024-09-21T07:03:17.376 INFO:teuthology.orchestra.run.smithi092.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T07:03:18.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:17 smithi092 ceph-mon[30987]: [21/Sep/2024:07:03:16] ENGINE Serving on https://172.21.15.92:7150 2024-09-21T07:03:18.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:17 smithi092 ceph-mon[30987]: [21/Sep/2024:07:03:16] ENGINE Error in HTTPServer.serve 2024-09-21T07:03:18.362 INFO:journalctl@ceph.mon.a.smithi092.stdout: Traceback (most recent call last): 2024-09-21T07:03:18.362 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._run(expiration_interval) 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: s = self.context.wrap_socket( 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:03:18.363 INFO:journalctl@ceph.mon.a.smithi092.stdout: return self.sslsocket_class._create( 2024-09-21T07:03:18.364 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:03:18.364 INFO:journalctl@ceph.mon.a.smithi092.stdout: self.do_handshake() 2024-09-21T07:03:18.364 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:03:18.364 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._sslobj.do_handshake() 2024-09-21T07:03:18.364 INFO:journalctl@ceph.mon.a.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:03:18.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:17 smithi092 ceph-mon[30987]: [21/Sep/2024:07:03:17] ENGINE Serving on http://172.21.15.92:8765 2024-09-21T07:03:18.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:17 smithi092 ceph-mon[30987]: [21/Sep/2024:07:03:17] ENGINE Bus STARTED 2024-09-21T07:03:18.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:18 smithi092 ceph-mon[30987]: mgrmap e12: x(active, since 2s) 2024-09-21T07:03:18.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:18 smithi092 ceph-mon[30987]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:18.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:18 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:18.984 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUQY8TOv/TQFEl9znORf/+kfdkHRIwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA3MDMxOFoXDTM0\nMDkyMjA3MDMxOFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjkyMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA1yAXGkS2+lW8mW/tWyf2lCrYY74hbL2EX8NQ\nON2PS2g+EnAcsiXq1osjC18ypHGXGDgDA5v/JZqK3BOHEaZvipjiKj6a2GHfoa5N\nBLB3cOm5f+q+t+eSBuJT5ZHWg/u5FKAoOTjeUJh4G8G9C/HlGEa6J8fAZ2ofOYQc\nNfuCciiEh7prCwRvDXe+ZQTZWsUzhyZQCJtCohXRS/8bHAyfdVGHkEfhEOLsc8lk\nDwStJ7zvPSJw5jDdXn/5jRyBhd0IJFCBZ17hFFptbz2a+o44cGSAA5OoXJLjaFME\nqTBqfy6Et+nYm14wPVzf46/Nwiul0jvfszAZj3xIz2OhxWBS/7HIJw7P5QYJSyfQ\n3hrz+VQNaTQ5rQ7PBNNOJtxbel6Ri1rf6xpMzrMYWXXJsdHI3Q9N8SQfsmIF7jAJ\nyalyjQlMX4uYBCb3KpH7u5LM0l8S7KSl+rjwbmCQtodpEjRqBAHH342GRi6tOiVb\nC7hRBnPckgfIoXVEv58k25SHINDQ+oaY1zqdKTW7kBzd0Mj2FpMVghPCvR9Q7scb\nFFwxuNPZxnuj6qptGxTMLE8odlXmEdeVEc1Bj6S4sCRqq+l9Df7eMRH56CzonnXd\nxCJGUsLtP4UKjU2JNBZpbmRTD1ger7hsOqqv+z53y3PuC12mkc4AYHVYdDRTCAJT\nKP0b1bUCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDkyghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPXDAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQCJ\n1p3cg/u7pDgRExdBxgDuUyn3pLXYxzUsPAIblyJd6LmyKjUVvku5xSMadlh6ugcH\nZU1WeZn2kGdEy0SLn3ii2lCjvMaD++WWgcok4jJ8rE++dMZhVz0FjCYAOtGsNbiY\naY+0m7D11280R9VYChM81QB7AhCg6lDbDJrZ8ZBKGL6N79jyUcKAkyVxuDyy4DEz\nwHmrzbWdutjME6fgPvdjWUkIZ3xg3EkfbLxUqGM4x3AnsdsZ9G+AURliPeQRPfsq\nn0APbb9KycIjOYoNqnKCeOwa8MgM0zv7WmWWJvYpixcEGQzW8j2XVVSokkwrMKSl\nxPfsAU7z3SDTTB8i3oLMAaD8pSrg6jdQWkB7yIuuw8xezD4i1dZQ1mzPB8GhaWVr\nIMLCWHk7yE/VWpZ7ka3CUo11tykA4JzYa0eMwaDSY0KrGAA/XpfzWjLF7AvQlcJv\nJ5txF+bt1G1HJSWg6lbYtZsA+1lgbc5Vw3sPIuJ7KEHL7bgTkYQd2tbI3MW3HU5x\nIc+Tr1Cj6c+otcAkPdn+qcBR459il0YLE3pYTfePE9cNncmXpXLAFNBsF50EpVCn\nSmh98L0SQLb0lGIWVU7IC6lWYN3ESy6GMWYed+HXekNGIMmLT8BQHVb6WlTZffVz\nBf21O20+7Xqc6W35rtcU8FfQdeVx6FB9kspsE+DpYw==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEA1yAXGkS2+lW8mW/tWyf2lCrYY74hbL2EX8NQON2PS2g+EnAc\nsiXq1osjC18ypHGXGDgDA5v/JZqK3BOHEaZvipjiKj6a2GHfoa5NBLB3cOm5f+q+\nt+eSBuJT5ZHWg/u5FKAoOTjeUJh4G8G9C/HlGEa6J8fAZ2ofOYQcNfuCciiEh7pr\nCwRvDXe+ZQTZWsUzhyZQCJtCohXRS/8bHAyfdVGHkEfhEOLsc8lkDwStJ7zvPSJw\n5jDdXn/5jRyBhd0IJFCBZ17hFFptbz2a+o44cGSAA5OoXJLjaFMEqTBqfy6Et+nY\nm14wPVzf46/Nwiul0jvfszAZj3xIz2OhxWBS/7HIJw7P5QYJSyfQ3hrz+VQNaTQ5\nrQ7PBNNOJtxbel6Ri1rf6xpMzrMYWXXJsdHI3Q9N8SQfsmIF7jAJyalyjQlMX4uY\nBCb3KpH7u5LM0l8S7KSl+rjwbmCQtodpEjRqBAHH342GRi6tOiVbC7hRBnPckgfI\noXVEv58k25SHINDQ+oaY1zqdKTW7kBzd0Mj2FpMVghPCvR9Q7scbFFwxuNPZxnuj\n6qptGxTMLE8odlXmEdeVEc1Bj6S4sCRqq+l9Df7eMRH56CzonnXdxCJGUsLtP4UK\njU2JNBZpbmRTD1ger7hsOqqv+z53y3PuC12mkc4AYHVYdDRTCAJTKP0b1bUCAwEA\nAQKCAgAMLStRl9EZk0/FCZJQRg9NbK1p2+Gtc36yIu6AAX5yYLiet4zQQpgrw51c\nr+tAZpOMUeNNyX8kJD623T4YcCjBGg03IesG02dikeiXGtvv3rLavDFGXIul6xqf\nlGUlfFKKCdStBHyE6FRoEcu/CNaUTLCNvt8zm0ygJ0unfJByILv7qMAVVA9rHjt/\nIUqiOiZEAJWoHw2i+gQqPorMyCQgclhvgLoLCCUlGqGYvgWFCcsq1S+5v8tP5YN9\nCr+EEbI7x/jDHpoz2jh2gvCqPPGR3wZl7W4qqz/G8GgDoZNtlnb5p/lUNf0aBA9C\nJnnJg0nz/+KWFGNl/T1ry7Jk5yJbbyU0tfbJtNCfkYAhPgpAwmnpbRQw2XRyJiGY\nvyagFUo0zUslj/ndd6lcokOuGggT0JigDex2rhyZ/cRzwcAIEEdrNYae5WB6qgRY\nfoR2NctvWxKu3huWOT5F2wTtO75a9Qjy4noQDJYN9teccMG+aUhJ5ol1KtDflifk\nmbFM9DaiLJPVeYMW6Bk9v9ZOGdEDWuvX2zqHZFw12lkYunVF8+rSy46aywsZf+P5\nPqE4x4fedLIlYJIqQYpOFDoDGINXP+kIOG5hGX5grT8/wWdc4lCt9vR/moJdlw1X\n/FoC9JfP6Tvm5ZZyKURvH9MaEgKmQR8+28QuCQJYE3BYCj9jwwKCAQEA7rQZa5jx\nQnydyMD95k4JpWXMI+iwNLgjSflMAspTKLbWI5Af7ia861hlHXfttFwsQBGcbOhY\naWwqAsRekaFUGenFDtmfY3vG3xCZHYVgCnqW2pbJU8lYnd3X8REY0G1TsuSQl4nD\neHst4KChS8uTd6sXo6zSpUf9e2Szu9pPqVPdZDF+TalSYXKXv8y5T7s+GACT+czT\nPgkBDLqQofpcIIDqo3zFLw3jE9a2SJHuZo77JVmep4ffStUe06i6aqUb/L4tuPB6\nduaN8GUa/CVCZeyswh1WPERxbKoumLC8kKCd1Za5oiDESLFG6YtoHaNUeqpPaZHJ\ntIVcU7dBAJBoowKCAQEA5rae9xB3XNZAh+dHrWtktw/4gVmVqz6ORKXHpb9xrh9M\nqbPe+G3hXdQEPllmsU4PWA5byTojp0j7DOiPnvUWRQe//8ZV23ARkywbztM/y8TN\njx7UCU0Ey5n73Nq8BvPpCyi9dEguMjzGm6TCzYoYiwjIa9Aw7bqMTutFPVX9Y9Vs\nI3kLm7iQQGHTMfcLQALUnuKivEAPBB/9j/AoYuGnxcEWM8X0DyJQDhuDBwEgVJrk\n1KCvcumPhZG+5Uy0R7UTfw1EbbvJtnVNhPV4AHmWIXmZ3EGuhtUpQU1OysWIZPWZ\nLk+/8Ecu+XYF0RKOeD4E/jW8XhH4x8G5xob2Z1h1xwKCAQEAqpx7VtZ4Cmd7d1PJ\npeS9LES4Rio4V1YNkv/mflASZBVatQx8ZgG2IhiKHSfs9G61Cg4MWiMvnho7ZMLq\nPPisXeEigdy1+assl58LcXg1DwhT7mS7/XD6L8uyXpEzxTV/D2wilM1YszKHtffZ\nkY0uF+hn+wq5fH0aBioR9QCy03on0Uc22VdelFwNbn9rLDvOw+UV3wOxMLPK1kg6\nvCtv0aOTEctKPLmWRkW+/9ueJBuqEiYeKewJgzkU0X/Vzge5G0rq7zaisX1UkjAR\nu4r+DE+/ovbI/kaFM3/n0ibwgAbtCQ60G9eDs9lRr/d+MUDeTtaP8ArNuoNfXE6s\n3TRaNQKCAQB99U4sjOzd3os0p2xWnb9Kwoll9UblSy3ZBLlPIIosCiKMtAsTjsnv\ntATtFVofiwKNjKlH31n/xrRpg76FhkE2RtjoB5xwRWsS8o3sCSFXWobvkGErAsWP\ncu4y0ai+EwQ0d3WXuqCeBNhZuUYxeSeVIKJrWiqcX7CilYgjyIKisq5rX3aa+dSn\nkcEAEmQt+l2isREvvbl1AxIoN3GVKqWyLYy1j2mDqbQTP6n1dQP1rOspuuCO2Dzn\nK38RKSNz0sRmJRQq5M9nsfs0j9+IQtlYRU9fFOz36ACyCkbuJZIlrICI7DlaMULQ\nJ0NdtcfaleGb+DJzGVS9mmKWpLB6E62ZAoIBAC4v5YO1Bx5ZkJRf+Shuuv0PBuI3\nxMfHjpt+kE5i9718QAHgeYcd6V70VI3fQ+hICQ8nAVD5CL31RP+wOFFeJ0t7S0W6\nl8A7/NLFBcEtRvuo1PUtJHbUMlEzRk97Cr6E/VxsHdvs/Ru6EUPtvcxAf56z5+XG\ntK2RviaRBRAsd5IDZt8ceSdfuc2HcXq/YLGapM0eLps3BvAmMpinl6uF0AbkC1W4\nn0U8tK0WTVnbiKH3hVtxj5dw37Hb0G/6MQS5FrF+pjh/B9jObNdIdYlAaXTtgmKw\nvptTTBPzU0zWX5MltM1o1z9qd8knvoilWo/mdZqMtM1+i5PA+xfPsPRUt2Y=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T07:03:20.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T07:03:20.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:20 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:20.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:20 smithi092 ceph-mon[30987]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:20.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:20 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:22.086 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T07:03:22.087 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial admin user... 2024-09-21T07:03:22.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:22 smithi092 ceph-mon[30987]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:22.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:22 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:23.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:23 smithi092 ceph-mon[30987]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:23.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:23 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:23.492 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$6cicJfUuaB/lS7CmLoOZn.FiWcDMF2W3f527XLx2nXqCJzvIlpIum", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726902202, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T07:03:23.492 INFO:teuthology.orchestra.run.smithi092.stdout:Fetching dashboard port number... 2024-09-21T07:03:24.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:24 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/715341454' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T07:03:24.640 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T07:03:24.650 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:03:24.650 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-21T07:03:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:03:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-21T07:03:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-21T07:03:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T07:03:24.659 INFO:teuthology.orchestra.run.smithi092.stdout:Ceph Dashboard is now available at: 2024-09-21T07:03:24.659 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:24.659 INFO:teuthology.orchestra.run.smithi092.stdout: URL: https://smithi092.front.sepia.ceph.com:8443/ 2024-09-21T07:03:24.659 INFO:teuthology.orchestra.run.smithi092.stdout: User: admin 2024-09-21T07:03:24.659 INFO:teuthology.orchestra.run.smithi092.stdout: Password: 5f0corrksr 2024-09-21T07:03:24.660 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:24.660 INFO:teuthology.orchestra.run.smithi092.stdout:Saving cluster configuration to /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config directory 2024-09-21T07:03:25.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T07:03:25.855 INFO:teuthology.orchestra.run.smithi092.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T07:03:25.855 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:25.855 INFO:teuthology.orchestra.run.smithi092.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:03:25.855 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout: ceph telemetry on 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout:For more information see: 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:25.856 INFO:teuthology.orchestra.run.smithi092.stdout:Bootstrap complete. 2024-09-21T07:03:25.895 INFO:tasks.cephadm:Fetching config... 2024-09-21T07:03:25.895 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:03:25.895 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T07:03:25.910 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T07:03:25.910 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:03:25.910 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T07:03:25.967 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T07:03:25.967 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:03:25.967 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T07:03:26.033 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T07:03:26.033 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:03:26.033 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T07:03:26.089 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T07:03:26.089 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmN0NsRSoO87TDPrRla5sBHwaJ0kdnFEz49O+kuaZO1TDxDz/sDTJy5NCULg2Dx8I8XFZ3qfaj1QfA5V3N2QMKjItKvcc2g+vBZQEcwaYVY7vy4i1ag80ErG2pxvlYooibmgMBmRyFmTgZ54zMJOFGCCIPmYihIadWtBdFloj9LHGGeq8BHfZeXjvh1lIiuaqeDQP1GBWSmAueKPBOiETKkTR8TJRL+HZFt47wsEDE7tEewP+Bxp3DmFJzSxbuu+kW+LhLDnejyBDGgWxZ6q58h91Z9Rw9sJ4kkPKK0miTI2EKlTzhkM4gA91UDLG4dVWF/0x0a96Tl3CzUVMDefJ1Wg0aSfBFUFMOuwlALm89HsLpUQ54Vj+yzRXipjr3JRTuavKbhaJyOEB/xc7Y6WPbWwKayTahiBgEh5xAA1UIqpq/nX/c0gpJo6EOTTizbKFuCLKNk0ytwppEu6DyEQVHIQQvWheZWIsD3EFwTI57JbKrPsmfu6MKPaxXXYSkIOs= ceph-4e9565c0-77e7-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:03:26.163 INFO:teuthology.orchestra.run.smithi092.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmN0NsRSoO87TDPrRla5sBHwaJ0kdnFEz49O+kuaZO1TDxDz/sDTJy5NCULg2Dx8I8XFZ3qfaj1QfA5V3N2QMKjItKvcc2g+vBZQEcwaYVY7vy4i1ag80ErG2pxvlYooibmgMBmRyFmTgZ54zMJOFGCCIPmYihIadWtBdFloj9LHGGeq8BHfZeXjvh1lIiuaqeDQP1GBWSmAueKPBOiETKkTR8TJRL+HZFt47wsEDE7tEewP+Bxp3DmFJzSxbuu+kW+LhLDnejyBDGgWxZ6q58h91Z9Rw9sJ4kkPKK0miTI2EKlTzhkM4gA91UDLG4dVWF/0x0a96Tl3CzUVMDefJ1Wg0aSfBFUFMOuwlALm89HsLpUQ54Vj+yzRXipjr3JRTuavKbhaJyOEB/xc7Y6WPbWwKayTahiBgEh5xAA1UIqpq/nX/c0gpJo6EOTTizbKFuCLKNk0ytwppEu6DyEQVHIQQvWheZWIsD3EFwTI57JbKrPsmfu6MKPaxXXYSkIOs= ceph-4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:03:26.175 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmN0NsRSoO87TDPrRla5sBHwaJ0kdnFEz49O+kuaZO1TDxDz/sDTJy5NCULg2Dx8I8XFZ3qfaj1QfA5V3N2QMKjItKvcc2g+vBZQEcwaYVY7vy4i1ag80ErG2pxvlYooibmgMBmRyFmTgZ54zMJOFGCCIPmYihIadWtBdFloj9LHGGeq8BHfZeXjvh1lIiuaqeDQP1GBWSmAueKPBOiETKkTR8TJRL+HZFt47wsEDE7tEewP+Bxp3DmFJzSxbuu+kW+LhLDnejyBDGgWxZ6q58h91Z9Rw9sJ4kkPKK0miTI2EKlTzhkM4gA91UDLG4dVWF/0x0a96Tl3CzUVMDefJ1Wg0aSfBFUFMOuwlALm89HsLpUQ54Vj+yzRXipjr3JRTuavKbhaJyOEB/xc7Y6WPbWwKayTahiBgEh5xAA1UIqpq/nX/c0gpJo6EOTTizbKFuCLKNk0ytwppEu6DyEQVHIQQvWheZWIsD3EFwTI57JbKrPsmfu6MKPaxXXYSkIOs= ceph-4e9565c0-77e7-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:03:26.230 INFO:teuthology.orchestra.run.smithi169.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmN0NsRSoO87TDPrRla5sBHwaJ0kdnFEz49O+kuaZO1TDxDz/sDTJy5NCULg2Dx8I8XFZ3qfaj1QfA5V3N2QMKjItKvcc2g+vBZQEcwaYVY7vy4i1ag80ErG2pxvlYooibmgMBmRyFmTgZ54zMJOFGCCIPmYihIadWtBdFloj9LHGGeq8BHfZeXjvh1lIiuaqeDQP1GBWSmAueKPBOiETKkTR8TJRL+HZFt47wsEDE7tEewP+Bxp3DmFJzSxbuu+kW+LhLDnejyBDGgWxZ6q58h91Z9Rw9sJ4kkPKK0miTI2EKlTzhkM4gA91UDLG4dVWF/0x0a96Tl3CzUVMDefJ1Wg0aSfBFUFMOuwlALm89HsLpUQ54Vj+yzRXipjr3JRTuavKbhaJyOEB/xc7Y6WPbWwKayTahiBgEh5xAA1UIqpq/nX/c0gpJo6EOTTizbKFuCLKNk0ytwppEu6DyEQVHIQQvWheZWIsD3EFwTI57JbKrPsmfu6MKPaxXXYSkIOs= ceph-4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:03:26.242 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmN0NsRSoO87TDPrRla5sBHwaJ0kdnFEz49O+kuaZO1TDxDz/sDTJy5NCULg2Dx8I8XFZ3qfaj1QfA5V3N2QMKjItKvcc2g+vBZQEcwaYVY7vy4i1ag80ErG2pxvlYooibmgMBmRyFmTgZ54zMJOFGCCIPmYihIadWtBdFloj9LHGGeq8BHfZeXjvh1lIiuaqeDQP1GBWSmAueKPBOiETKkTR8TJRL+HZFt47wsEDE7tEewP+Bxp3DmFJzSxbuu+kW+LhLDnejyBDGgWxZ6q58h91Z9Rw9sJ4kkPKK0miTI2EKlTzhkM4gA91UDLG4dVWF/0x0a96Tl3CzUVMDefJ1Wg0aSfBFUFMOuwlALm89HsLpUQ54Vj+yzRXipjr3JRTuavKbhaJyOEB/xc7Y6WPbWwKayTahiBgEh5xAA1UIqpq/nX/c0gpJo6EOTTizbKFuCLKNk0ytwppEu6DyEQVHIQQvWheZWIsD3EFwTI57JbKrPsmfu6MKPaxXXYSkIOs= ceph-4e9565c0-77e7-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:03:26.289 INFO:teuthology.orchestra.run.smithi175.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmN0NsRSoO87TDPrRla5sBHwaJ0kdnFEz49O+kuaZO1TDxDz/sDTJy5NCULg2Dx8I8XFZ3qfaj1QfA5V3N2QMKjItKvcc2g+vBZQEcwaYVY7vy4i1ag80ErG2pxvlYooibmgMBmRyFmTgZ54zMJOFGCCIPmYihIadWtBdFloj9LHGGeq8BHfZeXjvh1lIiuaqeDQP1GBWSmAueKPBOiETKkTR8TJRL+HZFt47wsEDE7tEewP+Bxp3DmFJzSxbuu+kW+LhLDnejyBDGgWxZ6q58h91Z9Rw9sJ4kkPKK0miTI2EKlTzhkM4gA91UDLG4dVWF/0x0a96Tl3CzUVMDefJ1Wg0aSfBFUFMOuwlALm89HsLpUQ54Vj+yzRXipjr3JRTuavKbhaJyOEB/xc7Y6WPbWwKayTahiBgEh5xAA1UIqpq/nX/c0gpJo6EOTTizbKFuCLKNk0ytwppEu6DyEQVHIQQvWheZWIsD3EFwTI57JbKrPsmfu6MKPaxXXYSkIOs= ceph-4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:03:26.302 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T07:03:26.556 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:26.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:26 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3289017195' entity='client.admin' 2024-09-21T07:03:27.903 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T07:03:27.903 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T07:03:28.573 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:28 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1845502742' entity='client.admin' 2024-09-21T07:03:28.826 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:29.563 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:29 smithi092 ceph-mon[30987]: mgrmap e13: x(active, since 12s) 2024-09-21T07:03:29.563 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:29 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:29.563 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:29 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:29.563 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:29 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:29.563 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:29 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:29.563 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:29 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:29.563 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:29 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:30.324 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi169 2024-09-21T07:03:30.324 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T07:03:30.325 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:03:30.343 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T07:03:30.343 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:03:30.401 INFO:tasks.cephadm:Adding host smithi169 to orchestrator... 2024-09-21T07:03:30.402 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch host add smithi169 2024-09-21T07:03:30.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:30.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:30.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:30.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:30.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:30.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-21T07:03:30.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:03:30.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:03:30.614 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:30.614 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:30.614 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:30 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:31.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:31 smithi092 ceph-mon[30987]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:03:32.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:32 smithi092 ceph-mon[30987]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:33.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:33 smithi092 ceph-mon[30987]: Deploying cephadm binary to smithi169 2024-09-21T07:03:34.454 INFO:teuthology.orchestra.run.smithi092.stdout:Added host 'smithi169' with addr '172.21.15.169' 2024-09-21T07:03:35.017 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:03:35.255 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:35.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:35 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:35.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:35 smithi092 ceph-mon[30987]: Added host smithi169 2024-09-21T07:03:35.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:35 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:35.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:35 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:35.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:35 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:35.865 INFO:teuthology.orchestra.run.smithi092.stdout:[{"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.169", "hostname": "smithi169", "labels": [], "status": ""}] 2024-09-21T07:03:36.450 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi175 2024-09-21T07:03:36.451 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T07:03:36.451 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:03:36.469 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T07:03:36.469 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:03:36.527 INFO:tasks.cephadm:Adding host smithi175 to orchestrator... 2024-09-21T07:03:36.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch host add smithi175 2024-09-21T07:03:36.766 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:37.091 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:36 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:37.091 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:36 smithi092 ceph-mon[30987]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:37.091 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:36 smithi092 ceph-mon[30987]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:03:38.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:37 smithi092 ceph-mon[30987]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:38.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:37 smithi092 ceph-mon[30987]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:39 smithi092 ceph-mon[30987]: Deploying cephadm binary to smithi175 2024-09-21T07:03:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:39 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:39 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:39 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:39 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:40.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:39 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:40.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:39 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:40.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:39 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:40.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:39 smithi092 ceph-mon[30987]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-21T07:03:40.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:39 smithi092 ceph-mon[30987]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:03:40.429 INFO:teuthology.orchestra.run.smithi092.stdout:Added host 'smithi175' with addr '172.21.15.175' 2024-09-21T07:03:41.036 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:40 smithi092 ceph-mon[30987]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:03:41.036 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:40 smithi092 ceph-mon[30987]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:03:41.036 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:40 smithi092 ceph-mon[30987]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:41.036 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:40 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:41.036 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:40 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:41.036 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:40 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:41.036 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:40 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:41.036 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:40 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:41.036 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:40 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:41.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:03:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:41.930 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:03:41.931 INFO:teuthology.orchestra.run.smithi092.stdout:[{"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.169", "hostname": "smithi169", "labels": [], "status": ""}, {"addr": "172.21.15.175", "hostname": "smithi175", "labels": [], "status": ""}] 2024-09-21T07:03:42.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:41 smithi092 ceph-mon[30987]: Added host smithi175 2024-09-21T07:03:42.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:41 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:42.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:41 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:42.487 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T07:03:42.488 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T07:03:42.726 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:03:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:42 smithi092 ceph-mon[30987]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:43.873 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2024-09-21T07:03:44.190 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:43 smithi092 ceph-mon[30987]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:03:44.190 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:43 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3820109223' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T07:03:44.477 INFO:tasks.cephadm:Adding mon.a on smithi092 2024-09-21T07:03:44.477 INFO:tasks.cephadm:Adding mon.b on smithi169 2024-09-21T07:03:44.477 INFO:tasks.cephadm:Adding mon.c on smithi175 2024-09-21T07:03:44.478 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi092:172.21.15.92=a;smithi169:172.21.15.169=b;smithi175:172.21.15.175=c' 2024-09-21T07:03:44.768 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:03:45.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3820109223' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:03:45.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:44 smithi092 ceph-mon[30987]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:03:45.440 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mon update... 2024-09-21T07:03:46.047 DEBUG:teuthology.orchestra.run.smithi169:mon.b> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T07:03:46.049 DEBUG:teuthology.orchestra.run.smithi175:mon.c> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T07:03:46.051 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:03:46.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:03:46.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi169:172.21.15.169=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi169:172.21.15.169=b;smithi175:172.21.15.175=c;count:3 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: Deploying daemon mon.c on smithi175 2024-09-21T07:03:46.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:45 smithi092 ceph-mon[30987]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:48.064 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:03:48.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:47 smithi092 ceph-mon[30987]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:48.894 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:03:48.895 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","modified":"2024-09-21T07:02:25.230849Z","created":"2024-09-21T07:02:25.230849Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:03:48.895 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-09-21T07:03:49.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:48 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/4264534409' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:03:50.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:49 smithi175 systemd[1]: Started Ceph mon.c for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:03:50.520 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:03:50.520 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:03:50.773 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:03:55.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:03:55.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: mon.a calling monitor election 2024-09-21T07:03:55.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:55.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: mon.c calling monitor election 2024-09-21T07:03:55.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: monmap epoch 2 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: last_changed 2024-09-21T07:03:49.895579+0000 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: created 2024-09-21T07:02:25.230849+0000 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: min_mon_release 19 (squid) 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: election_strategy: 1 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: fsmap 2024-09-21T07:03:55.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:03:55.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: mgrmap e13: x(active, since 39s) 2024-09-21T07:03:55.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: overall HEALTH_OK 2024-09-21T07:03:55.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:55.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:55.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:55.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:03:55.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:54 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:55.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:03:55.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: mon.a calling monitor election 2024-09-21T07:03:55.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: mon.c calling monitor election 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: monmap epoch 2 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: last_changed 2024-09-21T07:03:49.895579+0000 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: created 2024-09-21T07:02:25.230849+0000 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: min_mon_release 19 (squid) 2024-09-21T07:03:55.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: election_strategy: 1 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: fsmap 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: mgrmap e13: x(active, since 39s) 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: overall HEALTH_OK 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:03:55.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:54 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:55.864 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:03:55.864 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","modified":"2024-09-21T07:03:49.895579Z","created":"2024-09-21T07:02:25.230849Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:03:55.864 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-09-21T07:03:56.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:55 smithi175 ceph-mon[34064]: Deploying daemon mon.b on smithi169 2024-09-21T07:03:56.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:55 smithi175 ceph-mon[34064]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:56.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:55 smithi175 ceph-mon[34064]: from='client.? 172.21.15.175:0/1420584625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:03:56.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:55 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:56.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:55 smithi092 ceph-mon[30987]: Deploying daemon mon.b on smithi169 2024-09-21T07:03:56.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:55 smithi092 ceph-mon[30987]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:56.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:55 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/1420584625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:03:56.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:55 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:57.362 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:03:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:03:56.895+0000 7f2205c60640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T07:03:57.483 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:03:57.484 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:03:57.744 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:03:58.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:03:57 smithi175 ceph-mon[34064]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:58.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:03:57 smithi092 ceph-mon[30987]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:58.450 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:03:58.450 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","modified":"2024-09-21T07:03:49.895579Z","created":"2024-09-21T07:02:25.230849Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:03:58.450 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-09-21T07:03:58.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 podman[33686]: 2024-09-21 07:03:58.728358893 +0000 UTC m=+0.326582288 container start 20f3cdf1dfe80ec0de622a7cb06fb544dce3f27e6b37837fc69ca23fe61587ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T07:03:58.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T07:03:58.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T07:03:58.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: pidfile_write: ignore empty --pid-file 2024-09-21T07:03:59.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: load: jerasure load: lrc 2024-09-21T07:03:59.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: RocksDB version: 7.9.2 2024-09-21T07:03:59.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Git sha 0 2024-09-21T07:03:59.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T07:03:59.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: DB SUMMARY 2024-09-21T07:03:59.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: DB Session ID: WAC35CPA7GCFPV4RSITK 2024-09-21T07:03:59.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: CURRENT file: CURRENT 2024-09-21T07:03:59.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T07:03:59.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.error_if_exists: 0 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.create_if_missing: 0 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.paranoid_checks: 1 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.env: 0x555f37109d60 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.info_log: 0x555f3c767360 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.statistics: (nil) 2024-09-21T07:03:59.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.use_fsync: 0 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_log_file_size: 0 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.allow_fallocate: 1 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.use_direct_reads: 0 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.db_log_dir: 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.wal_dir: 2024-09-21T07:03:59.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T07:03:59.147 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T07:03:59.147 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T07:03:59.147 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T07:03:59.148 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T07:03:59.148 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T07:03:59.148 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.write_buffer_manager: 0x555f3c76bd60 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.unordered_write: 0 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T07:03:59.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.row_cache: None 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.wal_filter: None 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.two_write_queues: 0 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.wal_compression: 0 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.atomic_flush: 0 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.log_readahead_size: 0 2024-09-21T07:03:59.150 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_background_jobs: 2 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_background_compactions: -1 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_subcompactions: 1 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T07:03:59.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_open_files: -1 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_background_flushes: -1 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Compression algorithms supported: 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: kZSTD supported: 0 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: kXpressCompression supported: 0 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: kBZip2Compression supported: 0 2024-09-21T07:03:59.152 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: kLZ4Compression supported: 1 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: kZlibCompression supported: 1 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: kSnappyCompression supported: 1 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.merge_operator: 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_filter: None 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T07:03:59.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555f3c766fa0) 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: cache_index_and_filter_blocks: 1 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: pin_top_level_index_and_filter: 1 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: index_type: 0 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: data_block_index_type: 0 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: index_shortening: 1 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: checksum: 4 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: no_block_cache: 0 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: block_cache: 0x555f3872b610 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: block_cache_name: BinnedLRUCache 2024-09-21T07:03:59.154 INFO:journalctl@ceph.mon.b.smithi169.stdout: block_cache_options: 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: capacity : 536870912 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: num_shard_bits : 4 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: strict_capacity_limit : 0 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: high_pri_pool_ratio: 0.000 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: block_cache_compressed: (nil) 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: persistent_cache: (nil) 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: block_size: 4096 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: block_size_deviation: 10 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: block_restart_interval: 16 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: index_block_restart_interval: 1 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: metadata_block_size: 4096 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: partition_filters: 0 2024-09-21T07:03:59.155 INFO:journalctl@ceph.mon.b.smithi169.stdout: use_delta_encoding: 1 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: filter_policy: bloomfilter 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: whole_key_filtering: 1 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: verify_compression: 0 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: read_amp_bytes_per_bit: 0 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: format_version: 5 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: enable_index_compression: 1 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: block_align: 0 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: max_auto_readahead_size: 262144 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: prepopulate_block_cache: 0 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: initial_auto_readahead_size: 8192 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compression: NoCompression 2024-09-21T07:03:59.156 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.num_levels: 7 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T07:03:59.157 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T07:03:59.158 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T07:03:59.159 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T07:03:59.160 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.inplace_update_support: 0 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.bloom_locality: 0 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.max_successive_merges: 0 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T07:03:59.161 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.ttl: 2592000 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.enable_blob_files: false 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.min_blob_size: 0 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T07:03:59.162 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f669201e-f438-4f09-ba1f-eef21a6f11c0 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726902238765771, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726902238766216, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726902238, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f669201e-f438-4f09-ba1f-eef21a6f11c0", "db_session_id": "WAC35CPA7GCFPV4RSITK", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726902238766311, "job": 1, "event": "recovery_finished"} 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555f3c78aa80 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: DB pointer 0x555f3d530000 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T07:03:59.163 INFO:journalctl@ceph.mon.b.smithi169.stdout: ** DB Stats ** 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: ** Compaction Stats [default] ** 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:03:59.164 INFO:journalctl@ceph.mon.b.smithi169.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: ** Compaction Stats [default] ** 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T07:03:59.165 INFO:journalctl@ceph.mon.b.smithi169.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout: Block cache BinnedLRUCache@0x555f3872b610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout: 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: using public_addr v2:172.21.15.169:0/0 -> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: starting mon.b rank -1 at public addrs [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] at bind addrs [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(???) e0 preinit fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T07:03:59.166 INFO:journalctl@ceph.mon.b.smithi169.stdout: e1 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout: btime 2024-09-21T07:02:28:950840+0000 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout: legacy client fscid: -1 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout: 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout: No filesystems configured 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T07:03:59.167 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Deploying cephadm binary to smithi175 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:03:59.168 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Added host smithi175 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3820109223' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:59.169 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3820109223' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.170 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi169:172.21.15.169=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi169:172.21.15.169=b;smithi175:172.21.15.175=c;count:3 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Deploying daemon mon.c on smithi175 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/4264534409' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:03:59.171 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.a calling monitor election 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.c calling monitor election 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: monmap epoch 2 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: last_changed 2024-09-21T07:03:49.895579+0000 2024-09-21T07:03:59.172 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: created 2024-09-21T07:02:25.230849+0000 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: min_mon_release 19 (squid) 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: election_strategy: 1 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: fsmap 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mgrmap e13: x(active, since 39s) 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: overall HEALTH_OK 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:59.173 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: Deploying daemon mon.b on smithi169 2024-09-21T07:03:59.174 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:59.174 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/1420584625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:03:59.174 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:03:59.174 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:03:59.174 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 ceph-mon[33705]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T07:03:59.174 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 bash[33686]: 20f3cdf1dfe80ec0de622a7cb06fb544dce3f27e6b37837fc69ca23fe61587ec 2024-09-21T07:03:59.174 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:03:58 smithi169 systemd[1]: Started Ceph mon.b for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:04:00.047 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:04:00.047 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:04:00.301 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:04:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:04:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: mon.a calling monitor election 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: mon.c calling monitor election 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: mon.b calling monitor election 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:04:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: monmap epoch 3 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: last_changed 2024-09-21T07:03:58.795201+0000 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: created 2024-09-21T07:02:25.230849+0000 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: min_mon_release 19 (squid) 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: election_strategy: 1 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: 2: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: fsmap 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: mgrmap e13: x(active, since 47s) 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: overall HEALTH_OK 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:03 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.199 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:04:04.199 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","modified":"2024-09-21T07:03:58.795201Z","created":"2024-09-21T07:02:25.230849Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T07:04:04.200 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 3 2024-09-21T07:04:04.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:04:04.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: mon.a calling monitor election 2024-09-21T07:04:04.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: mon.c calling monitor election 2024-09-21T07:04:04.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:04:04.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:04.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: mon.b calling monitor election 2024-09-21T07:04:04.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: monmap epoch 3 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: last_changed 2024-09-21T07:03:58.795201+0000 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: created 2024-09-21T07:02:25.230849+0000 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: min_mon_release 19 (squid) 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: election_strategy: 1 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: 2: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: fsmap 2024-09-21T07:04:04.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:04:04.202 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: mgrmap e13: x(active, since 47s) 2024-09-21T07:04:04.202 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: overall HEALTH_OK 2024-09-21T07:04:04.202 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.202 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.202 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.202 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:03 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: mon.a calling monitor election 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: mon.c calling monitor election 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: mon.b calling monitor election 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:04.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: monmap epoch 3 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: last_changed 2024-09-21T07:03:58.795201+0000 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: created 2024-09-21T07:02:25.230849+0000 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: min_mon_release 19 (squid) 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: election_strategy: 1 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: 2: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: fsmap 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:04:04.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: mgrmap e13: x(active, since 47s) 2024-09-21T07:04:04.365 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: overall HEALTH_OK 2024-09-21T07:04:04.365 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.365 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.365 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.365 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:03 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:04.802 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T07:04:04.803 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T07:04:05.063 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:05.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:04 smithi175 ceph-mon[34064]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:05.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:04 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:05.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:04 smithi175 ceph-mon[34064]: from='client.? 172.21.15.175:0/2792555574' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:04:05.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:04 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:05.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:04 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:05.095 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:04 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:04 smithi092 ceph-mon[30987]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:04 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:04 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/2792555574' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:04:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:04 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:04 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:04 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:04 smithi169 ceph-mon[33705]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:04 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:04 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/2792555574' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:04:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:04 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:04 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:04 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:05.765 INFO:teuthology.orchestra.run.smithi092.stdout:# minimal ceph.conf for 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:04:05.765 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2024-09-21T07:04:05.765 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:04:05.765 INFO:teuthology.orchestra.run.smithi092.stdout: mon_host = [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-09-21T07:04:06.358 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T07:04:06.358 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:04:06.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:04:06.387 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:04:06.387 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:06.452 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T07:04:06.453 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:04:06.481 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T07:04:06.481 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:06.546 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T07:04:06.546 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:04:06.575 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T07:04:06.575 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:06.644 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T07:04:06.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T07:04:06.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:06.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3873774869' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:06.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:06.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:06.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:06 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-21T07:04:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-21T07:04:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T07:04:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3873774869' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:06.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:06.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:06.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:06.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:06 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-21T07:04:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-21T07:04:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T07:04:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3873774869' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:07.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:07.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:07.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:06 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:07.421 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:07.814 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:07 smithi169 ceph-mon[33705]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:04:07.814 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:07 smithi169 ceph-mon[33705]: Reconfiguring daemon mon.a on smithi092 2024-09-21T07:04:09.105 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:07 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:09.106 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:07 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:09.106 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:07 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:09.106 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:07 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:09.106 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:07 smithi169 ceph-mon[33705]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:09.107 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:08 smithi169 ceph-mon[33705]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:04:09.107 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:08 smithi169 ceph-mon[33705]: Reconfiguring daemon mon.b on smithi169 2024-09-21T07:04:09.107 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:08 smithi169 ceph-mon[33705]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:09.107 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:08 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3002254888' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T07:04:09.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:07 smithi175 ceph-mon[34064]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:04:09.107 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:07 smithi175 ceph-mon[34064]: Reconfiguring daemon mon.a on smithi092 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:07 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:07 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:07 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:07 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:07 smithi175 ceph-mon[34064]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:08 smithi175 ceph-mon[34064]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:08 smithi175 ceph-mon[34064]: Reconfiguring daemon mon.b on smithi169 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:08 smithi175 ceph-mon[34064]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:08 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3002254888' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:07 smithi092 ceph-mon[30987]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:07 smithi092 ceph-mon[30987]: Reconfiguring daemon mon.a on smithi092 2024-09-21T07:04:09.108 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:07 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:09.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:07 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' 2024-09-21T07:04:09.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:07 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:09.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:07 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:09.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:07 smithi092 ceph-mon[30987]: from='mgr.14152 172.21.15.92:0/455745678' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:09.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:08 smithi092 ceph-mon[30987]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:04:09.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:08 smithi092 ceph-mon[30987]: Reconfiguring daemon mon.b on smithi169 2024-09-21T07:04:09.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:08 smithi092 ceph-mon[30987]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:09.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:08 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3002254888' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T07:04:09.109 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:08 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: ignoring --setuser ceph since I am not root 2024-09-21T07:04:09.109 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:08 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: ignoring --setgroup ceph since I am not root 2024-09-21T07:04:09.220 INFO:tasks.cephadm:Adding mgr.x on smithi092 2024-09-21T07:04:09.221 INFO:tasks.cephadm:Adding mgr.y on smithi169 2024-09-21T07:04:09.221 INFO:tasks.cephadm:Adding mgr.z on smithi175 2024-09-21T07:04:09.221 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi092=x;smithi169=y;smithi175=z' 2024-09-21T07:04:09.469 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:04:09.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:09 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3002254888' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T07:04:09.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:09 smithi092 ceph-mon[30987]: mgrmap e14: x(active, since 52s) 2024-09-21T07:04:09.865 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:09 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3002254888' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T07:04:09.866 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:09 smithi175 ceph-mon[34064]: mgrmap e14: x(active, since 52s) 2024-09-21T07:04:09.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:09 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3002254888' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T07:04:09.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:09 smithi169 ceph-mon[33705]: mgrmap e14: x(active, since 52s) 2024-09-21T07:04:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: Active manager daemon x restarted 2024-09-21T07:04:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: Activating manager daemon x 2024-09-21T07:04:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:04:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: mgrmap e15: x(active, starting, since 0.00543307s) 2024-09-21T07:04:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:04:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:04:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:04:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:04:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:04:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:04:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:13 smithi092 ceph-mon[30987]: Manager daemon x is now available 2024-09-21T07:04:13.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: Active manager daemon x restarted 2024-09-21T07:04:13.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: Activating manager daemon x 2024-09-21T07:04:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:04:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: mgrmap e15: x(active, starting, since 0.00543307s) 2024-09-21T07:04:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:04:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:04:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:04:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:04:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:04:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:04:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:13 smithi169 ceph-mon[33705]: Manager daemon x is now available 2024-09-21T07:04:13.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: Active manager daemon x restarted 2024-09-21T07:04:13.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: Activating manager daemon x 2024-09-21T07:04:13.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:04:13.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: mgrmap e15: x(active, starting, since 0.00543307s) 2024-09-21T07:04:13.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:04:13.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:04:13.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:04:13.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:04:13.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:04:13.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:04:13.917 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:04:13.917 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:13 smithi175 ceph-mon[34064]: Manager daemon x is now available 2024-09-21T07:04:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mgr update... 2024-09-21T07:04:14.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:15.152 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:04:15.152 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:04:15.152 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:14 smithi175 ceph-mon[34064]: mgrmap e16: x(active, since 1.00905s) 2024-09-21T07:04:15.152 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.153 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:15.154 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:04:15.154 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:04:15.154 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:14 smithi169 ceph-mon[33705]: mgrmap e16: x(active, since 1.00905s) 2024-09-21T07:04:15.154 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:15.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:04:15.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:04:15.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:14 smithi092 ceph-mon[30987]: mgrmap e16: x(active, since 1.00905s) 2024-09-21T07:04:15.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.617 DEBUG:teuthology.orchestra.run.smithi169:mgr.y> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T07:04:15.620 DEBUG:teuthology.orchestra.run.smithi175:mgr.z> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T07:04:15.623 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T07:04:15.623 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T07:04:15.625 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T07:04:15.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T07:04:15.668 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T07:04:15.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T07:04:15.710 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T07:04:15.710 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T07:04:15.753 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T07:04:15.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T07:04:15.796 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T07:04:15.796 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T07:04:15.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:15 smithi092 ceph-mon[30987]: Saving service mgr spec with placement smithi092=x;smithi169=y;smithi175=z;count:3 2024-09-21T07:04:15.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:15.827 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T07:04:15.828 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T07:04:15.871 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T07:04:15.871 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T07:04:15.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:15 smithi169 ceph-mon[33705]: Saving service mgr spec with placement smithi092=x;smithi169=y;smithi175=z;count:3 2024-09-21T07:04:15.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:15.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:15.914 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T07:04:15.914 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T07:04:15.928 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:15.946 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T07:04:15.946 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T07:04:15.991 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T07:04:15.991 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T07:04:16.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:15 smithi175 ceph-mon[34064]: Saving service mgr spec with placement smithi092=x;smithi169=y;smithi175=z;count:3 2024-09-21T07:04:16.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:16.035 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T07:04:16.036 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T07:04:16.088 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T07:04:16.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T07:04:16.137 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T07:04:16.137 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T07:04:16.181 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T07:04:16.181 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T07:04:16.228 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T07:04:16.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T07:04:16.282 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T07:04:16.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T07:04:16.333 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T07:04:16.334 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T07:04:16.364 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:04:16.077+0000 7fc74bf86640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:04:16] ENGINE Error in HTTPServer.serve 2024-09-21T07:04:16.364 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: Traceback (most recent call last): 2024-09-21T07:04:16.365 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:04:16.365 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self._connections.run(self.expiration_interval) 2024-09-21T07:04:16.365 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:04:16.365 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self._run(expiration_interval) 2024-09-21T07:04:16.365 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:04:16.365 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:04:16.366 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:04:16.366 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:04:16.366 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:04:16.366 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: s = self.context.wrap_socket( 2024-09-21T07:04:16.366 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:04:16.366 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: return self.sslsocket_class._create( 2024-09-21T07:04:16.367 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:04:16.367 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self.do_handshake() 2024-09-21T07:04:16.367 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:04:16.367 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: self._sslobj.do_handshake() 2024-09-21T07:04:16.367 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:04:16.367 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:04:16.368 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T07:04:16.369 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T07:04:16.415 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T07:04:16.416 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T07:04:16.466 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T07:04:16.467 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T07:04:16.519 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T07:04:16.519 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T07:04:16.563 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T07:04:16.564 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T07:04:16.628 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T07:04:16.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T07:04:16.691 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T07:04:16.691 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T07:04:16.692 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:16.736 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T07:04:16.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T07:04:16.788 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T07:04:16.789 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T07:04:16.840 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T07:04:16.841 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T07:04:16.927 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T07:04:16.927 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: [21/Sep/2024:07:04:15] ENGINE Bus STARTING 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: [21/Sep/2024:07:04:15] ENGINE Serving on http://172.21.15.92:8765 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:16.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: [21/Sep/2024:07:04:16] ENGINE Serving on https://172.21.15.92:7150 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: [21/Sep/2024:07:04:16] ENGINE Bus STARTED 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: [21/Sep/2024:07:04:16] ENGINE Error in HTTPServer.serve 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout: Traceback (most recent call last): 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._run(expiration_interval) 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:04:16.929 INFO:journalctl@ceph.mon.a.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout: s = self.context.wrap_socket( 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout: return self.sslsocket_class._create( 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout: self.do_handshake() 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._sslobj.do_handshake() 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:16.930 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:16.931 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: mgrmap e17: x(active, since 3s) 2024-09-21T07:04:16.931 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:04:16.931 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:16 smithi092 ceph-mon[30987]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:04:16.992 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T07:04:16.992 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T07:04:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: [21/Sep/2024:07:04:15] ENGINE Bus STARTING 2024-09-21T07:04:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: [21/Sep/2024:07:04:15] ENGINE Serving on http://172.21.15.92:8765 2024-09-21T07:04:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: [21/Sep/2024:07:04:16] ENGINE Serving on https://172.21.15.92:7150 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: [21/Sep/2024:07:04:16] ENGINE Bus STARTED 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: [21/Sep/2024:07:04:16] ENGINE Error in HTTPServer.serve 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout: Traceback (most recent call last): 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout: self._run(expiration_interval) 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:04:17.019 INFO:journalctl@ceph.mon.c.smithi175.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: s = self.context.wrap_socket( 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: return self.sslsocket_class._create( 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: self.do_handshake() 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: self._sslobj.do_handshake() 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:17.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:17.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:17.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: mgrmap e17: x(active, since 3s) 2024-09-21T07:04:17.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:04:17.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:16 smithi175 ceph-mon[34064]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:04:17.050 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T07:04:17.051 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi092') 2024-09-21T07:04:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: [21/Sep/2024:07:04:15] ENGINE Bus STARTING 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: [21/Sep/2024:07:04:15] ENGINE Serving on http://172.21.15.92:8765 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: [21/Sep/2024:07:04:16] ENGINE Serving on https://172.21.15.92:7150 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: [21/Sep/2024:07:04:16] ENGINE Bus STARTED 2024-09-21T07:04:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: [21/Sep/2024:07:04:16] ENGINE Error in HTTPServer.serve 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: Traceback (most recent call last): 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: self._run(expiration_interval) 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: s = self.context.wrap_socket( 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: return self.sslsocket_class._create( 2024-09-21T07:04:17.145 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout: self.do_handshake() 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout: self._sslobj.do_handshake() 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: mgrmap e17: x(active, since 3s) 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: Updating smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:04:17.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:16 smithi169 ceph-mon[33705]: Updating smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:04:17.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:17 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:17 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:17 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:17 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:17.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:17 smithi092 ceph-mon[30987]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:17.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:17 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/293054489' entity='client.admin' 2024-09-21T07:04:17.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:17 smithi092 ceph-mon[30987]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:18.008 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi092') 2024-09-21T07:04:18.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:17 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:18.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:17 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:18.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:17 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:18.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:17 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:18.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:17 smithi175 ceph-mon[34064]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:18.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:17 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/293054489' entity='client.admin' 2024-09-21T07:04:18.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:17 smithi175 ceph-mon[34064]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:17 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:17 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:17 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:17 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:18.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:17 smithi169 ceph-mon[33705]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:04:18.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:17 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/293054489' entity='client.admin' 2024-09-21T07:04:18.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:17 smithi169 ceph-mon[33705]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:04:18.209 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:18.258 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:18.259 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:18.265 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:18.268 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:18.268 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:19.072 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:18 smithi092 ceph-mon[30987]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:04:19.072 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:19.072 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:19.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:19.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:04:19.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:04:19.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:04:19.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:19.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:18 smithi092 ceph-mon[30987]: Deploying daemon mgr.z on smithi175 2024-09-21T07:04:19.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:18 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/892137541' entity='client.admin' 2024-09-21T07:04:19.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:18 smithi175 ceph-mon[34064]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:04:19.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:19.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:19.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:19.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:04:19.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:04:19.096 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:04:19.097 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:19.097 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:18 smithi175 ceph-mon[34064]: Deploying daemon mgr.z on smithi175 2024-09-21T07:04:19.097 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:18 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/892137541' entity='client.admin' 2024-09-21T07:04:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:18 smithi169 ceph-mon[33705]: Updating smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:04:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:04:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:04:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:04:19.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:19.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:18 smithi169 ceph-mon[33705]: Deploying daemon mgr.z on smithi175 2024-09-21T07:04:19.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:18 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/892137541' entity='client.admin' 2024-09-21T07:04:19.749 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:04:19 smithi175 systemd[1]: Starting Ceph mgr.z for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:04:20.001 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:04:19 smithi175 podman[35940]: 2024-09-21 07:04:19.747505398 +0000 UTC m=+0.102518920 container create aab098ccbcb889459806ff20ebfc877d59ff131abd8b7e3833997c3788802fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-z, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:04:20.001 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:04:19 smithi175 podman[35940]: 2024-09-21 07:04:19.660711713 +0000 UTC m=+0.015725244 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:20.001 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:04:19 smithi175 podman[35940]: 2024-09-21 07:04:19.999909013 +0000 UTC m=+0.354922546 container init aab098ccbcb889459806ff20ebfc877d59ff131abd8b7e3833997c3788802fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T07:04:20.268 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:04:20 smithi175 podman[35940]: 2024-09-21 07:04:20.002937157 +0000 UTC m=+0.357950679 container start aab098ccbcb889459806ff20ebfc877d59ff131abd8b7e3833997c3788802fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T07:04:20.268 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mgr[35959]: -- 172.21.15.175:0/2437072687 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a71aa10e0 con 0x556a76844000 2024-09-21T07:04:20.268 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:04:20 smithi175 bash[35940]: aab098ccbcb889459806ff20ebfc877d59ff131abd8b7e3833997c3788802fd0 2024-09-21T07:04:20.268 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:04:20 smithi175 systemd[1]: Started Ceph mgr.z for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:04:20.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1866209959' entity='client.admin' 2024-09-21T07:04:20.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1668625837' entity='client.admin' 2024-09-21T07:04:20.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/547288302' entity='client.admin' 2024-09-21T07:04:20.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:20.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:20.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:20.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:04:20.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:04:20.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:04:20.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:20.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1866209959' entity='client.admin' 2024-09-21T07:04:20.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1668625837' entity='client.admin' 2024-09-21T07:04:20.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/547288302' entity='client.admin' 2024-09-21T07:04:20.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:20.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:20.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:20.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:04:20.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:04:20.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:04:20.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:20.549 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1866209959' entity='client.admin' 2024-09-21T07:04:20.550 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1668625837' entity='client.admin' 2024-09-21T07:04:20.550 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/547288302' entity='client.admin' 2024-09-21T07:04:20.550 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:20.550 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:20.550 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:20.550 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:04:20.550 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:04:20.550 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:04:20.550 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:20.750 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi092') 2024-09-21T07:04:21.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:21 smithi092 ceph-mon[30987]: Deploying daemon mgr.y on smithi169 2024-09-21T07:04:21.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.373+0000 7f5607706640 1 -- 172.21.15.92:0/1130571391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5600109df0 msgr2=0x7f5600110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:21.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.373+0000 7f5607706640 1 --2- 172.21.15.92:0/1130571391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5600109df0 0x7f5600110620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009ca0 tx=0x7f55f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.373+0000 7f5607706640 1 -- 172.21.15.92:0/1130571391 shutdown_connections 2024-09-21T07:04:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.373+0000 7f5607706640 1 --2- 172.21.15.92:0/1130571391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5600109df0 0x7f5600110620 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.373+0000 7f5607706640 1 --2- 172.21.15.92:0/1130571391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56001094a0 0x7f56001098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.373+0000 7f5607706640 1 --2- 172.21.15.92:0/1130571391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5600103b60 0x7f5600103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.373+0000 7f5607706640 1 -- 172.21.15.92:0/1130571391 >> 172.21.15.92:0/1130571391 conn(0x7f560007b850 msgr2=0x7f560007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.373+0000 7f5607706640 1 -- 172.21.15.92:0/1130571391 shutdown_connections 2024-09-21T07:04:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.373+0000 7f5607706640 1 -- 172.21.15.92:0/1130571391 wait complete. 2024-09-21T07:04:21.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.374+0000 7f5607706640 1 Processor -- start 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.374+0000 7f5607706640 1 -- start start 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.374+0000 7f5607706640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5600103b60 0x7f560019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.374+0000 7f5607706640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56001094a0 0x7f560019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.374+0000 7f5607706640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5600109df0 0x7f560019f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.374+0000 7f5607706640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5600113720 con 0x7f56001094a0 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.374+0000 7f5607706640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f56001135a0 con 0x7f5600109df0 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.374+0000 7f5607706640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56001138a0 con 0x7f5600103b60 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5604ca1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56001094a0 0x7f560019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5604ca1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56001094a0 0x7f560019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47554/0 (socket says 172.21.15.92:47554) 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5604ca1640 1 -- 172.21.15.92:0/1251053932 learned_addr learned my addr 172.21.15.92:0/1251053932 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:21.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f56054a2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5600103b60 0x7f560019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:21.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5605ca3640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5600109df0 0x7f560019f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:21.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5604ca1640 1 -- 172.21.15.92:0/1251053932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5600103b60 msgr2=0x7f560019a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:21.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5604ca1640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5600103b60 0x7f560019a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5604ca1640 1 -- 172.21.15.92:0/1251053932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5600109df0 msgr2=0x7f560019f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:21.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5604ca1640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5600109df0 0x7f560019f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5604ca1640 1 -- 172.21.15.92:0/1251053932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56001a0120 con 0x7f56001094a0 2024-09-21T07:04:21.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5604ca1640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56001094a0 0x7f560019a750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f55f000d740 tx=0x7f55f000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:21.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f55f67fc640 1 -- 172.21.15.92:0/1251053932 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0017070 con 0x7f56001094a0 2024-09-21T07:04:21.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f55f67fc640 1 -- 172.21.15.92:0/1251053932 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f55f000de50 con 0x7f56001094a0 2024-09-21T07:04:21.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5607706640 1 -- 172.21.15.92:0/1251053932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56001a0410 con 0x7f56001094a0 2024-09-21T07:04:21.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f55f67fc640 1 -- 172.21.15.92:0/1251053932 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f000f3c0 con 0x7f56001094a0 2024-09-21T07:04:21.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.375+0000 7f5607706640 1 -- 172.21.15.92:0/1251053932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56001a6b70 con 0x7f56001094a0 2024-09-21T07:04:21.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.376+0000 7f55f67fc640 1 -- 172.21.15.92:0/1251053932 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f55f001a070 con 0x7f56001094a0 2024-09-21T07:04:21.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.376+0000 7f5607706640 1 -- 172.21.15.92:0/1251053932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5600103f70 con 0x7f56001094a0 2024-09-21T07:04:21.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.377+0000 7f55f67fc640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f55ec03fb70 0x7f55ec042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:21.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.377+0000 7f55f67fc640 1 -- 172.21.15.92:0/1251053932 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f55f0054d90 con 0x7f56001094a0 2024-09-21T07:04:21.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.377+0000 7f56054a2640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f55ec03fb70 0x7f55ec042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:21.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.377+0000 7f56054a2640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f55ec03fb70 0x7f55ec042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00bbe0 tx=0x7f55fc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:21.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.382+0000 7f55f67fc640 1 -- 172.21.15.92:0/1251053932 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55f001bdc0 con 0x7f56001094a0 2024-09-21T07:04:21.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:21 smithi175 ceph-mon[34064]: Deploying daemon mgr.y on smithi169 2024-09-21T07:04:21.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.042+0000 7fce014bb640 1 -- 172.21.15.92:0/547288302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fcdfc10aac0 con 0x7fcdfc1083a0 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.047+0000 7fcde3fff640 1 -- 172.21.15.92:0/547288302 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v14)=0 v14) ==== 117+0+0 (secure 0 0 0) 0x7fcdf000e350 con 0x7fcdfc1083a0 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 -- 172.21.15.92:0/547288302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcde403fb70 msgr2=0x7fcde4042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 --2- 172.21.15.92:0/547288302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcde403fb70 0x7fcde4042080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcdec005f70 tx=0x7fcdec005d50 comp rx=0 tx=0).stop 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 -- 172.21.15.92:0/547288302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcdfc1083a0 msgr2=0x7fcdfc1995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 --2- 172.21.15.92:0/547288302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcdfc1083a0 0x7fcdfc1995e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000d770 tx=0x7fcdf000dc30 comp rx=0 tx=0).stop 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 -- 172.21.15.92:0/547288302 shutdown_connections 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 --2- 172.21.15.92:0/547288302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcde403fb70 0x7fcde4042080 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 --2- 172.21.15.92:0/547288302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdfc108cf0 0x7fcdfc19e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 --2- 172.21.15.92:0/547288302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcdfc1083a0 0x7fcdfc1995e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 --2- 172.21.15.92:0/547288302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdfc102a60 0x7fcdfc199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 -- 172.21.15.92:0/547288302 >> 172.21.15.92:0/547288302 conn(0x7fcdfc079730 msgr2=0x7fcdfc1017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:21.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 -- 172.21.15.92:0/547288302 shutdown_connections 2024-09-21T07:04:21.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:20.049+0000 7fce014bb640 1 -- 172.21.15.92:0/547288302 wait complete. 2024-09-21T07:04:21.515 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:21 smithi169 ceph-mon[33705]: Deploying daemon mgr.y on smithi169 2024-09-21T07:04:21.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.563+0000 7f5607706640 1 -- 172.21.15.92:0/1251053932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f560010bb70 con 0x7f56001094a0 2024-09-21T07:04:21.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.567+0000 7f55f67fc640 1 -- 172.21.15.92:0/1251053932 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v15)=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f55f00536d0 con 0x7f56001094a0 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 -- 172.21.15.92:0/1251053932 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f55ec03fb70 msgr2=0x7f55ec042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f55ec03fb70 0x7f55ec042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00bbe0 tx=0x7f55fc00b390 comp rx=0 tx=0).stop 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 -- 172.21.15.92:0/1251053932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56001094a0 msgr2=0x7f560019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56001094a0 0x7f560019a750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f55f000d740 tx=0x7f55f000dc00 comp rx=0 tx=0).stop 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 -- 172.21.15.92:0/1251053932 shutdown_connections 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f55ec03fb70 0x7f55ec042080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5600109df0 0x7f560019f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56001094a0 0x7f560019a750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 --2- 172.21.15.92:0/1251053932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5600103b60 0x7f560019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 -- 172.21.15.92:0/1251053932 >> 172.21.15.92:0/1251053932 conn(0x7f560007b850 msgr2=0x7f56001076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 -- 172.21.15.92:0/1251053932 shutdown_connections 2024-09-21T07:04:21.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:21.570+0000 7f5607706640 1 -- 172.21.15.92:0/1251053932 wait complete. 2024-09-21T07:04:21.893 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:04:21 smithi169 systemd[1]: Starting Ceph mgr.y for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:04:22.180 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:04:21 smithi169 podman[35213]: 2024-09-21 07:04:21.830715019 +0000 UTC m=+0.015729514 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:04:22.181 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:04:21 smithi169 podman[35213]: 2024-09-21 07:04:21.931121084 +0000 UTC m=+0.116135567 container create 1d315b83ec9111c03215a4cb38fc7bcbdbf4ba17e035888cce57db40eb6a1d82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T07:04:22.181 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:04:22 smithi169 podman[35213]: 2024-09-21 07:04:22.141734116 +0000 UTC m=+0.326748605 container init 1d315b83ec9111c03215a4cb38fc7bcbdbf4ba17e035888cce57db40eb6a1d82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-21T07:04:22.181 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:04:22 smithi169 podman[35213]: 2024-09-21 07:04:22.14456508 +0000 UTC m=+0.329579560 container start 1d315b83ec9111c03215a4cb38fc7bcbdbf4ba17e035888cce57db40eb6a1d82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:04:22.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.332+0000 7f36c0d42640 1 -- 172.21.15.92:0/1516191406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36bc102a80 msgr2=0x7f36bc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.332+0000 7f36c0d42640 1 --2- 172.21.15.92:0/1516191406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36bc102a80 0x7f36bc102e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009900 tx=0x7f36b402a410 comp rx=0 tx=0).stop 2024-09-21T07:04:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.333+0000 7f36c0d42640 1 -- 172.21.15.92:0/1516191406 shutdown_connections 2024-09-21T07:04:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.333+0000 7f36c0d42640 1 --2- 172.21.15.92:0/1516191406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36bc108d10 0x7f36bc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.333+0000 7f36c0d42640 1 --2- 172.21.15.92:0/1516191406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc1083c0 0x7f36bc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.333+0000 7f36c0d42640 1 --2- 172.21.15.92:0/1516191406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36bc102a80 0x7f36bc102e90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.333+0000 7f36c0d42640 1 -- 172.21.15.92:0/1516191406 >> 172.21.15.92:0/1516191406 conn(0x7f36bc079740 msgr2=0x7f36bc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.333+0000 7f36c0d42640 1 -- 172.21.15.92:0/1516191406 shutdown_connections 2024-09-21T07:04:22.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.333+0000 7f36c0d42640 1 -- 172.21.15.92:0/1516191406 wait complete. 2024-09-21T07:04:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.333+0000 7f36c0d42640 1 Processor -- start 2024-09-21T07:04:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.333+0000 7f36c0d42640 1 -- start start 2024-09-21T07:04:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36c0d42640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36bc102a80 0x7f36bc19af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36c0d42640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc1083c0 0x7f36bc19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36c0d42640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36bc108d10 0x7f36bc19ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36c0d42640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc112640 con 0x7f36bc102a80 2024-09-21T07:04:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36c0d42640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1124c0 con 0x7f36bc1083c0 2024-09-21T07:04:22.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36c0d42640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1127c0 con 0x7f36bc108d10 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36ba59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36bc102a80 0x7f36bc19af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36ba59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36bc102a80 0x7f36bc19af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47570/0 (socket says 172.21.15.92:47570) 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36ba59c640 1 -- 172.21.15.92:0/561558230 learned_addr learned my addr 172.21.15.92:0/561558230 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36bad9d640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36bc108d10 0x7f36bc19ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36b9d9b640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc1083c0 0x7f36bc19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36ba59c640 1 -- 172.21.15.92:0/561558230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36bc108d10 msgr2=0x7f36bc19ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36ba59c640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36bc108d10 0x7f36bc19ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36ba59c640 1 -- 172.21.15.92:0/561558230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc1083c0 msgr2=0x7f36bc19b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36ba59c640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc1083c0 0x7f36bc19b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36ba59c640 1 -- 172.21.15.92:0/561558230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc1a6190 con 0x7f36bc102a80 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.334+0000 7f36ba59c640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36bc102a80 0x7f36bc19af90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f36b4005ab0 tx=0x7f36b4003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.335+0000 7f36ab7fe640 1 -- 172.21.15.92:0/561558230 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b403f070 con 0x7f36bc102a80 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.335+0000 7f36ab7fe640 1 -- 172.21.15.92:0/561558230 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f36b403bcc0 con 0x7f36bc102a80 2024-09-21T07:04:22.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.335+0000 7f36ab7fe640 1 -- 172.21.15.92:0/561558230 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4035030 con 0x7f36bc102a80 2024-09-21T07:04:22.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.335+0000 7f36c0d42640 1 -- 172.21.15.92:0/561558230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc1a6420 con 0x7f36bc102a80 2024-09-21T07:04:22.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.335+0000 7f36c0d42640 1 -- 172.21.15.92:0/561558230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc1a6950 con 0x7f36bc102a80 2024-09-21T07:04:22.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.336+0000 7f36c0d42640 1 -- 172.21.15.92:0/561558230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36bc102e90 con 0x7f36bc102a80 2024-09-21T07:04:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.336+0000 7f36ab7fe640 1 -- 172.21.15.92:0/561558230 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f36b4042070 con 0x7f36bc102a80 2024-09-21T07:04:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.336+0000 7f36ab7fe640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a403fba0 0x7f36a40420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.336+0000 7f36ab7fe640 1 -- 172.21.15.92:0/561558230 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f36b4074ee0 con 0x7f36bc102a80 2024-09-21T07:04:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.336+0000 7f36b9d9b640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a403fba0 0x7f36a40420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:22.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.336+0000 7f36b9d9b640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a403fba0 0x7f36a40420b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f36bc100d40 tx=0x7f36b00075b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:22.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.341+0000 7f36ab7fe640 1 -- 172.21.15.92:0/561558230 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36b4045d70 con 0x7f36bc102a80 2024-09-21T07:04:22.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.538+0000 7f36c0d42640 1 -- 172.21.15.92:0/561558230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f36bc10aae0 con 0x7f36bc102a80 2024-09-21T07:04:22.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.543+0000 7f36ab7fe640 1 -- 172.21.15.92:0/561558230 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7f36b4036db0 con 0x7f36bc102a80 2024-09-21T07:04:22.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.544+0000 7f36ab7fe640 1 -- 172.21.15.92:0/561558230 <== mon.0 v2:172.21.15.92:3300/0 8 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f36b4043ea0 con 0x7f36bc102a80 2024-09-21T07:04:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 -- 172.21.15.92:0/561558230 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a403fba0 msgr2=0x7f36a40420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a403fba0 0x7f36a40420b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f36bc100d40 tx=0x7f36b00075b0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 -- 172.21.15.92:0/561558230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36bc102a80 msgr2=0x7f36bc19af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36bc102a80 0x7f36bc19af90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f36b4005ab0 tx=0x7f36b4003d50 comp rx=0 tx=0).stop 2024-09-21T07:04:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 -- 172.21.15.92:0/561558230 shutdown_connections 2024-09-21T07:04:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a403fba0 0x7f36a40420b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36bc108d10 0x7f36bc19ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36bc1083c0 0x7f36bc19b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 --2- 172.21.15.92:0/561558230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36bc102a80 0x7f36bc19af90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 -- 172.21.15.92:0/561558230 >> 172.21.15.92:0/561558230 conn(0x7f36bc079740 msgr2=0x7f36bc101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 -- 172.21.15.92:0/561558230 shutdown_connections 2024-09-21T07:04:22.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.545+0000 7f36c0d42640 1 -- 172.21.15.92:0/561558230 wait complete. 2024-09-21T07:04:22.571 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:04:22 smithi169 ceph-mgr[35232]: -- 172.21.15.169:0/3375491268 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5637959010e0 con 0x56379591fa80 2024-09-21T07:04:22.571 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:04:22 smithi169 bash[35213]: 1d315b83ec9111c03215a4cb38fc7bcbdbf4ba17e035888cce57db40eb6a1d82 2024-09-21T07:04:22.571 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:04:22 smithi169 systemd[1]: Started Ceph mgr.y for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:04:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:22 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1251053932' entity='client.admin' 2024-09-21T07:04:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:22.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:22 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/561558230' entity='client.admin' 2024-09-21T07:04:22.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:22 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1251053932' entity='client.admin' 2024-09-21T07:04:22.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:22.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:22 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/561558230' entity='client.admin' 2024-09-21T07:04:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:22 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1251053932' entity='client.admin' 2024-09-21T07:04:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:22 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/561558230' entity='client.admin' 2024-09-21T07:04:22.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.940+0000 7f8764b86640 1 -- 172.21.15.92:0/2753095929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8760103bb0 msgr2=0x7f8760103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.940+0000 7f8764b86640 1 --2- 172.21.15.92:0/2753095929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8760103bb0 0x7f8760103fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8750009900 tx=0x7f875002a410 comp rx=0 tx=0).stop 2024-09-21T07:04:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.940+0000 7f8764b86640 1 -- 172.21.15.92:0/2753095929 shutdown_connections 2024-09-21T07:04:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.940+0000 7f8764b86640 1 --2- 172.21.15.92:0/2753095929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760109e40 0x7f8760110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.940+0000 7f8764b86640 1 --2- 172.21.15.92:0/2753095929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87601094f0 0x7f8760109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.940+0000 7f8764b86640 1 --2- 172.21.15.92:0/2753095929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8760103bb0 0x7f8760103fc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.940+0000 7f8764b86640 1 -- 172.21.15.92:0/2753095929 >> 172.21.15.92:0/2753095929 conn(0x7f87600ff600 msgr2=0x7f8760101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.940+0000 7f8764b86640 1 -- 172.21.15.92:0/2753095929 shutdown_connections 2024-09-21T07:04:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.940+0000 7f8764b86640 1 -- 172.21.15.92:0/2753095929 wait complete. 2024-09-21T07:04:22.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.941+0000 7f8764b86640 1 Processor -- start 2024-09-21T07:04:22.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.941+0000 7f8764b86640 1 -- start start 2024-09-21T07:04:22.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.941+0000 7f8764b86640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760103bb0 0x7f8760075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:22.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.941+0000 7f8764b86640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87601094f0 0x7f8760075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:22.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.941+0000 7f8764b86640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8760109e40 0x7f8760076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:22.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f8764b86640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8760113890 con 0x7f87601094f0 2024-09-21T07:04:22.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f8764b86640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8760113710 con 0x7f8760103bb0 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f8764b86640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8760113a10 con 0x7f8760109e40 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87601094f0 0x7f8760075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87601094f0 0x7f8760075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47584/0 (socket says 172.21.15.92:47584) 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875dd9b640 1 -- 172.21.15.92:0/4197619032 learned_addr learned my addr 172.21.15.92:0/4197619032 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875e59c640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760103bb0 0x7f8760075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875ed9d640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8760109e40 0x7f8760076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875dd9b640 1 -- 172.21.15.92:0/4197619032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8760109e40 msgr2=0x7f8760076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875dd9b640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8760109e40 0x7f8760076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875dd9b640 1 -- 172.21.15.92:0/4197619032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760103bb0 msgr2=0x7f8760075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875dd9b640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760103bb0 0x7f8760075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875dd9b640 1 -- 172.21.15.92:0/4197619032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87601a85a0 con 0x7f87601094f0 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f875dd9b640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87601094f0 0x7f8760075c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f874800d950 tx=0x7f874800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:22.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f87577fe640 1 -- 172.21.15.92:0/4197619032 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748017070 con 0x7f87601094f0 2024-09-21T07:04:22.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f87577fe640 1 -- 172.21.15.92:0/4197619032 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8748004490 con 0x7f87601094f0 2024-09-21T07:04:22.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f8764b86640 1 -- 172.21.15.92:0/4197619032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87601a8890 con 0x7f87601094f0 2024-09-21T07:04:22.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.942+0000 7f87577fe640 1 -- 172.21.15.92:0/4197619032 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748005540 con 0x7f87601094f0 2024-09-21T07:04:22.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.943+0000 7f8764b86640 1 -- 172.21.15.92:0/4197619032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87601a8e20 con 0x7f87601094f0 2024-09-21T07:04:22.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.944+0000 7f8764b86640 1 -- 172.21.15.92:0/4197619032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8760103fc0 con 0x7f87601094f0 2024-09-21T07:04:22.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.944+0000 7f87577fe640 1 -- 172.21.15.92:0/4197619032 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f87480047a0 con 0x7f87601094f0 2024-09-21T07:04:22.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.944+0000 7f87577fe640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f874c03fb70 0x7f874c042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:22.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.944+0000 7f87577fe640 1 -- 172.21.15.92:0/4197619032 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f87480542a0 con 0x7f87601094f0 2024-09-21T07:04:22.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.944+0000 7f875e59c640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f874c03fb70 0x7f874c042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:22.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.945+0000 7f875e59c640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f874c03fb70 0x7f874c042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8760077160 tx=0x7f87500058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:22.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:22.949+0000 7f87577fe640 1 -- 172.21.15.92:0/4197619032 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8748020020 con 0x7f87601094f0 2024-09-21T07:04:23.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.133+0000 7f8764b86640 1 -- 172.21.15.92:0/4197619032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f876010bbc0 con 0x7f87601094f0 2024-09-21T07:04:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.136+0000 7f87577fe640 1 -- 172.21.15.92:0/4197619032 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7f874800e350 con 0x7f87601094f0 2024-09-21T07:04:23.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 -- 172.21.15.92:0/4197619032 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f874c03fb70 msgr2=0x7f874c042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:23.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f874c03fb70 0x7f874c042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8760077160 tx=0x7f87500058d0 comp rx=0 tx=0).stop 2024-09-21T07:04:23.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 -- 172.21.15.92:0/4197619032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87601094f0 msgr2=0x7f8760075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:23.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87601094f0 0x7f8760075c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f874800d950 tx=0x7f874800de10 comp rx=0 tx=0).stop 2024-09-21T07:04:23.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 -- 172.21.15.92:0/4197619032 shutdown_connections 2024-09-21T07:04:23.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f874c03fb70 0x7f874c042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:23.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8760109e40 0x7f8760076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:23.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87601094f0 0x7f8760075c50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:23.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 --2- 172.21.15.92:0/4197619032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760103bb0 0x7f8760075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 -- 172.21.15.92:0/4197619032 >> 172.21.15.92:0/4197619032 conn(0x7f87600ff600 msgr2=0x7f8760101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 -- 172.21.15.92:0/4197619032 shutdown_connections 2024-09-21T07:04:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:23.139+0000 7f8764b86640 1 -- 172.21.15.92:0/4197619032 wait complete. 2024-09-21T07:04:23.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.965+0000 7ff726f8f640 1 -- 172.21.15.92:0/1668625837 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff70c03fb70 msgr2=0x7ff70c042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:23.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.965+0000 7ff726f8f640 1 --2- 172.21.15.92:0/1668625837 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff70c03fb70 0x7ff70c042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff7080096c0 tx=0x7ff708005d50 comp rx=0 tx=0).stop 2024-09-21T07:04:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.965+0000 7ff726f8f640 1 -- 172.21.15.92:0/1668625837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7201083a0 msgr2=0x7ff72019a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.965+0000 7ff726f8f640 1 --2- 172.21.15.92:0/1668625837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7201083a0 0x7ff72019a6b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff71000ea80 tx=0x7ff71000ef40 comp rx=0 tx=0).stop 2024-09-21T07:04:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.965+0000 7ff726f8f640 1 -- 172.21.15.92:0/1668625837 shutdown_connections 2024-09-21T07:04:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.965+0000 7ff726f8f640 1 --2- 172.21.15.92:0/1668625837 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff70c03fb70 0x7ff70c042080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.965+0000 7ff726f8f640 1 --2- 172.21.15.92:0/1668625837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff720108cf0 0x7ff72019f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.966+0000 7ff726f8f640 1 --2- 172.21.15.92:0/1668625837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7201083a0 0x7ff72019a6b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.966+0000 7ff726f8f640 1 --2- 172.21.15.92:0/1668625837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff720102a60 0x7ff72019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.966+0000 7ff726f8f640 1 -- 172.21.15.92:0/1668625837 >> 172.21.15.92:0/1668625837 conn(0x7ff720079720 msgr2=0x7ff7201017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.966+0000 7ff726f8f640 1 -- 172.21.15.92:0/1668625837 shutdown_connections 2024-09-21T07:04:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:19.966+0000 7ff726f8f640 1 -- 172.21.15.92:0/1668625837 wait complete. 2024-09-21T07:04:24.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi092') 2024-09-21T07:04:24.214 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:24.214 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:24.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/4197619032' entity='client.admin' 2024-09-21T07:04:24.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:24.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:24.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:04:24.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:04:24.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:04:24.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:24.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: Reconfiguring daemon mgr.x on smithi092 2024-09-21T07:04:24.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4197619032' entity='client.admin' 2024-09-21T07:04:24.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:24.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:24.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:04:24.445 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:04:24.445 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:04:24.445 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:24.445 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: Reconfiguring daemon mgr.x on smithi092 2024-09-21T07:04:24.445 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/4197619032' entity='client.admin' 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: Reconfiguring daemon mgr.x on smithi092 2024-09-21T07:04:24.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.264+0000 7f0797d6f640 1 -- 172.21.15.92:0/2283992728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790105300 msgr2=0x7f079010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.264+0000 7f0797d6f640 1 --2- 172.21.15.92:0/2283992728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790105300 0x7f079010d850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0780009900 tx=0x7f078002a410 comp rx=0 tx=0).stop 2024-09-21T07:04:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.264+0000 7f0797d6f640 1 -- 172.21.15.92:0/2283992728 shutdown_connections 2024-09-21T07:04:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.264+0000 7f0797d6f640 1 --2- 172.21.15.92:0/2283992728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f079010de10 0x7f0790110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.264+0000 7f0797d6f640 1 --2- 172.21.15.92:0/2283992728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790105300 0x7f079010d850 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.264+0000 7f0797d6f640 1 --2- 172.21.15.92:0/2283992728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07901049b0 0x7f0790104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.264+0000 7f0797d6f640 1 -- 172.21.15.92:0/2283992728 >> 172.21.15.92:0/2283992728 conn(0x7f0790079730 msgr2=0x7f0790079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.264+0000 7f0797d6f640 1 -- 172.21.15.92:0/2283992728 shutdown_connections 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.264+0000 7f0797d6f640 1 -- 172.21.15.92:0/2283992728 wait complete. 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.265+0000 7f0797d6f640 1 Processor -- start 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.265+0000 7f0797d6f640 1 -- start start 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.265+0000 7f0797d6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07901049b0 0x7f079019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.265+0000 7f0797d6f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0790105300 0x7f079019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.265+0000 7f0797d6f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079010de10 0x7f07901a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.265+0000 7f0797d6f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0790113800 con 0x7f07901049b0 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.265+0000 7f0797d6f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0790113680 con 0x7f0790105300 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.265+0000 7f0797d6f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0790113980 con 0x7f079010de10 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.265+0000 7f0795b0b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07901049b0 0x7f079019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0795b0b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07901049b0 0x7f079019c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47614/0 (socket says 172.21.15.92:47614) 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0795b0b640 1 -- 172.21.15.92:0/1370892720 learned_addr learned my addr 172.21.15.92:0/1370892720 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f079530a640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0790105300 0x7f079019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f079630c640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079010de10 0x7f07901a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0795b0b640 1 -- 172.21.15.92:0/1370892720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079010de10 msgr2=0x7f07901a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0795b0b640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079010de10 0x7f07901a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0795b0b640 1 -- 172.21.15.92:0/1370892720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0790105300 msgr2=0x7f079019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0795b0b640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0790105300 0x7f079019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0795b0b640 1 -- 172.21.15.92:0/1370892720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07901a2520 con 0x7f07901049b0 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0795b0b640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07901049b0 0x7f079019c5b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f078c00e9c0 tx=0x7f078c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0786ffd640 1 -- 172.21.15.92:0/1370892720 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c00cde0 con 0x7f07901049b0 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0786ffd640 1 -- 172.21.15.92:0/1370892720 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f078c0108a0 con 0x7f07901049b0 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0786ffd640 1 -- 172.21.15.92:0/1370892720 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c0187c0 con 0x7f07901049b0 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0797d6f640 1 -- 172.21.15.92:0/1370892720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07901a2810 con 0x7f07901049b0 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.266+0000 7f0797d6f640 1 -- 172.21.15.92:0/1370892720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07901a8f70 con 0x7f07901049b0 2024-09-21T07:04:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.267+0000 7f0797d6f640 1 -- 172.21.15.92:0/1370892720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f079006b560 con 0x7f07901049b0 2024-09-21T07:04:25.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.268+0000 7f0786ffd640 1 -- 172.21.15.92:0/1370892720 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 103194+0+0 (secure 0 0 0) 0x7f078c01f020 con 0x7f07901049b0 2024-09-21T07:04:25.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.268+0000 7f0786ffd640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f077c07b020 0x7f077c07d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:25.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.269+0000 7f0786ffd640 1 -- 172.21.15.92:0/1370892720 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f078c09cf70 con 0x7f07901049b0 2024-09-21T07:04:25.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.269+0000 7f079530a640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f077c07b020 0x7f077c07d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:25.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.269+0000 7f079530a640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f077c07b020 0x7f077c07d530 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0780005940 tx=0x7f07800058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:25.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.274+0000 7f0786ffd640 1 -- 172.21.15.92:0/1370892720 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f078c010a50 con 0x7f07901049b0 2024-09-21T07:04:25.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.370+0000 7f0786ffd640 1 -- 172.21.15.92:0/1370892720 <== mon.0 v2:172.21.15.92:3300/0 7 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f078c010d70 con 0x7f07901049b0 2024-09-21T07:04:25.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:25 smithi169 ceph-mon[33705]: Standby manager daemon z started 2024-09-21T07:04:25.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:25 smithi169 ceph-mon[33705]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:04:25.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:25 smithi169 ceph-mon[33705]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:04:25.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:25 smithi169 ceph-mon[33705]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:04:25.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:25 smithi169 ceph-mon[33705]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:04:25.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:25 smithi092 ceph-mon[30987]: Standby manager daemon z started 2024-09-21T07:04:25.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:25 smithi092 ceph-mon[30987]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:04:25.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:25 smithi092 ceph-mon[30987]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:04:25.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:25 smithi092 ceph-mon[30987]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:04:25.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:25 smithi092 ceph-mon[30987]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:04:25.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.166+0000 7f0732e2c640 1 -- 172.21.15.92:0/407045287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072c108cf0 msgr2=0x7f072c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:25.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.166+0000 7f0732e2c640 1 --2- 172.21.15.92:0/407045287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072c108cf0 0x7f072c10f520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0724009ca0 tx=0x7f072402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.166+0000 7f0732e2c640 1 -- 172.21.15.92:0/407045287 shutdown_connections 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.166+0000 7f0732e2c640 1 --2- 172.21.15.92:0/407045287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072c108cf0 0x7f072c10f520 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.166+0000 7f0732e2c640 1 --2- 172.21.15.92:0/407045287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f072c1083a0 0x7f072c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.166+0000 7f0732e2c640 1 --2- 172.21.15.92:0/407045287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f072c102a60 0x7f072c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.166+0000 7f0732e2c640 1 -- 172.21.15.92:0/407045287 >> 172.21.15.92:0/407045287 conn(0x7f072c079730 msgr2=0x7f072c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.166+0000 7f0732e2c640 1 -- 172.21.15.92:0/407045287 shutdown_connections 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.166+0000 7f0732e2c640 1 -- 172.21.15.92:0/407045287 wait complete. 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0732e2c640 1 Processor -- start 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0732e2c640 1 -- start start 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0732e2c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072c102a60 0x7f072c19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0732e2c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f072c1083a0 0x7f072c19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:25.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0732e2c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f072c108cf0 0x7f072c19faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0732e2c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1126f0 con 0x7f072c102a60 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0732e2c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f072c112570 con 0x7f072c1083a0 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0732e2c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f072c112870 con 0x7f072c108cf0 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0730bc8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072c102a60 0x7f072c19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0730bc8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072c102a60 0x7f072c19a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47590/0 (socket says 172.21.15.92:47590) 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f0730bc8640 1 -- 172.21.15.92:0/702791724 learned_addr learned my addr 172.21.15.92:0/702791724 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f07313c9640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f072c108cf0 0x7f072c19faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.167+0000 7f072bfff640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f072c1083a0 0x7f072c19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0730bc8640 1 -- 172.21.15.92:0/702791724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f072c108cf0 msgr2=0x7f072c19faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0730bc8640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f072c108cf0 0x7f072c19faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0730bc8640 1 -- 172.21.15.92:0/702791724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f072c1083a0 msgr2=0x7f072c19a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0730bc8640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f072c1083a0 0x7f072c19a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0730bc8640 1 -- 172.21.15.92:0/702791724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072c1a0220 con 0x7f072c102a60 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0730bc8640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072c102a60 0x7f072c19a2b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f072000e9f0 tx=0x7f072000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0729ffb640 1 -- 172.21.15.92:0/702791724 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072000cd80 con 0x7f072c102a60 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0732e2c640 1 -- 172.21.15.92:0/702791724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072c1a0510 con 0x7f072c102a60 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0729ffb640 1 -- 172.21.15.92:0/702791724 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0720005490 con 0x7f072c102a60 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0729ffb640 1 -- 172.21.15.92:0/702791724 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720010430 con 0x7f072c102a60 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.168+0000 7f0732e2c640 1 -- 172.21.15.92:0/702791724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072c1a6c70 con 0x7f072c102a60 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.169+0000 7f0732e2c640 1 -- 172.21.15.92:0/702791724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072c102e70 con 0x7f072c102a60 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.170+0000 7f0729ffb640 1 -- 172.21.15.92:0/702791724 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 103194+0+0 (secure 0 0 0) 0x7f07200046c0 con 0x7f072c102a60 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.170+0000 7f0729ffb640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f071c07b020 0x7f071c07d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.170+0000 7f072bfff640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f071c07b020 0x7f071c07d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.170+0000 7f0729ffb640 1 -- 172.21.15.92:0/702791724 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f072009d1c0 con 0x7f072c102a60 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.171+0000 7f072bfff640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f071c07b020 0x7f071c07d530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f072c079cd0 tx=0x7f0718005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:25.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.175+0000 7f0729ffb640 1 -- 172.21.15.92:0/702791724 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0720069c10 con 0x7f072c102a60 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.366+0000 7f0732e2c640 1 -- 172.21.15.92:0/702791724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f072c10baf0 con 0x7f072c102a60 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.369+0000 7f0729ffb640 1 -- 172.21.15.92:0/702791724 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7f072006eac0 con 0x7f072c102a60 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.370+0000 7f0729ffb640 1 -- 172.21.15.92:0/702791724 <== mon.0 v2:172.21.15.92:3300/0 8 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0720064cf0 con 0x7f072c102a60 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 -- 172.21.15.92:0/702791724 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f071c07b020 msgr2=0x7f071c07d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f071c07b020 0x7f071c07d530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f072c079cd0 tx=0x7f0718005f90 comp rx=0 tx=0).stop 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 -- 172.21.15.92:0/702791724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072c102a60 msgr2=0x7f072c19a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072c102a60 0x7f072c19a2b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f072000e9f0 tx=0x7f072000edf0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 -- 172.21.15.92:0/702791724 shutdown_connections 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f071c07b020 0x7f071c07d530 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f072c108cf0 0x7f072c19faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f072c1083a0 0x7f072c19a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 --2- 172.21.15.92:0/702791724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f072c102a60 0x7f072c19a2b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 -- 172.21.15.92:0/702791724 >> 172.21.15.92:0/702791724 conn(0x7f072c079730 msgr2=0x7f072c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:25.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 -- 172.21.15.92:0/702791724 shutdown_connections 2024-09-21T07:04:25.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.372+0000 7f0732e2c640 1 -- 172.21.15.92:0/702791724 wait complete. 2024-09-21T07:04:25.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.471+0000 7f0797d6f640 1 -- 172.21.15.92:0/1370892720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f079019d6e0 con 0x7f07901049b0 2024-09-21T07:04:25.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.475+0000 7f0786ffd640 1 -- 172.21.15.92:0/1370892720 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 106+0+0 (secure 0 0 0) 0x7f078c069980 con 0x7f07901049b0 2024-09-21T07:04:25.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 -- 172.21.15.92:0/1370892720 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f077c07b020 msgr2=0x7f077c07d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:25.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f077c07b020 0x7f077c07d530 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0780005940 tx=0x7f07800058d0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 -- 172.21.15.92:0/1370892720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07901049b0 msgr2=0x7f079019c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:25.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07901049b0 0x7f079019c5b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f078c00e9c0 tx=0x7f078c00ee80 comp rx=0 tx=0).stop 2024-09-21T07:04:25.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 -- 172.21.15.92:0/1370892720 shutdown_connections 2024-09-21T07:04:25.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f077c07b020 0x7f077c07d530 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f079010de10 0x7f07901a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0790105300 0x7f079019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 --2- 172.21.15.92:0/1370892720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07901049b0 0x7f079019c5b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:25.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 -- 172.21.15.92:0/1370892720 >> 172.21.15.92:0/1370892720 conn(0x7f0790079730 msgr2=0x7f079010bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:25.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 -- 172.21.15.92:0/1370892720 shutdown_connections 2024-09-21T07:04:25.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:25.478+0000 7f0797d6f640 1 -- 172.21.15.92:0/1370892720 wait complete. 2024-09-21T07:04:25.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:25 smithi175 ceph-mon[34064]: Standby manager daemon z started 2024-09-21T07:04:25.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:25 smithi175 ceph-mon[34064]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:04:25.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:25 smithi175 ceph-mon[34064]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:04:25.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:25 smithi175 ceph-mon[34064]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:04:25.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:25 smithi175 ceph-mon[34064]: from='mgr.? 172.21.15.175:0/2935397222' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:04:26.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:26 smithi175 ceph-mon[34064]: mgrmap e18: x(active, since 11s), standbys: z 2024-09-21T07:04:26.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:26 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:04:26.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:26 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/702791724' entity='client.admin' 2024-09-21T07:04:26.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:26 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1370892720' entity='client.admin' 2024-09-21T07:04:26.557 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:26 smithi169 ceph-mon[33705]: mgrmap e18: x(active, since 11s), standbys: z 2024-09-21T07:04:26.557 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:26 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:04:26.557 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:26 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/702791724' entity='client.admin' 2024-09-21T07:04:26.557 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:26 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1370892720' entity='client.admin' 2024-09-21T07:04:26.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:26 smithi092 ceph-mon[30987]: mgrmap e18: x(active, since 11s), standbys: z 2024-09-21T07:04:26.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:26 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:04:26.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:26 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/702791724' entity='client.admin' 2024-09-21T07:04:26.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:26 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1370892720' entity='client.admin' 2024-09-21T07:04:26.749 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.749 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.749 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.751 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.751 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.752 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.753 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.757 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.757 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.757 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.759 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.765 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.766 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.768 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.777 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.971+0000 7f254954e640 1 -- 172.21.15.92:0/2186577738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25441083c0 msgr2=0x7f25441087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:26.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.971+0000 7f254954e640 1 --2- 172.21.15.92:0/2186577738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25441083c0 0x7f25441087d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f252c009900 tx=0x7f252c02a410 comp rx=0 tx=0).stop 2024-09-21T07:04:26.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.971+0000 7f254954e640 1 -- 172.21.15.92:0/2186577738 shutdown_connections 2024-09-21T07:04:26.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.971+0000 7f254954e640 1 --2- 172.21.15.92:0/2186577738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2544108d10 0x7f254410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:26.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.971+0000 7f254954e640 1 --2- 172.21.15.92:0/2186577738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25441083c0 0x7f25441087d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.971+0000 7f254954e640 1 --2- 172.21.15.92:0/2186577738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2544102ad0 0x7f2544102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.971+0000 7f254954e640 1 -- 172.21.15.92:0/2186577738 >> 172.21.15.92:0/2186577738 conn(0x7f25440796d0 msgr2=0x7f2544079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.971+0000 7f254954e640 1 -- 172.21.15.92:0/2186577738 shutdown_connections 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.971+0000 7f254954e640 1 -- 172.21.15.92:0/2186577738 wait complete. 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f254954e640 1 Processor -- start 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f254954e640 1 -- start start 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f254954e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2544102ad0 0x7f254419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f254954e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25441083c0 0x7f254419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f254954e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2544108d10 0x7f254419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f254954e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2544113a20 con 0x7f25441083c0 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f254954e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f25441138a0 con 0x7f2544102ad0 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f254954e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2544113ba0 con 0x7f2544108d10 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f25427fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25441083c0 0x7f254419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:26.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f25427fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25441083c0 0x7f254419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47632/0 (socket says 172.21.15.92:47632) 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f25427fc640 1 -- 172.21.15.92:0/1486799601 learned_addr learned my addr 172.21.15.92:0/1486799601 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.972+0000 7f2542ffd640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2544102ad0 0x7f254419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f25437fe640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2544108d10 0x7f254419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f25427fc640 1 -- 172.21.15.92:0/1486799601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2544108d10 msgr2=0x7f254419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f25427fc640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2544108d10 0x7f254419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f25427fc640 1 -- 172.21.15.92:0/1486799601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2544102ad0 msgr2=0x7f254419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f25427fc640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2544102ad0 0x7f254419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f25427fc640 1 -- 172.21.15.92:0/1486799601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25441a0500 con 0x7f25441083c0 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f25427fc640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25441083c0 0x7f254419ab30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f252c005940 tx=0x7f252c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f253bfff640 1 -- 172.21.15.92:0/1486799601 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c03f030 con 0x7f25441083c0 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f254954e640 1 -- 172.21.15.92:0/1486799601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25441a0790 con 0x7f25441083c0 2024-09-21T07:04:26.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f253bfff640 1 -- 172.21.15.92:0/1486799601 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f252c003c90 con 0x7f25441083c0 2024-09-21T07:04:26.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f253bfff640 1 -- 172.21.15.92:0/1486799601 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c035070 con 0x7f25441083c0 2024-09-21T07:04:26.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.973+0000 7f254954e640 1 -- 172.21.15.92:0/1486799601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25441a6f50 con 0x7f25441083c0 2024-09-21T07:04:26.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.975+0000 7f254954e640 1 -- 172.21.15.92:0/1486799601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2544103d00 con 0x7f25441083c0 2024-09-21T07:04:26.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.976+0000 7f253bfff640 1 -- 172.21.15.92:0/1486799601 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 103194+0+0 (secure 0 0 0) 0x7f252c042030 con 0x7f25441083c0 2024-09-21T07:04:26.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.976+0000 7f253bfff640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f253007b020 0x7f253007d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:26.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.976+0000 7f253bfff640 1 -- 172.21.15.92:0/1486799601 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f252c0bd750 con 0x7f25441083c0 2024-09-21T07:04:26.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.977+0000 7f2542ffd640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f253007b020 0x7f253007d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:26.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.977+0000 7f2542ffd640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f253007b020 0x7f253007d530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f253400a400 tx=0x7f253400d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:26.980 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.981 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:26.982+0000 7f253bfff640 1 -- 172.21.15.92:0/1486799601 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f252c08a0e0 con 0x7f25441083c0 2024-09-21T07:04:27.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.194+0000 7f254954e640 1 -- 172.21.15.92:0/1486799601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f254410aae0 con 0x7f25441083c0 2024-09-21T07:04:27.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.195+0000 7f253bfff640 1 -- 172.21.15.92:0/1486799601 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 106+0+0 (secure 0 0 0) 0x7f252c08ef90 con 0x7f25441083c0 2024-09-21T07:04:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 -- 172.21.15.92:0/1486799601 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f253007b020 msgr2=0x7f253007d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f253007b020 0x7f253007d530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f253400a400 tx=0x7f253400d040 comp rx=0 tx=0).stop 2024-09-21T07:04:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 -- 172.21.15.92:0/1486799601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25441083c0 msgr2=0x7f254419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25441083c0 0x7f254419ab30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f252c005940 tx=0x7f252c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:04:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 -- 172.21.15.92:0/1486799601 shutdown_connections 2024-09-21T07:04:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f253007b020 0x7f253007d530 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2544108d10 0x7f254419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25441083c0 0x7f254419ab30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 --2- 172.21.15.92:0/1486799601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2544102ad0 0x7f254419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 -- 172.21.15.92:0/1486799601 >> 172.21.15.92:0/1486799601 conn(0x7f25440796d0 msgr2=0x7f25441065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.197+0000 7f254954e640 1 -- 172.21.15.92:0/1486799601 shutdown_connections 2024-09-21T07:04:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:27.198+0000 7f254954e640 1 -- 172.21.15.92:0/1486799601 wait complete. 2024-09-21T07:04:27.476 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi092') 2024-09-21T07:04:27.476 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi092') 2024-09-21T07:04:27.476 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi092') 2024-09-21T07:04:27.477 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi092') 2024-09-21T07:04:27.477 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi092') 2024-09-21T07:04:27.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:27 smithi175 ceph-mon[34064]: Standby manager daemon y started 2024-09-21T07:04:27.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:27 smithi175 ceph-mon[34064]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:04:27.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:27 smithi175 ceph-mon[34064]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:04:27.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:27 smithi175 ceph-mon[34064]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:04:27.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:27 smithi175 ceph-mon[34064]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:04:27.531 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:27 smithi169 ceph-mon[33705]: Standby manager daemon y started 2024-09-21T07:04:27.531 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:27 smithi169 ceph-mon[33705]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:04:27.532 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:27 smithi169 ceph-mon[33705]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:04:27.532 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:27 smithi169 ceph-mon[33705]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:04:27.532 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:27 smithi169 ceph-mon[33705]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:04:27.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:27 smithi092 ceph-mon[30987]: Standby manager daemon y started 2024-09-21T07:04:27.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:27 smithi092 ceph-mon[30987]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:04:27.558 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:27 smithi092 ceph-mon[30987]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:04:27.558 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:27 smithi092 ceph-mon[30987]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:04:27.558 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:27 smithi092 ceph-mon[30987]: from='mgr.? 172.21.15.169:0/1653028889' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:04:28.440 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:28 smithi092 ceph-mon[30987]: mgrmap e19: x(active, since 13s), standbys: z, y 2024-09-21T07:04:28.441 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:04:28.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:28 smithi175 ceph-mon[34064]: mgrmap e19: x(active, since 13s), standbys: z, y 2024-09-21T07:04:28.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:04:28.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:28 smithi169 ceph-mon[33705]: mgrmap e19: x(active, since 13s), standbys: z, y 2024-09-21T07:04:28.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:04:29.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.019+0000 7f1a9cc16640 1 -- 172.21.15.92:0/1077970497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a98108520 msgr2=0x7f1a9810ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.019+0000 7f1a9cc16640 1 --2- 172.21.15.92:0/1077970497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a98108520 0x7f1a9810ed50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009ca0 tx=0x7f1a9002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.019+0000 7f1a9cc16640 1 -- 172.21.15.92:0/1077970497 shutdown_connections 2024-09-21T07:04:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.019+0000 7f1a9cc16640 1 --2- 172.21.15.92:0/1077970497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a98108520 0x7f1a9810ed50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.019+0000 7f1a9cc16640 1 --2- 172.21.15.92:0/1077970497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a98107bd0 0x7f1a98107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.019+0000 7f1a9cc16640 1 --2- 172.21.15.92:0/1077970497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a98102290 0x7f1a981026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.019+0000 7f1a9cc16640 1 -- 172.21.15.92:0/1077970497 >> 172.21.15.92:0/1077970497 conn(0x7f1a98079ea0 msgr2=0x7f1a9807a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.019+0000 7f1a9cc16640 1 -- 172.21.15.92:0/1077970497 shutdown_connections 2024-09-21T07:04:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.019+0000 7f1a9cc16640 1 -- 172.21.15.92:0/1077970497 wait complete. 2024-09-21T07:04:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.020+0000 7f1a9cc16640 1 Processor -- start 2024-09-21T07:04:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a9cc16640 1 -- start start 2024-09-21T07:04:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a9cc16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a98102290 0x7f1a98199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a9cc16640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a98107bd0 0x7f1a98199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a9cc16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a98108520 0x7f1a9819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a9cc16640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1a98112970 con 0x7f1a98108520 2024-09-21T07:04:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a9cc16640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1a981127f0 con 0x7f1a98107bd0 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a9cc16640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1a98112af0 con 0x7f1a98102290 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a96d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a98108520 0x7f1a9819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a96d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a98108520 0x7f1a9819eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47642/0 (socket says 172.21.15.92:47642) 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a96d9d640 1 -- 172.21.15.92:0/266181870 learned_addr learned my addr 172.21.15.92:0/266181870 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a9659c640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a98102290 0x7f1a98199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a95d9b640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a98107bd0 0x7f1a98199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a96d9d640 1 -- 172.21.15.92:0/266181870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a98102290 msgr2=0x7f1a98199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a96d9d640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a98102290 0x7f1a98199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a96d9d640 1 -- 172.21.15.92:0/266181870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a98107bd0 msgr2=0x7f1a98199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a96d9d640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a98107bd0 0x7f1a98199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a96d9d640 1 -- 172.21.15.92:0/266181870 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9819f2d0 con 0x7f1a98108520 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a9659c640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a98102290 0x7f1a98199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.021+0000 7f1a96d9d640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a98108520 0x7f1a9819eba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005e30 tx=0x7f1a900093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.022+0000 7f1a877fe640 1 -- 172.21.15.92:0/266181870 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90032d10 con 0x7f1a98108520 2024-09-21T07:04:29.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.022+0000 7f1a9cc16640 1 -- 172.21.15.92:0/266181870 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9819f560 con 0x7f1a98108520 2024-09-21T07:04:29.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.022+0000 7f1a877fe640 1 -- 172.21.15.92:0/266181870 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a90032eb0 con 0x7f1a98108520 2024-09-21T07:04:29.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.022+0000 7f1a877fe640 1 -- 172.21.15.92:0/266181870 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90030b20 con 0x7f1a98108520 2024-09-21T07:04:29.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.022+0000 7f1a9cc16640 1 -- 172.21.15.92:0/266181870 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a981a5d20 con 0x7f1a98108520 2024-09-21T07:04:29.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.023+0000 7f1a9cc16640 1 -- 172.21.15.92:0/266181870 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a981026a0 con 0x7f1a98108520 2024-09-21T07:04:29.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.025+0000 7f1a877fe640 1 -- 172.21.15.92:0/266181870 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f1a90030cc0 con 0x7f1a98108520 2024-09-21T07:04:29.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.026+0000 7f1a877fe640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1a800b64d0 0x7f1a800b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:29.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.026+0000 7f1a9659c640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1a800b64d0 0x7f1a800b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:29.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.026+0000 7f1a877fe640 1 -- 172.21.15.92:0/266181870 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1a90106b70 con 0x7f1a98108520 2024-09-21T07:04:29.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.026+0000 7f1a9659c640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1a800b64d0 0x7f1a800b89e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a880058c0 tx=0x7f1a88005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:29.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.029+0000 7f1a877fe640 1 -- 172.21.15.92:0/266181870 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a900cf000 con 0x7f1a98108520 2024-09-21T07:04:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.207+0000 7fcde4c30640 1 -- 172.21.15.92:0/159819629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcde0105300 msgr2=0x7fcde010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.207+0000 7fcde4c30640 1 --2- 172.21.15.92:0/159819629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcde0105300 0x7fcde010d850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009900 tx=0x7fcdd402a410 comp rx=0 tx=0).stop 2024-09-21T07:04:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.207+0000 7fcde4c30640 1 -- 172.21.15.92:0/159819629 shutdown_connections 2024-09-21T07:04:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.207+0000 7fcde4c30640 1 --2- 172.21.15.92:0/159819629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde010de10 0x7fcde0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.207+0000 7fcde4c30640 1 --2- 172.21.15.92:0/159819629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcde0105300 0x7fcde010d850 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.207+0000 7fcde4c30640 1 --2- 172.21.15.92:0/159819629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde01049b0 0x7fcde0104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.207+0000 7fcde4c30640 1 -- 172.21.15.92:0/159819629 >> 172.21.15.92:0/159819629 conn(0x7fcde0079730 msgr2=0x7fcde0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.207+0000 7fcde4c30640 1 -- 172.21.15.92:0/159819629 shutdown_connections 2024-09-21T07:04:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.207+0000 7fcde4c30640 1 -- 172.21.15.92:0/159819629 wait complete. 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcde4c30640 1 Processor -- start 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcde4c30640 1 -- start start 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcde4c30640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde01049b0 0x7fcde019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcde4c30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcde0105300 0x7fcde019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcde4c30640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde010de10 0x7fcde019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcde4c30640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcde0113920 con 0x7fcde0105300 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcde4c30640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcde01137a0 con 0x7fcde010de10 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcde4c30640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcde0113aa0 con 0x7fcde01049b0 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcdddd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcde0105300 0x7fcde019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcdddd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcde0105300 0x7fcde019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47670/0 (socket says 172.21.15.92:47670) 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcdddd9b640 1 -- 172.21.15.92:0/1042837536 learned_addr learned my addr 172.21.15.92:0/1042837536 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcdded9d640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde010de10 0x7fcde019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.208+0000 7fcdde59c640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde01049b0 0x7fcde019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcdddd9b640 1 -- 172.21.15.92:0/1042837536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde01049b0 msgr2=0x7fcde019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcdddd9b640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde01049b0 0x7fcde019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcdddd9b640 1 -- 172.21.15.92:0/1042837536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde010de10 msgr2=0x7fcde019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcdddd9b640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde010de10 0x7fcde019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcdddd9b640 1 -- 172.21.15.92:0/1042837536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde01a03e0 con 0x7fcde0105300 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcdddd9b640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcde0105300 0x7fcde019aa10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4005940 tx=0x7fcdd4005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcdcf7fe640 1 -- 172.21.15.92:0/1042837536 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd403f030 con 0x7fcde0105300 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcdcf7fe640 1 -- 172.21.15.92:0/1042837536 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdd40043d0 con 0x7fcde0105300 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcde4c30640 1 -- 172.21.15.92:0/1042837536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde01a0670 con 0x7fcde0105300 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcdcf7fe640 1 -- 172.21.15.92:0/1042837536 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4035070 con 0x7fcde0105300 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.209+0000 7fcde4c30640 1 -- 172.21.15.92:0/1042837536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde01a6e30 con 0x7fcde0105300 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.210+0000 7fcde4c30640 1 -- 172.21.15.92:0/1042837536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde0104dc0 con 0x7fcde0105300 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.211+0000 7fcdcf7fe640 1 -- 172.21.15.92:0/1042837536 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fcdd4042030 con 0x7fcde0105300 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.212+0000 7fcdcf7fe640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcdc80b6550 0x7fcdc80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.212+0000 7fcdde59c640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcdc80b6550 0x7fcdc80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.212+0000 7fcdcf7fe640 1 -- 172.21.15.92:0/1042837536 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcdd41059b0 con 0x7fcde0105300 2024-09-21T07:04:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.213+0000 7fcdde59c640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcdc80b6550 0x7fcdc80b8a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcde006bc60 tx=0x7fcdd0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.217+0000 7fcdcf7fe640 1 -- 172.21.15.92:0/1042837536 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcdd40d2220 con 0x7fcde0105300 2024-09-21T07:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.218+0000 7f1a9cc16640 1 -- 172.21.15.92:0/266181870 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f1a9819a490 con 0x7f1a98108520 2024-09-21T07:04:29.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.224+0000 7f1a877fe640 1 -- 172.21.15.92:0/266181870 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v20)=0 v20) ==== 120+0+0 (secure 0 0 0) 0x7f1a9819a490 con 0x7f1a98108520 2024-09-21T07:04:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 -- 172.21.15.92:0/266181870 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1a800b64d0 msgr2=0x7f1a800b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1a800b64d0 0x7f1a800b89e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a880058c0 tx=0x7f1a88005850 comp rx=0 tx=0).stop 2024-09-21T07:04:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 -- 172.21.15.92:0/266181870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a98108520 msgr2=0x7f1a9819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a98108520 0x7f1a9819eba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005e30 tx=0x7f1a900093d0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 -- 172.21.15.92:0/266181870 shutdown_connections 2024-09-21T07:04:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1a800b64d0 0x7f1a800b89e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a98108520 0x7f1a9819eba0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a98107bd0 0x7f1a98199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 --2- 172.21.15.92:0/266181870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a98102290 0x7f1a98199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 -- 172.21.15.92:0/266181870 >> 172.21.15.92:0/266181870 conn(0x7f1a98079ea0 msgr2=0x7f1a98105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 -- 172.21.15.92:0/266181870 shutdown_connections 2024-09-21T07:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.227+0000 7f1a9cc16640 1 -- 172.21.15.92:0/266181870 wait complete. 2024-09-21T07:04:29.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.407+0000 7fcde4c30640 1 -- 172.21.15.92:0/1042837536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fcde0108f10 con 0x7fcde0105300 2024-09-21T07:04:29.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.411+0000 7fcdcf7fe640 1 -- 172.21.15.92:0/1042837536 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v21)=0 v21) ==== 129+0+0 (secure 0 0 0) 0x7fcdd40d7160 con 0x7fcde0105300 2024-09-21T07:04:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 -- 172.21.15.92:0/1042837536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcdc80b6550 msgr2=0x7fcdc80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcdc80b6550 0x7fcdc80b8a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcde006bc60 tx=0x7fcdd0005f90 comp rx=0 tx=0).stop 2024-09-21T07:04:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 -- 172.21.15.92:0/1042837536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcde0105300 msgr2=0x7fcde019aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcde0105300 0x7fcde019aa10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4005940 tx=0x7fcdd4005e10 comp rx=0 tx=0).stop 2024-09-21T07:04:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 -- 172.21.15.92:0/1042837536 shutdown_connections 2024-09-21T07:04:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcdc80b6550 0x7fcdc80b8a60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcde010de10 0x7fcde019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcde0105300 0x7fcde019aa10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 --2- 172.21.15.92:0/1042837536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde01049b0 0x7fcde019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:29.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 -- 172.21.15.92:0/1042837536 >> 172.21.15.92:0/1042837536 conn(0x7fcde0079730 msgr2=0x7fcde00ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:29.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 -- 172.21.15.92:0/1042837536 shutdown_connections 2024-09-21T07:04:29.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.413+0000 7fcde4c30640 1 -- 172.21.15.92:0/1042837536 wait complete. 2024-09-21T07:04:30.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:30 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/266181870' entity='client.admin' 2024-09-21T07:04:30.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:30 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1042837536' entity='client.admin' 2024-09-21T07:04:30.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:30 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3691948631' entity='client.admin' 2024-09-21T07:04:30.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:30 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/266181870' entity='client.admin' 2024-09-21T07:04:30.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:30 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1042837536' entity='client.admin' 2024-09-21T07:04:30.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:30 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3691948631' entity='client.admin' 2024-09-21T07:04:30.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:30 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/266181870' entity='client.admin' 2024-09-21T07:04:30.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:30 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1042837536' entity='client.admin' 2024-09-21T07:04:30.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:30 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3691948631' entity='client.admin' 2024-09-21T07:04:31.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.625+0000 7f29178bb640 1 -- 172.21.15.92:0/88130994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2910103b80 msgr2=0x7f2910103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:31.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.625+0000 7f29178bb640 1 --2- 172.21.15.92:0/88130994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2910103b80 0x7f2910103f90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f290c009900 tx=0x7f290c02a410 comp rx=0 tx=0).stop 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.625+0000 7f29178bb640 1 -- 172.21.15.92:0/88130994 shutdown_connections 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.625+0000 7f29178bb640 1 --2- 172.21.15.92:0/88130994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2910109e10 0x7f2910110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.625+0000 7f29178bb640 1 --2- 172.21.15.92:0/88130994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29101094c0 0x7f29101098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.625+0000 7f29178bb640 1 --2- 172.21.15.92:0/88130994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2910103b80 0x7f2910103f90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.625+0000 7f29178bb640 1 -- 172.21.15.92:0/88130994 >> 172.21.15.92:0/88130994 conn(0x7f29100ff5b0 msgr2=0x7f2910101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.625+0000 7f29178bb640 1 -- 172.21.15.92:0/88130994 shutdown_connections 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.625+0000 7f29178bb640 1 -- 172.21.15.92:0/88130994 wait complete. 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f29178bb640 1 Processor -- start 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f29178bb640 1 -- start start 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f29178bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2910103b80 0x7f291019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f29178bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29101094c0 0x7f291019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f29178bb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2910109e10 0x7f291019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f29178bb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2910113980 con 0x7f2910109e10 2024-09-21T07:04:31.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f29178bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2910113800 con 0x7f2910103b80 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f29178bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2910113b00 con 0x7f29101094c0 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f2915e58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2910109e10 0x7f291019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f2915e58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2910109e10 0x7f291019fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41252/0 (socket says 172.21.15.92:41252) 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.626+0000 7f2915e58640 1 -- 172.21.15.92:0/3303396863 learned_addr learned my addr 172.21.15.92:0/3303396863 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f2915657640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2910103b80 0x7f291019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f2914e56640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29101094c0 0x7f291019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f2915e58640 1 -- 172.21.15.92:0/3303396863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29101094c0 msgr2=0x7f291019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f2915e58640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29101094c0 0x7f291019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f2915e58640 1 -- 172.21.15.92:0/3303396863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2910103b80 msgr2=0x7f291019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f2915e58640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2910103b80 0x7f291019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f2915e58640 1 -- 172.21.15.92:0/3303396863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29101a02a0 con 0x7f2910109e10 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f2915e58640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2910109e10 0x7f291019fc30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f290800cce0 tx=0x7f290800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:31.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f29027fc640 1 -- 172.21.15.92:0/3303396863 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290800f450 con 0x7f2910109e10 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f29027fc640 1 -- 172.21.15.92:0/3303396863 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f290800fa80 con 0x7f2910109e10 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f29027fc640 1 -- 172.21.15.92:0/3303396863 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908018ad0 con 0x7f2910109e10 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f29178bb640 1 -- 172.21.15.92:0/3303396863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29101a0590 con 0x7f2910109e10 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.627+0000 7f29178bb640 1 -- 172.21.15.92:0/3303396863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29101a6db0 con 0x7f2910109e10 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.628+0000 7f29178bb640 1 -- 172.21.15.92:0/3303396863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2910104e00 con 0x7f2910109e10 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.631+0000 7f29027fc640 1 -- 172.21.15.92:0/3303396863 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f290800f5f0 con 0x7f2910109e10 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.631+0000 7f29027fc640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f28fc0b6580 0x7f28fc0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.632+0000 7f2915657640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f28fc0b6580 0x7f28fc0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.632+0000 7f29027fc640 1 -- 172.21.15.92:0/3303396863 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f29080e5f90 con 0x7f2910109e10 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.632+0000 7f2915657640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f28fc0b6580 0x7f28fc0b8a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f290c000c00 tx=0x7f290c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:31.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.635+0000 7f29027fc640 1 -- 172.21.15.92:0/3303396863 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2908014030 con 0x7f2910109e10 2024-09-21T07:04:31.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.825+0000 7f29178bb640 1 -- 172.21.15.92:0/3303396863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f2910103f90 con 0x7f2910109e10 2024-09-21T07:04:31.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.829+0000 7f29027fc640 1 -- 172.21.15.92:0/3303396863 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) ==== 133+0+0 (secure 0 0 0) 0x7f29080ae530 con 0x7f2910109e10 2024-09-21T07:04:31.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.831+0000 7f29178bb640 1 -- 172.21.15.92:0/3303396863 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f28fc0b6580 msgr2=0x7f28fc0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.831+0000 7f29178bb640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f28fc0b6580 0x7f28fc0b8a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f290c000c00 tx=0x7f290c009680 comp rx=0 tx=0).stop 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.832+0000 7f29178bb640 1 -- 172.21.15.92:0/3303396863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2910109e10 msgr2=0x7f291019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.832+0000 7f29178bb640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2910109e10 0x7f291019fc30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f290800cce0 tx=0x7f290800a620 comp rx=0 tx=0).stop 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.832+0000 7f29178bb640 1 -- 172.21.15.92:0/3303396863 shutdown_connections 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.832+0000 7f29178bb640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f28fc0b6580 0x7f28fc0b8a90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.832+0000 7f29178bb640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2910109e10 0x7f291019fc30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.832+0000 7f29178bb640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29101094c0 0x7f291019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.832+0000 7f29178bb640 1 --2- 172.21.15.92:0/3303396863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2910103b80 0x7f291019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.832+0000 7f29178bb640 1 -- 172.21.15.92:0/3303396863 >> 172.21.15.92:0/3303396863 conn(0x7f29100ff5b0 msgr2=0x7f29101019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.832+0000 7f29178bb640 1 -- 172.21.15.92:0/3303396863 shutdown_connections 2024-09-21T07:04:31.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.832+0000 7f29178bb640 1 -- 172.21.15.92:0/3303396863 wait complete. 2024-09-21T07:04:32.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.478+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/660355900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4d0108d70 msgr2=0x7ff4d010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.478+0000 7ff4d7a2e640 1 --2- 172.21.15.92:0/660355900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4d0108d70 0x7ff4d010f5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009ca0 tx=0x7ff4c802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.478+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/660355900 shutdown_connections 2024-09-21T07:04:32.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.478+0000 7ff4d7a2e640 1 --2- 172.21.15.92:0/660355900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4d0108d70 0x7ff4d010f5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.478+0000 7ff4d7a2e640 1 --2- 172.21.15.92:0/660355900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4d0108420 0x7ff4d0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.478+0000 7ff4d7a2e640 1 --2- 172.21.15.92:0/660355900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4d0102ae0 0x7ff4d0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.478+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/660355900 >> 172.21.15.92:0/660355900 conn(0x7ff4d0079770 msgr2=0x7ff4d0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:32.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.478+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/660355900 shutdown_connections 2024-09-21T07:04:32.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.478+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/660355900 wait complete. 2024-09-21T07:04:32.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d7a2e640 1 Processor -- start 2024-09-21T07:04:32.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d7a2e640 1 -- start start 2024-09-21T07:04:32.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d7a2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4d0102ae0 0x7ff4d019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d7a2e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4d0108420 0x7ff4d019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d7a2e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4d0108d70 0x7ff4d019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d7a2e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d0112930 con 0x7ff4d0102ae0 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d7a2e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d01127b0 con 0x7ff4d0108420 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d7a2e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d0112ab0 con 0x7ff4d0108d70 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d57ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4d0102ae0 0x7ff4d019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d57ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4d0102ae0 0x7ff4d019a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41294/0 (socket says 172.21.15.92:41294) 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d57ca640 1 -- 172.21.15.92:0/2156968302 learned_addr learned my addr 172.21.15.92:0/2156968302 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d4fc9640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4d0108420 0x7ff4d019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.479+0000 7ff4d5fcb640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4d0108d70 0x7ff4d019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4d57ca640 1 -- 172.21.15.92:0/2156968302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4d0108d70 msgr2=0x7ff4d019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4d57ca640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4d0108d70 0x7ff4d019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4d57ca640 1 -- 172.21.15.92:0/2156968302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4d0108420 msgr2=0x7ff4d019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4d57ca640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4d0108420 0x7ff4d019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4d57ca640 1 -- 172.21.15.92:0/2156968302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d01a0360 con 0x7ff4d0102ae0 2024-09-21T07:04:32.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4d5fcb640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4d0108d70 0x7ff4d019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:32.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4d57ca640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4d0102ae0 0x7ff4d019a3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00d950 tx=0x7ff4cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:32.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4c67fc640 1 -- 172.21.15.92:0/2156968302 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc017070 con 0x7ff4d0102ae0 2024-09-21T07:04:32.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4c67fc640 1 -- 172.21.15.92:0/2156968302 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4cc009c30 con 0x7ff4d0102ae0 2024-09-21T07:04:32.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4c67fc640 1 -- 172.21.15.92:0/2156968302 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00f620 con 0x7ff4d0102ae0 2024-09-21T07:04:32.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/2156968302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d01a0650 con 0x7ff4d0102ae0 2024-09-21T07:04:32.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.480+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/2156968302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d01a6db0 con 0x7ff4d0102ae0 2024-09-21T07:04:32.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.481+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/2156968302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d0103d60 con 0x7ff4d0102ae0 2024-09-21T07:04:32.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.482+0000 7ff4c67fc640 1 -- 172.21.15.92:0/2156968302 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7ff4cc005030 con 0x7ff4d0102ae0 2024-09-21T07:04:32.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.483+0000 7ff4c67fc640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4bc0b6550 0x7ff4bc0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.483+0000 7ff4d4fc9640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4bc0b6550 0x7ff4bc0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.483+0000 7ff4c67fc640 1 -- 172.21.15.92:0/2156968302 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff4cc0e52a0 con 0x7ff4d0102ae0 2024-09-21T07:04:32.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.484+0000 7ff4d4fc9640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4bc0b6550 0x7ff4bc0b8a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff4d01053d0 tx=0x7ff4c000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:32.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.486+0000 7ff4c67fc640 1 -- 172.21.15.92:0/2156968302 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4cc0ad7b0 con 0x7ff4d0102ae0 2024-09-21T07:04:32.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.670+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/2156968302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7ff4d019b520 con 0x7ff4d0102ae0 2024-09-21T07:04:32.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.675+0000 7ff4c67fc640 1 -- 172.21.15.92:0/2156968302 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v26)=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7ff4cc009de0 con 0x7ff4d0102ae0 2024-09-21T07:04:32.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/2156968302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4bc0b6550 msgr2=0x7ff4bc0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4bc0b6550 0x7ff4bc0b8a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff4d01053d0 tx=0x7ff4c000b390 comp rx=0 tx=0).stop 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/2156968302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4d0102ae0 msgr2=0x7ff4d019a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4d0102ae0 0x7ff4d019a3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00d950 tx=0x7ff4cc00de10 comp rx=0 tx=0).stop 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/2156968302 shutdown_connections 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4bc0b6550 0x7ff4bc0b8a60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4d0108d70 0x7ff4d019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4d0108420 0x7ff4d019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 --2- 172.21.15.92:0/2156968302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4d0102ae0 0x7ff4d019a3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/2156968302 >> 172.21.15.92:0/2156968302 conn(0x7ff4d0079770 msgr2=0x7ff4d0101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/2156968302 shutdown_connections 2024-09-21T07:04:32.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.678+0000 7ff4d7a2e640 1 -- 172.21.15.92:0/2156968302 wait complete. 2024-09-21T07:04:32.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.682+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2757735593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c0102a60 msgr2=0x7f58c0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.682+0000 7f58c6ab9640 1 --2- 172.21.15.92:0/2757735593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c0102a60 0x7f58c0102e70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009900 tx=0x7f58b402a410 comp rx=0 tx=0).stop 2024-09-21T07:04:32.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.682+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2757735593 shutdown_connections 2024-09-21T07:04:32.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.682+0000 7f58c6ab9640 1 --2- 172.21.15.92:0/2757735593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c0108cf0 0x7f58c010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.682+0000 7f58c6ab9640 1 --2- 172.21.15.92:0/2757735593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c01083a0 0x7f58c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.682+0000 7f58c6ab9640 1 --2- 172.21.15.92:0/2757735593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c0102a60 0x7f58c0102e70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.682+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2757735593 >> 172.21.15.92:0/2757735593 conn(0x7f58c0079730 msgr2=0x7f58c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:32.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.682+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2757735593 shutdown_connections 2024-09-21T07:04:32.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.682+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2757735593 wait complete. 2024-09-21T07:04:32.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.683+0000 7f58c6ab9640 1 Processor -- start 2024-09-21T07:04:32.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.683+0000 7f58c6ab9640 1 -- start start 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.683+0000 7f58c6ab9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c0102a60 0x7f58c019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.683+0000 7f58c6ab9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c01083a0 0x7f58c019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.683+0000 7f58c6ab9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c0108cf0 0x7f58c019fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.683+0000 7f58c6ab9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0112810 con 0x7f58c0108cf0 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.683+0000 7f58c6ab9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0112690 con 0x7f58c0102a60 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.683+0000 7f58c6ab9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0112990 con 0x7f58c01083a0 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.683+0000 7f58c5056640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c0108cf0 0x7f58c019fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.683+0000 7f58c4855640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c0102a60 0x7f58c019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58c4855640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c0102a60 0x7f58c019a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:53624/0 (socket says 172.21.15.92:53624) 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58c5056640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c0108cf0 0x7f58c019fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41308/0 (socket says 172.21.15.92:41308) 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58c4855640 1 -- 172.21.15.92:0/2550761462 learned_addr learned my addr 172.21.15.92:0/2550761462 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58bffff640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c01083a0 0x7f58c019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58c4855640 1 -- 172.21.15.92:0/2550761462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c01083a0 msgr2=0x7f58c019a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58c4855640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c01083a0 0x7f58c019a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58c4855640 1 -- 172.21.15.92:0/2550761462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c0108cf0 msgr2=0x7f58c019fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58c4855640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c0108cf0 0x7f58c019fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58c4855640 1 -- 172.21.15.92:0/2550761462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c01a02a0 con 0x7f58c0102a60 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58c5056640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c0108cf0 0x7f58c019fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.684+0000 7f58c4855640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c0102a60 0x7f58c019a330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009230 tx=0x7f58b4004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.685+0000 7f58bdffb640 1 -- 172.21.15.92:0/2550761462 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b403f030 con 0x7f58c0102a60 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.685+0000 7f58bdffb640 1 -- 172.21.15.92:0/2550761462 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58b4003a80 con 0x7f58c0102a60 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.685+0000 7f58bdffb640 1 -- 172.21.15.92:0/2550761462 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4035070 con 0x7f58c0102a60 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.685+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2550761462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c01a0530 con 0x7f58c0102a60 2024-09-21T07:04:32.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.685+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2550761462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c01a6cf0 con 0x7f58c0102a60 2024-09-21T07:04:32.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.686+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2550761462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c0102e70 con 0x7f58c0102a60 2024-09-21T07:04:32.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.687+0000 7f58bdffb640 1 -- 172.21.15.92:0/2550761462 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f58b4042030 con 0x7f58c0102a60 2024-09-21T07:04:32.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.688+0000 7f58bdffb640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58b00b6550 0x7f58b00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.688+0000 7f58bffff640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58b00b6550 0x7f58b00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.688+0000 7f58bdffb640 1 -- 172.21.15.92:0/2550761462 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f58b4105d50 con 0x7f58c0102a60 2024-09-21T07:04:32.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.688+0000 7f58bffff640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58b00b6550 0x7f58b00b8a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f58c0100e70 tx=0x7f58ac00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:32.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.693+0000 7f58bdffb640 1 -- 172.21.15.92:0/2550761462 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58b40d25c0 con 0x7f58c0102a60 2024-09-21T07:04:32.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.540+0000 7f1e777fa640 1 -- 172.21.15.92:0/3049619611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e701083c0 msgr2=0x7f1e701087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.540+0000 7f1e777fa640 1 --2- 172.21.15.92:0/3049619611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e701083c0 0x7f1e701087d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009900 tx=0x7f1e6002a410 comp rx=0 tx=0).stop 2024-09-21T07:04:32.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.540+0000 7f1e777fa640 1 -- 172.21.15.92:0/3049619611 shutdown_connections 2024-09-21T07:04:32.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.540+0000 7f1e777fa640 1 --2- 172.21.15.92:0/3049619611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70108d10 0x7f1e7010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.540+0000 7f1e777fa640 1 --2- 172.21.15.92:0/3049619611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e701083c0 0x7f1e701087d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.540+0000 7f1e777fa640 1 --2- 172.21.15.92:0/3049619611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70102a80 0x7f1e70102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.540+0000 7f1e777fa640 1 -- 172.21.15.92:0/3049619611 >> 172.21.15.92:0/3049619611 conn(0x7f1e70079740 msgr2=0x7f1e70079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.541+0000 7f1e777fa640 1 -- 172.21.15.92:0/3049619611 shutdown_connections 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.541+0000 7f1e777fa640 1 -- 172.21.15.92:0/3049619611 wait complete. 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.541+0000 7f1e777fa640 1 Processor -- start 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.541+0000 7f1e777fa640 1 -- start start 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.541+0000 7f1e777fa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70102a80 0x7f1e7019b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e777fa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e701083c0 0x7f1e7019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e777fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70108d10 0x7f1e7019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e777fa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1e70112830 con 0x7f1e701083c0 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e777fa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701126b0 con 0x7f1e70108d10 2024-09-21T07:04:32.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e777fa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701129b0 con 0x7f1e70102a80 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e74d95640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e701083c0 0x7f1e7019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e74d95640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e701083c0 0x7f1e7019b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41240/0 (socket says 172.21.15.92:41240) 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e74d95640 1 -- 172.21.15.92:0/2546687275 learned_addr learned my addr 172.21.15.92:0/2546687275 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e75596640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70102a80 0x7f1e7019b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e75d97640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70108d10 0x7f1e7019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e74d95640 1 -- 172.21.15.92:0/2546687275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70102a80 msgr2=0x7f1e7019b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e74d95640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70102a80 0x7f1e7019b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e74d95640 1 -- 172.21.15.92:0/2546687275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70108d10 msgr2=0x7f1e7019bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e74d95640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70108d10 0x7f1e7019bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e74d95640 1 -- 172.21.15.92:0/2546687275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e701a6490 con 0x7f1e701083c0 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e74d95640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e701083c0 0x7f1e7019b740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e60005940 tx=0x7f1e600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e667fc640 1 -- 172.21.15.92:0/2546687275 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6003f030 con 0x7f1e701083c0 2024-09-21T07:04:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e777fa640 1 -- 172.21.15.92:0/2546687275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e701a6720 con 0x7f1e701083c0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e667fc640 1 -- 172.21.15.92:0/2546687275 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e60003c90 con 0x7f1e701083c0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e667fc640 1 -- 172.21.15.92:0/2546687275 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60035070 con 0x7f1e701083c0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.542+0000 7f1e777fa640 1 -- 172.21.15.92:0/2546687275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e701a6c00 con 0x7f1e701083c0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.544+0000 7f1e777fa640 1 -- 172.21.15.92:0/2546687275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e70102e90 con 0x7f1e701083c0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.545+0000 7f1e667fc640 1 -- 172.21.15.92:0/2546687275 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f1e60042030 con 0x7f1e701083c0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.545+0000 7f1e667fc640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1e5c0b6500 0x7f1e5c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.546+0000 7f1e75596640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1e5c0b6500 0x7f1e5c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.546+0000 7f1e667fc640 1 -- 172.21.15.92:0/2546687275 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1e60105cf0 con 0x7f1e701083c0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.546+0000 7f1e75596640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1e5c0b6500 0x7f1e5c0b8a10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c005fd0 tx=0x7f1e6c005e20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.550+0000 7f1e667fc640 1 -- 172.21.15.92:0/2546687275 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e600ce180 con 0x7f1e701083c0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.739+0000 7f1e777fa640 1 -- 172.21.15.92:0/2546687275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f1e7010ab40 con 0x7f1e701083c0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.744+0000 7f1e667fc640 1 -- 172.21.15.92:0/2546687275 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v23)=0 v23) ==== 127+0+0 (secure 0 0 0) 0x7f1e600d2560 con 0x7f1e701083c0 2024-09-21T07:04:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 -- 172.21.15.92:0/2546687275 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1e5c0b6500 msgr2=0x7f1e5c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1e5c0b6500 0x7f1e5c0b8a10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c005fd0 tx=0x7f1e6c005e20 comp rx=0 tx=0).stop 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 -- 172.21.15.92:0/2546687275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e701083c0 msgr2=0x7f1e7019b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e701083c0 0x7f1e7019b740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e60005940 tx=0x7f1e600042f0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 -- 172.21.15.92:0/2546687275 shutdown_connections 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1e5c0b6500 0x7f1e5c0b8a10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70108d10 0x7f1e7019bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e701083c0 0x7f1e7019b740 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 --2- 172.21.15.92:0/2546687275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70102a80 0x7f1e7019b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 -- 172.21.15.92:0/2546687275 >> 172.21.15.92:0/2546687275 conn(0x7f1e70079740 msgr2=0x7f1e701044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 -- 172.21.15.92:0/2546687275 shutdown_connections 2024-09-21T07:04:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:31.746+0000 7f1e777fa640 1 -- 172.21.15.92:0/2546687275 wait complete. 2024-09-21T07:04:32.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.881+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2550761462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f58c01a6ec0 con 0x7f58c0102a60 2024-09-21T07:04:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.887+0000 7f58bdffb640 1 -- 172.21.15.92:0/2550761462 <== mon.2 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v27)=0 v27) ==== 116+0+0 (secure 0 0 0) 0x7f58b40d7500 con 0x7f58c0102a60 2024-09-21T07:04:32.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2550761462 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58b00b6550 msgr2=0x7f58b00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58b00b6550 0x7f58b00b8a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f58c0100e70 tx=0x7f58ac00b410 comp rx=0 tx=0).stop 2024-09-21T07:04:32.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2550761462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c0102a60 msgr2=0x7f58c019a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:32.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c0102a60 0x7f58c019a330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009230 tx=0x7f58b4004270 comp rx=0 tx=0).stop 2024-09-21T07:04:32.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2550761462 shutdown_connections 2024-09-21T07:04:32.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58b00b6550 0x7f58b00b8a60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c0108cf0 0x7f58c019fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c01083a0 0x7f58c019a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 --2- 172.21.15.92:0/2550761462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c0102a60 0x7f58c019a330 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:32.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2550761462 >> 172.21.15.92:0/2550761462 conn(0x7f58c0079730 msgr2=0x7f58c0101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:32.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2550761462 shutdown_connections 2024-09-21T07:04:32.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.889+0000 7f58c6ab9640 1 -- 172.21.15.92:0/2550761462 wait complete. 2024-09-21T07:04:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:32 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2546687275' entity='client.admin' 2024-09-21T07:04:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:32 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3303396863' entity='client.admin' 2024-09-21T07:04:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:32 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/4200963556' entity='client.admin' 2024-09-21T07:04:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:32 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2156968302' entity='client.admin' 2024-09-21T07:04:33.075 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:32 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2546687275' entity='client.admin' 2024-09-21T07:04:33.075 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:32 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3303396863' entity='client.admin' 2024-09-21T07:04:33.075 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:32 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4200963556' entity='client.admin' 2024-09-21T07:04:33.075 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:32 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2156968302' entity='client.admin' 2024-09-21T07:04:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:32 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2546687275' entity='client.admin' 2024-09-21T07:04:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:32 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3303396863' entity='client.admin' 2024-09-21T07:04:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:32 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/4200963556' entity='client.admin' 2024-09-21T07:04:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:32 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2156968302' entity='client.admin' 2024-09-21T07:04:33.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.165+0000 7fa0d5040640 1 -- 172.21.15.92:0/3954390196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0d0108db0 msgr2=0x7fa0d010f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:33.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.165+0000 7fa0d5040640 1 --2- 172.21.15.92:0/3954390196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0d0108db0 0x7fa0d010f5e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009ca0 tx=0x7fa0c802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.165+0000 7fa0d5040640 1 -- 172.21.15.92:0/3954390196 shutdown_connections 2024-09-21T07:04:33.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.165+0000 7fa0d5040640 1 --2- 172.21.15.92:0/3954390196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0d0108db0 0x7fa0d010f5e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.165+0000 7fa0d5040640 1 --2- 172.21.15.92:0/3954390196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0d0108460 0x7fa0d0108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.165+0000 7fa0d5040640 1 --2- 172.21.15.92:0/3954390196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d01031f0 0x7fa0d0103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.165+0000 7fa0d5040640 1 -- 172.21.15.92:0/3954390196 >> 172.21.15.92:0/3954390196 conn(0x7fa0d0079ec0 msgr2=0x7fa0d007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:33.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.165+0000 7fa0d5040640 1 -- 172.21.15.92:0/3954390196 shutdown_connections 2024-09-21T07:04:33.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.165+0000 7fa0d5040640 1 -- 172.21.15.92:0/3954390196 wait complete. 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.166+0000 7fa0d5040640 1 Processor -- start 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.166+0000 7fa0d5040640 1 -- start start 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0d5040640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d01031f0 0x7fa0d0199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0d5040640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0d0108460 0x7fa0d01998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0d5040640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0d0108db0 0x7fa0d019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0d5040640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0112970 con 0x7fa0d0108db0 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0d5040640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d01127f0 con 0x7fa0d0108460 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0d5040640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0112af0 con 0x7fa0d01031f0 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0cf59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0d0108db0 0x7fa0d019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0cf59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0d0108db0 0x7fa0d019eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41332/0 (socket says 172.21.15.92:41332) 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0cf59e640 1 -- 172.21.15.92:0/1861105169 learned_addr learned my addr 172.21.15.92:0/1861105169 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:33.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0ced9d640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d01031f0 0x7fa0d0199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0c7fff640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0d0108460 0x7fa0d01998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0cf59e640 1 -- 172.21.15.92:0/1861105169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d01031f0 msgr2=0x7fa0d0199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0cf59e640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d01031f0 0x7fa0d0199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0cf59e640 1 -- 172.21.15.92:0/1861105169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0d0108460 msgr2=0x7fa0d01998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0cf59e640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0d0108460 0x7fa0d01998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0cf59e640 1 -- 172.21.15.92:0/1861105169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d019f1b0 con 0x7fa0d0108db0 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0ced9d640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d01031f0 0x7fa0d0199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0cf59e640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0d0108db0 0x7fa0d019eb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8005cc0 tx=0x7fa0c8032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.167+0000 7fa0ccd99640 1 -- 172.21.15.92:0/1861105169 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8004040 con 0x7fa0d0108db0 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.168+0000 7fa0ccd99640 1 -- 172.21.15.92:0/1861105169 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c8004670 con 0x7fa0d0108db0 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.168+0000 7fa0d5040640 1 -- 172.21.15.92:0/1861105169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d019f440 con 0x7fa0d0108db0 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.168+0000 7fa0ccd99640 1 -- 172.21.15.92:0/1861105169 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8030cc0 con 0x7fa0d0108db0 2024-09-21T07:04:33.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.168+0000 7fa0d5040640 1 -- 172.21.15.92:0/1861105169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d01a5cc0 con 0x7fa0d0108db0 2024-09-21T07:04:33.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.169+0000 7fa0d5040640 1 -- 172.21.15.92:0/1861105169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d0103600 con 0x7fa0d0108db0 2024-09-21T07:04:33.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.170+0000 7fa0ccd99640 1 -- 172.21.15.92:0/1861105169 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fa0c80041e0 con 0x7fa0d0108db0 2024-09-21T07:04:33.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.171+0000 7fa0ccd99640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0bc0b6580 0x7fa0bc0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:33.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.171+0000 7fa0ced9d640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0bc0b6580 0x7fa0bc0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:33.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.172+0000 7fa0ccd99640 1 -- 172.21.15.92:0/1861105169 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa0c8106be0 con 0x7fa0d0108db0 2024-09-21T07:04:33.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.172+0000 7fa0ced9d640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0bc0b6580 0x7fa0bc0b8a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000afb0 tx=0x7fa0c000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:33.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.175+0000 7fa0ccd99640 1 -- 172.21.15.92:0/1861105169 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0c80cf070 con 0x7fa0d0108db0 2024-09-21T07:04:33.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.366+0000 7fa0d5040640 1 -- 172.21.15.92:0/1861105169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fa0d010aba0 con 0x7fa0d0108db0 2024-09-21T07:04:33.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.371+0000 7fa0ccd99640 1 -- 172.21.15.92:0/1861105169 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v28)=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7fa0c80d3450 con 0x7fa0d0108db0 2024-09-21T07:04:33.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.373+0000 7fa0d5040640 1 -- 172.21.15.92:0/1861105169 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0bc0b6580 msgr2=0x7fa0bc0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.373+0000 7fa0d5040640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0bc0b6580 0x7fa0bc0b8a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000afb0 tx=0x7fa0c000a2d0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.373+0000 7fa0d5040640 1 -- 172.21.15.92:0/1861105169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0d0108db0 msgr2=0x7fa0d019eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.373+0000 7fa0d5040640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0d0108db0 0x7fa0d019eb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8005cc0 tx=0x7fa0c8032c40 comp rx=0 tx=0).stop 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.374+0000 7fa0d5040640 1 -- 172.21.15.92:0/1861105169 shutdown_connections 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.374+0000 7fa0d5040640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0bc0b6580 0x7fa0bc0b8a90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.374+0000 7fa0d5040640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0d0108db0 0x7fa0d019eb40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.374+0000 7fa0d5040640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0d0108460 0x7fa0d01998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.374+0000 7fa0d5040640 1 --2- 172.21.15.92:0/1861105169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d01031f0 0x7fa0d0199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.374+0000 7fa0d5040640 1 -- 172.21.15.92:0/1861105169 >> 172.21.15.92:0/1861105169 conn(0x7fa0d0079ec0 msgr2=0x7fa0d01064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.374+0000 7fa0d5040640 1 -- 172.21.15.92:0/1861105169 shutdown_connections 2024-09-21T07:04:33.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.374+0000 7fa0d5040640 1 -- 172.21.15.92:0/1861105169 wait complete. 2024-09-21T07:04:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.050+0000 7f816587b640 1 -- 172.21.15.92:0/1540340678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81601083b0 msgr2=0x7f81601087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.050+0000 7f816587b640 1 --2- 172.21.15.92:0/1540340678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81601083b0 0x7f81601087c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8148009900 tx=0x7f814802a410 comp rx=0 tx=0).stop 2024-09-21T07:04:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.050+0000 7f816587b640 1 -- 172.21.15.92:0/1540340678 shutdown_connections 2024-09-21T07:04:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.050+0000 7f816587b640 1 --2- 172.21.15.92:0/1540340678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8160108d00 0x7f816010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.050+0000 7f816587b640 1 --2- 172.21.15.92:0/1540340678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81601083b0 0x7f81601087c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.050+0000 7f816587b640 1 --2- 172.21.15.92:0/1540340678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8160102ac0 0x7f8160102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.050+0000 7f816587b640 1 -- 172.21.15.92:0/1540340678 >> 172.21.15.92:0/1540340678 conn(0x7f8160079720 msgr2=0x7f8160079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.050+0000 7f816587b640 1 -- 172.21.15.92:0/1540340678 shutdown_connections 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.050+0000 7f816587b640 1 -- 172.21.15.92:0/1540340678 wait complete. 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f816587b640 1 Processor -- start 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f816587b640 1 -- start start 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f816587b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8160102ac0 0x7f8160110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f816587b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81601083b0 0x7f8160110550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f816587b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8160108d00 0x7f8160110a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f816587b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f81601139c0 con 0x7f8160108d00 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f816587b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8160113840 con 0x7f8160102ac0 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f816587b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8160113b40 con 0x7f81601083b0 2024-09-21T07:04:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f815f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8160108d00 0x7f8160110a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f815f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8160108d00 0x7f8160110a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41264/0 (socket says 172.21.15.92:41264) 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f815f7fe640 1 -- 172.21.15.92:0/4200963556 learned_addr learned my addr 172.21.15.92:0/4200963556 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f815effd640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8160102ac0 0x7f8160110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f8157fff640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81601083b0 0x7f8160110550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f815f7fe640 1 -- 172.21.15.92:0/4200963556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81601083b0 msgr2=0x7f8160110550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.051+0000 7f815f7fe640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81601083b0 0x7f8160110550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.052+0000 7f815f7fe640 1 -- 172.21.15.92:0/4200963556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8160102ac0 msgr2=0x7f8160110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.052+0000 7f815f7fe640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8160102ac0 0x7f8160110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.052+0000 7f815f7fe640 1 -- 172.21.15.92:0/4200963556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81601a8750 con 0x7f8160108d00 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.052+0000 7f815effd640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8160102ac0 0x7f8160110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.052+0000 7f815f7fe640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8160108d00 0x7f8160110a90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8158009fd0 tx=0x7f815800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.052+0000 7f8164879640 1 -- 172.21.15.92:0/4200963556 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158017070 con 0x7f8160108d00 2024-09-21T07:04:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.052+0000 7f8164879640 1 -- 172.21.15.92:0/4200963556 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8158003e00 con 0x7f8160108d00 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.052+0000 7f816587b640 1 -- 172.21.15.92:0/4200963556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81601a8a40 con 0x7f8160108d00 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.052+0000 7f8164879640 1 -- 172.21.15.92:0/4200963556 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158010460 con 0x7f8160108d00 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.052+0000 7f816587b640 1 -- 172.21.15.92:0/4200963556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81601a8f30 con 0x7f8160108d00 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.053+0000 7f816587b640 1 -- 172.21.15.92:0/4200963556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8160102ed0 con 0x7f8160108d00 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.055+0000 7f8164879640 1 -- 172.21.15.92:0/4200963556 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f8158003970 con 0x7f8160108d00 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.056+0000 7f8164879640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f814c0b64d0 0x7f814c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.056+0000 7f815effd640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f814c0b64d0 0x7f814c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.056+0000 7f8164879640 1 -- 172.21.15.92:0/4200963556 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f81580e58c0 con 0x7f8160108d00 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.056+0000 7f815effd640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f814c0b64d0 0x7f814c0b89e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8150005d00 tx=0x7f8150005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.059+0000 7f8164879640 1 -- 172.21.15.92:0/4200963556 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81580add50 con 0x7f8160108d00 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.243+0000 7f816587b640 1 -- 172.21.15.92:0/4200963556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f8160111310 con 0x7f8160108d00 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.247+0000 7f8164879640 1 -- 172.21.15.92:0/4200963556 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f8160111310 con 0x7f8160108d00 2024-09-21T07:04:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 -- 172.21.15.92:0/4200963556 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f814c0b64d0 msgr2=0x7f814c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f814c0b64d0 0x7f814c0b89e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8150005d00 tx=0x7f8150005c70 comp rx=0 tx=0).stop 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 -- 172.21.15.92:0/4200963556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8160108d00 msgr2=0x7f8160110a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8160108d00 0x7f8160110a90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8158009fd0 tx=0x7f815800b260 comp rx=0 tx=0).stop 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 -- 172.21.15.92:0/4200963556 shutdown_connections 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f814c0b64d0 0x7f814c0b89e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8160108d00 0x7f8160110a90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81601083b0 0x7f8160110550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 --2- 172.21.15.92:0/4200963556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8160102ac0 0x7f8160110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 -- 172.21.15.92:0/4200963556 >> 172.21.15.92:0/4200963556 conn(0x7f8160079720 msgr2=0x7f8160106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 -- 172.21.15.92:0/4200963556 shutdown_connections 2024-09-21T07:04:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:32.250+0000 7f816587b640 1 -- 172.21.15.92:0/4200963556 wait complete. 2024-09-21T07:04:34.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:33 smithi092 ceph-mon[30987]: from='client.? ' entity='client.admin' 2024-09-21T07:04:34.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:33 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1861105169' entity='client.admin' 2024-09-21T07:04:34.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:33 smithi092 ceph-mon[30987]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:34.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:33 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1254846366' entity='client.admin' 2024-09-21T07:04:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:33 smithi169 ceph-mon[33705]: from='client.? ' entity='client.admin' 2024-09-21T07:04:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:33 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1861105169' entity='client.admin' 2024-09-21T07:04:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:33 smithi169 ceph-mon[33705]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:33 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1254846366' entity='client.admin' 2024-09-21T07:04:34.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.351+0000 7f0f4e771640 1 -- 172.21.15.92:0/3464900008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102a60 msgr2=0x7f0f48102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.351+0000 7f0f4e771640 1 --2- 172.21.15.92:0/3464900008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102a60 0x7f0f48102e70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009900 tx=0x7f0f3002a410 comp rx=0 tx=0).stop 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.352+0000 7f0f4e771640 1 -- 172.21.15.92:0/3464900008 shutdown_connections 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.352+0000 7f0f4e771640 1 --2- 172.21.15.92:0/3464900008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f48108cf0 0x7f0f4810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.352+0000 7f0f4e771640 1 --2- 172.21.15.92:0/3464900008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f481083a0 0x7f0f481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.352+0000 7f0f4e771640 1 --2- 172.21.15.92:0/3464900008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102a60 0x7f0f48102e70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.352+0000 7f0f4e771640 1 -- 172.21.15.92:0/3464900008 >> 172.21.15.92:0/3464900008 conn(0x7f0f48079730 msgr2=0x7f0f48079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.353+0000 7f0f4e771640 1 -- 172.21.15.92:0/3464900008 shutdown_connections 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.354+0000 7f0f4e771640 1 -- 172.21.15.92:0/3464900008 wait complete. 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.354+0000 7f0f4e771640 1 Processor -- start 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.354+0000 7f0f4e771640 1 -- start start 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f4e771640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102a60 0x7f0f4819afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f4e771640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f481083a0 0x7f0f4819b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f4e771640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f48108cf0 0x7f0f4819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f4e771640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48112860 con 0x7f0f48102a60 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f4e771640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481126e0 con 0x7f0f481083a0 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f4e771640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481129e0 con 0x7f0f48108cf0 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f47fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102a60 0x7f0f4819afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f47fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102a60 0x7f0f4819afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41358/0 (socket says 172.21.15.92:41358) 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f47fff640 1 -- 172.21.15.92:0/1254846366 learned_addr learned my addr 172.21.15.92:0/1254846366 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f477fe640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f481083a0 0x7f0f4819b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.355+0000 7f0f4cd0e640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f48108cf0 0x7f0f4819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f47fff640 1 -- 172.21.15.92:0/1254846366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f48108cf0 msgr2=0x7f0f4819ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f47fff640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f48108cf0 0x7f0f4819ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f47fff640 1 -- 172.21.15.92:0/1254846366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f481083a0 msgr2=0x7f0f4819b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f47fff640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f481083a0 0x7f0f4819b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f47fff640 1 -- 172.21.15.92:0/1254846366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f481a6260 con 0x7f0f48102a60 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f47fff640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102a60 0x7f0f4819afd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f3002a930 tx=0x7f0f30030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f457fa640 1 -- 172.21.15.92:0/1254846366 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3003f070 con 0x7f0f48102a60 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f457fa640 1 -- 172.21.15.92:0/1254846366 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f30004460 con 0x7f0f48102a60 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f4e771640 1 -- 172.21.15.92:0/1254846366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f481a64f0 con 0x7f0f48102a60 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f4e771640 1 -- 172.21.15.92:0/1254846366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f481a6a20 con 0x7f0f48102a60 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.356+0000 7f0f457fa640 1 -- 172.21.15.92:0/1254846366 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30035030 con 0x7f0f48102a60 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.357+0000 7f0f4e771640 1 -- 172.21.15.92:0/1254846366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f28005290 con 0x7f0f48102a60 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.360+0000 7f0f457fa640 1 -- 172.21.15.92:0/1254846366 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f0f30042070 con 0x7f0f48102a60 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.361+0000 7f0f457fa640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f340b6580 0x7f0f340b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.361+0000 7f0f477fe640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f340b6580 0x7f0f340b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.361+0000 7f0f457fa640 1 -- 172.21.15.92:0/1254846366 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0f301062b0 con 0x7f0f48102a60 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.362+0000 7f0f477fe640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f340b6580 0x7f0f340b8a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0f48079d30 tx=0x7f0f3800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.364+0000 7f0f457fa640 1 -- 172.21.15.92:0/1254846366 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f300d2b20 con 0x7f0f48102a60 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.552+0000 7f0f4e771640 1 -- 172.21.15.92:0/1254846366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f0f28005580 con 0x7f0f48102a60 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.556+0000 7f0f457fa640 1 -- 172.21.15.92:0/1254846366 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f0f300d7a60 con 0x7f0f48102a60 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.558+0000 7f0f4e771640 1 -- 172.21.15.92:0/1254846366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f340b6580 msgr2=0x7f0f340b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.558+0000 7f0f4e771640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f340b6580 0x7f0f340b8a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0f48079d30 tx=0x7f0f3800b390 comp rx=0 tx=0).stop 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.558+0000 7f0f4e771640 1 -- 172.21.15.92:0/1254846366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102a60 msgr2=0x7f0f4819afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.558+0000 7f0f4e771640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102a60 0x7f0f4819afd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f3002a930 tx=0x7f0f30030650 comp rx=0 tx=0).stop 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.559+0000 7f0f4e771640 1 -- 172.21.15.92:0/1254846366 shutdown_connections 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.559+0000 7f0f4e771640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f340b6580 0x7f0f340b8a90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.559+0000 7f0f4e771640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f48108cf0 0x7f0f4819ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.559+0000 7f0f4e771640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f481083a0 0x7f0f4819b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.559+0000 7f0f4e771640 1 --2- 172.21.15.92:0/1254846366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102a60 0x7f0f4819afd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.559+0000 7f0f4e771640 1 -- 172.21.15.92:0/1254846366 >> 172.21.15.92:0/1254846366 conn(0x7f0f48079730 msgr2=0x7f0f48109460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:34.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.559+0000 7f0f4e771640 1 -- 172.21.15.92:0/1254846366 shutdown_connections 2024-09-21T07:04:34.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:33.559+0000 7f0f4e771640 1 -- 172.21.15.92:0/1254846366 wait complete. 2024-09-21T07:04:34.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:33 smithi175 ceph-mon[34064]: from='client.? ' entity='client.admin' 2024-09-21T07:04:34.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:33 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1861105169' entity='client.admin' 2024-09-21T07:04:34.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:33 smithi175 ceph-mon[34064]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:34.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:33 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1254846366' entity='client.admin' 2024-09-21T07:04:34.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.784+0000 7f3b131e6640 1 -- 172.21.15.92:0/217714128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1083d0 msgr2=0x7f3b0c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.784+0000 7f3b131e6640 1 --2- 172.21.15.92:0/217714128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1083d0 0x7f3b0c1087e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009900 tx=0x7f3b0002a410 comp rx=0 tx=0).stop 2024-09-21T07:04:34.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.785+0000 7f3b131e6640 1 -- 172.21.15.92:0/217714128 shutdown_connections 2024-09-21T07:04:34.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.785+0000 7f3b131e6640 1 --2- 172.21.15.92:0/217714128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c108d20 0x7f3b0c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.785+0000 7f3b131e6640 1 --2- 172.21.15.92:0/217714128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1083d0 0x7f3b0c1087e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.785+0000 7f3b131e6640 1 --2- 172.21.15.92:0/217714128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b0c102a90 0x7f3b0c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.785+0000 7f3b131e6640 1 -- 172.21.15.92:0/217714128 >> 172.21.15.92:0/217714128 conn(0x7f3b0c079750 msgr2=0x7f3b0c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:34.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.785+0000 7f3b131e6640 1 -- 172.21.15.92:0/217714128 shutdown_connections 2024-09-21T07:04:34.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.785+0000 7f3b131e6640 1 -- 172.21.15.92:0/217714128 wait complete. 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.785+0000 7f3b131e6640 1 Processor -- start 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b131e6640 1 -- start start 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b131e6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c102a90 0x7f3b0c19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b131e6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1083d0 0x7f3b0c19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b131e6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b0c108d20 0x7f3b0c19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b131e6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c112840 con 0x7f3b0c1083d0 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b131e6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c1126c0 con 0x7f3b0c108d20 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b131e6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c1129c0 con 0x7f3b0c102a90 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b0bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1083d0 0x7f3b0c19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b0bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1083d0 0x7f3b0c19b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41378/0 (socket says 172.21.15.92:41378) 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b0bfff640 1 -- 172.21.15.92:0/2792198552 learned_addr learned my addr 172.21.15.92:0/2792198552 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:34.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b10f82640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c102a90 0x7f3b0c19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b11783640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b0c108d20 0x7f3b0c19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b0bfff640 1 -- 172.21.15.92:0/2792198552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c102a90 msgr2=0x7f3b0c19b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b0bfff640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c102a90 0x7f3b0c19b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b0bfff640 1 -- 172.21.15.92:0/2792198552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b0c108d20 msgr2=0x7f3b0c19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b0bfff640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b0c108d20 0x7f3b0c19bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b0bfff640 1 -- 172.21.15.92:0/2792198552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c199000 con 0x7f3b0c1083d0 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.786+0000 7f3b0bfff640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1083d0 0x7f3b0c19b750 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3b00005940 tx=0x7f3b000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.787+0000 7f3b09ffb640 1 -- 172.21.15.92:0/2792198552 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0003f030 con 0x7f3b0c1083d0 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.787+0000 7f3b09ffb640 1 -- 172.21.15.92:0/2792198552 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b00003c90 con 0x7f3b0c1083d0 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.787+0000 7f3b131e6640 1 -- 172.21.15.92:0/2792198552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0c199290 con 0x7f3b0c1083d0 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.787+0000 7f3b09ffb640 1 -- 172.21.15.92:0/2792198552 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00035070 con 0x7f3b0c1083d0 2024-09-21T07:04:34.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.787+0000 7f3b131e6640 1 -- 172.21.15.92:0/2792198552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0c1997c0 con 0x7f3b0c1083d0 2024-09-21T07:04:34.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.788+0000 7f3b131e6640 1 -- 172.21.15.92:0/2792198552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0c103d10 con 0x7f3b0c1083d0 2024-09-21T07:04:34.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.789+0000 7f3b09ffb640 1 -- 172.21.15.92:0/2792198552 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f3b00042030 con 0x7f3b0c1083d0 2024-09-21T07:04:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.790+0000 7f3b09ffb640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3af40b6580 0x7f3af40b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.790+0000 7f3b10f82640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3af40b6580 0x7f3af40b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.791+0000 7f3b09ffb640 1 -- 172.21.15.92:0/2792198552 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3b00106050 con 0x7f3b0c1083d0 2024-09-21T07:04:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.791+0000 7f3b10f82640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3af40b6580 0x7f3af40b8a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c06c680 tx=0x7f3afc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:34.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.794+0000 7f3b09ffb640 1 -- 172.21.15.92:0/2792198552 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b000ce440 con 0x7f3b0c1083d0 2024-09-21T07:04:34.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.983+0000 7f3b131e6640 1 -- 172.21.15.92:0/2792198552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f3b0c06bf30 con 0x7f3b0c1083d0 2024-09-21T07:04:34.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.987+0000 7f3b09ffb640 1 -- 172.21.15.92:0/2792198552 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v30)=0 v30) ==== 119+0+0 (secure 0 0 0) 0x7f3b000d2820 con 0x7f3b0c1083d0 2024-09-21T07:04:34.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 -- 172.21.15.92:0/2792198552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3af40b6580 msgr2=0x7f3af40b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3af40b6580 0x7f3af40b8a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c06c680 tx=0x7f3afc00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 -- 172.21.15.92:0/2792198552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1083d0 msgr2=0x7f3b0c19b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:34.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1083d0 0x7f3b0c19b750 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3b00005940 tx=0x7f3b000042f0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 -- 172.21.15.92:0/2792198552 shutdown_connections 2024-09-21T07:04:34.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3af40b6580 0x7f3af40b8a90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b0c108d20 0x7f3b0c19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c1083d0 0x7f3b0c19b750 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 --2- 172.21.15.92:0/2792198552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c102a90 0x7f3b0c19b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:34.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 -- 172.21.15.92:0/2792198552 >> 172.21.15.92:0/2792198552 conn(0x7f3b0c079750 msgr2=0x7f3b0c104500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:34.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 -- 172.21.15.92:0/2792198552 shutdown_connections 2024-09-21T07:04:34.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:34.990+0000 7f3b131e6640 1 -- 172.21.15.92:0/2792198552 wait complete. 2024-09-21T07:04:35.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.589+0000 7f99773d5640 1 -- 172.21.15.92:0/2718765387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9970108cf0 msgr2=0x7f997010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:35.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.589+0000 7f99773d5640 1 --2- 172.21.15.92:0/2718765387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9970108cf0 0x7f997010f520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9968009900 tx=0x7f996802a410 comp rx=0 tx=0).stop 2024-09-21T07:04:35.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.589+0000 7f99773d5640 1 -- 172.21.15.92:0/2718765387 shutdown_connections 2024-09-21T07:04:35.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.589+0000 7f99773d5640 1 --2- 172.21.15.92:0/2718765387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9970108cf0 0x7f997010f520 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.589+0000 7f99773d5640 1 --2- 172.21.15.92:0/2718765387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99701083a0 0x7f99701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.589+0000 7f99773d5640 1 --2- 172.21.15.92:0/2718765387 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9970102a60 0x7f9970102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.589+0000 7f99773d5640 1 -- 172.21.15.92:0/2718765387 >> 172.21.15.92:0/2718765387 conn(0x7f9970079730 msgr2=0x7f9970079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.589+0000 7f99773d5640 1 -- 172.21.15.92:0/2718765387 shutdown_connections 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.589+0000 7f99773d5640 1 -- 172.21.15.92:0/2718765387 wait complete. 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f99773d5640 1 Processor -- start 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f99773d5640 1 -- start start 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f99773d5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9970102a60 0x7f99700ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f99773d5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99701083a0 0x7f99700ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f99773d5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9970108cf0 0x7f99701000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f99773d5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9970112810 con 0x7f99701083a0 2024-09-21T07:04:35.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f99773d5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9970112690 con 0x7f9970108cf0 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f99773d5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9970112990 con 0x7f9970102a60 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f9974970640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99701083a0 0x7f99700ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f9974970640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99701083a0 0x7f99700ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41402/0 (socket says 172.21.15.92:41402) 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.590+0000 7f9974970640 1 -- 172.21.15.92:0/3662809442 learned_addr learned my addr 172.21.15.92:0/3662809442 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f9975972640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9970108cf0 0x7f99701000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f9975171640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9970102a60 0x7f99700ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f9974970640 1 -- 172.21.15.92:0/3662809442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9970102a60 msgr2=0x7f99700ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f9974970640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9970102a60 0x7f99700ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f9974970640 1 -- 172.21.15.92:0/3662809442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9970108cf0 msgr2=0x7f99701000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f9974970640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9970108cf0 0x7f99701000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f9974970640 1 -- 172.21.15.92:0/3662809442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99701a8690 con 0x7f99701083a0 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f9975972640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9970108cf0 0x7f99701000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:04:35.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f9974970640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99701083a0 0x7f99700ffbb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f996000c970 tx=0x7f996000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:35.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f99667fc640 1 -- 172.21.15.92:0/3662809442 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960007bb0 con 0x7f99701083a0 2024-09-21T07:04:35.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f99773d5640 1 -- 172.21.15.92:0/3662809442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99701a8980 con 0x7f99701083a0 2024-09-21T07:04:35.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f99667fc640 1 -- 172.21.15.92:0/3662809442 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9960007d50 con 0x7f99701083a0 2024-09-21T07:04:35.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f99667fc640 1 -- 172.21.15.92:0/3662809442 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960018660 con 0x7f99701083a0 2024-09-21T07:04:35.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.591+0000 7f99773d5640 1 -- 172.21.15.92:0/3662809442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99701a8e70 con 0x7f99701083a0 2024-09-21T07:04:35.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.592+0000 7f99773d5640 1 -- 172.21.15.92:0/3662809442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9970102e70 con 0x7f99701083a0 2024-09-21T07:04:35.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.594+0000 7f99667fc640 1 -- 172.21.15.92:0/3662809442 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f996000f970 con 0x7f99701083a0 2024-09-21T07:04:35.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.595+0000 7f99667fc640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f995c0b64d0 0x7f995c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:35.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.595+0000 7f9975171640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f995c0b64d0 0x7f995c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:35.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.595+0000 7f99667fc640 1 -- 172.21.15.92:0/3662809442 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f99600e5c00 con 0x7f99701083a0 2024-09-21T07:04:35.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.595+0000 7f9975171640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f995c0b64d0 0x7f995c0b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f996c005c40 tx=0x7f996c008230 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:35.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.598+0000 7f99667fc640 1 -- 172.21.15.92:0/3662809442 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9960014030 con 0x7f99701083a0 2024-09-21T07:04:35.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.786+0000 7f99773d5640 1 -- 172.21.15.92:0/3662809442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f997002e640 con 0x7f99701083a0 2024-09-21T07:04:35.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.790+0000 7f99667fc640 1 -- 172.21.15.92:0/3662809442 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7f99600ae070 con 0x7f99701083a0 2024-09-21T07:04:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 -- 172.21.15.92:0/3662809442 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f995c0b64d0 msgr2=0x7f995c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f995c0b64d0 0x7f995c0b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f996c005c40 tx=0x7f996c008230 comp rx=0 tx=0).stop 2024-09-21T07:04:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 -- 172.21.15.92:0/3662809442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99701083a0 msgr2=0x7f99700ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99701083a0 0x7f99700ffbb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f996000c970 tx=0x7f996000ce30 comp rx=0 tx=0).stop 2024-09-21T07:04:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 -- 172.21.15.92:0/3662809442 shutdown_connections 2024-09-21T07:04:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f995c0b64d0 0x7f995c0b89e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9970108cf0 0x7f99701000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99701083a0 0x7f99700ffbb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 --2- 172.21.15.92:0/3662809442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9970102a60 0x7f99700ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 -- 172.21.15.92:0/3662809442 >> 172.21.15.92:0/3662809442 conn(0x7f9970079730 msgr2=0x7f997006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:35.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 -- 172.21.15.92:0/3662809442 shutdown_connections 2024-09-21T07:04:35.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:35.792+0000 7f99773d5640 1 -- 172.21.15.92:0/3662809442 wait complete. 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.785+0000 7f64065b9640 1 -- 172.21.15.92:0/1071222451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6400101f70 msgr2=0x7f6400102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.785+0000 7f64065b9640 1 --2- 172.21.15.92:0/1071222451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6400101f70 0x7f6400102380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009900 tx=0x7f63f002a410 comp rx=0 tx=0).stop 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.785+0000 7f64065b9640 1 -- 172.21.15.92:0/1071222451 shutdown_connections 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.785+0000 7f64065b9640 1 --2- 172.21.15.92:0/1071222451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6400109e00 0x7f6400110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.785+0000 7f64065b9640 1 --2- 172.21.15.92:0/1071222451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64001094b0 0x7f64001098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.785+0000 7f64065b9640 1 --2- 172.21.15.92:0/1071222451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6400101f70 0x7f6400102380 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.785+0000 7f64065b9640 1 -- 172.21.15.92:0/1071222451 >> 172.21.15.92:0/1071222451 conn(0x7f6400077c60 msgr2=0x7f64000780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.785+0000 7f64065b9640 1 -- 172.21.15.92:0/1071222451 shutdown_connections 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.785+0000 7f64065b9640 1 -- 172.21.15.92:0/1071222451 wait complete. 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.786+0000 7f64065b9640 1 Processor -- start 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.786+0000 7f64065b9640 1 -- start start 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f64065b9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6400101f70 0x7f640019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:36.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f64065b9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64001094b0 0x7f640019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f64065b9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6400109e00 0x7f640019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f64065b9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6400113970 con 0x7f6400101f70 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f64065b9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f64001137f0 con 0x7f6400109e00 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f64065b9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6400113af0 con 0x7f64001094b0 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6400101f70 0x7f640019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6400101f70 0x7f640019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47690/0 (socket says 172.21.15.92:47690) 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fffff640 1 -- 172.21.15.92:0/3691948631 learned_addr learned my addr 172.21.15.92:0/3691948631 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f6404b56640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6400109e00 0x7f640019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63ff7fe640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64001094b0 0x7f640019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fffff640 1 -- 172.21.15.92:0/3691948631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64001094b0 msgr2=0x7f640019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fffff640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64001094b0 0x7f640019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fffff640 1 -- 172.21.15.92:0/3691948631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6400109e00 msgr2=0x7f640019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:36.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fffff640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6400109e00 0x7f640019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fffff640 1 -- 172.21.15.92:0/3691948631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64001a0290 con 0x7f6400101f70 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63ff7fe640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64001094b0 0x7f640019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fffff640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6400101f70 0x7f640019a3e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009a20 tx=0x7f63f0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fd7fa640 1 -- 172.21.15.92:0/3691948631 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f003f030 con 0x7f6400101f70 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fd7fa640 1 -- 172.21.15.92:0/3691948631 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63f00035f0 con 0x7f6400101f70 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f64065b9640 1 -- 172.21.15.92:0/3691948631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64001a0520 con 0x7f6400101f70 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.787+0000 7f63fd7fa640 1 -- 172.21.15.92:0/3691948631 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0035070 con 0x7f6400101f70 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.788+0000 7f64065b9640 1 -- 172.21.15.92:0/3691948631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64001a0a50 con 0x7f6400101f70 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.789+0000 7f64065b9640 1 -- 172.21.15.92:0/3691948631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6400102380 con 0x7f6400101f70 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.791+0000 7f63fd7fa640 1 -- 172.21.15.92:0/3691948631 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f63f0003aa0 con 0x7f6400101f70 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.792+0000 7f63fd7fa640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f63e80b6580 0x7f63e80b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.792+0000 7f63ff7fe640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f63e80b6580 0x7f63e80b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.792+0000 7f63fd7fa640 1 -- 172.21.15.92:0/3691948631 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f63f0106610 con 0x7f6400101f70 2024-09-21T07:04:36.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.792+0000 7f63ff7fe640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f63e80b6580 0x7f63e80b8a90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6400109220 tx=0x7f63f400a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.795+0000 7f63fd7fa640 1 -- 172.21.15.92:0/3691948631 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64001a0a50 con 0x7f6400101f70 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.984+0000 7f64065b9640 1 -- 172.21.15.92:0/3691948631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f640002e640 con 0x7f6400101f70 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.989+0000 7f63fd7fa640 1 -- 172.21.15.92:0/3691948631 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f63f00ceaa0 con 0x7f6400101f70 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 -- 172.21.15.92:0/3691948631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f63e80b6580 msgr2=0x7f63e80b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f63e80b6580 0x7f63e80b8a90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6400109220 tx=0x7f63f400a5c0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 -- 172.21.15.92:0/3691948631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6400101f70 msgr2=0x7f640019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6400101f70 0x7f640019a3e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009a20 tx=0x7f63f0004270 comp rx=0 tx=0).stop 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 -- 172.21.15.92:0/3691948631 shutdown_connections 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f63e80b6580 0x7f63e80b8a90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6400109e00 0x7f640019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64001094b0 0x7f640019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 --2- 172.21.15.92:0/3691948631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6400101f70 0x7f640019a3e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 -- 172.21.15.92:0/3691948631 >> 172.21.15.92:0/3691948631 conn(0x7f6400077c60 msgr2=0x7f64001075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 -- 172.21.15.92:0/3691948631 shutdown_connections 2024-09-21T07:04:36.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:29.991+0000 7f64065b9640 1 -- 172.21.15.92:0/3691948631 wait complete. 2024-09-21T07:04:36.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:35 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2792198552' entity='client.admin' 2024-09-21T07:04:36.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:35 smithi175 ceph-mon[34064]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:36.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:35 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3662809442' entity='client.admin' 2024-09-21T07:04:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:35 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2792198552' entity='client.admin' 2024-09-21T07:04:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:35 smithi092 ceph-mon[30987]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:35 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3662809442' entity='client.admin' 2024-09-21T07:04:36.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:35 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2792198552' entity='client.admin' 2024-09-21T07:04:36.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:35 smithi169 ceph-mon[33705]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:36.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:35 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3662809442' entity='client.admin' 2024-09-21T07:04:38.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:38 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2849368970' entity='client.admin' 2024-09-21T07:04:38.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:38 smithi092 ceph-mon[30987]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:38.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 -- 172.21.15.92:0/1598914105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27501083a0 msgr2=0x7f27501087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:38.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 --2- 172.21.15.92:0/1598914105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27501083a0 0x7f27501087b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2744009900 tx=0x7f274402a410 comp rx=0 tx=0).stop 2024-09-21T07:04:38.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 -- 172.21.15.92:0/1598914105 shutdown_connections 2024-09-21T07:04:38.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 --2- 172.21.15.92:0/1598914105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2750108cf0 0x7f275010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 --2- 172.21.15.92:0/1598914105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27501083a0 0x7f27501087b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 --2- 172.21.15.92:0/1598914105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2750102a60 0x7f2750102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 -- 172.21.15.92:0/1598914105 >> 172.21.15.92:0/1598914105 conn(0x7f2750079730 msgr2=0x7f2750079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:38.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 -- 172.21.15.92:0/1598914105 shutdown_connections 2024-09-21T07:04:38.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 -- 172.21.15.92:0/1598914105 wait complete. 2024-09-21T07:04:38.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 Processor -- start 2024-09-21T07:04:38.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.307+0000 7f2756945640 1 -- start start 2024-09-21T07:04:38.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f2756945640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2750102a60 0x7f27501130d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:38.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f2756945640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27501083a0 0x7f2750113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:38.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f2756945640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2750108cf0 0x7f2750113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:38.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f2756945640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2750112810 con 0x7f27501083a0 2024-09-21T07:04:38.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f2756945640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2750112690 con 0x7f2750102a60 2024-09-21T07:04:38.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f2756945640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2750112990 con 0x7f2750108cf0 2024-09-21T07:04:38.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f274f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27501083a0 0x7f2750113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:38.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f274f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27501083a0 0x7f2750113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41426/0 (socket says 172.21.15.92:41426) 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f274f7fe640 1 -- 172.21.15.92:0/4111690233 learned_addr learned my addr 172.21.15.92:0/4111690233 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f274ffff640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2750102a60 0x7f27501130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f2754ee2640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2750108cf0 0x7f2750113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f274f7fe640 1 -- 172.21.15.92:0/4111690233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2750108cf0 msgr2=0x7f2750113b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f274f7fe640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2750108cf0 0x7f2750113b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f274f7fe640 1 -- 172.21.15.92:0/4111690233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2750102a60 msgr2=0x7f27501130d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f274f7fe640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2750102a60 0x7f27501130d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.308+0000 7f274f7fe640 1 -- 172.21.15.92:0/4111690233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27501a8700 con 0x7f27501083a0 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.309+0000 7f274f7fe640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27501083a0 0x7f2750113610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2744005940 tx=0x7f27440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.309+0000 7f274d7fa640 1 -- 172.21.15.92:0/4111690233 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274403f030 con 0x7f27501083a0 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.309+0000 7f274d7fa640 1 -- 172.21.15.92:0/4111690233 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2744003c90 con 0x7f27501083a0 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.309+0000 7f2756945640 1 -- 172.21.15.92:0/4111690233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27501a8990 con 0x7f27501083a0 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.309+0000 7f274d7fa640 1 -- 172.21.15.92:0/4111690233 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2744035070 con 0x7f27501083a0 2024-09-21T07:04:38.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.309+0000 7f2756945640 1 -- 172.21.15.92:0/4111690233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27501a8e70 con 0x7f27501083a0 2024-09-21T07:04:38.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.310+0000 7f2756945640 1 -- 172.21.15.92:0/4111690233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2750102e70 con 0x7f27501083a0 2024-09-21T07:04:38.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.312+0000 7f274d7fa640 1 -- 172.21.15.92:0/4111690233 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f2744042030 con 0x7f27501083a0 2024-09-21T07:04:38.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.313+0000 7f274d7fa640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27380b64d0 0x7f27380b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:38.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.313+0000 7f274ffff640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27380b64d0 0x7f27380b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:38.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.313+0000 7f274d7fa640 1 -- 172.21.15.92:0/4111690233 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2744106150 con 0x7f27501083a0 2024-09-21T07:04:38.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.314+0000 7f274ffff640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27380b64d0 0x7f27380b89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27400058c0 tx=0x7f274000a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:38.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.317+0000 7f274d7fa640 1 -- 172.21.15.92:0/4111690233 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27440d2920 con 0x7f27501083a0 2024-09-21T07:04:38.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:38 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2849368970' entity='client.admin' 2024-09-21T07:04:38.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:38 smithi169 ceph-mon[33705]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:38.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:38 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2849368970' entity='client.admin' 2024-09-21T07:04:38.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:38 smithi175 ceph-mon[34064]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:38.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.516+0000 7f2756945640 1 -- 172.21.15.92:0/4111690233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f27501a91f0 con 0x7f27501083a0 2024-09-21T07:04:38.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.521+0000 7f274d7fa640 1 -- 172.21.15.92:0/4111690233 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v33)=0 v33) ==== 111+0+0 (secure 0 0 0) 0x7f27440d7860 con 0x7f27501083a0 2024-09-21T07:04:38.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 -- 172.21.15.92:0/4111690233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27380b64d0 msgr2=0x7f27380b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:38.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27380b64d0 0x7f27380b89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27400058c0 tx=0x7f274000a250 comp rx=0 tx=0).stop 2024-09-21T07:04:38.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 -- 172.21.15.92:0/4111690233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27501083a0 msgr2=0x7f2750113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:38.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27501083a0 0x7f2750113610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2744005940 tx=0x7f27440042f0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 -- 172.21.15.92:0/4111690233 shutdown_connections 2024-09-21T07:04:38.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27380b64d0 0x7f27380b89e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2750108cf0 0x7f2750113b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27501083a0 0x7f2750113610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 --2- 172.21.15.92:0/4111690233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2750102a60 0x7f27501130d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:38.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 -- 172.21.15.92:0/4111690233 >> 172.21.15.92:0/4111690233 conn(0x7f2750079730 msgr2=0x7f27501067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:38.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 -- 172.21.15.92:0/4111690233 shutdown_connections 2024-09-21T07:04:38.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.523+0000 7f2756945640 1 -- 172.21.15.92:0/4111690233 wait complete. 2024-09-21T07:04:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.830+0000 7efdce170640 1 -- 172.21.15.92:0/2917395471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdc8102b10 msgr2=0x7efdc8102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.830+0000 7efdce170640 1 --2- 172.21.15.92:0/2917395471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdc8102b10 0x7efdc8102f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009900 tx=0x7efdb802a410 comp rx=0 tx=0).stop 2024-09-21T07:04:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.830+0000 7efdce170640 1 -- 172.21.15.92:0/2917395471 shutdown_connections 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.830+0000 7efdce170640 1 --2- 172.21.15.92:0/2917395471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc8108da0 0x7efdc810f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.830+0000 7efdce170640 1 --2- 172.21.15.92:0/2917395471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdc8108450 0x7efdc8108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.830+0000 7efdce170640 1 --2- 172.21.15.92:0/2917395471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdc8102b10 0x7efdc8102f20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.830+0000 7efdce170640 1 -- 172.21.15.92:0/2917395471 >> 172.21.15.92:0/2917395471 conn(0x7efdc80796d0 msgr2=0x7efdc8079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.830+0000 7efdce170640 1 -- 172.21.15.92:0/2917395471 shutdown_connections 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.830+0000 7efdce170640 1 -- 172.21.15.92:0/2917395471 wait complete. 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdce170640 1 Processor -- start 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdce170640 1 -- start start 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdce170640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc8102b10 0x7efdc81993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdce170640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdc8108450 0x7efdc8199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdce170640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdc8108da0 0x7efdc819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdce170640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efdc8112910 con 0x7efdc8108da0 2024-09-21T07:04:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdce170640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efdc8112790 con 0x7efdc8108450 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdce170640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efdc8112a90 con 0x7efdc8102b10 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdc7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdc8108da0 0x7efdc819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdc7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdc8108da0 0x7efdc819ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41414/0 (socket says 172.21.15.92:41414) 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdc7fff640 1 -- 172.21.15.92:0/2849368970 learned_addr learned my addr 172.21.15.92:0/2849368970 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.831+0000 7efdc77fe640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc8102b10 0x7efdc81993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdbffff640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdc8108450 0x7efdc8199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdc7fff640 1 -- 172.21.15.92:0/2849368970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc8102b10 msgr2=0x7efdc81993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdc7fff640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc8102b10 0x7efdc81993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdc7fff640 1 -- 172.21.15.92:0/2849368970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdc8108450 msgr2=0x7efdc8199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdc7fff640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdc8108450 0x7efdc8199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdc7fff640 1 -- 172.21.15.92:0/2849368970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc819f350 con 0x7efdc8108da0 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdc77fe640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc8102b10 0x7efdc81993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdbffff640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdc8108450 0x7efdc8199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:04:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdc7fff640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdc8108da0 0x7efdc819ec20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efdc000cad0 tx=0x7efdc000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdc57fa640 1 -- 172.21.15.92:0/2849368970 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc000ae20 con 0x7efdc8108da0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdc57fa640 1 -- 172.21.15.92:0/2849368970 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdc0005020 con 0x7efdc8108da0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdc57fa640 1 -- 172.21.15.92:0/2849368970 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc000f6b0 con 0x7efdc8108da0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdce170640 1 -- 172.21.15.92:0/2849368970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc819f640 con 0x7efdc8108da0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.832+0000 7efdce170640 1 -- 172.21.15.92:0/2849368970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc81a5da0 con 0x7efdc8108da0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.833+0000 7efdce170640 1 -- 172.21.15.92:0/2849368970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc8102f20 con 0x7efdc8108da0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.834+0000 7efdc57fa640 1 -- 172.21.15.92:0/2849368970 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7efdc00051d0 con 0x7efdc8108da0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.835+0000 7efdc57fa640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdb40b6550 0x7efdb40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.835+0000 7efdc77fe640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdb40b6550 0x7efdb40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.835+0000 7efdc57fa640 1 -- 172.21.15.92:0/2849368970 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7efdc00e5a40 con 0x7efdc8108da0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.836+0000 7efdc77fe640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdb40b6550 0x7efdb40b8a60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efdb8000c00 tx=0x7efdb8005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:39.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:36.840+0000 7efdc57fa640 1 -- 172.21.15.92:0/2849368970 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efdc0014030 con 0x7efdc8108da0 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.023+0000 7efdce170640 1 -- 172.21.15.92:0/2849368970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7efdc810a5e0 con 0x7efdc8108da0 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.028+0000 7efdc57fa640 1 -- 172.21.15.92:0/2849368970 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v32)=0 v32) ==== 119+0+0 (secure 0 0 0) 0x7efdc00aded0 con 0x7efdc8108da0 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 -- 172.21.15.92:0/2849368970 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdb40b6550 msgr2=0x7efdb40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdb40b6550 0x7efdb40b8a60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efdb8000c00 tx=0x7efdb8005a20 comp rx=0 tx=0).stop 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 -- 172.21.15.92:0/2849368970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdc8108da0 msgr2=0x7efdc819ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdc8108da0 0x7efdc819ec20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efdc000cad0 tx=0x7efdc000cf90 comp rx=0 tx=0).stop 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 -- 172.21.15.92:0/2849368970 shutdown_connections 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdb40b6550 0x7efdb40b8a60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdc8108da0 0x7efdc819ec20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdc8108450 0x7efdc8199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 --2- 172.21.15.92:0/2849368970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc8102b10 0x7efdc81993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 -- 172.21.15.92:0/2849368970 >> 172.21.15.92:0/2849368970 conn(0x7efdc80796d0 msgr2=0x7efdc81065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 -- 172.21.15.92:0/2849368970 shutdown_connections 2024-09-21T07:04:39.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:37.030+0000 7efdce170640 1 -- 172.21.15.92:0/2849368970 wait complete. 2024-09-21T07:04:39.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:39 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4111690233' entity='client.admin' 2024-09-21T07:04:39.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:39 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3406008138' entity='client.admin' 2024-09-21T07:04:39.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:39 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/4111690233' entity='client.admin' 2024-09-21T07:04:39.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:39 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3406008138' entity='client.admin' 2024-09-21T07:04:40.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:39 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/4111690233' entity='client.admin' 2024-09-21T07:04:40.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:39 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3406008138' entity='client.admin' 2024-09-21T07:04:40.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.823+0000 7f21729b6640 1 -- 172.21.15.92:0/1895311763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c1083a0 msgr2=0x7f216c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:40.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.823+0000 7f21729b6640 1 --2- 172.21.15.92:0/1895311763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c1083a0 0x7f216c1087b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2154009900 tx=0x7f215402a410 comp rx=0 tx=0).stop 2024-09-21T07:04:40.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.823+0000 7f21729b6640 1 -- 172.21.15.92:0/1895311763 shutdown_connections 2024-09-21T07:04:40.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.823+0000 7f21729b6640 1 --2- 172.21.15.92:0/1895311763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c108cf0 0x7f216c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.823+0000 7f21729b6640 1 --2- 172.21.15.92:0/1895311763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c1083a0 0x7f216c1087b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.823+0000 7f21729b6640 1 --2- 172.21.15.92:0/1895311763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216c102a60 0x7f216c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.823+0000 7f21729b6640 1 -- 172.21.15.92:0/1895311763 >> 172.21.15.92:0/1895311763 conn(0x7f216c079730 msgr2=0x7f216c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.823+0000 7f21729b6640 1 -- 172.21.15.92:0/1895311763 shutdown_connections 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.823+0000 7f21729b6640 1 -- 172.21.15.92:0/1895311763 wait complete. 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f21729b6640 1 Processor -- start 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f21729b6640 1 -- start start 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f21729b6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c102a60 0x7f216c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f21729b6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216c1083a0 0x7f216c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f21729b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c108cf0 0x7f216c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:40.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f21729b6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f216c113930 con 0x7f216c102a60 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f21729b6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f216c1137b0 con 0x7f216c1083a0 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f21729b6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f216c113ab0 con 0x7f216c108cf0 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f216bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c102a60 0x7f216c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f216bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c102a60 0x7f216c19a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41436/0 (socket says 172.21.15.92:41436) 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f216bfff640 1 -- 172.21.15.92:0/3406008138 learned_addr learned my addr 172.21.15.92:0/3406008138 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.824+0000 7f2163fff640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216c1083a0 0x7f216c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f2170f53640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c108cf0 0x7f216c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f216bfff640 1 -- 172.21.15.92:0/3406008138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c108cf0 msgr2=0x7f216c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f216bfff640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c108cf0 0x7f216c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f216bfff640 1 -- 172.21.15.92:0/3406008138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216c1083a0 msgr2=0x7f216c19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f216bfff640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216c1083a0 0x7f216c19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f216bfff640 1 -- 172.21.15.92:0/3406008138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216c1a0370 con 0x7f216c102a60 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f2163fff640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216c1083a0 0x7f216c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f2170f53640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c108cf0 0x7f216c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f216bfff640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c102a60 0x7f216c19a400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f215c00d950 tx=0x7f215c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f2169ffb640 1 -- 172.21.15.92:0/3406008138 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c017070 con 0x7f216c102a60 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f2169ffb640 1 -- 172.21.15.92:0/3406008138 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f215c009c30 con 0x7f216c102a60 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f21729b6640 1 -- 172.21.15.92:0/3406008138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216c1a0660 con 0x7f216c102a60 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f2169ffb640 1 -- 172.21.15.92:0/3406008138 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c00f620 con 0x7f216c102a60 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.825+0000 7f21729b6640 1 -- 172.21.15.92:0/3406008138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216c1a6dc0 con 0x7f216c102a60 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.826+0000 7f21729b6640 1 -- 172.21.15.92:0/3406008138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216c102e70 con 0x7f216c102a60 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.827+0000 7f2169ffb640 1 -- 172.21.15.92:0/3406008138 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f215c010460 con 0x7f216c102a60 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.828+0000 7f2169ffb640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f21580b64d0 0x7f21580b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:40.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.828+0000 7f2163fff640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f21580b64d0 0x7f21580b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.828+0000 7f2169ffb640 1 -- 172.21.15.92:0/3406008138 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f215c0e5400 con 0x7f216c102a60 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.829+0000 7f2163fff640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f21580b64d0 0x7f21580b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2154006010 tx=0x7f2154005de0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:38.833+0000 7f2169ffb640 1 -- 172.21.15.92:0/3406008138 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f215c0ad890 con 0x7f216c102a60 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.016+0000 7f21729b6640 1 -- 172.21.15.92:0/3406008138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f216c02e640 con 0x7f216c102a60 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.020+0000 7f2169ffb640 1 -- 172.21.15.92:0/3406008138 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v34)=0 v34) ==== 118+0+0 (secure 0 0 0) 0x7f215c009de0 con 0x7f216c102a60 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.022+0000 7f21729b6640 1 -- 172.21.15.92:0/3406008138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f21580b64d0 msgr2=0x7f21580b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.022+0000 7f21729b6640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f21580b64d0 0x7f21580b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2154006010 tx=0x7f2154005de0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.023+0000 7f21729b6640 1 -- 172.21.15.92:0/3406008138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c102a60 msgr2=0x7f216c19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.023+0000 7f21729b6640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c102a60 0x7f216c19a400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f215c00d950 tx=0x7f215c00de10 comp rx=0 tx=0).stop 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.023+0000 7f21729b6640 1 -- 172.21.15.92:0/3406008138 shutdown_connections 2024-09-21T07:04:40.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.023+0000 7f21729b6640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f21580b64d0 0x7f21580b89e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.023+0000 7f21729b6640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c108cf0 0x7f216c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.023+0000 7f21729b6640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f216c1083a0 0x7f216c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.023+0000 7f21729b6640 1 --2- 172.21.15.92:0/3406008138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f216c102a60 0x7f216c19a400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:40.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.023+0000 7f21729b6640 1 -- 172.21.15.92:0/3406008138 >> 172.21.15.92:0/3406008138 conn(0x7f216c079730 msgr2=0x7f216c104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:40.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.023+0000 7f21729b6640 1 -- 172.21.15.92:0/3406008138 shutdown_connections 2024-09-21T07:04:40.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:39.023+0000 7f21729b6640 1 -- 172.21.15.92:0/3406008138 wait complete. 2024-09-21T07:04:40.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:40 smithi092 ceph-mon[30987]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:40.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:40 smithi169 ceph-mon[33705]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:41.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:40 smithi175 ceph-mon[34064]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:42.438 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi092') 2024-09-21T07:04:42.439 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi092') 2024-09-21T07:04:42.439 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi092') 2024-09-21T07:04:42.439 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi092') 2024-09-21T07:04:42.676 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:42 smithi092 ceph-mon[30987]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:42.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:42 smithi169 ceph-mon[33705]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:42.995 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi092') 2024-09-21T07:04:42.995 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi092') 2024-09-21T07:04:43.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:42 smithi175 ceph-mon[34064]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:43.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.170+0000 7f5de1580640 1 -- 172.21.15.92:0/890802186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc1094a0 msgr2=0x7f5ddc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:43.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.170+0000 7f5de1580640 1 --2- 172.21.15.92:0/890802186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc1094a0 0x7f5ddc1098b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009900 tx=0x7f5dc402a410 comp rx=0 tx=0).stop 2024-09-21T07:04:43.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.170+0000 7f5de1580640 1 -- 172.21.15.92:0/890802186 shutdown_connections 2024-09-21T07:04:43.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.170+0000 7f5de1580640 1 --2- 172.21.15.92:0/890802186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ddc109df0 0x7f5ddc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:43.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.170+0000 7f5de1580640 1 --2- 172.21.15.92:0/890802186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc1094a0 0x7f5ddc1098b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:43.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.170+0000 7f5de1580640 1 --2- 172.21.15.92:0/890802186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ddc103b60 0x7f5ddc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:43.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.170+0000 7f5de1580640 1 -- 172.21.15.92:0/890802186 >> 172.21.15.92:0/890802186 conn(0x7f5ddc07b850 msgr2=0x7f5ddc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:43.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.170+0000 7f5de1580640 1 -- 172.21.15.92:0/890802186 shutdown_connections 2024-09-21T07:04:43.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.170+0000 7f5de1580640 1 -- 172.21.15.92:0/890802186 wait complete. 2024-09-21T07:04:43.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.171+0000 7f5de1580640 1 Processor -- start 2024-09-21T07:04:43.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.171+0000 7f5de1580640 1 -- start start 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.171+0000 7f5de1580640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ddc103b60 0x7f5ddc19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.171+0000 7f5de1580640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc1094a0 0x7f5ddc19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5de1580640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ddc109df0 0x7f5ddc19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5de1580640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc113960 con 0x7f5ddc1094a0 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5de1580640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc1137e0 con 0x7f5ddc103b60 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5de1580640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc113ae0 con 0x7f5ddc109df0 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc1094a0 0x7f5ddc19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc1094a0 0x7f5ddc19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57130/0 (socket says 172.21.15.92:57130) 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd27fc640 1 -- 172.21.15.92:0/3071954074 learned_addr learned my addr 172.21.15.92:0/3071954074 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5ddb7fe640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ddc109df0 0x7f5ddc19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5ddaffd640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ddc103b60 0x7f5ddc19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:43.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd27fc640 1 -- 172.21.15.92:0/3071954074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ddc109df0 msgr2=0x7f5ddc19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:43.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd27fc640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ddc109df0 0x7f5ddc19fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:43.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd27fc640 1 -- 172.21.15.92:0/3071954074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ddc103b60 msgr2=0x7f5ddc19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:43.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd27fc640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ddc103b60 0x7f5ddc19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:43.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd27fc640 1 -- 172.21.15.92:0/3071954074 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ddc1a0380 con 0x7f5ddc1094a0 2024-09-21T07:04:43.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd27fc640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc1094a0 0x7f5ddc19a9b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4005940 tx=0x7f5dc40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:43.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd8ff9640 1 -- 172.21.15.92:0/3071954074 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc403f030 con 0x7f5ddc1094a0 2024-09-21T07:04:43.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5de1580640 1 -- 172.21.15.92:0/3071954074 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ddc1a0610 con 0x7f5ddc1094a0 2024-09-21T07:04:43.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd8ff9640 1 -- 172.21.15.92:0/3071954074 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5dc4003c90 con 0x7f5ddc1094a0 2024-09-21T07:04:43.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5dd8ff9640 1 -- 172.21.15.92:0/3071954074 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4035070 con 0x7f5ddc1094a0 2024-09-21T07:04:43.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.172+0000 7f5de1580640 1 -- 172.21.15.92:0/3071954074 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ddc1a6dd0 con 0x7f5ddc1094a0 2024-09-21T07:04:43.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.174+0000 7f5de1580640 1 -- 172.21.15.92:0/3071954074 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ddc103f70 con 0x7f5ddc1094a0 2024-09-21T07:04:43.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.175+0000 7f5dd8ff9640 1 -- 172.21.15.92:0/3071954074 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f5dc4042030 con 0x7f5ddc1094a0 2024-09-21T07:04:43.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.176+0000 7f5dd8ff9640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5dc80b64d0 0x7f5dc80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:43.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.176+0000 7f5ddaffd640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5dc80b64d0 0x7f5dc80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:43.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.176+0000 7f5dd8ff9640 1 -- 172.21.15.92:0/3071954074 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5dc4105fc0 con 0x7f5ddc1094a0 2024-09-21T07:04:43.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.176+0000 7f5ddaffd640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5dc80b64d0 0x7f5dc80b89e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0058c0 tx=0x7f5dcc00a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:43.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.180+0000 7f5dd8ff9640 1 -- 172.21.15.92:0/3071954074 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5dc40d2830 con 0x7f5ddc1094a0 2024-09-21T07:04:43.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.364+0000 7f5de1580640 1 -- 172.21.15.92:0/3071954074 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f5ddc10bc20 con 0x7f5ddc1094a0 2024-09-21T07:04:43.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.368+0000 7f5dd8ff9640 1 -- 172.21.15.92:0/3071954074 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v35)=0 v35) ==== 121+0+0 (secure 0 0 0) 0x7f5dc40d7770 con 0x7f5ddc1094a0 2024-09-21T07:04:43.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 -- 172.21.15.92:0/3071954074 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5dc80b64d0 msgr2=0x7f5dc80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:43.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5dc80b64d0 0x7f5dc80b89e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0058c0 tx=0x7f5dcc00a250 comp rx=0 tx=0).stop 2024-09-21T07:04:43.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 -- 172.21.15.92:0/3071954074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc1094a0 msgr2=0x7f5ddc19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:43.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc1094a0 0x7f5ddc19a9b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4005940 tx=0x7f5dc40042f0 comp rx=0 tx=0).stop 2024-09-21T07:04:43.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 -- 172.21.15.92:0/3071954074 shutdown_connections 2024-09-21T07:04:43.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5dc80b64d0 0x7f5dc80b89e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:43.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ddc109df0 0x7f5ddc19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:43.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc1094a0 0x7f5ddc19a9b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:43.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 --2- 172.21.15.92:0/3071954074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ddc103b60 0x7f5ddc19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:43.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 -- 172.21.15.92:0/3071954074 >> 172.21.15.92:0/3071954074 conn(0x7f5ddc07b850 msgr2=0x7f5ddc1055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:43.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 -- 172.21.15.92:0/3071954074 shutdown_connections 2024-09-21T07:04:43.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:43.370+0000 7f5de1580640 1 -- 172.21.15.92:0/3071954074 wait complete. 2024-09-21T07:04:44.311 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi092') 2024-09-21T07:04:44.587 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:44 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3071954074' entity='client.admin' 2024-09-21T07:04:44.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:44 smithi092 ceph-mon[30987]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:44.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:44.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:44.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:44.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:44.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:44.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:44 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3071954074' entity='client.admin' 2024-09-21T07:04:44.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:44 smithi169 ceph-mon[33705]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:44.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:44.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:44.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:44.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:44.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:44.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:44 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3071954074' entity='client.admin' 2024-09-21T07:04:44.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:44 smithi175 ceph-mon[34064]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:44.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:44.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:44.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:44.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:44.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:44.842 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi092') 2024-09-21T07:04:44.842 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi092') 2024-09-21T07:04:45.164 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:45.542 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:45 smithi092 ceph-mon[30987]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:04:45.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:45 smithi092 ceph-mon[30987]: Reconfiguring daemon mon.b on smithi169 2024-09-21T07:04:45.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:45.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:45.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:45.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:45.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:45.633 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:45 smithi175 ceph-mon[34064]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:04:45.633 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:45 smithi175 ceph-mon[34064]: Reconfiguring daemon mon.b on smithi169 2024-09-21T07:04:45.634 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:45.634 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:45.634 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:45.634 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:45.634 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:45.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:45 smithi169 ceph-mon[33705]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:04:45.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:45 smithi169 ceph-mon[33705]: Reconfiguring daemon mon.b on smithi169 2024-09-21T07:04:45.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:45.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:45.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:04:45.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:04:45.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:45.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.844+0000 7fac2b87a640 1 -- 172.21.15.92:0/2545511482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac241027c0 msgr2=0x7fac24102bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.844+0000 7fac2b87a640 1 --2- 172.21.15.92:0/2545511482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac241027c0 0x7fac24102bd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fac20009930 tx=0x7fac2002a420 comp rx=0 tx=0).stop 2024-09-21T07:04:46.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.844+0000 7fac2b87a640 1 -- 172.21.15.92:0/2545511482 shutdown_connections 2024-09-21T07:04:46.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.844+0000 7fac2b87a640 1 --2- 172.21.15.92:0/2545511482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac24107c00 0x7fac241080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.844+0000 7fac2b87a640 1 --2- 172.21.15.92:0/2545511482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac24103110 0x7fac24107640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.844+0000 7fac2b87a640 1 --2- 172.21.15.92:0/2545511482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac241027c0 0x7fac24102bd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.844+0000 7fac2b87a640 1 -- 172.21.15.92:0/2545511482 >> 172.21.15.92:0/2545511482 conn(0x7fac24079740 msgr2=0x7fac24079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:46.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.844+0000 7fac2b87a640 1 -- 172.21.15.92:0/2545511482 shutdown_connections 2024-09-21T07:04:46.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.844+0000 7fac2b87a640 1 -- 172.21.15.92:0/2545511482 wait complete. 2024-09-21T07:04:46.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.844+0000 7fac2b87a640 1 Processor -- start 2024-09-21T07:04:46.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac2b87a640 1 -- start start 2024-09-21T07:04:46.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac2b87a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac241027c0 0x7fac241a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac2b87a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac24103110 0x7fac241a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac2b87a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac24107c00 0x7fac241a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac2b87a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fac24119fd0 con 0x7fac24107c00 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac2b87a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac24119e50 con 0x7fac24103110 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac2b87a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac2411a150 con 0x7fac241027c0 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac29e17640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac24107c00 0x7fac241a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac29e17640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac24107c00 0x7fac241a62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57154/0 (socket says 172.21.15.92:57154) 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac29e17640 1 -- 172.21.15.92:0/897822911 learned_addr learned my addr 172.21.15.92:0/897822911 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac29616640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac241027c0 0x7fac241a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac28e15640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac24103110 0x7fac241a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac29e17640 1 -- 172.21.15.92:0/897822911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac241027c0 msgr2=0x7fac241a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac29e17640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac241027c0 0x7fac241a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac29e17640 1 -- 172.21.15.92:0/897822911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac24103110 msgr2=0x7fac241a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac29e17640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac24103110 0x7fac241a1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac29e17640 1 -- 172.21.15.92:0/897822911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac241a6950 con 0x7fac24107c00 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.845+0000 7fac29e17640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac24107c00 0x7fac241a62e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00b970 tx=0x7fac1c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.846+0000 7fac1a7fc640 1 -- 172.21.15.92:0/897822911 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c019070 con 0x7fac24107c00 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.846+0000 7fac2b87a640 1 -- 172.21.15.92:0/897822911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac241a6c40 con 0x7fac24107c00 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.846+0000 7fac1a7fc640 1 -- 172.21.15.92:0/897822911 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac1c014440 con 0x7fac24107c00 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.846+0000 7fac1a7fc640 1 -- 172.21.15.92:0/897822911 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0075d0 con 0x7fac24107c00 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.846+0000 7fac2b87a640 1 -- 172.21.15.92:0/897822911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac241ad460 con 0x7fac24107c00 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.847+0000 7fac2b87a640 1 -- 172.21.15.92:0/897822911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2406c240 con 0x7fac24107c00 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.848+0000 7fac1a7fc640 1 -- 172.21.15.92:0/897822911 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fac1c01c070 con 0x7fac24107c00 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.849+0000 7fac1a7fc640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fac100b6500 0x7fac100b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.849+0000 7fac29616640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fac100b6500 0x7fac100b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.849+0000 7fac1a7fc640 1 -- 172.21.15.92:0/897822911 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fac1c0e53b0 con 0x7fac24107c00 2024-09-21T07:04:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.850+0000 7fac29616640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fac100b6500 0x7fac100b8a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fac20005940 tx=0x7fac200058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:46.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:45.852+0000 7fac1a7fc640 1 -- 172.21.15.92:0/897822911 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac1c023070 con 0x7fac24107c00 2024-09-21T07:04:46.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.691+0000 7f7da362a640 1 -- 172.21.15.92:0/2610667987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d9c1094b0 msgr2=0x7f7d9c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.691+0000 7f7da362a640 1 --2- 172.21.15.92:0/2610667987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d9c1094b0 0x7f7d9c1098c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009900 tx=0x7f7d9002a410 comp rx=0 tx=0).stop 2024-09-21T07:04:46.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.691+0000 7f7da362a640 1 -- 172.21.15.92:0/2610667987 shutdown_connections 2024-09-21T07:04:46.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.691+0000 7f7da362a640 1 --2- 172.21.15.92:0/2610667987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c109e00 0x7f7d9c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.691+0000 7f7da362a640 1 --2- 172.21.15.92:0/2610667987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d9c1094b0 0x7f7d9c1098c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.691+0000 7f7da362a640 1 --2- 172.21.15.92:0/2610667987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d9c103bc0 0x7f7d9c103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.691+0000 7f7da362a640 1 -- 172.21.15.92:0/2610667987 >> 172.21.15.92:0/2610667987 conn(0x7f7d9c07b910 msgr2=0x7f7d9c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.692+0000 7f7da362a640 1 -- 172.21.15.92:0/2610667987 shutdown_connections 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.692+0000 7f7da362a640 1 -- 172.21.15.92:0/2610667987 wait complete. 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.692+0000 7f7da362a640 1 Processor -- start 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.692+0000 7f7da362a640 1 -- start start 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da362a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c103bc0 0x7f7d9c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da362a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d9c1094b0 0x7f7d9c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da362a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d9c109e00 0x7f7d9c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da362a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c113990 con 0x7f7d9c109e00 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da362a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c113810 con 0x7f7d9c103bc0 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da362a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c113b10 con 0x7f7d9c1094b0 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da1bc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d9c109e00 0x7f7d9c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da1bc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d9c109e00 0x7f7d9c19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57120/0 (socket says 172.21.15.92:57120) 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da1bc7640 1 -- 172.21.15.92:0/1084496961 learned_addr learned my addr 172.21.15.92:0/1084496961 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:46.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da13c6640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c103bc0 0x7f7d9c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da0bc5640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d9c1094b0 0x7f7d9c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da1bc7640 1 -- 172.21.15.92:0/1084496961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d9c1094b0 msgr2=0x7f7d9c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da1bc7640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d9c1094b0 0x7f7d9c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da1bc7640 1 -- 172.21.15.92:0/1084496961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c103bc0 msgr2=0x7f7d9c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da1bc7640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c103bc0 0x7f7d9c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da1bc7640 1 -- 172.21.15.92:0/1084496961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c1a03f0 con 0x7f7d9c109e00 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da13c6640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c103bc0 0x7f7d9c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da1bc7640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d9c109e00 0x7f7d9c19fcc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00eaa0 tx=0x7f7d8c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7d9a7fc640 1 -- 172.21.15.92:0/1084496961 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c00cdb0 con 0x7f7d9c109e00 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7d9a7fc640 1 -- 172.21.15.92:0/1084496961 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d8c005020 con 0x7f7d9c109e00 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da362a640 1 -- 172.21.15.92:0/1084496961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9c1a06e0 con 0x7f7d9c109e00 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7d9a7fc640 1 -- 172.21.15.92:0/1084496961 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c0116d0 con 0x7f7d9c109e00 2024-09-21T07:04:46.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.693+0000 7f7da362a640 1 -- 172.21.15.92:0/1084496961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d9c1a6e40 con 0x7f7d9c109e00 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.695+0000 7f7da362a640 1 -- 172.21.15.92:0/1084496961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d9c103fd0 con 0x7f7d9c109e00 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.696+0000 7f7d9a7fc640 1 -- 172.21.15.92:0/1084496961 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f7d8c0051d0 con 0x7f7d9c109e00 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.697+0000 7f7d9a7fc640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7d840b64d0 0x7f7d840b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.697+0000 7f7da13c6640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7d840b64d0 0x7f7d840b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.697+0000 7f7d9a7fc640 1 -- 172.21.15.92:0/1084496961 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7d8c0e5de0 con 0x7f7d9c109e00 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.697+0000 7f7da13c6640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7d840b64d0 0x7f7d840b89e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009930 tx=0x7f7d94008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.700+0000 7f7d9a7fc640 1 -- 172.21.15.92:0/1084496961 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d8c016030 con 0x7f7d9c109e00 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.881+0000 7f7da362a640 1 -- 172.21.15.92:0/1084496961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f7d9c10bc30 con 0x7f7d9c109e00 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.881+0000 7f7d9a7fc640 1 -- 172.21.15.92:0/1084496961 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v34)=0 v34) ==== 108+0+0 (secure 0 0 0) 0x7f7d8c0ae270 con 0x7f7d9c109e00 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 -- 172.21.15.92:0/1084496961 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7d840b64d0 msgr2=0x7f7d840b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7d840b64d0 0x7f7d840b89e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009930 tx=0x7f7d94008040 comp rx=0 tx=0).stop 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 -- 172.21.15.92:0/1084496961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d9c109e00 msgr2=0x7f7d9c19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d9c109e00 0x7f7d9c19fcc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00eaa0 tx=0x7f7d8c00ef60 comp rx=0 tx=0).stop 2024-09-21T07:04:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 -- 172.21.15.92:0/1084496961 shutdown_connections 2024-09-21T07:04:46.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7d840b64d0 0x7f7d840b89e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d9c109e00 0x7f7d9c19fcc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d9c1094b0 0x7f7d9c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 --2- 172.21.15.92:0/1084496961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c103bc0 0x7f7d9c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 -- 172.21.15.92:0/1084496961 >> 172.21.15.92:0/1084496961 conn(0x7f7d9c07b910 msgr2=0x7f7d9c1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:46.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 -- 172.21.15.92:0/1084496961 shutdown_connections 2024-09-21T07:04:46.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:42.884+0000 7f7da362a640 1 -- 172.21.15.92:0/1084496961 wait complete. 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.034+0000 7fac2b87a640 1 -- 172.21.15.92:0/897822911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fac24107640 con 0x7fac24107c00 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.038+0000 7fac1a7fc640 1 -- 172.21.15.92:0/897822911 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v36)=0 v36) ==== 125+0+0 (secure 0 0 0) 0x7fac1c0ad840 con 0x7fac24107c00 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 -- 172.21.15.92:0/897822911 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fac100b6500 msgr2=0x7fac100b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fac100b6500 0x7fac100b8a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fac20005940 tx=0x7fac200058d0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 -- 172.21.15.92:0/897822911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac24107c00 msgr2=0x7fac241a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac24107c00 0x7fac241a62e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00b970 tx=0x7fac1c00be30 comp rx=0 tx=0).stop 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 -- 172.21.15.92:0/897822911 shutdown_connections 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fac100b6500 0x7fac100b8a10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac24107c00 0x7fac241a62e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac24103110 0x7fac241a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 --2- 172.21.15.92:0/897822911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac241027c0 0x7fac241a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 -- 172.21.15.92:0/897822911 >> 172.21.15.92:0/897822911 conn(0x7fac24079740 msgr2=0x7fac24105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:46.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 -- 172.21.15.92:0/897822911 shutdown_connections 2024-09-21T07:04:46.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:46.041+0000 7fac2b87a640 1 -- 172.21.15.92:0/897822911 wait complete. 2024-09-21T07:04:46.635 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:46 smithi175 ceph-mon[34064]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:04:46.636 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:46 smithi175 ceph-mon[34064]: Reconfiguring daemon mon.c on smithi175 2024-09-21T07:04:46.636 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:46 smithi175 ceph-mon[34064]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:46.636 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:46 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/897822911' entity='client.admin' 2024-09-21T07:04:46.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:46 smithi169 ceph-mon[33705]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:04:46.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:46 smithi169 ceph-mon[33705]: Reconfiguring daemon mon.c on smithi175 2024-09-21T07:04:46.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:46 smithi169 ceph-mon[33705]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:46.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:46 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/897822911' entity='client.admin' 2024-09-21T07:04:46.673 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:46 smithi092 ceph-mon[30987]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:04:46.673 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:46 smithi092 ceph-mon[30987]: Reconfiguring daemon mon.c on smithi175 2024-09-21T07:04:46.673 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:46 smithi092 ceph-mon[30987]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:46.673 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:46 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/897822911' entity='client.admin' 2024-09-21T07:04:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:47 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:47 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:47 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:47 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:47 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:47 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:47 smithi092 ceph-mon[30987]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:48.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:47 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:48.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:47 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:48.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:47 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:48.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:47 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:48.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:47 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:48.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:47 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:48.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:47 smithi175 ceph-mon[34064]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:48.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.139+0000 7fb8da9d1640 1 -- 172.21.15.92:0/260288733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d4102bf0 msgr2=0x7fb8d4108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:48.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.139+0000 7fb8da9d1640 1 --2- 172.21.15.92:0/260288733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d4102bf0 0x7fb8d4108120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009ca0 tx=0x7fb8cc02a8e0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.139+0000 7fb8da9d1640 1 -- 172.21.15.92:0/260288733 shutdown_connections 2024-09-21T07:04:48.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.139+0000 7fb8da9d1640 1 --2- 172.21.15.92:0/260288733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d4102bf0 0x7fb8d4108120 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.139+0000 7fb8da9d1640 1 --2- 172.21.15.92:0/260288733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d41027e0 0x7fb8d4107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.139+0000 7fb8da9d1640 1 --2- 172.21.15.92:0/260288733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8d406b2d0 0x7fb8d41022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.139+0000 7fb8da9d1640 1 -- 172.21.15.92:0/260288733 >> 172.21.15.92:0/260288733 conn(0x7fb8d4079ec0 msgr2=0x7fb8d407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:48.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.139+0000 7fb8da9d1640 1 -- 172.21.15.92:0/260288733 shutdown_connections 2024-09-21T07:04:48.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.139+0000 7fb8da9d1640 1 -- 172.21.15.92:0/260288733 wait complete. 2024-09-21T07:04:48.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.140+0000 7fb8da9d1640 1 Processor -- start 2024-09-21T07:04:48.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.140+0000 7fb8da9d1640 1 -- start start 2024-09-21T07:04:48.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.140+0000 7fb8da9d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8d406b2d0 0x7fb8d4199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:48.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.140+0000 7fb8da9d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d41027e0 0x7fb8d4199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:48.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.140+0000 7fb8da9d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d4102bf0 0x7fb8d419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:48.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.140+0000 7fb8da9d1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d41129d0 con 0x7fb8d41027e0 2024-09-21T07:04:48.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.140+0000 7fb8da9d1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4112850 con 0x7fb8d406b2d0 2024-09-21T07:04:48.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.140+0000 7fb8da9d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4112b50 con 0x7fb8d4102bf0 2024-09-21T07:04:48.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.140+0000 7fb8d37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d41027e0 0x7fb8d4199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:48.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d41027e0 0x7fb8d4199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57160/0 (socket says 172.21.15.92:57160) 2024-09-21T07:04:48.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d37fe640 1 -- 172.21.15.92:0/4042103999 learned_addr learned my addr 172.21.15.92:0/4042103999 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:48.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d3fff640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8d406b2d0 0x7fb8d4199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d8f6e640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d4102bf0 0x7fb8d419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d37fe640 1 -- 172.21.15.92:0/4042103999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d4102bf0 msgr2=0x7fb8d419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d37fe640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d4102bf0 0x7fb8d419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d37fe640 1 -- 172.21.15.92:0/4042103999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8d406b2d0 msgr2=0x7fb8d4199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d37fe640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8d406b2d0 0x7fb8d4199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d37fe640 1 -- 172.21.15.92:0/4042103999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d419f2d0 con 0x7fb8d41027e0 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d37fe640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d41027e0 0x7fb8d4199900 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8006fd0 tx=0x7fb8c800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d17fa640 1 -- 172.21.15.92:0/4042103999 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8011830 con 0x7fb8d41027e0 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8da9d1640 1 -- 172.21.15.92:0/4042103999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d419f5c0 con 0x7fb8d41027e0 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d17fa640 1 -- 172.21.15.92:0/4042103999 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8c8016070 con 0x7fb8d41027e0 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8d17fa640 1 -- 172.21.15.92:0/4042103999 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8010d30 con 0x7fb8d41027e0 2024-09-21T07:04:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.141+0000 7fb8da9d1640 1 -- 172.21.15.92:0/4042103999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d41a5da0 con 0x7fb8d41027e0 2024-09-21T07:04:48.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:47 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:48.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:47 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:48.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:47 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:48.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:47 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:48.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:47 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:48.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:47 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:04:48.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:47 smithi169 ceph-mon[33705]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.142+0000 7fb8da9d1640 1 -- 172.21.15.92:0/4042103999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d41022a0 con 0x7fb8d41027e0 2024-09-21T07:04:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.144+0000 7fb8d17fa640 1 -- 172.21.15.92:0/4042103999 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fb8c80119d0 con 0x7fb8d41027e0 2024-09-21T07:04:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.144+0000 7fb8d17fa640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8bc0b64d0 0x7fb8bc0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.144+0000 7fb8d3fff640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8bc0b64d0 0x7fb8bc0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.145+0000 7fb8d17fa640 1 -- 172.21.15.92:0/4042103999 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb8c80e4d30 con 0x7fb8d41027e0 2024-09-21T07:04:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.145+0000 7fb8d3fff640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8bc0b64d0 0x7fb8bc0b89e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009890 tx=0x7fb8c4008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:48.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.149+0000 7fb8d17fa640 1 -- 172.21.15.92:0/4042103999 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8c80e9070 con 0x7fb8d41027e0 2024-09-21T07:04:48.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.325+0000 7fb8da9d1640 1 -- 172.21.15.92:0/4042103999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fb8d41a60a0 con 0x7fb8d41027e0 2024-09-21T07:04:48.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.329+0000 7fb8d17fa640 1 -- 172.21.15.92:0/4042103999 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v37)=0 v37) ==== 120+0+0 (secure 0 0 0) 0x7fb8c80ad1c0 con 0x7fb8d41027e0 2024-09-21T07:04:48.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.331+0000 7fb8da9d1640 1 -- 172.21.15.92:0/4042103999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8bc0b64d0 msgr2=0x7fb8bc0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8bc0b64d0 0x7fb8bc0b89e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009890 tx=0x7fb8c4008040 comp rx=0 tx=0).stop 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 -- 172.21.15.92:0/4042103999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d41027e0 msgr2=0x7fb8d4199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d41027e0 0x7fb8d4199900 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8006fd0 tx=0x7fb8c800b8e0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 -- 172.21.15.92:0/4042103999 shutdown_connections 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8bc0b64d0 0x7fb8bc0b89e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8d4102bf0 0x7fb8d419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d41027e0 0x7fb8d4199900 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 --2- 172.21.15.92:0/4042103999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8d406b2d0 0x7fb8d4199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 -- 172.21.15.92:0/4042103999 >> 172.21.15.92:0/4042103999 conn(0x7fb8d4079ec0 msgr2=0x7fb8d4100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 -- 172.21.15.92:0/4042103999 shutdown_connections 2024-09-21T07:04:48.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:48.332+0000 7fb8da9d1640 1 -- 172.21.15.92:0/4042103999 wait complete. 2024-09-21T07:04:48.910 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.911 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.911 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.911 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.911 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.911 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.911 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.911 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.911 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.911 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.912 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.912 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4e9565c0-77e7-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi092') 2024-09-21T07:04:48.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T07:04:49.151 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:49.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:49 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4042103999' entity='client.admin' 2024-09-21T07:04:49.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:49 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/4042103999' entity='client.admin' 2024-09-21T07:04:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.631+0000 7f3408fd4640 1 -- 172.21.15.92:0/2934236788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404103b60 msgr2=0x7f3404103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.631+0000 7f3408fd4640 1 --2- 172.21.15.92:0/2934236788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404103b60 0x7f3404103f70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009ca0 tx=0x7f33f402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.631+0000 7f3408fd4640 1 -- 172.21.15.92:0/2934236788 shutdown_connections 2024-09-21T07:04:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.631+0000 7f3408fd4640 1 --2- 172.21.15.92:0/2934236788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3404109df0 0x7f3404110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.631+0000 7f3408fd4640 1 --2- 172.21.15.92:0/2934236788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34041094a0 0x7f34041098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.631+0000 7f3408fd4640 1 --2- 172.21.15.92:0/2934236788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404103b60 0x7f3404103f70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.631+0000 7f3408fd4640 1 -- 172.21.15.92:0/2934236788 >> 172.21.15.92:0/2934236788 conn(0x7f340407b850 msgr2=0x7f340407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.631+0000 7f3408fd4640 1 -- 172.21.15.92:0/2934236788 shutdown_connections 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.632+0000 7f3408fd4640 1 -- 172.21.15.92:0/2934236788 wait complete. 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3408fd4640 1 Processor -- start 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3408fd4640 1 -- start start 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3408fd4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404103b60 0x7f340419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3408fd4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34041094a0 0x7f340419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3408fd4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3404109df0 0x7f340419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3408fd4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f34041139b0 con 0x7f3404103b60 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3408fd4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3404113830 con 0x7f3404109df0 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3408fd4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3404113b30 con 0x7f34041094a0 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f340259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404103b60 0x7f340419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f340259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404103b60 0x7f340419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57178/0 (socket says 172.21.15.92:57178) 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f340259c640 1 -- 172.21.15.92:0/2704067557 learned_addr learned my addr 172.21.15.92:0/2704067557 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3401d9b640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34041094a0 0x7f340419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3402d9d640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3404109df0 0x7f340419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f340259c640 1 -- 172.21.15.92:0/2704067557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34041094a0 msgr2=0x7f340419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f340259c640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34041094a0 0x7f340419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f340259c640 1 -- 172.21.15.92:0/2704067557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3404109df0 msgr2=0x7f340419fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f340259c640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3404109df0 0x7f340419fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f340259c640 1 -- 172.21.15.92:0/2704067557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34041a0270 con 0x7f3404103b60 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.633+0000 7f3402d9d640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3404109df0 0x7f340419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.634+0000 7f340259c640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404103b60 0x7f340419a3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009dc0 tx=0x7f33f4032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.634+0000 7f33f37fe640 1 -- 172.21.15.92:0/2704067557 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4004040 con 0x7f3404103b60 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.634+0000 7f3408fd4640 1 -- 172.21.15.92:0/2704067557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34041a0500 con 0x7f3404103b60 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.634+0000 7f33f37fe640 1 -- 172.21.15.92:0/2704067557 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33f4004670 con 0x7f3404103b60 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.634+0000 7f33f37fe640 1 -- 172.21.15.92:0/2704067557 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4030c80 con 0x7f3404103b60 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.634+0000 7f3408fd4640 1 -- 172.21.15.92:0/2704067557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34041a0a40 con 0x7f3404103b60 2024-09-21T07:04:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.635+0000 7f3408fd4640 1 -- 172.21.15.92:0/2704067557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3404103f70 con 0x7f3404103b60 2024-09-21T07:04:49.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.636+0000 7f33f37fe640 1 -- 172.21.15.92:0/2704067557 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f33f40041e0 con 0x7f3404103b60 2024-09-21T07:04:49.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.637+0000 7f33f37fe640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33ec0b6500 0x7f33ec0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:49.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.637+0000 7f3401d9b640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33ec0b6500 0x7f33ec0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:49.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.637+0000 7f33f37fe640 1 -- 172.21.15.92:0/2704067557 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f33f41069d0 con 0x7f3404103b60 2024-09-21T07:04:49.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.637+0000 7f3401d9b640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33ec0b6500 0x7f33ec0b8a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3404106530 tx=0x7f33f800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:49.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.641+0000 7f33f37fe640 1 -- 172.21.15.92:0/2704067557 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f33f40cee60 con 0x7f3404103b60 2024-09-21T07:04:49.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:49 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/4042103999' entity='client.admin' 2024-09-21T07:04:49.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.820+0000 7f3408fd4640 1 -- 172.21.15.92:0/2704067557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f340419b4f0 con 0x7f3404103b60 2024-09-21T07:04:49.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.821+0000 7f33f37fe640 1 -- 172.21.15.92:0/2704067557 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+22127 (secure 0 0 0) 0x7f33f4004820 con 0x7f3404103b60 2024-09-21T07:04:49.823 INFO:teuthology.orchestra.run.smithi092.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:04:49.823 INFO:teuthology.orchestra.run.smithi092.stdout:global dev auth_debug true 2024-09-21T07:04:49.823 INFO:teuthology.orchestra.run.smithi092.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T07:04:49.823 INFO:teuthology.orchestra.run.smithi092.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T07:04:49.823 INFO:teuthology.orchestra.run.smithi092.stdout:global basic log_to_file true 2024-09-21T07:04:49.823 INFO:teuthology.orchestra.run.smithi092.stdout:global basic log_to_journald false 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global basic log_to_stderr false 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced mon_allow_pool_delete true 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global dev ms_die_on_bug true 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global dev ms_die_on_old_message true 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:04:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced debug_mon 20/20 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced debug_ms 1/1 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced debug_paxos 20/20 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T07:04:49.825 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced debug_client 20/20 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T07:04:49.826 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:osd dev bdev_debug_aio true 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced debug_bluefs 20/20 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced debug_bluestore 20/20 2024-09-21T07:04:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced debug_ms 1/1 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced debug_osd 20/20 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd dev osd_debug_op_order true 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd dev osd_debug_shutdown true 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T07:04:49.828 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced debug_mds 20/20 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced debug_ms 2/2 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T07:04:49.829 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced mds_bal_split_size 100 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:mds dev mds_debug_frag true 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced mds_export_ephemeral_random_max 0.100000 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:mds dev mds_verify_scatter true 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:client advanced client_mount_timeout 600 2024-09-21T07:04:49.830 INFO:teuthology.orchestra.run.smithi092.stdout:client advanced debug_client 20/20 2024-09-21T07:04:49.831 INFO:teuthology.orchestra.run.smithi092.stdout:client advanced debug_ms 1/1 2024-09-21T07:04:49.831 INFO:teuthology.orchestra.run.smithi092.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:04:49.831 INFO:teuthology.orchestra.run.smithi092.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:04:49.831 INFO:teuthology.orchestra.run.smithi092.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T07:04:49.831 INFO:teuthology.orchestra.run.smithi092.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T07:04:49.831 INFO:teuthology.orchestra.run.smithi092.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 -- 172.21.15.92:0/2704067557 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33ec0b6500 msgr2=0x7f33ec0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33ec0b6500 0x7f33ec0b8a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3404106530 tx=0x7f33f800a2d0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 -- 172.21.15.92:0/2704067557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404103b60 msgr2=0x7f340419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404103b60 0x7f340419a3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009dc0 tx=0x7f33f4032bc0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 -- 172.21.15.92:0/2704067557 shutdown_connections 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33ec0b6500 0x7f33ec0b8a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3404109df0 0x7f340419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34041094a0 0x7f340419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 --2- 172.21.15.92:0/2704067557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404103b60 0x7f340419a3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 -- 172.21.15.92:0/2704067557 >> 172.21.15.92:0/2704067557 conn(0x7f340407b850 msgr2=0x7f3404107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.823+0000 7f3408fd4640 1 -- 172.21.15.92:0/2704067557 shutdown_connections 2024-09-21T07:04:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:49.824+0000 7f3408fd4640 1 -- 172.21.15.92:0/2704067557 wait complete. 2024-09-21T07:04:50.384 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T07:04:50.384 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:04:50.384 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:04:50.401 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:04:50.401 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-09-21T07:04:50.457 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:04:50.457 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:50.457 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T07:04:50.457 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:50.457 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:50.458 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-21 07:03:29.185554195 +0000 2024-09-21T07:04:50.458 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-21 06:59:08.850836988 +0000 2024-09-21T07:04:50.458 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-21 06:59:08.850836988 +0000 2024-09-21T07:04:50.458 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-21 06:59:08.850836988 +0000 2024-09-21T07:04:50.458 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:04:50.522 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-21T07:04:50.522 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-21T07:04:50.522 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000277269 s, 1.8 MB/s 2024-09-21T07:04:50.523 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:04:50.580 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-09-21T07:04:50.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:50 smithi092 ceph-mon[30987]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:50.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:50 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2704067557' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:04:50.626 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:04:50.626 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:50.626 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T07:04:50.627 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:50.627 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:50.627 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-21 07:03:29.210553477 +0000 2024-09-21T07:04:50.627 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-21 06:59:09.194827009 +0000 2024-09-21T07:04:50.627 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-21 06:59:09.194827009 +0000 2024-09-21T07:04:50.627 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-21 06:59:09.194827009 +0000 2024-09-21T07:04:50.627 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:04:50.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:50 smithi169 ceph-mon[33705]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:50.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:50 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2704067557' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:04:50.690 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-21T07:04:50.690 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-21T07:04:50.690 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.00022041 s, 2.3 MB/s 2024-09-21T07:04:50.691 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:04:50.747 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-09-21T07:04:50.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:50 smithi175 ceph-mon[34064]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:50.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:50 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2704067557' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:04:50.802 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:04:50.802 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:50.802 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T07:04:50.802 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:50.802 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:50.803 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-21 07:03:29.236552730 +0000 2024-09-21T07:04:50.803 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-21 06:59:09.533817175 +0000 2024-09-21T07:04:50.803 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-21 06:59:09.533817175 +0000 2024-09-21T07:04:50.803 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-21 06:59:09.533817175 +0000 2024-09-21T07:04:50.803 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:04:50.865 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-21T07:04:50.866 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-21T07:04:50.866 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000215334 s, 2.4 MB/s 2024-09-21T07:04:50.867 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:04:50.923 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-09-21T07:04:50.978 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:04:50.978 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:50.979 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T07:04:50.979 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:50.979 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:50.979 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-21 07:03:29.261552012 +0000 2024-09-21T07:04:50.979 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-21 06:59:09.852807922 +0000 2024-09-21T07:04:50.979 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-21 06:59:09.852807922 +0000 2024-09-21T07:04:50.979 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-21 06:59:09.852807922 +0000 2024-09-21T07:04:50.979 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:04:51.041 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-21T07:04:51.042 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-21T07:04:51.042 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000194045 s, 2.6 MB/s 2024-09-21T07:04:51.043 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:04:51.100 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-21T07:04:51.100 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:04:51.120 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:04:51.120 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-09-21T07:04:51.178 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:04:51.178 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:51.178 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T07:04:51.178 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:51.178 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:51.178 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-21 07:04:21.660667090 +0000 2024-09-21T07:04:51.178 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-21 06:59:08.451297599 +0000 2024-09-21T07:04:51.178 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-21 06:59:08.451297599 +0000 2024-09-21T07:04:51.179 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-21 06:59:08.451297599 +0000 2024-09-21T07:04:51.179 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:04:51.252 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-21T07:04:51.252 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-21T07:04:51.252 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000237415 s, 2.2 MB/s 2024-09-21T07:04:51.254 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:04:51.314 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-09-21T07:04:51.371 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:04:51.371 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:51.371 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T07:04:51.371 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:51.371 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:51.372 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-21 07:04:21.660667090 +0000 2024-09-21T07:04:51.372 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-21 06:59:08.773290618 +0000 2024-09-21T07:04:51.372 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-21 06:59:08.773290618 +0000 2024-09-21T07:04:51.372 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-21 06:59:08.773290618 +0000 2024-09-21T07:04:51.372 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:04:51.437 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-21T07:04:51.437 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-21T07:04:51.437 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000232744 s, 2.2 MB/s 2024-09-21T07:04:51.438 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:04:51.496 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-09-21T07:04:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:04:51.553 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:51.553 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T07:04:51.553 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:51.553 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:51.553 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-21 07:04:21.661667068 +0000 2024-09-21T07:04:51.553 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-21 06:59:09.112283268 +0000 2024-09-21T07:04:51.553 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-21 06:59:09.112283268 +0000 2024-09-21T07:04:51.554 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-21 06:59:09.112283268 +0000 2024-09-21T07:04:51.554 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:04:51.618 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-21T07:04:51.618 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-21T07:04:51.619 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000211497 s, 2.4 MB/s 2024-09-21T07:04:51.620 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:04:51.677 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-09-21T07:04:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:04:51.733 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:51.733 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T07:04:51.733 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:51.734 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:51.734 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-21 07:04:21.661667068 +0000 2024-09-21T07:04:51.734 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-21 06:59:09.449275962 +0000 2024-09-21T07:04:51.734 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-21 06:59:09.449275962 +0000 2024-09-21T07:04:51.734 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-21 06:59:09.449275962 +0000 2024-09-21T07:04:51.734 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:04:51.797 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-21T07:04:51.797 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-21T07:04:51.798 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000185722 s, 2.8 MB/s 2024-09-21T07:04:51.799 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:04:51.855 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-21T07:04:51.855 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:04:51.875 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:04:51.875 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-09-21T07:04:51.934 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:04:51.934 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:51.934 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T07:04:51.934 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:51.935 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:51.935 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-21 07:04:19.489245622 +0000 2024-09-21T07:04:51.935 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-21 06:59:08.465732306 +0000 2024-09-21T07:04:51.935 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-21 06:59:08.465732306 +0000 2024-09-21T07:04:51.935 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-21 06:59:08.465732306 +0000 2024-09-21T07:04:51.935 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:04:52.004 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-21T07:04:52.004 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-21T07:04:52.004 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000289135 s, 1.8 MB/s 2024-09-21T07:04:52.006 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:04:52.064 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-09-21T07:04:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:04:52.121 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:52.121 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T07:04:52.121 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:52.121 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:52.121 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-21 07:04:19.489245622 +0000 2024-09-21T07:04:52.122 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-21 06:59:08.802726906 +0000 2024-09-21T07:04:52.122 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-21 06:59:08.802726906 +0000 2024-09-21T07:04:52.122 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-21 06:59:08.802726906 +0000 2024-09-21T07:04:52.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:04:52.187 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-21T07:04:52.187 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-21T07:04:52.187 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00027356 s, 1.9 MB/s 2024-09-21T07:04:52.189 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:04:52.246 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-09-21T07:04:52.301 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:04:52.301 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:52.302 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T07:04:52.302 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:52.302 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:52.302 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-21 07:04:19.489245622 +0000 2024-09-21T07:04:52.302 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-21 06:59:09.139721506 +0000 2024-09-21T07:04:52.302 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-21 06:59:09.139721506 +0000 2024-09-21T07:04:52.302 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-21 06:59:09.139721506 +0000 2024-09-21T07:04:52.302 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:04:52.365 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-21T07:04:52.365 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-21T07:04:52.365 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000169972 s, 3.0 MB/s 2024-09-21T07:04:52.367 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:04:52.424 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-09-21T07:04:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:04:52.480 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:04:52.481 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T07:04:52.481 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:04:52.481 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:04:52.481 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-21 07:04:19.490245606 +0000 2024-09-21T07:04:52.481 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-21 06:59:09.464716299 +0000 2024-09-21T07:04:52.481 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-21 06:59:09.464716299 +0000 2024-09-21T07:04:52.481 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-21 06:59:09.464716299 +0000 2024-09-21T07:04:52.481 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:04:52.545 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-21T07:04:52.545 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-21T07:04:52.545 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00020944 s, 2.4 MB/s 2024-09-21T07:04:52.546 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:04:52.603 INFO:tasks.cephadm:Deploying osd.0 on smithi092 with /dev/vg_nvme/lv_4... 2024-09-21T07:04:52.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:04:52.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:52 smithi175 ceph-mon[34064]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:52.860 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:52.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:52 smithi092 ceph-mon[30987]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:52.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:52 smithi169 ceph-mon[33705]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:54.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:54 smithi092 ceph-mon[30987]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:54 smithi169 ceph-mon[33705]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:55.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:54 smithi175 ceph-mon[34064]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:55.196 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:04:55.221 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi092:vg_nvme/lv_4 2024-09-21T07:04:55.462 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.906+0000 7f5398c6f640 1 -- 172.21.15.92:0/296056984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53941062d0 msgr2=0x7f53941066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.906+0000 7f5398c6f640 1 --2- 172.21.15.92:0/296056984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53941062d0 0x7f53941066e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f537c009900 tx=0x7f537c02a410 comp rx=0 tx=0).stop 2024-09-21T07:04:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.906+0000 7f5398c6f640 1 -- 172.21.15.92:0/296056984 shutdown_connections 2024-09-21T07:04:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.906+0000 7f5398c6f640 1 --2- 172.21.15.92:0/296056984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5394106c20 0x7f53941106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.906+0000 7f5398c6f640 1 --2- 172.21.15.92:0/296056984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53941062d0 0x7f53941066e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.906+0000 7f5398c6f640 1 --2- 172.21.15.92:0/296056984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5394102080 0x7f5394102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.906+0000 7f5398c6f640 1 -- 172.21.15.92:0/296056984 >> 172.21.15.92:0/296056984 conn(0x7f5394079f90 msgr2=0x7f539407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.906+0000 7f5398c6f640 1 -- 172.21.15.92:0/296056984 shutdown_connections 2024-09-21T07:04:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.906+0000 7f5398c6f640 1 -- 172.21.15.92:0/296056984 wait complete. 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.906+0000 7f5398c6f640 1 Processor -- start 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5398c6f640 1 -- start start 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5398c6f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5394102080 0x7f539419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5398c6f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53941062d0 0x7f539419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5398c6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5394106c20 0x7f539419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5398c6f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f53941139a0 con 0x7f5394106c20 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5398c6f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5394113820 con 0x7f53941062d0 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5398c6f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5394113b20 con 0x7f5394102080 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5392d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5394106c20 0x7f539419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5392d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5394106c20 0x7f539419fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47398/0 (socket says 172.21.15.92:47398) 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5392d9d640 1 -- 172.21.15.92:0/584543234 learned_addr learned my addr 172.21.15.92:0/584543234 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:04:55.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f539259c640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5394102080 0x7f539419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f538bfff640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53941062d0 0x7f539419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5392d9d640 1 -- 172.21.15.92:0/584543234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5394102080 msgr2=0x7f539419a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5392d9d640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5394102080 0x7f539419a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5392d9d640 1 -- 172.21.15.92:0/584543234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53941062d0 msgr2=0x7f539419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5392d9d640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53941062d0 0x7f539419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5392d9d640 1 -- 172.21.15.92:0/584543234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53941a0200 con 0x7f5394106c20 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.907+0000 7f5392d9d640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5394106c20 0x7f539419fb90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f538c00cce0 tx=0x7f538c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.908+0000 7f538b7fe640 1 -- 172.21.15.92:0/584543234 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c00f450 con 0x7f5394106c20 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.908+0000 7f538b7fe640 1 -- 172.21.15.92:0/584543234 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f538c00fa80 con 0x7f5394106c20 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.908+0000 7f538b7fe640 1 -- 172.21.15.92:0/584543234 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c018ad0 con 0x7f5394106c20 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.908+0000 7f5398c6f640 1 -- 172.21.15.92:0/584543234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53941a04f0 con 0x7f5394106c20 2024-09-21T07:04:55.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.908+0000 7f5398c6f640 1 -- 172.21.15.92:0/584543234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53941a6d10 con 0x7f5394106c20 2024-09-21T07:04:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.909+0000 7f5398c6f640 1 -- 172.21.15.92:0/584543234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f539406b850 con 0x7f5394106c20 2024-09-21T07:04:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.911+0000 7f538b7fe640 1 -- 172.21.15.92:0/584543234 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f538c00f5f0 con 0x7f5394106c20 2024-09-21T07:04:55.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.912+0000 7f538b7fe640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f53800b6580 0x7f53800b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:55.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.912+0000 7f538b7fe640 1 -- 172.21.15.92:0/584543234 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f538c0e5f20 con 0x7f5394106c20 2024-09-21T07:04:55.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.912+0000 7f539259c640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f53800b6580 0x7f53800b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:55.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.912+0000 7f539259c640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f53800b6580 0x7f53800b8a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f539406baf0 tx=0x7f5384005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:55.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:55.915+0000 7f538b7fe640 1 -- 172.21.15.92:0/584543234 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f538c014030 con 0x7f5394106c20 2024-09-21T07:04:56.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:04:56.103+0000 7f5398c6f640 1 -- 172.21.15.92:0/584543234 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5394063800 con 0x7f53800b6580 2024-09-21T07:04:56.766 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:56 smithi092 ceph-mon[30987]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:56.766 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:04:56.766 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:04:56.767 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:56.820 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:56 smithi175 ceph-mon[34064]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:56.820 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:04:56.820 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:04:56.820 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:56 smithi169 ceph-mon[33705]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:04:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:04:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:57.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:57 smithi092 ceph-mon[30987]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:57.836 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:57 smithi175 ceph-mon[34064]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:57.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:57 smithi169 ceph-mon[33705]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:58 smithi092 ceph-mon[30987]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:58 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1729254808' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f883948-e8ec-4370-9f8d-6ce7095732ef"} : dispatch 2024-09-21T07:04:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:58 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1729254808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f883948-e8ec-4370-9f8d-6ce7095732ef"}]': finished 2024-09-21T07:04:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:58 smithi092 ceph-mon[30987]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:04:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:04:58.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:58 smithi169 ceph-mon[33705]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:58.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1729254808' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f883948-e8ec-4370-9f8d-6ce7095732ef"} : dispatch 2024-09-21T07:04:58.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1729254808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f883948-e8ec-4370-9f8d-6ce7095732ef"}]': finished 2024-09-21T07:04:58.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:58 smithi169 ceph-mon[33705]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:04:58.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:04:59.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:58 smithi175 ceph-mon[34064]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:04:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:58 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1729254808' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f883948-e8ec-4370-9f8d-6ce7095732ef"} : dispatch 2024-09-21T07:04:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:58 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1729254808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f883948-e8ec-4370-9f8d-6ce7095732ef"}]': finished 2024-09-21T07:04:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:58 smithi175 ceph-mon[34064]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:04:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:04:59.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:04:59 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/228817350' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:04:59.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:04:59 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/228817350' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:00.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:04:59 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/228817350' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:00.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:00 smithi092 ceph-mon[30987]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:00.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:00 smithi169 ceph-mon[33705]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:01.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:00 smithi175 ceph-mon[34064]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:02.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:02 smithi092 ceph-mon[30987]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:02 smithi169 ceph-mon[33705]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:03.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:02 smithi175 ceph-mon[34064]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:04.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:04 smithi092 ceph-mon[30987]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:04.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:04 smithi169 ceph-mon[33705]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:05.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:04 smithi175 ceph-mon[34064]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:06.844 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:06 smithi092 ceph-mon[30987]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:06.844 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:05:06.844 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:06 smithi169 ceph-mon[33705]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:05:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:07.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:06 smithi175 ceph-mon[34064]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:05:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:07.789 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:07 smithi092 ceph-mon[30987]: Deploying daemon osd.0 on smithi092 2024-09-21T07:05:07.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:07 smithi169 ceph-mon[33705]: Deploying daemon osd.0 on smithi092 2024-09-21T07:05:08.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:07 smithi175 ceph-mon[34064]: Deploying daemon osd.0 on smithi092 2024-09-21T07:05:08.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:08 smithi092 ceph-mon[30987]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:08.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:08 smithi169 ceph-mon[33705]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:09.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:08 smithi175 ceph-mon[34064]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:10.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:10 smithi092 ceph-mon[30987]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:10.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:10 smithi169 ceph-mon[33705]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:10 smithi175 ceph-mon[34064]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:12 smithi092 ceph-mon[30987]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:12 smithi169 ceph-mon[33705]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:12 smithi175 ceph-mon[34064]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:13.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:13.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:13.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:14.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:14 smithi092 ceph-mon[30987]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:14.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:14 smithi169 ceph-mon[33705]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:14 smithi175 ceph-mon[34064]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:16.281 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:16.281 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:16.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:16.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:16.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:16 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:16.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:16 smithi092 ceph-mon[30987]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:16.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.319+0000 7f538b7fe640 1 -- 172.21.15.92:0/584543234 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5394063800 con 0x7f53800b6580 2024-09-21T07:05:16.321 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 0 on host 'smithi092' 2024-09-21T07:05:16.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 -- 172.21.15.92:0/584543234 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f53800b6580 msgr2=0x7f53800b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:16.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f53800b6580 0x7f53800b8a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f539406baf0 tx=0x7f5384005f90 comp rx=0 tx=0).stop 2024-09-21T07:05:16.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 -- 172.21.15.92:0/584543234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5394106c20 msgr2=0x7f539419fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:16.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5394106c20 0x7f539419fb90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f538c00cce0 tx=0x7f538c00a620 comp rx=0 tx=0).stop 2024-09-21T07:05:16.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 -- 172.21.15.92:0/584543234 shutdown_connections 2024-09-21T07:05:16.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f53800b6580 0x7f53800b8a90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5394106c20 0x7f539419fb90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53941062d0 0x7f539419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 --2- 172.21.15.92:0/584543234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5394102080 0x7f539419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:16.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 -- 172.21.15.92:0/584543234 >> 172.21.15.92:0/584543234 conn(0x7f5394079f90 msgr2=0x7f5394107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:16.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 -- 172.21.15.92:0/584543234 shutdown_connections 2024-09-21T07:05:16.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:05:16.322+0000 7f5398c6f640 1 -- 172.21.15.92:0/584543234 wait complete. 2024-09-21T07:05:16.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:16.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:16.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:16.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:16.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:16 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:16.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:16 smithi175 ceph-mon[34064]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:16.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:16.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:16.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:16.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:16.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:16 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:16.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:16 smithi169 ceph-mon[33705]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:16.940 DEBUG:teuthology.orchestra.run.smithi092:osd.0> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T07:05:16.997 INFO:tasks.cephadm:Deploying osd.1 on smithi169 with /dev/vg_nvme/lv_4... 2024-09-21T07:05:16.997 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:05:17.241 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:05:17.359 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:17 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:17.359 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:17 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:17.359 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:17 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:17.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:17 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:17.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:17 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:17.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:17 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:17.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:17 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:17.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:17 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:17.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:17 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:18.462 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:18 smithi092 ceph-mon[30987]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:18.466 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:18 smithi169 ceph-mon[33705]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:18.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:18 smithi175 ceph-mon[34064]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:19.481 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:05:19.507 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi169:vg_nvme/lv_4 2024-09-21T07:05:19.522 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:19 smithi169 ceph-mon[33705]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:05:19.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:19 smithi092 ceph-mon[30987]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:05:19.532 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:05:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0[47459]: 2024-09-21T07:05:19.206+0000 7f4e66db0640 -1 osd.0 0 log_to_monitors true 2024-09-21T07:05:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:05:19.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:19 smithi175 ceph-mon[34064]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:05:20.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.315+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/3669532887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d08103ba0 msgr2=0x7f0d08103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:20.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.315+0000 7f0d0cb1e640 1 --2- 172.21.15.169:0/3669532887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d08103ba0 0x7f0d08103fb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009900 tx=0x7f0cf802a410 comp rx=0 tx=0).stop 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.315+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/3669532887 shutdown_connections 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.315+0000 7f0d0cb1e640 1 --2- 172.21.15.169:0/3669532887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d08109e30 0x7f0d08110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.315+0000 7f0d0cb1e640 1 --2- 172.21.15.169:0/3669532887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d081094e0 0x7f0d081098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.315+0000 7f0d0cb1e640 1 --2- 172.21.15.169:0/3669532887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d08103ba0 0x7f0d08103fb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.315+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/3669532887 >> 172.21.15.169:0/3669532887 conn(0x7f0d080ff630 msgr2=0x7f0d08101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.315+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/3669532887 shutdown_connections 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.315+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/3669532887 wait complete. 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d0cb1e640 1 Processor -- start 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d0cb1e640 1 -- start start 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d0cb1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d08103ba0 0x7f0d0819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d0cb1e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d081094e0 0x7f0d0819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d0cb1e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d08109e30 0x7f0d0819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d0cb1e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0d081139a0 con 0x7f0d08103ba0 2024-09-21T07:05:20.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d0cb1e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d08113820 con 0x7f0d081094e0 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d0cb1e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d08113b20 con 0x7f0d08109e30 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d05d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d081094e0 0x7f0d0819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d05d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d081094e0 0x7f0d0819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:60368/0 (socket says 172.21.15.169:60368) 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d05d9b640 1 -- 172.21.15.169:0/2260925810 learned_addr learned my addr 172.21.15.169:0/2260925810 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d0659c640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d08103ba0 0x7f0d0819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.316+0000 7f0d06d9d640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d08109e30 0x7f0d0819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0d05d9b640 1 -- 172.21.15.169:0/2260925810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d08109e30 msgr2=0x7f0d0819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0d05d9b640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d08109e30 0x7f0d0819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0d05d9b640 1 -- 172.21.15.169:0/2260925810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d08103ba0 msgr2=0x7f0d0819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0d05d9b640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d08103ba0 0x7f0d0819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0d05d9b640 1 -- 172.21.15.169:0/2260925810 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d081a0340 con 0x7f0d081094e0 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0d06d9d640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d08109e30 0x7f0d0819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:05:20.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0d05d9b640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d081094e0 0x7f0d0819a970 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00e9f0 tx=0x7f0cfc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0cf77fe640 1 -- 172.21.15.169:0/2260925810 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00ccc0 con 0x7f0d081094e0 2024-09-21T07:05:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0cf77fe640 1 -- 172.21.15.169:0/2260925810 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0cfc0108c0 con 0x7f0d081094e0 2024-09-21T07:05:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0cf77fe640 1 -- 172.21.15.169:0/2260925810 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc018750 con 0x7f0d081094e0 2024-09-21T07:05:20.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/2260925810 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d081a0630 con 0x7f0d081094e0 2024-09-21T07:05:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.317+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/2260925810 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d081a6d90 con 0x7f0d081094e0 2024-09-21T07:05:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.318+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/2260925810 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d08103fb0 con 0x7f0d081094e0 2024-09-21T07:05:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.320+0000 7f0cf77fe640 1 -- 172.21.15.169:0/2260925810 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f0cfc010430 con 0x7f0d081094e0 2024-09-21T07:05:20.322 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:05:20.322 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:05:20.322 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:05:20.322 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:20.322 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:20.322 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.323 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.323 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:20.323 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.323 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:20.323 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:20.323 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.323 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:20 smithi169 ceph-mon[33705]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:05:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.321+0000 7f0cf77fe640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0cf00b64d0 0x7f0cf00b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.321+0000 7f0cf77fe640 1 -- 172.21.15.169:0/2260925810 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7f0cfc0e60c0 con 0x7f0d081094e0 2024-09-21T07:05:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.321+0000 7f0d0659c640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0cf00b64d0 0x7f0cf00b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.321+0000 7f0d0659c640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0cf00b64d0 0x7f0cf00b89e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80057c0 tx=0x7f0cf80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:20.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.328+0000 7f0cf77fe640 1 -- 172.21.15.169:0/2260925810 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0cfc0ae400 con 0x7f0d081094e0 2024-09-21T07:05:20.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:20.518+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/2260925810 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0d0810bc60 con 0x7f0cf00b64d0 2024-09-21T07:05:20.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:05:20.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:05:20.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:05:20.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:20.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:20.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:20.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:20.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:20.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-mon[30987]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:05:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:05:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:05:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:05:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:20.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:20.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:20.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:20 smithi175 ceph-mon[34064]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:05:21.112 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0[47459]: 2024-09-21T07:05:20.679+0000 7f4e62d32640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T07:05:21.112 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:05:20 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0[47459]: 2024-09-21T07:05:20.682+0000 7f4e5ab28640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:05:21.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi092 2024-09-21T07:05:21.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-21T07:05:21.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:05:21.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:21.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:21.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:21.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:21.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:21.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:21.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' 2024-09-21T07:05:21.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:21 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:21.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi092 2024-09-21T07:05:21.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-21T07:05:21.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:05:21.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:21.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:21.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:21.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:21.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:21.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:21.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' 2024-09-21T07:05:21.614 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:21 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:21.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi092 2024-09-21T07:05:21.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-21T07:05:21.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:05:21.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:21.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:21.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:21.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:21.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:21.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:21.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: from='osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251]' entity='osd.0' 2024-09-21T07:05:21.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:21 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:22.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:22 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:05:22.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:22 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:05:22.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:22 smithi092 ceph-mon[30987]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:22.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:22 smithi092 ceph-mon[30987]: osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] boot 2024-09-21T07:05:22.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:22 smithi092 ceph-mon[30987]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:05:22.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:22.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:22 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:05:22.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:22 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:05:22.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:22 smithi169 ceph-mon[33705]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:22.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:22 smithi169 ceph-mon[33705]: osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] boot 2024-09-21T07:05:22.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:22 smithi169 ceph-mon[33705]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:05:22.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:22 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:05:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:22 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:05:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:22 smithi175 ceph-mon[34064]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:05:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:22 smithi175 ceph-mon[34064]: osd.0 [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] boot 2024-09-21T07:05:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:22 smithi175 ceph-mon[34064]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:05:22.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:05:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:23 smithi175 ceph-mon[34064]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:05:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:23 smithi175 ceph-mon[34064]: from='client.? 172.21.15.169:0/103065980' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "517c0676-0dfb-4f27-b98b-bf86a8e5d788"} : dispatch 2024-09-21T07:05:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:23 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "517c0676-0dfb-4f27-b98b-bf86a8e5d788"} : dispatch 2024-09-21T07:05:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:23 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "517c0676-0dfb-4f27-b98b-bf86a8e5d788"}]': finished 2024-09-21T07:05:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:23 smithi175 ceph-mon[34064]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:05:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:23 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:23 smithi175 ceph-mon[34064]: from='client.? 172.21.15.169:0/314808605' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:23 smithi175 ceph-mon[34064]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:24.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:23 smithi092 ceph-mon[30987]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:05:24.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:23 smithi092 ceph-mon[30987]: from='client.? 172.21.15.169:0/103065980' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "517c0676-0dfb-4f27-b98b-bf86a8e5d788"} : dispatch 2024-09-21T07:05:24.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:23 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "517c0676-0dfb-4f27-b98b-bf86a8e5d788"} : dispatch 2024-09-21T07:05:24.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:23 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "517c0676-0dfb-4f27-b98b-bf86a8e5d788"}]': finished 2024-09-21T07:05:24.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:23 smithi092 ceph-mon[30987]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:05:24.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:23 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:24.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:23 smithi092 ceph-mon[30987]: from='client.? 172.21.15.169:0/314808605' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:24.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:23 smithi092 ceph-mon[30987]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:23 smithi169 ceph-mon[33705]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:05:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:23 smithi169 ceph-mon[33705]: from='client.? 172.21.15.169:0/103065980' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "517c0676-0dfb-4f27-b98b-bf86a8e5d788"} : dispatch 2024-09-21T07:05:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:23 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "517c0676-0dfb-4f27-b98b-bf86a8e5d788"} : dispatch 2024-09-21T07:05:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:23 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "517c0676-0dfb-4f27-b98b-bf86a8e5d788"}]': finished 2024-09-21T07:05:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:23 smithi169 ceph-mon[33705]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:05:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:23 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:23 smithi169 ceph-mon[33705]: from='client.? 172.21.15.169:0/314808605' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:24.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:23 smithi169 ceph-mon[33705]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:26.847 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:26 smithi169 ceph-mon[33705]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:26.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:26 smithi092 ceph-mon[30987]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:27.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:26 smithi175 ceph-mon[34064]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:28.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:28 smithi092 ceph-mon[30987]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:28.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:28 smithi169 ceph-mon[33705]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:29.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:28 smithi175 ceph-mon[34064]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:30.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:30 smithi092 ceph-mon[30987]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:30.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:30 smithi169 ceph-mon[33705]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:31.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:30 smithi175 ceph-mon[34064]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:31.705 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:31 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:05:31.705 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:31 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:31.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:31 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:05:31.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:31 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:32.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:31 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:05:32.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:31 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:32.803 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:32 smithi169 ceph-mon[33705]: Deploying daemon osd.1 on smithi169 2024-09-21T07:05:32.803 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:32 smithi169 ceph-mon[33705]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:32.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:32 smithi092 ceph-mon[30987]: Deploying daemon osd.1 on smithi169 2024-09-21T07:05:32.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:32 smithi092 ceph-mon[30987]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:33.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:32 smithi175 ceph-mon[34064]: Deploying daemon osd.1 on smithi169 2024-09-21T07:05:33.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:32 smithi175 ceph-mon[34064]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:34.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:34 smithi092 ceph-mon[30987]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:34.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:34 smithi169 ceph-mon[33705]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:35.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:34 smithi175 ceph-mon[34064]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:36.816 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:36 smithi169 ceph-mon[33705]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:36.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:36 smithi092 ceph-mon[30987]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:37.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:36 smithi175 ceph-mon[34064]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:37.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:37.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:37.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:37.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:37.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:37.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:38.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:38.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:38.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:38.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:38 smithi092 ceph-mon[30987]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:38.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:38 smithi169 ceph-mon[33705]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:39.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:38 smithi175 ceph-mon[34064]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:40.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:40.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:40.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:40.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:40.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:40.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:40 smithi175 ceph-mon[34064]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:40.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:40.780 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:40.781 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:40.781 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:40.781 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:40.781 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:40 smithi169 ceph-mon[33705]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:40.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:40.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:40.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:40.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:40.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:40.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:40 smithi092 ceph-mon[30987]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:41.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.397+0000 7f0cf77fe640 1 -- 172.21.15.169:0/2260925810 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0d0810bc60 con 0x7f0cf00b64d0 2024-09-21T07:05:41.400 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 1 on host 'smithi169' 2024-09-21T07:05:41.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/2260925810 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0cf00b64d0 msgr2=0x7f0cf00b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:41.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0cf00b64d0 0x7f0cf00b89e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80057c0 tx=0x7f0cf80058d0 comp rx=0 tx=0).stop 2024-09-21T07:05:41.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/2260925810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d081094e0 msgr2=0x7f0d0819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:41.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d081094e0 0x7f0d0819a970 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00e9f0 tx=0x7f0cfc00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:05:41.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/2260925810 shutdown_connections 2024-09-21T07:05:41.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0cf00b64d0 0x7f0cf00b89e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:41.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d08109e30 0x7f0d0819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:41.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d081094e0 0x7f0d0819a970 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:41.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 --2- 172.21.15.169:0/2260925810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d08103ba0 0x7f0d0819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:41.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/2260925810 >> 172.21.15.169:0/2260925810 conn(0x7f0d080ff630 msgr2=0x7f0d08101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:41.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.399+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/2260925810 shutdown_connections 2024-09-21T07:05:41.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:05:41.400+0000 7f0d0cb1e640 1 -- 172.21.15.169:0/2260925810 wait complete. 2024-09-21T07:05:41.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:41 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:41.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:41 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:41.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:41 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:41.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:41 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:41.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:41 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:41.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:41 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:41.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:41 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:41.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:41 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:41.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:41 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:42.038 DEBUG:teuthology.orchestra.run.smithi169:osd.1> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T07:05:42.080 INFO:tasks.cephadm:Deploying osd.2 on smithi175 with /dev/vg_nvme/lv_4... 2024-09-21T07:05:42.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:05:42.335 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:05:42.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:42 smithi169 ceph-mon[33705]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:42.746 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:42 smithi175 ceph-mon[34064]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:42 smithi092 ceph-mon[30987]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:43.364 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:05:43 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1[38434]: 2024-09-21T07:05:43.202+0000 7fb85d48c640 -1 osd.1 0 log_to_monitors true 2024-09-21T07:05:43.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:43 smithi169 ceph-mon[33705]: from='osd.1 [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:05:43.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:43 smithi169 ceph-mon[33705]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:05:43.660 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:43 smithi175 ceph-mon[34064]: from='osd.1 [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:05:43.660 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:43 smithi175 ceph-mon[34064]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:05:43.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:43 smithi092 ceph-mon[30987]: from='osd.1 [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:05:43.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:43 smithi092 ceph-mon[30987]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:05:44.549 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:44 smithi175 ceph-mon[34064]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:05:44.549 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:44 smithi175 ceph-mon[34064]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:44.549 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:44 smithi175 ceph-mon[34064]: from='osd.1 [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:05:44.549 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:44 smithi175 ceph-mon[34064]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:05:44.549 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:44.550 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:44 smithi175 ceph-mon[34064]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:05:44.793 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:05:44 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1[38434]: 2024-09-21T07:05:44.525+0000 7fb85940e640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T07:05:44.793 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:05:44 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1[38434]: 2024-09-21T07:05:44.528+0000 7fb85520c640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:05:44.793 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:44 smithi169 ceph-mon[33705]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:05:44.794 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:44 smithi169 ceph-mon[33705]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:44.794 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:44 smithi169 ceph-mon[33705]: from='osd.1 [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:05:44.794 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:44 smithi169 ceph-mon[33705]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:05:44.794 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:44.794 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:44 smithi169 ceph-mon[33705]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:05:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:05:44.847 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi175:vg_nvme/lv_4 2024-09-21T07:05:44.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:44 smithi092 ceph-mon[30987]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:05:44.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:44 smithi092 ceph-mon[30987]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:44.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:44 smithi092 ceph-mon[30987]: from='osd.1 [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:05:44.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:44 smithi092 ceph-mon[30987]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:05:44.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:44.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:44 smithi092 ceph-mon[30987]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:05:45.100 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:05:45.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.611+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1179961700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83bc1048c0 msgr2=0x7f83bc104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:45.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.611+0000 7f83c0bfc640 1 --2- 172.21.15.175:0/1179961700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83bc1048c0 0x7f83bc104cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009900 tx=0x7f83ac02a410 comp rx=0 tx=0).stop 2024-09-21T07:05:45.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.611+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1179961700 shutdown_connections 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.611+0000 7f83c0bfc640 1 --2- 172.21.15.175:0/1179961700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83bc10de70 0x7f83bc110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.611+0000 7f83c0bfc640 1 --2- 172.21.15.175:0/1179961700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83bc1052a0 0x7f83bc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.611+0000 7f83c0bfc640 1 --2- 172.21.15.175:0/1179961700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83bc1048c0 0x7f83bc104cd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.611+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1179961700 >> 172.21.15.175:0/1179961700 conn(0x7f83bc079790 msgr2=0x7f83bc079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.611+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1179961700 shutdown_connections 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.611+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1179961700 wait complete. 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83c0bfc640 1 Processor -- start 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83c0bfc640 1 -- start start 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83c0bfc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83bc1048c0 0x7f83bc19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83c0bfc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83bc1052a0 0x7f83bc19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:45.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83c0bfc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83bc10de70 0x7f83bc19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83c0bfc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc113980 con 0x7f83bc10de70 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83c0bfc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc113800 con 0x7f83bc1052a0 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83c0bfc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc113b00 con 0x7f83bc1048c0 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83ba59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83bc1048c0 0x7f83bc19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83ba59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83bc1048c0 0x7f83bc19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59532/0 (socket says 172.21.15.175:59532) 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.612+0000 7f83ba59c640 1 -- 172.21.15.175:0/1208743561 learned_addr learned my addr 172.21.15.175:0/1208743561 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83b9d9b640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83bc1052a0 0x7f83bc19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83bad9d640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83bc10de70 0x7f83bc19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83ba59c640 1 -- 172.21.15.175:0/1208743561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83bc1052a0 msgr2=0x7f83bc19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83ba59c640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83bc1052a0 0x7f83bc19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83ba59c640 1 -- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83bc10de70 msgr2=0x7f83bc19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:45.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83ba59c640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83bc10de70 0x7f83bc19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83ba59c640 1 -- 172.21.15.175:0/1208743561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc1a03a0 con 0x7f83bc1048c0 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83bad9d640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83bc10de70 0x7f83bc19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83ba59c640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83bc1048c0 0x7f83bc19a430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009230 tx=0x7f83ac004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83ab7fe640 1 -- 172.21.15.175:0/1208743561 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac03f030 con 0x7f83bc1048c0 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83ab7fe640 1 -- 172.21.15.175:0/1208743561 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83ac003a80 con 0x7f83bc1048c0 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1208743561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83bc1a0630 con 0x7f83bc1048c0 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83ab7fe640 1 -- 172.21.15.175:0/1208743561 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac035070 con 0x7f83bc1048c0 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.613+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1208743561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83bc1a6df0 con 0x7f83bc1048c0 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.615+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1208743561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83bc06c170 con 0x7f83bc1048c0 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.616+0000 7f83ab7fe640 1 -- 172.21.15.175:0/1208743561 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f83ac042030 con 0x7f83bc1048c0 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.616+0000 7f83ab7fe640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f83a40b64d0 0x7f83a40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.617+0000 7f83ab7fe640 1 -- 172.21.15.175:0/1208743561 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2524+0+0 (secure 0 0 0) 0x7f83ac106600 con 0x7f83bc1048c0 2024-09-21T07:05:45.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.617+0000 7f83b9d9b640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f83a40b64d0 0x7f83a40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:45.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.617+0000 7f83b9d9b640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f83a40b64d0 0x7f83a40b89e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f83bc102500 tx=0x7f83b000a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:45.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.621+0000 7f83ab7fe640 1 -- 172.21.15.175:0/1208743561 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83ac0ce610 con 0x7f83bc1048c0 2024-09-21T07:05:45.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:05:45.808+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1208743561 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f83bc063800 con 0x7f83a40b64d0 2024-09-21T07:05:45.810 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:05:45.810 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:05:45.810 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:45.810 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:45.810 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.810 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.810 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:45.811 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.811 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:45.811 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:45.811 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:05:45.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:05:45.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:45.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:45.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:45.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:45.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:45.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:05:45.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:05:45.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:45.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:45.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:45.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:45.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:45.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:45.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:05:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:05:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:05:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi169 2024-09-21T07:05:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-21T07:05:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: osd.1 [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] boot 2024-09-21T07:05:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:05:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:46.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:46.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:46.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:46.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:05:46.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:05:46.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi169 2024-09-21T07:05:46.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-21T07:05:46.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:46.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: osd.1 [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] boot 2024-09-21T07:05:46.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:05:46.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:46.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:46.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:46.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:46.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:05:46.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:05:46.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi169 2024-09-21T07:05:46.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-21T07:05:46.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:05:46.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: osd.1 [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] boot 2024-09-21T07:05:46.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:05:46.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:05:46.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:46.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:46.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:47.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:47 smithi175 ceph-mon[34064]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:47.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:47 smithi175 ceph-mon[34064]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T07:05:47.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:47 smithi092 ceph-mon[30987]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:47.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:47 smithi092 ceph-mon[30987]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T07:05:47.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:47 smithi169 ceph-mon[33705]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:47.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:47 smithi169 ceph-mon[33705]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T07:05:48.744 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:48 smithi175 ceph-mon[34064]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:48.745 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:48 smithi175 ceph-mon[34064]: from='client.? 172.21.15.175:0/940105606' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71eb34bc-7d93-40d7-aa32-140aa96d10cb"} : dispatch 2024-09-21T07:05:48.745 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:48 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71eb34bc-7d93-40d7-aa32-140aa96d10cb"} : dispatch 2024-09-21T07:05:48.745 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:48 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71eb34bc-7d93-40d7-aa32-140aa96d10cb"}]': finished 2024-09-21T07:05:48.745 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:48 smithi175 ceph-mon[34064]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:05:48.745 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:48 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:05:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:48 smithi092 ceph-mon[30987]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:48 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/940105606' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71eb34bc-7d93-40d7-aa32-140aa96d10cb"} : dispatch 2024-09-21T07:05:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:48 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71eb34bc-7d93-40d7-aa32-140aa96d10cb"} : dispatch 2024-09-21T07:05:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:48 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71eb34bc-7d93-40d7-aa32-140aa96d10cb"}]': finished 2024-09-21T07:05:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:48 smithi092 ceph-mon[30987]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:05:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:48 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:05:48.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:48 smithi169 ceph-mon[33705]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:48.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:48 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/940105606' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71eb34bc-7d93-40d7-aa32-140aa96d10cb"} : dispatch 2024-09-21T07:05:48.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:48 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71eb34bc-7d93-40d7-aa32-140aa96d10cb"} : dispatch 2024-09-21T07:05:48.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:48 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71eb34bc-7d93-40d7-aa32-140aa96d10cb"}]': finished 2024-09-21T07:05:48.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:48 smithi169 ceph-mon[33705]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:05:48.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:48 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:05:49.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:49 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/4238189970' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:49.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:49 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/4238189970' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:50.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:49 smithi175 ceph-mon[34064]: from='client.? 172.21.15.175:0/4238189970' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:50.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:50 smithi092 ceph-mon[30987]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:50.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:50 smithi169 ceph-mon[33705]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:51.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:50 smithi175 ceph-mon[34064]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:52.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:52 smithi092 ceph-mon[30987]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:52.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:52 smithi169 ceph-mon[33705]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:52.992 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:52 smithi175 ceph-mon[34064]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:54.604 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:54 smithi175 ceph-mon[34064]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:54 smithi092 ceph-mon[30987]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:54 smithi169 ceph-mon[33705]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:56.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:56 smithi175 ceph-mon[34064]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:56.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:05:56.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:56 smithi092 ceph-mon[30987]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:05:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:56 smithi169 ceph-mon[33705]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:05:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:57.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:57 smithi175 ceph-mon[34064]: Deploying daemon osd.2 on smithi175 2024-09-21T07:05:57.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:57 smithi092 ceph-mon[30987]: Deploying daemon osd.2 on smithi175 2024-09-21T07:05:57.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:57 smithi169 ceph-mon[33705]: Deploying daemon osd.2 on smithi175 2024-09-21T07:05:58.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:05:58 smithi175 ceph-mon[34064]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:05:58 smithi092 ceph-mon[30987]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:05:58.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:05:58 smithi169 ceph-mon[33705]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:00.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:00 smithi092 ceph-mon[30987]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:00.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:00 smithi169 ceph-mon[33705]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:01.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:00 smithi175 ceph-mon[34064]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:02.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:02 smithi175 ceph-mon[34064]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:02.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:02 smithi092 ceph-mon[30987]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:02 smithi169 ceph-mon[33705]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:03.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:03.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:03.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:03.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:03.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:03.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:03.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:03.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:03.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:04.722 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:04 smithi175 ceph-mon[34064]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:04.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:04 smithi092 ceph-mon[30987]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:04.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:04 smithi169 ceph-mon[33705]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:07.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:06 smithi175 ceph-mon[34064]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:06 smithi092 ceph-mon[30987]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:06 smithi169 ceph-mon[33705]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.373 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 2 on host 'smithi175' 2024-09-21T07:06:07.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.370+0000 7f83ab7fe640 1 -- 172.21.15.175:0/1208743561 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f83bc063800 con 0x7f83a40b64d0 2024-09-21T07:06:07.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f83a40b64d0 msgr2=0x7f83a40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:07.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f83a40b64d0 0x7f83a40b89e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f83bc102500 tx=0x7f83b000a250 comp rx=0 tx=0).stop 2024-09-21T07:06:07.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1208743561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83bc1048c0 msgr2=0x7f83bc19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:07.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83bc1048c0 0x7f83bc19a430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009230 tx=0x7f83ac004270 comp rx=0 tx=0).stop 2024-09-21T07:06:07.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1208743561 shutdown_connections 2024-09-21T07:06:07.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f83a40b64d0 0x7f83a40b89e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:07.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83bc10de70 0x7f83bc19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:07.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83bc1052a0 0x7f83bc19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:07.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 --2- 172.21.15.175:0/1208743561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83bc1048c0 0x7f83bc19a430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:07.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1208743561 >> 172.21.15.175:0/1208743561 conn(0x7f83bc079790 msgr2=0x7f83bc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:07.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1208743561 shutdown_connections 2024-09-21T07:06:07.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:06:07.373+0000 7f83c0bfc640 1 -- 172.21.15.175:0/1208743561 wait complete. 2024-09-21T07:06:07.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:07 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:07.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:07 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:07 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.942 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:07 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:07.942 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:07 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.942 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:07 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.968 DEBUG:teuthology.orchestra.run.smithi175:osd.2> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T07:06:07.971 INFO:tasks.cephadm:Deploying osd.3 on smithi092 with /dev/vg_nvme/lv_3... 2024-09-21T07:06:07.971 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:06:07.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:07 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:07.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:07 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:07.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:07 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:08.226 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:08.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:08 smithi092 ceph-mon[30987]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:09.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:08 smithi175 ceph-mon[34064]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:09.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:08 smithi169 ceph-mon[33705]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:09.367 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:09 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2[39174]: 2024-09-21T07:06:09.342+0000 7f99106b5640 -1 osd.2 0 log_to_monitors true 2024-09-21T07:06:09.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:09 smithi175 ceph-mon[34064]: from='osd.2 [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:06:09.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:09 smithi175 ceph-mon[34064]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:06:09.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:09 smithi175 ceph-mon[34064]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:09.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:09 smithi092 ceph-mon[30987]: from='osd.2 [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:06:09.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:09 smithi092 ceph-mon[30987]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:06:09.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:09 smithi092 ceph-mon[30987]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:10.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:09 smithi169 ceph-mon[33705]: from='osd.2 [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:06:10.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:09 smithi169 ceph-mon[33705]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:06:10.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:09 smithi169 ceph-mon[33705]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:10.601 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:06:10.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi092:vg_nvme/lv_3 2024-09-21T07:06:10.927 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:10 smithi175 ceph-mon[34064]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:06:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:10 smithi175 ceph-mon[34064]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:06:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:10 smithi175 ceph-mon[34064]: from='osd.2 [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:06:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:10 smithi175 ceph-mon[34064]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:06:11.018 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:10 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2[39174]: 2024-09-21T07:06:10.685+0000 7f990c637640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T07:06:11.018 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:10 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2[39174]: 2024-09-21T07:06:10.690+0000 7f9908435640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:06:11.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:10 smithi092 ceph-mon[30987]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:06:11.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:10 smithi092 ceph-mon[30987]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:06:11.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:11.048 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:10 smithi092 ceph-mon[30987]: from='osd.2 [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:06:11.048 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:10 smithi092 ceph-mon[30987]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:06:11.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:10 smithi169 ceph-mon[33705]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:06:11.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:10 smithi169 ceph-mon[33705]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:06:11.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:11.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:10 smithi169 ceph-mon[33705]: from='osd.2 [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:06:11.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:10 smithi169 ceph-mon[33705]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:06:11.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.418+0000 7f051a1a1640 1 -- 172.21.15.92:0/4102197137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0514102a60 msgr2=0x7f0514102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:11.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.418+0000 7f051a1a1640 1 --2- 172.21.15.92:0/4102197137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0514102a60 0x7f0514102e70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0504009900 tx=0x7f050402a410 comp rx=0 tx=0).stop 2024-09-21T07:06:11.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.418+0000 7f051a1a1640 1 -- 172.21.15.92:0/4102197137 shutdown_connections 2024-09-21T07:06:11.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.418+0000 7f051a1a1640 1 --2- 172.21.15.92:0/4102197137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0514108cf0 0x7f051410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:11.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.418+0000 7f051a1a1640 1 --2- 172.21.15.92:0/4102197137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05141083a0 0x7f05141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:11.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.418+0000 7f051a1a1640 1 --2- 172.21.15.92:0/4102197137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0514102a60 0x7f0514102e70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:11.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.418+0000 7f051a1a1640 1 -- 172.21.15.92:0/4102197137 >> 172.21.15.92:0/4102197137 conn(0x7f0514079730 msgr2=0x7f0514079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.418+0000 7f051a1a1640 1 -- 172.21.15.92:0/4102197137 shutdown_connections 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.418+0000 7f051a1a1640 1 -- 172.21.15.92:0/4102197137 wait complete. 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.419+0000 7f051a1a1640 1 Processor -- start 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.419+0000 7f051a1a1640 1 -- start start 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.419+0000 7f051a1a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514102a60 0x7f051419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.419+0000 7f051a1a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05141083a0 0x7f051419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.419+0000 7f051a1a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0514108cf0 0x7f051419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.419+0000 7f051a1a1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0514112810 con 0x7f0514108cf0 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.419+0000 7f051a1a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0514112690 con 0x7f05141083a0 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.419+0000 7f051a1a1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0514112990 con 0x7f0514102a60 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0513fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0514108cf0 0x7f051419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0513fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0514108cf0 0x7f051419fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55510/0 (socket says 172.21.15.92:55510) 2024-09-21T07:06:11.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0513fff640 1 -- 172.21.15.92:0/2836273375 learned_addr learned my addr 172.21.15.92:0/2836273375 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:06:11.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f05137fe640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514102a60 0x7f051419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:11.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0512ffd640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05141083a0 0x7f051419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:11.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0513fff640 1 -- 172.21.15.92:0/2836273375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514102a60 msgr2=0x7f051419a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:11.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0513fff640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514102a60 0x7f051419a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:11.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0513fff640 1 -- 172.21.15.92:0/2836273375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05141083a0 msgr2=0x7f051419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:11.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0513fff640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05141083a0 0x7f051419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:11.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0513fff640 1 -- 172.21.15.92:0/2836273375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05141a0200 con 0x7f0514108cf0 2024-09-21T07:06:11.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0512ffd640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05141083a0 0x7f051419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:11.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0513fff640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0514108cf0 0x7f051419fb90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f050c00cad0 tx=0x7f050c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:11.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0510ff9640 1 -- 172.21.15.92:0/2836273375 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c00ae20 con 0x7f0514108cf0 2024-09-21T07:06:11.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f051a1a1640 1 -- 172.21.15.92:0/2836273375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05141a04f0 con 0x7f0514108cf0 2024-09-21T07:06:11.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0510ff9640 1 -- 172.21.15.92:0/2836273375 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f050c005020 con 0x7f0514108cf0 2024-09-21T07:06:11.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f0510ff9640 1 -- 172.21.15.92:0/2836273375 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c00f6b0 con 0x7f0514108cf0 2024-09-21T07:06:11.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.420+0000 7f051a1a1640 1 -- 172.21.15.92:0/2836273375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05141a6d10 con 0x7f0514108cf0 2024-09-21T07:06:11.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.421+0000 7f051a1a1640 1 -- 172.21.15.92:0/2836273375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0514102e70 con 0x7f0514108cf0 2024-09-21T07:06:11.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.423+0000 7f0510ff9640 1 -- 172.21.15.92:0/2836273375 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f050c0051d0 con 0x7f0514108cf0 2024-09-21T07:06:11.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.424+0000 7f0510ff9640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04fc0b6500 0x7f04fc0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:11.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.424+0000 7f05137fe640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04fc0b6500 0x7f04fc0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:11.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.424+0000 7f0510ff9640 1 -- 172.21.15.92:0/2836273375 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2786+0+0 (secure 0 0 0) 0x7f050c0e61f0 con 0x7f0514108cf0 2024-09-21T07:06:11.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.424+0000 7f05137fe640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04fc0b6500 0x7f04fc0b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f05040057c0 tx=0x7f05040058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:11.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.428+0000 7f0510ff9640 1 -- 172.21.15.92:0/2836273375 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f050c014030 con 0x7f0514108cf0 2024-09-21T07:06:11.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:11.616+0000 7f051a1a1640 1 -- 172.21.15.92:0/2836273375 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0514106340 con 0x7f04fc0b6500 2024-09-21T07:06:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:06:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T07:06:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi175 2024-09-21T07:06:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:06:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:06:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T07:06:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi175 2024-09-21T07:06:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:06:12.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:12.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi175 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:06:12.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:12.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:06:12.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:06:12.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:13.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:12 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:06:13.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:12 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:06:13.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:12 smithi092 ceph-mon[30987]: osd.2 [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] boot 2024-09-21T07:06:13.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:12 smithi092 ceph-mon[30987]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:06:13.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:13.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:06:13.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:12 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:06:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:12 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:06:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:12 smithi175 ceph-mon[34064]: osd.2 [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] boot 2024-09-21T07:06:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:12 smithi175 ceph-mon[34064]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:06:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:06:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:12 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:06:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:12 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:06:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:12 smithi169 ceph-mon[33705]: osd.2 [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] boot 2024-09-21T07:06:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:12 smithi169 ceph-mon[33705]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:06:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:06:13.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:06:14.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:06:14.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:13 smithi175 ceph-mon[34064]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:06:14.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:06:14.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:13 smithi175 ceph-mon[34064]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:14.021 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:13 smithi175 sudo[42657]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:06:14.021 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:13 smithi175 sudo[42657]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.021 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:13 smithi175 sudo[42657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.021 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:13 smithi175 sudo[42657]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.021 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:13 smithi175 sudo[42660]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:06:14.021 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:13 smithi175 sudo[42660]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.022 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:13 smithi175 sudo[42660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.022 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:06:13 smithi175 sudo[42660]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.035 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:06:14.035 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:13 smithi092 ceph-mon[30987]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:06:14.035 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:06:14.035 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:13 smithi092 ceph-mon[30987]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:14.036 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:06:13 smithi092 sudo[51589]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:06:14.036 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:06:13 smithi092 sudo[51589]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.036 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:06:13 smithi092 sudo[51589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.036 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:06:13 smithi092 sudo[51589]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.036 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:06:13 smithi092 sudo[51592]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:06:14.036 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:06:13 smithi092 sudo[51592]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.036 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:06:13 smithi092 sudo[51592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.036 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:06:13 smithi092 sudo[51592]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.116 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:06:14.116 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:13 smithi169 ceph-mon[33705]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:06:14.116 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:06:14.116 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:13 smithi169 ceph-mon[33705]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:14.117 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:06:13 smithi169 sudo[42374]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:06:14.117 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:06:13 smithi169 sudo[42374]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.117 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:06:13 smithi169 sudo[42374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.117 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:06:13 smithi169 sudo[42374]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.117 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:06:13 smithi169 sudo[42377]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:06:14.117 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:06:13 smithi169 sudo[42377]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.117 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:06:13 smithi169 sudo[42377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.117 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:06:13 smithi169 sudo[42377]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.311 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 sudo[51599]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:06:14.312 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 sudo[51599]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.312 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 sudo[51599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.312 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 sudo[51599]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.312 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 sudo[51604]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:06:14.312 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 sudo[51604]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.312 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 sudo[51604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.312 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 sudo[51604]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 sudo[42380]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:06:14.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 sudo[42380]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 sudo[42380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 sudo[42380]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 sudo[42383]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:06:14.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 sudo[42383]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 sudo[42383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 sudo[42383]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 sudo[42663]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:06:14.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 sudo[42663]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 sudo[42663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 sudo[42663]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 sudo[42666]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:06:14.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 sudo[42666]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:06:14.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 sudo[42666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:06:14.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 sudo[42666]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:06:14.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3081485403' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa947193-b87b-4ce9-a59f-5277dfefbbae"} : dispatch 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3081485403' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa947193-b87b-4ce9-a59f-5277dfefbbae"}]': finished 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:06:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:06:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:14 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3630170767' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:06:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:06:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T07:06:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3081485403' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa947193-b87b-4ce9-a59f-5277dfefbbae"} : dispatch 2024-09-21T07:06:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3081485403' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa947193-b87b-4ce9-a59f-5277dfefbbae"}]': finished 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:06:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:06:15.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:06:15.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:06:15.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:06:15.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:06:15.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:14 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3630170767' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:06:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:06:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3081485403' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa947193-b87b-4ce9-a59f-5277dfefbbae"} : dispatch 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3081485403' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa947193-b87b-4ce9-a59f-5277dfefbbae"}]': finished 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:06:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:06:15.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:06:15.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:06:15.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:06:15.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:06:15.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:06:15.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:06:15.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:06:15.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:06:15.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:06:15.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:14 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3630170767' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:06:15.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:15.771+0000 7f0510ff9640 1 -- 172.21.15.92:0/2836273375 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f050c0a9c60 con 0x7f0514108cf0 2024-09-21T07:06:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:15 smithi092 ceph-mon[30987]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:15 smithi169 ceph-mon[33705]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:15 smithi175 ceph-mon[34064]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:16 smithi092 ceph-mon[30987]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T07:06:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:16 smithi169 ceph-mon[33705]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T07:06:17.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:16 smithi175 ceph-mon[34064]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T07:06:18.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:17 smithi092 ceph-mon[30987]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:17 smithi169 ceph-mon[33705]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:18.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:17 smithi175 ceph-mon[34064]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:20.774 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:20 smithi092 ceph-mon[30987]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:20 smithi169 ceph-mon[33705]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:20 smithi175 ceph-mon[34064]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:22.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:22 smithi092 ceph-mon[30987]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:22.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:06:22.802 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:22 smithi169 ceph-mon[33705]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:06:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:23.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:22 smithi175 ceph-mon[34064]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:23.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:06:23.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:23.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:23 smithi092 ceph-mon[30987]: Deploying daemon osd.3 on smithi092 2024-09-21T07:06:23.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:23 smithi169 ceph-mon[33705]: Deploying daemon osd.3 on smithi092 2024-09-21T07:06:24.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:23 smithi175 ceph-mon[34064]: Deploying daemon osd.3 on smithi092 2024-09-21T07:06:24.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:24 smithi092 ceph-mon[30987]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:24.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:24 smithi169 ceph-mon[33705]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:25.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:24 smithi175 ceph-mon[34064]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:26.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:26 smithi092 ceph-mon[30987]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:26.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:26 smithi169 ceph-mon[33705]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:27.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:26 smithi175 ceph-mon[34064]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:28.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:28 smithi092 ceph-mon[30987]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:28.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:28.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:28.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:28.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:28 smithi169 ceph-mon[33705]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:28.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:28.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:28.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:29.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:28 smithi175 ceph-mon[34064]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:30.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:30 smithi092 ceph-mon[30987]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:30.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:30 smithi169 ceph-mon[33705]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:30 smithi175 ceph-mon[34064]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:31 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:31 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:31 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:31 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:31 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:31 smithi175 ceph-mon[34064]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:32.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:31 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:32.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:31 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:32.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:31 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:32.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:31 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:32.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:31 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:32.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:31 smithi092 ceph-mon[30987]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:32.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:31 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:32.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:31 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:32.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:31 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:32.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:31 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:32.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:31 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:32.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:31 smithi169 ceph-mon[33705]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:32.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.638+0000 7f0510ff9640 1 -- 172.21.15.92:0/2836273375 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0514106340 con 0x7f04fc0b6500 2024-09-21T07:06:32.641 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 3 on host 'smithi092' 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 -- 172.21.15.92:0/2836273375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04fc0b6500 msgr2=0x7f04fc0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04fc0b6500 0x7f04fc0b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f05040057c0 tx=0x7f05040058d0 comp rx=0 tx=0).stop 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 -- 172.21.15.92:0/2836273375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0514108cf0 msgr2=0x7f051419fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0514108cf0 0x7f051419fb90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f050c00cad0 tx=0x7f050c00cf90 comp rx=0 tx=0).stop 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 -- 172.21.15.92:0/2836273375 shutdown_connections 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04fc0b6500 0x7f04fc0b8a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0514108cf0 0x7f051419fb90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05141083a0 0x7f051419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 --2- 172.21.15.92:0/2836273375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514102a60 0x7f051419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 -- 172.21.15.92:0/2836273375 >> 172.21.15.92:0/2836273375 conn(0x7f0514079730 msgr2=0x7f0514101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:32.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 -- 172.21.15.92:0/2836273375 shutdown_connections 2024-09-21T07:06:32.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:06:32.641+0000 7f051a1a1640 1 -- 172.21.15.92:0/2836273375 wait complete. 2024-09-21T07:06:33.275 DEBUG:teuthology.orchestra.run.smithi092:osd.3> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T07:06:33.278 INFO:tasks.cephadm:Deploying osd.4 on smithi169 with /dev/vg_nvme/lv_3... 2024-09-21T07:06:33.278 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:06:33.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:33 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:33.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:33 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:33.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:33 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:33.532 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:06:33.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:33 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:33.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:33 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:33.557 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:33 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:33.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:33 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:33.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:33 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:33.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:33 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:34.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:34 smithi175 ceph-mon[34064]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:34.554 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:34 smithi092 ceph-mon[30987]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:34.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:34 smithi169 ceph-mon[33705]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:34.862 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:06:34 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3[53549]: 2024-09-21T07:06:34.623+0000 7fb1fd463640 -1 osd.3 0 log_to_monitors true 2024-09-21T07:06:35.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:35 smithi175 ceph-mon[34064]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:06:35.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:35 smithi092 ceph-mon[30987]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:06:35.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:35 smithi169 ceph-mon[33705]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:06:36.057 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:06:36.086 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi169:vg_nvme/lv_3 2024-09-21T07:06:36.339 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:06:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:06:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:06:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:06:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:36.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:36.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:36.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:36.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:06:36.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:06:36.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:06:36.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:36.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:36.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:36.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:36.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:36.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:36.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:06:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:06:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:06:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:06:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:36.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:36.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:36.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:36.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.816+0000 7f1de0f9e640 1 -- 172.21.15.169:0/2291570569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ddc1051b0 msgr2=0x7f1ddc1055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:36.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.816+0000 7f1de0f9e640 1 --2- 172.21.15.169:0/2291570569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ddc1051b0 0x7f1ddc1055c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009930 tx=0x7f1dc402a420 comp rx=0 tx=0).stop 2024-09-21T07:06:36.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.816+0000 7f1de0f9e640 1 -- 172.21.15.169:0/2291570569 shutdown_connections 2024-09-21T07:06:36.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.816+0000 7f1de0f9e640 1 --2- 172.21.15.169:0/2291570569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ddc105b00 0x7f1ddc10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:36.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.816+0000 7f1de0f9e640 1 --2- 172.21.15.169:0/2291570569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ddc1051b0 0x7f1ddc1055c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:36.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.816+0000 7f1de0f9e640 1 --2- 172.21.15.169:0/2291570569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ddc1031e0 0x7f1ddc1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:36.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.816+0000 7f1de0f9e640 1 -- 172.21.15.169:0/2291570569 >> 172.21.15.169:0/2291570569 conn(0x7f1ddc077cc0 msgr2=0x7f1ddc078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:36.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.816+0000 7f1de0f9e640 1 -- 172.21.15.169:0/2291570569 shutdown_connections 2024-09-21T07:06:36.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.816+0000 7f1de0f9e640 1 -- 172.21.15.169:0/2291570569 wait complete. 2024-09-21T07:06:36.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.817+0000 7f1de0f9e640 1 Processor -- start 2024-09-21T07:06:36.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.817+0000 7f1de0f9e640 1 -- start start 2024-09-21T07:06:36.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.817+0000 7f1de0f9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ddc1031e0 0x7f1ddc19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:36.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.817+0000 7f1de0f9e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ddc1051b0 0x7f1ddc19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:36.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.817+0000 7f1de0f9e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ddc105b00 0x7f1ddc19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:36.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.817+0000 7f1de0f9e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc112880 con 0x7f1ddc105b00 2024-09-21T07:06:36.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.817+0000 7f1de0f9e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc112700 con 0x7f1ddc1051b0 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.817+0000 7f1de0f9e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc112a00 con 0x7f1ddc1031e0 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd9d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ddc1051b0 0x7f1ddc19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd9d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ddc1051b0 0x7f1ddc19b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51864/0 (socket says 172.21.15.169:51864) 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd9d9b640 1 -- 172.21.15.169:0/1215148040 learned_addr learned my addr 172.21.15.169:0/1215148040 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dda59c640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ddc1031e0 0x7f1ddc19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1ddad9d640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ddc105b00 0x7f1ddc19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd9d9b640 1 -- 172.21.15.169:0/1215148040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ddc1031e0 msgr2=0x7f1ddc19b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd9d9b640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ddc1031e0 0x7f1ddc19b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd9d9b640 1 -- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ddc105b00 msgr2=0x7f1ddc19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd9d9b640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ddc105b00 0x7f1ddc19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd9d9b640 1 -- 172.21.15.169:0/1215148040 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc1a6570 con 0x7f1ddc1051b0 2024-09-21T07:06:36.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1ddad9d640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ddc105b00 0x7f1ddc19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:36.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd9d9b640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ddc1051b0 0x7f1ddc19b7f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4005940 tx=0x7f1dc40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:36.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd37fe640 1 -- 172.21.15.169:0/1215148040 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc403f030 con 0x7f1ddc1051b0 2024-09-21T07:06:36.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1de0f9e640 1 -- 172.21.15.169:0/1215148040 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ddc1a6800 con 0x7f1ddc1051b0 2024-09-21T07:06:36.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd37fe640 1 -- 172.21.15.169:0/1215148040 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dc4003c90 con 0x7f1ddc1051b0 2024-09-21T07:06:36.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1dd37fe640 1 -- 172.21.15.169:0/1215148040 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4035070 con 0x7f1ddc1051b0 2024-09-21T07:06:36.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.818+0000 7f1de0f9e640 1 -- 172.21.15.169:0/1215148040 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ddc1a6d30 con 0x7f1ddc1051b0 2024-09-21T07:06:36.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.819+0000 7f1de0f9e640 1 -- 172.21.15.169:0/1215148040 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ddc1035f0 con 0x7f1ddc1051b0 2024-09-21T07:06:36.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.821+0000 7f1dd37fe640 1 -- 172.21.15.169:0/1215148040 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1dc4042030 con 0x7f1ddc1051b0 2024-09-21T07:06:36.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.822+0000 7f1dd37fe640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1dc80b6560 0x7f1dc80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:36.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.822+0000 7f1dd37fe640 1 -- 172.21.15.169:0/1215148040 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3604+0+0 (secure 0 0 0) 0x7f1dc4106a30 con 0x7f1ddc1051b0 2024-09-21T07:06:36.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.822+0000 7f1dda59c640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1dc80b6560 0x7f1dc80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:36.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.823+0000 7f1dda59c640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1dc80b6560 0x7f1dc80b8a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc1029c0 tx=0x7f1dcc00a590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:36.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:36.825+0000 7f1dd37fe640 1 -- 172.21.15.169:0/1215148040 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1dc40ce520 con 0x7f1ddc1051b0 2024-09-21T07:06:37.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:37.014+0000 7f1de0f9e640 1 -- 172.21.15.169:0/1215148040 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1ddc063800 con 0x7f1dc80b6560 2024-09-21T07:06:37.112 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3[53549]: 2024-09-21T07:06:36.690+0000 7fb1f93e5640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T07:06:37.112 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:06:36 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3[53549]: 2024-09-21T07:06:36.695+0000 7fb1f11db640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:06:37.374 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi092 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] boot 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:06:37.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi092 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] boot 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:06:37.519 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:37.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi092 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: from='osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708]' entity='osd.3' 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: osd.3 [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] boot 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:06:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:06:38.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:38 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:06:38.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:38 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:06:38.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:38 smithi169 ceph-mon[33705]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:38.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:38 smithi169 ceph-mon[33705]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:38.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:38 smithi169 ceph-mon[33705]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:06:38.567 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:38 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:06:38.567 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:38 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:06:38.567 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:38 smithi175 ceph-mon[34064]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:38.567 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:38 smithi175 ceph-mon[34064]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:38.567 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:38 smithi175 ceph-mon[34064]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:06:38.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:38 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:06:38.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:38 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:06:38.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:38 smithi092 ceph-mon[30987]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:38.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:38 smithi092 ceph-mon[30987]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:38.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:38 smithi092 ceph-mon[30987]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:06:40.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:40 smithi169 ceph-mon[33705]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:06:40.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:40 smithi169 ceph-mon[33705]: from='client.? 172.21.15.169:0/356017792' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b727711-c462-405e-b7dd-4cef2e5ee2ab"} : dispatch 2024-09-21T07:06:40.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:40 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b727711-c462-405e-b7dd-4cef2e5ee2ab"} : dispatch 2024-09-21T07:06:40.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:40 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b727711-c462-405e-b7dd-4cef2e5ee2ab"}]': finished 2024-09-21T07:06:40.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:40 smithi169 ceph-mon[33705]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:06:40.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:06:40.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:40 smithi169 ceph-mon[33705]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:40.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:40 smithi169 ceph-mon[33705]: from='client.? 172.21.15.169:0/466920642' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:06:40.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:40 smithi175 ceph-mon[34064]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:06:40.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:40 smithi175 ceph-mon[34064]: from='client.? 172.21.15.169:0/356017792' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b727711-c462-405e-b7dd-4cef2e5ee2ab"} : dispatch 2024-09-21T07:06:40.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:40 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b727711-c462-405e-b7dd-4cef2e5ee2ab"} : dispatch 2024-09-21T07:06:40.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:40 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b727711-c462-405e-b7dd-4cef2e5ee2ab"}]': finished 2024-09-21T07:06:40.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:40 smithi175 ceph-mon[34064]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:06:40.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:06:40.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:40 smithi175 ceph-mon[34064]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:40.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:40 smithi175 ceph-mon[34064]: from='client.? 172.21.15.169:0/466920642' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:06:40.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:40 smithi092 ceph-mon[30987]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:06:40.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:40 smithi092 ceph-mon[30987]: from='client.? 172.21.15.169:0/356017792' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b727711-c462-405e-b7dd-4cef2e5ee2ab"} : dispatch 2024-09-21T07:06:40.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:40 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b727711-c462-405e-b7dd-4cef2e5ee2ab"} : dispatch 2024-09-21T07:06:40.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:40 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b727711-c462-405e-b7dd-4cef2e5ee2ab"}]': finished 2024-09-21T07:06:40.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:40 smithi092 ceph-mon[30987]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:06:40.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:06:40.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:40 smithi092 ceph-mon[30987]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:40.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:40 smithi092 ceph-mon[30987]: from='client.? 172.21.15.169:0/466920642' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:06:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:42 smithi092 ceph-mon[30987]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 357 GiB / 358 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-21T07:06:42.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:42 smithi169 ceph-mon[33705]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 357 GiB / 358 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-21T07:06:43.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:42 smithi175 ceph-mon[34064]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 357 GiB / 358 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-21T07:06:44.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:44 smithi092 ceph-mon[30987]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:06:44.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:44 smithi169 ceph-mon[33705]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:06:45.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:44 smithi175 ceph-mon[34064]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:06:46.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:46 smithi169 ceph-mon[33705]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T07:06:46.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:46 smithi092 ceph-mon[30987]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T07:06:47.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:46 smithi175 ceph-mon[34064]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T07:06:48.746 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:48 smithi169 ceph-mon[33705]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T07:06:48.747 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:48 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:06:48.747 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:48 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:48 smithi092 ceph-mon[30987]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T07:06:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:48 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:06:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:48 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:49.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:48 smithi175 ceph-mon[34064]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T07:06:49.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:48 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:06:49.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:48 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:49.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:49 smithi169 ceph-mon[33705]: Deploying daemon osd.4 on smithi169 2024-09-21T07:06:49.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:49 smithi092 ceph-mon[30987]: Deploying daemon osd.4 on smithi169 2024-09-21T07:06:50.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:49 smithi175 ceph-mon[34064]: Deploying daemon osd.4 on smithi169 2024-09-21T07:06:50.797 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:50 smithi169 ceph-mon[33705]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T07:06:50.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:50 smithi092 ceph-mon[30987]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T07:06:51.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:50 smithi175 ceph-mon[34064]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T07:06:52.860 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:52 smithi169 ceph-mon[33705]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:06:52.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:52 smithi092 ceph-mon[30987]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:06:53.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:52 smithi175 ceph-mon[34064]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:06:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:54 smithi092 ceph-mon[30987]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:54 smithi169 ceph-mon[33705]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:55.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:54 smithi175 ceph-mon[34064]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:55.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:55.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:55.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:56.891 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:56 smithi169 ceph-mon[33705]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:56 smithi175 ceph-mon[34064]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:56 smithi092 ceph-mon[30987]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:58.425 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:58.426 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:58.426 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:58.426 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:58.426 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:58.426 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:58 smithi169 ceph-mon[33705]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:58 smithi175 ceph-mon[34064]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:58.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.521+0000 7f1dd37fe640 1 -- 172.21.15.169:0/1215148040 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1ddc063800 con 0x7f1dc80b6560 2024-09-21T07:06:58.523 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 4 on host 'smithi169' 2024-09-21T07:06:58.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 -- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1dc80b6560 msgr2=0x7f1dc80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:58.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1dc80b6560 0x7f1dc80b8a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc1029c0 tx=0x7f1dcc00a590 comp rx=0 tx=0).stop 2024-09-21T07:06:58.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 -- 172.21.15.169:0/1215148040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ddc1051b0 msgr2=0x7f1ddc19b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:58.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ddc1051b0 0x7f1ddc19b7f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4005940 tx=0x7f1dc40042f0 comp rx=0 tx=0).stop 2024-09-21T07:06:58.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 -- 172.21.15.169:0/1215148040 shutdown_connections 2024-09-21T07:06:58.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1dc80b6560 0x7f1dc80b8a70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:58.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ddc105b00 0x7f1ddc19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:58.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ddc1051b0 0x7f1ddc19b7f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:58.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 --2- 172.21.15.169:0/1215148040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ddc1031e0 0x7f1ddc19b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:58.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 -- 172.21.15.169:0/1215148040 >> 172.21.15.169:0/1215148040 conn(0x7f1ddc077cc0 msgr2=0x7f1ddc106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:58.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 -- 172.21.15.169:0/1215148040 shutdown_connections 2024-09-21T07:06:58.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:06:58.524+0000 7f1de0f9e640 1 -- 172.21.15.169:0/1215148040 wait complete. 2024-09-21T07:06:58.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:58.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:58.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:58.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:58.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:58.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:58 smithi092 ceph-mon[30987]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:06:59.249 DEBUG:teuthology.orchestra.run.smithi169:osd.4> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T07:06:59.251 INFO:tasks.cephadm:Deploying osd.5 on smithi175 with /dev/vg_nvme/lv_3... 2024-09-21T07:06:59.251 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:06:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:06:59.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:59 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:59.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:59 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:59.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:06:59 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:59.522 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:59 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:59.522 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:59 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:59.523 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:06:59 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:59.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:59 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:59.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:59 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:06:59.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:06:59 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:00.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:00 smithi175 ceph-mon[34064]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:07:00.534 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:00 smithi169 ceph-mon[33705]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:07:00.534 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:07:00 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4[44952]: 2024-09-21T07:07:00.240+0000 7fae96c51640 -1 osd.4 0 log_to_monitors true 2024-09-21T07:07:00.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:00 smithi092 ceph-mon[30987]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:07:01.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:01 smithi175 ceph-mon[34064]: from='osd.4 [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:07:01.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:01 smithi175 ceph-mon[34064]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:07:01.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:01 smithi092 ceph-mon[30987]: from='osd.4 [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:07:01.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:01 smithi092 ceph-mon[30987]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:07:01.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:01 smithi169 ceph-mon[33705]: from='osd.4 [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:07:01.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:01 smithi169 ceph-mon[33705]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:07:02.034 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:07:02.060 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi175:vg_nvme/lv_3 2024-09-21T07:07:02.317 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:07:02.393 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4[44952]: 2024-09-21T07:07:02.209+0000 7fae92bd3640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T07:07:02.393 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4[44952]: 2024-09-21T07:07:02.217+0000 7fae8e9d1640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:07:02.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:07:02.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='osd.4 [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:07:02.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:02 smithi169 ceph-mon[33705]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='osd.4 [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:02.438 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.439 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:02.439 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:02.439 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.439 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:02 smithi175 ceph-mon[34064]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:07:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:07:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='osd.4 [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:07:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:07:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:07:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:07:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:02 smithi092 ceph-mon[30987]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:07:02.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.782+0000 7f50775aa640 1 -- 172.21.15.175:0/3803889640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5070108cf0 msgr2=0x7f507010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:02.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.782+0000 7f50775aa640 1 --2- 172.21.15.175:0/3803889640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5070108cf0 0x7f507010f520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5068009ca0 tx=0x7f506802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:07:02.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.782+0000 7f50775aa640 1 -- 172.21.15.175:0/3803889640 shutdown_connections 2024-09-21T07:07:02.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.782+0000 7f50775aa640 1 --2- 172.21.15.175:0/3803889640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5070108cf0 0x7f507010f520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:02.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.782+0000 7f50775aa640 1 --2- 172.21.15.175:0/3803889640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50701083a0 0x7f50701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:02.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.782+0000 7f50775aa640 1 --2- 172.21.15.175:0/3803889640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5070102a60 0x7f5070102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:02.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.782+0000 7f50775aa640 1 -- 172.21.15.175:0/3803889640 >> 172.21.15.175:0/3803889640 conn(0x7f5070079730 msgr2=0x7f5070079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:02.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.782+0000 7f50775aa640 1 -- 172.21.15.175:0/3803889640 shutdown_connections 2024-09-21T07:07:02.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.782+0000 7f50775aa640 1 -- 172.21.15.175:0/3803889640 wait complete. 2024-09-21T07:07:02.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f50775aa640 1 Processor -- start 2024-09-21T07:07:02.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f50775aa640 1 -- start start 2024-09-21T07:07:02.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f50775aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5070102a60 0x7f5070199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:02.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f50775aa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50701083a0 0x7f5070199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:02.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f50775aa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5070108cf0 0x7f507019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:02.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f50775aa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5070112940 con 0x7f5070108cf0 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f50775aa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50701127c0 con 0x7f50701083a0 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f50775aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5070112ac0 con 0x7f5070102a60 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f5075346640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5070102a60 0x7f5070199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f5075346640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5070102a60 0x7f5070199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41420/0 (socket says 172.21.15.175:41420) 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.783+0000 7f5075346640 1 -- 172.21.15.175:0/4255682037 learned_addr learned my addr 172.21.15.175:0/4255682037 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f5074b45640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50701083a0 0x7f5070199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f5075346640 1 -- 172.21.15.175:0/4255682037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50701083a0 msgr2=0x7f5070199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f5075346640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50701083a0 0x7f5070199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f5075346640 1 -- 172.21.15.175:0/4255682037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5070108cf0 msgr2=0x7f507019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f5075b47640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5070108cf0 0x7f507019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f5075346640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5070108cf0 0x7f507019ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f5075346640 1 -- 172.21.15.175:0/4255682037 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507019f300 con 0x7f5070102a60 2024-09-21T07:07:02.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f5075346640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5070102a60 0x7f5070199390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f506c00b4a0 tx=0x7f506c00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:02.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f50627fc640 1 -- 172.21.15.175:0/4255682037 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c014070 con 0x7f5070102a60 2024-09-21T07:07:02.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f50775aa640 1 -- 172.21.15.175:0/4255682037 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f507019f5f0 con 0x7f5070102a60 2024-09-21T07:07:02.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f50627fc640 1 -- 172.21.15.175:0/4255682037 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f506c010aa0 con 0x7f5070102a60 2024-09-21T07:07:02.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f50627fc640 1 -- 172.21.15.175:0/4255682037 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c017b70 con 0x7f5070102a60 2024-09-21T07:07:02.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.784+0000 7f50775aa640 1 -- 172.21.15.175:0/4255682037 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f507006ae60 con 0x7f5070102a60 2024-09-21T07:07:02.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.785+0000 7f50775aa640 1 -- 172.21.15.175:0/4255682037 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5070102e70 con 0x7f5070102a60 2024-09-21T07:07:02.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.787+0000 7f50627fc640 1 -- 172.21.15.175:0/4255682037 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f506c017070 con 0x7f5070102a60 2024-09-21T07:07:02.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.787+0000 7f50627fc640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f505c0b6560 0x7f505c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:02.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.788+0000 7f50627fc640 1 -- 172.21.15.175:0/4255682037 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7f506c0e59a0 con 0x7f5070102a60 2024-09-21T07:07:02.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.788+0000 7f5074b45640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f505c0b6560 0x7f505c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:02.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.788+0000 7f5074b45640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f505c0b6560 0x7f505c0b8a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5070107b40 tx=0x7f5064008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:02.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.792+0000 7f50627fc640 1 -- 172.21.15.175:0/4255682037 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f506c0ad2e0 con 0x7f5070102a60 2024-09-21T07:07:02.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:02.977+0000 7f50775aa640 1 -- 172.21.15.175:0/4255682037 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f507006ba20 con 0x7f505c0b6560 2024-09-21T07:07:03.502 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:03 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi169 2024-09-21T07:07:03.502 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:03 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-21T07:07:03.502 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:03 smithi175 ceph-mon[34064]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:07:03.502 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:03.502 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:03.502 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:07:03.502 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:07:03.502 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:03.502 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:03 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi169 2024-09-21T07:07:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:03 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-21T07:07:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:03 smithi092 ceph-mon[30987]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:07:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:07:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:07:03.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:03.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:03.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:03 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi169 2024-09-21T07:07:03.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:03 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-21T07:07:03.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:03 smithi169 ceph-mon[33705]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:07:03.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:03.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:03.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:07:03.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:07:03.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:03.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:04.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:04 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:07:04.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:04 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:07:04.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:04 smithi175 ceph-mon[34064]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:04.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:04 smithi175 ceph-mon[34064]: osd.4 [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] boot 2024-09-21T07:07:04.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:04 smithi175 ceph-mon[34064]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:07:04.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:04 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:04.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:04 smithi175 ceph-mon[34064]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:07:04.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:04 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:07:04.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:04 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:07:04.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:04 smithi092 ceph-mon[30987]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:04.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:04 smithi092 ceph-mon[30987]: osd.4 [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] boot 2024-09-21T07:07:04.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:04 smithi092 ceph-mon[30987]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:07:04.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:04 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:04.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:04 smithi092 ceph-mon[30987]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:07:04.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:04 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:07:04.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:04 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:07:04.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:04 smithi169 ceph-mon[33705]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:04.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:04 smithi169 ceph-mon[33705]: osd.4 [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] boot 2024-09-21T07:07:04.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:04 smithi169 ceph-mon[33705]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:07:04.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:04 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:07:04.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:04 smithi169 ceph-mon[33705]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:07:05.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:05 smithi175 ceph-mon[34064]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:07:05.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:05 smithi092 ceph-mon[30987]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:07:05.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:05 smithi169 ceph-mon[33705]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:07:06.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:06 smithi175 ceph-mon[34064]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:06.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:06 smithi175 ceph-mon[34064]: from='client.? 172.21.15.175:0/54061722' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7"} : dispatch 2024-09-21T07:07:06.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:06 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7"} : dispatch 2024-09-21T07:07:06.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:06 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7"}]': finished 2024-09-21T07:07:06.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:06 smithi175 ceph-mon[34064]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:07:06.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:06.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:06 smithi175 ceph-mon[34064]: from='client.? 172.21.15.175:0/3749081919' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:07:06.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:06 smithi092 ceph-mon[30987]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:06.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:06 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/54061722' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7"} : dispatch 2024-09-21T07:07:06.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:06 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7"} : dispatch 2024-09-21T07:07:06.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:06 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7"}]': finished 2024-09-21T07:07:06.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:06 smithi092 ceph-mon[30987]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:07:06.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:06.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:06 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/3749081919' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:07:06.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:06 smithi169 ceph-mon[33705]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:06.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:06 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/54061722' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7"} : dispatch 2024-09-21T07:07:06.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:06 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7"} : dispatch 2024-09-21T07:07:06.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:06 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7"}]': finished 2024-09-21T07:07:06.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:06 smithi169 ceph-mon[33705]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:07:06.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:06.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:06 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/3749081919' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:07:08.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:08 smithi092 ceph-mon[30987]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:08.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:08 smithi169 ceph-mon[33705]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:09.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:08 smithi175 ceph-mon[34064]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:10.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:10 smithi175 ceph-mon[34064]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:10.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:10 smithi092 ceph-mon[30987]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:10.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:10 smithi169 ceph-mon[33705]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:12.812 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:12 smithi175 ceph-mon[34064]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:12.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:12 smithi092 ceph-mon[30987]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:12 smithi169 ceph-mon[33705]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:14.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:14 smithi175 ceph-mon[34064]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:14.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:07:14.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:14.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:14 smithi092 ceph-mon[30987]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:07:14.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:14.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:14 smithi169 ceph-mon[33705]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:14.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:07:14.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:15.751 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:15 smithi175 ceph-mon[34064]: Deploying daemon osd.5 on smithi175 2024-09-21T07:07:15.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:15 smithi092 ceph-mon[30987]: Deploying daemon osd.5 on smithi175 2024-09-21T07:07:15.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:15 smithi169 ceph-mon[33705]: Deploying daemon osd.5 on smithi175 2024-09-21T07:07:16.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:16 smithi092 ceph-mon[30987]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:16.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:16 smithi169 ceph-mon[33705]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:16 smithi175 ceph-mon[34064]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:18.839 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:18 smithi175 ceph-mon[34064]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:18.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:18 smithi092 ceph-mon[30987]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:18.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:18 smithi169 ceph-mon[33705]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:20.870 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:20 smithi175 ceph-mon[34064]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:20.870 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:20.870 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:20.870 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:20 smithi169 ceph-mon[33705]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:20 smithi092 ceph-mon[30987]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:22 smithi169 ceph-mon[33705]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:23.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:22 smithi175 ceph-mon[34064]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:22 smithi092 ceph-mon[30987]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:23 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:23 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:23 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:23 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:23 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:23 smithi169 ceph-mon[33705]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:24.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:23 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:24.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:23 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:24.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:23 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:24.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:23 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:24.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:23 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:24.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:23 smithi175 ceph-mon[34064]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:24.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.239+0000 7f50627fc640 1 -- 172.21.15.175:0/4255682037 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f507006ba20 con 0x7f505c0b6560 2024-09-21T07:07:24.241 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 5 on host 'smithi175' 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 -- 172.21.15.175:0/4255682037 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f505c0b6560 msgr2=0x7f505c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f505c0b6560 0x7f505c0b8a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5070107b40 tx=0x7f5064008040 comp rx=0 tx=0).stop 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 -- 172.21.15.175:0/4255682037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5070102a60 msgr2=0x7f5070199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5070102a60 0x7f5070199390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f506c00b4a0 tx=0x7f506c00b960 comp rx=0 tx=0).stop 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 -- 172.21.15.175:0/4255682037 shutdown_connections 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f505c0b6560 0x7f505c0b8a70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5070108cf0 0x7f507019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50701083a0 0x7f5070199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 --2- 172.21.15.175:0/4255682037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5070102a60 0x7f5070199390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 -- 172.21.15.175:0/4255682037 >> 172.21.15.175:0/4255682037 conn(0x7f5070079730 msgr2=0x7f50701052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 -- 172.21.15.175:0/4255682037 shutdown_connections 2024-09-21T07:07:24.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:07:24.242+0000 7f50775aa640 1 -- 172.21.15.175:0/4255682037 wait complete. 2024-09-21T07:07:24.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:23 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:24.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:23 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:24.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:23 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:24.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:23 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:24.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:23 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:24.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:23 smithi092 ceph-mon[30987]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:24.855 DEBUG:teuthology.orchestra.run.smithi175:osd.5> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T07:07:24.857 INFO:tasks.cephadm:Deploying osd.6 on smithi092 with /dev/vg_nvme/lv_2... 2024-09-21T07:07:24.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:07:25.112 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:25.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:25.113 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:25.116 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:25.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:25.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:25.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:26.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:25 smithi175 ceph-mon[34064]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:26.268 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:07:26 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:07:26.010+0000 7fd730986640 -1 osd.5 0 log_to_monitors true 2024-09-21T07:07:26.313 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:25 smithi169 ceph-mon[33705]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:26.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:25 smithi092 ceph-mon[30987]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:26 smithi092 ceph-mon[30987]: from='osd.5 [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:07:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:26 smithi092 ceph-mon[30987]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:07:27.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:26 smithi175 ceph-mon[34064]: from='osd.5 [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:07:27.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:26 smithi175 ceph-mon[34064]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:07:27.291 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:26 smithi169 ceph-mon[33705]: from='osd.5 [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:07:27.291 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:26 smithi169 ceph-mon[33705]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:07:27.933 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:07:27.961 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi092:vg_nvme/lv_2 2024-09-21T07:07:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:07:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='osd.5 [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:07:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:07:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:07:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:28.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:28.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:28.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:28.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:28.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:07:28.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='osd.5 [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:07:28.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:07:28.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:28.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:07:28.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:28.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:28.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:28.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:28.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:28.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:07:28.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='osd.5 [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:28.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:28.395 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.709+0000 7f1abce33640 1 -- 172.21.15.92:0/4105405919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab8109e10 msgr2=0x7f1ab8110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.709+0000 7f1abce33640 1 --2- 172.21.15.92:0/4105405919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab8109e10 0x7f1ab8110640 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009ca0 tx=0x7f1ab002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.709+0000 7f1abce33640 1 -- 172.21.15.92:0/4105405919 shutdown_connections 2024-09-21T07:07:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.709+0000 7f1abce33640 1 --2- 172.21.15.92:0/4105405919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab8109e10 0x7f1ab8110640 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.709+0000 7f1abce33640 1 --2- 172.21.15.92:0/4105405919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab81094c0 0x7f1ab81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.709+0000 7f1abce33640 1 --2- 172.21.15.92:0/4105405919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ab8103b80 0x7f1ab8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.709+0000 7f1abce33640 1 -- 172.21.15.92:0/4105405919 >> 172.21.15.92:0/4105405919 conn(0x7f1ab80ff610 msgr2=0x7f1ab8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.709+0000 7f1abce33640 1 -- 172.21.15.92:0/4105405919 shutdown_connections 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.709+0000 7f1abce33640 1 -- 172.21.15.92:0/4105405919 wait complete. 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.710+0000 7f1abce33640 1 Processor -- start 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.710+0000 7f1abce33640 1 -- start start 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.710+0000 7f1abce33640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ab8103b80 0x7f1ab819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.710+0000 7f1abce33640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab81094c0 0x7f1ab819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.710+0000 7f1abce33640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab8109e10 0x7f1ab819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.710+0000 7f1abce33640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab81139d0 con 0x7f1ab81094c0 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1abce33640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab8113850 con 0x7f1ab8109e10 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1abce33640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab8113b50 con 0x7f1ab8103b80 2024-09-21T07:07:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab81094c0 0x7f1ab819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab81094c0 0x7f1ab819a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44552/0 (socket says 172.21.15.92:44552) 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab5d9b640 1 -- 172.21.15.92:0/4081454857 learned_addr learned my addr 172.21.15.92:0/4081454857 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab659c640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ab8103b80 0x7f1ab819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab6d9d640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab8109e10 0x7f1ab819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab5d9b640 1 -- 172.21.15.92:0/4081454857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ab8103b80 msgr2=0x7f1ab819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab5d9b640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ab8103b80 0x7f1ab819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab5d9b640 1 -- 172.21.15.92:0/4081454857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab8109e10 msgr2=0x7f1ab819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab5d9b640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab8109e10 0x7f1ab819fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab5d9b640 1 -- 172.21.15.92:0/4081454857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab81a01f0 con 0x7f1ab81094c0 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1ab5d9b640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab81094c0 0x7f1ab819a8e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00d740 tx=0x7f1aac00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1aa77fe640 1 -- 172.21.15.92:0/4081454857 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac017070 con 0x7f1ab81094c0 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1aa77fe640 1 -- 172.21.15.92:0/4081454857 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1aac00de50 con 0x7f1ab81094c0 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1abce33640 1 -- 172.21.15.92:0/4081454857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab81a04e0 con 0x7f1ab81094c0 2024-09-21T07:07:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1aa77fe640 1 -- 172.21.15.92:0/4081454857 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00f620 con 0x7f1ab81094c0 2024-09-21T07:07:28.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.711+0000 7f1abce33640 1 -- 172.21.15.92:0/4081454857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab81a6d00 con 0x7f1ab81094c0 2024-09-21T07:07:28.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.712+0000 7f1abce33640 1 -- 172.21.15.92:0/4081454857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab8103f90 con 0x7f1ab81094c0 2024-09-21T07:07:28.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.715+0000 7f1aa77fe640 1 -- 172.21.15.92:0/4081454857 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1aac01a070 con 0x7f1ab81094c0 2024-09-21T07:07:28.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.715+0000 7f1aa77fe640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1aa00b6590 0x7f1aa00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:28.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.715+0000 7f1ab659c640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1aa00b6590 0x7f1aa00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:28.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.716+0000 7f1aa77fe640 1 -- 172.21.15.92:0/4081454857 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4468+0+0 (secure 0 0 0) 0x7f1aac0e5f10 con 0x7f1ab81094c0 2024-09-21T07:07:28.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.716+0000 7f1ab659c640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1aa00b6590 0x7f1aa00b8aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8005e10 tx=0x7f1aa8005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:28.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.719+0000 7f1aa77fe640 1 -- 172.21.15.92:0/4081454857 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1aac0ad6a0 con 0x7f1ab81094c0 2024-09-21T07:07:28.768 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:07:28.354+0000 7fd72c908640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T07:07:28.768 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:07:28.364+0000 7fd7246fe640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:07:28.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:28.906+0000 7f1abce33640 1 -- 172.21.15.92:0/4081454857 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1ab8063800 con 0x7f1aa00b6590 2024-09-21T07:07:29.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi175 2024-09-21T07:07:29.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-21T07:07:29.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:07:29.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:07:29.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:29.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:29.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: from='osd.5 ' entity='osd.5' 2024-09-21T07:07:29.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: osd.5 [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] boot 2024-09-21T07:07:29.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:07:29.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:29.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:07:29.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi175 2024-09-21T07:07:29.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-21T07:07:29.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:07:29.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:07:29.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:29.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:29.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: from='osd.5 ' entity='osd.5' 2024-09-21T07:07:29.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: osd.5 [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] boot 2024-09-21T07:07:29.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:07:29.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:29.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:07:29.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi175 2024-09-21T07:07:29.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-21T07:07:29.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:07:29.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:07:29.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:29.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:29.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: from='osd.5 ' entity='osd.5' 2024-09-21T07:07:29.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: osd.5 [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] boot 2024-09-21T07:07:29.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:07:29.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:07:29.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:07:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:29 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:07:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:29 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:07:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:29 smithi175 ceph-mon[34064]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:29 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:07:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:29 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:29 smithi175 ceph-mon[34064]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:07:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:29 smithi175 ceph-mon[34064]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:30.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:29 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:07:30.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:29 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:07:30.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:29 smithi092 ceph-mon[30987]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:30.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:29 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:07:30.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:29 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:30.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:29 smithi092 ceph-mon[30987]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:07:30.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:29 smithi092 ceph-mon[30987]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:30.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:29 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:07:30.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:29 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:07:30.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:29 smithi169 ceph-mon[33705]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:30.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:29 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:07:30.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:29 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:30.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:29 smithi169 ceph-mon[33705]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:07:30.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:29 smithi169 ceph-mon[33705]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:31.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:31 smithi175 ceph-mon[34064]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:07:31.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:31 smithi092 ceph-mon[30987]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:07:31.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:31 smithi169 ceph-mon[33705]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:07:32.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:32 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3445094215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f91ad74-d901-41cc-bda8-b038fb38b605"} : dispatch 2024-09-21T07:07:32.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:32 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3445094215' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f91ad74-d901-41cc-bda8-b038fb38b605"}]': finished 2024-09-21T07:07:32.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:32 smithi092 ceph-mon[30987]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:07:32.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:32 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:32.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:32 smithi092 ceph-mon[30987]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 159 KiB/s, 0 objects/s recovering 2024-09-21T07:07:32.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:32 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2792828657' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:07:32.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:32 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3445094215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f91ad74-d901-41cc-bda8-b038fb38b605"} : dispatch 2024-09-21T07:07:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:32 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3445094215' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f91ad74-d901-41cc-bda8-b038fb38b605"}]': finished 2024-09-21T07:07:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:32 smithi175 ceph-mon[34064]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:07:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:32 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:32 smithi175 ceph-mon[34064]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 159 KiB/s, 0 objects/s recovering 2024-09-21T07:07:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:32 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2792828657' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:07:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:32 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3445094215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f91ad74-d901-41cc-bda8-b038fb38b605"} : dispatch 2024-09-21T07:07:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:32 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3445094215' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f91ad74-d901-41cc-bda8-b038fb38b605"}]': finished 2024-09-21T07:07:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:32 smithi169 ceph-mon[33705]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:07:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:32 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:32 smithi169 ceph-mon[33705]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 159 KiB/s, 0 objects/s recovering 2024-09-21T07:07:32.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:32 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2792828657' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:07:34.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:34 smithi092 ceph-mon[30987]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-21T07:07:34.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:34 smithi169 ceph-mon[33705]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-21T07:07:35.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:34 smithi175 ceph-mon[34064]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-21T07:07:36.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:36 smithi092 ceph-mon[30987]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:07:36.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:36 smithi169 ceph-mon[33705]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:07:37.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:36 smithi175 ceph-mon[34064]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T07:07:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:38 smithi175 ceph-mon[34064]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:07:38.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:38 smithi092 ceph-mon[30987]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:07:38.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:38 smithi169 ceph-mon[33705]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:07:40.842 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:40 smithi092 ceph-mon[30987]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:07:40.842 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:07:40.842 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:40.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:40 smithi169 ceph-mon[33705]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:07:40.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:07:40.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:41.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:40 smithi175 ceph-mon[34064]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:07:41.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:07:41.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:41.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:41 smithi092 ceph-mon[30987]: Deploying daemon osd.6 on smithi092 2024-09-21T07:07:41.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:41 smithi169 ceph-mon[33705]: Deploying daemon osd.6 on smithi092 2024-09-21T07:07:42.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:41 smithi175 ceph-mon[34064]: Deploying daemon osd.6 on smithi092 2024-09-21T07:07:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:42 smithi092 ceph-mon[30987]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:42.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:42 smithi169 ceph-mon[33705]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:43.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:42 smithi175 ceph-mon[34064]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:44.851 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:44 smithi092 ceph-mon[30987]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:44.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:44 smithi169 ceph-mon[33705]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:45.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:44 smithi175 ceph-mon[34064]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:46.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:46 smithi092 ceph-mon[30987]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:46.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:46.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:46.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:46.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:46 smithi169 ceph-mon[33705]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:46.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:46.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:46.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:46 smithi175 ceph-mon[34064]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:48.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:48 smithi169 ceph-mon[33705]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:48.899 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:48 smithi092 ceph-mon[30987]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:49.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:48 smithi175 ceph-mon[34064]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:50.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:50 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:50.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:50 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:50.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:50 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:50.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:50 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:50.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:50 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:50.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:50 smithi092 ceph-mon[30987]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:50.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.295+0000 7f1aa77fe640 1 -- 172.21.15.92:0/4081454857 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1ab8063800 con 0x7f1aa00b6590 2024-09-21T07:07:50.298 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 6 on host 'smithi092' 2024-09-21T07:07:50.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 -- 172.21.15.92:0/4081454857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1aa00b6590 msgr2=0x7f1aa00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:50.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1aa00b6590 0x7f1aa00b8aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8005e10 tx=0x7f1aa8005da0 comp rx=0 tx=0).stop 2024-09-21T07:07:50.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 -- 172.21.15.92:0/4081454857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab81094c0 msgr2=0x7f1ab819a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:50.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab81094c0 0x7f1ab819a8e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00d740 tx=0x7f1aac00dc00 comp rx=0 tx=0).stop 2024-09-21T07:07:50.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 -- 172.21.15.92:0/4081454857 shutdown_connections 2024-09-21T07:07:50.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1aa00b6590 0x7f1aa00b8aa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:50.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab8109e10 0x7f1ab819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:50.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab81094c0 0x7f1ab819a8e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:50.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 --2- 172.21.15.92:0/4081454857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ab8103b80 0x7f1ab819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:50.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 -- 172.21.15.92:0/4081454857 >> 172.21.15.92:0/4081454857 conn(0x7f1ab80ff610 msgr2=0x7f1ab8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:50.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.298+0000 7f1abce33640 1 -- 172.21.15.92:0/4081454857 shutdown_connections 2024-09-21T07:07:50.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:07:50.299+0000 7f1abce33640 1 -- 172.21.15.92:0/4081454857 wait complete. 2024-09-21T07:07:50.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:50 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:50.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:50 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:50.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:50 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:50.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:50 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:50.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:50 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:50.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:50 smithi175 ceph-mon[34064]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:50.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:50 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:50.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:50 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:50.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:50 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:50.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:50 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:50.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:50 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:50.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:50 smithi169 ceph-mon[33705]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:50.970 DEBUG:teuthology.orchestra.run.smithi092:osd.6> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T07:07:50.972 INFO:tasks.cephadm:Deploying osd.7 on smithi169 with /dev/vg_nvme/lv_2... 2024-09-21T07:07:50.972 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:07:51.231 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:07:51.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:51 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:51.281 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:51 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:51.281 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:51 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:51.352 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:51 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:51.352 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:51 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:51.352 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:51 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:51.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:51 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:51.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:51 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:51.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:51 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:52.441 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:52 smithi169 ceph-mon[33705]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:52.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:52 smithi092 ceph-mon[30987]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:52.517 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:07:52 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:07:52.299+0000 7fc1b737c640 -1 osd.6 0 log_to_monitors true 2024-09-21T07:07:52.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:52 smithi175 ceph-mon[34064]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:53.336 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:53 smithi169 ceph-mon[33705]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:07:53.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:53 smithi175 ceph-mon[34064]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:07:53.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:53 smithi092 ceph-mon[30987]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:07:53.869 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:07:53.901 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi169:vg_nvme/lv_2 2024-09-21T07:07:54.152 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:07:54.362 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:07:54.176+0000 7fc1b32fe640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T07:07:54.362 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:07:54.184+0000 7fc1af0fc640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:07:54.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:07:54.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:07:54.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:07:54.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:54.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:54.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:54.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:54.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:54.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:54.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:54.364 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.445 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:07:54.445 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:07:54.445 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:54.446 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:07:54.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:07:54.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:07:54.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:54.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:54.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:54.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:54.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:07:54.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:54.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:54.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:07:54.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.636+0000 7f94db4ed640 1 -- 172.21.15.169:0/291880974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94d41083a0 msgr2=0x7f94d41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:54.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.636+0000 7f94db4ed640 1 --2- 172.21.15.169:0/291880974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94d41083a0 0x7f94d41087b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009900 tx=0x7f94c802a410 comp rx=0 tx=0).stop 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.636+0000 7f94db4ed640 1 -- 172.21.15.169:0/291880974 shutdown_connections 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.636+0000 7f94db4ed640 1 --2- 172.21.15.169:0/291880974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d4108cf0 0x7f94d410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.636+0000 7f94db4ed640 1 --2- 172.21.15.169:0/291880974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94d41083a0 0x7f94d41087b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.636+0000 7f94db4ed640 1 --2- 172.21.15.169:0/291880974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d4102a60 0x7f94d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.636+0000 7f94db4ed640 1 -- 172.21.15.169:0/291880974 >> 172.21.15.169:0/291880974 conn(0x7f94d4079730 msgr2=0x7f94d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.636+0000 7f94db4ed640 1 -- 172.21.15.169:0/291880974 shutdown_connections 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.636+0000 7f94db4ed640 1 -- 172.21.15.169:0/291880974 wait complete. 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.637+0000 7f94db4ed640 1 Processor -- start 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.637+0000 7f94db4ed640 1 -- start start 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.637+0000 7f94db4ed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d4102a60 0x7f94d41993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.637+0000 7f94db4ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d41083a0 0x7f94d4199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.637+0000 7f94db4ed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94d4108cf0 0x7f94d419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.637+0000 7f94db4ed640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4112810 con 0x7f94d4102a60 2024-09-21T07:07:54.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.637+0000 7f94db4ed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4112690 con 0x7f94d4108cf0 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.637+0000 7f94db4ed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4112990 con 0x7f94d41083a0 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d9a8a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94d4108cf0 0x7f94d419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d9a8a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94d4108cf0 0x7f94d419ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:45220/0 (socket says 172.21.15.169:45220) 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d9a8a640 1 -- 172.21.15.169:0/1816377964 learned_addr learned my addr 172.21.15.169:0/1816377964 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d9289640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d4102a60 0x7f94d41993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d8a88640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d41083a0 0x7f94d4199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d9a8a640 1 -- 172.21.15.169:0/1816377964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d41083a0 msgr2=0x7f94d4199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d9a8a640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d41083a0 0x7f94d4199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d9a8a640 1 -- 172.21.15.169:0/1816377964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d4102a60 msgr2=0x7f94d41993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d9a8a640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d4102a60 0x7f94d41993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d9a8a640 1 -- 172.21.15.169:0/1816377964 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d419f250 con 0x7f94d4108cf0 2024-09-21T07:07:54.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d8a88640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d41083a0 0x7f94d4199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d9a8a640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94d4108cf0 0x7f94d419ebe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00eaa0 tx=0x7f94cc00eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d27fc640 1 -- 172.21.15.169:0/1816377964 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc004d20 con 0x7f94d4108cf0 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94db4ed640 1 -- 172.21.15.169:0/1816377964 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d419f540 con 0x7f94d4108cf0 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d27fc640 1 -- 172.21.15.169:0/1816377964 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94cc005020 con 0x7f94d4108cf0 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94d27fc640 1 -- 172.21.15.169:0/1816377964 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc0116d0 con 0x7f94d4108cf0 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.638+0000 7f94db4ed640 1 -- 172.21.15.169:0/1816377964 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d419fa00 con 0x7f94d4108cf0 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.639+0000 7f94db4ed640 1 -- 172.21.15.169:0/1816377964 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d4102e70 con 0x7f94d4108cf0 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.641+0000 7f94d27fc640 1 -- 172.21.15.169:0/1816377964 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f94cc0051d0 con 0x7f94d4108cf0 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.642+0000 7f94d27fc640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94bc0b6590 0x7f94bc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.642+0000 7f94d27fc640 1 -- 172.21.15.169:0/1816377964 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4900+0+0 (secure 0 0 0) 0x7f94cc0e6b00 con 0x7f94d4108cf0 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.642+0000 7f94d9289640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94bc0b6590 0x7f94bc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:54.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.642+0000 7f94d9289640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94bc0b6590 0x7f94bc0b8aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94c400abe0 tx=0x7f94c400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:54.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.645+0000 7f94d27fc640 1 -- 172.21.15.169:0/1816377964 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f94cc016030 con 0x7f94d4108cf0 2024-09-21T07:07:54.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:07:54.832+0000 7f94db4ed640 1 -- 172.21.15.169:0/1816377964 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f94d410ab40 con 0x7f94bc0b6590 2024-09-21T07:07:55.456 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:55 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi092 2024-09-21T07:07:55.456 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:55 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-21T07:07:55.456 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:55 smithi169 ceph-mon[33705]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:07:55.456 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:55 smithi169 ceph-mon[33705]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T07:07:55.456 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:55 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:55.456 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:55 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:55.456 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:55 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:07:55.456 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:55 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:07:55.456 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:55 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:55.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:55 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi092 2024-09-21T07:07:55.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:55 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-21T07:07:55.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:55 smithi175 ceph-mon[34064]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:07:55.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:55 smithi175 ceph-mon[34064]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T07:07:55.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:55 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:55.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:55 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:55.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:55 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:07:55.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:55 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:07:55.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:55 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:55.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:55 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi092 2024-09-21T07:07:55.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:55 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-21T07:07:55.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:55 smithi092 ceph-mon[30987]: from='osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:07:55.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:55 smithi092 ceph-mon[30987]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T07:07:55.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:55 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:55.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:55 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:55.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:55 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:07:55.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:55 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:07:55.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:55 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:56.489 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:56 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:07:56.489 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:56 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:07:56.489 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:56 smithi169 ceph-mon[33705]: from='client.24398 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:56.489 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:56 smithi169 ceph-mon[33705]: osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] boot 2024-09-21T07:07:56.489 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:56 smithi169 ceph-mon[33705]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T07:07:56.489 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:56.489 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:56 smithi169 ceph-mon[33705]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:56.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:56 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:07:56.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:56 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:07:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:56 smithi175 ceph-mon[34064]: from='client.24398 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:56 smithi175 ceph-mon[34064]: osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] boot 2024-09-21T07:07:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:56 smithi175 ceph-mon[34064]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T07:07:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:56 smithi175 ceph-mon[34064]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:56.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:56 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:07:56.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:56 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:07:56.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:56 smithi092 ceph-mon[30987]: from='client.24398 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:56.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:56 smithi092 ceph-mon[30987]: osd.6 [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] boot 2024-09-21T07:07:56.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:56 smithi092 ceph-mon[30987]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T07:07:56.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:07:56.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:56 smithi092 ceph-mon[30987]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:07:57.505 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:57 smithi169 ceph-mon[33705]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T07:07:57.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:57 smithi175 ceph-mon[34064]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T07:07:57.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:57 smithi092 ceph-mon[30987]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T07:07:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:58 smithi175 ceph-mon[34064]: from='client.? 172.21.15.169:0/3237505002' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f073d2c0-5006-4331-ba84-7c1b91fc70ee"} : dispatch 2024-09-21T07:07:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:58 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f073d2c0-5006-4331-ba84-7c1b91fc70ee"} : dispatch 2024-09-21T07:07:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:58 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f073d2c0-5006-4331-ba84-7c1b91fc70ee"}]': finished 2024-09-21T07:07:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:58 smithi175 ceph-mon[34064]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:07:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:07:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:58 smithi175 ceph-mon[34064]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:07:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:07:58 smithi175 ceph-mon[34064]: from='client.? 172.21.15.169:0/2123069652' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:07:58.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:58 smithi092 ceph-mon[30987]: from='client.? 172.21.15.169:0/3237505002' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f073d2c0-5006-4331-ba84-7c1b91fc70ee"} : dispatch 2024-09-21T07:07:58.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:58 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f073d2c0-5006-4331-ba84-7c1b91fc70ee"} : dispatch 2024-09-21T07:07:58.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:58 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f073d2c0-5006-4331-ba84-7c1b91fc70ee"}]': finished 2024-09-21T07:07:58.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:58 smithi092 ceph-mon[30987]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:07:58.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:07:58.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:58 smithi092 ceph-mon[30987]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:07:58.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:07:58 smithi092 ceph-mon[30987]: from='client.? 172.21.15.169:0/2123069652' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:07:58.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.169:0/3237505002' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f073d2c0-5006-4331-ba84-7c1b91fc70ee"} : dispatch 2024-09-21T07:07:58.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:58 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f073d2c0-5006-4331-ba84-7c1b91fc70ee"} : dispatch 2024-09-21T07:07:58.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:58 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f073d2c0-5006-4331-ba84-7c1b91fc70ee"}]': finished 2024-09-21T07:07:58.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:58 smithi169 ceph-mon[33705]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:07:58.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:07:58.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:58 smithi169 ceph-mon[33705]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:07:58.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:07:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.169:0/2123069652' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:08:00.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:00 smithi092 ceph-mon[30987]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:00.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:00 smithi169 ceph-mon[33705]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:01.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:00 smithi175 ceph-mon[34064]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:02.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:02 smithi092 ceph-mon[30987]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:02 smithi169 ceph-mon[33705]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:03.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:02 smithi175 ceph-mon[34064]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:04.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:04 smithi092 ceph-mon[30987]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:04.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:04 smithi169 ceph-mon[33705]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:05.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:04 smithi175 ceph-mon[34064]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:06.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:06 smithi092 ceph-mon[30987]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:06.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:08:06.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:06.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:06 smithi092 ceph-mon[30987]: Deploying daemon osd.7 on smithi169 2024-09-21T07:08:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:06 smithi169 ceph-mon[33705]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:08:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:06 smithi169 ceph-mon[33705]: Deploying daemon osd.7 on smithi169 2024-09-21T07:08:07.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:06 smithi175 ceph-mon[34064]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:08:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:06 smithi175 ceph-mon[34064]: Deploying daemon osd.7 on smithi169 2024-09-21T07:08:08.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:08 smithi092 ceph-mon[30987]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:08.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:08 smithi169 ceph-mon[33705]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:09.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:08 smithi175 ceph-mon[34064]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:10.822 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:10 smithi169 ceph-mon[33705]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:10.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:10 smithi092 ceph-mon[30987]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:10 smithi175 ceph-mon[34064]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:12 smithi169 ceph-mon[33705]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:12 smithi175 ceph-mon[34064]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:12 smithi092 ceph-mon[30987]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:13.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:14.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:14 smithi169 ceph-mon[33705]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:14.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:14.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:14.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:14.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:14.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:14 smithi175 ceph-mon[34064]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:14 smithi092 ceph-mon[30987]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:15.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.439+0000 7f94d27fc640 1 -- 172.21.15.169:0/1816377964 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f94d410ab40 con 0x7f94bc0b6590 2024-09-21T07:08:15.441 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 7 on host 'smithi169' 2024-09-21T07:08:15.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 -- 172.21.15.169:0/1816377964 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94bc0b6590 msgr2=0x7f94bc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:15.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94bc0b6590 0x7f94bc0b8aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94c400abe0 tx=0x7f94c400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 -- 172.21.15.169:0/1816377964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94d4108cf0 msgr2=0x7f94d419ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:15.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94d4108cf0 0x7f94d419ebe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00eaa0 tx=0x7f94cc00eea0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 -- 172.21.15.169:0/1816377964 shutdown_connections 2024-09-21T07:08:15.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94bc0b6590 0x7f94bc0b8aa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94d4108cf0 0x7f94d419ebe0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d41083a0 0x7f94d4199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 --2- 172.21.15.169:0/1816377964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d4102a60 0x7f94d41993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 -- 172.21.15.169:0/1816377964 >> 172.21.15.169:0/1816377964 conn(0x7f94d4079730 msgr2=0x7f94d4104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:15.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 -- 172.21.15.169:0/1816377964 shutdown_connections 2024-09-21T07:08:15.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:08:15.441+0000 7f94db4ed640 1 -- 172.21.15.169:0/1816377964 wait complete. 2024-09-21T07:08:15.807 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:15.807 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:15.807 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:16.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:16.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:16.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:16.110 DEBUG:teuthology.orchestra.run.smithi169:osd.7> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T07:08:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:16.113 INFO:tasks.cephadm:Deploying osd.8 on smithi175 with /dev/vg_nvme/lv_2... 2024-09-21T07:08:16.113 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:08:16.373 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:08:16.661 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:16 smithi169 ceph-mon[33705]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:16 smithi175 ceph-mon[34064]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:16 smithi092 ceph-mon[30987]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:17.537 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:08:17 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:08:17.336+0000 7fcc4cd54640 -1 osd.7 0 log_to_monitors true 2024-09-21T07:08:17.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:17 smithi169 ceph-mon[33705]: from='osd.7 [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:08:17.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:17 smithi169 ceph-mon[33705]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:08:17.972 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:17 smithi175 ceph-mon[34064]: from='osd.7 [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:08:17.972 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:17 smithi175 ceph-mon[34064]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:08:18.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:17 smithi092 ceph-mon[30987]: from='osd.7 [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:08:18.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:17 smithi092 ceph-mon[30987]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:08:18.843 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:18 smithi175 ceph-mon[34064]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:18.843 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:18 smithi175 ceph-mon[34064]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:08:18.843 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:18 smithi175 ceph-mon[34064]: from='osd.7 [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:08:18.843 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:18 smithi175 ceph-mon[34064]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:08:18.843 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:18.843 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:18 smithi175 ceph-mon[34064]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:08:18.893 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:08:18 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:08:18.641+0000 7fcc48cd6640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T07:08:18.893 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:08:18 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:08:18.652+0000 7fcc44ad4640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:08:18.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:18 smithi169 ceph-mon[33705]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:18.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:18 smithi169 ceph-mon[33705]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:08:18.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:18 smithi169 ceph-mon[33705]: from='osd.7 [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:08:18.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:18 smithi169 ceph-mon[33705]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:08:18.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:18.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:18 smithi169 ceph-mon[33705]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:08:19.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:18 smithi092 ceph-mon[30987]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:19.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:18 smithi092 ceph-mon[30987]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:08:19.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:18 smithi092 ceph-mon[30987]: from='osd.7 [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:08:19.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:18 smithi092 ceph-mon[30987]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:08:19.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:19.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:18 smithi092 ceph-mon[30987]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:08:19.137 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:08:19.163 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi175:vg_nvme/lv_2 2024-09-21T07:08:19.414 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:08:19.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:08:19.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T07:08:19.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:19.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:19.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:19.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:19.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:19.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:19.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:19.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:19.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:19.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:19.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:19.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: osd.7 [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] boot 2024-09-21T07:08:19.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:08:19.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:19.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:08:19.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T07:08:19.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:19.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:19.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:19.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:19.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:19.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:19.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:19.880 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:19.881 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:19.881 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:19.881 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:19.881 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: osd.7 [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] boot 2024-09-21T07:08:19.881 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:08:19.881 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:19.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.971+0000 7f78e31cd640 1 -- 172.21.15.175:0/2377077945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc102a60 msgr2=0x7f78dc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:19.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.971+0000 7f78e31cd640 1 --2- 172.21.15.175:0/2377077945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc102a60 0x7f78dc102e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009900 tx=0x7f78cc02a410 comp rx=0 tx=0).stop 2024-09-21T07:08:19.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.971+0000 7f78e31cd640 1 -- 172.21.15.175:0/2377077945 shutdown_connections 2024-09-21T07:08:19.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.971+0000 7f78e31cd640 1 --2- 172.21.15.175:0/2377077945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78dc108cf0 0x7f78dc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.971+0000 7f78e31cd640 1 --2- 172.21.15.175:0/2377077945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78dc1083a0 0x7f78dc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.971+0000 7f78e31cd640 1 --2- 172.21.15.175:0/2377077945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc102a60 0x7f78dc102e70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.971+0000 7f78e31cd640 1 -- 172.21.15.175:0/2377077945 >> 172.21.15.175:0/2377077945 conn(0x7f78dc079730 msgr2=0x7f78dc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.971+0000 7f78e31cd640 1 -- 172.21.15.175:0/2377077945 shutdown_connections 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.971+0000 7f78e31cd640 1 -- 172.21.15.175:0/2377077945 wait complete. 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78e31cd640 1 Processor -- start 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78e31cd640 1 -- start start 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78e31cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78dc102a60 0x7f78dc19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78e31cd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc1083a0 0x7f78dc19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78e31cd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78dc108cf0 0x7f78dc19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78e31cd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc113930 con 0x7f78dc102a60 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78e31cd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc1137b0 con 0x7f78dc108cf0 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78e31cd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc113ab0 con 0x7f78dc1083a0 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78dbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc1083a0 0x7f78dc19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78dbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc1083a0 0x7f78dc19a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35862/0 (socket says 172.21.15.175:35862) 2024-09-21T07:08:19.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78dbfff640 1 -- 172.21.15.175:0/4253736783 learned_addr learned my addr 172.21.15.175:0/4253736783 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78e0f69640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78dc102a60 0x7f78dc19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78e176a640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78dc108cf0 0x7f78dc19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78dbfff640 1 -- 172.21.15.175:0/4253736783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78dc108cf0 msgr2=0x7f78dc19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78dbfff640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78dc108cf0 0x7f78dc19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78dbfff640 1 -- 172.21.15.175:0/4253736783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78dc102a60 msgr2=0x7f78dc19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78dbfff640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78dc102a60 0x7f78dc19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.972+0000 7f78dbfff640 1 -- 172.21.15.175:0/4253736783 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc1a0350 con 0x7f78dc1083a0 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.973+0000 7f78dbfff640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc1083a0 0x7f78dc19a980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f78d0005fd0 tx=0x7f78d000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.973+0000 7f78d9ffb640 1 -- 172.21.15.175:0/4253736783 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0017070 con 0x7f78dc1083a0 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.973+0000 7f78d9ffb640 1 -- 172.21.15.175:0/4253736783 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78d0009c30 con 0x7f78dc1083a0 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.973+0000 7f78d9ffb640 1 -- 172.21.15.175:0/4253736783 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0003c70 con 0x7f78dc1083a0 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.973+0000 7f78e31cd640 1 -- 172.21.15.175:0/4253736783 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78dc1a0640 con 0x7f78dc1083a0 2024-09-21T07:08:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.973+0000 7f78e31cd640 1 -- 172.21.15.175:0/4253736783 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78dc1a6da0 con 0x7f78dc1083a0 2024-09-21T07:08:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.974+0000 7f78e31cd640 1 -- 172.21.15.175:0/4253736783 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78dc102e70 con 0x7f78dc1083a0 2024-09-21T07:08:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.975+0000 7f78d9ffb640 1 -- 172.21.15.175:0/4253736783 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f78d0003e10 con 0x7f78dc1083a0 2024-09-21T07:08:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.976+0000 7f78d9ffb640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78c40b65e0 0x7f78c40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.976+0000 7f78d9ffb640 1 -- 172.21.15.175:0/4253736783 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5645+0+0 (secure 0 0 0) 0x7f78d00e6c60 con 0x7f78dc1083a0 2024-09-21T07:08:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.976+0000 7f78e0f69640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78c40b65e0 0x7f78c40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.977+0000 7f78e0f69640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78c40b65e0 0x7f78c40b8af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0057c0 tx=0x7f78cc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:19.979+0000 7f78d9ffb640 1 -- 172.21.15.175:0/4253736783 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78d0020030 con 0x7f78dc1083a0 2024-09-21T07:08:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: osd.7 [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] boot 2024-09-21T07:08:20.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:08:20.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:08:20.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:20.168+0000 7f78e31cd640 1 -- 172.21.15.175:0/4253736783 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f78dc063800 con 0x7f78c40b65e0 2024-09-21T07:08:20.816 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:20 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:08:20.816 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:20 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:08:20.816 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:20 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi169 2024-09-21T07:08:20.816 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:20 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-21T07:08:20.816 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:20 smithi175 ceph-mon[34064]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:20.817 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:08:20.817 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:08:20.817 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:20 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:20.817 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:20 smithi175 ceph-mon[34064]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T07:08:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:20 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:08:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:20 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:08:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:20 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi169 2024-09-21T07:08:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:20 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-21T07:08:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:20 smithi092 ceph-mon[30987]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:21.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:08:21.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:08:21.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:20 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:21.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:20 smithi092 ceph-mon[30987]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T07:08:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:20 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:08:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:20 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:08:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:20 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi169 2024-09-21T07:08:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:20 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-21T07:08:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:20 smithi169 ceph-mon[33705]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:08:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:08:21.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:08:21.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:20 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:21.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:20 smithi169 ceph-mon[33705]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T07:08:21.867 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:21 smithi175 ceph-mon[34064]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:08:21.868 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:21 smithi175 ceph-mon[34064]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T07:08:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:21 smithi092 ceph-mon[30987]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:08:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:21 smithi092 ceph-mon[30987]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T07:08:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:21 smithi169 ceph-mon[33705]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:08:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:21 smithi169 ceph-mon[33705]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T07:08:22.981 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:22 smithi175 ceph-mon[34064]: pgmap v161: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:22.982 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:22 smithi175 ceph-mon[34064]: from='client.? 172.21.15.175:0/296104456' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84dbd9fc-2024-44fc-9cb4-82ccdbcb34db"} : dispatch 2024-09-21T07:08:22.982 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:22 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84dbd9fc-2024-44fc-9cb4-82ccdbcb34db"} : dispatch 2024-09-21T07:08:22.982 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:22 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84dbd9fc-2024-44fc-9cb4-82ccdbcb34db"}]': finished 2024-09-21T07:08:22.982 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:22 smithi175 ceph-mon[34064]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:08:22.982 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:22 smithi092 ceph-mon[30987]: pgmap v161: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:22 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/296104456' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84dbd9fc-2024-44fc-9cb4-82ccdbcb34db"} : dispatch 2024-09-21T07:08:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:22 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84dbd9fc-2024-44fc-9cb4-82ccdbcb34db"} : dispatch 2024-09-21T07:08:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:22 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84dbd9fc-2024-44fc-9cb4-82ccdbcb34db"}]': finished 2024-09-21T07:08:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:22 smithi092 ceph-mon[30987]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:08:23.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:22 smithi169 ceph-mon[33705]: pgmap v161: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:22 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/296104456' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84dbd9fc-2024-44fc-9cb4-82ccdbcb34db"} : dispatch 2024-09-21T07:08:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:22 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84dbd9fc-2024-44fc-9cb4-82ccdbcb34db"} : dispatch 2024-09-21T07:08:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:22 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84dbd9fc-2024-44fc-9cb4-82ccdbcb34db"}]': finished 2024-09-21T07:08:23.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:22 smithi169 ceph-mon[33705]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:08:23.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:23 smithi175 ceph-mon[34064]: from='client.? 172.21.15.175:0/807342627' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:08:24.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:23 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/807342627' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:08:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:23 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/807342627' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:08:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:24 smithi175 ceph-mon[34064]: pgmap v163: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:24 smithi092 ceph-mon[30987]: pgmap v163: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:24 smithi169 ceph-mon[33705]: pgmap v163: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:26.945 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:26 smithi169 ceph-mon[33705]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T07:08:27.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:26 smithi175 ceph-mon[34064]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T07:08:27.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:26 smithi092 ceph-mon[30987]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T07:08:28.953 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:28 smithi175 ceph-mon[34064]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s, 0 objects/s recovering 2024-09-21T07:08:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:28 smithi092 ceph-mon[30987]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s, 0 objects/s recovering 2024-09-21T07:08:29.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:28 smithi169 ceph-mon[33705]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s, 0 objects/s recovering 2024-09-21T07:08:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:30 smithi175 ceph-mon[34064]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-21T07:08:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:30 smithi092 ceph-mon[30987]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-21T07:08:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:30 smithi169 ceph-mon[33705]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-21T07:08:31.953 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:31 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:08:31.954 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:31 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:32.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:31 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:08:32.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:31 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:31 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:08:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:31 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:32.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:32 smithi175 ceph-mon[34064]: Deploying daemon osd.8 on smithi175 2024-09-21T07:08:32.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:32 smithi175 ceph-mon[34064]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-21T07:08:33.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:32 smithi092 ceph-mon[30987]: Deploying daemon osd.8 on smithi175 2024-09-21T07:08:33.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:32 smithi092 ceph-mon[30987]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-21T07:08:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:32 smithi169 ceph-mon[33705]: Deploying daemon osd.8 on smithi175 2024-09-21T07:08:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:32 smithi169 ceph-mon[33705]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-21T07:08:34.970 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:34 smithi175 ceph-mon[34064]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T07:08:35.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:34 smithi092 ceph-mon[30987]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T07:08:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:34 smithi169 ceph-mon[33705]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T07:08:37.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:36 smithi175 ceph-mon[34064]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:08:37.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:36 smithi092 ceph-mon[30987]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:08:37.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:36 smithi169 ceph-mon[33705]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:08:37.903 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:37.903 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:37.903 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:38.013 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:38.013 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:38.013 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:38.938 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:38 smithi175 ceph-mon[34064]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:39.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:38 smithi092 ceph-mon[30987]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:38 smithi169 ceph-mon[33705]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:40.994 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:40 smithi175 ceph-mon[34064]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:40.994 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:40.994 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:40.995 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:40.995 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:40.995 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:40 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:41.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:40 smithi092 ceph-mon[30987]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:41.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:41.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:41.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:41.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:41.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:40 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:40 smithi169 ceph-mon[33705]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:40 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:41.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.343+0000 7f78d9ffb640 1 -- 172.21.15.175:0/4253736783 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f78dc063800 con 0x7f78c40b65e0 2024-09-21T07:08:41.345 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 8 on host 'smithi175' 2024-09-21T07:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.346+0000 7f78e31cd640 1 -- 172.21.15.175:0/4253736783 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78c40b65e0 msgr2=0x7f78c40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.346+0000 7f78e31cd640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78c40b65e0 0x7f78c40b8af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0057c0 tx=0x7f78cc0058d0 comp rx=0 tx=0).stop 2024-09-21T07:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.346+0000 7f78e31cd640 1 -- 172.21.15.175:0/4253736783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc1083a0 msgr2=0x7f78dc19a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.346+0000 7f78e31cd640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc1083a0 0x7f78dc19a980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f78d0005fd0 tx=0x7f78d000dde0 comp rx=0 tx=0).stop 2024-09-21T07:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.346+0000 7f78e31cd640 1 -- 172.21.15.175:0/4253736783 shutdown_connections 2024-09-21T07:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.346+0000 7f78e31cd640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78c40b65e0 0x7f78c40b8af0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.346+0000 7f78e31cd640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78dc108cf0 0x7f78dc19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.346+0000 7f78e31cd640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc1083a0 0x7f78dc19a980 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.346+0000 7f78e31cd640 1 --2- 172.21.15.175:0/4253736783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78dc102a60 0x7f78dc19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.346+0000 7f78e31cd640 1 -- 172.21.15.175:0/4253736783 >> 172.21.15.175:0/4253736783 conn(0x7f78dc079730 msgr2=0x7f78dc1014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.347+0000 7f78e31cd640 1 -- 172.21.15.175:0/4253736783 shutdown_connections 2024-09-21T07:08:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:08:41.347+0000 7f78e31cd640 1 -- 172.21.15.175:0/4253736783 wait complete. 2024-09-21T07:08:41.957 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:41 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:41.958 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:41 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:41.958 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:41 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:41.985 DEBUG:teuthology.orchestra.run.smithi175:osd.8> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T07:08:41.987 INFO:tasks.cephadm:Deploying osd.9 on smithi092 with /dev/vg_nvme/lv_1... 2024-09-21T07:08:41.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:08:42.016 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:41 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:42.016 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:41 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:42.016 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:41 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:42.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:41 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:42.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:41 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:42.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:41 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:42.256 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:43.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:42 smithi175 ceph-mon[34064]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:42 smithi092 ceph-mon[30987]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:42 smithi169 ceph-mon[33705]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:43.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:08:43 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:08:43.336+0000 7fd83aab7640 -1 osd.8 0 log_to_monitors true 2024-09-21T07:08:43.794 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:43 smithi092 ceph-mon[30987]: from='osd.8 [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:08:43.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:43 smithi092 ceph-mon[30987]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:08:44.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:43 smithi175 ceph-mon[34064]: from='osd.8 [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:08:44.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:43 smithi175 ceph-mon[34064]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:08:44.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:43 smithi169 ceph-mon[33705]: from='osd.8 [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:08:44.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:43 smithi169 ceph-mon[33705]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:08:45.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:44 smithi175 ceph-mon[34064]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:45.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:44 smithi175 ceph-mon[34064]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:08:45.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:44 smithi175 ceph-mon[34064]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:08:45.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:45.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:44 smithi175 ceph-mon[34064]: from='osd.8 [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:08:45.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:44 smithi175 ceph-mon[34064]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:08:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:44 smithi092 ceph-mon[30987]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:44 smithi092 ceph-mon[30987]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:08:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:44 smithi092 ceph-mon[30987]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:08:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:44 smithi092 ceph-mon[30987]: from='osd.8 [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:08:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:44 smithi092 ceph-mon[30987]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:08:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:44 smithi169 ceph-mon[33705]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:44 smithi169 ceph-mon[33705]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:08:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:44 smithi169 ceph-mon[33705]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:08:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:44 smithi169 ceph-mon[33705]: from='osd.8 [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:08:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:44 smithi169 ceph-mon[33705]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:08:45.255 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:08:45.278 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi092:vg_nvme/lv_1 2024-09-21T07:08:45.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:08:45.131+0000 7fd836a39640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T07:08:45.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:08:45.146+0000 7fd82e82f640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:08:45.561 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:45.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:08:45.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T07:08:45.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:45.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi175 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: from='osd.8 ' entity='osd.8' 2024-09-21T07:08:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:45 smithi092 ceph-mon[30987]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:46.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:08:46.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T07:08:46.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:46.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:46.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi175 2024-09-21T07:08:46.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:46.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:46.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:46.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:46.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:46.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-21T07:08:46.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:46.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:46.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:46.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:46.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: from='osd.8 ' entity='osd.8' 2024-09-21T07:08:46.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:45 smithi175 ceph-mon[34064]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:46.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.046+0000 7f496279e640 1 -- 172.21.15.92:0/3432865692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f495c1092d0 msgr2=0x7f495c1096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.046+0000 7f496279e640 1 --2- 172.21.15.92:0/3432865692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f495c1092d0 0x7f495c1096e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f494c009900 tx=0x7f494c02a410 comp rx=0 tx=0).stop 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.046+0000 7f496279e640 1 -- 172.21.15.92:0/3432865692 shutdown_connections 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.046+0000 7f496279e640 1 --2- 172.21.15.92:0/3432865692 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c109c20 0x7f495c110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.046+0000 7f496279e640 1 --2- 172.21.15.92:0/3432865692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f495c1092d0 0x7f495c1096e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.046+0000 7f496279e640 1 --2- 172.21.15.92:0/3432865692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f495c103990 0x7f495c103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.047+0000 7f496279e640 1 -- 172.21.15.92:0/3432865692 >> 172.21.15.92:0/3432865692 conn(0x7f495c0ff3e0 msgr2=0x7f495c101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.047+0000 7f496279e640 1 -- 172.21.15.92:0/3432865692 shutdown_connections 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.047+0000 7f496279e640 1 -- 172.21.15.92:0/3432865692 wait complete. 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.047+0000 7f496279e640 1 Processor -- start 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.047+0000 7f496279e640 1 -- start start 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f496279e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c103990 0x7f495c19c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f496279e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f495c1092d0 0x7f495c19c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f496279e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f495c109c20 0x7f495c1a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f496279e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f495c113790 con 0x7f495c109c20 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f496279e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f495c113610 con 0x7f495c103990 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f496279e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f495c113910 con 0x7f495c1092d0 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f4961f9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f495c109c20 0x7f495c1a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f4961f9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f495c109c20 0x7f495c1a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54022/0 (socket says 172.21.15.92:54022) 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f4961f9d640 1 -- 172.21.15.92:0/2504503972 learned_addr learned my addr 172.21.15.92:0/2504503972 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f4960f9b640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f495c1092d0 0x7f495c19c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f496179c640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c103990 0x7f495c19c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f4961f9d640 1 -- 172.21.15.92:0/2504503972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f495c1092d0 msgr2=0x7f495c19c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f4961f9d640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f495c1092d0 0x7f495c19c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f4961f9d640 1 -- 172.21.15.92:0/2504503972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c103990 msgr2=0x7f495c19c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f4961f9d640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c103990 0x7f495c19c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f4961f9d640 1 -- 172.21.15.92:0/2504503972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c1a23b0 con 0x7f495c109c20 2024-09-21T07:08:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f496179c640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c103990 0x7f495c19c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f4961f9d640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f495c109c20 0x7f495c1a1c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f495400eaa0 tx=0x7f495400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.048+0000 7f49527fc640 1 -- 172.21.15.92:0/2504503972 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495400cdb0 con 0x7f495c109c20 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.049+0000 7f49527fc640 1 -- 172.21.15.92:0/2504503972 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4954005020 con 0x7f495c109c20 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.049+0000 7f49527fc640 1 -- 172.21.15.92:0/2504503972 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49540116d0 con 0x7f495c109c20 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.049+0000 7f496279e640 1 -- 172.21.15.92:0/2504503972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c1a26a0 con 0x7f495c109c20 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.049+0000 7f496279e640 1 -- 172.21.15.92:0/2504503972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c1a8e00 con 0x7f495c109c20 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.050+0000 7f496279e640 1 -- 172.21.15.92:0/2504503972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c103da0 con 0x7f495c109c20 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.051+0000 7f49527fc640 1 -- 172.21.15.92:0/2504503972 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f49540051d0 con 0x7f495c109c20 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.052+0000 7f49527fc640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49480b6560 0x7f49480b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.052+0000 7f496179c640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49480b6560 0x7f49480b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.052+0000 7f49527fc640 1 -- 172.21.15.92:0/2504503972 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6077+0+0 (secure 0 0 0) 0x7f49540e7000 con 0x7f495c109c20 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.052+0000 7f496179c640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49480b6560 0x7f49480b8a70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4958005d00 tx=0x7f4958005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:46.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.055+0000 7f49527fc640 1 -- 172.21.15.92:0/2504503972 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4954016030 con 0x7f495c109c20 2024-09-21T07:08:46.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:08:46.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T07:08:46.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi175 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: from='osd.8 ' entity='osd.8' 2024-09-21T07:08:46.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:45 smithi169 ceph-mon[33705]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:08:46.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:08:46.245+0000 7f496279e640 1 -- 172.21.15.92:0/2504503972 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f495c10fe30 con 0x7f49480b6560 2024-09-21T07:08:46.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:46 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:08:46.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:46 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:08:46.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:46.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:46 smithi092 ceph-mon[30987]: osd.8 [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] boot 2024-09-21T07:08:46.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:46 smithi092 ceph-mon[30987]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:08:46.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:46.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:46 smithi092 ceph-mon[30987]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:08:46.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:08:46.884 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:08:46.884 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:47.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:46 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:08:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:46 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:08:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:46 smithi175 ceph-mon[34064]: osd.8 [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] boot 2024-09-21T07:08:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:46 smithi175 ceph-mon[34064]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:08:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:46 smithi175 ceph-mon[34064]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:08:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:08:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:08:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:46 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:08:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:46 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:08:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:46 smithi169 ceph-mon[33705]: osd.8 [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] boot 2024-09-21T07:08:47.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:46 smithi169 ceph-mon[33705]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:08:47.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:08:47.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:46 smithi169 ceph-mon[33705]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:08:47.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:08:47.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:08:47.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:47.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:47 smithi092 ceph-mon[30987]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T07:08:47.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:47 smithi092 ceph-mon[30987]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:08:48.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:47 smithi175 ceph-mon[34064]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T07:08:48.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:47 smithi175 ceph-mon[34064]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:08:48.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:47 smithi169 ceph-mon[33705]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T07:08:48.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:47 smithi169 ceph-mon[33705]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:08:49.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:48 smithi175 ceph-mon[34064]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T07:08:49.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:48 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3443943657' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62fc48a5-f735-4d12-80bd-e79e4ca6ab1a"} : dispatch 2024-09-21T07:08:49.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:48 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3443943657' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62fc48a5-f735-4d12-80bd-e79e4ca6ab1a"}]': finished 2024-09-21T07:08:49.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:48 smithi175 ceph-mon[34064]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:08:49.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:48 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:08:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:48 smithi092 ceph-mon[30987]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T07:08:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:48 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3443943657' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62fc48a5-f735-4d12-80bd-e79e4ca6ab1a"} : dispatch 2024-09-21T07:08:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:48 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3443943657' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62fc48a5-f735-4d12-80bd-e79e4ca6ab1a"}]': finished 2024-09-21T07:08:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:48 smithi092 ceph-mon[30987]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:08:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:48 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:08:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:48 smithi169 ceph-mon[33705]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T07:08:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:48 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3443943657' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62fc48a5-f735-4d12-80bd-e79e4ca6ab1a"} : dispatch 2024-09-21T07:08:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:48 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3443943657' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62fc48a5-f735-4d12-80bd-e79e4ca6ab1a"}]': finished 2024-09-21T07:08:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:48 smithi169 ceph-mon[33705]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:08:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:48 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:08:50.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:49 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3794267932' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:08:50.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:49 smithi175 ceph-mon[34064]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:08:50.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:49 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3794267932' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:08:50.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:49 smithi092 ceph-mon[30987]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:08:50.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:49 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3794267932' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:08:50.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:49 smithi169 ceph-mon[33705]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:08:52.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:52 smithi092 ceph-mon[30987]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T07:08:52.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:52 smithi169 ceph-mon[33705]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T07:08:53.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:52 smithi175 ceph-mon[34064]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T07:08:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:54 smithi092 ceph-mon[30987]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T07:08:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:54 smithi169 ceph-mon[33705]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T07:08:55.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:54 smithi175 ceph-mon[34064]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T07:08:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:56 smithi092 ceph-mon[30987]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:08:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:08:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:56 smithi169 ceph-mon[33705]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:08:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:08:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:57.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:56 smithi175 ceph-mon[34064]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:08:57.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:08:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:57.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:57 smithi169 ceph-mon[33705]: Deploying daemon osd.9 on smithi092 2024-09-21T07:08:57.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:57 smithi092 ceph-mon[30987]: Deploying daemon osd.9 on smithi092 2024-09-21T07:08:58.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:57 smithi175 ceph-mon[34064]: Deploying daemon osd.9 on smithi092 2024-09-21T07:08:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:08:58 smithi092 ceph-mon[30987]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T07:08:58.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:08:58 smithi169 ceph-mon[33705]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T07:08:59.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:08:58 smithi175 ceph-mon[34064]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T07:09:00.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:00 smithi169 ceph-mon[33705]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T07:09:00.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:00 smithi092 ceph-mon[30987]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T07:09:01.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:00 smithi175 ceph-mon[34064]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T07:09:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:02 smithi169 ceph-mon[33705]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:09:03.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:02 smithi175 ceph-mon[34064]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:09:03.054 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:02 smithi092 ceph-mon[30987]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:09:03.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:03.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:03.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:04.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:04.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:04.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:04.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:04.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:04.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:04.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:04 smithi092 ceph-mon[30987]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:05.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:04 smithi175 ceph-mon[34064]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:04 smithi169 ceph-mon[33705]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.457+0000 7f49527fc640 1 -- 172.21.15.92:0/2504503972 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f495c10fe30 con 0x7f49480b6560 2024-09-21T07:09:06.459 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 9 on host 'smithi092' 2024-09-21T07:09:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 -- 172.21.15.92:0/2504503972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49480b6560 msgr2=0x7f49480b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49480b6560 0x7f49480b8a70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4958005d00 tx=0x7f4958005c70 comp rx=0 tx=0).stop 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 -- 172.21.15.92:0/2504503972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f495c109c20 msgr2=0x7f495c1a1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f495c109c20 0x7f495c1a1c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f495400eaa0 tx=0x7f495400ef60 comp rx=0 tx=0).stop 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 -- 172.21.15.92:0/2504503972 shutdown_connections 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49480b6560 0x7f49480b8a70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f495c109c20 0x7f495c1a1c80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f495c1092d0 0x7f495c19c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 --2- 172.21.15.92:0/2504503972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f495c103990 0x7f495c19c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 -- 172.21.15.92:0/2504503972 >> 172.21.15.92:0/2504503972 conn(0x7f495c0ff3e0 msgr2=0x7f495c10e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 -- 172.21.15.92:0/2504503972 shutdown_connections 2024-09-21T07:09:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:06.460+0000 7f496279e640 1 -- 172.21.15.92:0/2504503972 wait complete. 2024-09-21T07:09:06.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:06 smithi175 ceph-mon[34064]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:06.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:06.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:06.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:06.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:06 smithi092 ceph-mon[30987]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:06.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:06.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:06.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:06.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:06 smithi169 ceph-mon[33705]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:06.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:07.138 DEBUG:teuthology.orchestra.run.smithi092:osd.9> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T07:09:07.141 INFO:tasks.cephadm:Deploying osd.10 on smithi169 with /dev/vg_nvme/lv_1... 2024-09-21T07:09:07.141 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:09:07.401 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:09:08.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:08 smithi169 ceph-mon[33705]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:08.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:08 smithi092 ceph-mon[30987]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:09.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:08 smithi175 ceph-mon[34064]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:09.112 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:09:08 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:09:08.912+0000 7fc3415e3640 -1 osd.9 0 log_to_monitors true 2024-09-21T07:09:09.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:09 smithi092 ceph-mon[30987]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:09:09.683 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:09 smithi169 ceph-mon[33705]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:09:10.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:09 smithi175 ceph-mon[34064]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:09:10.225 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-21T07:09:10.251 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi169:vg_nvme/lv_1 2024-09-21T07:09:10.505 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:09:10.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:10.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:09:10.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:10.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:09:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T07:09:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:09:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:11.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:11.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:11.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:11.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:11.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:11.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:11.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:11.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/2679940248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a58109e40 msgr2=0x7f2a58110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 --2- 172.21.15.169:0/2679940248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a58109e40 0x7f2a58110670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009ca0 tx=0x7f2a5002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/2679940248 shutdown_connections 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 --2- 172.21.15.169:0/2679940248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a58109e40 0x7f2a58110670 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 --2- 172.21.15.169:0/2679940248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a581094f0 0x7f2a58109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 --2- 172.21.15.169:0/2679940248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a58103bb0 0x7f2a58103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/2679940248 >> 172.21.15.169:0/2679940248 conn(0x7f2a580ff600 msgr2=0x7f2a58101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/2679940248 shutdown_connections 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/2679940248 wait complete. 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 Processor -- start 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.027+0000 7f2a5f9fc640 1 -- start start 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5f9fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a58103bb0 0x7f2a5819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5f9fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a581094f0 0x7f2a5819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5f9fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a58109e40 0x7f2a5819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5f9fc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58113a00 con 0x7f2a581094f0 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5f9fc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58113880 con 0x7f2a58103bb0 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5f9fc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58113b80 con 0x7f2a58109e40 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5d798640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a58103bb0 0x7f2a5819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5d798640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a58103bb0 0x7f2a5819a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:57652/0 (socket says 172.21.15.169:57652) 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5d798640 1 -- 172.21.15.169:0/471152374 learned_addr learned my addr 172.21.15.169:0/471152374 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5cf97640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a581094f0 0x7f2a5819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5df99640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a58109e40 0x7f2a5819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5d798640 1 -- 172.21.15.169:0/471152374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a58109e40 msgr2=0x7f2a5819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5d798640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a58109e40 0x7f2a5819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5d798640 1 -- 172.21.15.169:0/471152374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a581094f0 msgr2=0x7f2a5819a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5d798640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a581094f0 0x7f2a5819a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5d798640 1 -- 172.21.15.169:0/471152374 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a581a02e0 con 0x7f2a58103bb0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.028+0000 7f2a5d798640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a58103bb0 0x7f2a5819a370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400d950 tx=0x7f2a5400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.029+0000 7f2a4e7fc640 1 -- 172.21.15.169:0/471152374 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54017070 con 0x7f2a58103bb0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.029+0000 7f2a4e7fc640 1 -- 172.21.15.169:0/471152374 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a54009c30 con 0x7f2a58103bb0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.029+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/471152374 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a581a05d0 con 0x7f2a58103bb0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.029+0000 7f2a4e7fc640 1 -- 172.21.15.169:0/471152374 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5400f620 con 0x7f2a58103bb0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.029+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/471152374 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a581a6d30 con 0x7f2a58103bb0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.030+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/471152374 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a58103fc0 con 0x7f2a58103bb0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.031+0000 7f2a4e7fc640 1 -- 172.21.15.169:0/471152374 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f2a54005030 con 0x7f2a58103bb0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.032+0000 7f2a4e7fc640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2a440b65e0 0x7f2a440b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.032+0000 7f2a4e7fc640 1 -- 172.21.15.169:0/471152374 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6196+0+0 (secure 0 0 0) 0x7f2a540e66a0 con 0x7f2a58103bb0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.032+0000 7f2a5cf97640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2a440b65e0 0x7f2a440b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.033+0000 7f2a5cf97640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2a440b65e0 0x7f2a440b8af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2a58106f30 tx=0x7f2a4800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:11.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.035+0000 7f2a4e7fc640 1 -- 172.21.15.169:0/471152374 <== mon.2 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a540ad7f0 con 0x7f2a58103bb0 2024-09-21T07:09:11.112 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:09:10.628+0000 7fc33d565640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T07:09:11.112 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:09:10.640+0000 7fc339363640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:09:11.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:11.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]} : dispatch 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:11.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:11.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:11.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:11.221+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/471152374 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2a58063800 con 0x7f2a440b65e0 2024-09-21T07:09:11.879 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:11 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi092 2024-09-21T07:09:11.879 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:11 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-21T07:09:11.879 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:11 smithi169 ceph-mon[33705]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:09:11.879 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:11 smithi169 ceph-mon[33705]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T07:09:11.879 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:11.879 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:11.880 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:09:11.880 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:09:11.880 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:11 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:11 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi092 2024-09-21T07:09:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:11 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-21T07:09:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:11 smithi175 ceph-mon[34064]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:09:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:11 smithi175 ceph-mon[34064]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T07:09:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:09:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:09:12.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:11 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:11 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi092 2024-09-21T07:09:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:11 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-21T07:09:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:11 smithi092 ceph-mon[30987]: from='osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-21T07:09:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:11 smithi092 ceph-mon[30987]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T07:09:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:09:12.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:09:12.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:11 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:12 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:09:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:12 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:09:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:12 smithi169 ceph-mon[33705]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:12 smithi169 ceph-mon[33705]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:12 smithi169 ceph-mon[33705]: osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] boot 2024-09-21T07:09:12.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:12 smithi169 ceph-mon[33705]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T07:09:12.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:12 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:09:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:12 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:09:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:12 smithi175 ceph-mon[34064]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:12 smithi175 ceph-mon[34064]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:12 smithi175 ceph-mon[34064]: osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] boot 2024-09-21T07:09:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:12 smithi175 ceph-mon[34064]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T07:09:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:12 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:09:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:12 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:09:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:12 smithi092 ceph-mon[30987]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:12 smithi092 ceph-mon[30987]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:09:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:12 smithi092 ceph-mon[30987]: osd.9 [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] boot 2024-09-21T07:09:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:12 smithi092 ceph-mon[30987]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T07:09:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:09:13.950 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:13 smithi169 ceph-mon[33705]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T07:09:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:13 smithi175 ceph-mon[34064]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T07:09:14.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:13 smithi092 ceph-mon[30987]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T07:09:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:14 smithi175 ceph-mon[34064]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:14 smithi175 ceph-mon[34064]: from='client.? 172.21.15.169:0/2549605342' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d002dc8-64fa-44f0-96aa-6161922b449f"} : dispatch 2024-09-21T07:09:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:14 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d002dc8-64fa-44f0-96aa-6161922b449f"} : dispatch 2024-09-21T07:09:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:14 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d002dc8-64fa-44f0-96aa-6161922b449f"}]': finished 2024-09-21T07:09:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:14 smithi175 ceph-mon[34064]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:09:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:14 smithi175 ceph-mon[34064]: from='client.? 172.21.15.169:0/721155070' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:09:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:14 smithi092 ceph-mon[30987]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:14 smithi092 ceph-mon[30987]: from='client.? 172.21.15.169:0/2549605342' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d002dc8-64fa-44f0-96aa-6161922b449f"} : dispatch 2024-09-21T07:09:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:14 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d002dc8-64fa-44f0-96aa-6161922b449f"} : dispatch 2024-09-21T07:09:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:14 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d002dc8-64fa-44f0-96aa-6161922b449f"}]': finished 2024-09-21T07:09:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:14 smithi092 ceph-mon[30987]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:09:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:14 smithi092 ceph-mon[30987]: from='client.? 172.21.15.169:0/721155070' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:09:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:14 smithi169 ceph-mon[33705]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:14 smithi169 ceph-mon[33705]: from='client.? 172.21.15.169:0/2549605342' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d002dc8-64fa-44f0-96aa-6161922b449f"} : dispatch 2024-09-21T07:09:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:14 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d002dc8-64fa-44f0-96aa-6161922b449f"} : dispatch 2024-09-21T07:09:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:14 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d002dc8-64fa-44f0-96aa-6161922b449f"}]': finished 2024-09-21T07:09:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:14 smithi169 ceph-mon[33705]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:09:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:14 smithi169 ceph-mon[33705]: from='client.? 172.21.15.169:0/721155070' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:09:17.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:16 smithi175 ceph-mon[34064]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:16 smithi092 ceph-mon[30987]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:16 smithi169 ceph-mon[33705]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:18.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:18 smithi169 ceph-mon[33705]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:19.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:18 smithi175 ceph-mon[34064]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:19.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:18 smithi092 ceph-mon[30987]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:20.918 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:20 smithi169 ceph-mon[33705]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:20 smithi175 ceph-mon[34064]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:20 smithi092 ceph-mon[30987]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:22.953 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:22 smithi169 ceph-mon[33705]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:22.954 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:09:22.954 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:23.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:22 smithi175 ceph-mon[34064]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:23.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:09:23.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:22 smithi092 ceph-mon[30987]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:09:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:23.708 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:23 smithi169 ceph-mon[33705]: Deploying daemon osd.10 on smithi169 2024-09-21T07:09:24.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:23 smithi175 ceph-mon[34064]: Deploying daemon osd.10 on smithi169 2024-09-21T07:09:24.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:23 smithi092 ceph-mon[30987]: Deploying daemon osd.10 on smithi169 2024-09-21T07:09:24.983 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:24 smithi169 ceph-mon[33705]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:24 smithi175 ceph-mon[34064]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:24 smithi092 ceph-mon[30987]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:26.979 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:26 smithi169 ceph-mon[33705]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:27.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:26 smithi175 ceph-mon[34064]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:27.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:26 smithi092 ceph-mon[30987]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:28.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:28 smithi169 ceph-mon[33705]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:28.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:28.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:28.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:28 smithi175 ceph-mon[34064]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:28 smithi092 ceph-mon[30987]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:29.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:29.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:30.870 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:30 smithi169 ceph-mon[33705]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:31.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:30 smithi175 ceph-mon[34064]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:30 smithi092 ceph-mon[30987]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:32.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.007+0000 7f2a4e7fc640 1 -- 172.21.15.169:0/471152374 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2a58063800 con 0x7f2a440b65e0 2024-09-21T07:09:32.011 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 10 on host 'smithi169' 2024-09-21T07:09:32.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/471152374 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2a440b65e0 msgr2=0x7f2a440b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:32.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2a440b65e0 0x7f2a440b8af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2a58106f30 tx=0x7f2a4800b410 comp rx=0 tx=0).stop 2024-09-21T07:09:32.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/471152374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a58103bb0 msgr2=0x7f2a5819a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:32.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a58103bb0 0x7f2a5819a370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400d950 tx=0x7f2a5400de10 comp rx=0 tx=0).stop 2024-09-21T07:09:32.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/471152374 shutdown_connections 2024-09-21T07:09:32.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2a440b65e0 0x7f2a440b8af0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:32.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a58109e40 0x7f2a5819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:32.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a581094f0 0x7f2a5819a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:32.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 --2- 172.21.15.169:0/471152374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a58103bb0 0x7f2a5819a370 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:32.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/471152374 >> 172.21.15.169:0/471152374 conn(0x7f2a580ff600 msgr2=0x7f2a58101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:32.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/471152374 shutdown_connections 2024-09-21T07:09:32.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-21T07:09:32.010+0000 7f2a5f9fc640 1 -- 172.21.15.169:0/471152374 wait complete. 2024-09-21T07:09:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:32 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:32 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:32 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:32 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:32 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:32 smithi175 ceph-mon[34064]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:32 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:32 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:32 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:32 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:32 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:32 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:32 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:32 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:32 smithi092 ceph-mon[30987]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:32.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:32 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:32.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:32 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:32 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:32 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:32 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:32 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:32 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:32.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:32 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:32 smithi169 ceph-mon[33705]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:32.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:32 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:32.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:32 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:32 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:32.715 DEBUG:teuthology.orchestra.run.smithi169:osd.10> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T07:09:32.717 INFO:tasks.cephadm:Deploying osd.11 on smithi175 with /dev/vg_nvme/lv_1... 2024-09-21T07:09:32.717 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:09:32.974 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:09:34.416 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:09:34 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:09:34.317+0000 7fc114a11640 -1 osd.10 0 log_to_monitors true 2024-09-21T07:09:34.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:34 smithi169 ceph-mon[33705]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:34.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:34 smithi169 ceph-mon[33705]: from='osd.10 [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:09:34.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:34 smithi169 ceph-mon[33705]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:09:35.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:34 smithi175 ceph-mon[34064]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:35.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:34 smithi175 ceph-mon[34064]: from='osd.10 [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:09:35.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:34 smithi175 ceph-mon[34064]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:09:35.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:34 smithi092 ceph-mon[30987]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:35.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:34 smithi092 ceph-mon[30987]: from='osd.10 [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:09:35.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:34 smithi092 ceph-mon[30987]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:09:35.547 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-21T07:09:35.573 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi175:vg_nvme/lv_1 2024-09-21T07:09:35.830 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:09:35.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:09:35.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='osd.10 [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:09:35.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T07:09:35.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:35.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:09:35.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:35.860 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:35.860 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:35.860 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:35.860 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:35.860 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:35.860 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:35.860 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:35.861 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:35.861 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:35.861 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:35 smithi175 ceph-mon[34064]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:09:35.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:09:35.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='osd.10 [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:09:35.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T07:09:35.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:35.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:09:35.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:35.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:35.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:35.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:35.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:35.895 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:35.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:35.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:35.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:35.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:35.896 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:35 smithi169 ceph-mon[33705]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:09:36.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:09:36.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='osd.10 [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:09:36.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T07:09:36.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:36.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]} : dispatch 2024-09-21T07:09:36.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:36.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:36.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:36.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:36.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:36.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:09:36.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:36.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:36.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:36.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:36.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:35 smithi092 ceph-mon[30987]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-21T07:09:36.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.325+0000 7fd3241cf640 1 -- 172.21.15.175:0/596037801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c108cf0 msgr2=0x7fd31c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.325+0000 7fd3241cf640 1 --2- 172.21.15.175:0/596037801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c108cf0 0x7fd31c10f520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009900 tx=0x7fd30c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.325+0000 7fd3241cf640 1 -- 172.21.15.175:0/596037801 shutdown_connections 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.325+0000 7fd3241cf640 1 --2- 172.21.15.175:0/596037801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c108cf0 0x7fd31c10f520 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.325+0000 7fd3241cf640 1 --2- 172.21.15.175:0/596037801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd31c1083a0 0x7fd31c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.325+0000 7fd3241cf640 1 --2- 172.21.15.175:0/596037801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd31c102a60 0x7fd31c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.325+0000 7fd3241cf640 1 -- 172.21.15.175:0/596037801 >> 172.21.15.175:0/596037801 conn(0x7fd31c079730 msgr2=0x7fd31c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.325+0000 7fd3241cf640 1 -- 172.21.15.175:0/596037801 shutdown_connections 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.325+0000 7fd3241cf640 1 -- 172.21.15.175:0/596037801 wait complete. 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd3241cf640 1 Processor -- start 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd3241cf640 1 -- start start 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd3241cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd31c102a60 0x7fd31c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd3241cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd31c1083a0 0x7fd31c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd3241cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c108cf0 0x7fd31c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd3241cf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c113930 con 0x7fd31c1083a0 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd3241cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c1137b0 con 0x7fd31c102a60 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd3241cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c113ab0 con 0x7fd31c108cf0 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd32276c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c108cf0 0x7fd31c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd32276c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c108cf0 0x7fd31c19fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59728/0 (socket says 172.21.15.175:59728) 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd32276c640 1 -- 172.21.15.175:0/4062399146 learned_addr learned my addr 172.21.15.175:0/4062399146 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.326+0000 7fd32176a640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd31c1083a0 0x7fd31c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd321f6b640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd31c102a60 0x7fd31c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd32276c640 1 -- 172.21.15.175:0/4062399146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd31c102a60 msgr2=0x7fd31c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd32276c640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd31c102a60 0x7fd31c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd32276c640 1 -- 172.21.15.175:0/4062399146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd31c1083a0 msgr2=0x7fd31c19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd32276c640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd31c1083a0 0x7fd31c19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd32276c640 1 -- 172.21.15.175:0/4062399146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c1a02f0 con 0x7fd31c108cf0 2024-09-21T07:09:36.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd321f6b640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd31c102a60 0x7fd31c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:36.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd32276c640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c108cf0 0x7fd31c19fc80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd30c005ab0 tx=0x7fd30c0040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:36.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd31affd640 1 -- 172.21.15.175:0/4062399146 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c03f030 con 0x7fd31c108cf0 2024-09-21T07:09:36.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd3241cf640 1 -- 172.21.15.175:0/4062399146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c1a0580 con 0x7fd31c108cf0 2024-09-21T07:09:36.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd31affd640 1 -- 172.21.15.175:0/4062399146 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd30c003a80 con 0x7fd31c108cf0 2024-09-21T07:09:36.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd31affd640 1 -- 172.21.15.175:0/4062399146 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c035070 con 0x7fd31c108cf0 2024-09-21T07:09:36.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.327+0000 7fd3241cf640 1 -- 172.21.15.175:0/4062399146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c1a0ab0 con 0x7fd31c108cf0 2024-09-21T07:09:36.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.328+0000 7fd3241cf640 1 -- 172.21.15.175:0/4062399146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31c102e70 con 0x7fd31c108cf0 2024-09-21T07:09:36.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.331+0000 7fd31affd640 1 -- 172.21.15.175:0/4062399146 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fd30c042030 con 0x7fd31c108cf0 2024-09-21T07:09:36.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.331+0000 7fd31affd640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3040ba9a0 0x7fd3040bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.331+0000 7fd31affd640 1 -- 172.21.15.175:0/4062399146 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6629+0+0 (secure 0 0 0) 0x7fd30c1076a0 con 0x7fd31c108cf0 2024-09-21T07:09:36.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.332+0000 7fd321f6b640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3040ba9a0 0x7fd3040bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.332+0000 7fd321f6b640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3040ba9a0 0x7fd3040bceb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd314005fd0 tx=0x7fd3140093e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:36.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.335+0000 7fd31affd640 1 -- 172.21.15.175:0/4062399146 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd31c1a0ab0 con 0x7fd31c108cf0 2024-09-21T07:09:36.393 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:09:36.075+0000 7fc110993640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T07:09:36.394 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:09:36.086+0000 7fc108789640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:09:36.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:36.528+0000 7fd3241cf640 1 -- 172.21.15.175:0/4062399146 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd31c063800 con 0x7fd3040ba9a0 2024-09-21T07:09:36.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:36.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi169 2024-09-21T07:09:36.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-21T07:09:36.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T07:09:36.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:36.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:36.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: from='osd.10 ' entity='osd.10' 2024-09-21T07:09:36.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:09:36.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:09:36.859 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:36.860 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:36.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:36.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi169 2024-09-21T07:09:36.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-21T07:09:36.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T07:09:36.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:36.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:36.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: from='osd.10 ' entity='osd.10' 2024-09-21T07:09:36.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:09:36.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:09:36.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:36.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:37.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:37.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi169 2024-09-21T07:09:37.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-21T07:09:37.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T07:09:37.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:37.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:37.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: from='osd.10 ' entity='osd.10' 2024-09-21T07:09:37.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:09:37.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:09:37.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:37.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:37.963 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:37 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:09:37.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:37 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:09:37.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:37 smithi175 ceph-mon[34064]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:37.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:37 smithi175 ceph-mon[34064]: osd.10 [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] boot 2024-09-21T07:09:37.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:37 smithi175 ceph-mon[34064]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:09:37.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:37 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:38.013 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:37 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:09:38.013 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:37 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:09:38.013 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:37 smithi092 ceph-mon[30987]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:38.014 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:37 smithi092 ceph-mon[30987]: osd.10 [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] boot 2024-09-21T07:09:38.014 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:37 smithi092 ceph-mon[30987]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:09:38.014 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:37 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:37 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:09:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:37 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:09:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:37 smithi169 ceph-mon[33705]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:38.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:37 smithi169 ceph-mon[33705]: osd.10 [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] boot 2024-09-21T07:09:38.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:37 smithi169 ceph-mon[33705]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:09:38.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:37 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:09:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:38 smithi175 ceph-mon[34064]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:38 smithi175 ceph-mon[34064]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T07:09:39.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:38 smithi092 ceph-mon[30987]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:39.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:38 smithi092 ceph-mon[30987]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T07:09:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:38 smithi169 ceph-mon[33705]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:09:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:38 smithi169 ceph-mon[33705]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T07:09:40.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:39 smithi175 ceph-mon[34064]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T07:09:40.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:39 smithi175 ceph-mon[34064]: from='client.? 172.21.15.175:0/772871227' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "825d45a4-6d88-45ce-ade4-5fd417f751d6"} : dispatch 2024-09-21T07:09:40.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:39 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "825d45a4-6d88-45ce-ade4-5fd417f751d6"} : dispatch 2024-09-21T07:09:40.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:39 smithi175 ceph-mon[34064]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "825d45a4-6d88-45ce-ade4-5fd417f751d6"}]': finished 2024-09-21T07:09:40.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:39 smithi175 ceph-mon[34064]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:09:40.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:39 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:09:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:39 smithi092 ceph-mon[30987]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T07:09:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:39 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/772871227' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "825d45a4-6d88-45ce-ade4-5fd417f751d6"} : dispatch 2024-09-21T07:09:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:39 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "825d45a4-6d88-45ce-ade4-5fd417f751d6"} : dispatch 2024-09-21T07:09:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:39 smithi092 ceph-mon[30987]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "825d45a4-6d88-45ce-ade4-5fd417f751d6"}]': finished 2024-09-21T07:09:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:39 smithi092 ceph-mon[30987]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:09:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:39 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:09:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:39 smithi169 ceph-mon[33705]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T07:09:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:39 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/772871227' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "825d45a4-6d88-45ce-ade4-5fd417f751d6"} : dispatch 2024-09-21T07:09:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:39 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "825d45a4-6d88-45ce-ade4-5fd417f751d6"} : dispatch 2024-09-21T07:09:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:39 smithi169 ceph-mon[33705]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "825d45a4-6d88-45ce-ade4-5fd417f751d6"}]': finished 2024-09-21T07:09:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:39 smithi169 ceph-mon[33705]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:09:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:39 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:09:41.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:40 smithi175 ceph-mon[34064]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:41.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:40 smithi175 ceph-mon[34064]: from='client.? 172.21.15.175:0/2830693405' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:09:41.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:40 smithi092 ceph-mon[30987]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:41.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:40 smithi092 ceph-mon[30987]: from='client.? 172.21.15.175:0/2830693405' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:09:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:40 smithi169 ceph-mon[33705]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:40 smithi169 ceph-mon[33705]: from='client.? 172.21.15.175:0/2830693405' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:09:43.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:42 smithi175 ceph-mon[34064]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-21T07:09:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:42 smithi092 ceph-mon[30987]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-21T07:09:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:42 smithi169 ceph-mon[33705]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-21T07:09:44.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:44 smithi175 ceph-mon[34064]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:09:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:44 smithi092 ceph-mon[30987]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:09:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:44 smithi169 ceph-mon[33705]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:09:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:46 smithi175 ceph-mon[34064]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T07:09:47.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:46 smithi092 ceph-mon[30987]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T07:09:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:46 smithi169 ceph-mon[33705]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T07:09:47.866 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:47 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:09:47.866 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:47 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:48.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:47 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:09:48.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:47 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:48.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:47 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:09:48.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:47 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:48.992 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:48 smithi175 ceph-mon[34064]: Deploying daemon osd.11 on smithi175 2024-09-21T07:09:48.992 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:48 smithi175 ceph-mon[34064]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T07:09:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:48 smithi092 ceph-mon[30987]: Deploying daemon osd.11 on smithi175 2024-09-21T07:09:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:48 smithi092 ceph-mon[30987]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T07:09:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:48 smithi169 ceph-mon[33705]: Deploying daemon osd.11 on smithi175 2024-09-21T07:09:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:48 smithi169 ceph-mon[33705]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T07:09:50.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:50 smithi175 ceph-mon[34064]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T07:09:51.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:50 smithi092 ceph-mon[30987]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T07:09:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:50 smithi169 ceph-mon[33705]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T07:09:52.874 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:52 smithi175 ceph-mon[34064]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:09:53.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:52 smithi092 ceph-mon[30987]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:09:53.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:52 smithi169 ceph-mon[33705]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:09:53.835 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:53 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:53.835 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:53 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:53.835 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:53 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:54.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:53 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:54.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:53 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:54.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:53 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:54.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:53 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:54.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:53 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:54.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:53 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:55.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:54 smithi175 ceph-mon[34064]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:55.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:54 smithi092 ceph-mon[30987]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:55.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:54 smithi169 ceph-mon[33705]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:56.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.734+0000 7fd31affd640 1 -- 172.21.15.175:0/4062399146 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd31c063800 con 0x7fd3040ba9a0 2024-09-21T07:09:56.736 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 11 on host 'smithi175' 2024-09-21T07:09:56.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.736+0000 7fd3241cf640 1 -- 172.21.15.175:0/4062399146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3040ba9a0 msgr2=0x7fd3040bceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:56.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.736+0000 7fd3241cf640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3040ba9a0 0x7fd3040bceb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd314005fd0 tx=0x7fd3140093e0 comp rx=0 tx=0).stop 2024-09-21T07:09:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.736+0000 7fd3241cf640 1 -- 172.21.15.175:0/4062399146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c108cf0 msgr2=0x7fd31c19fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.736+0000 7fd3241cf640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c108cf0 0x7fd31c19fc80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd30c005ab0 tx=0x7fd30c0040e0 comp rx=0 tx=0).stop 2024-09-21T07:09:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.736+0000 7fd3241cf640 1 -- 172.21.15.175:0/4062399146 shutdown_connections 2024-09-21T07:09:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.736+0000 7fd3241cf640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3040ba9a0 0x7fd3040bceb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.736+0000 7fd3241cf640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c108cf0 0x7fd31c19fc80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.736+0000 7fd3241cf640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd31c1083a0 0x7fd31c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.736+0000 7fd3241cf640 1 --2- 172.21.15.175:0/4062399146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd31c102a60 0x7fd31c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.737+0000 7fd3241cf640 1 -- 172.21.15.175:0/4062399146 >> 172.21.15.175:0/4062399146 conn(0x7fd31c079730 msgr2=0x7fd31c104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.737+0000 7fd3241cf640 1 -- 172.21.15.175:0/4062399146 shutdown_connections 2024-09-21T07:09:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:09:56.737+0000 7fd3241cf640 1 -- 172.21.15.175:0/4062399146 wait complete. 2024-09-21T07:09:56.946 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:56 smithi169 ceph-mon[33705]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:56.946 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:56.946 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:56.946 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:56.946 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:56.946 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:56 smithi175 ceph-mon[34064]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:56 smithi092 ceph-mon[30987]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:57.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.499 DEBUG:teuthology.orchestra.run.smithi175:osd.11> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T07:09:57.502 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T07:09:57.502 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:09:57.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:57 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:57.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:57 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:57 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.773 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:57.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:57 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:57.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:57 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:57 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.963 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:57 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:57.963 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:57 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:57.963 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:57 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.268+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3541818359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c58105220 msgr2=0x7f5c58105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.268+0000 7f5c5dc10640 1 --2- 172.21.15.92:0/3541818359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c58105220 0x7f5c58105630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009900 tx=0x7f5c4c02a410 comp rx=0 tx=0).stop 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.268+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3541818359 shutdown_connections 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.268+0000 7f5c5dc10640 1 --2- 172.21.15.92:0/3541818359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c58105b70 0x7f5c5810f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.268+0000 7f5c5dc10640 1 --2- 172.21.15.92:0/3541818359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c58105220 0x7f5c58105630 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.268+0000 7f5c5dc10640 1 --2- 172.21.15.92:0/3541818359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c58103210 0x7f5c58103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.268+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3541818359 >> 172.21.15.92:0/3541818359 conn(0x7f5c58079ec0 msgr2=0x7f5c5807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.268+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3541818359 shutdown_connections 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.268+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3541818359 wait complete. 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c5dc10640 1 Processor -- start 2024-09-21T07:09:58.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c5dc10640 1 -- start start 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c5dc10640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c58103210 0x7f5c5819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c5dc10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c58105220 0x7f5c5819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c5dc10640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c58105b70 0x7f5c5819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c5dc10640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5c58113a40 con 0x7f5c58105220 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c5dc10640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5c581138c0 con 0x7f5c58105b70 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c5dc10640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c58113bc0 con 0x7f5c58103210 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c56ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c58105220 0x7f5c5819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c56ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c58105220 0x7f5c5819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59556/0 (socket says 172.21.15.92:59556) 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c56ffd640 1 -- 172.21.15.92:0/3763305413 learned_addr learned my addr 172.21.15.92:0/3763305413 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c577fe640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c58103210 0x7f5c5819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.269+0000 7f5c57fff640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c58105b70 0x7f5c5819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c56ffd640 1 -- 172.21.15.92:0/3763305413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c58103210 msgr2=0x7f5c5819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c56ffd640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c58103210 0x7f5c5819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:58.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c56ffd640 1 -- 172.21.15.92:0/3763305413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c58105b70 msgr2=0x7f5c5819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c56ffd640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c58105b70 0x7f5c5819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c56ffd640 1 -- 172.21.15.92:0/3763305413 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c581a03c0 con 0x7f5c58105220 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c56ffd640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c58105220 0x7f5c5819a9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c005940 tx=0x7f5c4c005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c54ff9640 1 -- 172.21.15.92:0/3763305413 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c03f030 con 0x7f5c58105220 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c54ff9640 1 -- 172.21.15.92:0/3763305413 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c4c0043d0 con 0x7f5c58105220 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3763305413 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c581a0650 con 0x7f5c58105220 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c54ff9640 1 -- 172.21.15.92:0/3763305413 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c035070 con 0x7f5c58105220 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.270+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3763305413 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c581a6e10 con 0x7f5c58105220 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.271+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3763305413 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c58103f90 con 0x7f5c58105220 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.273+0000 7f5c54ff9640 1 -- 172.21.15.92:0/3763305413 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f5c4c042030 con 0x7f5c58105220 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.274+0000 7f5c54ff9640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5c400b6560 0x7f5c400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.274+0000 7f5c577fe640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5c400b6560 0x7f5c400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.274+0000 7f5c54ff9640 1 -- 172.21.15.92:0/3763305413 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7024+0+0 (secure 0 0 0) 0x7f5c4c107570 con 0x7f5c58105220 2024-09-21T07:09:58.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.274+0000 7f5c577fe640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5c400b6560 0x7f5c400b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5c48005fd0 tx=0x7f5c48009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:58.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.277+0000 7f5c54ff9640 1 -- 172.21.15.92:0/3763305413 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c4c0d26f0 con 0x7f5c58105220 2024-09-21T07:09:58.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.456+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3763305413 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5c5810ab10 con 0x7f5c58105220 2024-09-21T07:09:58.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.456+0000 7f5c54ff9640 1 -- 172.21.15.92:0/3763305413 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f5c4c0d7630 con 0x7f5c58105220 2024-09-21T07:09:58.458 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:09:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.459+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3763305413 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5c400b6560 msgr2=0x7f5c400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.459+0000 7f5c5dc10640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5c400b6560 0x7f5c400b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5c48005fd0 tx=0x7f5c48009500 comp rx=0 tx=0).stop 2024-09-21T07:09:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.459+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3763305413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c58105220 msgr2=0x7f5c5819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.459+0000 7f5c5dc10640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c58105220 0x7f5c5819a9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c005940 tx=0x7f5c4c005e10 comp rx=0 tx=0).stop 2024-09-21T07:09:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.460+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3763305413 shutdown_connections 2024-09-21T07:09:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.460+0000 7f5c5dc10640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5c400b6560 0x7f5c400b8a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.460+0000 7f5c5dc10640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c58105b70 0x7f5c5819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.460+0000 7f5c5dc10640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c58105220 0x7f5c5819a9f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.460+0000 7f5c5dc10640 1 --2- 172.21.15.92:0/3763305413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c58103210 0x7f5c5819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.460+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3763305413 >> 172.21.15.92:0/3763305413 conn(0x7f5c58079ec0 msgr2=0x7f5c58106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.460+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3763305413 shutdown_connections 2024-09-21T07:09:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:09:58.460+0000 7f5c5dc10640 1 -- 172.21.15.92:0/3763305413 wait complete. 2024-09-21T07:09:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:58 smithi092 ceph-mon[30987]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:58 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3763305413' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:09:58.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:58 smithi175 ceph-mon[34064]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:58.948 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:58 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3763305413' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:09:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:58 smithi169 ceph-mon[33705]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:09:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3763305413' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:09:59.215 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:09:59 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:09:59.172+0000 7f632c411640 -1 osd.11 0 log_to_monitors true 2024-09-21T07:09:59.283 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726902576,"num_in_osds":12,"osd_in_since":1726902579,"num_remapped_pgs":0} 2024-09-21T07:10:00.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:59 smithi175 ceph-mon[34064]: from='osd.11 [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:10:00.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:09:59 smithi175 ceph-mon[34064]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:10:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:59 smithi092 ceph-mon[30987]: from='osd.11 [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:10:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:09:59 smithi092 ceph-mon[30987]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:10:00.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:59 smithi169 ceph-mon[33705]: from='osd.11 [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:10:00.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:09:59 smithi169 ceph-mon[33705]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:10:00.284 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:10:00.557 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:00.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:10:00.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:10:00.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T07:10:00.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:00.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='osd.11 [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: overall HEALTH_OK 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:00.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:00.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:10:00.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:10:00.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T07:10:00.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:00.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='osd.11 [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:10:00.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:10:00.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: overall HEALTH_OK 2024-09-21T07:10:00.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:00.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:00.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:00.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:00.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:00.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:00.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:00.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:00.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:00.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:01.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:10:00.712+0000 7f6328393640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T07:10:01.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:10:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:10:00.726+0000 7f6324191640 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.075+0000 7fb998245640 1 -- 172.21.15.92:0/3418300596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb990103b60 msgr2=0x7fb990103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.075+0000 7fb998245640 1 --2- 172.21.15.92:0/3418300596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb990103b60 0x7fb990103f70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb988009900 tx=0x7fb98802a410 comp rx=0 tx=0).stop 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.076+0000 7fb998245640 1 -- 172.21.15.92:0/3418300596 shutdown_connections 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.076+0000 7fb998245640 1 --2- 172.21.15.92:0/3418300596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb990109df0 0x7fb990110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.076+0000 7fb998245640 1 --2- 172.21.15.92:0/3418300596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9901094a0 0x7fb9901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.076+0000 7fb998245640 1 --2- 172.21.15.92:0/3418300596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb990103b60 0x7fb990103f70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.076+0000 7fb998245640 1 -- 172.21.15.92:0/3418300596 >> 172.21.15.92:0/3418300596 conn(0x7fb99007b850 msgr2=0x7fb99007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.076+0000 7fb998245640 1 -- 172.21.15.92:0/3418300596 shutdown_connections 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.076+0000 7fb998245640 1 -- 172.21.15.92:0/3418300596 wait complete. 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.076+0000 7fb998245640 1 Processor -- start 2024-09-21T07:10:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.076+0000 7fb998245640 1 -- start start 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb998245640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb990103b60 0x7fb99019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb998245640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9901094a0 0x7fb99019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb998245640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb990109df0 0x7fb99019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb998245640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb990113960 con 0x7fb990103b60 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb998245640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb9901137e0 con 0x7fb990109df0 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb998245640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb990113ae0 con 0x7fb9901094a0 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb995fe1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb990103b60 0x7fb99019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb995fe1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb990103b60 0x7fb99019a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55888/0 (socket says 172.21.15.92:55888) 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb995fe1640 1 -- 172.21.15.92:0/1431130735 learned_addr learned my addr 172.21.15.92:0/1431130735 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb9957e0640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9901094a0 0x7fb99019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb9967e2640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb990109df0 0x7fb99019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb995fe1640 1 -- 172.21.15.92:0/1431130735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9901094a0 msgr2=0x7fb99019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb995fe1640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9901094a0 0x7fb99019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb995fe1640 1 -- 172.21.15.92:0/1431130735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb990109df0 msgr2=0x7fb99019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb995fe1640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb990109df0 0x7fb99019fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb995fe1640 1 -- 172.21.15.92:0/1431130735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9901a0320 con 0x7fb990103b60 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb9967e2640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb990109df0 0x7fb99019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb9957e0640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9901094a0 0x7fb99019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.077+0000 7fb995fe1640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb990103b60 0x7fb99019a3b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb988009230 tx=0x7fb988004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.078+0000 7fb986ffd640 1 -- 172.21.15.92:0/1431130735 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98803f030 con 0x7fb990103b60 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.078+0000 7fb986ffd640 1 -- 172.21.15.92:0/1431130735 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb988003a80 con 0x7fb990103b60 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.078+0000 7fb986ffd640 1 -- 172.21.15.92:0/1431130735 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988035070 con 0x7fb990103b60 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.078+0000 7fb998245640 1 -- 172.21.15.92:0/1431130735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9901a05b0 con 0x7fb990103b60 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.078+0000 7fb998245640 1 -- 172.21.15.92:0/1431130735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9901a6d70 con 0x7fb990103b60 2024-09-21T07:10:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.079+0000 7fb998245640 1 -- 172.21.15.92:0/1431130735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb990103f70 con 0x7fb990103b60 2024-09-21T07:10:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.080+0000 7fb986ffd640 1 -- 172.21.15.92:0/1431130735 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fb988042030 con 0x7fb990103b60 2024-09-21T07:10:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.081+0000 7fb986ffd640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb97c0b65e0 0x7fb97c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.081+0000 7fb9957e0640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb97c0b65e0 0x7fb97c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.081+0000 7fb986ffd640 1 -- 172.21.15.92:0/1431130735 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7062+0+0 (secure 0 0 0) 0x7fb988107940 con 0x7fb990103b60 2024-09-21T07:10:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.081+0000 7fb9957e0640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb97c0b65e0 0x7fb97c0b8af0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb990106530 tx=0x7fb98000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:01.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.084+0000 7fb986ffd640 1 -- 172.21.15.92:0/1431130735 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9880ce6b0 con 0x7fb990103b60 2024-09-21T07:10:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='osd.11 [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: overall HEALTH_OK 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:01.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:01.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:01.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.262+0000 7fb998245640 1 -- 172.21.15.92:0/1431130735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb99019b4e0 con 0x7fb990103b60 2024-09-21T07:10:01.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.263+0000 7fb986ffd640 1 -- 172.21.15.92:0/1431130735 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7fb99019b4e0 con 0x7fb990103b60 2024-09-21T07:10:01.265 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:01.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 -- 172.21.15.92:0/1431130735 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb97c0b65e0 msgr2=0x7fb97c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:01.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb97c0b65e0 0x7fb97c0b8af0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb990106530 tx=0x7fb98000a2d0 comp rx=0 tx=0).stop 2024-09-21T07:10:01.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 -- 172.21.15.92:0/1431130735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb990103b60 msgr2=0x7fb99019a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:01.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb990103b60 0x7fb99019a3b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb988009230 tx=0x7fb988004270 comp rx=0 tx=0).stop 2024-09-21T07:10:01.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 -- 172.21.15.92:0/1431130735 shutdown_connections 2024-09-21T07:10:01.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb97c0b65e0 0x7fb97c0b8af0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:01.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb990109df0 0x7fb99019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:01.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9901094a0 0x7fb99019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:01.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 --2- 172.21.15.92:0/1431130735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb990103b60 0x7fb99019a3b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:01.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 -- 172.21.15.92:0/1431130735 >> 172.21.15.92:0/1431130735 conn(0x7fb99007b850 msgr2=0x7fb9901075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:01.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 -- 172.21.15.92:0/1431130735 shutdown_connections 2024-09-21T07:10:01.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:01.265+0000 7fb998245640 1 -- 172.21.15.92:0/1431130735 wait complete. 2024-09-21T07:10:01.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:01 smithi169 ceph-mon[33705]: Detected new or changed devices on smithi175 2024-09-21T07:10:01.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:01 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-21T07:10:01.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:01 smithi169 ceph-mon[33705]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:10:01.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:01 smithi169 ceph-mon[33705]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T07:10:01.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:01 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:01.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:01 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:01.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:01 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1431130735' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:10:01.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:01 smithi169 ceph-mon[33705]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:10:01.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:01 smithi092 ceph-mon[30987]: Detected new or changed devices on smithi175 2024-09-21T07:10:01.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:01 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-21T07:10:01.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:01 smithi092 ceph-mon[30987]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:10:01.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:01 smithi092 ceph-mon[30987]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T07:10:01.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:01 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:01.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:01 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:01.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:01 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1431130735' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:10:01.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:01 smithi092 ceph-mon[30987]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:10:01.991 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726902576,"num_in_osds":12,"osd_in_since":1726902579,"num_remapped_pgs":0} 2024-09-21T07:10:02.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:01 smithi175 ceph-mon[34064]: Detected new or changed devices on smithi175 2024-09-21T07:10:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:01 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-21T07:10:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:01 smithi175 ceph-mon[34064]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-21T07:10:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:01 smithi175 ceph-mon[34064]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T07:10:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:01 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:01 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:01 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1431130735' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:10:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:01 smithi175 ceph-mon[34064]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:10:02.993 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:10:03.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:02 smithi175 ceph-mon[34064]: purged_snaps scrub starts 2024-09-21T07:10:03.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:02 smithi175 ceph-mon[34064]: purged_snaps scrub ok 2024-09-21T07:10:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:02 smithi175 ceph-mon[34064]: osd.11 [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] boot 2024-09-21T07:10:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:02 smithi175 ceph-mon[34064]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:10:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:03.022 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:02 smithi092 ceph-mon[30987]: purged_snaps scrub starts 2024-09-21T07:10:03.022 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:02 smithi092 ceph-mon[30987]: purged_snaps scrub ok 2024-09-21T07:10:03.022 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:02 smithi092 ceph-mon[30987]: osd.11 [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] boot 2024-09-21T07:10:03.022 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:02 smithi092 ceph-mon[30987]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:10:03.022 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:02 smithi169 ceph-mon[33705]: purged_snaps scrub starts 2024-09-21T07:10:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:02 smithi169 ceph-mon[33705]: purged_snaps scrub ok 2024-09-21T07:10:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:02 smithi169 ceph-mon[33705]: osd.11 [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] boot 2024-09-21T07:10:03.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:02 smithi169 ceph-mon[33705]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:10:03.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:10:03.275 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:03.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.761+0000 7fdcae650640 1 -- 172.21.15.92:0/3237609831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca8102a60 msgr2=0x7fdca8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:03.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.761+0000 7fdcae650640 1 --2- 172.21.15.92:0/3237609831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca8102a60 0x7fdca8102e70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009900 tx=0x7fdc9802a410 comp rx=0 tx=0).stop 2024-09-21T07:10:03.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.761+0000 7fdcae650640 1 -- 172.21.15.92:0/3237609831 shutdown_connections 2024-09-21T07:10:03.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.761+0000 7fdcae650640 1 --2- 172.21.15.92:0/3237609831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdca8108cf0 0x7fdca810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:03.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.761+0000 7fdcae650640 1 --2- 172.21.15.92:0/3237609831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca81083a0 0x7fdca81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:03.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.761+0000 7fdcae650640 1 --2- 172.21.15.92:0/3237609831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca8102a60 0x7fdca8102e70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.761+0000 7fdcae650640 1 -- 172.21.15.92:0/3237609831 >> 172.21.15.92:0/3237609831 conn(0x7fdca8079730 msgr2=0x7fdca8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.762+0000 7fdcae650640 1 -- 172.21.15.92:0/3237609831 shutdown_connections 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.762+0000 7fdcae650640 1 -- 172.21.15.92:0/3237609831 wait complete. 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.762+0000 7fdcae650640 1 Processor -- start 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.762+0000 7fdcae650640 1 -- start start 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.762+0000 7fdcae650640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca8102a60 0x7fdca819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.762+0000 7fdcae650640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81083a0 0x7fdca819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.762+0000 7fdcae650640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdca8108cf0 0x7fdca819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdcae650640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8112810 con 0x7fdca81083a0 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdcae650640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8112690 con 0x7fdca8108cf0 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdcae650640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8112990 con 0x7fdca8102a60 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdc9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81083a0 0x7fdca819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdc9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81083a0 0x7fdca819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55912/0 (socket says 172.21.15.92:55912) 2024-09-21T07:10:03.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdc9ffff640 1 -- 172.21.15.92:0/965765274 learned_addr learned my addr 172.21.15.92:0/965765274 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:03.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdcacbed640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdca8108cf0 0x7fdca819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:03.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdca7fff640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca8102a60 0x7fdca819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:03.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdc9ffff640 1 -- 172.21.15.92:0/965765274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca8102a60 msgr2=0x7fdca819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:03.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdc9ffff640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca8102a60 0x7fdca819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:03.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdc9ffff640 1 -- 172.21.15.92:0/965765274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdca8108cf0 msgr2=0x7fdca819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:03.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdc9ffff640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdca8108cf0 0x7fdca819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:03.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdc9ffff640 1 -- 172.21.15.92:0/965765274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca81a0220 con 0x7fdca81083a0 2024-09-21T07:10:03.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdc9ffff640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81083a0 0x7fdca819a910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000d770 tx=0x7fdc9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:03.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdca5ffb640 1 -- 172.21.15.92:0/965765274 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90017070 con 0x7fdca81083a0 2024-09-21T07:10:03.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdcae650640 1 -- 172.21.15.92:0/965765274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca81a0510 con 0x7fdca81083a0 2024-09-21T07:10:03.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdca5ffb640 1 -- 172.21.15.92:0/965765274 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc90009c30 con 0x7fdca81083a0 2024-09-21T07:10:03.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdcae650640 1 -- 172.21.15.92:0/965765274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca81a6d30 con 0x7fdca81083a0 2024-09-21T07:10:03.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.763+0000 7fdca5ffb640 1 -- 172.21.15.92:0/965765274 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9000f620 con 0x7fdca81083a0 2024-09-21T07:10:03.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.765+0000 7fdcae650640 1 -- 172.21.15.92:0/965765274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca8102e70 con 0x7fdca81083a0 2024-09-21T07:10:03.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.766+0000 7fdca5ffb640 1 -- 172.21.15.92:0/965765274 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fdc9001a070 con 0x7fdca81083a0 2024-09-21T07:10:03.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.767+0000 7fdca5ffb640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdc940b6610 0x7fdc940b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:03.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.767+0000 7fdca7fff640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdc940b6610 0x7fdc940b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:03.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.767+0000 7fdca5ffb640 1 -- 172.21.15.92:0/965765274 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fdc900e6940 con 0x7fdca81083a0 2024-09-21T07:10:03.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.767+0000 7fdca7fff640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdc940b6610 0x7fdc940b8b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdc980057c0 tx=0x7fdc980058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:03.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.770+0000 7fdca5ffb640 1 -- 172.21.15.92:0/965765274 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc90009de0 con 0x7fdca81083a0 2024-09-21T07:10:03.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.950+0000 7fdcae650640 1 -- 172.21.15.92:0/965765274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdca819b4a0 con 0x7fdca81083a0 2024-09-21T07:10:03.952 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:03 smithi092 ceph-mon[30987]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:10:03.952 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:03 smithi092 ceph-mon[30987]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:03.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.950+0000 7fdca5ffb640 1 -- 172.21.15.92:0/965765274 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fdc900b1a00 con 0x7fdca81083a0 2024-09-21T07:10:03.953 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:03.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 -- 172.21.15.92:0/965765274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdc940b6610 msgr2=0x7fdc940b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:03.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdc940b6610 0x7fdc940b8b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdc980057c0 tx=0x7fdc980058d0 comp rx=0 tx=0).stop 2024-09-21T07:10:03.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 -- 172.21.15.92:0/965765274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81083a0 msgr2=0x7fdca819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:03.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81083a0 0x7fdca819a910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000d770 tx=0x7fdc9000dc30 comp rx=0 tx=0).stop 2024-09-21T07:10:03.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 -- 172.21.15.92:0/965765274 shutdown_connections 2024-09-21T07:10:03.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdc940b6610 0x7fdc940b8b20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:03.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdca8108cf0 0x7fdca819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:03.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81083a0 0x7fdca819a910 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:03.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 --2- 172.21.15.92:0/965765274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca8102a60 0x7fdca819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:03.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 -- 172.21.15.92:0/965765274 >> 172.21.15.92:0/965765274 conn(0x7fdca8079730 msgr2=0x7fdca8101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:03.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 -- 172.21.15.92:0/965765274 shutdown_connections 2024-09-21T07:10:03.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:03.953+0000 7fdcae650640 1 -- 172.21.15.92:0/965765274 wait complete. 2024-09-21T07:10:04.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:03 smithi175 ceph-mon[34064]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:10:04.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:03 smithi175 ceph-mon[34064]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:03 smithi169 ceph-mon[33705]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:10:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:03 smithi169 ceph-mon[33705]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:04.693 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1726902601,"num_in_osds":12,"osd_in_since":1726902579,"num_remapped_pgs":0} 2024-09-21T07:10:04.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:10:04.979 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:05.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:04 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/965765274' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:10:05.100 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:04 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/965765274' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:10:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:04 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/965765274' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:10:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.478+0000 7f8201430640 1 -- 172.21.15.92:0/2054362127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc109df0 msgr2=0x7f81fc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.478+0000 7f8201430640 1 --2- 172.21.15.92:0/2054362127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc109df0 0x7f81fc110620 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009ca0 tx=0x7f81f402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:10:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.478+0000 7f8201430640 1 -- 172.21.15.92:0/2054362127 shutdown_connections 2024-09-21T07:10:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.478+0000 7f8201430640 1 --2- 172.21.15.92:0/2054362127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc109df0 0x7f81fc110620 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.478+0000 7f8201430640 1 --2- 172.21.15.92:0/2054362127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81fc1094a0 0x7f81fc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:05.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.478+0000 7f8201430640 1 --2- 172.21.15.92:0/2054362127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81fc103b60 0x7f81fc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.478+0000 7f8201430640 1 -- 172.21.15.92:0/2054362127 >> 172.21.15.92:0/2054362127 conn(0x7f81fc07b850 msgr2=0x7f81fc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.478+0000 7f8201430640 1 -- 172.21.15.92:0/2054362127 shutdown_connections 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.478+0000 7f8201430640 1 -- 172.21.15.92:0/2054362127 wait complete. 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f8201430640 1 Processor -- start 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f8201430640 1 -- start start 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f8201430640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc103b60 0x7f81fc19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f8201430640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81fc1094a0 0x7f81fc19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f8201430640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81fc109df0 0x7f81fc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f8201430640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1139b0 con 0x7f81fc103b60 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f8201430640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc113830 con 0x7f81fc109df0 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f8201430640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc113b30 con 0x7f81fc1094a0 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f81faffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc103b60 0x7f81fc19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f81faffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc103b60 0x7f81fc19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55936/0 (socket says 172.21.15.92:55936) 2024-09-21T07:10:05.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.479+0000 7f81faffd640 1 -- 172.21.15.92:0/737610904 learned_addr learned my addr 172.21.15.92:0/737610904 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81fb7fe640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81fc109df0 0x7f81fc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81fa7fc640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81fc1094a0 0x7f81fc19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81faffd640 1 -- 172.21.15.92:0/737610904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81fc1094a0 msgr2=0x7f81fc19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81faffd640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81fc1094a0 0x7f81fc19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81faffd640 1 -- 172.21.15.92:0/737610904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81fc109df0 msgr2=0x7f81fc19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81faffd640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81fc109df0 0x7f81fc19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81faffd640 1 -- 172.21.15.92:0/737610904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc1a0370 con 0x7f81fc103b60 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81fb7fe640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81fc109df0 0x7f81fc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81fa7fc640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81fc1094a0 0x7f81fc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81faffd640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc103b60 0x7f81fc19a4c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00d770 tx=0x7f81ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81e3fff640 1 -- 172.21.15.92:0/737610904 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec017070 con 0x7f81fc103b60 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81e3fff640 1 -- 172.21.15.92:0/737610904 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81ec0054b0 con 0x7f81fc103b60 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f8201430640 1 -- 172.21.15.92:0/737610904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc1a0660 con 0x7f81fc103b60 2024-09-21T07:10:05.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f81e3fff640 1 -- 172.21.15.92:0/737610904 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec004c60 con 0x7f81fc103b60 2024-09-21T07:10:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.480+0000 7f8201430640 1 -- 172.21.15.92:0/737610904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc1a6e80 con 0x7f81fc103b60 2024-09-21T07:10:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.481+0000 7f8201430640 1 -- 172.21.15.92:0/737610904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81fc104de0 con 0x7f81fc103b60 2024-09-21T07:10:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.484+0000 7f81e3fff640 1 -- 172.21.15.92:0/737610904 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f81ec004e00 con 0x7f81fc103b60 2024-09-21T07:10:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.484+0000 7f81e3fff640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f81e40b6590 0x7f81e40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.485+0000 7f81fa7fc640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f81e40b6590 0x7f81e40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.485+0000 7f81e3fff640 1 -- 172.21.15.92:0/737610904 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f81ec0e6ea0 con 0x7f81fc103b60 2024-09-21T07:10:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.485+0000 7f81fa7fc640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f81e40b6590 0x7f81e40b8aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f81fc1071a0 tx=0x7f81f0005d20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:05.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.488+0000 7f81e3fff640 1 -- 172.21.15.92:0/737610904 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81ec0adb00 con 0x7f81fc103b60 2024-09-21T07:10:05.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.669+0000 7f8201430640 1 -- 172.21.15.92:0/737610904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81fc10bbe0 con 0x7f81fc103b60 2024-09-21T07:10:05.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.669+0000 7f81e3fff640 1 -- 172.21.15.92:0/737610904 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+18814 (secure 0 0 0) 0x7f81ec0b1ee0 con 0x7f81fc103b60 2024-09-21T07:10:05.671 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:05.672 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":71,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:10:02.718315+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:05.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 -- 172.21.15.92:0/737610904 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f81e40b6590 msgr2=0x7f81e40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:05.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f81e40b6590 0x7f81e40b8aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f81fc1071a0 tx=0x7f81f0005d20 comp rx=0 tx=0).stop 2024-09-21T07:10:05.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 -- 172.21.15.92:0/737610904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc103b60 msgr2=0x7f81fc19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:05.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc103b60 0x7f81fc19a4c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00d770 tx=0x7f81ec00dc30 comp rx=0 tx=0).stop 2024-09-21T07:10:05.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 -- 172.21.15.92:0/737610904 shutdown_connections 2024-09-21T07:10:05.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f81e40b6590 0x7f81e40b8aa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:05.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81fc109df0 0x7f81fc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:05.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81fc1094a0 0x7f81fc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:05.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 --2- 172.21.15.92:0/737610904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81fc103b60 0x7f81fc19a4c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:05.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 -- 172.21.15.92:0/737610904 >> 172.21.15.92:0/737610904 conn(0x7f81fc07b850 msgr2=0x7f81fc105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:05.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 -- 172.21.15.92:0/737610904 shutdown_connections 2024-09-21T07:10:05.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:05.672+0000 7f8201430640 1 -- 172.21.15.92:0/737610904 wait complete. 2024-09-21T07:10:05.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:05 smithi092 ceph-mon[30987]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:05.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:05 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/737610904' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:10:06.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:05 smithi175 ceph-mon[34064]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:06.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:05 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/737610904' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:10:06.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:05 smithi169 ceph-mon[33705]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:06.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:05 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/737610904' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:10:06.433 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:06:11.822418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:10:06.434 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T07:10:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:07.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 -- 172.21.15.92:0/1749838650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc58102f50 msgr2=0x7efc5810fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:07.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 --2- 172.21.15.92:0/1749838650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc58102f50 0x7efc5810fc70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009900 tx=0x7efc4c02a480 comp rx=0 tx=0).stop 2024-09-21T07:10:07.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 -- 172.21.15.92:0/1749838650 shutdown_connections 2024-09-21T07:10:07.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 --2- 172.21.15.92:0/1749838650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc581101b0 0x7efc581125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:07.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 --2- 172.21.15.92:0/1749838650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc58102f50 0x7efc5810fc70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:07.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 --2- 172.21.15.92:0/1749838650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc58102600 0x7efc58102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 -- 172.21.15.92:0/1749838650 >> 172.21.15.92:0/1749838650 conn(0x7efc58079750 msgr2=0x7efc58079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 -- 172.21.15.92:0/1749838650 shutdown_connections 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 -- 172.21.15.92:0/1749838650 wait complete. 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 Processor -- start 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.166+0000 7efc5f44c640 1 -- start start 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5f44c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc58102600 0x7efc5819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5f44c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc58102f50 0x7efc5819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5f44c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc581101b0 0x7efc581a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5f44c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc58115b50 con 0x7efc58102f50 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5f44c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efc581159d0 con 0x7efc581101b0 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5f44c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc58115cd0 con 0x7efc58102600 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5c9e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc58102f50 0x7efc5819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5c9e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc58102f50 0x7efc5819cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55948/0 (socket says 172.21.15.92:55948) 2024-09-21T07:10:07.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5c9e7640 1 -- 172.21.15.92:0/2886427349 learned_addr learned my addr 172.21.15.92:0/2886427349 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5d1e8640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc58102600 0x7efc5819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5d9e9640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc581101b0 0x7efc581a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5c9e7640 1 -- 172.21.15.92:0/2886427349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc58102600 msgr2=0x7efc5819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5c9e7640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc58102600 0x7efc5819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5c9e7640 1 -- 172.21.15.92:0/2886427349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc581101b0 msgr2=0x7efc581a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5c9e7640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc581101b0 0x7efc581a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5c9e7640 1 -- 172.21.15.92:0/2886427349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc581a25d0 con 0x7efc58102f50 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5c9e7640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc58102f50 0x7efc5819cc00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009230 tx=0x7efc4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc567fc640 1 -- 172.21.15.92:0/2886427349 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c03f030 con 0x7efc58102f50 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc567fc640 1 -- 172.21.15.92:0/2886427349 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc4c003a80 con 0x7efc58102f50 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5f44c640 1 -- 172.21.15.92:0/2886427349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc581a2860 con 0x7efc58102f50 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc567fc640 1 -- 172.21.15.92:0/2886427349 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c035070 con 0x7efc58102f50 2024-09-21T07:10:07.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.167+0000 7efc5f44c640 1 -- 172.21.15.92:0/2886427349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc581a9020 con 0x7efc58102f50 2024-09-21T07:10:07.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.169+0000 7efc5f44c640 1 -- 172.21.15.92:0/2886427349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5806c220 con 0x7efc58102f50 2024-09-21T07:10:07.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.170+0000 7efc567fc640 1 -- 172.21.15.92:0/2886427349 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7efc4c042030 con 0x7efc58102f50 2024-09-21T07:10:07.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.171+0000 7efc567fc640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efc400b6560 0x7efc400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:07.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.171+0000 7efc5d1e8640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efc400b6560 0x7efc400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:07.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.171+0000 7efc567fc640 1 -- 172.21.15.92:0/2886427349 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7efc4c107b20 con 0x7efc58102f50 2024-09-21T07:10:07.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.171+0000 7efc5d1e8640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efc400b6560 0x7efc400b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efc48005fd0 tx=0x7efc4800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:07.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.174+0000 7efc567fc640 1 -- 172.21.15.92:0/2886427349 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc4c107e20 con 0x7efc58102f50 2024-09-21T07:10:07.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.352+0000 7efc5f44c640 1 -- 172.21.15.92:0/2886427349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efc5810b340 con 0x7efc58102f50 2024-09-21T07:10:07.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.353+0000 7efc567fc640 1 -- 172.21.15.92:0/2886427349 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7efc4c0ce780 con 0x7efc58102f50 2024-09-21T07:10:07.355 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 -- 172.21.15.92:0/2886427349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efc400b6560 msgr2=0x7efc400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efc400b6560 0x7efc400b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efc48005fd0 tx=0x7efc4800b390 comp rx=0 tx=0).stop 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 -- 172.21.15.92:0/2886427349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc58102f50 msgr2=0x7efc5819cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc58102f50 0x7efc5819cc00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009230 tx=0x7efc4c004270 comp rx=0 tx=0).stop 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 -- 172.21.15.92:0/2886427349 shutdown_connections 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efc400b6560 0x7efc400b8a70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc581101b0 0x7efc581a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc58102f50 0x7efc5819cc00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 --2- 172.21.15.92:0/2886427349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc58102600 0x7efc5819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 -- 172.21.15.92:0/2886427349 >> 172.21.15.92:0/2886427349 conn(0x7efc58079750 msgr2=0x7efc58111760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 -- 172.21.15.92:0/2886427349 shutdown_connections 2024-09-21T07:10:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:07.355+0000 7efc5f44c640 1 -- 172.21.15.92:0/2886427349 wait complete. 2024-09-21T07:10:07.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:07 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2886427349' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:10:07.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:07 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2886427349' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:10:07.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:07 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2886427349' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:10:08.155 INFO:tasks.cephadm:Adding mds.a on smithi092 2024-09-21T07:10:08.155 INFO:tasks.cephadm:Adding mds.d on smithi092 2024-09-21T07:10:08.156 INFO:tasks.cephadm:Adding mds.g on smithi092 2024-09-21T07:10:08.156 INFO:tasks.cephadm:Adding mds.j on smithi092 2024-09-21T07:10:08.156 INFO:tasks.cephadm:Adding mds.b on smithi169 2024-09-21T07:10:08.156 INFO:tasks.cephadm:Adding mds.e on smithi169 2024-09-21T07:10:08.156 INFO:tasks.cephadm:Adding mds.h on smithi169 2024-09-21T07:10:08.156 INFO:tasks.cephadm:Adding mds.k on smithi169 2024-09-21T07:10:08.156 INFO:tasks.cephadm:Adding mds.c on smithi175 2024-09-21T07:10:08.156 INFO:tasks.cephadm:Adding mds.f on smithi175 2024-09-21T07:10:08.156 INFO:tasks.cephadm:Adding mds.i on smithi175 2024-09-21T07:10:08.156 INFO:tasks.cephadm:Adding mds.l on smithi175 2024-09-21T07:10:08.156 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l' 2024-09-21T07:10:08.426 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:10:08.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:08 smithi175 ceph-mon[34064]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:08.707 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:08 smithi169 ceph-mon[33705]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:08.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:08 smithi092 ceph-mon[30987]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:08.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.917+0000 7f789f6ff640 1 -- 172.21.15.175:0/769910641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7898103c30 msgr2=0x7f7898104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:08.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.917+0000 7f789f6ff640 1 --2- 172.21.15.175:0/769910641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7898103c30 0x7f7898104040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7888009ca0 tx=0x7f788802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.917+0000 7f789f6ff640 1 -- 172.21.15.175:0/769910641 shutdown_connections 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.917+0000 7f789f6ff640 1 --2- 172.21.15.175:0/769910641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7898109ec0 0x7f78981106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.917+0000 7f789f6ff640 1 --2- 172.21.15.175:0/769910641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7898109570 0x7f7898109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.917+0000 7f789f6ff640 1 --2- 172.21.15.175:0/769910641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7898103c30 0x7f7898104040 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.917+0000 7f789f6ff640 1 -- 172.21.15.175:0/769910641 >> 172.21.15.175:0/769910641 conn(0x7f789807b8d0 msgr2=0x7f789807bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.917+0000 7f789f6ff640 1 -- 172.21.15.175:0/769910641 shutdown_connections 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.917+0000 7f789f6ff640 1 -- 172.21.15.175:0/769910641 wait complete. 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789f6ff640 1 Processor -- start 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789f6ff640 1 -- start start 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789f6ff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7898103c30 0x7f789819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789f6ff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7898109570 0x7f789819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:08.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789f6ff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7898109ec0 0x7f789819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789f6ff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f78981139e0 con 0x7f7898109570 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789f6ff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7898113860 con 0x7f7898103c30 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789f6ff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7898113b60 con 0x7f7898109ec0 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789dc9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7898109ec0 0x7f789819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789dc9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7898109ec0 0x7f789819fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40438/0 (socket says 172.21.15.175:40438) 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789dc9c640 1 -- 172.21.15.175:0/903140635 learned_addr learned my addr 172.21.15.175:0/903140635 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.918+0000 7f789d49b640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7898103c30 0x7f789819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f789cc9a640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7898109570 0x7f789819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f789dc9c640 1 -- 172.21.15.175:0/903140635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7898103c30 msgr2=0x7f789819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f789dc9c640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7898103c30 0x7f789819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:08.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f789dc9c640 1 -- 172.21.15.175:0/903140635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7898109570 msgr2=0x7f789819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f789dc9c640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7898109570 0x7f789819a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f789dc9c640 1 -- 172.21.15.175:0/903140635 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78981a0320 con 0x7f7898109ec0 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f789dc9c640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7898109ec0 0x7f789819fbf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f789000d750 tx=0x7f789000dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f78967fc640 1 -- 172.21.15.175:0/903140635 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7890017070 con 0x7f7898109ec0 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f78967fc640 1 -- 172.21.15.175:0/903140635 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78900054b0 con 0x7f7898109ec0 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f789f6ff640 1 -- 172.21.15.175:0/903140635 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78981a0610 con 0x7f7898109ec0 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f78967fc640 1 -- 172.21.15.175:0/903140635 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7890004b90 con 0x7f7898109ec0 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.919+0000 7f789f6ff640 1 -- 172.21.15.175:0/903140635 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78981a6d70 con 0x7f7898109ec0 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.920+0000 7f789f6ff640 1 -- 172.21.15.175:0/903140635 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7898104040 con 0x7f7898109ec0 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.922+0000 7f78967fc640 1 -- 172.21.15.175:0/903140635 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f7890004d30 con 0x7f7898109ec0 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.922+0000 7f78967fc640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78800b65e0 0x7f78800b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.922+0000 7f78967fc640 1 -- 172.21.15.175:0/903140635 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f78900e6cf0 con 0x7f7898109ec0 2024-09-21T07:10:08.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.923+0000 7f789d49b640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78800b65e0 0x7f78800b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:08.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.923+0000 7f789d49b640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78800b65e0 0x7f78800b8af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7888000f80 tx=0x7f7888031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:08.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:08.926+0000 7f78967fc640 1 -- 172.21.15.175:0/903140635 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78900ad9d0 con 0x7f7898109ec0 2024-09-21T07:10:09.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.111+0000 7f789f6ff640 1 -- 172.21.15.175:0/903140635 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}) -- 0x7f7898063800 con 0x7f78800b65e0 2024-09-21T07:10:09.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.120+0000 7f78967fc640 1 -- 172.21.15.175:0/903140635 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f7898063800 con 0x7f78800b65e0 2024-09-21T07:10:09.122 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mds.all update... 2024-09-21T07:10:09.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 -- 172.21.15.175:0/903140635 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78800b65e0 msgr2=0x7f78800b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:09.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78800b65e0 0x7f78800b8af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7888000f80 tx=0x7f7888031000 comp rx=0 tx=0).stop 2024-09-21T07:10:09.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 -- 172.21.15.175:0/903140635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7898109ec0 msgr2=0x7f789819fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:09.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7898109ec0 0x7f789819fbf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f789000d750 tx=0x7f789000dc10 comp rx=0 tx=0).stop 2024-09-21T07:10:09.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 -- 172.21.15.175:0/903140635 shutdown_connections 2024-09-21T07:10:09.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f78800b65e0 0x7f78800b8af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:09.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7898109ec0 0x7f789819fbf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:09.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7898109570 0x7f789819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:09.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 --2- 172.21.15.175:0/903140635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7898103c30 0x7f789819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:09.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 -- 172.21.15.175:0/903140635 >> 172.21.15.175:0/903140635 conn(0x7f789807b8d0 msgr2=0x7f7898107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:09.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 -- 172.21.15.175:0/903140635 shutdown_connections 2024-09-21T07:10:09.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-21T07:10:09.122+0000 7f789f6ff640 1 -- 172.21.15.175:0/903140635 wait complete. 2024-09-21T07:10:09.836 DEBUG:teuthology.orchestra.run.smithi092:mds.a> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T07:10:09.839 DEBUG:teuthology.orchestra.run.smithi092:mds.d> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T07:10:09.881 DEBUG:teuthology.orchestra.run.smithi092:mds.g> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T07:10:09.924 DEBUG:teuthology.orchestra.run.smithi092:mds.j> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T07:10:09.967 DEBUG:teuthology.orchestra.run.smithi169:mds.b> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T07:10:09.970 DEBUG:teuthology.orchestra.run.smithi169:mds.e> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T07:10:10.012 DEBUG:teuthology.orchestra.run.smithi169:mds.h> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T07:10:10.055 DEBUG:teuthology.orchestra.run.smithi169:mds.k> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T07:10:10.098 DEBUG:teuthology.orchestra.run.smithi175:mds.c> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T07:10:10.101 DEBUG:teuthology.orchestra.run.smithi175:mds.f> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T07:10:10.146 DEBUG:teuthology.orchestra.run.smithi175:mds.i> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T07:10:10.188 DEBUG:teuthology.orchestra.run.smithi175:mds.l> sudo journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T07:10:10.231 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T07:10:10.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:10:10.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: from='client.24577 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:10:10.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-21T07:10:10.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:10.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:10.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:10.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:10.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:10.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:10.395 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:10.395 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:10.395 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: Deploying daemon mds.l on smithi175 2024-09-21T07:10:10.395 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:10 smithi169 ceph-mon[33705]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:10.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: from='client.24577 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:10:10.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-21T07:10:10.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:10.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:10.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:10.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:10.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:10.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:10.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:10.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:10.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: Deploying daemon mds.l on smithi175 2024-09-21T07:10:10.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:10 smithi092 ceph-mon[30987]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:10.479 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:10.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: from='client.24577 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:10:10.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-21T07:10:10.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:10.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:10.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:10.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:10.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:10.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:10.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:10.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:10.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: Deploying daemon mds.l on smithi175 2024-09-21T07:10:10.519 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:10 smithi175 ceph-mon[34064]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:10.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.956+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2648428096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c98102a60 msgr2=0x7f8c98102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.956+0000 7f8c9e6f5640 1 --2- 172.21.15.92:0/2648428096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c98102a60 0x7f8c98102e70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c88009900 tx=0x7f8c8802a410 comp rx=0 tx=0).stop 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.956+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2648428096 shutdown_connections 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.956+0000 7f8c9e6f5640 1 --2- 172.21.15.92:0/2648428096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c98108cf0 0x7f8c9810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.956+0000 7f8c9e6f5640 1 --2- 172.21.15.92:0/2648428096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c981083a0 0x7f8c981087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.956+0000 7f8c9e6f5640 1 --2- 172.21.15.92:0/2648428096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c98102a60 0x7f8c98102e70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.956+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2648428096 >> 172.21.15.92:0/2648428096 conn(0x7f8c98079730 msgr2=0x7f8c98079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.956+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2648428096 shutdown_connections 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.956+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2648428096 wait complete. 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.957+0000 7f8c9e6f5640 1 Processor -- start 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.957+0000 7f8c9e6f5640 1 -- start start 2024-09-21T07:10:10.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.957+0000 7f8c9e6f5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c98102a60 0x7f8c9819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.957+0000 7f8c9e6f5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c981083a0 0x7f8c9819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.957+0000 7f8c9e6f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c98108cf0 0x7f8c9819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.957+0000 7f8c9e6f5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8c98112870 con 0x7f8c981083a0 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.957+0000 7f8c9e6f5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8c981126f0 con 0x7f8c98108cf0 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.957+0000 7f8c9e6f5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8c981129f0 con 0x7f8c98102a60 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.957+0000 7f8c8ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c981083a0 0x7f8c9819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c8ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c981083a0 0x7f8c9819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35222/0 (socket says 172.21.15.92:35222) 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c8ffff640 1 -- 172.21.15.92:0/2742868664 learned_addr learned my addr 172.21.15.92:0/2742868664 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c97fff640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c98102a60 0x7f8c9819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c9cc92640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c98108cf0 0x7f8c9819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c8ffff640 1 -- 172.21.15.92:0/2742868664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c98102a60 msgr2=0x7f8c9819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c8ffff640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c98102a60 0x7f8c9819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:10.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c8ffff640 1 -- 172.21.15.92:0/2742868664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c98108cf0 msgr2=0x7f8c9819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c8ffff640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c98108cf0 0x7f8c9819fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c8ffff640 1 -- 172.21.15.92:0/2742868664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c981a03a0 con 0x7f8c981083a0 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c97fff640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c98102a60 0x7f8c9819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c8ffff640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c981083a0 0x7f8c9819a9d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000b450 tx=0x7f8c8000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c95ffb640 1 -- 172.21.15.92:0/2742868664 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80015020 con 0x7f8c981083a0 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c95ffb640 1 -- 172.21.15.92:0/2742868664 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c80011d20 con 0x7f8c981083a0 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2742868664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c981a0690 con 0x7f8c981083a0 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c95ffb640 1 -- 172.21.15.92:0/2742868664 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80010e10 con 0x7f8c981083a0 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.958+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2742868664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c981a6df0 con 0x7f8c981083a0 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.959+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2742868664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c98102e70 con 0x7f8c981083a0 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.962+0000 7f8c95ffb640 1 -- 172.21.15.92:0/2742868664 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f8c80018020 con 0x7f8c981083a0 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.962+0000 7f8c95ffb640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c840b65e0 0x7f8c840b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:10.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.962+0000 7f8c97fff640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c840b65e0 0x7f8c840b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:10.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.962+0000 7f8c95ffb640 1 -- 172.21.15.92:0/2742868664 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f8c800e6fc0 con 0x7f8c981083a0 2024-09-21T07:10:10.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.963+0000 7f8c97fff640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c840b65e0 0x7f8c840b8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8c88006010 tx=0x7f8c88000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:10.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:10.965+0000 7f8c95ffb640 1 -- 172.21.15.92:0/2742868664 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c8001f020 con 0x7f8c981083a0 2024-09-21T07:10:11.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.183+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2742868664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c981a71c0 con 0x7f8c981083a0 2024-09-21T07:10:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.184+0000 7f8c95ffb640 1 -- 172.21.15.92:0/2742868664 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f8c8000d040 con 0x7f8c981083a0 2024-09-21T07:10:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:11.187 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"btime":"2024-09-21T07:02:28:950840+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T07:10:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 1 2024-09-21T07:10:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.186+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2742868664 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c840b65e0 msgr2=0x7f8c840b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.186+0000 7f8c9e6f5640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c840b65e0 0x7f8c840b8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8c88006010 tx=0x7f8c88000bc0 comp rx=0 tx=0).stop 2024-09-21T07:10:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.186+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2742868664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c981083a0 msgr2=0x7f8c9819a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.186+0000 7f8c9e6f5640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c981083a0 0x7f8c9819a9d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000b450 tx=0x7f8c8000b910 comp rx=0 tx=0).stop 2024-09-21T07:10:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.186+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2742868664 shutdown_connections 2024-09-21T07:10:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.186+0000 7f8c9e6f5640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c840b65e0 0x7f8c840b8af0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.186+0000 7f8c9e6f5640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c98108cf0 0x7f8c9819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.186+0000 7f8c9e6f5640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c981083a0 0x7f8c9819a9d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.186+0000 7f8c9e6f5640 1 --2- 172.21.15.92:0/2742868664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c98102a60 0x7f8c9819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.186+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2742868664 >> 172.21.15.92:0/2742868664 conn(0x7f8c98079730 msgr2=0x7f8c98106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.187+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2742868664 shutdown_connections 2024-09-21T07:10:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:11.187+0000 7f8c9e6f5640 1 -- 172.21.15.92:0/2742868664 wait complete. 2024-09-21T07:10:11.538 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:10:11 smithi175 systemd[1]: Starting Ceph mds.l for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:11.806 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:11 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2742868664' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:11.806 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:10:11 smithi175 podman[61909]: 2024-09-21 07:10:11.568845909 +0000 UTC m=+0.016294440 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:11.806 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:10:11 smithi175 podman[61909]: 2024-09-21 07:10:11.673400618 +0000 UTC m=+0.120849187 container create 4a49adc8976f36babffb0b1ba2006c740be56a1ec053bdfce54825cb389f6ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T07:10:11.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:11 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2742868664' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:11.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:11 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2742868664' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:12.268 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:10:11 smithi175 podman[61909]: 2024-09-21 07:10:11.892679542 +0000 UTC m=+0.340128074 container init 4a49adc8976f36babffb0b1ba2006c740be56a1ec053bdfce54825cb389f6ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T07:10:12.268 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:10:11 smithi175 podman[61909]: 2024-09-21 07:10:11.895457126 +0000 UTC m=+0.342905654 container start 4a49adc8976f36babffb0b1ba2006c740be56a1ec053bdfce54825cb389f6ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T07:10:12.268 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:10:11 smithi175 ceph-mds[61928]: -- 172.21.15.175:0/3267248925 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bfd194f860 con 0x55bfd5af7600 2024-09-21T07:10:12.268 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:10:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l[61924]: starting mds.l at 2024-09-21T07:10:12.268 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:10:11 smithi175 bash[61909]: 4a49adc8976f36babffb0b1ba2006c740be56a1ec053bdfce54825cb389f6ac5 2024-09-21T07:10:12.268 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:10:11 smithi175 systemd[1]: Started Ceph mds.l for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:12.831 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:12 smithi169 ceph-mon[33705]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:12.831 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:12 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] up:boot 2024-09-21T07:10:12.831 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:12 smithi169 ceph-mon[33705]: fsmap 1 up:standby 2024-09-21T07:10:12.831 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:10:12.831 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:12.831 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:12.831 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:12.831 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:12.831 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:12.831 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:12 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:12 smithi092 ceph-mon[30987]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:12 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] up:boot 2024-09-21T07:10:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:12 smithi092 ceph-mon[30987]: fsmap 1 up:standby 2024-09-21T07:10:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:10:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:12.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:12.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:12.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:12 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:12 smithi175 ceph-mon[34064]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:12 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] up:boot 2024-09-21T07:10:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:12 smithi175 ceph-mon[34064]: fsmap 1 up:standby 2024-09-21T07:10:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:10:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:13.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:12 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:13.820 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:13 smithi169 ceph-mon[33705]: Deploying daemon mds.k on smithi169 2024-09-21T07:10:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:13 smithi092 ceph-mon[30987]: Deploying daemon mds.k on smithi169 2024-09-21T07:10:13.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:10:14.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:13 smithi175 ceph-mon[34064]: Deploying daemon mds.k on smithi169 2024-09-21T07:10:14.211 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:14.393 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:10:14 smithi169 systemd[1]: Starting Ceph mds.k for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:14.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:14 smithi092 ceph-mon[30987]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:14.719 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:14 smithi169 ceph-mon[33705]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:14.719 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:10:14 smithi169 podman[62162]: 2024-09-21 07:10:14.368309671 +0000 UTC m=+0.016023170 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:14.719 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:10:14 smithi169 podman[62162]: 2024-09-21 07:10:14.479969554 +0000 UTC m=+0.127683085 container create df9288155f364184ddd3b6fedc79aefe7e2f50c1f865aaa853aeea010c9ba705 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T07:10:14.720 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:10:14 smithi169 podman[62162]: 2024-09-21 07:10:14.715751829 +0000 UTC m=+0.363465324 container init df9288155f364184ddd3b6fedc79aefe7e2f50c1f865aaa853aeea010c9ba705 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T07:10:14.720 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:10:14 smithi169 podman[62162]: 2024-09-21 07:10:14.718463493 +0000 UTC m=+0.366176982 container start df9288155f364184ddd3b6fedc79aefe7e2f50c1f865aaa853aeea010c9ba705 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T07:10:14.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.707+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3945242932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1b4104a30 msgr2=0x7fe1b4104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:14.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.707+0000 7fe1baaf7640 1 --2- 172.21.15.92:0/3945242932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1b4104a30 0x7fe1b4104e40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009900 tx=0x7fe1a802a410 comp rx=0 tx=0).stop 2024-09-21T07:10:14.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.707+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3945242932 shutdown_connections 2024-09-21T07:10:14.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.707+0000 7fe1baaf7640 1 --2- 172.21.15.92:0/3945242932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1b410de90 0x7fe1b4110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:14.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.707+0000 7fe1baaf7640 1 --2- 172.21.15.92:0/3945242932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b4105380 0x7fe1b410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:14.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.707+0000 7fe1baaf7640 1 --2- 172.21.15.92:0/3945242932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1b4104a30 0x7fe1b4104e40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:14.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.707+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3945242932 >> 172.21.15.92:0/3945242932 conn(0x7fe1b4079770 msgr2=0x7fe1b4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.707+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3945242932 shutdown_connections 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.707+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3945242932 wait complete. 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.708+0000 7fe1baaf7640 1 Processor -- start 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.708+0000 7fe1baaf7640 1 -- start start 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.708+0000 7fe1baaf7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b4104a30 0x7fe1b419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.708+0000 7fe1baaf7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1b4105380 0x7fe1b419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.708+0000 7fe1baaf7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1b410de90 0x7fe1b419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.708+0000 7fe1baaf7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b41139a0 con 0x7fe1b4105380 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.708+0000 7fe1baaf7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b4113820 con 0x7fe1b410de90 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.708+0000 7fe1baaf7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b4113b20 con 0x7fe1b4104a30 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.708+0000 7fe1b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1b4105380 0x7fe1b419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.708+0000 7fe1b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1b4105380 0x7fe1b419a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35246/0 (socket says 172.21.15.92:35246) 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b3fff640 1 -- 172.21.15.92:0/3135066335 learned_addr learned my addr 172.21.15.92:0/3135066335 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b8893640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b4104a30 0x7fe1b419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b9094640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1b410de90 0x7fe1b419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b3fff640 1 -- 172.21.15.92:0/3135066335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b4104a30 msgr2=0x7fe1b419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b3fff640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b4104a30 0x7fe1b419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b3fff640 1 -- 172.21.15.92:0/3135066335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1b410de90 msgr2=0x7fe1b419fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b3fff640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1b410de90 0x7fe1b419fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b3fff640 1 -- 172.21.15.92:0/3135066335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b41a03c0 con 0x7fe1b4105380 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b9094640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1b410de90 0x7fe1b419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b3fff640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1b4105380 0x7fe1b419a9f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000d740 tx=0x7fe1a000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b1ffb640 1 -- 172.21.15.92:0/3135066335 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0017070 con 0x7fe1b4105380 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b1ffb640 1 -- 172.21.15.92:0/3135066335 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1a000de50 con 0x7fe1b4105380 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3135066335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b41a06b0 con 0x7fe1b4105380 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1b1ffb640 1 -- 172.21.15.92:0/3135066335 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000f620 con 0x7fe1b4105380 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.709+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3135066335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b41a6e10 con 0x7fe1b4105380 2024-09-21T07:10:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.711+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3135066335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b406c260 con 0x7fe1b4105380 2024-09-21T07:10:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.712+0000 7fe1b1ffb640 1 -- 172.21.15.92:0/3135066335 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fe1a001a070 con 0x7fe1b4105380 2024-09-21T07:10:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.712+0000 7fe1b1ffb640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1a40b65e0 0x7fe1a40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.713+0000 7fe1b8893640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1a40b65e0 0x7fe1a40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.713+0000 7fe1b1ffb640 1 -- 172.21.15.92:0/3135066335 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fe1a00e6950 con 0x7fe1b4105380 2024-09-21T07:10:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.713+0000 7fe1b8893640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1a40b65e0 0x7fe1a40b8af0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80057c0 tx=0x7fe1a80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:14.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.717+0000 7fe1b1ffb640 1 -- 172.21.15.92:0/3135066335 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1a00ad5b0 con 0x7fe1b4105380 2024-09-21T07:10:14.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.936+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3135066335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1b4108a00 con 0x7fe1b4105380 2024-09-21T07:10:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.936+0000 7fe1b1ffb640 1 -- 172.21.15.92:0/3135066335 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fe1a00b1990 con 0x7fe1b4105380 2024-09-21T07:10:14.938 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:14.938 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":2,"btime":"2024-09-21T07:10:11:933345+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:10:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 2 2024-09-21T07:10:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3135066335 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1a40b65e0 msgr2=0x7fe1a40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1a40b65e0 0x7fe1a40b8af0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80057c0 tx=0x7fe1a80058d0 comp rx=0 tx=0).stop 2024-09-21T07:10:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3135066335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1b4105380 msgr2=0x7fe1b419a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1b4105380 0x7fe1b419a9f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000d740 tx=0x7fe1a000dc00 comp rx=0 tx=0).stop 2024-09-21T07:10:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3135066335 shutdown_connections 2024-09-21T07:10:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1a40b65e0 0x7fe1a40b8af0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1b410de90 0x7fe1b419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1b4105380 0x7fe1b419a9f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 --2- 172.21.15.92:0/3135066335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1b4104a30 0x7fe1b419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3135066335 >> 172.21.15.92:0/3135066335 conn(0x7fe1b4079770 msgr2=0x7fe1b40ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3135066335 shutdown_connections 2024-09-21T07:10:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:14.939+0000 7fe1baaf7640 1 -- 172.21.15.92:0/3135066335 wait complete. 2024-09-21T07:10:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:14 smithi175 ceph-mon[34064]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:15.143 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:10:14 smithi169 ceph-mds[62181]: -- 172.21.15.169:0/516177691 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591b6955860 con 0x5591baafd180 2024-09-21T07:10:15.143 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:10:14 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k[62177]: starting mds.k at 2024-09-21T07:10:15.143 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:10:14 smithi169 bash[62162]: df9288155f364184ddd3b6fedc79aefe7e2f50c1f865aaa853aeea010c9ba705 2024-09-21T07:10:15.143 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:10:14 smithi169 systemd[1]: Started Ceph mds.k for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:16.020 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:16.020 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:16.021 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:16.021 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:16.021 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:16.021 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:16.021 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: Deploying daemon mds.j on smithi092 2024-09-21T07:10:16.021 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3135066335' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:16.021 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.169:6832/3784592006,v1:172.21.15.169:6833/3784592006] up:boot 2024-09-21T07:10:16.021 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: fsmap 2 up:standby 2024-09-21T07:10:16.021 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:10:16.021 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:15 smithi092 ceph-mon[30987]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: Deploying daemon mds.j on smithi092 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3135066335' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.169:6832/3784592006,v1:172.21.15.169:6833/3784592006] up:boot 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: fsmap 2 up:standby 2024-09-21T07:10:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:10:16.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:15 smithi175 ceph-mon[34064]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:16.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:16.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:16.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:16.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:16.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:16.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:16.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: Deploying daemon mds.j on smithi092 2024-09-21T07:10:16.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3135066335' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:16.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.169:6832/3784592006,v1:172.21.15.169:6833/3784592006] up:boot 2024-09-21T07:10:16.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: fsmap 2 up:standby 2024-09-21T07:10:16.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:10:16.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:15 smithi169 ceph-mon[33705]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:17.613 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:10:17 smithi092 systemd[1]: Starting Ceph mds.j for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:17.765 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:10:18.015 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:10:17 smithi092 podman[71509]: 2024-09-21 07:10:17.641302344 +0000 UTC m=+0.016027808 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:18.015 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:10:17 smithi092 podman[71509]: 2024-09-21 07:10:17.752669181 +0000 UTC m=+0.127394686 container create c66e82f8f177fe0be3b0cd88404de6a4bcb7100a77f0be98837bf02f8664e1d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T07:10:18.015 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:10:18 smithi092 podman[71509]: 2024-09-21 07:10:18.013653035 +0000 UTC m=+0.388378495 container init c66e82f8f177fe0be3b0cd88404de6a4bcb7100a77f0be98837bf02f8664e1d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:10:18.200 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:18.326 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:10:18 smithi092 podman[71509]: 2024-09-21 07:10:18.017348998 +0000 UTC m=+0.392074467 container start c66e82f8f177fe0be3b0cd88404de6a4bcb7100a77f0be98837bf02f8664e1d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-j, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T07:10:18.326 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:10:18 smithi092 ceph-mds[71558]: -- 172.21.15.92:0/3832544588 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e40cf59860 con 0x55e411101180 2024-09-21T07:10:18.326 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:10:18 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-j[71542]: starting mds.j at 2024-09-21T07:10:18.326 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:10:18 smithi092 bash[71509]: c66e82f8f177fe0be3b0cd88404de6a4bcb7100a77f0be98837bf02f8664e1d7 2024-09-21T07:10:18.326 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:10:18 smithi092 systemd[1]: Started Ceph mds.j for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.707+0000 7f7731d66640 1 -- 172.21.15.92:0/1961581467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c103b60 msgr2=0x7f772c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.707+0000 7f7731d66640 1 --2- 172.21.15.92:0/1961581467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c103b60 0x7f772c103f70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f771c009900 tx=0x7f771c02a410 comp rx=0 tx=0).stop 2024-09-21T07:10:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.707+0000 7f7731d66640 1 -- 172.21.15.92:0/1961581467 shutdown_connections 2024-09-21T07:10:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.707+0000 7f7731d66640 1 --2- 172.21.15.92:0/1961581467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f772c109df0 0x7f772c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.707+0000 7f7731d66640 1 --2- 172.21.15.92:0/1961581467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c1094a0 0x7f772c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.707+0000 7f7731d66640 1 --2- 172.21.15.92:0/1961581467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c103b60 0x7f772c103f70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.707+0000 7f7731d66640 1 -- 172.21.15.92:0/1961581467 >> 172.21.15.92:0/1961581467 conn(0x7f772c07b850 msgr2=0x7f772c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.708+0000 7f7731d66640 1 -- 172.21.15.92:0/1961581467 shutdown_connections 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.708+0000 7f7731d66640 1 -- 172.21.15.92:0/1961581467 wait complete. 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.708+0000 7f7731d66640 1 Processor -- start 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.708+0000 7f7731d66640 1 -- start start 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f7731d66640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c103b60 0x7f772c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f7731d66640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f772c1094a0 0x7f772c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f7731d66640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c109df0 0x7f772c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f7731d66640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f772c113a20 con 0x7f772c103b60 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f7731d66640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1138a0 con 0x7f772c109df0 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f7731d66640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f772c113ba0 con 0x7f772c1094a0 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c103b60 0x7f772c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c103b60 0x7f772c19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35266/0 (socket says 172.21.15.92:35266) 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772b7fe640 1 -- 172.21.15.92:0/204233605 learned_addr learned my addr 172.21.15.92:0/204233605 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772bfff640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c109df0 0x7f772c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772affd640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f772c1094a0 0x7f772c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772b7fe640 1 -- 172.21.15.92:0/204233605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f772c1094a0 msgr2=0x7f772c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772b7fe640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f772c1094a0 0x7f772c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772b7fe640 1 -- 172.21.15.92:0/204233605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c109df0 msgr2=0x7f772c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772b7fe640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c109df0 0x7f772c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772b7fe640 1 -- 172.21.15.92:0/204233605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772c1a04c0 con 0x7f772c103b60 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772affd640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f772c1094a0 0x7f772c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.709+0000 7f772b7fe640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c103b60 0x7f772c19a550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f771c009a20 tx=0x7f771c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.710+0000 7f7728ff9640 1 -- 172.21.15.92:0/204233605 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c03f030 con 0x7f772c103b60 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.710+0000 7f7728ff9640 1 -- 172.21.15.92:0/204233605 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f771c0035f0 con 0x7f772c103b60 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.710+0000 7f7731d66640 1 -- 172.21.15.92:0/204233605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772c1a0750 con 0x7f772c103b60 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.710+0000 7f7728ff9640 1 -- 172.21.15.92:0/204233605 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c035070 con 0x7f772c103b60 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.710+0000 7f7731d66640 1 -- 172.21.15.92:0/204233605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f772c1a6f10 con 0x7f772c103b60 2024-09-21T07:10:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.711+0000 7f7731d66640 1 -- 172.21.15.92:0/204233605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f772c103ff0 con 0x7f772c103b60 2024-09-21T07:10:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.712+0000 7f7728ff9640 1 -- 172.21.15.92:0/204233605 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f771c003aa0 con 0x7f772c103b60 2024-09-21T07:10:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.713+0000 7f7728ff9640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77140b65e0 0x7f77140b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.713+0000 7f772affd640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77140b65e0 0x7f77140b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.713+0000 7f7728ff9640 1 -- 172.21.15.92:0/204233605 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f771c107f80 con 0x7f772c103b60 2024-09-21T07:10:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.714+0000 7f772affd640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77140b65e0 0x7f77140b8af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7720006fd0 tx=0x7f7720008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.716+0000 7f7728ff9640 1 -- 172.21.15.92:0/204233605 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f771c0cebe0 con 0x7f772c103b60 2024-09-21T07:10:18.886 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:18 smithi092 ceph-mon[30987]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:18.886 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:18.886 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:18.887 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:18.887 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:18.887 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:18.887 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:18 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:18.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:18 smithi169 ceph-mon[33705]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:18.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:18.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:18.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:18.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:18.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:18.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:18 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:18.907 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:18 smithi175 ceph-mon[34064]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:18.907 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:18.907 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:18.907 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:18.907 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:18.907 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:18.907 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:18 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:18.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.954+0000 7f7731d66640 1 -- 172.21.15.92:0/204233605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f772c02e640 con 0x7f772c103b60 2024-09-21T07:10:18.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.955+0000 7f7728ff9640 1 -- 172.21.15.92:0/204233605 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f771c0d2fc0 con 0x7f772c103b60 2024-09-21T07:10:18.957 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:18.957 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":4,"btime":"2024-09-21T07:10:18:625066+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:10:18.957 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 4 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 -- 172.21.15.92:0/204233605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77140b65e0 msgr2=0x7f77140b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77140b65e0 0x7f77140b8af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7720006fd0 tx=0x7f7720008040 comp rx=0 tx=0).stop 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 -- 172.21.15.92:0/204233605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c103b60 msgr2=0x7f772c19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c103b60 0x7f772c19a550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f771c009a20 tx=0x7f771c004270 comp rx=0 tx=0).stop 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 -- 172.21.15.92:0/204233605 shutdown_connections 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77140b65e0 0x7f77140b8af0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c109df0 0x7f772c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f772c1094a0 0x7f772c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 --2- 172.21.15.92:0/204233605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f772c103b60 0x7f772c19a550 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 -- 172.21.15.92:0/204233605 >> 172.21.15.92:0/204233605 conn(0x7f772c07b850 msgr2=0x7f772c1076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 -- 172.21.15.92:0/204233605 shutdown_connections 2024-09-21T07:10:18.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:18.957+0000 7f7731d66640 1 -- 172.21.15.92:0/204233605 wait complete. 2024-09-21T07:10:19.890 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:19 smithi092 ceph-mon[30987]: Deploying daemon mds.d on smithi092 2024-09-21T07:10:19.890 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:19 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.92:6834/4146602671,v1:172.21.15.92:6835/4146602671] up:boot 2024-09-21T07:10:19.890 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:19 smithi092 ceph-mon[30987]: fsmap 3 up:standby 2024-09-21T07:10:19.891 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:19 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:10:19.891 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:19 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/204233605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:19.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:19 smithi169 ceph-mon[33705]: Deploying daemon mds.d on smithi092 2024-09-21T07:10:19.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:19 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.92:6834/4146602671,v1:172.21.15.92:6835/4146602671] up:boot 2024-09-21T07:10:19.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:19 smithi169 ceph-mon[33705]: fsmap 3 up:standby 2024-09-21T07:10:19.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:19 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:10:19.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:19 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/204233605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:20.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:19 smithi175 ceph-mon[34064]: Deploying daemon mds.d on smithi092 2024-09-21T07:10:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:19 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.92:6834/4146602671,v1:172.21.15.92:6835/4146602671] up:boot 2024-09-21T07:10:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:19 smithi175 ceph-mon[34064]: fsmap 3 up:standby 2024-09-21T07:10:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:19 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:10:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:19 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/204233605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:20 smithi169 ceph-mon[33705]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:20 smithi175 ceph-mon[34064]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:21.071 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:20 smithi092 ceph-mon[30987]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:21.362 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:10:21 smithi092 systemd[1]: Starting Ceph mds.d for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:21.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:10:21 smithi092 podman[71893]: 2024-09-21 07:10:21.368551807 +0000 UTC m=+0.016354568 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:21.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:10:21 smithi092 podman[71893]: 2024-09-21 07:10:21.500823132 +0000 UTC m=+0.148625873 container create 5c4964628a8ce963d4c35466cad11d2e9c8120870531bd7c98199a3953255b58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-d, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T07:10:21.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:10:21 smithi092 podman[71893]: 2024-09-21 07:10:21.75686111 +0000 UTC m=+0.404663862 container init 5c4964628a8ce963d4c35466cad11d2e9c8120870531bd7c98199a3953255b58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-d, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:10:22.112 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:10:21 smithi092 podman[71893]: 2024-09-21 07:10:21.759700214 +0000 UTC m=+0.407502955 container start 5c4964628a8ce963d4c35466cad11d2e9c8120870531bd7c98199a3953255b58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:10:22.112 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:10:21 smithi092 ceph-mds[71912]: -- 172.21.15.92:0/109897524 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5629d7ba3860 con 0x5629dbd4ba80 2024-09-21T07:10:22.112 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:10:21 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-d[71908]: starting mds.d at 2024-09-21T07:10:22.112 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:10:21 smithi092 bash[71893]: 5c4964628a8ce963d4c35466cad11d2e9c8120870531bd7c98199a3953255b58 2024-09-21T07:10:22.112 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:10:21 smithi092 systemd[1]: Started Ceph mds.d for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:22.308 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:10:22.557 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:22.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:22 smithi169 ceph-mon[33705]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:22.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:22.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:22.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:22.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:22.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:22.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:22 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:22.961 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:22 smithi092 ceph-mon[30987]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:22.961 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:22.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:22.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:22.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:22.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:22.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:22 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:23.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:22 smithi175 ceph-mon[34064]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:23.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:23.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:23.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:23.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:23.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:23.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:22 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:23.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.050+0000 7ff98867f640 1 -- 172.21.15.92:0/1368845539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9801083d0 msgr2=0x7ff9801087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:23.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.050+0000 7ff98867f640 1 --2- 172.21.15.92:0/1368845539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9801083d0 0x7ff9801087e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff970009900 tx=0x7ff97002a410 comp rx=0 tx=0).stop 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.050+0000 7ff98867f640 1 -- 172.21.15.92:0/1368845539 shutdown_connections 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.050+0000 7ff98867f640 1 --2- 172.21.15.92:0/1368845539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff980108d20 0x7ff98010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.050+0000 7ff98867f640 1 --2- 172.21.15.92:0/1368845539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9801083d0 0x7ff9801087e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.050+0000 7ff98867f640 1 --2- 172.21.15.92:0/1368845539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff980102ae0 0x7ff980102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.050+0000 7ff98867f640 1 -- 172.21.15.92:0/1368845539 >> 172.21.15.92:0/1368845539 conn(0x7ff980079760 msgr2=0x7ff980079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.050+0000 7ff98867f640 1 -- 172.21.15.92:0/1368845539 shutdown_connections 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.050+0000 7ff98867f640 1 -- 172.21.15.92:0/1368845539 wait complete. 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98867f640 1 Processor -- start 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98867f640 1 -- start start 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98867f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff980102ae0 0x7ff98019b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98867f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9801083d0 0x7ff98019b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98867f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff980108d20 0x7ff98019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:23.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98867f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff980112840 con 0x7ff980102ae0 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98867f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9801126c0 con 0x7ff980108d20 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98867f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9801129c0 con 0x7ff9801083d0 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98641b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff980102ae0 0x7ff98019b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98641b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff980102ae0 0x7ff98019b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56006/0 (socket says 172.21.15.92:56006) 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98641b640 1 -- 172.21.15.92:0/43203671 learned_addr learned my addr 172.21.15.92:0/43203671 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff986c1c640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff980108d20 0x7ff98019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff985c1a640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9801083d0 0x7ff98019b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98641b640 1 -- 172.21.15.92:0/43203671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9801083d0 msgr2=0x7ff98019b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98641b640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9801083d0 0x7ff98019b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98641b640 1 -- 172.21.15.92:0/43203671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff980108d20 msgr2=0x7ff98019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98641b640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff980108d20 0x7ff98019bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.051+0000 7ff98641b640 1 -- 172.21.15.92:0/43203671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9801a6410 con 0x7ff980102ae0 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.052+0000 7ff98641b640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff980102ae0 0x7ff98019b210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00c890 tx=0x7ff97c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:23.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.052+0000 7ff9777fe640 1 -- 172.21.15.92:0/43203671 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c004220 con 0x7ff980102ae0 2024-09-21T07:10:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.052+0000 7ff98867f640 1 -- 172.21.15.92:0/43203671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9801a6700 con 0x7ff980102ae0 2024-09-21T07:10:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.052+0000 7ff9777fe640 1 -- 172.21.15.92:0/43203671 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff97c007e40 con 0x7ff980102ae0 2024-09-21T07:10:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.052+0000 7ff9777fe640 1 -- 172.21.15.92:0/43203671 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c004a00 con 0x7ff980102ae0 2024-09-21T07:10:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.052+0000 7ff98867f640 1 -- 172.21.15.92:0/43203671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9801a6c10 con 0x7ff980102ae0 2024-09-21T07:10:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.053+0000 7ff98867f640 1 -- 172.21.15.92:0/43203671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff980103d10 con 0x7ff980102ae0 2024-09-21T07:10:23.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.054+0000 7ff9777fe640 1 -- 172.21.15.92:0/43203671 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7ff97c0079b0 con 0x7ff980102ae0 2024-09-21T07:10:23.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.055+0000 7ff9777fe640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff96c0b6590 0x7ff96c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:23.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.055+0000 7ff985c1a640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff96c0b6590 0x7ff96c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:23.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.055+0000 7ff9777fe640 1 -- 172.21.15.92:0/43203671 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7ff97c0e6ca0 con 0x7ff980102ae0 2024-09-21T07:10:23.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.056+0000 7ff985c1a640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff96c0b6590 0x7ff96c0b8aa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff970006010 tx=0x7ff970031c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:23.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.059+0000 7ff9777fe640 1 -- 172.21.15.92:0/43203671 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff97c014030 con 0x7ff980102ae0 2024-09-21T07:10:23.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.273+0000 7ff98867f640 1 -- 172.21.15.92:0/43203671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff98006bf70 con 0x7ff980102ae0 2024-09-21T07:10:23.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.274+0000 7ff9777fe640 1 -- 172.21.15.92:0/43203671 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7ff97c0ad900 con 0x7ff980102ae0 2024-09-21T07:10:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:23.276 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":5,"btime":"2024-09-21T07:10:22:646771+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:10:23.276 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 5 2024-09-21T07:10:23.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.276+0000 7ff98867f640 1 -- 172.21.15.92:0/43203671 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff96c0b6590 msgr2=0x7ff96c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:23.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.276+0000 7ff98867f640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff96c0b6590 0x7ff96c0b8aa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff970006010 tx=0x7ff970031c70 comp rx=0 tx=0).stop 2024-09-21T07:10:23.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.276+0000 7ff98867f640 1 -- 172.21.15.92:0/43203671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff980102ae0 msgr2=0x7ff98019b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:23.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.276+0000 7ff98867f640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff980102ae0 0x7ff98019b210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00c890 tx=0x7ff97c00cd50 comp rx=0 tx=0).stop 2024-09-21T07:10:23.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.277+0000 7ff98867f640 1 -- 172.21.15.92:0/43203671 shutdown_connections 2024-09-21T07:10:23.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.277+0000 7ff98867f640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff96c0b6590 0x7ff96c0b8aa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:23.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.277+0000 7ff98867f640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff980108d20 0x7ff98019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:23.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.277+0000 7ff98867f640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9801083d0 0x7ff98019b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:23.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.277+0000 7ff98867f640 1 --2- 172.21.15.92:0/43203671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff980102ae0 0x7ff98019b210 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:23.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.277+0000 7ff98867f640 1 -- 172.21.15.92:0/43203671 >> 172.21.15.92:0/43203671 conn(0x7ff980079760 msgr2=0x7ff980104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:23.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.277+0000 7ff98867f640 1 -- 172.21.15.92:0/43203671 shutdown_connections 2024-09-21T07:10:23.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:23.277+0000 7ff98867f640 1 -- 172.21.15.92:0/43203671 wait complete. 2024-09-21T07:10:23.962 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:23 smithi169 ceph-mon[33705]: Deploying daemon mds.e on smithi169 2024-09-21T07:10:23.962 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:23 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.92:6836/445790137,v1:172.21.15.92:6837/445790137] up:boot 2024-09-21T07:10:23.962 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:23 smithi169 ceph-mon[33705]: fsmap 4 up:standby 2024-09-21T07:10:23.962 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:23 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:10:23.962 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:23 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/43203671' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:23.963 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:10:23 smithi169 systemd[1]: Starting Ceph mds.e for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:23 smithi175 ceph-mon[34064]: Deploying daemon mds.e on smithi169 2024-09-21T07:10:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:23 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.92:6836/445790137,v1:172.21.15.92:6837/445790137] up:boot 2024-09-21T07:10:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:23 smithi175 ceph-mon[34064]: fsmap 4 up:standby 2024-09-21T07:10:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:23 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:10:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:23 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/43203671' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:24.080 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:23 smithi092 ceph-mon[30987]: Deploying daemon mds.e on smithi169 2024-09-21T07:10:24.081 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:23 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.92:6836/445790137,v1:172.21.15.92:6837/445790137] up:boot 2024-09-21T07:10:24.081 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:23 smithi092 ceph-mon[30987]: fsmap 4 up:standby 2024-09-21T07:10:24.081 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:23 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:10:24.081 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:23 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/43203671' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:24.323 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:10:24 smithi169 podman[62446]: 2024-09-21 07:10:24.077240081 +0000 UTC m=+0.016331914 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:24.323 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:10:24 smithi169 podman[62446]: 2024-09-21 07:10:24.193983954 +0000 UTC m=+0.133075819 container create 032f8a71257016f644555be47eca4a0d994a1833d6f584b6b0cd6514f347b7b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:24.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:24 smithi169 ceph-mon[33705]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:24.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:24.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:24.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:24.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:24.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:24.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:24 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:24.894 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:10:24 smithi169 podman[62446]: 2024-09-21 07:10:24.446619875 +0000 UTC m=+0.385711706 container init 032f8a71257016f644555be47eca4a0d994a1833d6f584b6b0cd6514f347b7b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:24.894 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:10:24 smithi169 podman[62446]: 2024-09-21 07:10:24.449464099 +0000 UTC m=+0.388555931 container start 032f8a71257016f644555be47eca4a0d994a1833d6f584b6b0cd6514f347b7b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T07:10:24.894 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:10:24 smithi169 ceph-mds[62466]: -- 172.21.15.169:0/963468770 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5625857a5860 con 0x56258994d600 2024-09-21T07:10:24.894 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:10:24 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e[62462]: starting mds.e at 2024-09-21T07:10:24.894 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:10:24 smithi169 bash[62446]: 032f8a71257016f644555be47eca4a0d994a1833d6f584b6b0cd6514f347b7b5 2024-09-21T07:10:24.894 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:10:24 smithi169 systemd[1]: Started Ceph mds.e for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:25.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:24 smithi175 ceph-mon[34064]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:25.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:25.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:25.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:25.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:25.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:25.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:24 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:24 smithi092 ceph-mon[30987]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:25.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:24 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:26.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:25 smithi175 ceph-mon[34064]: Deploying daemon mds.f on smithi175 2024-09-21T07:10:26.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:25 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.169:6834/1770920559,v1:172.21.15.169:6835/1770920559] up:boot 2024-09-21T07:10:26.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:25 smithi175 ceph-mon[34064]: fsmap 5 up:standby 2024-09-21T07:10:26.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:25 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:10:26.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:10:26.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:25 smithi092 ceph-mon[30987]: Deploying daemon mds.f on smithi175 2024-09-21T07:10:26.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:25 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.169:6834/1770920559,v1:172.21.15.169:6835/1770920559] up:boot 2024-09-21T07:10:26.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:25 smithi092 ceph-mon[30987]: fsmap 5 up:standby 2024-09-21T07:10:26.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:25 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:10:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:25 smithi169 ceph-mon[33705]: Deploying daemon mds.f on smithi175 2024-09-21T07:10:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:25 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.169:6834/1770920559,v1:172.21.15.169:6835/1770920559] up:boot 2024-09-21T07:10:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:25 smithi169 ceph-mon[33705]: fsmap 5 up:standby 2024-09-21T07:10:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:25 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:10:26.375 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:26.673 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:10:26 smithi175 systemd[1]: Starting Ceph mds.f for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:26.777 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:26 smithi092 ceph-mon[30987]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:26.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.863+0000 7f85c109d640 1 -- 172.21.15.92:0/78234451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85bc102ae0 msgr2=0x7f85bc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:26.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.863+0000 7f85c109d640 1 --2- 172.21.15.92:0/78234451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85bc102ae0 0x7f85bc102ef0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f85ac009ca0 tx=0x7f85ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:10:26.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.863+0000 7f85c109d640 1 -- 172.21.15.92:0/78234451 shutdown_connections 2024-09-21T07:10:26.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.863+0000 7f85c109d640 1 --2- 172.21.15.92:0/78234451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85bc108d20 0x7f85bc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:26.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.863+0000 7f85c109d640 1 --2- 172.21.15.92:0/78234451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc1083d0 0x7f85bc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:26.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.863+0000 7f85c109d640 1 --2- 172.21.15.92:0/78234451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85bc102ae0 0x7f85bc102ef0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:26.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.863+0000 7f85c109d640 1 -- 172.21.15.92:0/78234451 >> 172.21.15.92:0/78234451 conn(0x7f85bc079760 msgr2=0x7f85bc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:26.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.863+0000 7f85c109d640 1 -- 172.21.15.92:0/78234451 shutdown_connections 2024-09-21T07:10:26.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.863+0000 7f85c109d640 1 -- 172.21.15.92:0/78234451 wait complete. 2024-09-21T07:10:26.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.864+0000 7f85c109d640 1 Processor -- start 2024-09-21T07:10:26.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.864+0000 7f85c109d640 1 -- start start 2024-09-21T07:10:26.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.864+0000 7f85c109d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85bc102ae0 0x7f85bc198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:26.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.864+0000 7f85c109d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc1083d0 0x7f85bc1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:26.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.864+0000 7f85c109d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85bc108d20 0x7f85bc19da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:26.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.864+0000 7f85c109d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc111780 con 0x7f85bc102ae0 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.864+0000 7f85c109d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc111600 con 0x7f85bc108d20 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.864+0000 7f85c109d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc111900 con 0x7f85bc1083d0 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85bc102ae0 0x7f85bc198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85ba59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc1083d0 0x7f85bc1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85bc102ae0 0x7f85bc198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56020/0 (socket says 172.21.15.92:56020) 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85bad9d640 1 -- 172.21.15.92:0/3718877645 learned_addr learned my addr 172.21.15.92:0/3718877645 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85bb59e640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85bc108d20 0x7f85bc19da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85bad9d640 1 -- 172.21.15.92:0/3718877645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc1083d0 msgr2=0x7f85bc1987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85bad9d640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc1083d0 0x7f85bc1987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85bad9d640 1 -- 172.21.15.92:0/3718877645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85bc108d20 msgr2=0x7f85bc19da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85bad9d640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85bc108d20 0x7f85bc19da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85bad9d640 1 -- 172.21.15.92:0/3718877645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc19e1a0 con 0x7f85bc102ae0 2024-09-21T07:10:26.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85ba59c640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc1083d0 0x7f85bc1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85bad9d640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85bc102ae0 0x7f85bc198230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f85ac009dc0 tx=0x7f85ac003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85b3fff640 1 -- 172.21.15.92:0/3718877645 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac032dd0 con 0x7f85bc102ae0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85b3fff640 1 -- 172.21.15.92:0/3718877645 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85ac0044d0 con 0x7f85bc102ae0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85c109d640 1 -- 172.21.15.92:0/3718877645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85bc19e430 con 0x7f85bc102ae0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85b3fff640 1 -- 172.21.15.92:0/3718877645 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac030c50 con 0x7f85bc102ae0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.865+0000 7f85c109d640 1 -- 172.21.15.92:0/3718877645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85bc1a4bf0 con 0x7f85bc102ae0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.866+0000 7f85c109d640 1 -- 172.21.15.92:0/3718877645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85bc102ef0 con 0x7f85bc102ae0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.868+0000 7f85b3fff640 1 -- 172.21.15.92:0/3718877645 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f85ac004680 con 0x7f85bc102ae0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.869+0000 7f85b3fff640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85a80b8770 0x7f85a80bac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.869+0000 7f85ba59c640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85a80b8770 0x7f85a80bac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.869+0000 7f85b3fff640 1 -- 172.21.15.92:0/3718877645 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f85ac1082f0 con 0x7f85bc102ae0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.869+0000 7f85ba59c640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85a80b8770 0x7f85a80bac80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85a40095f0 tx=0x7f85a4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:26.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:26.872+0000 7f85b3fff640 1 -- 172.21.15.92:0/3718877645 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85ac0cef50 con 0x7f85bc102ae0 2024-09-21T07:10:26.961 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:26 smithi175 ceph-mon[34064]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:26.962 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:10:26 smithi175 podman[62179]: 2024-09-21 07:10:26.575809688 +0000 UTC m=+0.015666625 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:26.962 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:10:26 smithi175 podman[62179]: 2024-09-21 07:10:26.709627864 +0000 UTC m=+0.149484840 container create 9488da2c92efc2b160bde579ba3f0982b3302ccca1682ef2ef5116ecf8945dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T07:10:26.962 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:10:26 smithi175 podman[62179]: 2024-09-21 07:10:26.960385957 +0000 UTC m=+0.400242907 container init 9488da2c92efc2b160bde579ba3f0982b3302ccca1682ef2ef5116ecf8945dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:27.044 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:26 smithi169 ceph-mon[33705]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:27.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.088+0000 7f85c109d640 1 -- 172.21.15.92:0/3718877645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85bc199360 con 0x7f85bc102ae0 2024-09-21T07:10:27.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.088+0000 7f85b3fff640 1 -- 172.21.15.92:0/3718877645 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7f85ac0d3330 con 0x7f85bc102ae0 2024-09-21T07:10:27.093 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:27.094 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":6,"btime":"2024-09-21T07:10:24:658336+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:10:27.096 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 6 2024-09-21T07:10:27.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 -- 172.21.15.92:0/3718877645 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85a80b8770 msgr2=0x7f85a80bac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:27.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85a80b8770 0x7f85a80bac80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85a40095f0 tx=0x7f85a4005f90 comp rx=0 tx=0).stop 2024-09-21T07:10:27.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 -- 172.21.15.92:0/3718877645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85bc102ae0 msgr2=0x7f85bc198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:27.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85bc102ae0 0x7f85bc198230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f85ac009dc0 tx=0x7f85ac003f80 comp rx=0 tx=0).stop 2024-09-21T07:10:27.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 -- 172.21.15.92:0/3718877645 shutdown_connections 2024-09-21T07:10:27.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85a80b8770 0x7f85a80bac80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:27.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85bc108d20 0x7f85bc19da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:27.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85bc1083d0 0x7f85bc1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:27.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 --2- 172.21.15.92:0/3718877645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85bc102ae0 0x7f85bc198230 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:27.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 -- 172.21.15.92:0/3718877645 >> 172.21.15.92:0/3718877645 conn(0x7f85bc079760 msgr2=0x7f85bc101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:27.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 -- 172.21.15.92:0/3718877645 shutdown_connections 2024-09-21T07:10:27.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:27.091+0000 7f85c109d640 1 -- 172.21.15.92:0/3718877645 wait complete. 2024-09-21T07:10:27.267 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:10:26 smithi175 podman[62179]: 2024-09-21 07:10:26.963255311 +0000 UTC m=+0.403112247 container start 9488da2c92efc2b160bde579ba3f0982b3302ccca1682ef2ef5116ecf8945dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:10:27.268 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:10:26 smithi175 ceph-mds[62198]: -- 172.21.15.175:0/1920123509 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5571d5237860 con 0x5571d93dfa80 2024-09-21T07:10:27.268 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:10:26 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f[62194]: starting mds.f at 2024-09-21T07:10:27.268 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:10:27 smithi175 bash[62179]: 9488da2c92efc2b160bde579ba3f0982b3302ccca1682ef2ef5116ecf8945dc7 2024-09-21T07:10:27.268 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:10:27 smithi175 systemd[1]: Started Ceph mds.f for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:27.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:27 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3718877645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:27.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:27.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:27.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:27.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:27.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:27.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:27 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:27.778 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:27 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3718877645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:27.778 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:27.778 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:27.778 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:27.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:27.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:27.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:27 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:27 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3718877645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:28.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:28.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:27 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:28.825 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:28 smithi175 ceph-mon[34064]: Deploying daemon mds.c on smithi175 2024-09-21T07:10:28.825 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:28 smithi175 ceph-mon[34064]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:28.825 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:28 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] up:boot 2024-09-21T07:10:28.825 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:28 smithi175 ceph-mon[34064]: fsmap 6 up:standby 2024-09-21T07:10:28.825 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:28 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:10:29.092 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:10:29 smithi175 systemd[1]: Starting Ceph mds.c for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:28 smithi092 ceph-mon[30987]: Deploying daemon mds.c on smithi175 2024-09-21T07:10:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:28 smithi092 ceph-mon[30987]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:28 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] up:boot 2024-09-21T07:10:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:28 smithi092 ceph-mon[30987]: fsmap 6 up:standby 2024-09-21T07:10:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:28 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:10:29.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:28 smithi169 ceph-mon[33705]: Deploying daemon mds.c on smithi175 2024-09-21T07:10:29.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:28 smithi169 ceph-mon[33705]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:29.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:28 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] up:boot 2024-09-21T07:10:29.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:28 smithi169 ceph-mon[33705]: fsmap 6 up:standby 2024-09-21T07:10:29.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:28 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:10:29.444 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:10:29 smithi175 podman[62449]: 2024-09-21 07:10:29.170867165 +0000 UTC m=+0.016434451 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:29.444 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:10:29 smithi175 podman[62449]: 2024-09-21 07:10:29.304388523 +0000 UTC m=+0.149955808 container create e8af9bae0688bc561ff12096db9518ae37e61d296fd25bc2a951e4aafc21d868 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:10:29.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:10:30.018 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:10:29 smithi175 podman[62449]: 2024-09-21 07:10:29.582036701 +0000 UTC m=+0.427603996 container init e8af9bae0688bc561ff12096db9518ae37e61d296fd25bc2a951e4aafc21d868 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:30.018 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:10:29 smithi175 podman[62449]: 2024-09-21 07:10:29.584994378 +0000 UTC m=+0.430561666 container start e8af9bae0688bc561ff12096db9518ae37e61d296fd25bc2a951e4aafc21d868 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T07:10:30.018 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:10:29 smithi175 ceph-mds[62478]: -- 172.21.15.175:0/3100962032 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f7e53fc20 con 0x557f826e7a80 2024-09-21T07:10:30.018 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:10:29 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c[62472]: starting mds.c at 2024-09-21T07:10:30.018 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:10:29 smithi175 bash[62449]: e8af9bae0688bc561ff12096db9518ae37e61d296fd25bc2a951e4aafc21d868 2024-09-21T07:10:30.018 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:10:29 smithi175 systemd[1]: Started Ceph mds.c for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:30.063 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:30.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:30 smithi169 ceph-mon[33705]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:30.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:30 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:30.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:30 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:30.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:30 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:30.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:30 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:30.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:30 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:30.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:30 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:30.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:30 smithi092 ceph-mon[30987]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:30.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:30 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:30.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:30 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:30.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:30 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:30.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:30 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:30.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:30 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:30.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:30 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:30.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:30 smithi175 ceph-mon[34064]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:30.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:30 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:30.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:30 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:30.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:30 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:30.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:30 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:30.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:30 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:30.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:30 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.563+0000 7fe234bc6640 1 -- 172.21.15.92:0/328509442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe23010de10 msgr2=0x7fe230110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.563+0000 7fe234bc6640 1 --2- 172.21.15.92:0/328509442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe23010de10 0x7fe230110300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe228009ca0 tx=0x7fe22802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.563+0000 7fe234bc6640 1 -- 172.21.15.92:0/328509442 shutdown_connections 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.563+0000 7fe234bc6640 1 --2- 172.21.15.92:0/328509442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe23010de10 0x7fe230110300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.563+0000 7fe234bc6640 1 --2- 172.21.15.92:0/328509442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe230105300 0x7fe23010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.563+0000 7fe234bc6640 1 --2- 172.21.15.92:0/328509442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2301049b0 0x7fe230104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.563+0000 7fe234bc6640 1 -- 172.21.15.92:0/328509442 >> 172.21.15.92:0/328509442 conn(0x7fe230079730 msgr2=0x7fe230079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.563+0000 7fe234bc6640 1 -- 172.21.15.92:0/328509442 shutdown_connections 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.563+0000 7fe234bc6640 1 -- 172.21.15.92:0/328509442 wait complete. 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe234bc6640 1 Processor -- start 2024-09-21T07:10:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe234bc6640 1 -- start start 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe234bc6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2301049b0 0x7fe23019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe234bc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe230105300 0x7fe23019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe234bc6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe23010de10 0x7fe23019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe234bc6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe230113a10 con 0x7fe230105300 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe234bc6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe230113890 con 0x7fe23010de10 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe234bc6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe230113b90 con 0x7fe2301049b0 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe230105300 0x7fe23019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe230105300 0x7fe23019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41838/0 (socket says 172.21.15.92:41838) 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22dd9b640 1 -- 172.21.15.92:0/3329632308 learned_addr learned my addr 172.21.15.92:0/3329632308 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22ed9d640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe23010de10 0x7fe23019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22e59c640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2301049b0 0x7fe23019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22dd9b640 1 -- 172.21.15.92:0/3329632308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2301049b0 msgr2=0x7fe23019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22dd9b640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2301049b0 0x7fe23019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22dd9b640 1 -- 172.21.15.92:0/3329632308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe23010de10 msgr2=0x7fe23019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22dd9b640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe23010de10 0x7fe23019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22dd9b640 1 -- 172.21.15.92:0/3329632308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2301a0430 con 0x7fe230105300 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.564+0000 7fe22e59c640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2301049b0 0x7fe23019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.565+0000 7fe22dd9b640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe230105300 0x7fe23019aa60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe22400d740 tx=0x7fe22400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.565+0000 7fe21f7fe640 1 -- 172.21.15.92:0/3329632308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224017070 con 0x7fe230105300 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.565+0000 7fe234bc6640 1 -- 172.21.15.92:0/3329632308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2301a0720 con 0x7fe230105300 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.565+0000 7fe21f7fe640 1 -- 172.21.15.92:0/3329632308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe22400de50 con 0x7fe230105300 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.565+0000 7fe21f7fe640 1 -- 172.21.15.92:0/3329632308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22400f620 con 0x7fe230105300 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.565+0000 7fe234bc6640 1 -- 172.21.15.92:0/3329632308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2301a6e80 con 0x7fe230105300 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.566+0000 7fe234bc6640 1 -- 172.21.15.92:0/3329632308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe230104dc0 con 0x7fe230105300 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.567+0000 7fe21f7fe640 1 -- 172.21.15.92:0/3329632308 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fe22401a070 con 0x7fe230105300 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.568+0000 7fe21f7fe640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2180b6560 0x7fe2180b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.568+0000 7fe22e59c640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2180b6560 0x7fe2180b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:30.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.568+0000 7fe21f7fe640 1 -- 172.21.15.92:0/3329632308 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fe2240e6990 con 0x7fe230105300 2024-09-21T07:10:30.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.569+0000 7fe22e59c640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2180b6560 0x7fe2180b8a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe220006fd0 tx=0x7fe220008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:30.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.571+0000 7fe21f7fe640 1 -- 172.21.15.92:0/3329632308 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2240ad5f0 con 0x7fe230105300 2024-09-21T07:10:30.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.791+0000 7fe234bc6640 1 -- 172.21.15.92:0/3329632308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe23019b5f0 con 0x7fe230105300 2024-09-21T07:10:30.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.792+0000 7fe21f7fe640 1 -- 172.21.15.92:0/3329632308 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7fe23019b5f0 con 0x7fe230105300 2024-09-21T07:10:30.794 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:30.794 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-21T07:10:30:245330+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T07:10:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-21T07:10:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 -- 172.21.15.92:0/3329632308 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2180b6560 msgr2=0x7fe2180b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2180b6560 0x7fe2180b8a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe220006fd0 tx=0x7fe220008040 comp rx=0 tx=0).stop 2024-09-21T07:10:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 -- 172.21.15.92:0/3329632308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe230105300 msgr2=0x7fe23019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe230105300 0x7fe23019aa60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe22400d740 tx=0x7fe22400dc00 comp rx=0 tx=0).stop 2024-09-21T07:10:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 -- 172.21.15.92:0/3329632308 shutdown_connections 2024-09-21T07:10:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2180b6560 0x7fe2180b8a70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe23010de10 0x7fe23019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe230105300 0x7fe23019aa60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 --2- 172.21.15.92:0/3329632308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2301049b0 0x7fe23019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:30.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 -- 172.21.15.92:0/3329632308 >> 172.21.15.92:0/3329632308 conn(0x7fe230079730 msgr2=0x7fe2300ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:30.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 -- 172.21.15.92:0/3329632308 shutdown_connections 2024-09-21T07:10:30.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:30.794+0000 7fe234bc6640 1 -- 172.21.15.92:0/3329632308 wait complete. 2024-09-21T07:10:31.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:31 smithi092 ceph-mon[30987]: Deploying daemon mds.h on smithi169 2024-09-21T07:10:31.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:31 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] up:boot 2024-09-21T07:10:31.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:31 smithi092 ceph-mon[30987]: fsmap 7 up:standby 2024-09-21T07:10:31.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:31 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:10:31.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:31 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3329632308' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:31.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:31 smithi175 ceph-mon[34064]: Deploying daemon mds.h on smithi169 2024-09-21T07:10:31.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:31 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] up:boot 2024-09-21T07:10:31.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:31 smithi175 ceph-mon[34064]: fsmap 7 up:standby 2024-09-21T07:10:31.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:31 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:10:31.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:31 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3329632308' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:31.534 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:31 smithi169 ceph-mon[33705]: Deploying daemon mds.h on smithi169 2024-09-21T07:10:31.534 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:31 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] up:boot 2024-09-21T07:10:31.534 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:31 smithi169 ceph-mon[33705]: fsmap 7 up:standby 2024-09-21T07:10:31.534 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:31 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:10:31.534 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:31 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3329632308' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:31.893 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:10:31 smithi169 systemd[1]: Starting Ceph mds.h for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:32.224 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:10:31 smithi169 podman[62722]: 2024-09-21 07:10:31.825906539 +0000 UTC m=+0.015922067 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:32.268 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:10:31 smithi169 podman[62722]: 2024-09-21 07:10:31.942093754 +0000 UTC m=+0.132109269 container create 5ca148c1383d0df514ddf508498f51243aeda14db09d873703e1678b1718ada2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T07:10:32.268 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:10:32 smithi169 podman[62722]: 2024-09-21 07:10:32.223426856 +0000 UTC m=+0.413442384 container init 5ca148c1383d0df514ddf508498f51243aeda14db09d873703e1678b1718ada2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:10:32.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:32 smithi175 ceph-mon[34064]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:32 smithi092 ceph-mon[30987]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:32 smithi169 ceph-mon[33705]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:32.643 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:10:32 smithi169 podman[62722]: 2024-09-21 07:10:32.226271887 +0000 UTC m=+0.416287406 container start 5ca148c1383d0df514ddf508498f51243aeda14db09d873703e1678b1718ada2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T07:10:32.643 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:10:32 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h[62737]: starting mds.h at 2024-09-21T07:10:32.644 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:10:32 smithi169 bash[62722]: 5ca148c1383d0df514ddf508498f51243aeda14db09d873703e1678b1718ada2 2024-09-21T07:10:32.644 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:10:32 smithi169 systemd[1]: Started Ceph mds.h for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:33.508 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:10:33.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:33 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:33.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:33 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:33.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:33 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:33.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:33 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:33.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:33 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:33.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:33 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:33.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:33 smithi169 ceph-mon[33705]: Deploying daemon mds.i on smithi175 2024-09-21T07:10:33.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:33 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.169:6836/2116680832,v1:172.21.15.169:6837/2116680832] up:boot 2024-09-21T07:10:33.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:33 smithi169 ceph-mon[33705]: fsmap 8 up:standby 2024-09-21T07:10:33.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:33 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:10:33.766 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:33.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:33 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:33.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:33 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:33.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:33 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:33.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:33 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:33.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:33 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:33.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:33 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:33.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:33 smithi175 ceph-mon[34064]: Deploying daemon mds.i on smithi175 2024-09-21T07:10:33.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:33 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.169:6836/2116680832,v1:172.21.15.169:6837/2116680832] up:boot 2024-09-21T07:10:33.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:33 smithi175 ceph-mon[34064]: fsmap 8 up:standby 2024-09-21T07:10:33.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:33 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:10:33.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:33 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:33.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:33 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:33.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:33 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:33.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:33 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:33.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:33 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:33.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:33 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:33.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:33 smithi092 ceph-mon[30987]: Deploying daemon mds.i on smithi175 2024-09-21T07:10:33.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:33 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.169:6836/2116680832,v1:172.21.15.169:6837/2116680832] up:boot 2024-09-21T07:10:33.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:33 smithi092 ceph-mon[30987]: fsmap 8 up:standby 2024-09-21T07:10:33.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:33 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:10:34.380 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:10:34 smithi175 systemd[1]: Starting Ceph mds.i for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:34.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3383940876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbd4108460 msgr2=0x7fdbd4108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:34.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 --2- 172.21.15.92:0/3383940876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbd4108460 0x7fdbd4108870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009900 tx=0x7fdbc402a410 comp rx=0 tx=0).stop 2024-09-21T07:10:34.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3383940876 shutdown_connections 2024-09-21T07:10:34.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 --2- 172.21.15.92:0/3383940876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4108db0 0x7fdbd410f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 --2- 172.21.15.92:0/3383940876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbd4108460 0x7fdbd4108870 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 --2- 172.21.15.92:0/3383940876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbd41031f0 0x7fdbd4103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3383940876 >> 172.21.15.92:0/3383940876 conn(0x7fdbd4079ec0 msgr2=0x7fdbd407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3383940876 shutdown_connections 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3383940876 wait complete. 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 Processor -- start 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.408+0000 7fdbdc54f640 1 -- start start 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbdc54f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbd41031f0 0x7fdbd4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbdc54f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbd4108460 0x7fdbd41998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbdc54f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4108db0 0x7fdbd419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbdc54f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4112920 con 0x7fdbd41031f0 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbdc54f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41127a0 con 0x7fdbd4108db0 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbdc54f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4112aa0 con 0x7fdbd4108460 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbda2eb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbd41031f0 0x7fdbd4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbda2eb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbd41031f0 0x7fdbd4199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41846/0 (socket says 172.21.15.92:41846) 2024-09-21T07:10:34.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbda2eb640 1 -- 172.21.15.92:0/3456773785 learned_addr learned my addr 172.21.15.92:0/3456773785 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbd9aea640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbd4108460 0x7fdbd41998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbdaaec640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4108db0 0x7fdbd419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbda2eb640 1 -- 172.21.15.92:0/3456773785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbd4108460 msgr2=0x7fdbd41998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbda2eb640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbd4108460 0x7fdbd41998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbda2eb640 1 -- 172.21.15.92:0/3456773785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4108db0 msgr2=0x7fdbd419eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbda2eb640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4108db0 0x7fdbd419eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbda2eb640 1 -- 172.21.15.92:0/3456773785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd419f2c0 con 0x7fdbd41031f0 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbda2eb640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbd41031f0 0x7fdbd4199350 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000e9f0 tx=0x7fdbd000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbcb7fe640 1 -- 172.21.15.92:0/3456773785 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000cd80 con 0x7fdbd41031f0 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3456773785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd419f5b0 con 0x7fdbd41031f0 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbcb7fe640 1 -- 172.21.15.92:0/3456773785 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbd00054b0 con 0x7fdbd41031f0 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.409+0000 7fdbcb7fe640 1 -- 172.21.15.92:0/3456773785 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0010430 con 0x7fdbd41031f0 2024-09-21T07:10:34.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.410+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3456773785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd41a5d10 con 0x7fdbd41031f0 2024-09-21T07:10:34.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.410+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3456773785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd4103600 con 0x7fdbd41031f0 2024-09-21T07:10:34.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.412+0000 7fdbcb7fe640 1 -- 172.21.15.92:0/3456773785 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fdbd00046c0 con 0x7fdbd41031f0 2024-09-21T07:10:34.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.413+0000 7fdbcb7fe640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdbc00b6560 0x7fdbc00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:34.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.413+0000 7fdbd9aea640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdbc00b6560 0x7fdbc00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:34.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.413+0000 7fdbcb7fe640 1 -- 172.21.15.92:0/3456773785 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fdbd00e75b0 con 0x7fdbd41031f0 2024-09-21T07:10:34.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.413+0000 7fdbd9aea640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdbc00b6560 0x7fdbc00b8a70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4005940 tx=0x7fdbc40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:34.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.416+0000 7fdbcb7fe640 1 -- 172.21.15.92:0/3456773785 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdbd0056710 con 0x7fdbd41031f0 2024-09-21T07:10:34.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:34 smithi092 ceph-mon[30987]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:34.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.634+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3456773785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbd410abe0 con 0x7fdbd41031f0 2024-09-21T07:10:34.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.635+0000 7fdbcb7fe640 1 -- 172.21.15.92:0/3456773785 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7fdbd00ae210 con 0x7fdbd41031f0 2024-09-21T07:10:34.637 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:34.637 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":9,"btime":"2024-09-21T07:10:33:263255+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T07:10:34.637 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 9 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3456773785 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdbc00b6560 msgr2=0x7fdbc00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdbc00b6560 0x7fdbc00b8a70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4005940 tx=0x7fdbc40058d0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3456773785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbd41031f0 msgr2=0x7fdbd4199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbd41031f0 0x7fdbd4199350 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000e9f0 tx=0x7fdbd000edf0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3456773785 shutdown_connections 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdbc00b6560 0x7fdbc00b8a70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4108db0 0x7fdbd419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbd4108460 0x7fdbd41998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 --2- 172.21.15.92:0/3456773785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbd41031f0 0x7fdbd4199350 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3456773785 >> 172.21.15.92:0/3456773785 conn(0x7fdbd4079ec0 msgr2=0x7fdbd41044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:34.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3456773785 shutdown_connections 2024-09-21T07:10:34.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:34.637+0000 7fdbdc54f640 1 -- 172.21.15.92:0/3456773785 wait complete. 2024-09-21T07:10:34.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:34 smithi169 ceph-mon[33705]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:34.669 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:34 smithi175 ceph-mon[34064]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:34.670 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:10:34 smithi175 podman[62727]: 2024-09-21 07:10:34.409817379 +0000 UTC m=+0.016029019 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:34.670 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:10:34 smithi175 podman[62727]: 2024-09-21 07:10:34.550590129 +0000 UTC m=+0.156801754 container create af83965619687978edfc7c0a49b5b719e38d9903c49ea44b6311ddd5e312c161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T07:10:35.018 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:10:34 smithi175 podman[62727]: 2024-09-21 07:10:34.795022745 +0000 UTC m=+0.401234378 container init af83965619687978edfc7c0a49b5b719e38d9903c49ea44b6311ddd5e312c161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T07:10:35.018 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:10:34 smithi175 podman[62727]: 2024-09-21 07:10:34.797936233 +0000 UTC m=+0.404147858 container start af83965619687978edfc7c0a49b5b719e38d9903c49ea44b6311ddd5e312c161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T07:10:35.018 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:10:34 smithi175 ceph-mds[62747]: -- 172.21.15.175:0/185152353 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f1a6021860 con 0x55f1aa1c9180 2024-09-21T07:10:35.018 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:10:34 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: starting mds.i at 2024-09-21T07:10:35.018 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:10:34 smithi175 bash[62727]: af83965619687978edfc7c0a49b5b719e38d9903c49ea44b6311ddd5e312c161 2024-09-21T07:10:35.018 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:10:34 smithi175 systemd[1]: Started Ceph mds.i for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:35.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:35 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3456773785' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:35.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:35.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:35.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:35.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:35.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:35.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:35 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:35.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:35 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3456773785' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:35.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:35.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:35.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:35.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:35.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:35.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:35 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:35.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:35 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3456773785' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:35.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:35.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:35.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:35.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:35.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:35.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:35 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:36.607 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:36 smithi092 ceph-mon[30987]: Deploying daemon mds.g on smithi092 2024-09-21T07:10:36.607 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:36 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] up:boot 2024-09-21T07:10:36.607 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:36 smithi092 ceph-mon[30987]: fsmap 9 up:standby 2024-09-21T07:10:36.607 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:36 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:10:36.607 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:36 smithi092 ceph-mon[30987]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:36.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:36 smithi169 ceph-mon[33705]: Deploying daemon mds.g on smithi092 2024-09-21T07:10:36.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:36 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] up:boot 2024-09-21T07:10:36.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:36 smithi169 ceph-mon[33705]: fsmap 9 up:standby 2024-09-21T07:10:36.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:36 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:10:36.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:36 smithi169 ceph-mon[33705]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:36 smithi175 ceph-mon[34064]: Deploying daemon mds.g on smithi092 2024-09-21T07:10:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:36 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] up:boot 2024-09-21T07:10:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:36 smithi175 ceph-mon[34064]: fsmap 9 up:standby 2024-09-21T07:10:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:36 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:10:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:36 smithi175 ceph-mon[34064]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:37.299 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:10:37 smithi092 systemd[1]: Starting Ceph mds.g for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:37.334 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:10:37.588 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:10:37 smithi092 podman[72636]: 2024-09-21 07:10:37.200431017 +0000 UTC m=+0.015837151 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:37.588 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:10:37 smithi092 podman[72636]: 2024-09-21 07:10:37.316693714 +0000 UTC m=+0.132099893 container create ee112da5b2b713ba4e39615459ce537f48c026dd2e5a9972d1b3d4271ef25e3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T07:10:37.588 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:10:37 smithi092 podman[72636]: 2024-09-21 07:10:37.586623309 +0000 UTC m=+0.402029451 container init ee112da5b2b713ba4e39615459ce537f48c026dd2e5a9972d1b3d4271ef25e3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T07:10:37.821 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:37.862 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:10:37 smithi092 podman[72636]: 2024-09-21 07:10:37.590273749 +0000 UTC m=+0.405679892 container start ee112da5b2b713ba4e39615459ce537f48c026dd2e5a9972d1b3d4271ef25e3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T07:10:37.862 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:10:37 smithi092 ceph-mds[72685]: -- 172.21.15.92:0/1397243570 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d0cb56d860 con 0x55d0cf715a80 2024-09-21T07:10:37.862 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:10:37 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g[72669]: starting mds.g at 2024-09-21T07:10:37.862 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:10:37 smithi092 bash[72636]: ee112da5b2b713ba4e39615459ce537f48c026dd2e5a9972d1b3d4271ef25e3d 2024-09-21T07:10:37.862 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:10:37 smithi092 systemd[1]: Started Ceph mds.g for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:38.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 -- 172.21.15.92:0/3953384364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd0102a60 msgr2=0x7f1bd0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:38.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 --2- 172.21.15.92:0/3953384364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd0102a60 0x7f1bd0102e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009900 tx=0x7f1bcc02a410 comp rx=0 tx=0).stop 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 -- 172.21.15.92:0/3953384364 shutdown_connections 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 --2- 172.21.15.92:0/3953384364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd0108cf0 0x7f1bd010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 --2- 172.21.15.92:0/3953384364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bd01083a0 0x7f1bd01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 --2- 172.21.15.92:0/3953384364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd0102a60 0x7f1bd0102e70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 -- 172.21.15.92:0/3953384364 >> 172.21.15.92:0/3953384364 conn(0x7f1bd0079720 msgr2=0x7f1bd0079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 -- 172.21.15.92:0/3953384364 shutdown_connections 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 -- 172.21.15.92:0/3953384364 wait complete. 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 Processor -- start 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.322+0000 7f1bd703c640 1 -- start start 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bd703c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd0102a60 0x7f1bd019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bd703c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd01083a0 0x7f1bd019b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bd703c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bd0108cf0 0x7f1bd019bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:38.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bd703c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01128f0 con 0x7f1bd01083a0 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bd703c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0112770 con 0x7f1bd0108cf0 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bd703c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0112a70 con 0x7f1bd0102a60 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bc7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd01083a0 0x7f1bd019b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bc7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd01083a0 0x7f1bd019b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41870/0 (socket says 172.21.15.92:41870) 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bc7fff640 1 -- 172.21.15.92:0/1213270926 learned_addr learned my addr 172.21.15.92:0/1213270926 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bd4dd8640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd0102a60 0x7f1bd019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bd55d9640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bd0108cf0 0x7f1bd019bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bc7fff640 1 -- 172.21.15.92:0/1213270926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd0102a60 msgr2=0x7f1bd019b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bc7fff640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd0102a60 0x7f1bd019b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bc7fff640 1 -- 172.21.15.92:0/1213270926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bd0108cf0 msgr2=0x7f1bd019bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bc7fff640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bd0108cf0 0x7f1bd019bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.323+0000 7f1bc7fff640 1 -- 172.21.15.92:0/1213270926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd01a6590 con 0x7f1bd01083a0 2024-09-21T07:10:38.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.324+0000 7f1bc7fff640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd01083a0 0x7f1bd019b840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b450 tx=0x7f1bc000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.324+0000 7f1bc5ffb640 1 -- 172.21.15.92:0/1213270926 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0015020 con 0x7f1bd01083a0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.324+0000 7f1bc5ffb640 1 -- 172.21.15.92:0/1213270926 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bc0011d20 con 0x7f1bd01083a0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.324+0000 7f1bd703c640 1 -- 172.21.15.92:0/1213270926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd01a6880 con 0x7f1bd01083a0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.324+0000 7f1bc5ffb640 1 -- 172.21.15.92:0/1213270926 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0010e10 con 0x7f1bd01083a0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.324+0000 7f1bd703c640 1 -- 172.21.15.92:0/1213270926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd01a6e40 con 0x7f1bd01083a0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.325+0000 7f1bd703c640 1 -- 172.21.15.92:0/1213270926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd0103ce0 con 0x7f1bd01083a0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.326+0000 7f1bc5ffb640 1 -- 172.21.15.92:0/1213270926 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1bc0018020 con 0x7f1bd01083a0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.327+0000 7f1bc5ffb640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1bb80b6590 0x7f1bb80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.327+0000 7f1bd4dd8640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1bb80b6590 0x7f1bb80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.327+0000 7f1bc5ffb640 1 -- 172.21.15.92:0/1213270926 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7f1bc00e6c50 con 0x7f1bd01083a0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.327+0000 7f1bd4dd8640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1bb80b6590 0x7f1bb80b8aa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1bd006c6e0 tx=0x7f1bcc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:38.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.330+0000 7f1bc5ffb640 1 -- 172.21.15.92:0/1213270926 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1bc001f020 con 0x7f1bd01083a0 2024-09-21T07:10:38.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.562+0000 7f1bd703c640 1 -- 172.21.15.92:0/1213270926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bd006bf90 con 0x7f1bd01083a0 2024-09-21T07:10:38.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.563+0000 7f1bc5ffb640 1 -- 172.21.15.92:0/1213270926 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8881 (secure 0 0 0) 0x7f1bc000d040 con 0x7f1bd01083a0 2024-09-21T07:10:38.565 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:38.565 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":11,"btime":"2024-09-21T07:10:37:678499+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T07:10:38.565 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 11 2024-09-21T07:10:38.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 -- 172.21.15.92:0/1213270926 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1bb80b6590 msgr2=0x7f1bb80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1bb80b6590 0x7f1bb80b8aa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1bd006c6e0 tx=0x7f1bcc0058d0 comp rx=0 tx=0).stop 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 -- 172.21.15.92:0/1213270926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd01083a0 msgr2=0x7f1bd019b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd01083a0 0x7f1bd019b840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b450 tx=0x7f1bc000b910 comp rx=0 tx=0).stop 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 -- 172.21.15.92:0/1213270926 shutdown_connections 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1bb80b6590 0x7f1bb80b8aa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bd0108cf0 0x7f1bd019bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1bd01083a0 0x7f1bd019b840 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 --2- 172.21.15.92:0/1213270926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd0102a60 0x7f1bd019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 -- 172.21.15.92:0/1213270926 >> 172.21.15.92:0/1213270926 conn(0x7f1bd0079720 msgr2=0x7f1bd0101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 -- 172.21.15.92:0/1213270926 shutdown_connections 2024-09-21T07:10:38.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:38.566+0000 7f1bd703c640 1 -- 172.21.15.92:0/1213270926 wait complete. 2024-09-21T07:10:38.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:38.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.92:6838/1835760933,v1:172.21.15.92:6839/1835760933] up:boot 2024-09-21T07:10:38.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: fsmap 10 up:standby 2024-09-21T07:10:38.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:10:38.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:38.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:38.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:38.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:38.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:38.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:38.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:38 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1213270926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:38.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:38.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.92:6838/1835760933,v1:172.21.15.92:6839/1835760933] up:boot 2024-09-21T07:10:38.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: fsmap 10 up:standby 2024-09-21T07:10:38.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:10:38.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:38.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:38.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:38.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:38.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:38.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:38.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:38 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1213270926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.92:6838/1835760933,v1:172.21.15.92:6839/1835760933] up:boot 2024-09-21T07:10:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: fsmap 10 up:standby 2024-09-21T07:10:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:10:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:39.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:39.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:39.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:39.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:39.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:38 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1213270926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:40.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:39 smithi175 ceph-mon[34064]: Deploying daemon mds.a on smithi092 2024-09-21T07:10:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:39 smithi092 ceph-mon[30987]: Deploying daemon mds.a on smithi092 2024-09-21T07:10:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:39 smithi169 ceph-mon[33705]: Deploying daemon mds.a on smithi092 2024-09-21T07:10:40.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:40 smithi092 ceph-mon[30987]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:41.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:40 smithi175 ceph-mon[34064]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:40 smithi169 ceph-mon[33705]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:41.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:10:41.605 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:42.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.088+0000 7fc98d9d1640 1 -- 172.21.15.92:0/1118968318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc988105270 msgr2=0x7fc98810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:42.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.088+0000 7fc98d9d1640 1 --2- 172.21.15.92:0/1118968318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc988105270 0x7fc98810d8b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009900 tx=0x7fc97c02a410 comp rx=0 tx=0).stop 2024-09-21T07:10:42.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.088+0000 7fc98d9d1640 1 -- 172.21.15.92:0/1118968318 shutdown_connections 2024-09-21T07:10:42.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.088+0000 7fc98d9d1640 1 --2- 172.21.15.92:0/1118968318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc98810ddf0 0x7fc988110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.088+0000 7fc98d9d1640 1 --2- 172.21.15.92:0/1118968318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc988105270 0x7fc98810d8b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.088+0000 7fc98d9d1640 1 --2- 172.21.15.92:0/1118968318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc988104840 0x7fc988104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.088+0000 7fc98d9d1640 1 -- 172.21.15.92:0/1118968318 >> 172.21.15.92:0/1118968318 conn(0x7fc988079730 msgr2=0x7fc988079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:42.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.088+0000 7fc98d9d1640 1 -- 172.21.15.92:0/1118968318 shutdown_connections 2024-09-21T07:10:42.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.088+0000 7fc98d9d1640 1 -- 172.21.15.92:0/1118968318 wait complete. 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc98d9d1640 1 Processor -- start 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc98d9d1640 1 -- start start 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc98d9d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc988104840 0x7fc98819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc98d9d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc988105270 0x7fc98819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc98d9d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc98810ddf0 0x7fc98819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc98d9d1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc988113980 con 0x7fc988105270 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc98d9d1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc988113800 con 0x7fc98810ddf0 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc98d9d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc988113b00 con 0x7fc988104840 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc9867fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc988105270 0x7fc98819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc9867fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc988105270 0x7fc98819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41946/0 (socket says 172.21.15.92:41946) 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc9867fc640 1 -- 172.21.15.92:0/3539002584 learned_addr learned my addr 172.21.15.92:0/3539002584 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.089+0000 7fc986ffd640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc988104840 0x7fc98819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:42.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc9877fe640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc98810ddf0 0x7fc98819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc9867fc640 1 -- 172.21.15.92:0/3539002584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc988104840 msgr2=0x7fc98819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc9867fc640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc988104840 0x7fc98819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc9867fc640 1 -- 172.21.15.92:0/3539002584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc98810ddf0 msgr2=0x7fc98819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc9867fc640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc98810ddf0 0x7fc98819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc9867fc640 1 -- 172.21.15.92:0/3539002584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9881a03c0 con 0x7fc988105270 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc9877fe640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc98810ddf0 0x7fc98819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc9867fc640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc988105270 0x7fc98819a9f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc97c005940 tx=0x7fc97c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc98c9cf640 1 -- 172.21.15.92:0/3539002584 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c03f030 con 0x7fc988105270 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc98c9cf640 1 -- 172.21.15.92:0/3539002584 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc97c003c90 con 0x7fc988105270 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc98c9cf640 1 -- 172.21.15.92:0/3539002584 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c035070 con 0x7fc988105270 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc98d9d1640 1 -- 172.21.15.92:0/3539002584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9881a0650 con 0x7fc988105270 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.090+0000 7fc98d9d1640 1 -- 172.21.15.92:0/3539002584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9881a6e10 con 0x7fc988105270 2024-09-21T07:10:42.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.091+0000 7fc98d9d1640 1 -- 172.21.15.92:0/3539002584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc988104c50 con 0x7fc988105270 2024-09-21T07:10:42.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.093+0000 7fc98c9cf640 1 -- 172.21.15.92:0/3539002584 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fc97c042030 con 0x7fc988105270 2024-09-21T07:10:42.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.093+0000 7fc98c9cf640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9700b6560 0x7fc9700b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:42.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.094+0000 7fc986ffd640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9700b6560 0x7fc9700b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:42.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.094+0000 7fc98c9cf640 1 -- 172.21.15.92:0/3539002584 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fc97c107a80 con 0x7fc988105270 2024-09-21T07:10:42.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.094+0000 7fc986ffd640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9700b6560 0x7fc9700b8a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc98806bc00 tx=0x7fc978009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:42.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.097+0000 7fc98c9cf640 1 -- 172.21.15.92:0/3539002584 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc97c0ce6c0 con 0x7fc988105270 2024-09-21T07:10:42.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.312+0000 7fc98d9d1640 1 -- 172.21.15.92:0/3539002584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc98819b580 con 0x7fc988105270 2024-09-21T07:10:42.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.313+0000 7fc98c9cf640 1 -- 172.21.15.92:0/3539002584 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7fc98819b580 con 0x7fc988105270 2024-09-21T07:10:42.315 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:42.315 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":12,"btime":"2024-09-21T07:10:41:689158+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T07:10:42.316 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 12 2024-09-21T07:10:42.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 -- 172.21.15.92:0/3539002584 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9700b6560 msgr2=0x7fc9700b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:42.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9700b6560 0x7fc9700b8a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc98806bc00 tx=0x7fc978009110 comp rx=0 tx=0).stop 2024-09-21T07:10:42.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 -- 172.21.15.92:0/3539002584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc988105270 msgr2=0x7fc98819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:42.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc988105270 0x7fc98819a9f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc97c005940 tx=0x7fc97c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 -- 172.21.15.92:0/3539002584 shutdown_connections 2024-09-21T07:10:42.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9700b6560 0x7fc9700b8a70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc98810ddf0 0x7fc98819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc988105270 0x7fc98819a9f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 --2- 172.21.15.92:0/3539002584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc988104840 0x7fc98819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 -- 172.21.15.92:0/3539002584 >> 172.21.15.92:0/3539002584 conn(0x7fc988079730 msgr2=0x7fc9880ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:42.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 -- 172.21.15.92:0/3539002584 shutdown_connections 2024-09-21T07:10:42.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:42.316+0000 7fc98d9d1640 1 -- 172.21.15.92:0/3539002584 wait complete. 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: Deploying daemon mds.b on smithi169 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.92:6840/752270354,v1:172.21.15.92:6841/752270354] up:boot 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: fsmap 11 up:standby 2024-09-21T07:10:42.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:42 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:10:42.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:42.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:42.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:42.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:42.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:42.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:42.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: Deploying daemon mds.b on smithi169 2024-09-21T07:10:42.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:42.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.92:6840/752270354,v1:172.21.15.92:6841/752270354] up:boot 2024-09-21T07:10:42.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: fsmap 11 up:standby 2024-09-21T07:10:42.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:42 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:10:42.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:42.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:42.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:42.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:10:42.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:10:42.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:42.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: Deploying daemon mds.b on smithi169 2024-09-21T07:10:42.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:42.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.92:6840/752270354,v1:172.21.15.92:6841/752270354] up:boot 2024-09-21T07:10:42.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: fsmap 11 up:standby 2024-09-21T07:10:42.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:42 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:10:43.566 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:43 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3539002584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:43.566 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:10:43 smithi169 systemd[1]: Starting Ceph mds.b for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:10:43.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:43 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3539002584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:43.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:43 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3539002584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:43.818 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:10:43 smithi169 podman[62993]: 2024-09-21 07:10:43.467143803 +0000 UTC m=+0.016227348 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:10:43.818 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:10:43 smithi169 podman[62993]: 2024-09-21 07:10:43.57268657 +0000 UTC m=+0.121770145 container create 9c04609fae8d10caf9bb01d32200819d36af67074bc4835ba02018a48bff392c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T07:10:43.818 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:10:43 smithi169 podman[62993]: 2024-09-21 07:10:43.817286758 +0000 UTC m=+0.366370302 container init 9c04609fae8d10caf9bb01d32200819d36af67074bc4835ba02018a48bff392c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:10:44.143 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:10:43 smithi169 podman[62993]: 2024-09-21 07:10:43.820434305 +0000 UTC m=+0.369517844 container start 9c04609fae8d10caf9bb01d32200819d36af67074bc4835ba02018a48bff392c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T07:10:44.143 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:10:43 smithi169 ceph-mds[63012]: -- 172.21.15.169:0/995652678 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556875a4b860 con 0x556879bf3600 2024-09-21T07:10:44.144 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:10:43 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b[63008]: starting mds.b at 2024-09-21T07:10:44.144 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:10:43 smithi169 bash[62993]: 9c04609fae8d10caf9bb01d32200819d36af67074bc4835ba02018a48bff392c 2024-09-21T07:10:44.144 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:10:43 smithi169 systemd[1]: Started Ceph mds.b for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:10:44.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:44 smithi092 ceph-mon[30987]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:44.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:44 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:44.624 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:44 smithi169 ceph-mon[33705]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:44.624 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.624 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.624 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.624 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.624 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.624 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:44 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:44.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:44 smithi175 ceph-mon[34064]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:44.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:44.650 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:44 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:45.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:10:45.347 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:45.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:45 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] up:boot 2024-09-21T07:10:45.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:45 smithi092 ceph-mon[30987]: fsmap 12 up:standby 2024-09-21T07:10:45.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:45 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:10:45.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:45 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] up:boot 2024-09-21T07:10:45.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:45 smithi169 ceph-mon[33705]: fsmap 12 up:standby 2024-09-21T07:10:45.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:45 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:10:45.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:45 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] up:boot 2024-09-21T07:10:45.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:45 smithi175 ceph-mon[34064]: fsmap 12 up:standby 2024-09-21T07:10:45.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:45 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.843+0000 7efe0c11c640 1 -- 172.21.15.92:0/88574312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe04108d70 msgr2=0x7efe0410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.843+0000 7efe0c11c640 1 --2- 172.21.15.92:0/88574312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe04108d70 0x7efe0410f5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efdfc009ca0 tx=0x7efdfc02a8e0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.843+0000 7efe0c11c640 1 -- 172.21.15.92:0/88574312 shutdown_connections 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.843+0000 7efe0c11c640 1 --2- 172.21.15.92:0/88574312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe04108d70 0x7efe0410f5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.843+0000 7efe0c11c640 1 --2- 172.21.15.92:0/88574312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe04108420 0x7efe04108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.843+0000 7efe0c11c640 1 --2- 172.21.15.92:0/88574312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe04102ae0 0x7efe04102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.843+0000 7efe0c11c640 1 -- 172.21.15.92:0/88574312 >> 172.21.15.92:0/88574312 conn(0x7efe04079770 msgr2=0x7efe04079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.843+0000 7efe0c11c640 1 -- 172.21.15.92:0/88574312 shutdown_connections 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.843+0000 7efe0c11c640 1 -- 172.21.15.92:0/88574312 wait complete. 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe0c11c640 1 Processor -- start 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe0c11c640 1 -- start start 2024-09-21T07:10:45.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe0c11c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe04102ae0 0x7efe040ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe0c11c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe04108420 0x7efe040ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe0c11c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe04108d70 0x7efe041000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe0c11c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe04112920 con 0x7efe04102ae0 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe0c11c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efe041127a0 con 0x7efe04108420 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe0c11c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe04112aa0 con 0x7efe04108d70 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe09eb8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe04102ae0 0x7efe040ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe09eb8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe04102ae0 0x7efe040ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41960/0 (socket says 172.21.15.92:41960) 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.844+0000 7efe09eb8640 1 -- 172.21.15.92:0/2646203355 learned_addr learned my addr 172.21.15.92:0/2646203355 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe096b7640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe04108420 0x7efe040ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe0a6b9640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe04108d70 0x7efe041000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe09eb8640 1 -- 172.21.15.92:0/2646203355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe04108d70 msgr2=0x7efe041000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe09eb8640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe04108d70 0x7efe041000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe09eb8640 1 -- 172.21.15.92:0/2646203355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe04108420 msgr2=0x7efe040ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe09eb8640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe04108420 0x7efe040ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe09eb8640 1 -- 172.21.15.92:0/2646203355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe041a8800 con 0x7efe04102ae0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe0a6b9640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe04108d70 0x7efe041000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe09eb8640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe04102ae0 0x7efe040ff670 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efdf800c890 tx=0x7efdf800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efdf6ffd640 1 -- 172.21.15.92:0/2646203355 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf8004220 con 0x7efe04102ae0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efdf6ffd640 1 -- 172.21.15.92:0/2646203355 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdf8007e40 con 0x7efe04102ae0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe0c11c640 1 -- 172.21.15.92:0/2646203355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe041a8af0 con 0x7efe04102ae0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efdf6ffd640 1 -- 172.21.15.92:0/2646203355 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf80047a0 con 0x7efe04102ae0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.845+0000 7efe0c11c640 1 -- 172.21.15.92:0/2646203355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe041a9080 con 0x7efe04102ae0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.846+0000 7efe0c11c640 1 -- 172.21.15.92:0/2646203355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe04103d60 con 0x7efe04102ae0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.848+0000 7efdf6ffd640 1 -- 172.21.15.92:0/2646203355 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7efdf80079b0 con 0x7efe04102ae0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.849+0000 7efdf6ffd640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdf00b65e0 0x7efdf00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.849+0000 7efe096b7640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdf00b65e0 0x7efdf00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.849+0000 7efdf6ffd640 1 -- 172.21.15.92:0/2646203355 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7efdf80e7010 con 0x7efe04102ae0 2024-09-21T07:10:45.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.849+0000 7efe096b7640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdf00b65e0 0x7efdf00b8af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe041054b0 tx=0x7efe00009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:45.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:45.852+0000 7efdf6ffd640 1 -- 172.21.15.92:0/2646203355 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efdf8014030 con 0x7efe04102ae0 2024-09-21T07:10:46.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.080+0000 7efe0c11c640 1 -- 172.21.15.92:0/2646203355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe04102ef0 con 0x7efe04102ae0 2024-09-21T07:10:46.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.081+0000 7efdf6ffd640 1 -- 172.21.15.92:0/2646203355 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7efe04102ef0 con 0x7efe04102ae0 2024-09-21T07:10:46.084 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:46.084 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":13,"btime":"2024-09-21T07:10:44:311841+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T07:10:46.084 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 13 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 -- 172.21.15.92:0/2646203355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdf00b65e0 msgr2=0x7efdf00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdf00b65e0 0x7efdf00b8af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe041054b0 tx=0x7efe00009110 comp rx=0 tx=0).stop 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 -- 172.21.15.92:0/2646203355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe04102ae0 msgr2=0x7efe040ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe04102ae0 0x7efe040ff670 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efdf800c890 tx=0x7efdf800cc90 comp rx=0 tx=0).stop 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 -- 172.21.15.92:0/2646203355 shutdown_connections 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7efdf00b65e0 0x7efdf00b8af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe04108d70 0x7efe041000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe04108420 0x7efe040ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 --2- 172.21.15.92:0/2646203355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe04102ae0 0x7efe040ff670 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 -- 172.21.15.92:0/2646203355 >> 172.21.15.92:0/2646203355 conn(0x7efe04079770 msgr2=0x7efe04101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 -- 172.21.15.92:0/2646203355 shutdown_connections 2024-09-21T07:10:46.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:46.084+0000 7efe0c11c640 1 -- 172.21.15.92:0/2646203355 wait complete. 2024-09-21T07:10:46.761 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.761 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.761 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.761 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:46.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:46.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:46.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:46.762 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:46 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2646203355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:46.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:46.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:46 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2646203355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:46.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:46.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:46 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2646203355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:10:46.811 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T07:10:47.713 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:48.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.244+0000 7fdac066c640 1 -- 172.21.15.92:0/3117452623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8108cf0 msgr2=0x7fdab810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.244+0000 7fdac066c640 1 --2- 172.21.15.92:0/3117452623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8108cf0 0x7fdab810f520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009ca0 tx=0x7fdab002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.244+0000 7fdac066c640 1 -- 172.21.15.92:0/3117452623 shutdown_connections 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.244+0000 7fdac066c640 1 --2- 172.21.15.92:0/3117452623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8108cf0 0x7fdab810f520 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.244+0000 7fdac066c640 1 --2- 172.21.15.92:0/3117452623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdab81083a0 0x7fdab81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.244+0000 7fdac066c640 1 --2- 172.21.15.92:0/3117452623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdab8102a60 0x7fdab8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.244+0000 7fdac066c640 1 -- 172.21.15.92:0/3117452623 >> 172.21.15.92:0/3117452623 conn(0x7fdab8079730 msgr2=0x7fdab8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.244+0000 7fdac066c640 1 -- 172.21.15.92:0/3117452623 shutdown_connections 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.244+0000 7fdac066c640 1 -- 172.21.15.92:0/3117452623 wait complete. 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdac066c640 1 Processor -- start 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdac066c640 1 -- start start 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdac066c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdab8102a60 0x7fdab819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdac066c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab81083a0 0x7fdab819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdac066c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdab8108cf0 0x7fdab819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdac066c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdab81128c0 con 0x7fdab81083a0 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdac066c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8112740 con 0x7fdab8102a60 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdac066c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8112a40 con 0x7fdab8108cf0 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdabdc07640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab81083a0 0x7fdab819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdabdc07640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab81083a0 0x7fdab819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41978/0 (socket says 172.21.15.92:41978) 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdabdc07640 1 -- 172.21.15.92:0/2830400438 learned_addr learned my addr 172.21.15.92:0/2830400438 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.245+0000 7fdabe408640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdab8102a60 0x7fdab819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdabec09640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdab8108cf0 0x7fdab819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdabdc07640 1 -- 172.21.15.92:0/2830400438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdab8108cf0 msgr2=0x7fdab819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdabdc07640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdab8108cf0 0x7fdab819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdabdc07640 1 -- 172.21.15.92:0/2830400438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdab8102a60 msgr2=0x7fdab819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdabdc07640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdab8102a60 0x7fdab819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdabdc07640 1 -- 172.21.15.92:0/2830400438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab81a02f0 con 0x7fdab81083a0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdabec09640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdab8108cf0 0x7fdab819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdabdc07640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab81083a0 0x7fdab819a9e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdab400b450 tx=0x7fdab400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdaab7fe640 1 -- 172.21.15.92:0/2830400438 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4015020 con 0x7fdab81083a0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdaab7fe640 1 -- 172.21.15.92:0/2830400438 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdab4011cc0 con 0x7fdab81083a0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdac066c640 1 -- 172.21.15.92:0/2830400438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab81a05e0 con 0x7fdab81083a0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdaab7fe640 1 -- 172.21.15.92:0/2830400438 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4010d00 con 0x7fdab81083a0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.246+0000 7fdac066c640 1 -- 172.21.15.92:0/2830400438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab81a6e00 con 0x7fdab81083a0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.247+0000 7fdac066c640 1 -- 172.21.15.92:0/2830400438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab8102e70 con 0x7fdab81083a0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.249+0000 7fdaab7fe640 1 -- 172.21.15.92:0/2830400438 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fdab4018020 con 0x7fdab81083a0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.249+0000 7fdaab7fe640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdaa40b6590 0x7fdaa40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.249+0000 7fdabe408640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdaa40b6590 0x7fdaa40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.250+0000 7fdaab7fe640 1 -- 172.21.15.92:0/2830400438 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7fdab40e6d00 con 0x7fdab81083a0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.250+0000 7fdabe408640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdaa40b6590 0x7fdaa40b8aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00abe0 tx=0x7fdaac00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:48.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.253+0000 7fdaab7fe640 1 -- 172.21.15.92:0/2830400438 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdab401f020 con 0x7fdab81083a0 2024-09-21T07:10:48.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.441+0000 7fdac066c640 1 -- 172.21.15.92:0/2830400438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdab819b570 con 0x7fdab81083a0 2024-09-21T07:10:48.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.441+0000 7fdaab7fe640 1 -- 172.21.15.92:0/2830400438 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7fdab819b570 con 0x7fdab81083a0 2024-09-21T07:10:48.444 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:10:48.444 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2024-09-21T07:10:48.444 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:10:48.444 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 1, 2024-09-21T07:10:48.445 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": ".mgr" 2024-09-21T07:10:48.445 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:10:48.445 INFO:teuthology.orchestra.run.smithi092.stdout:] 2024-09-21T07:10:48.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 -- 172.21.15.92:0/2830400438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdaa40b6590 msgr2=0x7fdaa40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdaa40b6590 0x7fdaa40b8aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00abe0 tx=0x7fdaac00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 -- 172.21.15.92:0/2830400438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab81083a0 msgr2=0x7fdab819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab81083a0 0x7fdab819a9e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdab400b450 tx=0x7fdab400b850 comp rx=0 tx=0).stop 2024-09-21T07:10:48.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 -- 172.21.15.92:0/2830400438 shutdown_connections 2024-09-21T07:10:48.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdaa40b6590 0x7fdaa40b8aa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdab8108cf0 0x7fdab819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab81083a0 0x7fdab819a9e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 --2- 172.21.15.92:0/2830400438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdab8102a60 0x7fdab819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 -- 172.21.15.92:0/2830400438 >> 172.21.15.92:0/2830400438 conn(0x7fdab8079730 msgr2=0x7fdab80ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:48.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 -- 172.21.15.92:0/2830400438 shutdown_connections 2024-09-21T07:10:48.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:48.443+0000 7fdac066c640 1 -- 172.21.15.92:0/2830400438 wait complete. 2024-09-21T07:10:48.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:48 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:48 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:48 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:48 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:48 smithi175 ceph-mon[34064]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:48.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:48 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:48 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:48 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:48 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:48 smithi092 ceph-mon[30987]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:48.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:48 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:48 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:48 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:48 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:48.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:48 smithi169 ceph-mon[33705]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:49.150 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:10:49.151 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:10:49.414 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:49.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:49 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2830400438' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:10:49.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:49 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:49 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:49 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:49 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:49.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:49 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:49.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:49 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:49 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2830400438' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:10:49.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:49 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:49 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:49 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:49 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:49.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:49 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:49.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:49 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:49 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2830400438' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:10:49.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:49 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:49 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:49 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:49 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:49.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:49 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:49.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:49 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:10:49.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.935+0000 7fade9748640 1 -- 172.21.15.92:0/1619079737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4104840 msgr2=0x7fade4104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.935+0000 7fade9748640 1 --2- 172.21.15.92:0/1619079737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4104840 0x7fade4104c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faddc009900 tx=0x7faddc02a410 comp rx=0 tx=0).stop 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.935+0000 7fade9748640 1 -- 172.21.15.92:0/1619079737 shutdown_connections 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.935+0000 7fade9748640 1 --2- 172.21.15.92:0/1619079737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fade410ddf0 0x7fade4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.935+0000 7fade9748640 1 --2- 172.21.15.92:0/1619079737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4105270 0x7fade410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.935+0000 7fade9748640 1 --2- 172.21.15.92:0/1619079737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4104840 0x7fade4104c50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.935+0000 7fade9748640 1 -- 172.21.15.92:0/1619079737 >> 172.21.15.92:0/1619079737 conn(0x7fade4079730 msgr2=0x7fade4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.935+0000 7fade9748640 1 -- 172.21.15.92:0/1619079737 shutdown_connections 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.935+0000 7fade9748640 1 -- 172.21.15.92:0/1619079737 wait complete. 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade9748640 1 Processor -- start 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade9748640 1 -- start start 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade9748640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4104840 0x7fade419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade9748640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fade4105270 0x7fade419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade9748640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade410ddf0 0x7fade419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade9748640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fade4113920 con 0x7fade4104840 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade9748640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fade41137a0 con 0x7fade4105270 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade9748640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fade4113aa0 con 0x7fade410ddf0 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4104840 0x7fade419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4104840 0x7fade419a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43150/0 (socket says 172.21.15.92:43150) 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade2ffd640 1 -- 172.21.15.92:0/3392442930 learned_addr learned my addr 172.21.15.92:0/3392442930 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.936+0000 7fade27fc640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fade4105270 0x7fade419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7fade2ffd640 1 -- 172.21.15.92:0/3392442930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade410ddf0 msgr2=0x7fade419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7fade2ffd640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade410ddf0 0x7fade419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7fade2ffd640 1 -- 172.21.15.92:0/3392442930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fade4105270 msgr2=0x7fade419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7fade2ffd640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fade4105270 0x7fade419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7fade2ffd640 1 -- 172.21.15.92:0/3392442930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade41a0360 con 0x7fade4104840 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7fade2ffd640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4104840 0x7fade419a3f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faddc005940 tx=0x7faddc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7faddbfff640 1 -- 172.21.15.92:0/3392442930 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc03f030 con 0x7fade4104840 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7fade9748640 1 -- 172.21.15.92:0/3392442930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade41a05f0 con 0x7fade4104840 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7faddbfff640 1 -- 172.21.15.92:0/3392442930 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faddc003c90 con 0x7fade4104840 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7faddbfff640 1 -- 172.21.15.92:0/3392442930 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc035070 con 0x7fade4104840 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.937+0000 7fade9748640 1 -- 172.21.15.92:0/3392442930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade41a6db0 con 0x7fade4104840 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.938+0000 7fade9748640 1 -- 172.21.15.92:0/3392442930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade4104c50 con 0x7fade4104840 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.939+0000 7faddbfff640 1 -- 172.21.15.92:0/3392442930 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7faddc042030 con 0x7fade4104840 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.940+0000 7faddbfff640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fadd00b6560 0x7fadd00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.940+0000 7fade27fc640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fadd00b6560 0x7fadd00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.940+0000 7faddbfff640 1 -- 172.21.15.92:0/3392442930 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7342+0+0 (secure 0 0 0) 0x7faddc107920 con 0x7fade4104840 2024-09-21T07:10:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.941+0000 7fade27fc640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fadd00b6560 0x7fadd00b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fade4102470 tx=0x7fadcc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:49.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:49.943+0000 7faddbfff640 1 -- 172.21.15.92:0/3392442930 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faddc0ce580 con 0x7fade4104840 2024-09-21T07:10:50.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.123+0000 7fade9748640 1 -- 172.21.15.92:0/3392442930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fade402e640 con 0x7fade4104840 2024-09-21T07:10:50.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.446+0000 7faddbfff640 1 -- 172.21.15.92:0/3392442930 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7faddc0d2960 con 0x7fade4104840 2024-09-21T07:10:50.448 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' created 2024-09-21T07:10:50.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.448+0000 7fade9748640 1 -- 172.21.15.92:0/3392442930 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fadd00b6560 msgr2=0x7fadd00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.448+0000 7fade9748640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fadd00b6560 0x7fadd00b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fade4102470 tx=0x7fadcc00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.448+0000 7fade9748640 1 -- 172.21.15.92:0/3392442930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4104840 msgr2=0x7fade419a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.448+0000 7fade9748640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4104840 0x7fade419a3f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faddc005940 tx=0x7faddc0042f0 comp rx=0 tx=0).stop 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.449+0000 7fade9748640 1 -- 172.21.15.92:0/3392442930 shutdown_connections 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.449+0000 7fade9748640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fadd00b6560 0x7fadd00b8a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.449+0000 7fade9748640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade410ddf0 0x7fade419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.449+0000 7fade9748640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fade4105270 0x7fade419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.449+0000 7fade9748640 1 --2- 172.21.15.92:0/3392442930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4104840 0x7fade419a3f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.449+0000 7fade9748640 1 -- 172.21.15.92:0/3392442930 >> 172.21.15.92:0/3392442930 conn(0x7fade4079730 msgr2=0x7fade41008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.449+0000 7fade9748640 1 -- 172.21.15.92:0/3392442930 shutdown_connections 2024-09-21T07:10:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:50.449+0000 7fade9748640 1 -- 172.21.15.92:0/3392442930 wait complete. 2024-09-21T07:10:50.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:50 smithi175 ceph-mon[34064]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:50.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:50 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3392442930' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:10:50.822 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:50 smithi092 ceph-mon[30987]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:50.822 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:50 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3392442930' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:10:50.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:50 smithi169 ceph-mon[33705]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:50.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:50 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3392442930' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:10:51.161 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T07:10:51.408 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:51.457 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:51 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3392442930' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:10:51.457 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:51 smithi092 ceph-mon[30987]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:10:51.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:51 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3392442930' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:10:51.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:51 smithi175 ceph-mon[34064]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:10:51.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:51 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3392442930' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:10:51.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:51 smithi169 ceph-mon[33705]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:10:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.938+0000 7f64232eb640 1 -- 172.21.15.92:0/2154018551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c101ff0 msgr2=0x7f641c102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.938+0000 7f64232eb640 1 --2- 172.21.15.92:0/2154018551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c101ff0 0x7f641c102400 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6414009900 tx=0x7f641402a410 comp rx=0 tx=0).stop 2024-09-21T07:10:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.938+0000 7f64232eb640 1 -- 172.21.15.92:0/2154018551 shutdown_connections 2024-09-21T07:10:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.938+0000 7f64232eb640 1 --2- 172.21.15.92:0/2154018551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c106c20 0x7f641c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.938+0000 7f64232eb640 1 --2- 172.21.15.92:0/2154018551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f641c1062d0 0x7f641c1066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.938+0000 7f64232eb640 1 --2- 172.21.15.92:0/2154018551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c101ff0 0x7f641c102400 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.938+0000 7f64232eb640 1 -- 172.21.15.92:0/2154018551 >> 172.21.15.92:0/2154018551 conn(0x7f641c077cc0 msgr2=0x7f641c078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.938+0000 7f64232eb640 1 -- 172.21.15.92:0/2154018551 shutdown_connections 2024-09-21T07:10:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.938+0000 7f64232eb640 1 -- 172.21.15.92:0/2154018551 wait complete. 2024-09-21T07:10:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f64232eb640 1 Processor -- start 2024-09-21T07:10:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f64232eb640 1 -- start start 2024-09-21T07:10:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f64232eb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c101ff0 0x7f641c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f64232eb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f641c1062d0 0x7f641c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f64232eb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c106c20 0x7f641c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f64232eb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f641c1139d0 con 0x7f641c101ff0 2024-09-21T07:10:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f64232eb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f641c113850 con 0x7f641c1062d0 2024-09-21T07:10:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f64232eb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f641c113b50 con 0x7f641c106c20 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6421087640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c101ff0 0x7f641c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6421087640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c101ff0 0x7f641c19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43168/0 (socket says 172.21.15.92:43168) 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6421087640 1 -- 172.21.15.92:0/4059590481 learned_addr learned my addr 172.21.15.92:0/4059590481 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6420886640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f641c1062d0 0x7f641c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6421888640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c106c20 0x7f641c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6421087640 1 -- 172.21.15.92:0/4059590481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c106c20 msgr2=0x7f641c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6421087640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c106c20 0x7f641c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6421087640 1 -- 172.21.15.92:0/4059590481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f641c1062d0 msgr2=0x7f641c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6421087640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f641c1062d0 0x7f641c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6421087640 1 -- 172.21.15.92:0/4059590481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c1a0390 con 0x7f641c101ff0 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.939+0000 7f6420886640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f641c1062d0 0x7f641c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.940+0000 7f6421087640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c101ff0 0x7f641c19a4e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6414009a20 tx=0x7f6414004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.940+0000 7f641a7fc640 1 -- 172.21.15.92:0/4059590481 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641403f030 con 0x7f641c101ff0 2024-09-21T07:10:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.940+0000 7f64232eb640 1 -- 172.21.15.92:0/4059590481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641c1a0620 con 0x7f641c101ff0 2024-09-21T07:10:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.940+0000 7f641a7fc640 1 -- 172.21.15.92:0/4059590481 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64140035f0 con 0x7f641c101ff0 2024-09-21T07:10:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.940+0000 7f641a7fc640 1 -- 172.21.15.92:0/4059590481 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414035070 con 0x7f641c101ff0 2024-09-21T07:10:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.940+0000 7f64232eb640 1 -- 172.21.15.92:0/4059590481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f641c1a0b00 con 0x7f641c101ff0 2024-09-21T07:10:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.941+0000 7f64232eb640 1 -- 172.21.15.92:0/4059590481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641c102400 con 0x7f641c101ff0 2024-09-21T07:10:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.942+0000 7f641a7fc640 1 -- 172.21.15.92:0/4059590481 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f6414003aa0 con 0x7f641c101ff0 2024-09-21T07:10:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.943+0000 7f641a7fc640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f64040b6590 0x7f64040b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.943+0000 7f6420886640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f64040b6590 0x7f64040b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.943+0000 7f641a7fc640 1 -- 172.21.15.92:0/4059590481 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7712+0+0 (secure 0 0 0) 0x7f6414108120 con 0x7f641c101ff0 2024-09-21T07:10:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.944+0000 7f6420886640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f64040b6590 0x7f64040b8aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f641c1054e0 tx=0x7f6410008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:51.947+0000 7f641a7fc640 1 -- 172.21.15.92:0/4059590481 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64140cec10 con 0x7f641c101ff0 2024-09-21T07:10:52.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.132+0000 7f64232eb640 1 -- 172.21.15.92:0/4059590481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f641c19b610 con 0x7f641c101ff0 2024-09-21T07:10:52.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.461+0000 7f641a7fc640 1 -- 172.21.15.92:0/4059590481 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v74) ==== 171+0+0 (secure 0 0 0) 0x7f64140d2ff0 con 0x7f641c101ff0 2024-09-21T07:10:52.463 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' created 2024-09-21T07:10:52.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 -- 172.21.15.92:0/4059590481 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f64040b6590 msgr2=0x7f64040b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f64040b6590 0x7f64040b8aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f641c1054e0 tx=0x7f6410008040 comp rx=0 tx=0).stop 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 -- 172.21.15.92:0/4059590481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c101ff0 msgr2=0x7f641c19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c101ff0 0x7f641c19a4e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6414009a20 tx=0x7f6414004270 comp rx=0 tx=0).stop 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 -- 172.21.15.92:0/4059590481 shutdown_connections 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f64040b6590 0x7f64040b8aa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f641c106c20 0x7f641c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f641c1062d0 0x7f641c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 --2- 172.21.15.92:0/4059590481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c101ff0 0x7f641c19a4e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 -- 172.21.15.92:0/4059590481 >> 172.21.15.92:0/4059590481 conn(0x7f641c077cc0 msgr2=0x7f641c107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 -- 172.21.15.92:0/4059590481 shutdown_connections 2024-09-21T07:10:52.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:52.465+0000 7f64232eb640 1 -- 172.21.15.92:0/4059590481 wait complete. 2024-09-21T07:10:52.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:52 smithi175 ceph-mon[34064]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:10:52.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:52 smithi175 ceph-mon[34064]: pgmap v260: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:52.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:52 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/4059590481' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T07:10:52.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:52 smithi092 ceph-mon[30987]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:10:52.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:52 smithi092 ceph-mon[30987]: pgmap v260: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:52.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:52 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4059590481' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T07:10:52.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:52 smithi169 ceph-mon[33705]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:10:52.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:52 smithi169 ceph-mon[33705]: pgmap v260: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:52.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:52 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/4059590481' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T07:10:53.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:10:53.479 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:53.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:53 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/4059590481' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T07:10:53.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:53 smithi175 ceph-mon[34064]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:10:53.775 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:53 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4059590481' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T07:10:53.775 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:53 smithi092 ceph-mon[30987]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:10:53.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:53 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/4059590481' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T07:10:53.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:53 smithi169 ceph-mon[33705]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:10:54.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.009+0000 7f56a20aa640 1 -- 172.21.15.92:0/2703681147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569c1094d0 msgr2=0x7f569c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.009+0000 7f56a20aa640 1 --2- 172.21.15.92:0/2703681147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569c1094d0 0x7f569c1098e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5684009900 tx=0x7f568402a410 comp rx=0 tx=0).stop 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.009+0000 7f56a20aa640 1 -- 172.21.15.92:0/2703681147 shutdown_connections 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.009+0000 7f56a20aa640 1 --2- 172.21.15.92:0/2703681147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f569c109e20 0x7f569c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.009+0000 7f56a20aa640 1 --2- 172.21.15.92:0/2703681147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569c1094d0 0x7f569c1098e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.009+0000 7f56a20aa640 1 --2- 172.21.15.92:0/2703681147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c103b90 0x7f569c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.009+0000 7f56a20aa640 1 -- 172.21.15.92:0/2703681147 >> 172.21.15.92:0/2703681147 conn(0x7f569c0ff600 msgr2=0x7f569c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.009+0000 7f56a20aa640 1 -- 172.21.15.92:0/2703681147 shutdown_connections 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.009+0000 7f56a20aa640 1 -- 172.21.15.92:0/2703681147 wait complete. 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.010+0000 7f56a20aa640 1 Processor -- start 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.010+0000 7f56a20aa640 1 -- start start 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.010+0000 7f56a20aa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c103b90 0x7f569c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.010+0000 7f56a20aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f569c1094d0 0x7f569c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.010+0000 7f56a20aa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569c109e20 0x7f569c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.010+0000 7f56a20aa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f569c1139b0 con 0x7f569c109e20 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.010+0000 7f56a20aa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f569c113830 con 0x7f569c103b90 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.010+0000 7f56a20aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f569c113b30 con 0x7f569c1094d0 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569c109e20 0x7f569c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569c109e20 0x7f569c19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43184/0 (socket says 172.21.15.92:43184) 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569bfff640 1 -- 172.21.15.92:0/1937749108 learned_addr learned my addr 172.21.15.92:0/1937749108 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569b7fe640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c103b90 0x7f569c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f5692ffd640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f569c1094d0 0x7f569c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569bfff640 1 -- 172.21.15.92:0/1937749108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f569c1094d0 msgr2=0x7f569c19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569bfff640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f569c1094d0 0x7f569c19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569bfff640 1 -- 172.21.15.92:0/1937749108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c103b90 msgr2=0x7f569c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569bfff640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c103b90 0x7f569c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569bfff640 1 -- 172.21.15.92:0/1937749108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569c1a03b0 con 0x7f569c109e20 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569b7fe640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c103b90 0x7f569c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f5692ffd640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f569c1094d0 0x7f569c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f569bfff640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569c109e20 0x7f569c19fd40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f569400cce0 tx=0x7f569400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f56997fa640 1 -- 172.21.15.92:0/1937749108 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569400f450 con 0x7f569c109e20 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f56997fa640 1 -- 172.21.15.92:0/1937749108 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f569400fa80 con 0x7f569c109e20 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f56a20aa640 1 -- 172.21.15.92:0/1937749108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569c1a06a0 con 0x7f569c109e20 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f56997fa640 1 -- 172.21.15.92:0/1937749108 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5694018ad0 con 0x7f569c109e20 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.011+0000 7f56a20aa640 1 -- 172.21.15.92:0/1937749108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f569c1a0b90 con 0x7f569c109e20 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.012+0000 7f56a20aa640 1 -- 172.21.15.92:0/1937749108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569c103fa0 con 0x7f569c109e20 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.014+0000 7f56997fa640 1 -- 172.21.15.92:0/1937749108 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f569400f5f0 con 0x7f569c109e20 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.014+0000 7f56997fa640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f56880b6590 0x7f56880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.015+0000 7f569b7fe640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f56880b6590 0x7f56880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.015+0000 7f56997fa640 1 -- 172.21.15.92:0/1937749108 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8094+0+0 (secure 0 0 0) 0x7f56940e7b70 con 0x7f569c109e20 2024-09-21T07:10:54.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.015+0000 7f569b7fe640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f56880b6590 0x7f56880b8aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f568c006fd0 tx=0x7f568c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.018+0000 7f56997fa640 1 -- 172.21.15.92:0/1937749108 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f569c1a0b90 con 0x7f569c109e20 2024-09-21T07:10:54.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.235+0000 7f56a20aa640 1 -- 172.21.15.92:0/1937749108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f569c19b630 con 0x7f569c109e20 2024-09-21T07:10:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.484+0000 7f56997fa640 1 -- 172.21.15.92:0/1937749108 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f569c19b630 con 0x7f569c109e20 2024-09-21T07:10:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T07:10:54.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:54 smithi092 ceph-mon[30987]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:10:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 -- 172.21.15.92:0/1937749108 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f56880b6590 msgr2=0x7f56880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f56880b6590 0x7f56880b8aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f568c006fd0 tx=0x7f568c008040 comp rx=0 tx=0).stop 2024-09-21T07:10:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 -- 172.21.15.92:0/1937749108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569c109e20 msgr2=0x7f569c19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569c109e20 0x7f569c19fd40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f569400cce0 tx=0x7f569400a620 comp rx=0 tx=0).stop 2024-09-21T07:10:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 -- 172.21.15.92:0/1937749108 shutdown_connections 2024-09-21T07:10:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f56880b6590 0x7f56880b8aa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f569c109e20 0x7f569c19fd40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f569c1094d0 0x7f569c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 --2- 172.21.15.92:0/1937749108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c103b90 0x7f569c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 -- 172.21.15.92:0/1937749108 >> 172.21.15.92:0/1937749108 conn(0x7f569c0ff600 msgr2=0x7f569c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 -- 172.21.15.92:0/1937749108 shutdown_connections 2024-09-21T07:10:54.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:54.487+0000 7f56a20aa640 1 -- 172.21.15.92:0/1937749108 wait complete. 2024-09-21T07:10:54.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:54 smithi175 ceph-mon[34064]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:10:54.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:54 smithi175 ceph-mon[34064]: pgmap v263: 97 pgs: 21 creating+peering, 58 unknown, 18 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:54.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:54 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1937749108' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:10:54.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:54 smithi175 ceph-mon[34064]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-21T07:10:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:54 smithi092 ceph-mon[30987]: pgmap v263: 97 pgs: 21 creating+peering, 58 unknown, 18 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:54 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1937749108' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:10:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:54 smithi092 ceph-mon[30987]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-21T07:10:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:54 smithi169 ceph-mon[33705]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:10:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:54 smithi169 ceph-mon[33705]: pgmap v263: 97 pgs: 21 creating+peering, 58 unknown, 18 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:54 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1937749108' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:10:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:54 smithi169 ceph-mon[33705]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-21T07:10:55.281 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T07:10:55.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T07:10:55.531 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:55.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:55 smithi092 ceph-mon[30987]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:10:55.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:55 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1937749108' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:10:55.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:55 smithi092 ceph-mon[30987]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-21T07:10:55.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:55 smithi092 ceph-mon[30987]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-21T07:10:55.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:55 smithi175 ceph-mon[34064]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:10:55.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:55 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1937749108' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:10:55.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:55 smithi175 ceph-mon[34064]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-21T07:10:55.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:55 smithi175 ceph-mon[34064]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-21T07:10:55.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:55 smithi169 ceph-mon[33705]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:10:55.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:55 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1937749108' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:10:55.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:55 smithi169 ceph-mon[33705]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-21T07:10:55.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:55 smithi169 ceph-mon[33705]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-21T07:10:56.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2576700724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb681025e0 msgr2=0x7fcb681029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 --2- 172.21.15.92:0/2576700724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb681025e0 0x7fcb681029f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009ca0 tx=0x7fcb5802a950 comp rx=0 tx=0).stop 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2576700724 shutdown_connections 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 --2- 172.21.15.92:0/2576700724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb68110190 0x7fcb681125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 --2- 172.21.15.92:0/2576700724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb68102f30 0x7fcb6810fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 --2- 172.21.15.92:0/2576700724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb681025e0 0x7fcb681029f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2576700724 >> 172.21.15.92:0/2576700724 conn(0x7fcb68079710 msgr2=0x7fcb68079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2576700724 shutdown_connections 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2576700724 wait complete. 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 Processor -- start 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.030+0000 7fcb6d2ef640 1 -- start start 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb6d2ef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb681025e0 0x7fcb6819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb6d2ef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb68102f30 0x7fcb6819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb6d2ef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb68110190 0x7fcb681a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb6d2ef640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb68115b30 con 0x7fcb68110190 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb6d2ef640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb681159b0 con 0x7fcb68102f30 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb6d2ef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb68115cb0 con 0x7fcb681025e0 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb677fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb68110190 0x7fcb681a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb677fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb68110190 0x7fcb681a1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43204/0 (socket says 172.21.15.92:43204) 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb677fe640 1 -- 172.21.15.92:0/2533431302 learned_addr learned my addr 172.21.15.92:0/2533431302 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb66ffd640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb681025e0 0x7fcb6819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb677fe640 1 -- 172.21.15.92:0/2533431302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb681025e0 msgr2=0x7fcb6819c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb677fe640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb681025e0 0x7fcb6819c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb677fe640 1 -- 172.21.15.92:0/2533431302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb68102f30 msgr2=0x7fcb6819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb677fe640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb68102f30 0x7fcb6819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb677fe640 1 -- 172.21.15.92:0/2533431302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb681a2590 con 0x7fcb68110190 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb66ffd640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb681025e0 0x7fcb6819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb677fe640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb68110190 0x7fcb681a1f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000c970 tx=0x7fcb6000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:56.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb4ffff640 1 -- 172.21.15.92:0/2533431302 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60007bb0 con 0x7fcb68110190 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2533431302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb681a2880 con 0x7fcb68110190 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb4ffff640 1 -- 172.21.15.92:0/2533431302 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb60007d50 con 0x7fcb68110190 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.031+0000 7fcb4ffff640 1 -- 172.21.15.92:0/2533431302 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60018660 con 0x7fcb68110190 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.032+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2533431302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb681a90a0 con 0x7fcb68110190 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.033+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2533431302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6806c260 con 0x7fcb68110190 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.034+0000 7fcb4ffff640 1 -- 172.21.15.92:0/2533431302 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fcb6000f970 con 0x7fcb68110190 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.035+0000 7fcb4ffff640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb500b6590 0x7fcb500b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.035+0000 7fcb66ffd640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb500b6590 0x7fcb500b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.035+0000 7fcb4ffff640 1 -- 172.21.15.92:0/2533431302 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8194+0+0 (secure 0 0 0) 0x7fcb600e77b0 con 0x7fcb68110190 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.035+0000 7fcb66ffd640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb500b6590 0x7fcb500b8aa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcb580094e0 tx=0x7fcb58009800 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:56.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.038+0000 7fcb4ffff640 1 -- 172.21.15.92:0/2533431302 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb60014030 con 0x7fcb68110190 2024-09-21T07:10:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.225+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2533431302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fcb6810b380 con 0x7fcb68110190 2024-09-21T07:10:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.503+0000 7fcb4ffff640 1 -- 172.21.15.92:0/2533431302 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v77) ==== 157+0+0 (secure 0 0 0) 0x7fcb600ae060 con 0x7fcb68110190 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2533431302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb500b6590 msgr2=0x7fcb500b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb500b6590 0x7fcb500b8aa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcb580094e0 tx=0x7fcb58009800 comp rx=0 tx=0).stop 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2533431302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb68110190 msgr2=0x7fcb681a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb68110190 0x7fcb681a1f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000c970 tx=0x7fcb6000ce30 comp rx=0 tx=0).stop 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2533431302 shutdown_connections 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb500b6590 0x7fcb500b8aa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb68110190 0x7fcb681a1f20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb68102f30 0x7fcb6819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 --2- 172.21.15.92:0/2533431302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb681025e0 0x7fcb6819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2533431302 >> 172.21.15.92:0/2533431302 conn(0x7fcb68079710 msgr2=0x7fcb681117a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2533431302 shutdown_connections 2024-09-21T07:10:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:56.505+0000 7fcb6d2ef640 1 -- 172.21.15.92:0/2533431302 wait complete. 2024-09-21T07:10:56.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:56 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] up:active 2024-09-21T07:10:56.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:56 smithi175 ceph-mon[34064]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:10:56.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:56 smithi175 ceph-mon[34064]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:10:56.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:56 smithi175 ceph-mon[34064]: pgmap v265: 97 pgs: 20 creating+peering, 26 unknown, 51 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:56.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:56 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2533431302' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T07:10:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:56 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] up:active 2024-09-21T07:10:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:56 smithi092 ceph-mon[30987]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:10:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:56 smithi092 ceph-mon[30987]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:10:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:56 smithi092 ceph-mon[30987]: pgmap v265: 97 pgs: 20 creating+peering, 26 unknown, 51 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:56.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:56 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2533431302' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T07:10:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:56 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] up:active 2024-09-21T07:10:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:56 smithi169 ceph-mon[33705]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:10:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:56 smithi169 ceph-mon[33705]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:10:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:56 smithi169 ceph-mon[33705]: pgmap v265: 97 pgs: 20 creating+peering, 26 unknown, 51 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:10:56.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:56 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2533431302' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T07:10:57.213 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:10:57.459 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:10:57.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:57 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2533431302' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T07:10:57.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:57 smithi175 ceph-mon[34064]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:10:57.795 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:57 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2533431302' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T07:10:57.795 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:57 smithi169 ceph-mon[33705]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:10:57.847 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:57 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2533431302' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T07:10:57.847 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:57 smithi092 ceph-mon[30987]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:10:57.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.942+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/3100475426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dc41094e0 msgr2=0x7f7dc41098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.942+0000 7f7dcb5f1640 1 --2- 172.21.15.92:0/3100475426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dc41094e0 0x7f7dc41098f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009900 tx=0x7f7db402a410 comp rx=0 tx=0).stop 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.943+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/3100475426 shutdown_connections 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.943+0000 7f7dcb5f1640 1 --2- 172.21.15.92:0/3100475426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dc4109e30 0x7f7dc4110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.943+0000 7f7dcb5f1640 1 --2- 172.21.15.92:0/3100475426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dc41094e0 0x7f7dc41098f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.943+0000 7f7dcb5f1640 1 --2- 172.21.15.92:0/3100475426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc4103ba0 0x7f7dc4103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.943+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/3100475426 >> 172.21.15.92:0/3100475426 conn(0x7f7dc40ff610 msgr2=0x7f7dc4101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.943+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/3100475426 shutdown_connections 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.943+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/3100475426 wait complete. 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.943+0000 7f7dcb5f1640 1 Processor -- start 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.943+0000 7f7dcb5f1640 1 -- start start 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dcb5f1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dc4103ba0 0x7f7dc4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dcb5f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc41094e0 0x7f7dc4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dcb5f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dc4109e30 0x7f7dc4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dcb5f1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc41139a0 con 0x7f7dc4103ba0 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dcb5f1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc4113820 con 0x7f7dc41094e0 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dcb5f1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc4113b20 con 0x7f7dc4109e30 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc938d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dc4103ba0 0x7f7dc4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc938d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dc4103ba0 0x7f7dc4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43226/0 (socket says 172.21.15.92:43226) 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc938d640 1 -- 172.21.15.92:0/2572882146 learned_addr learned my addr 172.21.15.92:0/2572882146 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc9b8e640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dc4109e30 0x7f7dc4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc8b8c640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc41094e0 0x7f7dc4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc938d640 1 -- 172.21.15.92:0/2572882146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dc4109e30 msgr2=0x7f7dc4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc938d640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dc4109e30 0x7f7dc4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc938d640 1 -- 172.21.15.92:0/2572882146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc41094e0 msgr2=0x7f7dc4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc938d640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc41094e0 0x7f7dc4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc938d640 1 -- 172.21.15.92:0/2572882146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc41a8670 con 0x7f7dc4103ba0 2024-09-21T07:10:57.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.944+0000 7f7dc938d640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dc4103ba0 0x7f7dc4075710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00d950 tx=0x7f7dbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:57.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.945+0000 7f7dba7fc640 1 -- 172.21.15.92:0/2572882146 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc017070 con 0x7f7dc4103ba0 2024-09-21T07:10:57.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.945+0000 7f7dba7fc640 1 -- 172.21.15.92:0/2572882146 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dbc009c30 con 0x7f7dc4103ba0 2024-09-21T07:10:57.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.945+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/2572882146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc41a8960 con 0x7f7dc4103ba0 2024-09-21T07:10:57.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.945+0000 7f7dba7fc640 1 -- 172.21.15.92:0/2572882146 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00f620 con 0x7f7dc4103ba0 2024-09-21T07:10:57.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.945+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/2572882146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc41a8e70 con 0x7f7dc4103ba0 2024-09-21T07:10:57.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.946+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/2572882146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc4104e20 con 0x7f7dc4103ba0 2024-09-21T07:10:57.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.947+0000 7f7dba7fc640 1 -- 172.21.15.92:0/2572882146 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f7dbc010460 con 0x7f7dc4103ba0 2024-09-21T07:10:57.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.948+0000 7f7dba7fc640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7db00b6560 0x7f7db00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.948+0000 7f7dc8b8c640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7db00b6560 0x7f7db00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.948+0000 7f7dba7fc640 1 -- 172.21.15.92:0/2572882146 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8492+0+0 (secure 0 0 0) 0x7f7dbc0e6fe0 con 0x7f7dc4103ba0 2024-09-21T07:10:57.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.949+0000 7f7dc8b8c640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7db00b6560 0x7f7db00b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7db4005940 tx=0x7f7db40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:57.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:57.951+0000 7f7dba7fc640 1 -- 172.21.15.92:0/2572882146 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7dbc009de0 con 0x7f7dc4103ba0 2024-09-21T07:10:58.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:58.133+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/2572882146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7dc402e640 con 0x7f7dc4103ba0 2024-09-21T07:10:58.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:58 smithi175 ceph-mon[34064]: pgmap v267: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 200 B/s wr, 4 op/s 2024-09-21T07:10:58.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:58 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2572882146' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:10:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:58 smithi092 ceph-mon[30987]: pgmap v267: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 200 B/s wr, 4 op/s 2024-09-21T07:10:58.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:58 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2572882146' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:10:58.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:58 smithi169 ceph-mon[33705]: pgmap v267: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 200 B/s wr, 4 op/s 2024-09-21T07:10:58.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2572882146' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:10:59.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.523+0000 7f7dba7fc640 1 -- 172.21.15.92:0/2572882146 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v79) ==== 228+0+0 (secure 0 0 0) 0x7f7dbc0b1b50 con 0x7f7dc4103ba0 2024-09-21T07:10:59.525 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data_ec' created 2024-09-21T07:10:59.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.527+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/2572882146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7db00b6560 msgr2=0x7f7db00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:59.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.527+0000 7f7dcb5f1640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7db00b6560 0x7f7db00b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7db4005940 tx=0x7f7db40058d0 comp rx=0 tx=0).stop 2024-09-21T07:10:59.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.527+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/2572882146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dc4103ba0 msgr2=0x7f7dc4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:59.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.527+0000 7f7dcb5f1640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dc4103ba0 0x7f7dc4075710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00d950 tx=0x7f7dbc00de10 comp rx=0 tx=0).stop 2024-09-21T07:10:59.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.527+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/2572882146 shutdown_connections 2024-09-21T07:10:59.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.527+0000 7f7dcb5f1640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7db00b6560 0x7f7db00b8a70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:59.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.527+0000 7f7dcb5f1640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dc4109e30 0x7f7dc4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:59.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.527+0000 7f7dcb5f1640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc41094e0 0x7f7dc4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:59.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.527+0000 7f7dcb5f1640 1 --2- 172.21.15.92:0/2572882146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dc4103ba0 0x7f7dc4075710 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:59.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.527+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/2572882146 >> 172.21.15.92:0/2572882146 conn(0x7f7dc40ff610 msgr2=0x7f7dc4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:59.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.528+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/2572882146 shutdown_connections 2024-09-21T07:10:59.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:10:59.528+0000 7f7dcb5f1640 1 -- 172.21.15.92:0/2572882146 wait complete. 2024-09-21T07:10:59.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:10:59 smithi175 ceph-mon[34064]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:10:59.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:10:59 smithi092 ceph-mon[30987]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:10:59.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:10:59 smithi169 ceph-mon[33705]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:11:00.301 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T07:11:00.566 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:00.768 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:11:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: 2024-09-21T07:11:00.388+0000 7fed8ee71640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:11:00.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:00 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2572882146' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:11:00.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:00 smithi175 ceph-mon[34064]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T07:11:00.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:00 smithi175 ceph-mon[34064]: pgmap v270: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T07:11:00.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:00 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2572882146' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:11:00.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:00 smithi092 ceph-mon[30987]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T07:11:00.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:00 smithi092 ceph-mon[30987]: pgmap v270: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T07:11:00.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:00 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2572882146' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:11:00.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:00 smithi169 ceph-mon[33705]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T07:11:00.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:00 smithi169 ceph-mon[33705]: pgmap v270: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T07:11:01.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.224+0000 7ff434368640 1 -- 172.21.15.92:0/396682024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff42c108d70 msgr2=0x7ff42c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:01.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.224+0000 7ff434368640 1 --2- 172.21.15.92:0/396682024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff42c108d70 0x7ff42c10f5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff424009ca0 tx=0x7ff42402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.224+0000 7ff434368640 1 -- 172.21.15.92:0/396682024 shutdown_connections 2024-09-21T07:11:01.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.224+0000 7ff434368640 1 --2- 172.21.15.92:0/396682024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff42c108d70 0x7ff42c10f5a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.224+0000 7ff434368640 1 --2- 172.21.15.92:0/396682024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c108420 0x7ff42c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.224+0000 7ff434368640 1 --2- 172.21.15.92:0/396682024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff42c102ae0 0x7ff42c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.224+0000 7ff434368640 1 -- 172.21.15.92:0/396682024 >> 172.21.15.92:0/396682024 conn(0x7ff42c079770 msgr2=0x7ff42c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.224+0000 7ff434368640 1 -- 172.21.15.92:0/396682024 shutdown_connections 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.224+0000 7ff434368640 1 -- 172.21.15.92:0/396682024 wait complete. 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff434368640 1 Processor -- start 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff434368640 1 -- start start 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff434368640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c102ae0 0x7ff42c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff434368640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff42c108420 0x7ff42c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff434368640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff42c108d70 0x7ff42c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff434368640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c112930 con 0x7ff42c108d70 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff434368640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c1127b0 con 0x7ff42c108420 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff434368640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c112ab0 con 0x7ff42c102ae0 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff432905640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff42c108d70 0x7ff42c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:01.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff432905640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff42c108d70 0x7ff42c19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60218/0 (socket says 172.21.15.92:60218) 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff432905640 1 -- 172.21.15.92:0/1569013227 learned_addr learned my addr 172.21.15.92:0/1569013227 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff431903640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff42c108420 0x7ff42c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff432104640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c102ae0 0x7ff42c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff432905640 1 -- 172.21.15.92:0/1569013227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c102ae0 msgr2=0x7ff42c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff432905640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c102ae0 0x7ff42c19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff432905640 1 -- 172.21.15.92:0/1569013227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff42c108420 msgr2=0x7ff42c19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff432905640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff42c108420 0x7ff42c19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.225+0000 7ff432905640 1 -- 172.21.15.92:0/1569013227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c1a02a0 con 0x7ff42c108d70 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.226+0000 7ff432104640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c102ae0 0x7ff42c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.226+0000 7ff432905640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff42c108d70 0x7ff42c19fc30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff424005cc0 tx=0x7ff424032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.226+0000 7ff4237fe640 1 -- 172.21.15.92:0/1569013227 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424004040 con 0x7ff42c108d70 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.226+0000 7ff434368640 1 -- 172.21.15.92:0/1569013227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff42c1a0530 con 0x7ff42c108d70 2024-09-21T07:11:01.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.226+0000 7ff4237fe640 1 -- 172.21.15.92:0/1569013227 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff424004670 con 0x7ff42c108d70 2024-09-21T07:11:01.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.226+0000 7ff4237fe640 1 -- 172.21.15.92:0/1569013227 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424030cc0 con 0x7ff42c108d70 2024-09-21T07:11:01.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.226+0000 7ff434368640 1 -- 172.21.15.92:0/1569013227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff42c1a6db0 con 0x7ff42c108d70 2024-09-21T07:11:01.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.227+0000 7ff434368640 1 -- 172.21.15.92:0/1569013227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42c103d60 con 0x7ff42c108d70 2024-09-21T07:11:01.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.228+0000 7ff4237fe640 1 -- 172.21.15.92:0/1569013227 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7ff4240041e0 con 0x7ff42c108d70 2024-09-21T07:11:01.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.229+0000 7ff4237fe640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4180b6590 0x7ff4180b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:01.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.229+0000 7ff432104640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4180b6590 0x7ff4180b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:01.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.229+0000 7ff4237fe640 1 -- 172.21.15.92:0/1569013227 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8985+0+0 (secure 0 0 0) 0x7ff424108c40 con 0x7ff42c108d70 2024-09-21T07:11:01.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.230+0000 7ff432104640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4180b6590 0x7ff4180b8aa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff42800abe0 tx=0x7ff42800a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:01.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.233+0000 7ff4237fe640 1 -- 172.21.15.92:0/1569013227 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4240cf1e0 con 0x7ff42c108d70 2024-09-21T07:11:01.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.414+0000 7ff434368640 1 -- 172.21.15.92:0/1569013227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7ff42c102ef0 con 0x7ff42c108d70 2024-09-21T07:11:01.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.537+0000 7ff4237fe640 1 -- 172.21.15.92:0/1569013227 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v81) ==== 169+0+0 (secure 0 0 0) 0x7ff42c102ef0 con 0x7ff42c108d70 2024-09-21T07:11:01.539 INFO:teuthology.orchestra.run.smithi092.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T07:11:01.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.540+0000 7ff434368640 1 -- 172.21.15.92:0/1569013227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4180b6590 msgr2=0x7ff4180b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:01.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.540+0000 7ff434368640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4180b6590 0x7ff4180b8aa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff42800abe0 tx=0x7ff42800a5c0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.540+0000 7ff434368640 1 -- 172.21.15.92:0/1569013227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff42c108d70 msgr2=0x7ff42c19fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:01.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.540+0000 7ff434368640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff42c108d70 0x7ff42c19fc30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff424005cc0 tx=0x7ff424032c40 comp rx=0 tx=0).stop 2024-09-21T07:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.541+0000 7ff434368640 1 -- 172.21.15.92:0/1569013227 shutdown_connections 2024-09-21T07:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.541+0000 7ff434368640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4180b6590 0x7ff4180b8aa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.541+0000 7ff434368640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff42c108d70 0x7ff42c19fc30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.541+0000 7ff434368640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff42c108420 0x7ff42c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.541+0000 7ff434368640 1 --2- 172.21.15.92:0/1569013227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c102ae0 0x7ff42c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.541+0000 7ff434368640 1 -- 172.21.15.92:0/1569013227 >> 172.21.15.92:0/1569013227 conn(0x7ff42c079770 msgr2=0x7ff42c101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.541+0000 7ff434368640 1 -- 172.21.15.92:0/1569013227 shutdown_connections 2024-09-21T07:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:01.541+0000 7ff434368640 1 -- 172.21.15.92:0/1569013227 wait complete. 2024-09-21T07:11:01.631 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:01 smithi092 ceph-mon[30987]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T07:11:01.631 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:01 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1569013227' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T07:11:01.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:01 smithi169 ceph-mon[33705]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T07:11:01.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:01 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1569013227' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T07:11:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:01 smithi175 ceph-mon[34064]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T07:11:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:01 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1569013227' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T07:11:02.250 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T07:11:02.503 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:02.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:02 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1569013227' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T07:11:02.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:02 smithi092 ceph-mon[30987]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T07:11:02.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:02 smithi092 ceph-mon[30987]: pgmap v273: 129 pgs: 1 creating+peering, 27 unknown, 101 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2024-09-21T07:11:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:02 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1569013227' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T07:11:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:02 smithi169 ceph-mon[33705]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T07:11:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:02 smithi169 ceph-mon[33705]: pgmap v273: 129 pgs: 1 creating+peering, 27 unknown, 101 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2024-09-21T07:11:03.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:02 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1569013227' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T07:11:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:02 smithi175 ceph-mon[34064]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T07:11:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:02 smithi175 ceph-mon[34064]: pgmap v273: 129 pgs: 1 creating+peering, 27 unknown, 101 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2024-09-21T07:11:03.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.032+0000 7f2511e5a640 1 -- 172.21.15.92:0/1351810815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c108cf0 msgr2=0x7f250c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:03.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.032+0000 7f2511e5a640 1 --2- 172.21.15.92:0/1351810815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c108cf0 0x7f250c10f520 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2504009ca0 tx=0x7f250402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:03.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.032+0000 7f2511e5a640 1 -- 172.21.15.92:0/1351810815 shutdown_connections 2024-09-21T07:11:03.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.032+0000 7f2511e5a640 1 --2- 172.21.15.92:0/1351810815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c108cf0 0x7f250c10f520 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:03.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.032+0000 7f2511e5a640 1 --2- 172.21.15.92:0/1351810815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f250c1083a0 0x7f250c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:03.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.032+0000 7f2511e5a640 1 --2- 172.21.15.92:0/1351810815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f250c102a60 0x7f250c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:03.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.032+0000 7f2511e5a640 1 -- 172.21.15.92:0/1351810815 >> 172.21.15.92:0/1351810815 conn(0x7f250c079730 msgr2=0x7f250c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:03.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.032+0000 7f2511e5a640 1 -- 172.21.15.92:0/1351810815 shutdown_connections 2024-09-21T07:11:03.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.032+0000 7f2511e5a640 1 -- 172.21.15.92:0/1351810815 wait complete. 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.033+0000 7f2511e5a640 1 Processor -- start 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.033+0000 7f2511e5a640 1 -- start start 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2511e5a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f250c102a60 0x7f250c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2511e5a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c1083a0 0x7f250c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2511e5a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f250c108cf0 0x7f250c19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2511e5a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f250c112860 con 0x7f250c1083a0 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2511e5a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f250c1126e0 con 0x7f250c102a60 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2511e5a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f250c1129e0 con 0x7f250c108cf0 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2503fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c1083a0 0x7f250c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2503fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c1083a0 0x7f250c1997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60236/0 (socket says 172.21.15.92:60236) 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2503fff640 1 -- 172.21.15.92:0/1796007034 learned_addr learned my addr 172.21.15.92:0/1796007034 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f250b7fe640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f250c102a60 0x7f250c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f250bfff640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f250c108cf0 0x7f250c19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:03.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2503fff640 1 -- 172.21.15.92:0/1796007034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f250c108cf0 msgr2=0x7f250c19ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2503fff640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f250c108cf0 0x7f250c19ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2503fff640 1 -- 172.21.15.92:0/1796007034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f250c102a60 msgr2=0x7f250c199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2503fff640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f250c102a60 0x7f250c199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2503fff640 1 -- 172.21.15.92:0/1796007034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c19f1a0 con 0x7f250c1083a0 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.034+0000 7f2503fff640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c1083a0 0x7f250c1997d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f24f400c970 tx=0x7f24f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.035+0000 7f25097fa640 1 -- 172.21.15.92:0/1796007034 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4007bb0 con 0x7f250c1083a0 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.035+0000 7f2511e5a640 1 -- 172.21.15.92:0/1796007034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250c19f490 con 0x7f250c1083a0 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.035+0000 7f25097fa640 1 -- 172.21.15.92:0/1796007034 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24f4007d50 con 0x7f250c1083a0 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.035+0000 7f25097fa640 1 -- 172.21.15.92:0/1796007034 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4018660 con 0x7f250c1083a0 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.035+0000 7f2511e5a640 1 -- 172.21.15.92:0/1796007034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250c1a5bf0 con 0x7f250c1083a0 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.036+0000 7f2511e5a640 1 -- 172.21.15.92:0/1796007034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250c102e70 con 0x7f250c1083a0 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.037+0000 7f25097fa640 1 -- 172.21.15.92:0/1796007034 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f24f400f970 con 0x7f250c1083a0 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.038+0000 7f25097fa640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f24f80b6560 0x7f24f80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:03.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.038+0000 7f250b7fe640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f24f80b6560 0x7f24f80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:03.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.038+0000 7f25097fa640 1 -- 172.21.15.92:0/1796007034 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8985+0+0 (secure 0 0 0) 0x7f24f40e7ae0 con 0x7f250c1083a0 2024-09-21T07:11:03.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.038+0000 7f250b7fe640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f24f80b6560 0x7f24f80b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00bbe0 tx=0x7f24fc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:03.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.041+0000 7f25097fa640 1 -- 172.21.15.92:0/1796007034 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24f4014030 con 0x7f250c1083a0 2024-09-21T07:11:03.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.258+0000 7f2511e5a640 1 -- 172.21.15.92:0/1796007034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f250c19a360 con 0x7f250c1083a0 2024-09-21T07:11:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.555+0000 7f25097fa640 1 -- 172.21.15.92:0/1796007034 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f24f40ae080 con 0x7f250c1083a0 2024-09-21T07:11:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:added data pool 4 to fsmap 2024-09-21T07:11:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 -- 172.21.15.92:0/1796007034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f24f80b6560 msgr2=0x7f24f80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f24f80b6560 0x7f24f80b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00bbe0 tx=0x7f24fc00b390 comp rx=0 tx=0).stop 2024-09-21T07:11:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 -- 172.21.15.92:0/1796007034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c1083a0 msgr2=0x7f250c1997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c1083a0 0x7f250c1997d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f24f400c970 tx=0x7f24f400ce30 comp rx=0 tx=0).stop 2024-09-21T07:11:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 -- 172.21.15.92:0/1796007034 shutdown_connections 2024-09-21T07:11:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f24f80b6560 0x7f24f80b8a70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f250c108cf0 0x7f250c19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c1083a0 0x7f250c1997d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 --2- 172.21.15.92:0/1796007034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f250c102a60 0x7f250c199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:03.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 -- 172.21.15.92:0/1796007034 >> 172.21.15.92:0/1796007034 conn(0x7f250c079730 msgr2=0x7f250c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:03.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 -- 172.21.15.92:0/1796007034 shutdown_connections 2024-09-21T07:11:03.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:03.557+0000 7f2511e5a640 1 -- 172.21.15.92:0/1796007034 wait complete. 2024-09-21T07:11:03.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:03 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1796007034' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T07:11:03.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:03 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1796007034' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T07:11:04.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:03 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1796007034' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T07:11:04.251 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:11:04.498 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:04.807 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:04 smithi092 ceph-mon[30987]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T07:11:04.807 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:04 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1796007034' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T07:11:04.807 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:04 smithi092 ceph-mon[30987]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:11:04.807 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:04 smithi092 ceph-mon[30987]: pgmap v275: 129 pgs: 1 creating+peering, 11 unknown, 117 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:04.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:04 smithi169 ceph-mon[33705]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T07:11:04.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:04 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1796007034' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T07:11:04.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:04 smithi169 ceph-mon[33705]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:11:04.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:04 smithi169 ceph-mon[33705]: pgmap v275: 129 pgs: 1 creating+peering, 11 unknown, 117 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:05.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:04 smithi175 ceph-mon[34064]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T07:11:05.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:04 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1796007034' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T07:11:05.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:04 smithi175 ceph-mon[34064]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:11:05.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:04 smithi175 ceph-mon[34064]: pgmap v275: 129 pgs: 1 creating+peering, 11 unknown, 117 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.147+0000 7fbdf6c16640 1 -- 172.21.15.92:0/1466846731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdf0105b10 msgr2=0x7fbdf010f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.147+0000 7fbdf6c16640 1 --2- 172.21.15.92:0/1466846731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdf0105b10 0x7fbdf010f580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009ca0 tx=0x7fbde802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.147+0000 7fbdf6c16640 1 -- 172.21.15.92:0/1466846731 shutdown_connections 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.147+0000 7fbdf6c16640 1 --2- 172.21.15.92:0/1466846731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdf0105b10 0x7fbdf010f580 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.147+0000 7fbdf6c16640 1 --2- 172.21.15.92:0/1466846731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf01051c0 0x7fbdf01055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.147+0000 7fbdf6c16640 1 --2- 172.21.15.92:0/1466846731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01031b0 0x7fbdf01035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.147+0000 7fbdf6c16640 1 -- 172.21.15.92:0/1466846731 >> 172.21.15.92:0/1466846731 conn(0x7fbdf0079f90 msgr2=0x7fbdf007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.148+0000 7fbdf6c16640 1 -- 172.21.15.92:0/1466846731 shutdown_connections 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.148+0000 7fbdf6c16640 1 -- 172.21.15.92:0/1466846731 wait complete. 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.148+0000 7fbdf6c16640 1 Processor -- start 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.148+0000 7fbdf6c16640 1 -- start start 2024-09-21T07:11:05.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdf6c16640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01031b0 0x7fbdf019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdf6c16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdf01051c0 0x7fbdf019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdf6c16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf0105b10 0x7fbdf019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdf6c16640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf0112910 con 0x7fbdf01051c0 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdf6c16640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf0112790 con 0x7fbdf01031b0 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdf6c16640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf0112a90 con 0x7fbdf0105b10 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdeffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdf01051c0 0x7fbdf019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdeffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdf01051c0 0x7fbdf019a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60254/0 (socket says 172.21.15.92:60254) 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdeffff640 1 -- 172.21.15.92:0/3170389578 learned_addr learned my addr 172.21.15.92:0/3170389578 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdf51b3640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf0105b10 0x7fbdf019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdf49b2640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01031b0 0x7fbdf019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdeffff640 1 -- 172.21.15.92:0/3170389578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf0105b10 msgr2=0x7fbdf019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdeffff640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf0105b10 0x7fbdf019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdeffff640 1 -- 172.21.15.92:0/3170389578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01031b0 msgr2=0x7fbdf019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:05.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdeffff640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01031b0 0x7fbdf019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdeffff640 1 -- 172.21.15.92:0/3170389578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf01a02a0 con 0x7fbdf01051c0 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdf51b3640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf0105b10 0x7fbdf019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdeffff640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdf01051c0 0x7fbdf019a990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00d950 tx=0x7fbddc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdedffb640 1 -- 172.21.15.92:0/3170389578 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc017070 con 0x7fbdf01051c0 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.149+0000 7fbdf6c16640 1 -- 172.21.15.92:0/3170389578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf01a0590 con 0x7fbdf01051c0 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.150+0000 7fbdedffb640 1 -- 172.21.15.92:0/3170389578 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbddc009c30 con 0x7fbdf01051c0 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.150+0000 7fbdedffb640 1 -- 172.21.15.92:0/3170389578 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc0047a0 con 0x7fbdf01051c0 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.150+0000 7fbdf6c16640 1 -- 172.21.15.92:0/3170389578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf01a6db0 con 0x7fbdf01051c0 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.151+0000 7fbdf6c16640 1 -- 172.21.15.92:0/3170389578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf01035c0 con 0x7fbdf01051c0 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.152+0000 7fbdedffb640 1 -- 172.21.15.92:0/3170389578 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fbddc004020 con 0x7fbdf01051c0 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.153+0000 7fbdedffb640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbde00b6590 0x7fbde00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.153+0000 7fbdf49b2640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbde00b6590 0x7fbde00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:05.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.154+0000 7fbdedffb640 1 -- 172.21.15.92:0/3170389578 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9017+0+0 (secure 0 0 0) 0x7fbddc0e7840 con 0x7fbdf01051c0 2024-09-21T07:11:05.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.154+0000 7fbdf49b2640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbde00b6590 0x7fbde00b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbde4005e10 tx=0x7fbde4005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:05.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.157+0000 7fbdedffb640 1 -- 172.21.15.92:0/3170389578 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbddc020020 con 0x7fbdf01051c0 2024-09-21T07:11:05.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.372+0000 7fbdf6c16640 1 -- 172.21.15.92:0/3170389578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdf019b520 con 0x7fbdf01051c0 2024-09-21T07:11:05.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.372+0000 7fbdedffb640 1 -- 172.21.15.92:0/3170389578 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11845 (secure 0 0 0) 0x7fbdf019b520 con 0x7fbdf01051c0 2024-09-21T07:11:05.374 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:05.375 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":17,"btime":"2024-09-21T07:11:03:544974+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:11:03.260197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24649,"qdb_cluster":[24649]},"id":1}]} 2024-09-21T07:11:05.375 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 17 2024-09-21T07:11:05.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.374+0000 7fbdf6c16640 1 -- 172.21.15.92:0/3170389578 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbde00b6590 msgr2=0x7fbde00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:05.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.374+0000 7fbdf6c16640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbde00b6590 0x7fbde00b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbde4005e10 tx=0x7fbde4005da0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.374+0000 7fbdf6c16640 1 -- 172.21.15.92:0/3170389578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdf01051c0 msgr2=0x7fbdf019a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:05.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.374+0000 7fbdf6c16640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdf01051c0 0x7fbdf019a990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00d950 tx=0x7fbddc00de10 comp rx=0 tx=0).stop 2024-09-21T07:11:05.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.374+0000 7fbdf6c16640 1 -- 172.21.15.92:0/3170389578 shutdown_connections 2024-09-21T07:11:05.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.374+0000 7fbdf6c16640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbde00b6590 0x7fbde00b8aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.374+0000 7fbdf6c16640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf0105b10 0x7fbdf019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.374+0000 7fbdf6c16640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdf01051c0 0x7fbdf019a990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.374+0000 7fbdf6c16640 1 --2- 172.21.15.92:0/3170389578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01031b0 0x7fbdf019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:05.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.374+0000 7fbdf6c16640 1 -- 172.21.15.92:0/3170389578 >> 172.21.15.92:0/3170389578 conn(0x7fbdf0079f90 msgr2=0x7fbdf01065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:05.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.375+0000 7fbdf6c16640 1 -- 172.21.15.92:0/3170389578 shutdown_connections 2024-09-21T07:11:05.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:05.375+0000 7fbdf6c16640 1 -- 172.21.15.92:0/3170389578 wait complete. 2024-09-21T07:11:05.688 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:05 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3170389578' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:11:05.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:05 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3170389578' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:11:06.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:05 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3170389578' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:11:06.035 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:11:06.281 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:06.702 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:06 smithi092 ceph-mon[30987]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.790+0000 7f1136688640 1 -- 172.21.15.92:0/271121414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1130108670 msgr2=0x7f1130108a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.790+0000 7f1136688640 1 --2- 172.21.15.92:0/271121414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1130108670 0x7f1130108a80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1118009900 tx=0x7f111802a410 comp rx=0 tx=0).stop 2024-09-21T07:11:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.790+0000 7f1136688640 1 -- 172.21.15.92:0/271121414 shutdown_connections 2024-09-21T07:11:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.790+0000 7f1136688640 1 --2- 172.21.15.92:0/271121414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1130108fc0 0x7f113010f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.790+0000 7f1136688640 1 --2- 172.21.15.92:0/271121414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1130108670 0x7f1130108a80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.790+0000 7f1136688640 1 --2- 172.21.15.92:0/271121414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1130103230 0x7f1130103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.790+0000 7f1136688640 1 -- 172.21.15.92:0/271121414 >> 172.21.15.92:0/271121414 conn(0x7f1130079ea0 msgr2=0x7f113007a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.790+0000 7f1136688640 1 -- 172.21.15.92:0/271121414 shutdown_connections 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.790+0000 7f1136688640 1 -- 172.21.15.92:0/271121414 wait complete. 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1136688640 1 Processor -- start 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1136688640 1 -- start start 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1136688640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1130103230 0x7f113019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1136688640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1130108670 0x7f113019acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1136688640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1130108fc0 0x7f113019ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1136688640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1130112b30 con 0x7f1130108fc0 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1136688640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f11301129b0 con 0x7f1130103230 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1136688640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1130112cb0 con 0x7f1130108670 2024-09-21T07:11:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1134c25640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1130108fc0 0x7f113019ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1134c25640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1130108fc0 0x7f113019ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60270/0 (socket says 172.21.15.92:60270) 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1134c25640 1 -- 172.21.15.92:0/604129453 learned_addr learned my addr 172.21.15.92:0/604129453 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1127fff640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1130108670 0x7f113019acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f112ffff640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1130103230 0x7f113019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1134c25640 1 -- 172.21.15.92:0/604129453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1130108670 msgr2=0x7f113019acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1134c25640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1130108670 0x7f113019acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1134c25640 1 -- 172.21.15.92:0/604129453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1130103230 msgr2=0x7f113019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1134c25640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1130103230 0x7f113019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1134c25640 1 -- 172.21.15.92:0/604129453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11301a06a0 con 0x7f1130108fc0 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1127fff640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1130108670 0x7f113019acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.791+0000 7f1134c25640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1130108fc0 0x7f113019ff70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f112800cad0 tx=0x7f112800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.792+0000 7f112dffb640 1 -- 172.21.15.92:0/604129453 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112800ae20 con 0x7f1130108fc0 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.792+0000 7f1136688640 1 -- 172.21.15.92:0/604129453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11301a0990 con 0x7f1130108fc0 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.792+0000 7f112dffb640 1 -- 172.21.15.92:0/604129453 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1128005020 con 0x7f1130108fc0 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.792+0000 7f112dffb640 1 -- 172.21.15.92:0/604129453 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112800f6b0 con 0x7f1130108fc0 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.792+0000 7f1136688640 1 -- 172.21.15.92:0/604129453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11301a70f0 con 0x7f1130108fc0 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.793+0000 7f1136688640 1 -- 172.21.15.92:0/604129453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1130103640 con 0x7f1130108fc0 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.794+0000 7f112dffb640 1 -- 172.21.15.92:0/604129453 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f11280051d0 con 0x7f1130108fc0 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.795+0000 7f112dffb640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f111c0b6560 0x7f111c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.795+0000 7f112ffff640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f111c0b6560 0x7f111c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.795+0000 7f112dffb640 1 -- 172.21.15.92:0/604129453 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9017+0+0 (secure 0 0 0) 0x7f11280e7a60 con 0x7f1130108fc0 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.795+0000 7f112ffff640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f111c0b6560 0x7f111c0b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1120005fd0 tx=0x7f1120005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.798+0000 7f112dffb640 1 -- 172.21.15.92:0/604129453 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1128014030 con 0x7f1130108fc0 2024-09-21T07:11:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:06 smithi169 ceph-mon[33705]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:06.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.977+0000 7f1136688640 1 -- 172.21.15.92:0/604129453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f113019b860 con 0x7f1130108fc0 2024-09-21T07:11:06.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.978+0000 7f112dffb640 1 -- 172.21.15.92:0/604129453 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24558 (secure 0 0 0) 0x7f113019b860 con 0x7f1130108fc0 2024-09-21T07:11:06.981 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:06.981 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:11:03.260021+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 -- 172.21.15.92:0/604129453 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f111c0b6560 msgr2=0x7f111c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f111c0b6560 0x7f111c0b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1120005fd0 tx=0x7f1120005850 comp rx=0 tx=0).stop 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 -- 172.21.15.92:0/604129453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1130108fc0 msgr2=0x7f113019ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1130108fc0 0x7f113019ff70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f112800cad0 tx=0x7f112800cf90 comp rx=0 tx=0).stop 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 -- 172.21.15.92:0/604129453 shutdown_connections 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f111c0b6560 0x7f111c0b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1130108fc0 0x7f113019ff70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1130108670 0x7f113019acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 --2- 172.21.15.92:0/604129453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1130103230 0x7f113019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 -- 172.21.15.92:0/604129453 >> 172.21.15.92:0/604129453 conn(0x7f1130079ea0 msgr2=0x7f1130104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:06.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 -- 172.21.15.92:0/604129453 shutdown_connections 2024-09-21T07:11:06.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:06.981+0000 7f1136688640 1 -- 172.21.15.92:0/604129453 wait complete. 2024-09-21T07:11:07.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:06 smithi175 ceph-mon[34064]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:07.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:11:07.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:07 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/604129453' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:07.891 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:07.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:07 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/604129453' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:08.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:07 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/604129453' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:08.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.373+0000 7fcfce363640 1 -- 172.21.15.92:0/343453527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc81083c0 msgr2=0x7fcfc81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.373+0000 7fcfce363640 1 --2- 172.21.15.92:0/343453527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc81083c0 0x7fcfc81087d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009900 tx=0x7fcfbc02a410 comp rx=0 tx=0).stop 2024-09-21T07:11:08.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.373+0000 7fcfce363640 1 -- 172.21.15.92:0/343453527 shutdown_connections 2024-09-21T07:11:08.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.373+0000 7fcfce363640 1 --2- 172.21.15.92:0/343453527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc8108d10 0x7fcfc810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.373+0000 7fcfce363640 1 --2- 172.21.15.92:0/343453527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc81083c0 0x7fcfc81087d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.373+0000 7fcfce363640 1 --2- 172.21.15.92:0/343453527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc8102a80 0x7fcfc8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.373+0000 7fcfce363640 1 -- 172.21.15.92:0/343453527 >> 172.21.15.92:0/343453527 conn(0x7fcfc8079740 msgr2=0x7fcfc8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.373+0000 7fcfce363640 1 -- 172.21.15.92:0/343453527 shutdown_connections 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.373+0000 7fcfce363640 1 -- 172.21.15.92:0/343453527 wait complete. 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.374+0000 7fcfce363640 1 Processor -- start 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.374+0000 7fcfce363640 1 -- start start 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.374+0000 7fcfce363640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc8102a80 0x7fcfc819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.374+0000 7fcfce363640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc81083c0 0x7fcfc819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.374+0000 7fcfce363640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc8108d10 0x7fcfc819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.374+0000 7fcfce363640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8112870 con 0x7fcfc8102a80 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.374+0000 7fcfce363640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81126f0 con 0x7fcfc8108d10 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.374+0000 7fcfce363640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81129f0 con 0x7fcfc81083c0 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc8102a80 0x7fcfc819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc8102a80 0x7fcfc819b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60292/0 (socket says 172.21.15.92:60292) 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc7fff640 1 -- 172.21.15.92:0/3518905986 learned_addr learned my addr 172.21.15.92:0/3518905986 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc77fe640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc81083c0 0x7fcfc819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfcc900640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc8108d10 0x7fcfc819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc7fff640 1 -- 172.21.15.92:0/3518905986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc81083c0 msgr2=0x7fcfc819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc7fff640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc81083c0 0x7fcfc819b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc7fff640 1 -- 172.21.15.92:0/3518905986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc8108d10 msgr2=0x7fcfc819bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc7fff640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc8108d10 0x7fcfc819bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc7fff640 1 -- 172.21.15.92:0/3518905986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc81a6540 con 0x7fcfc8102a80 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc7fff640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc8102a80 0x7fcfc819b280 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800b4a0 tx=0x7fcfb800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:08.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc57fa640 1 -- 172.21.15.92:0/3518905986 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8014070 con 0x7fcfc8102a80 2024-09-21T07:11:08.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc57fa640 1 -- 172.21.15.92:0/3518905986 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcfb8010aa0 con 0x7fcfc8102a80 2024-09-21T07:11:08.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfce363640 1 -- 172.21.15.92:0/3518905986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc81a6830 con 0x7fcfc8102a80 2024-09-21T07:11:08.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfc57fa640 1 -- 172.21.15.92:0/3518905986 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8017b70 con 0x7fcfc8102a80 2024-09-21T07:11:08.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.375+0000 7fcfce363640 1 -- 172.21.15.92:0/3518905986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc81a6dc0 con 0x7fcfc8102a80 2024-09-21T07:11:08.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.377+0000 7fcfce363640 1 -- 172.21.15.92:0/3518905986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc8103d00 con 0x7fcfc8102a80 2024-09-21T07:11:08.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.378+0000 7fcfc57fa640 1 -- 172.21.15.92:0/3518905986 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fcfb8017070 con 0x7fcfc8102a80 2024-09-21T07:11:08.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.379+0000 7fcfc57fa640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfb00b6560 0x7fcfb00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.379+0000 7fcfc77fe640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfb00b6560 0x7fcfb00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.379+0000 7fcfc57fa640 1 -- 172.21.15.92:0/3518905986 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9017+0+0 (secure 0 0 0) 0x7fcfb80e6c50 con 0x7fcfc8102a80 2024-09-21T07:11:08.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.380+0000 7fcfc77fe640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfb00b6560 0x7fcfb00b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc005ec0 tx=0x7fcfbc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:08.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.384+0000 7fcfc57fa640 1 -- 172.21.15.92:0/3518905986 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcfb80b1550 con 0x7fcfc8102a80 2024-09-21T07:11:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.565+0000 7fcfce363640 1 -- 172.21.15.92:0/3518905986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcfc806bf70 con 0x7fcfc8102a80 2024-09-21T07:11:08.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.566+0000 7fcfc57fa640 1 -- 172.21.15.92:0/3518905986 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24558 (secure 0 0 0) 0x7fcfc806bf70 con 0x7fcfc8102a80 2024-09-21T07:11:08.568 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:08.569 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:11:03.260021+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:08.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.569+0000 7fcfce363640 1 -- 172.21.15.92:0/3518905986 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfb00b6560 msgr2=0x7fcfb00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.569+0000 7fcfce363640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfb00b6560 0x7fcfb00b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc005ec0 tx=0x7fcfbc0058d0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.569+0000 7fcfce363640 1 -- 172.21.15.92:0/3518905986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc8102a80 msgr2=0x7fcfc819b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.569+0000 7fcfce363640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc8102a80 0x7fcfc819b280 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800b4a0 tx=0x7fcfb800b960 comp rx=0 tx=0).stop 2024-09-21T07:11:08.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.570+0000 7fcfce363640 1 -- 172.21.15.92:0/3518905986 shutdown_connections 2024-09-21T07:11:08.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.570+0000 7fcfce363640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfb00b6560 0x7fcfb00b8a70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.570+0000 7fcfce363640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc8108d10 0x7fcfc819bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.570+0000 7fcfce363640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc81083c0 0x7fcfc819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.570+0000 7fcfce363640 1 --2- 172.21.15.92:0/3518905986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc8102a80 0x7fcfc819b280 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.570+0000 7fcfce363640 1 -- 172.21.15.92:0/3518905986 >> 172.21.15.92:0/3518905986 conn(0x7fcfc8079740 msgr2=0x7fcfc8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:08.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.570+0000 7fcfce363640 1 -- 172.21.15.92:0/3518905986 shutdown_connections 2024-09-21T07:11:08.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:08.570+0000 7fcfce363640 1 -- 172.21.15.92:0/3518905986 wait complete. 2024-09-21T07:11:08.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:08 smithi175 ceph-mon[34064]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:08.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:08 smithi092 ceph-mon[30987]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:08.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:08 smithi169 ceph-mon[33705]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:09.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:11:09.612 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:09.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:09 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3518905986' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:09.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:09 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3518905986' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:10.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:09 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3518905986' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:10.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.115+0000 7fc8aa887640 1 -- 172.21.15.92:0/813101788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8a4109e10 msgr2=0x7fc8a4110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.115+0000 7fc8aa887640 1 --2- 172.21.15.92:0/813101788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8a4109e10 0x7fc8a4110640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009ca0 tx=0x7fc89c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.115+0000 7fc8aa887640 1 -- 172.21.15.92:0/813101788 shutdown_connections 2024-09-21T07:11:10.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.116+0000 7fc8aa887640 1 --2- 172.21.15.92:0/813101788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8a4109e10 0x7fc8a4110640 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.116+0000 7fc8aa887640 1 --2- 172.21.15.92:0/813101788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a41094c0 0x7fc8a41098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.116+0000 7fc8aa887640 1 --2- 172.21.15.92:0/813101788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a4101fe0 0x7fc8a41023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.116+0000 7fc8aa887640 1 -- 172.21.15.92:0/813101788 >> 172.21.15.92:0/813101788 conn(0x7fc8a4077bc0 msgr2=0x7fc8a4078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.116+0000 7fc8aa887640 1 -- 172.21.15.92:0/813101788 shutdown_connections 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.116+0000 7fc8aa887640 1 -- 172.21.15.92:0/813101788 wait complete. 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.116+0000 7fc8aa887640 1 Processor -- start 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.116+0000 7fc8aa887640 1 -- start start 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8aa887640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a4101fe0 0x7fc8a419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8aa887640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a41094c0 0x7fc8a419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8aa887640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8a4109e10 0x7fc8a419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8aa887640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a41139e0 con 0x7fc8a4109e10 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8aa887640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a4113860 con 0x7fc8a4101fe0 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8aa887640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a4113b60 con 0x7fc8a41094c0 2024-09-21T07:11:10.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a8e24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8a4109e10 0x7fc8a419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a8e24640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8a4109e10 0x7fc8a419fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53564/0 (socket says 172.21.15.92:53564) 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a8e24640 1 -- 172.21.15.92:0/1977023047 learned_addr learned my addr 172.21.15.92:0/1977023047 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a37fe640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a41094c0 0x7fc8a419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a3fff640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a4101fe0 0x7fc8a419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a8e24640 1 -- 172.21.15.92:0/1977023047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a41094c0 msgr2=0x7fc8a419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a8e24640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a41094c0 0x7fc8a419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a8e24640 1 -- 172.21.15.92:0/1977023047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a4101fe0 msgr2=0x7fc8a419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a8e24640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a4101fe0 0x7fc8a419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a8e24640 1 -- 172.21.15.92:0/1977023047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a41a0380 con 0x7fc8a4109e10 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a8e24640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8a4109e10 0x7fc8a419fc50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc89c005cc0 tx=0x7fc89c032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a17fa640 1 -- 172.21.15.92:0/1977023047 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c004040 con 0x7fc8a4109e10 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8aa887640 1 -- 172.21.15.92:0/1977023047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a41a0610 con 0x7fc8a4109e10 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a17fa640 1 -- 172.21.15.92:0/1977023047 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc89c004670 con 0x7fc8a4109e10 2024-09-21T07:11:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8a17fa640 1 -- 172.21.15.92:0/1977023047 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c030cc0 con 0x7fc8a4109e10 2024-09-21T07:11:10.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.117+0000 7fc8aa887640 1 -- 172.21.15.92:0/1977023047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a41a6dd0 con 0x7fc8a4109e10 2024-09-21T07:11:10.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.119+0000 7fc8aa887640 1 -- 172.21.15.92:0/1977023047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a41023f0 con 0x7fc8a4109e10 2024-09-21T07:11:10.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.120+0000 7fc8a17fa640 1 -- 172.21.15.92:0/1977023047 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fc89c0041e0 con 0x7fc8a4109e10 2024-09-21T07:11:10.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.121+0000 7fc8a17fa640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc88c0b6560 0x7fc88c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.121+0000 7fc8a3fff640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc88c0b6560 0x7fc88c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.121+0000 7fc8a17fa640 1 -- 172.21.15.92:0/1977023047 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9017+0+0 (secure 0 0 0) 0x7fc89c108d50 con 0x7fc8a4109e10 2024-09-21T07:11:10.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.122+0000 7fc8a3fff640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc88c0b6560 0x7fc88c0b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc894009890 tx=0x7fc894008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:10.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.126+0000 7fc8a17fa640 1 -- 172.21.15.92:0/1977023047 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc89c10c030 con 0x7fc8a4109e10 2024-09-21T07:11:10.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.337+0000 7fc8aa887640 1 -- 172.21.15.92:0/1977023047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8a410bc40 con 0x7fc8a4109e10 2024-09-21T07:11:10.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.338+0000 7fc8a17fa640 1 -- 172.21.15.92:0/1977023047 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11845 (secure 0 0 0) 0x7fc89c0cf2d0 con 0x7fc8a4109e10 2024-09-21T07:11:10.340 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:10.340 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":17,"btime":"2024-09-21T07:11:03:544974+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:11:03.260197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24649,"qdb_cluster":[24649]},"id":1}]} 2024-09-21T07:11:10.340 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 17 2024-09-21T07:11:10.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.340+0000 7fc8aa887640 1 -- 172.21.15.92:0/1977023047 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc88c0b6560 msgr2=0x7fc88c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.340+0000 7fc8aa887640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc88c0b6560 0x7fc88c0b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc894009890 tx=0x7fc894008040 comp rx=0 tx=0).stop 2024-09-21T07:11:10.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.340+0000 7fc8aa887640 1 -- 172.21.15.92:0/1977023047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8a4109e10 msgr2=0x7fc8a419fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.340+0000 7fc8aa887640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8a4109e10 0x7fc8a419fc50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc89c005cc0 tx=0x7fc89c032c40 comp rx=0 tx=0).stop 2024-09-21T07:11:10.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.341+0000 7fc8aa887640 1 -- 172.21.15.92:0/1977023047 shutdown_connections 2024-09-21T07:11:10.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.341+0000 7fc8aa887640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc88c0b6560 0x7fc88c0b8a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.341+0000 7fc8aa887640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8a4109e10 0x7fc8a419fc50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.341+0000 7fc8aa887640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a41094c0 0x7fc8a419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.341+0000 7fc8aa887640 1 --2- 172.21.15.92:0/1977023047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8a4101fe0 0x7fc8a419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.341+0000 7fc8aa887640 1 -- 172.21.15.92:0/1977023047 >> 172.21.15.92:0/1977023047 conn(0x7fc8a4077bc0 msgr2=0x7fc8a41075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:10.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.341+0000 7fc8aa887640 1 -- 172.21.15.92:0/1977023047 shutdown_connections 2024-09-21T07:11:10.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:10.341+0000 7fc8aa887640 1 -- 172.21.15.92:0/1977023047 wait complete. 2024-09-21T07:11:10.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:10 smithi092 ceph-mon[30987]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:10.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:10 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1977023047' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:11:10.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:10 smithi169 ceph-mon[33705]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:10.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:10 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1977023047' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:11:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:10 smithi175 ceph-mon[34064]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:10 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1977023047' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:11:11.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:11:11.420 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:11.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.927+0000 7fe357a83640 1 -- 172.21.15.92:0/2873362026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3501083a0 msgr2=0x7fe3501087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.927+0000 7fe357a83640 1 --2- 172.21.15.92:0/2873362026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3501083a0 0x7fe3501087b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009900 tx=0x7fe34c02a410 comp rx=0 tx=0).stop 2024-09-21T07:11:11.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.927+0000 7fe357a83640 1 -- 172.21.15.92:0/2873362026 shutdown_connections 2024-09-21T07:11:11.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.927+0000 7fe357a83640 1 --2- 172.21.15.92:0/2873362026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe350108cf0 0x7fe35010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.927+0000 7fe357a83640 1 --2- 172.21.15.92:0/2873362026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3501083a0 0x7fe3501087b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.927+0000 7fe357a83640 1 --2- 172.21.15.92:0/2873362026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe350102a60 0x7fe350102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.927+0000 7fe357a83640 1 -- 172.21.15.92:0/2873362026 >> 172.21.15.92:0/2873362026 conn(0x7fe350079760 msgr2=0x7fe350079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.927+0000 7fe357a83640 1 -- 172.21.15.92:0/2873362026 shutdown_connections 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.927+0000 7fe357a83640 1 -- 172.21.15.92:0/2873362026 wait complete. 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe357a83640 1 Processor -- start 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe357a83640 1 -- start start 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe357a83640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe350102a60 0x7fe35019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe357a83640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3501083a0 0x7fe35019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe357a83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe350108cf0 0x7fe35019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe357a83640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3501128a0 con 0x7fe350108cf0 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe357a83640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe350112720 con 0x7fe3501083a0 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe357a83640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe350112a20 con 0x7fe350102a60 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe356020640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe350108cf0 0x7fe35019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe356020640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe350108cf0 0x7fe35019fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53588/0 (socket says 172.21.15.92:53588) 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.928+0000 7fe356020640 1 -- 172.21.15.92:0/2372161145 learned_addr learned my addr 172.21.15.92:0/2372161145 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe35581f640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe350102a60 0x7fe35019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe35501e640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3501083a0 0x7fe35019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe356020640 1 -- 172.21.15.92:0/2372161145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe350102a60 msgr2=0x7fe35019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe356020640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe350102a60 0x7fe35019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe356020640 1 -- 172.21.15.92:0/2372161145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3501083a0 msgr2=0x7fe35019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe356020640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3501083a0 0x7fe35019aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe356020640 1 -- 172.21.15.92:0/2372161145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3501a04b0 con 0x7fe350108cf0 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe356020640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe350108cf0 0x7fe35019fd80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe34400cad0 tx=0x7fe34400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe342ffd640 1 -- 172.21.15.92:0/2372161145 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34400ae20 con 0x7fe350108cf0 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe342ffd640 1 -- 172.21.15.92:0/2372161145 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe344005020 con 0x7fe350108cf0 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe342ffd640 1 -- 172.21.15.92:0/2372161145 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34400f6b0 con 0x7fe350108cf0 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe357a83640 1 -- 172.21.15.92:0/2372161145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3501a07a0 con 0x7fe350108cf0 2024-09-21T07:11:11.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.929+0000 7fe357a83640 1 -- 172.21.15.92:0/2372161145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3501a6f00 con 0x7fe350108cf0 2024-09-21T07:11:11.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.930+0000 7fe357a83640 1 -- 172.21.15.92:0/2372161145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe350103ce0 con 0x7fe350108cf0 2024-09-21T07:11:11.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.932+0000 7fe342ffd640 1 -- 172.21.15.92:0/2372161145 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fe3440051d0 con 0x7fe350108cf0 2024-09-21T07:11:11.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.932+0000 7fe342ffd640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe33c0b6560 0x7fe33c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.933+0000 7fe35581f640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe33c0b6560 0x7fe33c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.933+0000 7fe342ffd640 1 -- 172.21.15.92:0/2372161145 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9017+0+0 (secure 0 0 0) 0x7fe3440e7aa0 con 0x7fe350108cf0 2024-09-21T07:11:11.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.933+0000 7fe35581f640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe33c0b6560 0x7fe33c0b8a70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe348009890 tx=0x7fe348008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:11.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:11.935+0000 7fe342ffd640 1 -- 172.21.15.92:0/2372161145 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe344014030 con 0x7fe350108cf0 2024-09-21T07:11:12.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.116+0000 7fe357a83640 1 -- 172.21.15.92:0/2372161145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe350102e70 con 0x7fe350108cf0 2024-09-21T07:11:12.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.117+0000 7fe342ffd640 1 -- 172.21.15.92:0/2372161145 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24558 (secure 0 0 0) 0x7fe350102e70 con 0x7fe350108cf0 2024-09-21T07:11:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:12.119 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:11:03.260021+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:12.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.119+0000 7fe357a83640 1 -- 172.21.15.92:0/2372161145 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe33c0b6560 msgr2=0x7fe33c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.119+0000 7fe357a83640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe33c0b6560 0x7fe33c0b8a70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe348009890 tx=0x7fe348008040 comp rx=0 tx=0).stop 2024-09-21T07:11:12.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.119+0000 7fe357a83640 1 -- 172.21.15.92:0/2372161145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe350108cf0 msgr2=0x7fe35019fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.119+0000 7fe357a83640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe350108cf0 0x7fe35019fd80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe34400cad0 tx=0x7fe34400cf90 comp rx=0 tx=0).stop 2024-09-21T07:11:12.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.119+0000 7fe357a83640 1 -- 172.21.15.92:0/2372161145 shutdown_connections 2024-09-21T07:11:12.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.119+0000 7fe357a83640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe33c0b6560 0x7fe33c0b8a70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.119+0000 7fe357a83640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe350108cf0 0x7fe35019fd80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.119+0000 7fe357a83640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3501083a0 0x7fe35019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.119+0000 7fe357a83640 1 --2- 172.21.15.92:0/2372161145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe350102a60 0x7fe35019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.119+0000 7fe357a83640 1 -- 172.21.15.92:0/2372161145 >> 172.21.15.92:0/2372161145 conn(0x7fe350079760 msgr2=0x7fe35006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:12.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.120+0000 7fe357a83640 1 -- 172.21.15.92:0/2372161145 shutdown_connections 2024-09-21T07:11:12.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:12.120+0000 7fe357a83640 1 -- 172.21.15.92:0/2372161145 wait complete. 2024-09-21T07:11:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:12 smithi092 ceph-mon[30987]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:12 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2372161145' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:12.890 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:10:54.236729+0000', 'modified': '2024-09-21T07:11:03.260197+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24649}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24649': {'gid': 24649, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.175:6839/3839014225', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3839014225}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3839014225}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24649, 'qdb_cluster': [24649]} 2024-09-21T07:11:12.890 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:11:12.890 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:11:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:12 smithi169 ceph-mon[33705]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:12.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:12 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2372161145' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:12 smithi175 ceph-mon[34064]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:12 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2372161145' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:13.135 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.668+0000 7f32e1e7b640 1 -- 172.21.15.92:0/1572878522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc106c10 msgr2=0x7f32dc110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.668+0000 7f32e1e7b640 1 --2- 172.21.15.92:0/1572878522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc106c10 0x7f32dc110650 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009ca0 tx=0x7f32d402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.668+0000 7f32e1e7b640 1 -- 172.21.15.92:0/1572878522 shutdown_connections 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.668+0000 7f32e1e7b640 1 --2- 172.21.15.92:0/1572878522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc106c10 0x7f32dc110650 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.668+0000 7f32e1e7b640 1 --2- 172.21.15.92:0/1572878522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32dc1062c0 0x7f32dc1066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.668+0000 7f32e1e7b640 1 --2- 172.21.15.92:0/1572878522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc1020d0 0x7f32dc1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.668+0000 7f32e1e7b640 1 -- 172.21.15.92:0/1572878522 >> 172.21.15.92:0/1572878522 conn(0x7f32dc077cc0 msgr2=0x7f32dc078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.668+0000 7f32e1e7b640 1 -- 172.21.15.92:0/1572878522 shutdown_connections 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.668+0000 7f32e1e7b640 1 -- 172.21.15.92:0/1572878522 wait complete. 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32e1e7b640 1 Processor -- start 2024-09-21T07:11:13.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32e1e7b640 1 -- start start 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32e1e7b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32dc1020d0 0x7f32dc19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32e1e7b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc1062c0 0x7f32dc19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32e1e7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc106c10 0x7f32dc19fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32e1e7b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc1139e0 con 0x7f32dc106c10 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32e1e7b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc113860 con 0x7f32dc1020d0 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32e1e7b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc113b60 con 0x7f32dc1062c0 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32dbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc106c10 0x7f32dc19fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32dbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc106c10 0x7f32dc19fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53620/0 (socket says 172.21.15.92:53620) 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32dbfff640 1 -- 172.21.15.92:0/263371029 learned_addr learned my addr 172.21.15.92:0/263371029 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32db7fe640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32dc1020d0 0x7f32dc19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.669+0000 7f32d3fff640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc1062c0 0x7f32dc19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32dbfff640 1 -- 172.21.15.92:0/263371029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc1062c0 msgr2=0x7f32dc19a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32dbfff640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc1062c0 0x7f32dc19a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32dbfff640 1 -- 172.21.15.92:0/263371029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32dc1020d0 msgr2=0x7f32dc19a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32dbfff640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32dc1020d0 0x7f32dc19a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32dbfff640 1 -- 172.21.15.92:0/263371029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc1a0200 con 0x7f32dc106c10 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32db7fe640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32dc1020d0 0x7f32dc19a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32dbfff640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc106c10 0x7f32dc19fb90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f32d4005cc0 tx=0x7f32d4032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32d97fa640 1 -- 172.21.15.92:0/263371029 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4004040 con 0x7f32dc106c10 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32e1e7b640 1 -- 172.21.15.92:0/263371029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32dc1a0490 con 0x7f32dc106c10 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32d97fa640 1 -- 172.21.15.92:0/263371029 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d4004670 con 0x7f32dc106c10 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32d97fa640 1 -- 172.21.15.92:0/263371029 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4030cc0 con 0x7f32dc106c10 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.670+0000 7f32e1e7b640 1 -- 172.21.15.92:0/263371029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32dc1a09d0 con 0x7f32dc106c10 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.673+0000 7f32e83ef740 1 Processor -- start 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.673+0000 7f32d97fa640 1 -- 172.21.15.92:0/263371029 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f32d40041e0 con 0x7f32dc106c10 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.673+0000 7f32e83ef740 1 -- start start 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.673+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803cd1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.673+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 0x556803cd2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.673+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 0x556803cd2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.673+0000 7f32e83ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556803c49c10 con 0x55680392bf60 2024-09-21T07:11:13.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.673+0000 7f32e83ef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556803c39040 con 0x55680390b280 2024-09-21T07:11:13.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.673+0000 7f32e83ef740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556803c3ce50 con 0x5568039030a0 2024-09-21T07:11:13.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 0x556803cd2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32db7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 0x556803cd2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 0x556803cd2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:56968/0 (socket says 172.21.15.92:56968) 2024-09-21T07:11:13.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32d3fff640 1 -- 172.21.15.92:0/3728582218 learned_addr learned my addr 172.21.15.92:0/3728582218 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:13.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32d3fff640 1 --2- 172.21.15.92:0/3728582218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803cd1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32d3fff640 1 -- 172.21.15.92:0/3728582218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 msgr2=0x556803cd2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32d3fff640 1 --2- 172.21.15.92:0/3728582218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 0x556803cd2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32d3fff640 1 -- 172.21.15.92:0/3728582218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 msgr2=0x556803cd1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32d3fff640 1 --2- 172.21.15.92:0/3728582218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803cd1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32d3fff640 1 -- 172.21.15.92:0/3728582218 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556803997540 con 0x55680390b280 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.674+0000 7f32db7fe640 1 --2- 172.21.15.92:0/3728582218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 0x556803cd2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.675+0000 7f32d3fff640 1 --2- 172.21.15.92:0/3728582218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 0x556803cd2980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005fd0 tx=0x7f32c400e410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51ebc923d616eb09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.675+0000 7f32d97fa640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32c80b6590 0x7f32c80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.675+0000 7f32db7fe640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32c80b6590 0x7f32c80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.675+0000 7f32d1ffb640 1 -- 172.21.15.92:0/3728582218 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4004020 con 0x55680390b280 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.675+0000 7f32d97fa640 1 -- 172.21.15.92:0/263371029 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f32d4108c90 con 0x7f32dc106c10 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.675+0000 7f32d1ffb640 1 -- 172.21.15.92:0/3728582218 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32c400bd60 con 0x55680390b280 2024-09-21T07:11:13.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.675+0000 7f32d1ffb640 1 -- 172.21.15.92:0/3728582218 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4005280 con 0x55680390b280 2024-09-21T07:11:13.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32e83ef740 1 -- 172.21.15.92:0/3728582218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 msgr2=0x556803cd2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32e83ef740 1 --2- 172.21.15.92:0/3728582218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 0x556803cd2980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005fd0 tx=0x7f32c400e410 comp rx=0 tx=0).stop 2024-09-21T07:11:13.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32db7fe640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32c80b6590 0x7f32c80b8aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x556803cd0b80 tx=0x7f32cc0084c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32e83ef740 1 -- 172.21.15.92:0/3728582218 shutdown_connections 2024-09-21T07:11:13.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32e83ef740 1 --2- 172.21.15.92:0/3728582218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 0x556803cd2980 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32e83ef740 1 --2- 172.21.15.92:0/3728582218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 0x556803cd2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32e83ef740 1 --2- 172.21.15.92:0/3728582218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803cd1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32e83ef740 1 -- 172.21.15.92:0/3728582218 >> 172.21.15.92:0/3728582218 conn(0x556803920350 msgr2=0x556803ccfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32e83ef740 1 -- 172.21.15.92:0/3728582218 shutdown_connections 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32e83ef740 1 -- 172.21.15.92:0/3728582218 wait complete. 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.676+0000 7f32e83ef740 1 -- start start 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32e83ef740 1 Processor -- start 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568039030a0 0x556803cd9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680390b280 0x556803cda0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55680392bf60 0x556803cdf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32e83ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556803a9a5f0 con 0x55680390b280 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32e83ef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556803bd4010 con 0x5568039030a0 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32e83ef740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556803ce0460 con 0x55680392bf60 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32e83ef740 10 client.0 _ll_register_callbacks cb 0x556803c33340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680390b280 0x556803cda0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680390b280 0x556803cda0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53632/0 (socket says 172.21.15.92:53632) 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32d3fff640 1 -- 172.21.15.92:0/1923599155 learned_addr learned my addr 172.21.15.92:0/1923599155 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32dbfff640 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55680392bf60 0x556803cdf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32db7fe640 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568039030a0 0x556803cd9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32d3fff640 1 -- 172.21.15.92:0/1923599155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55680392bf60 msgr2=0x556803cdf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32d3fff640 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55680392bf60 0x556803cdf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32d3fff640 1 -- 172.21.15.92:0/1923599155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568039030a0 msgr2=0x556803cd9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32d3fff640 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568039030a0 0x556803cd9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.677+0000 7f32d3fff640 1 -- 172.21.15.92:0/1923599155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556803c01a00 con 0x55680390b280 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32d3fff640 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680390b280 0x556803cda0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f32c400ed90 tx=0x7f32c400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5378bc12eced40 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32baffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32baffd640 1 -- 172.21.15.92:0/1923599155 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40132d0 con 0x55680390b280 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32baffd640 1 -- 172.21.15.92:0/1923599155 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f32c400b8d0 con 0x55680390b280 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32e83ef740 1 -- 172.21.15.92:0/1923599155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32c400bd60 con 0x55680390b280 2024-09-21T07:11:13.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32baffd640 1 -- 172.21.15.92:0/1923599155 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f32c402c050 con 0x55680390b280 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32e83ef740 10 client.14979 fetch_fsmap learned FSMap version 17 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32e83ef740 1 -- 172.21.15.92:0/1923599155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x556803cf4ea0 con 0x55680390b280 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32baffd640 1 -- 172.21.15.92:0/1923599155 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32c400bd60 con 0x55680390b280 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32baffd640 1 -- 172.21.15.92:0/1923599155 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f32c4025060 con 0x55680390b280 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.678+0000 7f32e83ef740 10 client.14979 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.679+0000 7f32e83ef740 10 client.14979 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.679+0000 7f32e83ef740 20 client.14979 populate_metadata read hostname 'smithi092' 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.679+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568038ea8e0 0x556803cf8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.679+0000 7f32e83ef740 4 client.14979 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.679+0000 7f32e83ef740 1 -- 172.21.15.92:0/1923599155 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556803c4bb60 con 0x5568038ea8e0 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.679+0000 7f32db7fe640 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568038ea8e0 0x556803cf8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.679+0000 7f32baffd640 10 client.14979 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.679+0000 7f32db7fe640 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568038ea8e0 0x556803cf8700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cfa5e2ede93a2bd server_cookie=bf1acaad73782fde in_seq=0 out_seq=0 2024-09-21T07:11:13.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32baffd640 1 -- 172.21.15.92:0/1923599155 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556803c4bb60 con 0x5568038ea8e0 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32baffd640 10 client.14979 handle_command_reply: tid=0 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32e83ef740 1 client.14979 shutdown 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32e83ef740 1 -- 172.21.15.92:0/1923599155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680390b280 msgr2=0x556803cda0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680390b280 0x556803cda0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f32c400ed90 tx=0x7f32c400edc0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32e83ef740 1 -- 172.21.15.92:0/1923599155 shutdown_connections 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568038ea8e0 0x556803cf8700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55680392bf60 0x556803cdf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680390b280 0x556803cda0d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1923599155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568039030a0 0x556803cd9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32baffd640 0 client.14979 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32e83ef740 1 -- 172.21.15.92:0/1923599155 >> 172.21.15.92:0/1923599155 conn(0x556803920350 msgr2=0x556803cd50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.680+0000 7f32e83ef740 1 -- 172.21.15.92:0/1923599155 shutdown_connections 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.681+0000 7f32e83ef740 1 -- 172.21.15.92:0/1923599155 wait complete. 2024-09-21T07:11:13.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.681+0000 7f32e83ef740 20 client.14979 trim_cache size 0 max 16384 2024-09-21T07:11:13.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32e83ef740 1 Processor -- start 2024-09-21T07:11:13.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32e83ef740 1 -- start start 2024-09-21T07:11:13.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 0x556803cf7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 0x556803ce16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ce1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32e83ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556803cf6a40 con 0x55680392bf60 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32e83ef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556803cf7110 con 0x55680390b280 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32e83ef740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556803cf77e0 con 0x5568039030a0 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32dbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ce1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32dbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ce1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53640/0 (socket says 172.21.15.92:53640) 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32dbfff640 1 -- 172.21.15.92:0/4195729566 learned_addr learned my addr 172.21.15.92:0/4195729566 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32d3fff640 1 --2- 172.21.15.92:0/4195729566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 0x556803ce16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32db7fe640 1 --2- 172.21.15.92:0/4195729566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 0x556803cf7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32dbfff640 1 -- 172.21.15.92:0/4195729566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 msgr2=0x556803cf7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32dbfff640 1 --2- 172.21.15.92:0/4195729566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 0x556803cf7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32dbfff640 1 -- 172.21.15.92:0/4195729566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 msgr2=0x556803ce16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:13.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32dbfff640 1 --2- 172.21.15.92:0/4195729566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 0x556803ce16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32dbfff640 1 -- 172.21.15.92:0/4195729566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556803cd41f0 con 0x55680392bf60 2024-09-21T07:11:13.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32db7fe640 1 --2- 172.21.15.92:0/4195729566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 0x556803cf7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:13.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.699+0000 7f32dbfff640 1 --2- 172.21.15.92:0/4195729566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ce1bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f32d40cbc60 tx=0x7f32d40ce400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8cd93adde1c515 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.700+0000 7f32d17fa640 1 -- 172.21.15.92:0/4195729566 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40ca160 con 0x55680392bf60 2024-09-21T07:11:13.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.700+0000 7f32d17fa640 1 -- 172.21.15.92:0/4195729566 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d4036040 con 0x55680392bf60 2024-09-21T07:11:13.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.700+0000 7f32d17fa640 1 -- 172.21.15.92:0/4195729566 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40cf0f0 con 0x55680392bf60 2024-09-21T07:11:13.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.700+0000 7f32e83ef740 1 -- 172.21.15.92:0/4195729566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 msgr2=0x556803ce1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.700+0000 7f32e83ef740 1 --2- 172.21.15.92:0/4195729566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ce1bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f32d40cbc60 tx=0x7f32d40ce400 comp rx=0 tx=0).stop 2024-09-21T07:11:13.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.700+0000 7f32e83ef740 1 -- 172.21.15.92:0/4195729566 shutdown_connections 2024-09-21T07:11:13.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.700+0000 7f32e83ef740 1 --2- 172.21.15.92:0/4195729566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ce1bf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.700+0000 7f32e83ef740 1 --2- 172.21.15.92:0/4195729566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55680390b280 0x556803ce16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.700+0000 7f32e83ef740 1 --2- 172.21.15.92:0/4195729566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568039030a0 0x556803cf7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.700+0000 7f32e83ef740 1 -- 172.21.15.92:0/4195729566 >> 172.21.15.92:0/4195729566 conn(0x556803920350 msgr2=0x556803cd7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 1 -- 172.21.15.92:0/4195729566 shutdown_connections 2024-09-21T07:11:13.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 1 -- 172.21.15.92:0/4195729566 wait complete. 2024-09-21T07:11:13.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 1 -- start start 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 1 Processor -- start 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568039030a0 0x556803d00e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55680390b280 0x556803d013c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ccef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556803cf8580 con 0x55680392bf60 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556803cf7eb0 con 0x5568039030a0 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556803cf8c50 con 0x55680390b280 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32e83ef740 10 client.0 _ll_register_callbacks cb 0x7f32c400ee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.701+0000 7f32dbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ccef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32dbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ccef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53652/0 (socket says 172.21.15.92:53652) 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32dbfff640 1 -- 172.21.15.92:0/1107702892 learned_addr learned my addr 172.21.15.92:0/1107702892 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32db7fe640 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568039030a0 0x556803d00e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32d3fff640 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55680390b280 0x556803d013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32dbfff640 1 -- 172.21.15.92:0/1107702892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55680390b280 msgr2=0x556803d013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32dbfff640 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55680390b280 0x556803d013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32dbfff640 1 -- 172.21.15.92:0/1107702892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568039030a0 msgr2=0x556803d00e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32dbfff640 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568039030a0 0x556803d00e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32dbfff640 1 -- 172.21.15.92:0/1107702892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556803ccf6f0 con 0x55680392bf60 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32dbfff640 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ccef60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f32d40ce980 tx=0x7f32d40ca1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f69fbe390b6e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32baffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32baffd640 1 -- 172.21.15.92:0/1107702892 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40e8020 con 0x55680392bf60 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32baffd640 1 -- 172.21.15.92:0/1107702892 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 9307+0+0 (secure 0 0 0) 0x7f32d40cac60 con 0x55680392bf60 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32e83ef740 1 -- 172.21.15.92:0/1107702892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32d4036040 con 0x55680392bf60 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32baffd640 1 -- 172.21.15.92:0/1107702892 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f32d4004820 con 0x55680392bf60 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32e83ef740 10 client.14985 fetch_fsmap learned FSMap version 17 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.702+0000 7f32e83ef740 1 -- 172.21.15.92:0/1107702892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x556803cf2bb0 con 0x55680392bf60 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32baffd640 1 -- 172.21.15.92:0/1107702892 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d4036040 con 0x55680392bf60 2024-09-21T07:11:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32baffd640 1 -- 172.21.15.92:0/1107702892 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f32d40d7f80 con 0x55680392bf60 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32e83ef740 10 client.14985 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32e83ef740 10 client.14985 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32e83ef740 20 client.14985 populate_metadata read hostname 'smithi092' 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568038bfc90 0x556803d66ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32e83ef740 4 client.14985 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32e83ef740 1 -- 172.21.15.92:0/1107702892 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "status"}) -- 0x556803c47610 con 0x5568038bfc90 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32db7fe640 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568038bfc90 0x556803d66ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32baffd640 10 client.14985 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.703+0000 7f32db7fe640 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568038bfc90 0x556803d66ec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71dde9bef8c40b41 server_cookie=832de4d5675f76ab in_seq=0 out_seq=0 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32baffd640 1 -- 172.21.15.92:0/1107702892 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x556803c47610 con 0x5568038bfc90 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32baffd640 10 client.14985 handle_command_reply: tid=0 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 client.14985 shutdown 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 -- 172.21.15.92:0/1107702892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 msgr2=0x556803ccef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ccef60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f32d40ce980 tx=0x7f32d40ca1f0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 -- 172.21.15.92:0/1107702892 shutdown_connections 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568038bfc90 0x556803d66ec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55680392bf60 0x556803ccef60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32baffd640 0 client.14985 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55680390b280 0x556803d013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 --2- 172.21.15.92:0/1107702892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568039030a0 0x556803d00e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 -- 172.21.15.92:0/1107702892 >> 172.21.15.92:0/1107702892 conn(0x556803920350 msgr2=0x556803cd7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 -- 172.21.15.92:0/1107702892 shutdown_connections 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 1 -- 172.21.15.92:0/1107702892 wait complete. 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.704+0000 7f32e83ef740 20 client.14985 trim_cache size 0 max 16384 2024-09-21T07:11:13.711 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24649, 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 19.217283831, 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 17, 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 38.870691377 2024-09-21T07:11:13.712 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:11:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 -- 172.21.15.92:0/263371029 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32c80b6590 msgr2=0x7f32c80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32c80b6590 0x7f32c80b8aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x556803cd0b80 tx=0x7f32cc0084c0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 -- 172.21.15.92:0/263371029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc106c10 msgr2=0x7f32dc19fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc106c10 0x7f32dc19fb90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f32d4005cc0 tx=0x7f32d4032c40 comp rx=0 tx=0).stop 2024-09-21T07:11:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 -- 172.21.15.92:0/263371029 shutdown_connections 2024-09-21T07:11:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32c80b6590 0x7f32c80b8aa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32dc106c10 0x7f32dc19fb90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc1062c0 0x7f32dc19a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 --2- 172.21.15.92:0/263371029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32dc1020d0 0x7f32dc19a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 -- 172.21.15.92:0/263371029 >> 172.21.15.92:0/263371029 conn(0x7f32dc077cc0 msgr2=0x7f32dc108500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 -- 172.21.15.92:0/263371029 shutdown_connections 2024-09-21T07:11:13.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:13.705+0000 7f32e1e7b640 1 -- 172.21.15.92:0/263371029 wait complete. 2024-09-21T07:11:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]} : dispatch 2024-09-21T07:11:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-21T07:11:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-09-21T07:11:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2024-09-21T07:11:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-09-21T07:11:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]} : dispatch 2024-09-21T07:11:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]} : dispatch 2024-09-21T07:11:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T07:11:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T07:11:13.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]} : dispatch 2024-09-21T07:11:13.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]} : dispatch 2024-09-21T07:11:13.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-21T07:11:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-09-21T07:11:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2024-09-21T07:11:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-09-21T07:11:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]} : dispatch 2024-09-21T07:11:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]} : dispatch 2024-09-21T07:11:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T07:11:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T07:11:13.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]} : dispatch 2024-09-21T07:11:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]} : dispatch 2024-09-21T07:11:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-21T07:11:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-09-21T07:11:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2024-09-21T07:11:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-09-21T07:11:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]} : dispatch 2024-09-21T07:11:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]} : dispatch 2024-09-21T07:11:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T07:11:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T07:11:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]} : dispatch 2024-09-21T07:11:14.406 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:11:14.406 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:11:14.406 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T07:11:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:14.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:14.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]}]': finished 2024-09-21T07:11:14.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-21T07:11:14.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-21T07:11:14.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-21T07:11:14.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-21T07:11:14.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2024-09-21T07:11:14.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-09-21T07:11:14.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T07:11:14.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T07:11:14.922 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]': finished 2024-09-21T07:11:14.922 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:14 smithi092 ceph-mon[30987]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T07:11:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]}]': finished 2024-09-21T07:11:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-21T07:11:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-21T07:11:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-21T07:11:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-21T07:11:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2024-09-21T07:11:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-09-21T07:11:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T07:11:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T07:11:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]': finished 2024-09-21T07:11:15.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:14 smithi175 ceph-mon[34064]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T07:11:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]}]': finished 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]': finished 2024-09-21T07:11:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:14 smithi169 ceph-mon[33705]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T07:11:15.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.146+0000 7f979a044640 1 -- 172.21.15.92:0/1799995815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9794108d20 msgr2=0x7f979410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.146+0000 7f979a044640 1 --2- 172.21.15.92:0/1799995815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9794108d20 0x7f979410f550 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f978c009ca0 tx=0x7f978c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.146+0000 7f979a044640 1 -- 172.21.15.92:0/1799995815 shutdown_connections 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.146+0000 7f979a044640 1 --2- 172.21.15.92:0/1799995815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9794108d20 0x7f979410f550 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.146+0000 7f979a044640 1 --2- 172.21.15.92:0/1799995815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97941083d0 0x7f97941087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.146+0000 7f979a044640 1 --2- 172.21.15.92:0/1799995815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9794102ae0 0x7f9794102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.146+0000 7f979a044640 1 -- 172.21.15.92:0/1799995815 >> 172.21.15.92:0/1799995815 conn(0x7f9794079760 msgr2=0x7f9794079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.147+0000 7f979a044640 1 -- 172.21.15.92:0/1799995815 shutdown_connections 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.147+0000 7f979a044640 1 -- 172.21.15.92:0/1799995815 wait complete. 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.147+0000 7f979a044640 1 Processor -- start 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.147+0000 7f979a044640 1 -- start start 2024-09-21T07:11:15.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.147+0000 7f979a044640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9794102ae0 0x7f979419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.147+0000 7f979a044640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97941083d0 0x7f979419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.147+0000 7f979a044640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9794108d20 0x7f979419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.147+0000 7f979a044640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9794112890 con 0x7f9794102ae0 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.147+0000 7f979a044640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9794112710 con 0x7f9794108d20 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.147+0000 7f979a044640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9794112a10 con 0x7f97941083d0 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97937fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9794102ae0 0x7f979419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97937fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9794102ae0 0x7f979419b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53656/0 (socket says 172.21.15.92:53656) 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97937fe640 1 -- 172.21.15.92:0/3025174373 learned_addr learned my addr 172.21.15.92:0/3025174373 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f978bfff640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97941083d0 0x7f979419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f9793fff640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9794108d20 0x7f979419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97937fe640 1 -- 172.21.15.92:0/3025174373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97941083d0 msgr2=0x7f979419b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97937fe640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97941083d0 0x7f979419b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97937fe640 1 -- 172.21.15.92:0/3025174373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9794108d20 msgr2=0x7f979419bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97937fe640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9794108d20 0x7f979419bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97937fe640 1 -- 172.21.15.92:0/3025174373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97941a64a0 con 0x7f9794102ae0 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97937fe640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9794102ae0 0x7f979419b1e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f978400c890 tx=0x7f978400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97917fa640 1 -- 172.21.15.92:0/3025174373 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784004220 con 0x7f9794102ae0 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97917fa640 1 -- 172.21.15.92:0/3025174373 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9784007e40 con 0x7f9794102ae0 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f979a044640 1 -- 172.21.15.92:0/3025174373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97941a6790 con 0x7f9794102ae0 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f97917fa640 1 -- 172.21.15.92:0/3025174373 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784004a00 con 0x7f9794102ae0 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.148+0000 7f979a044640 1 -- 172.21.15.92:0/3025174373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97941a6d20 con 0x7f9794102ae0 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.149+0000 7f979a044640 1 -- 172.21.15.92:0/3025174373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9794102ef0 con 0x7f9794102ae0 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.151+0000 7f97917fa640 1 -- 172.21.15.92:0/3025174373 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f97840079b0 con 0x7f9794102ae0 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.151+0000 7f97917fa640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97800b65e0 0x7f97800b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.151+0000 7f978bfff640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97800b65e0 0x7f97800b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:15.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.152+0000 7f97917fa640 1 -- 172.21.15.92:0/3025174373 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f97840e7860 con 0x7f9794102ae0 2024-09-21T07:11:15.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.152+0000 7f978bfff640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97800b65e0 0x7f97800b8af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9794105f20 tx=0x7f977c00a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:15.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.155+0000 7f97917fa640 1 -- 172.21.15.92:0/3025174373 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9784014030 con 0x7f9794102ae0 2024-09-21T07:11:15.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.372+0000 7f979a044640 1 -- 172.21.15.92:0/3025174373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f979406bf10 con 0x7f9794102ae0 2024-09-21T07:11:15.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.373+0000 7f97917fa640 1 -- 172.21.15.92:0/3025174373 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f97840add40 con 0x7f9794102ae0 2024-09-21T07:11:15.375 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T07:11:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 -- 172.21.15.92:0/3025174373 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97800b65e0 msgr2=0x7f97800b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97800b65e0 0x7f97800b8af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9794105f20 tx=0x7f977c00a250 comp rx=0 tx=0).stop 2024-09-21T07:11:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 -- 172.21.15.92:0/3025174373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9794102ae0 msgr2=0x7f979419b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9794102ae0 0x7f979419b1e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f978400c890 tx=0x7f978400cd50 comp rx=0 tx=0).stop 2024-09-21T07:11:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 -- 172.21.15.92:0/3025174373 shutdown_connections 2024-09-21T07:11:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97800b65e0 0x7f97800b8af0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9794108d20 0x7f979419bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97941083d0 0x7f979419b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 --2- 172.21.15.92:0/3025174373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9794102ae0 0x7f979419b1e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 -- 172.21.15.92:0/3025174373 >> 172.21.15.92:0/3025174373 conn(0x7f9794079760 msgr2=0x7f9794104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:15.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 -- 172.21.15.92:0/3025174373 shutdown_connections 2024-09-21T07:11:15.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:15.375+0000 7f979a044640 1 -- 172.21.15.92:0/3025174373 wait complete. 2024-09-21T07:11:16.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:15 smithi092 ceph-mon[30987]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T07:11:16.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:15 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3025174373' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:11:16.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:15 smithi175 ceph-mon[34064]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T07:11:16.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:15 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3025174373' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:11:16.029 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:11:16.029 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:11:16.029 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-09-21T07:11:16.029 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T07:11:16.030 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:11:16.030 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:11:16.030 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:11:16.030 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:11:16.030 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T07:11:16.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:16.030 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-09-21T07:11:16.047 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:11:16.047 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:11:16.047 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:11:16.047 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:16.047 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-21T07:11:16.047 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:16.047 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:16.047 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42258sec preferred_lft 42258sec 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-21T07:11:16.048 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:16.049 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:11:16.049 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:16.049 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-21T07:11:16.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:11:16.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2024-09-21T07:11:16.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2024-09-21T07:11:16.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:11:16.049 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-21T07:11:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:15 smithi169 ceph-mon[33705]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T07:11:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:15 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3025174373' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:11:16.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:16.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:16.257 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:11:16.281 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-09-21T07:11:16.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:16.283 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-09-21T07:11:16.346 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-09-21T07:11:16.346 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:11:16.346 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:11:16.346 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:11:16.346 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:11:16.347 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:16.347 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-21T07:11:16.347 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:11:16.347 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:11:16.347 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:11:16.347 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-21T07:11:16.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:16.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:16.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:16.659 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-21T07:11:16.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:16.675 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-09-21T07:11:16.730 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:16.730 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-21T07:11:16.730 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:11:16.730 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T07:11:16.730 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-21T07:11:16.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:16.825 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:16 smithi092 ceph-mon[30987]: pgmap v283: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:16.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:16.847 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T07:11:16.847 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:16.847 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-21T07:11:16.847 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T07:11:16.847 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:11:16.848 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T07:11:16.848 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T07:11:16.848 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T07:11:16.848 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-21T07:11:16.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:16.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:16.977 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:16.977 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-21T07:11:16.977 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-09-21T07:11:16.977 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:11:16.977 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-21T07:11:17.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:16 smithi175 ceph-mon[34064]: pgmap v283: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:17.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:17.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:17.053 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T07:11:17.053 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:17.053 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:11:17.068 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T07:11:17.068 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:17.069 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:11:17.124 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-09-21T07:11:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:16 smithi169 ceph-mon[33705]: pgmap v283: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:17.190 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:11:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2024-09-21T07:11:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2024-09-21T07:11:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2024-09-21T07:11:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2024-09-21T07:11:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2024-09-21T07:11:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2024-09-21T07:11:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2024-09-21T07:11:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2024-09-21T07:11:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2024-09-21T07:11:17.247 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:11:17.248 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/34edce966ac4de38bf9c8a1f54a2758fd0073664ae9a081c1170c4e56dcf58ac/merged 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/a07ceeb3fa0c0949a1d20c11f0000f1f3df31f8a6e94736f87ba23ac5b7bdc6b/merged 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/0 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/ef0a9feff7cd43331a5796bf8349f921b372e32961a17c7cc73fc6cf35fe1f93/merged 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/698e11a63cd62172272f02b7a52c7cb7c0defe9c500777231eda6565d03c5c69/merged 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/2b800a5980bdd021b915f1c4e4a44406908415dc03aa1759dffdf17c2bb549e2/merged 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c94d506025720fdba2d4cdbc9c1b2f7beb32022e69d747fc04fc4cd8a5c4ca01/merged 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/5cb03c57ca9c7d75ad577198240a8823055e29c5f8edfa965984b274e21e1628/merged 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4e69f5e86b63d786f8a5aedabcab65ae6e801d469396af325fafe2a60f14f970/merged 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c1795127ce5350675dd0216437be5c9452eb313f1c404b8388c9431ad958bf49/merged 2024-09-21T07:11:17.249 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4125d8548753bfcdddc533d562bd1a3d9f7fab11a7280000a3418e147f891849/merged 2024-09-21T07:11:17.250 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2024-09-21T07:11:17.250 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:11:17.250 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:11:17.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:17.250 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-09-21T07:11:17.303 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T07:11:17.303 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T07:11:17.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-09-21T07:11:17.369 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:11:17.425 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2024-09-21T07:11:17.425 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2024-09-21T07:11:17.426 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/34edce966ac4de38bf9c8a1f54a2758fd0073664ae9a081c1170c4e56dcf58ac/merged 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/a07ceeb3fa0c0949a1d20c11f0000f1f3df31f8a6e94736f87ba23ac5b7bdc6b/merged 2024-09-21T07:11:17.427 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/0 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/ef0a9feff7cd43331a5796bf8349f921b372e32961a17c7cc73fc6cf35fe1f93/merged 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/698e11a63cd62172272f02b7a52c7cb7c0defe9c500777231eda6565d03c5c69/merged 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/2b800a5980bdd021b915f1c4e4a44406908415dc03aa1759dffdf17c2bb549e2/merged 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c94d506025720fdba2d4cdbc9c1b2f7beb32022e69d747fc04fc4cd8a5c4ca01/merged 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/5cb03c57ca9c7d75ad577198240a8823055e29c5f8edfa965984b274e21e1628/merged 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4e69f5e86b63d786f8a5aedabcab65ae6e801d469396af325fafe2a60f14f970/merged 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c1795127ce5350675dd0216437be5c9452eb313f1c404b8388c9431ad958bf49/merged 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4125d8548753bfcdddc533d562bd1a3d9f7fab11a7280000a3418e147f891849/merged 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:11:17.428 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:11:17.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:17.429 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-09-21T07:11:17.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi092.stderr:2024-09-21T07:11:17.494+0000 7fe43f1cf480 -1 init, newargv = 0x7fe424056f60 newargc=15 2024-09-21T07:11:17.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi092.stderr:ceph-fuse[76095]: starting ceph client 2024-09-21T07:11:17.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi092.stderr:ceph-fuse[76095]: starting fuse 2024-09-21T07:11:18.584 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-09-21T07:11:18.615 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/34edce966ac4de38bf9c8a1f54a2758fd0073664ae9a081c1170c4e56dcf58ac/merged 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/a07ceeb3fa0c0949a1d20c11f0000f1f3df31f8a6e94736f87ba23ac5b7bdc6b/merged 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/0 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/ef0a9feff7cd43331a5796bf8349f921b372e32961a17c7cc73fc6cf35fe1f93/merged 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/698e11a63cd62172272f02b7a52c7cb7c0defe9c500777231eda6565d03c5c69/merged 2024-09-21T07:11:18.678 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/2b800a5980bdd021b915f1c4e4a44406908415dc03aa1759dffdf17c2bb549e2/merged 2024-09-21T07:11:18.679 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c94d506025720fdba2d4cdbc9c1b2f7beb32022e69d747fc04fc4cd8a5c4ca01/merged 2024-09-21T07:11:18.679 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/5cb03c57ca9c7d75ad577198240a8823055e29c5f8edfa965984b274e21e1628/merged 2024-09-21T07:11:18.679 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4e69f5e86b63d786f8a5aedabcab65ae6e801d469396af325fafe2a60f14f970/merged 2024-09-21T07:11:18.679 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c1795127ce5350675dd0216437be5c9452eb313f1c404b8388c9431ad958bf49/merged 2024-09-21T07:11:18.679 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4125d8548753bfcdddc533d562bd1a3d9f7fab11a7280000a3418e147f891849/merged 2024-09-21T07:11:18.679 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2024-09-21T07:11:18.679 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:11:18.679 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:11:18.679 INFO:teuthology.orchestra.run.smithi092.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-21T07:11:18.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:18.680 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-09-21T07:11:18.734 INFO:teuthology.orchestra.run.smithi092.stdout:120 2024-09-21T07:11:18.734 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T07:11:18.734 DEBUG:teuthology.orchestra.run.smithi092:> sudo stdin-killer -- python3 -c ' 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> import re 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> import os 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2024-09-21T07:11:18.735 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> return f 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.admin")) 2024-09-21T07:11:18.736 DEBUG:teuthology.orchestra.run.smithi092:> ' 2024-09-21T07:11:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.admin.76095.asok 2024-09-21T07:11:18.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:18 smithi092 ceph-mon[30987]: pgmap v284: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:18.870 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.76095.asok 2024-09-21T07:11:18.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:18.871 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.76095.asok status 2024-09-21T07:11:19.014 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:11:19.014 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2024-09-21T07:11:19.014 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T07:11:19.014 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:11:19.014 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "admin", 2024-09-21T07:11:19.014 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2024-09-21T07:11:19.014 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "76095", 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/" 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 14997, 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 14997 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-21T07:11:19.015 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2844235219 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2844235219 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.14997 192.168.0.1:0/2844235219", 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "192.168.0.1:0/2844235219", 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 1, 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 17, 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 84, 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2024-09-21T07:11:19.016 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2024-09-21T07:11:19.017 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2024-09-21T07:11:19.017 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:11:19.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:19.023 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2024-09-21T07:11:19.023 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:11:19.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:18 smithi175 ceph-mon[34064]: pgmap v284: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:19.039 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2024-09-21T07:11:19.039 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:11:19.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:19.039 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:11:19.106 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T07:11:19.151 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:18 smithi169 ceph-mon[33705]: pgmap v284: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:11:19.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:19.222 INFO:teuthology.orchestra.run.smithi092.stdout:# file: . 2024-09-21T07:11:19.222 INFO:teuthology.orchestra.run.smithi092.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T07:11:19.222 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:19.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:19.228 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:11:19.228 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:19.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T07:11:19.572 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.071+0000 7f6ec0748640 1 -- 172.21.15.92:0/1608538391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6eb81062e0 msgr2=0x7f6eb81066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.071+0000 7f6ec0748640 1 --2- 172.21.15.92:0/1608538391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6eb81062e0 0x7f6eb81066f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009900 tx=0x7f6eac02a410 comp rx=0 tx=0).stop 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.071+0000 7f6ec0748640 1 -- 172.21.15.92:0/1608538391 shutdown_connections 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.071+0000 7f6ec0748640 1 --2- 172.21.15.92:0/1608538391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6eb8106c30 0x7f6eb8110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.071+0000 7f6ec0748640 1 --2- 172.21.15.92:0/1608538391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6eb81062e0 0x7f6eb81066f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.071+0000 7f6ec0748640 1 --2- 172.21.15.92:0/1608538391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb8102000 0x7f6eb8102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.071+0000 7f6ec0748640 1 -- 172.21.15.92:0/1608538391 >> 172.21.15.92:0/1608538391 conn(0x7f6eb8079e40 msgr2=0x7f6eb807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.071+0000 7f6ec0748640 1 -- 172.21.15.92:0/1608538391 shutdown_connections 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.071+0000 7f6ec0748640 1 -- 172.21.15.92:0/1608538391 wait complete. 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ec0748640 1 Processor -- start 2024-09-21T07:11:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ec0748640 1 -- start start 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ec0748640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6eb8102000 0x7f6eb819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ec0748640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb81062e0 0x7f6eb819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ec0748640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6eb8106c30 0x7f6eb819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ec0748640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb8113980 con 0x7f6eb8106c30 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ec0748640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb8113800 con 0x7f6eb8102000 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ec0748640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb8113b00 con 0x7f6eb81062e0 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ebece5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6eb8106c30 0x7f6eb819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ebece5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6eb8106c30 0x7f6eb819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52140/0 (socket says 172.21.15.92:52140) 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ebece5640 1 -- 172.21.15.92:0/1848028871 learned_addr learned my addr 172.21.15.92:0/1848028871 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ebe4e4640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6eb8102000 0x7f6eb819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ebdce3640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb81062e0 0x7f6eb819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ebece5640 1 -- 172.21.15.92:0/1848028871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb81062e0 msgr2=0x7f6eb819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ebece5640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb81062e0 0x7f6eb819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.072+0000 7f6ebece5640 1 -- 172.21.15.92:0/1848028871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6eb8102000 msgr2=0x7f6eb819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.073+0000 7f6ebece5640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6eb8102000 0x7f6eb819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.073+0000 7f6ebece5640 1 -- 172.21.15.92:0/1848028871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb81a0340 con 0x7f6eb8106c30 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.073+0000 7f6ebece5640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6eb8106c30 0x7f6eb819fc10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000eaa0 tx=0x7f6eb000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.073+0000 7f6eab7fe640 1 -- 172.21.15.92:0/1848028871 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000cdb0 con 0x7f6eb8106c30 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.073+0000 7f6eab7fe640 1 -- 172.21.15.92:0/1848028871 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6eb0005020 con 0x7f6eb8106c30 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.073+0000 7f6ec0748640 1 -- 172.21.15.92:0/1848028871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb81a0630 con 0x7f6eb8106c30 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.073+0000 7f6eab7fe640 1 -- 172.21.15.92:0/1848028871 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00116d0 con 0x7f6eb8106c30 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.073+0000 7f6ec0748640 1 -- 172.21.15.92:0/1848028871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb81a6d90 con 0x7f6eb8106c30 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.074+0000 7f6ec0748640 1 -- 172.21.15.92:0/1848028871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb8102410 con 0x7f6eb8106c30 2024-09-21T07:11:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.076+0000 7f6eab7fe640 1 -- 172.21.15.92:0/1848028871 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f6eb00051d0 con 0x7f6eb8106c30 2024-09-21T07:11:20.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.077+0000 7f6eab7fe640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6ea40b6560 0x7f6ea40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.077+0000 7f6ebe4e4640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6ea40b6560 0x7f6ea40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.077+0000 7f6eab7fe640 1 -- 172.21.15.92:0/1848028871 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f6eb00e7cf0 con 0x7f6eb8106c30 2024-09-21T07:11:20.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.077+0000 7f6ebe4e4640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6ea40b6560 0x7f6ea40b8a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4005fd0 tx=0x7f6eb400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:20.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.081+0000 7f6eab7fe640 1 -- 172.21.15.92:0/1848028871 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6eb0016030 con 0x7f6eb8106c30 2024-09-21T07:11:20.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.270+0000 7f6ec0748640 1 -- 172.21.15.92:0/1848028871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6eb819b500 con 0x7f6eb8106c30 2024-09-21T07:11:20.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.271+0000 7f6eab7fe640 1 -- 172.21.15.92:0/1848028871 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v84) ==== 81+0+880 (secure 0 0 0) 0x7f6eb819b500 con 0x7f6eb8106c30 2024-09-21T07:11:20.274 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3394957298 2024-09-22T07:04:13.495486+0000 2024-09-21T07:11:20.274 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2875922154 2024-09-22T07:04:13.495486+0000 2024-09-21T07:11:20.274 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/55970926 2024-09-22T07:03:15.831617+0000 2024-09-21T07:11:20.274 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/587317102 2024-09-22T07:04:13.495486+0000 2024-09-21T07:11:20.274 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/4259087529 2024-09-22T07:02:51.153241+0000 2024-09-21T07:11:20.274 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/4259087529 2024-09-22T07:02:51.153241+0000 2024-09-21T07:11:20.274 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1080149377 2024-09-22T07:03:15.831617+0000 2024-09-21T07:11:20.274 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/360775984 2024-09-22T07:03:15.831617+0000 2024-09-21T07:11:20.274 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3362034077 2024-09-22T07:02:51.153241+0000 2024-09-21T07:11:20.274 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/55970926 2024-09-22T07:03:15.831617+0000 2024-09-21T07:11:20.275 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3955243221 2024-09-22T07:02:51.153241+0000 2024-09-21T07:11:20.275 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/750676858 2024-09-22T07:03:15.831617+0000 2024-09-21T07:11:20.275 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2534333723 2024-09-22T07:04:13.495486+0000 2024-09-21T07:11:20.275 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3806081909 2024-09-22T07:02:51.153241+0000 2024-09-21T07:11:20.275 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/587317102 2024-09-22T07:04:13.495486+0000 2024-09-21T07:11:20.275 INFO:teuthology.orchestra.run.smithi092.stderr:listed 15 entries 2024-09-21T07:11:20.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 -- 172.21.15.92:0/1848028871 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6ea40b6560 msgr2=0x7f6ea40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6ea40b6560 0x7f6ea40b8a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4005fd0 tx=0x7f6eb400b390 comp rx=0 tx=0).stop 2024-09-21T07:11:20.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 -- 172.21.15.92:0/1848028871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6eb8106c30 msgr2=0x7f6eb819fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6eb8106c30 0x7f6eb819fc10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000eaa0 tx=0x7f6eb000ef60 comp rx=0 tx=0).stop 2024-09-21T07:11:20.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 -- 172.21.15.92:0/1848028871 shutdown_connections 2024-09-21T07:11:20.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6ea40b6560 0x7f6ea40b8a70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6eb8106c30 0x7f6eb819fc10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb81062e0 0x7f6eb819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 --2- 172.21.15.92:0/1848028871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6eb8102000 0x7f6eb819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 -- 172.21.15.92:0/1848028871 >> 172.21.15.92:0/1848028871 conn(0x7f6eb8079e40 msgr2=0x7f6eb81075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 -- 172.21.15.92:0/1848028871 shutdown_connections 2024-09-21T07:11:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:20.273+0000 7f6ec0748640 1 -- 172.21.15.92:0/1848028871 wait complete. 2024-09-21T07:11:20.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:20 smithi092 ceph-mon[30987]: pgmap v285: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T07:11:20.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1848028871' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:11:21.010 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:11:21.010 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:21.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:20 smithi175 ceph-mon[34064]: pgmap v285: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T07:11:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1848028871' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:11:21.028 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T07:11:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:20 smithi169 ceph-mon[33705]: pgmap v285: 129 pgs: 1 activating, 128 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T07:11:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1848028871' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:11:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:21.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.847+0000 7fd5096c0640 1 -- 172.21.15.92:0/1436730277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5041083a0 msgr2=0x7fd5041087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.847+0000 7fd5096c0640 1 --2- 172.21.15.92:0/1436730277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5041083a0 0x7fd5041087b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009900 tx=0x7fd4ec02a410 comp rx=0 tx=0).stop 2024-09-21T07:11:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.847+0000 7fd5096c0640 1 -- 172.21.15.92:0/1436730277 shutdown_connections 2024-09-21T07:11:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.847+0000 7fd5096c0640 1 --2- 172.21.15.92:0/1436730277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd504108cf0 0x7fd50410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.847+0000 7fd5096c0640 1 --2- 172.21.15.92:0/1436730277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5041083a0 0x7fd5041087b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.847+0000 7fd5096c0640 1 --2- 172.21.15.92:0/1436730277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd504102a60 0x7fd504102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.847+0000 7fd5096c0640 1 -- 172.21.15.92:0/1436730277 >> 172.21.15.92:0/1436730277 conn(0x7fd504079730 msgr2=0x7fd504079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:21.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.847+0000 7fd5096c0640 1 -- 172.21.15.92:0/1436730277 shutdown_connections 2024-09-21T07:11:21.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.847+0000 7fd5096c0640 1 -- 172.21.15.92:0/1436730277 wait complete. 2024-09-21T07:11:21.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.848+0000 7fd5096c0640 1 Processor -- start 2024-09-21T07:11:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.848+0000 7fd5096c0640 1 -- start start 2024-09-21T07:11:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.848+0000 7fd5096c0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd504102a60 0x7fd504199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.848+0000 7fd5096c0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5041083a0 0x7fd504199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.848+0000 7fd5096c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd504108cf0 0x7fd50419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.848+0000 7fd5096c0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd504112810 con 0x7fd504108cf0 2024-09-21T07:11:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.848+0000 7fd5096c0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd504112690 con 0x7fd5041083a0 2024-09-21T07:11:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.848+0000 7fd5096c0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd504112990 con 0x7fd504102a60 2024-09-21T07:11:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5037fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd504108cf0 0x7fd50419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5037fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd504108cf0 0x7fd50419eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52152/0 (socket says 172.21.15.92:52152) 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5037fe640 1 -- 172.21.15.92:0/3421217133 learned_addr learned my addr 172.21.15.92:0/3421217133 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd502ffd640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd504102a60 0x7fd504199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5027fc640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5041083a0 0x7fd504199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5037fe640 1 -- 172.21.15.92:0/3421217133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd504102a60 msgr2=0x7fd504199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5037fe640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd504102a60 0x7fd504199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5037fe640 1 -- 172.21.15.92:0/3421217133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5041083a0 msgr2=0x7fd504199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5037fe640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5041083a0 0x7fd504199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5037fe640 1 -- 172.21.15.92:0/3421217133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50419f1f0 con 0x7fd504108cf0 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5027fc640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5041083a0 0x7fd504199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5037fe640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd504108cf0 0x7fd50419eac0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009860 tx=0x7fd4fc009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd4fbfff640 1 -- 172.21.15.92:0/3421217133 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc005020 con 0x7fd504108cf0 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5096c0640 1 -- 172.21.15.92:0/3421217133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50419f4e0 con 0x7fd504108cf0 2024-09-21T07:11:21.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd4fbfff640 1 -- 172.21.15.92:0/3421217133 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4fc0047a0 con 0x7fd504108cf0 2024-09-21T07:11:21.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd4fbfff640 1 -- 172.21.15.92:0/3421217133 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc007980 con 0x7fd504108cf0 2024-09-21T07:11:21.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.849+0000 7fd5096c0640 1 -- 172.21.15.92:0/3421217133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50406ae60 con 0x7fd504108cf0 2024-09-21T07:11:21.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.850+0000 7fd5096c0640 1 -- 172.21.15.92:0/3421217133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd504102e70 con 0x7fd504108cf0 2024-09-21T07:11:21.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.852+0000 7fd4fbfff640 1 -- 172.21.15.92:0/3421217133 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fd4fc004950 con 0x7fd504108cf0 2024-09-21T07:11:21.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.853+0000 7fd4fbfff640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd4f00b6560 0x7fd4f00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.853+0000 7fd502ffd640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd4f00b6560 0x7fd4f00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.853+0000 7fd4fbfff640 1 -- 172.21.15.92:0/3421217133 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7fd4fc0e93f0 con 0x7fd504108cf0 2024-09-21T07:11:21.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.853+0000 7fd502ffd640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd4f00b6560 0x7fd4f00b8a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4005fd0 tx=0x7fd4f4009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:21.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:21.856+0000 7fd4fbfff640 1 -- 172.21.15.92:0/3421217133 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4fc0af850 con 0x7fd504108cf0 2024-09-21T07:11:22.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.044+0000 7fd5096c0640 1 -- 172.21.15.92:0/3421217133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd50406b8e0 con 0x7fd504108cf0 2024-09-21T07:11:22.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.044+0000 7fd4fbfff640 1 -- 172.21.15.92:0/3421217133 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v84) ==== 81+0+880 (secure 0 0 0) 0x7fd4fc0b3c30 con 0x7fd504108cf0 2024-09-21T07:11:22.047 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3394957298 2024-09-22T07:04:13.495486+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2875922154 2024-09-22T07:04:13.495486+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/55970926 2024-09-22T07:03:15.831617+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/587317102 2024-09-22T07:04:13.495486+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/4259087529 2024-09-22T07:02:51.153241+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/4259087529 2024-09-22T07:02:51.153241+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1080149377 2024-09-22T07:03:15.831617+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/360775984 2024-09-22T07:03:15.831617+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3362034077 2024-09-22T07:02:51.153241+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/55970926 2024-09-22T07:03:15.831617+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3955243221 2024-09-22T07:02:51.153241+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/750676858 2024-09-22T07:03:15.831617+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2534333723 2024-09-22T07:04:13.495486+0000 2024-09-21T07:11:22.048 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3806081909 2024-09-22T07:02:51.153241+0000 2024-09-21T07:11:22.049 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/587317102 2024-09-22T07:04:13.495486+0000 2024-09-21T07:11:22.049 INFO:teuthology.orchestra.run.smithi092.stderr:listed 15 entries 2024-09-21T07:11:22.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 -- 172.21.15.92:0/3421217133 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd4f00b6560 msgr2=0x7fd4f00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:22.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd4f00b6560 0x7fd4f00b8a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4005fd0 tx=0x7fd4f4009500 comp rx=0 tx=0).stop 2024-09-21T07:11:22.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 -- 172.21.15.92:0/3421217133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd504108cf0 msgr2=0x7fd50419eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:22.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd504108cf0 0x7fd50419eac0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009860 tx=0x7fd4fc009d20 comp rx=0 tx=0).stop 2024-09-21T07:11:22.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 -- 172.21.15.92:0/3421217133 shutdown_connections 2024-09-21T07:11:22.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd4f00b6560 0x7fd4f00b8a70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd504108cf0 0x7fd50419eac0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5041083a0 0x7fd504199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 --2- 172.21.15.92:0/3421217133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd504102a60 0x7fd504199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 -- 172.21.15.92:0/3421217133 >> 172.21.15.92:0/3421217133 conn(0x7fd504079730 msgr2=0x7fd504104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:22.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 -- 172.21.15.92:0/3421217133 shutdown_connections 2024-09-21T07:11:22.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:22.047+0000 7fd5096c0640 1 -- 172.21.15.92:0/3421217133 wait complete. 2024-09-21T07:11:22.811 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi092.front.sepia.ceph.com... 2024-09-21T07:11:22.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:22.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:11:22.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi092.stderr:ceph-fuse[76095]: fuse finished with error 0 and tester_r 0 2024-09-21T07:11:22.840 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:11:22.865 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T07:11:22.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:22.865 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T07:11:22.931 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:11:22.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:22 smithi092 ceph-mon[30987]: pgmap v286: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T07:11:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:22 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3421217133' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:11:23.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:22 smithi175 ceph-mon[34064]: pgmap v286: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T07:11:23.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:22 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3421217133' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:11:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:22 smithi169 ceph-mon[33705]: pgmap v286: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T07:11:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:22 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3421217133' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:11:23.216 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:23.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.739+0000 7f6983c1c640 1 -- 172.21.15.92:0/3945069224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f697c103b60 msgr2=0x7f697c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:23.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.739+0000 7f6983c1c640 1 --2- 172.21.15.92:0/3945069224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f697c103b60 0x7f697c103f70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6978009900 tx=0x7f697802a410 comp rx=0 tx=0).stop 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.739+0000 7f6983c1c640 1 -- 172.21.15.92:0/3945069224 shutdown_connections 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.739+0000 7f6983c1c640 1 --2- 172.21.15.92:0/3945069224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c109df0 0x7f697c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.739+0000 7f6983c1c640 1 --2- 172.21.15.92:0/3945069224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f697c1094a0 0x7f697c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.739+0000 7f6983c1c640 1 --2- 172.21.15.92:0/3945069224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f697c103b60 0x7f697c103f70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.739+0000 7f6983c1c640 1 -- 172.21.15.92:0/3945069224 >> 172.21.15.92:0/3945069224 conn(0x7f697c07b850 msgr2=0x7f697c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.739+0000 7f6983c1c640 1 -- 172.21.15.92:0/3945069224 shutdown_connections 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.739+0000 7f6983c1c640 1 -- 172.21.15.92:0/3945069224 wait complete. 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.740+0000 7f6983c1c640 1 Processor -- start 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.740+0000 7f6983c1c640 1 -- start start 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.740+0000 7f6983c1c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c103b60 0x7f697c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.740+0000 7f6983c1c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f697c1094a0 0x7f697c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.740+0000 7f6983c1c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f697c109df0 0x7f697c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:23.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.740+0000 7f6983c1c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f697c113960 con 0x7f697c109df0 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.740+0000 7f6983c1c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f697c1137e0 con 0x7f697c1094a0 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.740+0000 7f6983c1c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f697c113ae0 con 0x7f697c103b60 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.740+0000 7f69821b9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f697c109df0 0x7f697c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69821b9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f697c109df0 0x7f697c19fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52176/0 (socket says 172.21.15.92:52176) 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69821b9640 1 -- 172.21.15.92:0/80288257 learned_addr learned my addr 172.21.15.92:0/80288257 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69819b8640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c103b60 0x7f697c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69811b7640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f697c1094a0 0x7f697c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69821b9640 1 -- 172.21.15.92:0/80288257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c103b60 msgr2=0x7f697c19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69821b9640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c103b60 0x7f697c19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69821b9640 1 -- 172.21.15.92:0/80288257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f697c1094a0 msgr2=0x7f697c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69821b9640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f697c1094a0 0x7f697c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69821b9640 1 -- 172.21.15.92:0/80288257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c1a0300 con 0x7f697c109df0 2024-09-21T07:11:23.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69819b8640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c103b60 0x7f697c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69811b7640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f697c1094a0 0x7f697c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f69821b9640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f697c109df0 0x7f697c19fc90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f697400cad0 tx=0x7f697400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f6972ffd640 1 -- 172.21.15.92:0/80288257 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697400ae20 con 0x7f697c109df0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f6972ffd640 1 -- 172.21.15.92:0/80288257 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6974005020 con 0x7f697c109df0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f6983c1c640 1 -- 172.21.15.92:0/80288257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697c1a05f0 con 0x7f697c109df0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f6972ffd640 1 -- 172.21.15.92:0/80288257 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697400f6b0 con 0x7f697c109df0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.741+0000 7f6983c1c640 1 -- 172.21.15.92:0/80288257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f697c1a6e10 con 0x7f697c109df0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.742+0000 7f6983c1c640 1 -- 172.21.15.92:0/80288257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697c103f70 con 0x7f697c109df0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.744+0000 7f6972ffd640 1 -- 172.21.15.92:0/80288257 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f69740051d0 con 0x7f697c109df0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.745+0000 7f6972ffd640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69680b6590 0x7f69680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.745+0000 7f69819b8640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69680b6590 0x7f69680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.745+0000 7f6972ffd640 1 -- 172.21.15.92:0/80288257 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f69740e7b50 con 0x7f697c109df0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.745+0000 7f69819b8640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69680b6590 0x7f69680b8aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6978000c00 tx=0x7f6978005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:23.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.748+0000 7f6972ffd640 1 -- 172.21.15.92:0/80288257 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6974014030 con 0x7f697c109df0 2024-09-21T07:11:23.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.925+0000 7f6983c1c640 1 -- 172.21.15.92:0/80288257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f697c19b580 con 0x7f697c109df0 2024-09-21T07:11:23.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.926+0000 7f6972ffd640 1 -- 172.21.15.92:0/80288257 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25030 (secure 0 0 0) 0x7f697c19b580 con 0x7f697c109df0 2024-09-21T07:11:23.929 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:23.929 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":84,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:11:14.645823+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 -- 172.21.15.92:0/80288257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69680b6590 msgr2=0x7f69680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69680b6590 0x7f69680b8aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6978000c00 tx=0x7f6978005a20 comp rx=0 tx=0).stop 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 -- 172.21.15.92:0/80288257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f697c109df0 msgr2=0x7f697c19fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f697c109df0 0x7f697c19fc90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f697400cad0 tx=0x7f697400cf90 comp rx=0 tx=0).stop 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 -- 172.21.15.92:0/80288257 shutdown_connections 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69680b6590 0x7f69680b8aa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f697c109df0 0x7f697c19fc90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f697c1094a0 0x7f697c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 --2- 172.21.15.92:0/80288257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f697c103b60 0x7f697c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 -- 172.21.15.92:0/80288257 >> 172.21.15.92:0/80288257 conn(0x7f697c07b850 msgr2=0x7f697c107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 -- 172.21.15.92:0/80288257 shutdown_connections 2024-09-21T07:11:23.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:23.929+0000 7f6983c1c640 1 -- 172.21.15.92:0/80288257 wait complete. 2024-09-21T07:11:24.688 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:11:24.975 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:24 smithi175 ceph-mon[34064]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 0 op/s 2024-09-21T07:11:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:24 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/80288257' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:25.096 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:24 smithi092 ceph-mon[30987]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 0 op/s 2024-09-21T07:11:25.096 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:24 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/80288257' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:24 smithi169 ceph-mon[33705]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 0 op/s 2024-09-21T07:11:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:24 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/80288257' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:25.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.497+0000 7f8866fd6640 1 -- 172.21.15.92:0/1774167975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8860109e20 msgr2=0x7f8860110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:25.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.497+0000 7f8866fd6640 1 --2- 172.21.15.92:0/1774167975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8860109e20 0x7f8860110650 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8858009ca0 tx=0x7f885802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.498+0000 7f8866fd6640 1 -- 172.21.15.92:0/1774167975 shutdown_connections 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.498+0000 7f8866fd6640 1 --2- 172.21.15.92:0/1774167975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8860109e20 0x7f8860110650 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.498+0000 7f8866fd6640 1 --2- 172.21.15.92:0/1774167975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88601094d0 0x7f88601098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.498+0000 7f8866fd6640 1 --2- 172.21.15.92:0/1774167975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8860103b90 0x7f8860103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.498+0000 7f8866fd6640 1 -- 172.21.15.92:0/1774167975 >> 172.21.15.92:0/1774167975 conn(0x7f88600ff600 msgr2=0x7f8860101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.498+0000 7f8866fd6640 1 -- 172.21.15.92:0/1774167975 shutdown_connections 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.498+0000 7f8866fd6640 1 -- 172.21.15.92:0/1774167975 wait complete. 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.498+0000 7f8866fd6640 1 Processor -- start 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.498+0000 7f8866fd6640 1 -- start start 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.498+0000 7f8866fd6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8860103b90 0x7f886019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f8866fd6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88601094d0 0x7f886019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f8866fd6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8860109e20 0x7f886019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:25.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f8866fd6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f88601139e0 con 0x7f88601094d0 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f8866fd6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8860113860 con 0x7f8860109e20 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f8866fd6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8860113b60 con 0x7f8860103b90 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88601094d0 0x7f886019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88601094d0 0x7f886019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52184/0 (socket says 172.21.15.92:52184) 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885ffff640 1 -- 172.21.15.92:0/1765084327 learned_addr learned my addr 172.21.15.92:0/1765084327 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f8864d72640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8860103b90 0x7f886019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f8865573640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8860109e20 0x7f886019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885ffff640 1 -- 172.21.15.92:0/1765084327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8860103b90 msgr2=0x7f886019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885ffff640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8860103b90 0x7f886019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885ffff640 1 -- 172.21.15.92:0/1765084327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8860109e20 msgr2=0x7f886019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:25.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885ffff640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8860109e20 0x7f886019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885ffff640 1 -- 172.21.15.92:0/1765084327 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88601a0400 con 0x7f88601094d0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885ffff640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88601094d0 0x7f886019aa30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f884c00d750 tx=0x7f884c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885dffb640 1 -- 172.21.15.92:0/1765084327 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c017070 con 0x7f88601094d0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885dffb640 1 -- 172.21.15.92:0/1765084327 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f884c0054b0 con 0x7f88601094d0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f8866fd6640 1 -- 172.21.15.92:0/1765084327 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88601a06f0 con 0x7f88601094d0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.499+0000 7f885dffb640 1 -- 172.21.15.92:0/1765084327 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c004bc0 con 0x7f88601094d0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.500+0000 7f8866fd6640 1 -- 172.21.15.92:0/1765084327 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88601a6e50 con 0x7f88601094d0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.500+0000 7f8866fd6640 1 -- 172.21.15.92:0/1765084327 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8860103fa0 con 0x7f88601094d0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.502+0000 7f885dffb640 1 -- 172.21.15.92:0/1765084327 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f884c009c30 con 0x7f88601094d0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.503+0000 7f885dffb640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88500b65e0 0x7f88500b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.503+0000 7f8864d72640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88500b65e0 0x7f88500b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.503+0000 7f885dffb640 1 -- 172.21.15.92:0/1765084327 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f884c0e7470 con 0x7f88601094d0 2024-09-21T07:11:25.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.503+0000 7f8864d72640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88500b65e0 0x7f88500b8af0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f885400bbe0 tx=0x7f885400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:25.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.506+0000 7f885dffb640 1 -- 172.21.15.92:0/1765084327 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f884c0b1cd0 con 0x7f88601094d0 2024-09-21T07:11:25.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.689+0000 7f8866fd6640 1 -- 172.21.15.92:0/1765084327 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f886019b5c0 con 0x7f88601094d0 2024-09-21T07:11:25.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.690+0000 7f885dffb640 1 -- 172.21.15.92:0/1765084327 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25030 (secure 0 0 0) 0x7f886019b5c0 con 0x7f88601094d0 2024-09-21T07:11:25.692 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:25.693 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":84,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:11:14.645823+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 -- 172.21.15.92:0/1765084327 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88500b65e0 msgr2=0x7f88500b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88500b65e0 0x7f88500b8af0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f885400bbe0 tx=0x7f885400b390 comp rx=0 tx=0).stop 2024-09-21T07:11:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 -- 172.21.15.92:0/1765084327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88601094d0 msgr2=0x7f886019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88601094d0 0x7f886019aa30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f884c00d750 tx=0x7f884c00dc10 comp rx=0 tx=0).stop 2024-09-21T07:11:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 -- 172.21.15.92:0/1765084327 shutdown_connections 2024-09-21T07:11:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88500b65e0 0x7f88500b8af0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8860109e20 0x7f886019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88601094d0 0x7f886019aa30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 --2- 172.21.15.92:0/1765084327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8860103b90 0x7f886019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 -- 172.21.15.92:0/1765084327 >> 172.21.15.92:0/1765084327 conn(0x7f88600ff600 msgr2=0x7f8860101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:25.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 -- 172.21.15.92:0/1765084327 shutdown_connections 2024-09-21T07:11:25.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:25.693+0000 7f8866fd6640 1 -- 172.21.15.92:0/1765084327 wait complete. 2024-09-21T07:11:26.436 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:11:26.681 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:26.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:26 smithi092 ceph-mon[30987]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 374 B/s wr, 0 op/s 2024-09-21T07:11:26.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:26 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1765084327' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:27.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:26 smithi175 ceph-mon[34064]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 374 B/s wr, 0 op/s 2024-09-21T07:11:27.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:26 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1765084327' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:27.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:26 smithi169 ceph-mon[33705]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 374 B/s wr, 0 op/s 2024-09-21T07:11:27.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:26 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1765084327' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:27.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.197+0000 7ff15d2ca640 1 -- 172.21.15.92:0/751031238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1581051c0 msgr2=0x7ff1581055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.197+0000 7ff15d2ca640 1 --2- 172.21.15.92:0/751031238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1581051c0 0x7ff1581055d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009ca0 tx=0x7ff14c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.197+0000 7ff15d2ca640 1 -- 172.21.15.92:0/751031238 shutdown_connections 2024-09-21T07:11:27.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.197+0000 7ff15d2ca640 1 --2- 172.21.15.92:0/751031238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff158105b10 0x7ff15810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.197+0000 7ff15d2ca640 1 --2- 172.21.15.92:0/751031238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1581051c0 0x7ff1581055d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.197+0000 7ff15d2ca640 1 --2- 172.21.15.92:0/751031238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1581031b0 0x7ff1581035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.197+0000 7ff15d2ca640 1 -- 172.21.15.92:0/751031238 >> 172.21.15.92:0/751031238 conn(0x7ff158079f90 msgr2=0x7ff15807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:27.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.197+0000 7ff15d2ca640 1 -- 172.21.15.92:0/751031238 shutdown_connections 2024-09-21T07:11:27.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.197+0000 7ff15d2ca640 1 -- 172.21.15.92:0/751031238 wait complete. 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff15d2ca640 1 Processor -- start 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff15d2ca640 1 -- start start 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff15d2ca640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1581031b0 0x7ff1581993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff15d2ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1581051c0 0x7ff158199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff15d2ca640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff158105b10 0x7ff15819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff15d2ca640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff158112910 con 0x7ff1581051c0 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff15d2ca640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff158112790 con 0x7ff1581031b0 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff15d2ca640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff158112a90 con 0x7ff158105b10 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff1567fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1581051c0 0x7ff158199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff1567fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1581051c0 0x7ff158199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52192/0 (socket says 172.21.15.92:52192) 2024-09-21T07:11:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff1567fc640 1 -- 172.21.15.92:0/1599135502 learned_addr learned my addr 172.21.15.92:0/1599135502 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff156ffd640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1581031b0 0x7ff1581993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.198+0000 7ff1577fe640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff158105b10 0x7ff15819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff1567fc640 1 -- 172.21.15.92:0/1599135502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff158105b10 msgr2=0x7ff15819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff1567fc640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff158105b10 0x7ff15819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff1567fc640 1 -- 172.21.15.92:0/1599135502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1581031b0 msgr2=0x7ff1581993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff1567fc640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1581031b0 0x7ff1581993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff1567fc640 1 -- 172.21.15.92:0/1599135502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15819f310 con 0x7ff1581051c0 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff1567fc640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1581051c0 0x7ff158199940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff14c02ade0 tx=0x7ff14c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff13ffff640 1 -- 172.21.15.92:0/1599135502 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c004040 con 0x7ff1581051c0 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff13ffff640 1 -- 172.21.15.92:0/1599135502 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff14c004670 con 0x7ff1581051c0 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff15d2ca640 1 -- 172.21.15.92:0/1599135502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15819f5a0 con 0x7ff1581051c0 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff13ffff640 1 -- 172.21.15.92:0/1599135502 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c03c5a0 con 0x7ff1581051c0 2024-09-21T07:11:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.199+0000 7ff15d2ca640 1 -- 172.21.15.92:0/1599135502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff158101e10 con 0x7ff1581051c0 2024-09-21T07:11:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.200+0000 7ff15d2ca640 1 -- 172.21.15.92:0/1599135502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff158103f30 con 0x7ff1581051c0 2024-09-21T07:11:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.202+0000 7ff13ffff640 1 -- 172.21.15.92:0/1599135502 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7ff14c0305c0 con 0x7ff1581051c0 2024-09-21T07:11:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.202+0000 7ff13ffff640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff1400b6560 0x7ff1400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.202+0000 7ff156ffd640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff1400b6560 0x7ff1400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.203+0000 7ff13ffff640 1 -- 172.21.15.92:0/1599135502 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7ff14c10a960 con 0x7ff1581051c0 2024-09-21T07:11:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.203+0000 7ff156ffd640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff1400b6560 0x7ff1400b8a70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff148005d00 tx=0x7ff14800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.205+0000 7ff13ffff640 1 -- 172.21.15.92:0/1599135502 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff14c0d0dc0 con 0x7ff1581051c0 2024-09-21T07:11:27.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.421+0000 7ff15d2ca640 1 -- 172.21.15.92:0/1599135502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff15819a4d0 con 0x7ff1581051c0 2024-09-21T07:11:27.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.683+0000 7ff13ffff640 1 -- 172.21.15.92:0/1599135502 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7ff14c0d51a0 con 0x7ff1581051c0 2024-09-21T07:11:27.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.685+0000 7ff15d2ca640 1 -- 172.21.15.92:0/1599135502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff1400b6560 msgr2=0x7ff1400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.685+0000 7ff15d2ca640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff1400b6560 0x7ff1400b8a70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff148005d00 tx=0x7ff14800b410 comp rx=0 tx=0).stop 2024-09-21T07:11:27.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.685+0000 7ff15d2ca640 1 -- 172.21.15.92:0/1599135502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1581051c0 msgr2=0x7ff158199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.685+0000 7ff15d2ca640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1581051c0 0x7ff158199940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff14c02ade0 tx=0x7ff14c032a10 comp rx=0 tx=0).stop 2024-09-21T07:11:27.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.685+0000 7ff15d2ca640 1 -- 172.21.15.92:0/1599135502 shutdown_connections 2024-09-21T07:11:27.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.685+0000 7ff15d2ca640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff1400b6560 0x7ff1400b8a70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.685+0000 7ff15d2ca640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff158105b10 0x7ff15819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.685+0000 7ff15d2ca640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1581051c0 0x7ff158199940 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.685+0000 7ff15d2ca640 1 --2- 172.21.15.92:0/1599135502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1581031b0 0x7ff1581993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.685+0000 7ff15d2ca640 1 -- 172.21.15.92:0/1599135502 >> 172.21.15.92:0/1599135502 conn(0x7ff158079f90 msgr2=0x7ff158106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:27.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.686+0000 7ff15d2ca640 1 -- 172.21.15.92:0/1599135502 shutdown_connections 2024-09-21T07:11:27.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:27.686+0000 7ff15d2ca640 1 -- 172.21.15.92:0/1599135502 wait complete. 2024-09-21T07:11:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:27 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1599135502' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:11:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:27 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1599135502' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:11:28.044 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:27 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1599135502' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:11:28.424 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T07:11:28.425 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 5 2024-09-21T07:11:28.674 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:28.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:28 smithi092 ceph-mon[30987]: pgmap v289: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:11:28.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:28 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1599135502' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:11:28.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:28 smithi092 ceph-mon[30987]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:11:29.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:28 smithi175 ceph-mon[34064]: pgmap v289: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:11:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:28 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1599135502' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:11:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:28 smithi175 ceph-mon[34064]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:11:29.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:28 smithi169 ceph-mon[33705]: pgmap v289: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:11:29.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:28 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1599135502' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:11:29.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:28 smithi169 ceph-mon[33705]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:11:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.217+0000 7f2536efd640 1 -- 172.21.15.92:0/604954380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2530102ae0 msgr2=0x7f2530102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.217+0000 7f2536efd640 1 --2- 172.21.15.92:0/604954380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2530102ae0 0x7f2530102ef0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2524009900 tx=0x7f252402a410 comp rx=0 tx=0).stop 2024-09-21T07:11:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.217+0000 7f2536efd640 1 -- 172.21.15.92:0/604954380 shutdown_connections 2024-09-21T07:11:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.217+0000 7f2536efd640 1 --2- 172.21.15.92:0/604954380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2530108d20 0x7f253010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.217+0000 7f2536efd640 1 --2- 172.21.15.92:0/604954380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25301083d0 0x7f25301087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.217+0000 7f2536efd640 1 --2- 172.21.15.92:0/604954380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2530102ae0 0x7f2530102ef0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.217+0000 7f2536efd640 1 -- 172.21.15.92:0/604954380 >> 172.21.15.92:0/604954380 conn(0x7f2530079760 msgr2=0x7f2530079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.217+0000 7f2536efd640 1 -- 172.21.15.92:0/604954380 shutdown_connections 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.217+0000 7f2536efd640 1 -- 172.21.15.92:0/604954380 wait complete. 2024-09-21T07:11:29.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.217+0000 7f2536efd640 1 Processor -- start 2024-09-21T07:11:29.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2536efd640 1 -- start start 2024-09-21T07:11:29.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2536efd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2530102ae0 0x7f253019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:29.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2536efd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25301083d0 0x7f253019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:29.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2536efd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2530108d20 0x7f253019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:29.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2536efd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2530113990 con 0x7f2530102ae0 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2536efd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2530113810 con 0x7f25301083d0 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2536efd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2530113b10 con 0x7f2530108d20 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2534c99640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2530102ae0 0x7f253019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2534c99640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2530102ae0 0x7f253019a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52214/0 (socket says 172.21.15.92:52214) 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2534c99640 1 -- 172.21.15.92:0/1459353936 learned_addr learned my addr 172.21.15.92:0/1459353936 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f252ffff640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25301083d0 0x7f253019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f253549a640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2530108d20 0x7f253019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2534c99640 1 -- 172.21.15.92:0/1459353936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2530108d20 msgr2=0x7f253019fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2534c99640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2530108d20 0x7f253019fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2534c99640 1 -- 172.21.15.92:0/1459353936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25301083d0 msgr2=0x7f253019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2534c99640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25301083d0 0x7f253019a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f2534c99640 1 -- 172.21.15.92:0/1459353936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25301a02d0 con 0x7f2530102ae0 2024-09-21T07:11:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.218+0000 7f252ffff640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25301083d0 0x7f253019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:11:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.219+0000 7f2534c99640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2530102ae0 0x7f253019a360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f252402a930 tx=0x7f2524003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.219+0000 7f252dffb640 1 -- 172.21.15.92:0/1459353936 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252403f070 con 0x7f2530102ae0 2024-09-21T07:11:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.219+0000 7f252dffb640 1 -- 172.21.15.92:0/1459353936 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f252403baf0 con 0x7f2530102ae0 2024-09-21T07:11:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.219+0000 7f252dffb640 1 -- 172.21.15.92:0/1459353936 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524035030 con 0x7f2530102ae0 2024-09-21T07:11:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.219+0000 7f2536efd640 1 -- 172.21.15.92:0/1459353936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25301a0560 con 0x7f2530102ae0 2024-09-21T07:11:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.219+0000 7f2536efd640 1 -- 172.21.15.92:0/1459353936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25301a6d20 con 0x7f2530102ae0 2024-09-21T07:11:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.220+0000 7f2536efd640 1 -- 172.21.15.92:0/1459353936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2530103d10 con 0x7f2530102ae0 2024-09-21T07:11:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.221+0000 7f252dffb640 1 -- 172.21.15.92:0/1459353936 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f2524042070 con 0x7f2530102ae0 2024-09-21T07:11:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.222+0000 7f252dffb640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25200b65e0 0x7f25200b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.222+0000 7f252ffff640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25200b65e0 0x7f25200b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.222+0000 7f252dffb640 1 -- 172.21.15.92:0/1459353936 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f2524108260 con 0x7f2530102ae0 2024-09-21T07:11:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.223+0000 7f252ffff640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25200b65e0 0x7f25200b8af0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2530079df0 tx=0x7f251c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.225+0000 7f252dffb640 1 -- 172.21.15.92:0/1459353936 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25240ce6c0 con 0x7f2530102ae0 2024-09-21T07:11:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.443+0000 7f2536efd640 1 -- 172.21.15.92:0/1459353936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f253010ab50 con 0x7f2530102ae0 2024-09-21T07:11:29.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.690+0000 7f252dffb640 1 -- 172.21.15.92:0/1459353936 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f25240d5e20 con 0x7f2530102ae0 2024-09-21T07:11:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 -- 172.21.15.92:0/1459353936 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25200b65e0 msgr2=0x7f25200b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25200b65e0 0x7f25200b8af0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2530079df0 tx=0x7f251c005f90 comp rx=0 tx=0).stop 2024-09-21T07:11:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 -- 172.21.15.92:0/1459353936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2530102ae0 msgr2=0x7f253019a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2530102ae0 0x7f253019a360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f252402a930 tx=0x7f2524003b90 comp rx=0 tx=0).stop 2024-09-21T07:11:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 -- 172.21.15.92:0/1459353936 shutdown_connections 2024-09-21T07:11:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25200b65e0 0x7f25200b8af0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2530108d20 0x7f253019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25301083d0 0x7f253019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 --2- 172.21.15.92:0/1459353936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2530102ae0 0x7f253019a360 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 -- 172.21.15.92:0/1459353936 >> 172.21.15.92:0/1459353936 conn(0x7f2530079760 msgr2=0x7f2530101540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 -- 172.21.15.92:0/1459353936 shutdown_connections 2024-09-21T07:11:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:29.693+0000 7f2536efd640 1 -- 172.21.15.92:0/1459353936 wait complete. 2024-09-21T07:11:30.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:29 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1459353936' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T07:11:30.024 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:29 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1459353936' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T07:11:30.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:29 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1459353936' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T07:11:30.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T07:11:30.693 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:30.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:30 smithi092 ceph-mon[30987]: pgmap v290: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:11:30.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:30 smithi092 ceph-mon[30987]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:11:30.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:30 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1459353936' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T07:11:30.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:30 smithi092 ceph-mon[30987]: daemon mds.f assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:11:30.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:30 smithi092 ceph-mon[30987]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:11:30.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:30 smithi092 ceph-mon[30987]: fsmap cephfs:2 {0=i=up:active,1=f=up:creating} 10 up:standby 2024-09-21T07:11:30.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:30 smithi092 ceph-mon[30987]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-09-21T07:11:31.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:30 smithi175 ceph-mon[34064]: pgmap v290: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:11:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:30 smithi175 ceph-mon[34064]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:11:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:30 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1459353936' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T07:11:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:30 smithi175 ceph-mon[34064]: daemon mds.f assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:11:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:30 smithi175 ceph-mon[34064]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:11:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:30 smithi175 ceph-mon[34064]: fsmap cephfs:2 {0=i=up:active,1=f=up:creating} 10 up:standby 2024-09-21T07:11:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:30 smithi175 ceph-mon[34064]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-09-21T07:11:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:30 smithi169 ceph-mon[33705]: pgmap v290: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:11:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:30 smithi169 ceph-mon[33705]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:11:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:30 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1459353936' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T07:11:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:30 smithi169 ceph-mon[33705]: daemon mds.f assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:11:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:30 smithi169 ceph-mon[33705]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T07:11:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:30 smithi169 ceph-mon[33705]: fsmap cephfs:2 {0=i=up:active,1=f=up:creating} 10 up:standby 2024-09-21T07:11:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:30 smithi169 ceph-mon[33705]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-09-21T07:11:31.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.219+0000 7f7312a37640 1 -- 172.21.15.92:0/3485253969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c1083a0 msgr2=0x7f730c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.219+0000 7f7312a37640 1 --2- 172.21.15.92:0/3485253969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c1083a0 0x7f730c1087b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7300009900 tx=0x7f730002a410 comp rx=0 tx=0).stop 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.219+0000 7f7312a37640 1 -- 172.21.15.92:0/3485253969 shutdown_connections 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.219+0000 7f7312a37640 1 --2- 172.21.15.92:0/3485253969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f730c108cf0 0x7f730c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.219+0000 7f7312a37640 1 --2- 172.21.15.92:0/3485253969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c1083a0 0x7f730c1087b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.219+0000 7f7312a37640 1 --2- 172.21.15.92:0/3485253969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f730c102a60 0x7f730c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.219+0000 7f7312a37640 1 -- 172.21.15.92:0/3485253969 >> 172.21.15.92:0/3485253969 conn(0x7f730c079730 msgr2=0x7f730c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.219+0000 7f7312a37640 1 -- 172.21.15.92:0/3485253969 shutdown_connections 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.219+0000 7f7312a37640 1 -- 172.21.15.92:0/3485253969 wait complete. 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.220+0000 7f7312a37640 1 Processor -- start 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.220+0000 7f7312a37640 1 -- start start 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.220+0000 7f7312a37640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c102a60 0x7f730c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:31.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f7312a37640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f730c1083a0 0x7f730c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f7312a37640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f730c108cf0 0x7f730c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f7312a37640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f730c112810 con 0x7f730c102a60 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f7312a37640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f730c112690 con 0x7f730c1083a0 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f7312a37640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f730c112990 con 0x7f730c108cf0 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c102a60 0x7f730c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c102a60 0x7f730c19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34226/0 (socket says 172.21.15.92:34226) 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730bfff640 1 -- 172.21.15.92:0/285445188 learned_addr learned my addr 172.21.15.92:0/285445188 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f7310fd4640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f730c108cf0 0x7f730c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730b7fe640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f730c1083a0 0x7f730c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730bfff640 1 -- 172.21.15.92:0/285445188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f730c108cf0 msgr2=0x7f730c19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730bfff640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f730c108cf0 0x7f730c19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730bfff640 1 -- 172.21.15.92:0/285445188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f730c1083a0 msgr2=0x7f730c19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:31.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730bfff640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f730c1083a0 0x7f730c19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730bfff640 1 -- 172.21.15.92:0/285445188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c1a0350 con 0x7f730c102a60 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730b7fe640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f730c1083a0 0x7f730c19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f7310fd4640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f730c108cf0 0x7f730c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.221+0000 7f730bfff640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c102a60 0x7f730c19a3e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00c970 tx=0x7f72fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.222+0000 7f73097fa640 1 -- 172.21.15.92:0/285445188 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc007bb0 con 0x7f730c102a60 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.222+0000 7f7312a37640 1 -- 172.21.15.92:0/285445188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c1a0640 con 0x7f730c102a60 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.222+0000 7f73097fa640 1 -- 172.21.15.92:0/285445188 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72fc007d50 con 0x7f730c102a60 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.222+0000 7f73097fa640 1 -- 172.21.15.92:0/285445188 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc004e40 con 0x7f730c102a60 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.222+0000 7f7312a37640 1 -- 172.21.15.92:0/285445188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c1a6da0 con 0x7f730c102a60 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.223+0000 7f7312a37640 1 -- 172.21.15.92:0/285445188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c102e70 con 0x7f730c102a60 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.224+0000 7f73097fa640 1 -- 172.21.15.92:0/285445188 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f72fc005020 con 0x7f730c102a60 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.225+0000 7f73097fa640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72f40b6560 0x7f72f40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.225+0000 7f730b7fe640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72f40b6560 0x7f72f40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:31.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.225+0000 7f73097fa640 1 -- 172.21.15.92:0/285445188 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f72fc0e74d0 con 0x7f730c102a60 2024-09-21T07:11:31.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.226+0000 7f730b7fe640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72f40b6560 0x7f72f40b8a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7300006010 tx=0x7f7300000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:31.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.230+0000 7f73097fa640 1 -- 172.21.15.92:0/285445188 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72fc014030 con 0x7f730c102a60 2024-09-21T07:11:31.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.457+0000 7f7312a37640 1 -- 172.21.15.92:0/285445188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f730c1a6fa0 con 0x7f730c102a60 2024-09-21T07:11:31.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.708+0000 7f73097fa640 1 -- 172.21.15.92:0/285445188 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f72fc0ad930 con 0x7f730c102a60 2024-09-21T07:11:31.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 -- 172.21.15.92:0/285445188 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72f40b6560 msgr2=0x7f72f40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:31.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72f40b6560 0x7f72f40b8a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7300006010 tx=0x7f7300000bc0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 -- 172.21.15.92:0/285445188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c102a60 msgr2=0x7f730c19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:31.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c102a60 0x7f730c19a3e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00c970 tx=0x7f72fc00ce30 comp rx=0 tx=0).stop 2024-09-21T07:11:31.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 -- 172.21.15.92:0/285445188 shutdown_connections 2024-09-21T07:11:31.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72f40b6560 0x7f72f40b8a70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f730c108cf0 0x7f730c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f730c1083a0 0x7f730c19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 --2- 172.21.15.92:0/285445188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c102a60 0x7f730c19a3e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 -- 172.21.15.92:0/285445188 >> 172.21.15.92:0/285445188 conn(0x7f730c079730 msgr2=0x7f730c104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:31.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 -- 172.21.15.92:0/285445188 shutdown_connections 2024-09-21T07:11:31.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:31.712+0000 7f7312a37640 1 -- 172.21.15.92:0/285445188 wait complete. 2024-09-21T07:11:31.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:31 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] up:active 2024-09-21T07:11:31.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:31 smithi092 ceph-mon[30987]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:11:31.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:31 smithi092 ceph-mon[30987]: fsmap cephfs:2 {0=i=up:active,1=f=up:active} 10 up:standby 2024-09-21T07:11:31.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:31 smithi092 ceph-mon[30987]: fsmap cephfs:3 {0=i=up:active,1=f=up:active,2=b=up:creating} 9 up:standby 2024-09-21T07:11:31.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:31 smithi092 ceph-mon[30987]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-09-21T07:11:31.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:31 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/285445188' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:11:32.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:31 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] up:active 2024-09-21T07:11:32.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:31 smithi175 ceph-mon[34064]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:11:32.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:31 smithi175 ceph-mon[34064]: fsmap cephfs:2 {0=i=up:active,1=f=up:active} 10 up:standby 2024-09-21T07:11:32.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:31 smithi175 ceph-mon[34064]: fsmap cephfs:3 {0=i=up:active,1=f=up:active,2=b=up:creating} 9 up:standby 2024-09-21T07:11:32.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:31 smithi175 ceph-mon[34064]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-09-21T07:11:32.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:31 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/285445188' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:11:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:31 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] up:active 2024-09-21T07:11:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:31 smithi169 ceph-mon[33705]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:11:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:31 smithi169 ceph-mon[33705]: fsmap cephfs:2 {0=i=up:active,1=f=up:active} 10 up:standby 2024-09-21T07:11:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:31 smithi169 ceph-mon[33705]: fsmap cephfs:3 {0=i=up:active,1=f=up:active,2=b=up:creating} 9 up:standby 2024-09-21T07:11:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:31 smithi169 ceph-mon[33705]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-09-21T07:11:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:31 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/285445188' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:11:32.506 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T07:11:32.759 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:32.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:32 smithi092 ceph-mon[30987]: pgmap v291: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:11:32.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:32 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/285445188' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:11:32.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:32 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] up:active 2024-09-21T07:11:32.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:32 smithi092 ceph-mon[30987]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T07:11:32.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:32 smithi092 ceph-mon[30987]: fsmap cephfs:3 {0=i=up:active,1=f=up:active,2=b=up:active} 9 up:standby 2024-09-21T07:11:32.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:32 smithi092 ceph-mon[30987]: fsmap cephfs:4 {0=i=up:active,1=f=up:active,2=b=up:active,3=l=up:creating} 8 up:standby 2024-09-21T07:11:32.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:32 smithi092 ceph-mon[30987]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-09-21T07:11:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:32 smithi175 ceph-mon[34064]: pgmap v291: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:11:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:32 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/285445188' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:11:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:32 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] up:active 2024-09-21T07:11:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:32 smithi175 ceph-mon[34064]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T07:11:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:32 smithi175 ceph-mon[34064]: fsmap cephfs:3 {0=i=up:active,1=f=up:active,2=b=up:active} 9 up:standby 2024-09-21T07:11:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:32 smithi175 ceph-mon[34064]: fsmap cephfs:4 {0=i=up:active,1=f=up:active,2=b=up:active,3=l=up:creating} 8 up:standby 2024-09-21T07:11:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:32 smithi175 ceph-mon[34064]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-09-21T07:11:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:32 smithi169 ceph-mon[33705]: pgmap v291: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:11:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:32 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/285445188' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:11:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:32 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] up:active 2024-09-21T07:11:33.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:32 smithi169 ceph-mon[33705]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T07:11:33.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:32 smithi169 ceph-mon[33705]: fsmap cephfs:3 {0=i=up:active,1=f=up:active,2=b=up:active} 9 up:standby 2024-09-21T07:11:33.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:32 smithi169 ceph-mon[33705]: fsmap cephfs:4 {0=i=up:active,1=f=up:active,2=b=up:active,3=l=up:creating} 8 up:standby 2024-09-21T07:11:33.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:32 smithi169 ceph-mon[33705]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-09-21T07:11:33.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.312+0000 7f17413ec640 1 -- 172.21.15.92:0/3270275307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173c1083a0 msgr2=0x7f173c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.312+0000 7f17413ec640 1 --2- 172.21.15.92:0/3270275307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173c1083a0 0x7f173c1087b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1724009900 tx=0x7f172402a410 comp rx=0 tx=0).stop 2024-09-21T07:11:33.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.312+0000 7f17413ec640 1 -- 172.21.15.92:0/3270275307 shutdown_connections 2024-09-21T07:11:33.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.312+0000 7f17413ec640 1 --2- 172.21.15.92:0/3270275307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f173c108cf0 0x7f173c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.312+0000 7f17413ec640 1 --2- 172.21.15.92:0/3270275307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173c1083a0 0x7f173c1087b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.312+0000 7f17413ec640 1 --2- 172.21.15.92:0/3270275307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f173c102a60 0x7f173c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.312+0000 7f17413ec640 1 -- 172.21.15.92:0/3270275307 >> 172.21.15.92:0/3270275307 conn(0x7f173c079730 msgr2=0x7f173c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:33.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.312+0000 7f17413ec640 1 -- 172.21.15.92:0/3270275307 shutdown_connections 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.312+0000 7f17413ec640 1 -- 172.21.15.92:0/3270275307 wait complete. 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.312+0000 7f17413ec640 1 Processor -- start 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f17413ec640 1 -- start start 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f17413ec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173c102a60 0x7f173c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f17413ec640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f173c1083a0 0x7f173c1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f17413ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f173c108cf0 0x7f173c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f17413ec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f173c112850 con 0x7f173c102a60 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f17413ec640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f173c1126d0 con 0x7f173c1083a0 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f17413ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f173c1129d0 con 0x7f173c108cf0 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173c102a60 0x7f173c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173c102a60 0x7f173c199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34250/0 (socket says 172.21.15.92:34250) 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173affd640 1 -- 172.21.15.92:0/3175192600 learned_addr learned my addr 172.21.15.92:0/3175192600 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:33.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173b7fe640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f173c108cf0 0x7f173c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173a7fc640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f173c1083a0 0x7f173c1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173affd640 1 -- 172.21.15.92:0/3175192600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f173c108cf0 msgr2=0x7f173c19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173affd640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f173c108cf0 0x7f173c19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173affd640 1 -- 172.21.15.92:0/3175192600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f173c1083a0 msgr2=0x7f173c1998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173affd640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f173c1083a0 0x7f173c1998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173affd640 1 -- 172.21.15.92:0/3175192600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173c19f270 con 0x7f173c102a60 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.313+0000 7f173a7fc640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f173c1083a0 0x7f173c1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.314+0000 7f173affd640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173c102a60 0x7f173c199300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f172c00ba50 tx=0x7f172c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.314+0000 7f1733fff640 1 -- 172.21.15.92:0/3175192600 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c019070 con 0x7f173c102a60 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.314+0000 7f1733fff640 1 -- 172.21.15.92:0/3175192600 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f172c00cbe0 con 0x7f173c102a60 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.314+0000 7f17413ec640 1 -- 172.21.15.92:0/3175192600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173c19f560 con 0x7f173c102a60 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.314+0000 7f1733fff640 1 -- 172.21.15.92:0/3175192600 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c0075d0 con 0x7f173c102a60 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.314+0000 7f17413ec640 1 -- 172.21.15.92:0/3175192600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173c06ae60 con 0x7f173c102a60 2024-09-21T07:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.315+0000 7f17413ec640 1 -- 172.21.15.92:0/3175192600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173c102e70 con 0x7f173c102a60 2024-09-21T07:11:33.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.317+0000 7f1733fff640 1 -- 172.21.15.92:0/3175192600 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f172c01c070 con 0x7f173c102a60 2024-09-21T07:11:33.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.318+0000 7f1733fff640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f17280b65e0 0x7f17280b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.318+0000 7f173a7fc640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f17280b65e0 0x7f17280b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.318+0000 7f1733fff640 1 -- 172.21.15.92:0/3175192600 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f172c0e7540 con 0x7f173c102a60 2024-09-21T07:11:33.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.318+0000 7f173a7fc640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f17280b65e0 0x7f17280b8af0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1724006010 tx=0x7f1724000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:33.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.321+0000 7f1733fff640 1 -- 172.21.15.92:0/3175192600 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f172c023070 con 0x7f173c102a60 2024-09-21T07:11:33.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.543+0000 7f17413ec640 1 -- 172.21.15.92:0/3175192600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f173c06ba10 con 0x7f173c102a60 2024-09-21T07:11:33.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.729+0000 7f1733fff640 1 -- 172.21.15.92:0/3175192600 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v27) ==== 115+0+0 (secure 0 0 0) 0x7f172c0ad9a0 con 0x7f173c102a60 2024-09-21T07:11:33.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.731+0000 7f17413ec640 1 -- 172.21.15.92:0/3175192600 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f17280b65e0 msgr2=0x7f17280b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.731+0000 7f17413ec640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f17280b65e0 0x7f17280b8af0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1724006010 tx=0x7f1724000bc0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.731+0000 7f17413ec640 1 -- 172.21.15.92:0/3175192600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173c102a60 msgr2=0x7f173c199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.731+0000 7f17413ec640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173c102a60 0x7f173c199300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f172c00ba50 tx=0x7f172c00bf10 comp rx=0 tx=0).stop 2024-09-21T07:11:33.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.731+0000 7f17413ec640 1 -- 172.21.15.92:0/3175192600 shutdown_connections 2024-09-21T07:11:33.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.731+0000 7f17413ec640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f17280b65e0 0x7f17280b8af0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.731+0000 7f17413ec640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f173c108cf0 0x7f173c19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.731+0000 7f17413ec640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f173c1083a0 0x7f173c1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.731+0000 7f17413ec640 1 --2- 172.21.15.92:0/3175192600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173c102a60 0x7f173c199300 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.731+0000 7f17413ec640 1 -- 172.21.15.92:0/3175192600 >> 172.21.15.92:0/3175192600 conn(0x7f173c079730 msgr2=0x7f173c1052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:33.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.732+0000 7f17413ec640 1 -- 172.21.15.92:0/3175192600 shutdown_connections 2024-09-21T07:11:33.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:33.732+0000 7f17413ec640 1 -- 172.21.15.92:0/3175192600 wait complete. 2024-09-21T07:11:33.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:33 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] up:active 2024-09-21T07:11:33.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:33 smithi092 ceph-mon[30987]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T07:11:33.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:33 smithi092 ceph-mon[30987]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:11:33.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:33 smithi092 ceph-mon[30987]: Cluster is now healthy 2024-09-21T07:11:33.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:33 smithi092 ceph-mon[30987]: fsmap cephfs:4 {0=i=up:active,1=f=up:active,2=b=up:active,3=l=up:active} 8 up:standby 2024-09-21T07:11:33.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:33 smithi092 ceph-mon[30987]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T07:11:33.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:33 smithi092 ceph-mon[30987]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-21T07:11:33.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:33 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3175192600' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:11:34.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:33 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] up:active 2024-09-21T07:11:34.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:33 smithi175 ceph-mon[34064]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T07:11:34.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:33 smithi175 ceph-mon[34064]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:11:34.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:33 smithi175 ceph-mon[34064]: Cluster is now healthy 2024-09-21T07:11:34.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:33 smithi175 ceph-mon[34064]: fsmap cephfs:4 {0=i=up:active,1=f=up:active,2=b=up:active,3=l=up:active} 8 up:standby 2024-09-21T07:11:34.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:33 smithi175 ceph-mon[34064]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T07:11:34.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:33 smithi175 ceph-mon[34064]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-21T07:11:34.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:33 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3175192600' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:11:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:33 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] up:active 2024-09-21T07:11:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:33 smithi169 ceph-mon[33705]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T07:11:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:33 smithi169 ceph-mon[33705]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:11:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:33 smithi169 ceph-mon[33705]: Cluster is now healthy 2024-09-21T07:11:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:33 smithi169 ceph-mon[33705]: fsmap cephfs:4 {0=i=up:active,1=f=up:active,2=b=up:active,3=l=up:active} 8 up:standby 2024-09-21T07:11:34.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:33 smithi169 ceph-mon[33705]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T07:11:34.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:33 smithi169 ceph-mon[33705]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-21T07:11:34.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:33 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3175192600' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:11:34.558 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T07:11:34.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T07:11:34.809 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:34.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:34 smithi092 ceph-mon[30987]: pgmap v292: 129 pgs: 129 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 7 op/s 2024-09-21T07:11:34.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:34 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3175192600' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:11:34.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:34 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] up:active 2024-09-21T07:11:34.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:34 smithi092 ceph-mon[30987]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T07:11:34.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:34 smithi092 ceph-mon[30987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:11:35.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:34 smithi175 ceph-mon[34064]: pgmap v292: 129 pgs: 129 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 7 op/s 2024-09-21T07:11:35.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:34 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3175192600' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:11:35.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:34 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] up:active 2024-09-21T07:11:35.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:34 smithi175 ceph-mon[34064]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T07:11:35.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:34 smithi175 ceph-mon[34064]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:11:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:34 smithi169 ceph-mon[33705]: pgmap v292: 129 pgs: 129 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 7 op/s 2024-09-21T07:11:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:34 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3175192600' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:11:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:34 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] up:active 2024-09-21T07:11:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:34 smithi169 ceph-mon[33705]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T07:11:35.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:34 smithi169 ceph-mon[33705]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:11:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.422+0000 7fe69cda6640 1 -- 172.21.15.92:0/1790774228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe698102ae0 msgr2=0x7fe698102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.422+0000 7fe69cda6640 1 --2- 172.21.15.92:0/1790774228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe698102ae0 0x7fe698102ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe688009900 tx=0x7fe68802a410 comp rx=0 tx=0).stop 2024-09-21T07:11:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.423+0000 7fe69cda6640 1 -- 172.21.15.92:0/1790774228 shutdown_connections 2024-09-21T07:11:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.423+0000 7fe69cda6640 1 --2- 172.21.15.92:0/1790774228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe698108d70 0x7fe69810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.423+0000 7fe69cda6640 1 --2- 172.21.15.92:0/1790774228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe698108420 0x7fe698108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.423+0000 7fe69cda6640 1 --2- 172.21.15.92:0/1790774228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe698102ae0 0x7fe698102ef0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.423+0000 7fe69cda6640 1 -- 172.21.15.92:0/1790774228 >> 172.21.15.92:0/1790774228 conn(0x7fe698079770 msgr2=0x7fe698079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.423+0000 7fe69cda6640 1 -- 172.21.15.92:0/1790774228 shutdown_connections 2024-09-21T07:11:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.423+0000 7fe69cda6640 1 -- 172.21.15.92:0/1790774228 wait complete. 2024-09-21T07:11:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.423+0000 7fe69cda6640 1 Processor -- start 2024-09-21T07:11:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe69cda6640 1 -- start start 2024-09-21T07:11:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe69cda6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe698102ae0 0x7fe69819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe69cda6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe698108420 0x7fe69819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe69cda6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe698108d70 0x7fe69819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe69cda6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe698112930 con 0x7fe698108d70 2024-09-21T07:11:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe69cda6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6981127b0 con 0x7fe698108420 2024-09-21T07:11:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe69cda6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe698112ab0 con 0x7fe698102ae0 2024-09-21T07:11:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe696d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe698108d70 0x7fe69819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe696d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe698108d70 0x7fe69819fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34276/0 (socket says 172.21.15.92:34276) 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe696d9d640 1 -- 172.21.15.92:0/1644031659 learned_addr learned my addr 172.21.15.92:0/1644031659 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe695d9b640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe698108420 0x7fe69819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe69659c640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe698102ae0 0x7fe69819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe696d9d640 1 -- 172.21.15.92:0/1644031659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe698102ae0 msgr2=0x7fe69819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe696d9d640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe698102ae0 0x7fe69819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe696d9d640 1 -- 172.21.15.92:0/1644031659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe698108420 msgr2=0x7fe69819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe696d9d640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe698108420 0x7fe69819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe696d9d640 1 -- 172.21.15.92:0/1644031659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6981a0400 con 0x7fe698108d70 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.424+0000 7fe696d9d640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe698108d70 0x7fe69819fcd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe69000eb10 tx=0x7fe69000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.425+0000 7fe6877fe640 1 -- 172.21.15.92:0/1644031659 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690004b20 con 0x7fe698108d70 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.425+0000 7fe6877fe640 1 -- 172.21.15.92:0/1644031659 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe690004cc0 con 0x7fe698108d70 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.425+0000 7fe69cda6640 1 -- 172.21.15.92:0/1644031659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6981a06f0 con 0x7fe698108d70 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.425+0000 7fe6877fe640 1 -- 172.21.15.92:0/1644031659 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690010690 con 0x7fe698108d70 2024-09-21T07:11:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.425+0000 7fe69cda6640 1 -- 172.21.15.92:0/1644031659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6981a6e50 con 0x7fe698108d70 2024-09-21T07:11:35.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.426+0000 7fe69cda6640 1 -- 172.21.15.92:0/1644031659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe698103d60 con 0x7fe698108d70 2024-09-21T07:11:35.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.427+0000 7fe6877fe640 1 -- 172.21.15.92:0/1644031659 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fe690005020 con 0x7fe698108d70 2024-09-21T07:11:35.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.428+0000 7fe6877fe640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6800b65e0 0x7fe6800b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.428+0000 7fe69659c640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6800b65e0 0x7fe6800b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.428+0000 7fe6877fe640 1 -- 172.21.15.92:0/1644031659 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7fe6900e7e20 con 0x7fe698108d70 2024-09-21T07:11:35.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.428+0000 7fe69659c640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6800b65e0 0x7fe6800b8af0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe688006010 tx=0x7fe688000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:35.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.432+0000 7fe6877fe640 1 -- 172.21.15.92:0/1644031659 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6900ae220 con 0x7fe698108d70 2024-09-21T07:11:35.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.637+0000 7fe69cda6640 1 -- 172.21.15.92:0/1644031659 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe698063800 con 0x7fe6800b65e0 2024-09-21T07:11:35.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.667+0000 7fe6877fe640 1 -- 172.21.15.92:0/1644031659 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe698063800 con 0x7fe6800b65e0 2024-09-21T07:11:35.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.669+0000 7fe69cda6640 1 -- 172.21.15.92:0/1644031659 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6800b65e0 msgr2=0x7fe6800b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.669+0000 7fe69cda6640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6800b65e0 0x7fe6800b8af0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe688006010 tx=0x7fe688000bc0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.669+0000 7fe69cda6640 1 -- 172.21.15.92:0/1644031659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe698108d70 msgr2=0x7fe69819fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.669+0000 7fe69cda6640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe698108d70 0x7fe69819fcd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe69000eb10 tx=0x7fe69000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.669+0000 7fe69cda6640 1 -- 172.21.15.92:0/1644031659 shutdown_connections 2024-09-21T07:11:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.669+0000 7fe69cda6640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6800b65e0 0x7fe6800b8af0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.669+0000 7fe69cda6640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe698108d70 0x7fe69819fcd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.669+0000 7fe69cda6640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe698108420 0x7fe69819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.669+0000 7fe69cda6640 1 --2- 172.21.15.92:0/1644031659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe698102ae0 0x7fe69819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.669+0000 7fe69cda6640 1 -- 172.21.15.92:0/1644031659 >> 172.21.15.92:0/1644031659 conn(0x7fe698079770 msgr2=0x7fe698101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.670+0000 7fe69cda6640 1 -- 172.21.15.92:0/1644031659 shutdown_connections 2024-09-21T07:11:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:35.670+0000 7fe69cda6640 1 -- 172.21.15.92:0/1644031659 wait complete. 2024-09-21T07:11:35.729 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:11:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: 2024-09-21T07:11:35.391+0000 7fed8ee71640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T07:11:35.729 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:11:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: 2024-09-21T07:11:35.391+0000 7fed8ee71640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T07:11:35.729 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:11:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: 2024-09-21T07:11:35.391+0000 7fed8ee71640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-21T07:11:35.729 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:11:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: 2024-09-21T07:11:35.391+0000 7fed8ee71640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-21T07:11:35.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:35 smithi092 ceph-mon[30987]: pgmap v293: 129 pgs: 129 active+clean; 586 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-21T07:11:35.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:35 smithi092 ceph-mon[30987]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:35.976 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:11:35 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:11:35.642+0000 7fc75925a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.976 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:11:35 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:11:35.642+0000 7fc75925a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.977 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:11:35 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:11:35.642+0000 7fc75925a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.977 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:11:35 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:11:35.642+0000 7fc75925a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.977 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:11:35 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:11:35.642+0000 7fc75925a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:36.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:35 smithi175 ceph-mon[34064]: pgmap v293: 129 pgs: 129 active+clean; 586 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-21T07:11:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:35 smithi175 ceph-mon[34064]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:36.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:35 smithi169 ceph-mon[33705]: pgmap v293: 129 pgs: 129 active+clean; 586 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-21T07:11:36.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:35 smithi169 ceph-mon[33705]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:36.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T07:11:36.663 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:37.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.225+0000 7f3b7603f640 1 -- 172.21.15.92:0/3976841819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70103270 msgr2=0x7f3b70103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.225+0000 7f3b7603f640 1 --2- 172.21.15.92:0/3976841819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70103270 0x7f3b70103680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009900 tx=0x7f3b6002a410 comp rx=0 tx=0).stop 2024-09-21T07:11:37.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.225+0000 7f3b7603f640 1 -- 172.21.15.92:0/3976841819 shutdown_connections 2024-09-21T07:11:37.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.225+0000 7f3b7603f640 1 --2- 172.21.15.92:0/3976841819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b70105b90 0x7f3b7010f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.225+0000 7f3b7603f640 1 --2- 172.21.15.92:0/3976841819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b70105240 0x7f3b70105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.225+0000 7f3b7603f640 1 --2- 172.21.15.92:0/3976841819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70103270 0x7f3b70103680 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.225+0000 7f3b7603f640 1 -- 172.21.15.92:0/3976841819 >> 172.21.15.92:0/3976841819 conn(0x7f3b70079ec0 msgr2=0x7f3b7007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.225+0000 7f3b7603f640 1 -- 172.21.15.92:0/3976841819 shutdown_connections 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.225+0000 7f3b7603f640 1 -- 172.21.15.92:0/3976841819 wait complete. 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b7603f640 1 Processor -- start 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b7603f640 1 -- start start 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b7603f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b70103270 0x7f3b7019b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b7603f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70105240 0x7f3b7019b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b7603f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b70105b90 0x7f3b7019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b7603f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701128e0 con 0x7f3b70105240 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b7603f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70112760 con 0x7f3b70103270 2024-09-21T07:11:37.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b7603f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70112a60 con 0x7f3b70105b90 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b6effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70105240 0x7f3b7019b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b6effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70105240 0x7f3b7019b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34320/0 (socket says 172.21.15.92:34320) 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b6effd640 1 -- 172.21.15.92:0/1699221326 learned_addr learned my addr 172.21.15.92:0/1699221326 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b6f7fe640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b70103270 0x7f3b7019b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.226+0000 7f3b6ffff640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b70105b90 0x7f3b7019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b6effd640 1 -- 172.21.15.92:0/1699221326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b70105b90 msgr2=0x7f3b7019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b6effd640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b70105b90 0x7f3b7019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b6effd640 1 -- 172.21.15.92:0/1699221326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b70103270 msgr2=0x7f3b7019b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b6effd640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b70103270 0x7f3b7019b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b6effd640 1 -- 172.21.15.92:0/1699221326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b701a64b0 con 0x7f3b70105240 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b6effd640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70105240 0x7f3b7019b730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400d770 tx=0x7f3b6400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b6cff9640 1 -- 172.21.15.92:0/1699221326 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64017070 con 0x7f3b70105240 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b7603f640 1 -- 172.21.15.92:0/1699221326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b701a67a0 con 0x7f3b70105240 2024-09-21T07:11:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b6cff9640 1 -- 172.21.15.92:0/1699221326 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b64009c30 con 0x7f3b70105240 2024-09-21T07:11:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b6cff9640 1 -- 172.21.15.92:0/1699221326 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400f620 con 0x7f3b70105240 2024-09-21T07:11:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.227+0000 7f3b7603f640 1 -- 172.21.15.92:0/1699221326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b701a6d30 con 0x7f3b70105240 2024-09-21T07:11:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.228+0000 7f3b7603f640 1 -- 172.21.15.92:0/1699221326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b70102300 con 0x7f3b70105240 2024-09-21T07:11:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.231+0000 7f3b6cff9640 1 -- 172.21.15.92:0/1699221326 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f3b6401a070 con 0x7f3b70105240 2024-09-21T07:11:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.231+0000 7f3b6cff9640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b580b6560 0x7f3b580b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.231+0000 7f3b6f7fe640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b580b6560 0x7f3b580b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.231+0000 7f3b6cff9640 1 -- 172.21.15.92:0/1699221326 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f3b640e72a0 con 0x7f3b70105240 2024-09-21T07:11:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.232+0000 7f3b6f7fe640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b580b6560 0x7f3b580b8a70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3b70102a50 tx=0x7f3b600058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.235+0000 7f3b6cff9640 1 -- 172.21.15.92:0/1699221326 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b64009de0 con 0x7f3b70105240 2024-09-21T07:11:37.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.441+0000 7f3b7603f640 1 -- 172.21.15.92:0/1699221326 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3b70063800 con 0x7f3b580b6560 2024-09-21T07:11:37.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.471+0000 7f3b6cff9640 1 -- 172.21.15.92:0/1699221326 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3b70063800 con 0x7f3b580b6560 2024-09-21T07:11:37.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.473+0000 7f3b7603f640 1 -- 172.21.15.92:0/1699221326 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b580b6560 msgr2=0x7f3b580b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.473+0000 7f3b7603f640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b580b6560 0x7f3b580b8a70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3b70102a50 tx=0x7f3b600058d0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.474+0000 7f3b7603f640 1 -- 172.21.15.92:0/1699221326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70105240 msgr2=0x7f3b7019b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.474+0000 7f3b7603f640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70105240 0x7f3b7019b730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400d770 tx=0x7f3b6400dc30 comp rx=0 tx=0).stop 2024-09-21T07:11:37.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.474+0000 7f3b7603f640 1 -- 172.21.15.92:0/1699221326 shutdown_connections 2024-09-21T07:11:37.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.474+0000 7f3b7603f640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b580b6560 0x7f3b580b8a70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.474+0000 7f3b7603f640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b70105b90 0x7f3b7019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.474+0000 7f3b7603f640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b70105240 0x7f3b7019b730 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.474+0000 7f3b7603f640 1 --2- 172.21.15.92:0/1699221326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b70103270 0x7f3b7019b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.474+0000 7f3b7603f640 1 -- 172.21.15.92:0/1699221326 >> 172.21.15.92:0/1699221326 conn(0x7f3b70079ec0 msgr2=0x7f3b701074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:37.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.474+0000 7f3b7603f640 1 -- 172.21.15.92:0/1699221326 shutdown_connections 2024-09-21T07:11:37.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:37.474+0000 7f3b7603f640 1 -- 172.21.15.92:0/1699221326 wait complete. 2024-09-21T07:11:38.108 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T07:11:38.354 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:38.786 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:38 smithi092 ceph-mon[30987]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:38.786 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:38 smithi092 ceph-mon[30987]: pgmap v294: 129 pgs: 129 active+clean; 586 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-09-21T07:11:38.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.880+0000 7fefca214640 1 -- 172.21.15.92:0/915149053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefc41083d0 msgr2=0x7fefc41087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.880+0000 7fefca214640 1 --2- 172.21.15.92:0/915149053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefc41083d0 0x7fefc41087e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009900 tx=0x7fefb802a410 comp rx=0 tx=0).stop 2024-09-21T07:11:38.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.880+0000 7fefca214640 1 -- 172.21.15.92:0/915149053 shutdown_connections 2024-09-21T07:11:38.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.880+0000 7fefca214640 1 --2- 172.21.15.92:0/915149053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefc4108d20 0x7fefc410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.880+0000 7fefca214640 1 --2- 172.21.15.92:0/915149053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefc41083d0 0x7fefc41087e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.880+0000 7fefca214640 1 --2- 172.21.15.92:0/915149053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefc4102a90 0x7fefc4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.880+0000 7fefca214640 1 -- 172.21.15.92:0/915149053 >> 172.21.15.92:0/915149053 conn(0x7fefc4079750 msgr2=0x7fefc4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:38.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.880+0000 7fefca214640 1 -- 172.21.15.92:0/915149053 shutdown_connections 2024-09-21T07:11:38.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.880+0000 7fefca214640 1 -- 172.21.15.92:0/915149053 wait complete. 2024-09-21T07:11:38.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.881+0000 7fefca214640 1 Processor -- start 2024-09-21T07:11:38.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.881+0000 7fefca214640 1 -- start start 2024-09-21T07:11:38.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.881+0000 7fefca214640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefc4102a90 0x7fefc419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.881+0000 7fefca214640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefc41083d0 0x7fefc419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.881+0000 7fefca214640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefc4108d20 0x7fefc419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.881+0000 7fefca214640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fefc4112840 con 0x7fefc41083d0 2024-09-21T07:11:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.881+0000 7fefca214640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fefc41126c0 con 0x7fefc4102a90 2024-09-21T07:11:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.881+0000 7fefca214640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fefc41129c0 con 0x7fefc4108d20 2024-09-21T07:11:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefc41083d0 0x7fefc419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefc41083d0 0x7fefc419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34336/0 (socket says 172.21.15.92:34336) 2024-09-21T07:11:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc2ffd640 1 -- 172.21.15.92:0/3681784935 learned_addr learned my addr 172.21.15.92:0/3681784935 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc3fff640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefc4108d20 0x7fefc419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc37fe640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefc4102a90 0x7fefc419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc2ffd640 1 -- 172.21.15.92:0/3681784935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefc4108d20 msgr2=0x7fefc419bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc2ffd640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefc4108d20 0x7fefc419bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc2ffd640 1 -- 172.21.15.92:0/3681784935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefc4102a90 msgr2=0x7fefc419b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc2ffd640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefc4102a90 0x7fefc419b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc2ffd640 1 -- 172.21.15.92:0/3681784935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc41a6430 con 0x7fefc41083d0 2024-09-21T07:11:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc2ffd640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefc41083d0 0x7fefc419b6b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fefb8005940 tx=0x7fefb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:38.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.882+0000 7fefc0ff9640 1 -- 172.21.15.92:0/3681784935 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb803f030 con 0x7fefc41083d0 2024-09-21T07:11:38.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.883+0000 7fefca214640 1 -- 172.21.15.92:0/3681784935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc41a66c0 con 0x7fefc41083d0 2024-09-21T07:11:38.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.883+0000 7fefc0ff9640 1 -- 172.21.15.92:0/3681784935 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefb8003c90 con 0x7fefc41083d0 2024-09-21T07:11:38.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.883+0000 7fefc0ff9640 1 -- 172.21.15.92:0/3681784935 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8035070 con 0x7fefc41083d0 2024-09-21T07:11:38.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.883+0000 7fefca214640 1 -- 172.21.15.92:0/3681784935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc41a6bf0 con 0x7fefc41083d0 2024-09-21T07:11:38.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.884+0000 7fefca214640 1 -- 172.21.15.92:0/3681784935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc4103d10 con 0x7fefc41083d0 2024-09-21T07:11:38.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.885+0000 7fefc0ff9640 1 -- 172.21.15.92:0/3681784935 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fefb8042030 con 0x7fefc41083d0 2024-09-21T07:11:38.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.886+0000 7fefc0ff9640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fefac0b65f0 0x7fefac0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.886+0000 7fefc37fe640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fefac0b65f0 0x7fefac0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.886+0000 7fefc0ff9640 1 -- 172.21.15.92:0/3681784935 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7fefb81081a0 con 0x7fefc41083d0 2024-09-21T07:11:38.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.886+0000 7fefc37fe640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fefac0b65f0 0x7fefac0b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fefc406c6a0 tx=0x7fefb400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:38.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:38.889+0000 7fefc0ff9640 1 -- 172.21.15.92:0/3681784935 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fefb80d2880 con 0x7fefc41083d0 2024-09-21T07:11:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:38 smithi175 ceph-mon[34064]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:38 smithi175 ceph-mon[34064]: pgmap v294: 129 pgs: 129 active+clean; 586 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-09-21T07:11:39.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.096+0000 7fefca214640 1 -- 172.21.15.92:0/3681784935 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fefc4063800 con 0x7fefac0b65f0 2024-09-21T07:11:39.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.103+0000 7fefc0ff9640 1 -- 172.21.15.92:0/3681784935 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fefc4063800 con 0x7fefac0b65f0 2024-09-21T07:11:39.105 INFO:teuthology.orchestra.run.smithi092.stdout:/volumes/qa/sv_0/af3d21b7-6fdf-4360-94cc-b40a9c192877 2024-09-21T07:11:39.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 -- 172.21.15.92:0/3681784935 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fefac0b65f0 msgr2=0x7fefac0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fefac0b65f0 0x7fefac0b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fefc406c6a0 tx=0x7fefb400b390 comp rx=0 tx=0).stop 2024-09-21T07:11:39.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 -- 172.21.15.92:0/3681784935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefc41083d0 msgr2=0x7fefc419b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefc41083d0 0x7fefc419b6b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fefb8005940 tx=0x7fefb80042f0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 -- 172.21.15.92:0/3681784935 shutdown_connections 2024-09-21T07:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fefac0b65f0 0x7fefac0b8b00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefc4108d20 0x7fefc419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefc41083d0 0x7fefc419b6b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 --2- 172.21.15.92:0/3681784935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefc4102a90 0x7fefc419b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 -- 172.21.15.92:0/3681784935 >> 172.21.15.92:0/3681784935 conn(0x7fefc4079750 msgr2=0x7fefc41044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 -- 172.21.15.92:0/3681784935 shutdown_connections 2024-09-21T07:11:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:39.105+0000 7fefca214640 1 -- 172.21.15.92:0/3681784935 wait complete. 2024-09-21T07:11:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:38 smithi169 ceph-mon[33705]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:38 smithi169 ceph-mon[33705]: pgmap v294: 129 pgs: 129 active+clean; 586 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-09-21T07:11:39.794 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:39 smithi092 ceph-mon[30987]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-09-21T07:11:39.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T07:11:40.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:39 smithi175 ceph-mon[34064]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-09-21T07:11:40.067 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:39 smithi169 ceph-mon[33705]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-09-21T07:11:40.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.617+0000 7f05f1222640 1 -- 172.21.15.92:0/1425616238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05ec102a80 msgr2=0x7f05ec102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.617+0000 7f05f1222640 1 --2- 172.21.15.92:0/1425616238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05ec102a80 0x7f05ec102e90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009900 tx=0x7f05dc02a410 comp rx=0 tx=0).stop 2024-09-21T07:11:40.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.617+0000 7f05f1222640 1 -- 172.21.15.92:0/1425616238 shutdown_connections 2024-09-21T07:11:40.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.617+0000 7f05f1222640 1 --2- 172.21.15.92:0/1425616238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ec108d10 0x7f05ec10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.617+0000 7f05f1222640 1 --2- 172.21.15.92:0/1425616238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05ec1083c0 0x7f05ec1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.617+0000 7f05f1222640 1 --2- 172.21.15.92:0/1425616238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05ec102a80 0x7f05ec102e90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.617+0000 7f05f1222640 1 -- 172.21.15.92:0/1425616238 >> 172.21.15.92:0/1425616238 conn(0x7f05ec079740 msgr2=0x7f05ec079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:40.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.617+0000 7f05f1222640 1 -- 172.21.15.92:0/1425616238 shutdown_connections 2024-09-21T07:11:40.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.617+0000 7f05f1222640 1 -- 172.21.15.92:0/1425616238 wait complete. 2024-09-21T07:11:40.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.618+0000 7f05f1222640 1 Processor -- start 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05f1222640 1 -- start start 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05f1222640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ec102a80 0x7f05ec1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05f1222640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05ec1083c0 0x7f05ec199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05f1222640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05ec108d10 0x7f05ec19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05f1222640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec112890 con 0x7f05ec1083c0 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05f1222640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec112710 con 0x7f05ec102a80 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05f1222640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec112a10 con 0x7f05ec108d10 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05ea59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05ec1083c0 0x7f05ec199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05ea59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05ec1083c0 0x7f05ec199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46268/0 (socket says 172.21.15.92:46268) 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05ea59c640 1 -- 172.21.15.92:0/3291203627 learned_addr learned my addr 172.21.15.92:0/3291203627 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:40.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05eb59e640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05ec108d10 0x7f05ec19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05ead9d640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ec102a80 0x7f05ec1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05ea59c640 1 -- 172.21.15.92:0/3291203627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05ec108d10 msgr2=0x7f05ec19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05ea59c640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05ec108d10 0x7f05ec19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05ea59c640 1 -- 172.21.15.92:0/3291203627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ec102a80 msgr2=0x7f05ec1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05ea59c640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ec102a80 0x7f05ec1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.619+0000 7f05ea59c640 1 -- 172.21.15.92:0/3291203627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ec19f250 con 0x7f05ec1083c0 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.620+0000 7f05ea59c640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05ec1083c0 0x7f05ec199940 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f05d400b450 tx=0x7f05d400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.620+0000 7f05e3fff640 1 -- 172.21.15.92:0/3291203627 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4015020 con 0x7f05ec1083c0 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.620+0000 7f05f1222640 1 -- 172.21.15.92:0/3291203627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ec19f540 con 0x7f05ec1083c0 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.620+0000 7f05e3fff640 1 -- 172.21.15.92:0/3291203627 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05d4011d20 con 0x7f05ec1083c0 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.620+0000 7f05e3fff640 1 -- 172.21.15.92:0/3291203627 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4010e10 con 0x7f05ec1083c0 2024-09-21T07:11:40.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.620+0000 7f05f1222640 1 -- 172.21.15.92:0/3291203627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ec1a5d60 con 0x7f05ec1083c0 2024-09-21T07:11:40.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.621+0000 7f05f1222640 1 -- 172.21.15.92:0/3291203627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ec103d00 con 0x7f05ec1083c0 2024-09-21T07:11:40.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.623+0000 7f05e3fff640 1 -- 172.21.15.92:0/3291203627 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f05d4018020 con 0x7f05ec1083c0 2024-09-21T07:11:40.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.624+0000 7f05e3fff640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05d80b6620 0x7f05d80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.624+0000 7f05ead9d640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05d80b6620 0x7f05d80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.624+0000 7f05e3fff640 1 -- 172.21.15.92:0/3291203627 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f05d40e77d0 con 0x7f05ec1083c0 2024-09-21T07:11:40.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.624+0000 7f05ead9d640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05d80b6620 0x7f05d80b8b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f05dc000c00 tx=0x7f05dc009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:40.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.627+0000 7f05e3fff640 1 -- 172.21.15.92:0/3291203627 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05d401f020 con 0x7f05ec1083c0 2024-09-21T07:11:40.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.834+0000 7f05f1222640 1 -- 172.21.15.92:0/3291203627 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f05ec063800 con 0x7f05d80b6620 2024-09-21T07:11:40.836 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:40 smithi092 ceph-mon[30987]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:40.836 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:40 smithi092 ceph-mon[30987]: pgmap v295: 129 pgs: 129 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.6 KiB/s wr, 20 op/s 2024-09-21T07:11:40.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.862+0000 7f05e3fff640 1 -- 172.21.15.92:0/3291203627 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f05ec063800 con 0x7f05d80b6620 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 -- 172.21.15.92:0/3291203627 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05d80b6620 msgr2=0x7f05d80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05d80b6620 0x7f05d80b8b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f05dc000c00 tx=0x7f05dc009680 comp rx=0 tx=0).stop 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 -- 172.21.15.92:0/3291203627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05ec1083c0 msgr2=0x7f05ec199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05ec1083c0 0x7f05ec199940 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f05d400b450 tx=0x7f05d400b910 comp rx=0 tx=0).stop 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 -- 172.21.15.92:0/3291203627 shutdown_connections 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05d80b6620 0x7f05d80b8b30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05ec108d10 0x7f05ec19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05ec1083c0 0x7f05ec199940 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 --2- 172.21.15.92:0/3291203627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05ec102a80 0x7f05ec1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 -- 172.21.15.92:0/3291203627 >> 172.21.15.92:0/3291203627 conn(0x7f05ec079740 msgr2=0x7f05ec101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 -- 172.21.15.92:0/3291203627 shutdown_connections 2024-09-21T07:11:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:40.865+0000 7f05f1222640 1 -- 172.21.15.92:0/3291203627 wait complete. 2024-09-21T07:11:41.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:40 smithi175 ceph-mon[34064]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:41.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:40 smithi175 ceph-mon[34064]: pgmap v295: 129 pgs: 129 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.6 KiB/s wr, 20 op/s 2024-09-21T07:11:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:40 smithi169 ceph-mon[33705]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:40 smithi169 ceph-mon[33705]: pgmap v295: 129 pgs: 129 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.6 KiB/s wr, 20 op/s 2024-09-21T07:11:41.575 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T07:11:41.825 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:42.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.357+0000 7fadc27c2640 1 -- 172.21.15.92:0/698035686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadbc1083a0 msgr2=0x7fadbc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:42.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.357+0000 7fadc27c2640 1 --2- 172.21.15.92:0/698035686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadbc1083a0 0x7fadbc1087b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fada4009900 tx=0x7fada402a410 comp rx=0 tx=0).stop 2024-09-21T07:11:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.357+0000 7fadc27c2640 1 -- 172.21.15.92:0/698035686 shutdown_connections 2024-09-21T07:11:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.357+0000 7fadc27c2640 1 --2- 172.21.15.92:0/698035686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadbc108cf0 0x7fadbc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.357+0000 7fadc27c2640 1 --2- 172.21.15.92:0/698035686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadbc1083a0 0x7fadbc1087b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.357+0000 7fadc27c2640 1 --2- 172.21.15.92:0/698035686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadbc102a60 0x7fadbc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.357+0000 7fadc27c2640 1 -- 172.21.15.92:0/698035686 >> 172.21.15.92:0/698035686 conn(0x7fadbc079730 msgr2=0x7fadbc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:42.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.357+0000 7fadc27c2640 1 -- 172.21.15.92:0/698035686 shutdown_connections 2024-09-21T07:11:42.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.357+0000 7fadc27c2640 1 -- 172.21.15.92:0/698035686 wait complete. 2024-09-21T07:11:42.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadc27c2640 1 Processor -- start 2024-09-21T07:11:42.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadc27c2640 1 -- start start 2024-09-21T07:11:42.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadc27c2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadbc102a60 0x7fadbc19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:42.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadc27c2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadbc1083a0 0x7fadbc19b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:42.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadc27c2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadbc108cf0 0x7fadbc19bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:42.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadc27c2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc112810 con 0x7fadbc1083a0 2024-09-21T07:11:42.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadc27c2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc112690 con 0x7fadbc108cf0 2024-09-21T07:11:42.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadc27c2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc112990 con 0x7fadbc102a60 2024-09-21T07:11:42.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadbc1083a0 0x7fadbc19b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:42.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadbc1083a0 0x7fadbc19b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46284/0 (socket says 172.21.15.92:46284) 2024-09-21T07:11:42.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.358+0000 7fadb3fff640 1 -- 172.21.15.92:0/1959472315 learned_addr learned my addr 172.21.15.92:0/1959472315 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:42.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadc0d5f640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadbc108cf0 0x7fadbc19bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:42.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadbbfff640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadbc102a60 0x7fadbc19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:42.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadb3fff640 1 -- 172.21.15.92:0/1959472315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadbc102a60 msgr2=0x7fadbc19b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:42.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadb3fff640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadbc102a60 0x7fadbc19b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadb3fff640 1 -- 172.21.15.92:0/1959472315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadbc108cf0 msgr2=0x7fadbc19bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:42.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadb3fff640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadbc108cf0 0x7fadbc19bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadb3fff640 1 -- 172.21.15.92:0/1959472315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadbc1a6490 con 0x7fadbc1083a0 2024-09-21T07:11:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadbbfff640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadbc102a60 0x7fadbc19b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadb3fff640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadbc1083a0 0x7fadbc19b740 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fada4005940 tx=0x7fada40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadb9ffb640 1 -- 172.21.15.92:0/1959472315 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada403f030 con 0x7fadbc1083a0 2024-09-21T07:11:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadb9ffb640 1 -- 172.21.15.92:0/1959472315 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fada4003c90 con 0x7fadbc1083a0 2024-09-21T07:11:42.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadc27c2640 1 -- 172.21.15.92:0/1959472315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadbc1a6720 con 0x7fadbc1083a0 2024-09-21T07:11:42.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadb9ffb640 1 -- 172.21.15.92:0/1959472315 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4035070 con 0x7fadbc1083a0 2024-09-21T07:11:42.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.359+0000 7fadc27c2640 1 -- 172.21.15.92:0/1959472315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadbc1a6c00 con 0x7fadbc1083a0 2024-09-21T07:11:42.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.360+0000 7fadc27c2640 1 -- 172.21.15.92:0/1959472315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadbc103ce0 con 0x7fadbc1083a0 2024-09-21T07:11:42.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.362+0000 7fadb9ffb640 1 -- 172.21.15.92:0/1959472315 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fada4042030 con 0x7fadbc1083a0 2024-09-21T07:11:42.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.362+0000 7fadb9ffb640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fada80b6620 0x7fada80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:42.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.362+0000 7fadbbfff640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fada80b6620 0x7fada80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:42.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.362+0000 7fadb9ffb640 1 -- 172.21.15.92:0/1959472315 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7fada4108440 con 0x7fadbc1083a0 2024-09-21T07:11:42.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.363+0000 7fadbbfff640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fada80b6620 0x7fada80b8b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fadac0058c0 tx=0x7fadac005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:42.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.365+0000 7fadb9ffb640 1 -- 172.21.15.92:0/1959472315 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fada40ce740 con 0x7fadbc1083a0 2024-09-21T07:11:42.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.571+0000 7fadc27c2640 1 -- 172.21.15.92:0/1959472315 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fadbc063800 con 0x7fada80b6620 2024-09-21T07:11:42.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.576+0000 7fadb9ffb640 1 -- 172.21.15.92:0/1959472315 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fadbc063800 con 0x7fada80b6620 2024-09-21T07:11:42.578 INFO:teuthology.orchestra.run.smithi092.stdout:/volumes/qa/sv_1/b6ea155b-19c2-40a4-9dbd-efa3719628a2 2024-09-21T07:11:42.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 -- 172.21.15.92:0/1959472315 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fada80b6620 msgr2=0x7fada80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fada80b6620 0x7fada80b8b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fadac0058c0 tx=0x7fadac005d50 comp rx=0 tx=0).stop 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 -- 172.21.15.92:0/1959472315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadbc1083a0 msgr2=0x7fadbc19b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadbc1083a0 0x7fadbc19b740 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fada4005940 tx=0x7fada40042f0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 -- 172.21.15.92:0/1959472315 shutdown_connections 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fada80b6620 0x7fada80b8b30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadbc108cf0 0x7fadbc19bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadbc1083a0 0x7fadbc19b740 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 --2- 172.21.15.92:0/1959472315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadbc102a60 0x7fadbc19b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 -- 172.21.15.92:0/1959472315 >> 172.21.15.92:0/1959472315 conn(0x7fadbc079730 msgr2=0x7fadbc104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 -- 172.21.15.92:0/1959472315 shutdown_connections 2024-09-21T07:11:42.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:42.579+0000 7fadc27c2640 1 -- 172.21.15.92:0/1959472315 wait complete. 2024-09-21T07:11:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:42 smithi092 ceph-mon[30987]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:42 smithi092 ceph-mon[30987]: pgmap v296: 129 pgs: 129 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.6 KiB/s wr, 21 op/s 2024-09-21T07:11:43.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:42 smithi175 ceph-mon[34064]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:43.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:42 smithi175 ceph-mon[34064]: pgmap v296: 129 pgs: 129 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.6 KiB/s wr, 21 op/s 2024-09-21T07:11:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:42 smithi169 ceph-mon[33705]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:42 smithi169 ceph-mon[33705]: pgmap v296: 129 pgs: 129 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.6 KiB/s wr, 21 op/s 2024-09-21T07:11:43.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:11:43.503 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:43.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:43 smithi092 ceph-mon[30987]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:44.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:43 smithi175 ceph-mon[34064]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.062+0000 7f3aa5855640 1 -- 172.21.15.92:0/1305779986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa0103b60 msgr2=0x7f3aa0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.062+0000 7f3aa5855640 1 --2- 172.21.15.92:0/1305779986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa0103b60 0x7f3aa0103f70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009900 tx=0x7f3a9002a410 comp rx=0 tx=0).stop 2024-09-21T07:11:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.062+0000 7f3aa5855640 1 -- 172.21.15.92:0/1305779986 shutdown_connections 2024-09-21T07:11:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.062+0000 7f3aa5855640 1 --2- 172.21.15.92:0/1305779986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aa0109df0 0x7f3aa0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.062+0000 7f3aa5855640 1 --2- 172.21.15.92:0/1305779986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa01094a0 0x7f3aa01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.062+0000 7f3aa5855640 1 --2- 172.21.15.92:0/1305779986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa0103b60 0x7f3aa0103f70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.062+0000 7f3aa5855640 1 -- 172.21.15.92:0/1305779986 >> 172.21.15.92:0/1305779986 conn(0x7f3aa007b850 msgr2=0x7f3aa007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.062+0000 7f3aa5855640 1 -- 172.21.15.92:0/1305779986 shutdown_connections 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.062+0000 7f3aa5855640 1 -- 172.21.15.92:0/1305779986 wait complete. 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.062+0000 7f3aa5855640 1 Processor -- start 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3aa5855640 1 -- start start 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3aa5855640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa0103b60 0x7f3aa019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3aa5855640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aa01094a0 0x7f3aa019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3aa5855640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa0109df0 0x7f3aa019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3aa5855640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa01139a0 con 0x7f3aa0109df0 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3aa5855640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa0113820 con 0x7f3aa01094a0 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3aa5855640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa0113b20 con 0x7f3aa0103b60 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa0109df0 0x7f3aa019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa0109df0 0x7f3aa019fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46296/0 (socket says 172.21.15.92:46296) 2024-09-21T07:11:44.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9f7fe640 1 -- 172.21.15.92:0/3132924097 learned_addr learned my addr 172.21.15.92:0/3132924097 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9e7fc640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aa01094a0 0x7f3aa019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9effd640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa0103b60 0x7f3aa019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9f7fe640 1 -- 172.21.15.92:0/3132924097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa0103b60 msgr2=0x7f3aa019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9f7fe640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa0103b60 0x7f3aa019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9f7fe640 1 -- 172.21.15.92:0/3132924097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aa01094a0 msgr2=0x7f3aa019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9f7fe640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aa01094a0 0x7f3aa019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9f7fe640 1 -- 172.21.15.92:0/3132924097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa01a03e0 con 0x7f3aa0109df0 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9e7fc640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aa01094a0 0x7f3aa019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.063+0000 7f3a9effd640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa0103b60 0x7f3aa019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.064+0000 7f3a9f7fe640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa0109df0 0x7f3aa019fcb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800cad0 tx=0x7f3a9800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.064+0000 7f3aa4853640 1 -- 172.21.15.92:0/3132924097 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800ae20 con 0x7f3aa0109df0 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.064+0000 7f3aa4853640 1 -- 172.21.15.92:0/3132924097 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a98005020 con 0x7f3aa0109df0 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.064+0000 7f3aa5855640 1 -- 172.21.15.92:0/3132924097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa01a06d0 con 0x7f3aa0109df0 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.064+0000 7f3aa4853640 1 -- 172.21.15.92:0/3132924097 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800f6b0 con 0x7f3aa0109df0 2024-09-21T07:11:44.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.064+0000 7f3aa5855640 1 -- 172.21.15.92:0/3132924097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa01a6e30 con 0x7f3aa0109df0 2024-09-21T07:11:44.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.065+0000 7f3aa5855640 1 -- 172.21.15.92:0/3132924097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa0103f70 con 0x7f3aa0109df0 2024-09-21T07:11:44.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.066+0000 7f3aa4853640 1 -- 172.21.15.92:0/3132924097 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3a980051d0 con 0x7f3aa0109df0 2024-09-21T07:11:44.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.067+0000 7f3aa4853640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3a880b65f0 0x7f3a880b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.067+0000 7f3a9effd640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3a880b65f0 0x7f3a880b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.067+0000 7f3aa4853640 1 -- 172.21.15.92:0/3132924097 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f3a980e7db0 con 0x7f3aa0109df0 2024-09-21T07:11:44.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.068+0000 7f3a9effd640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3a880b65f0 0x7f3a880b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3a90006010 tx=0x7f3a90000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:44.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.070+0000 7f3aa4853640 1 -- 172.21.15.92:0/3132924097 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a98014030 con 0x7f3aa0109df0 2024-09-21T07:11:44.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:43 smithi169 ceph-mon[33705]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:11:44.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.284+0000 7f3aa5855640 1 -- 172.21.15.92:0/3132924097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3aa019b5a0 con 0x7f3aa0109df0 2024-09-21T07:11:44.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.285+0000 7f3aa4853640 1 -- 172.21.15.92:0/3132924097 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7f3a980ae0b0 con 0x7f3aa0109df0 2024-09-21T07:11:44.288 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:44.288 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":28,"btime":"2024-09-21T07:11:33:733807+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:11:33.733792+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24649,24625,24608,24583,24566]},"id":1}]} 2024-09-21T07:11:44.289 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 28 2024-09-21T07:11:44.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 -- 172.21.15.92:0/3132924097 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3a880b65f0 msgr2=0x7f3a880b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3a880b65f0 0x7f3a880b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3a90006010 tx=0x7f3a90000bc0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 -- 172.21.15.92:0/3132924097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa0109df0 msgr2=0x7f3aa019fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa0109df0 0x7f3aa019fcb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800cad0 tx=0x7f3a9800cf90 comp rx=0 tx=0).stop 2024-09-21T07:11:44.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 -- 172.21.15.92:0/3132924097 shutdown_connections 2024-09-21T07:11:44.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3a880b65f0 0x7f3a880b8b00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa0109df0 0x7f3aa019fcb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3aa01094a0 0x7f3aa019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 --2- 172.21.15.92:0/3132924097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3aa0103b60 0x7f3aa019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 -- 172.21.15.92:0/3132924097 >> 172.21.15.92:0/3132924097 conn(0x7f3aa007b850 msgr2=0x7f3aa01075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:44.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 -- 172.21.15.92:0/3132924097 shutdown_connections 2024-09-21T07:11:44.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:44.288+0000 7f3aa5855640 1 -- 172.21.15.92:0/3132924097 wait complete. 2024-09-21T07:11:44.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:44 smithi092 ceph-mon[30987]: pgmap v297: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2024-09-21T07:11:44.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:44 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3132924097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:11:44.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:11:45.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:44 smithi175 ceph-mon[34064]: pgmap v297: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2024-09-21T07:11:45.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:44 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3132924097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:11:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:44 smithi169 ceph-mon[33705]: pgmap v297: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2024-09-21T07:11:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:44 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3132924097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:11:45.230 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.748+0000 7f25ccced640 1 -- 172.21.15.92:0/1905372940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25c81094a0 msgr2=0x7f25c81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.748+0000 7f25ccced640 1 --2- 172.21.15.92:0/1905372940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25c81094a0 0x7f25c81098b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009900 tx=0x7f25bc02a410 comp rx=0 tx=0).stop 2024-09-21T07:11:45.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.748+0000 7f25ccced640 1 -- 172.21.15.92:0/1905372940 shutdown_connections 2024-09-21T07:11:45.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.748+0000 7f25ccced640 1 --2- 172.21.15.92:0/1905372940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25c8109df0 0x7f25c8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.748+0000 7f25ccced640 1 --2- 172.21.15.92:0/1905372940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25c81094a0 0x7f25c81098b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.748+0000 7f25ccced640 1 --2- 172.21.15.92:0/1905372940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25c8103b60 0x7f25c8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.748+0000 7f25ccced640 1 -- 172.21.15.92:0/1905372940 >> 172.21.15.92:0/1905372940 conn(0x7f25c807b850 msgr2=0x7f25c807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:45.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.748+0000 7f25ccced640 1 -- 172.21.15.92:0/1905372940 shutdown_connections 2024-09-21T07:11:45.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.748+0000 7f25ccced640 1 -- 172.21.15.92:0/1905372940 wait complete. 2024-09-21T07:11:45.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.748+0000 7f25ccced640 1 Processor -- start 2024-09-21T07:11:45.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25ccced640 1 -- start start 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25ccced640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25c8103b60 0x7f25c819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25ccced640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25c81094a0 0x7f25c819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25ccced640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25c8109df0 0x7f25c819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25ccced640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8113960 con 0x7f25c8103b60 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25ccced640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f25c81137e0 con 0x7f25c81094a0 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25ccced640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8113ae0 con 0x7f25c8109df0 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25c8103b60 0x7f25c819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25c8103b60 0x7f25c819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46310/0 (socket says 172.21.15.92:46310) 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c659c640 1 -- 172.21.15.92:0/2069276058 learned_addr learned my addr 172.21.15.92:0/2069276058 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c6d9d640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25c8109df0 0x7f25c819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c5d9b640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25c81094a0 0x7f25c819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c659c640 1 -- 172.21.15.92:0/2069276058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25c8109df0 msgr2=0x7f25c819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c659c640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25c8109df0 0x7f25c819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c659c640 1 -- 172.21.15.92:0/2069276058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25c81094a0 msgr2=0x7f25c819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c659c640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25c81094a0 0x7f25c819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c659c640 1 -- 172.21.15.92:0/2069276058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c81a03a0 con 0x7f25c8103b60 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.749+0000 7f25c5d9b640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25c81094a0 0x7f25c819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.750+0000 7f25c659c640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25c8103b60 0x7f25c819a430 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c890 tx=0x7f25b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.750+0000 7f25b77fe640 1 -- 172.21.15.92:0/2069276058 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8004220 con 0x7f25c8103b60 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.750+0000 7f25b77fe640 1 -- 172.21.15.92:0/2069276058 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25b8007e40 con 0x7f25c8103b60 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.750+0000 7f25ccced640 1 -- 172.21.15.92:0/2069276058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c81a0690 con 0x7f25c8103b60 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.750+0000 7f25b77fe640 1 -- 172.21.15.92:0/2069276058 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8004a00 con 0x7f25c8103b60 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.750+0000 7f25ccced640 1 -- 172.21.15.92:0/2069276058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c81a6df0 con 0x7f25c8103b60 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.751+0000 7f25ccced640 1 -- 172.21.15.92:0/2069276058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c8103f70 con 0x7f25c8103b60 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.752+0000 7f25b77fe640 1 -- 172.21.15.92:0/2069276058 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f25b80079b0 con 0x7f25c8103b60 2024-09-21T07:11:45.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.753+0000 7f25b77fe640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25b00b65f0 0x7f25b00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.753+0000 7f25c5d9b640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25b00b65f0 0x7f25b00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.753+0000 7f25b77fe640 1 -- 172.21.15.92:0/2069276058 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f25b80e7670 con 0x7f25c8103b60 2024-09-21T07:11:45.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.754+0000 7f25c5d9b640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25b00b65f0 0x7f25b00b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0057c0 tx=0x7f25bc009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:45.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.758+0000 7f25b77fe640 1 -- 172.21.15.92:0/2069276058 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25b8014030 con 0x7f25c8103b60 2024-09-21T07:11:45.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.937+0000 7f25ccced640 1 -- 172.21.15.92:0/2069276058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25c802e640 con 0x7f25c8103b60 2024-09-21T07:11:45.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.939+0000 7f25b77fe640 1 -- 172.21.15.92:0/2069276058 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25030 (secure 0 0 0) 0x7f25b80ad970 con 0x7f25c8103b60 2024-09-21T07:11:45.942 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:45.942 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":84,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:11:14.645823+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:45.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 -- 172.21.15.92:0/2069276058 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25b00b65f0 msgr2=0x7f25b00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25b00b65f0 0x7f25b00b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0057c0 tx=0x7f25bc009680 comp rx=0 tx=0).stop 2024-09-21T07:11:45.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 -- 172.21.15.92:0/2069276058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25c8103b60 msgr2=0x7f25c819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25c8103b60 0x7f25c819a430 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c890 tx=0x7f25b800cd50 comp rx=0 tx=0).stop 2024-09-21T07:11:45.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 -- 172.21.15.92:0/2069276058 shutdown_connections 2024-09-21T07:11:45.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25b00b65f0 0x7f25b00b8b00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25c8109df0 0x7f25c819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25c81094a0 0x7f25c819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 --2- 172.21.15.92:0/2069276058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25c8103b60 0x7f25c819a430 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 -- 172.21.15.92:0/2069276058 >> 172.21.15.92:0/2069276058 conn(0x7f25c807b850 msgr2=0x7f25c81055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 -- 172.21.15.92:0/2069276058 shutdown_connections 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:45.941+0000 7f25ccced640 1 -- 172.21.15.92:0/2069276058 wait complete. 2024-09-21T07:11:46.567 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:11:46.567 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:46.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:46 smithi092 ceph-mon[30987]: pgmap v298: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 19 op/s 2024-09-21T07:11:46.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:46 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2069276058' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:46 smithi175 ceph-mon[34064]: pgmap v298: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 19 op/s 2024-09-21T07:11:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:46 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2069276058' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:46 smithi169 ceph-mon[33705]: pgmap v298: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 19 op/s 2024-09-21T07:11:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:46 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2069276058' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 -- 172.21.15.92:0/1672656295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0108d20 msgr2=0x7f84d010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 --2- 172.21.15.92:0/1672656295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0108d20 0x7f84d010f550 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009ca0 tx=0x7f84c802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 -- 172.21.15.92:0/1672656295 shutdown_connections 2024-09-21T07:11:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 --2- 172.21.15.92:0/1672656295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0108d20 0x7f84d010f550 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 --2- 172.21.15.92:0/1672656295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d01083d0 0x7f84d01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 --2- 172.21.15.92:0/1672656295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d0102a90 0x7f84d0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 -- 172.21.15.92:0/1672656295 >> 172.21.15.92:0/1672656295 conn(0x7f84d0079750 msgr2=0x7f84d0079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 -- 172.21.15.92:0/1672656295 shutdown_connections 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 -- 172.21.15.92:0/1672656295 wait complete. 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 Processor -- start 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.330+0000 7f84d71b0640 1 -- start start 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d71b0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d0102a90 0x7f84d019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d71b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d01083d0 0x7f84d019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d71b0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0108d20 0x7f84d019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d71b0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f84d0113990 con 0x7f84d0108d20 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d71b0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84d0113810 con 0x7f84d0102a90 2024-09-21T07:11:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d71b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84d0113b10 con 0x7f84d01083d0 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d574d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0108d20 0x7f84d019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d574d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0108d20 0x7f84d019fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46320/0 (socket says 172.21.15.92:46320) 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d574d640 1 -- 172.21.15.92:0/844749208 learned_addr learned my addr 172.21.15.92:0/844749208 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d4f4c640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d0102a90 0x7f84d019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84cffff640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d01083d0 0x7f84d019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d574d640 1 -- 172.21.15.92:0/844749208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d01083d0 msgr2=0x7f84d019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d574d640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d01083d0 0x7f84d019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d574d640 1 -- 172.21.15.92:0/844749208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d0102a90 msgr2=0x7f84d019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d574d640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d0102a90 0x7f84d019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d574d640 1 -- 172.21.15.92:0/844749208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d01a03f0 con 0x7f84d0108d20 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84cffff640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d01083d0 0x7f84d019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84d574d640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0108d20 0x7f84d019fcc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f84c8005cc0 tx=0x7f84c8032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.331+0000 7f84cdffb640 1 -- 172.21.15.92:0/844749208 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c8032e00 con 0x7f84d0108d20 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.332+0000 7f84cdffb640 1 -- 172.21.15.92:0/844749208 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84c80044d0 con 0x7f84d0108d20 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.332+0000 7f84d71b0640 1 -- 172.21.15.92:0/844749208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d01a0680 con 0x7f84d0108d20 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.332+0000 7f84cdffb640 1 -- 172.21.15.92:0/844749208 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c8030b70 con 0x7f84d0108d20 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.332+0000 7f84d71b0640 1 -- 172.21.15.92:0/844749208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d01a6e40 con 0x7f84d0108d20 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.333+0000 7f84d71b0640 1 -- 172.21.15.92:0/844749208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d0103d10 con 0x7f84d0108d20 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.335+0000 7f84cdffb640 1 -- 172.21.15.92:0/844749208 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f84c8030d10 con 0x7f84d0108d20 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.336+0000 7f84cdffb640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84b80b65f0 0x7f84b80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.336+0000 7f84d4f4c640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84b80b65f0 0x7f84b80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.336+0000 7f84cdffb640 1 -- 172.21.15.92:0/844749208 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f84c8108d90 con 0x7f84d0108d20 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.337+0000 7f84d4f4c640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84b80b65f0 0x7f84b80b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f84c00058c0 tx=0x7f84c000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.339+0000 7f84cdffb640 1 -- 172.21.15.92:0/844749208 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84c80cf090 con 0x7f84d0108d20 2024-09-21T07:11:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.517+0000 7f84d71b0640 1 -- 172.21.15.92:0/844749208 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84d0063800 con 0x7f84b80b65f0 2024-09-21T07:11:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.524+0000 7f84cdffb640 1 -- 172.21.15.92:0/844749208 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340666 (secure 0 0 0) 0x7f84d0063800 con 0x7f84b80b65f0 2024-09-21T07:11:47.529 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:47.530 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-21T07:11:47.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 -- 172.21.15.92:0/844749208 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84b80b65f0 msgr2=0x7f84b80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:47.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84b80b65f0 0x7f84b80b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f84c00058c0 tx=0x7f84c000a2d0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 -- 172.21.15.92:0/844749208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0108d20 msgr2=0x7f84d019fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:47.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0108d20 0x7f84d019fcc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f84c8005cc0 tx=0x7f84c8032a10 comp rx=0 tx=0).stop 2024-09-21T07:11:47.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 -- 172.21.15.92:0/844749208 shutdown_connections 2024-09-21T07:11:47.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84b80b65f0 0x7f84b80b8b00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84d0108d20 0x7f84d019fcc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d01083d0 0x7f84d019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 --2- 172.21.15.92:0/844749208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d0102a90 0x7f84d019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:47.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 -- 172.21.15.92:0/844749208 >> 172.21.15.92:0/844749208 conn(0x7f84d0079750 msgr2=0x7f84d0104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:47.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.527+0000 7f84d71b0640 1 -- 172.21.15.92:0/844749208 shutdown_connections 2024-09-21T07:11:47.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:47.528+0000 7f84d71b0640 1 -- 172.21.15.92:0/844749208 wait complete. 2024-09-21T07:11:48.203 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-09-21T07:11:45.595218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645287,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":214,"num_read_kb":194,"num_write":357,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364864,"kb_used_data":11456,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576960,"statfs":{"total":1151940427776,"available":1151566807040,"internally_reserved":0,"allocated":11730944,"data_stored":7758163,"data_compressed":391833,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48581,"num_objects":41,"num_object_clones":0,"num_object_copies":125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":133,"num_read_kb":125,"num_write":99,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003290"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:40.756387+0000","last_change":"2024-09-21T07:10:51.463956+0000","last_active":"2024-09-21T07:11:40.756387+0000","last_peered":"2024-09-21T07:11:40.756387+0000","last_clean":"2024-09-21T07:11:40.756387+0000","last_became_active":"2024-09-21T07:10:51.463564+0000","last_became_peered":"2024-09-21T07:10:51.463564+0000","last_unstale":"2024-09-21T07:11:40.756387+0000","last_undegraded":"2024-09-21T07:11:40.756387+0000","last_fullsized":"2024-09-21T07:11:40.756387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671587+0000","last_change":"2024-09-21T07:10:53.484379+0000","last_active":"2024-09-21T07:11:14.671587+0000","last_peered":"2024-09-21T07:11:14.671587+0000","last_clean":"2024-09-21T07:11:14.671587+0000","last_became_active":"2024-09-21T07:10:53.484005+0000","last_became_peered":"2024-09-21T07:10:53.484005+0000","last_unstale":"2024-09-21T07:11:14.671587+0000","last_undegraded":"2024-09-21T07:11:14.671587+0000","last_fullsized":"2024-09-21T07:11:14.671587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:27.665257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650238+0000","last_change":"2024-09-21T07:11:00.552729+0000","last_active":"2024-09-21T07:11:14.650238+0000","last_peered":"2024-09-21T07:11:14.650238+0000","last_clean":"2024-09-21T07:11:14.650238+0000","last_became_active":"2024-09-21T07:11:00.552196+0000","last_became_peered":"2024-09-21T07:11:00.552196+0000","last_unstale":"2024-09-21T07:11:14.650238+0000","last_undegraded":"2024-09-21T07:11:14.650238+0000","last_fullsized":"2024-09-21T07:11:14.650238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:35.942717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671851+0000","last_change":"2024-09-21T07:10:51.467798+0000","last_active":"2024-09-21T07:11:14.671851+0000","last_peered":"2024-09-21T07:11:14.671851+0000","last_clean":"2024-09-21T07:11:14.671851+0000","last_became_active":"2024-09-21T07:10:51.467314+0000","last_became_peered":"2024-09-21T07:10:51.467314+0000","last_unstale":"2024-09-21T07:11:14.671851+0000","last_undegraded":"2024-09-21T07:11:14.671851+0000","last_fullsized":"2024-09-21T07:11:14.671851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:21.944378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653001+0000","last_change":"2024-09-21T07:10:53.494849+0000","last_active":"2024-09-21T07:11:14.653001+0000","last_peered":"2024-09-21T07:11:14.653001+0000","last_clean":"2024-09-21T07:11:14.653001+0000","last_became_active":"2024-09-21T07:10:53.494478+0000","last_became_peered":"2024-09-21T07:10:53.494478+0000","last_unstale":"2024-09-21T07:11:14.653001+0000","last_undegraded":"2024-09-21T07:11:14.653001+0000","last_fullsized":"2024-09-21T07:11:14.653001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:38.383547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650072+0000","last_change":"2024-09-21T07:11:00.558306+0000","last_active":"2024-09-21T07:11:14.650072+0000","last_peered":"2024-09-21T07:11:14.650072+0000","last_clean":"2024-09-21T07:11:14.650072+0000","last_became_active":"2024-09-21T07:11:00.557814+0000","last_became_peered":"2024-09-21T07:11:00.557814+0000","last_unstale":"2024-09-21T07:11:14.650072+0000","last_undegraded":"2024-09-21T07:11:14.650072+0000","last_fullsized":"2024-09-21T07:11:14.650072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:31.401788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:33.742565+0000","last_change":"2024-09-21T07:10:51.466831+0000","last_active":"2024-09-21T07:11:33.742565+0000","last_peered":"2024-09-21T07:11:33.742565+0000","last_clean":"2024-09-21T07:11:33.742565+0000","last_became_active":"2024-09-21T07:10:51.466381+0000","last_became_peered":"2024-09-21T07:10:51.466381+0000","last_unstale":"2024-09-21T07:11:33.742565+0000","last_undegraded":"2024-09-21T07:11:33.742565+0000","last_fullsized":"2024-09-21T07:11:33.742565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.559370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669367+0000","last_change":"2024-09-21T07:10:53.485920+0000","last_active":"2024-09-21T07:11:14.669367+0000","last_peered":"2024-09-21T07:11:14.669367+0000","last_clean":"2024-09-21T07:11:14.669367+0000","last_became_active":"2024-09-21T07:10:53.484689+0000","last_became_peered":"2024-09-21T07:10:53.484689+0000","last_unstale":"2024-09-21T07:11:14.669367+0000","last_undegraded":"2024-09-21T07:11:14.669367+0000","last_fullsized":"2024-09-21T07:11:14.669367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:59.951999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651022+0000","last_change":"2024-09-21T07:11:00.558298+0000","last_active":"2024-09-21T07:11:14.651022+0000","last_peered":"2024-09-21T07:11:14.651022+0000","last_clean":"2024-09-21T07:11:14.651022+0000","last_became_active":"2024-09-21T07:11:00.557738+0000","last_became_peered":"2024-09-21T07:11:00.557738+0000","last_unstale":"2024-09-21T07:11:14.651022+0000","last_undegraded":"2024-09-21T07:11:14.651022+0000","last_fullsized":"2024-09-21T07:11:14.651022+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:03.037820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.736671+0000","last_change":"2024-09-21T07:10:51.464283+0000","last_active":"2024-09-21T07:11:32.736671+0000","last_peered":"2024-09-21T07:11:32.736671+0000","last_clean":"2024-09-21T07:11:32.736671+0000","last_became_active":"2024-09-21T07:10:51.463783+0000","last_became_peered":"2024-09-21T07:10:51.463783+0000","last_unstale":"2024-09-21T07:11:32.736671+0000","last_undegraded":"2024-09-21T07:11:32.736671+0000","last_fullsized":"2024-09-21T07:11:32.736671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:45.298654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671587+0000","last_change":"2024-09-21T07:11:14.671020+0000","last_active":"2024-09-21T07:11:14.671587+0000","last_peered":"2024-09-21T07:11:14.671587+0000","last_clean":"2024-09-21T07:11:14.671587+0000","last_became_active":"2024-09-21T07:11:14.670573+0000","last_became_peered":"2024-09-21T07:11:14.670573+0000","last_unstale":"2024-09-21T07:11:14.671587+0000","last_undegraded":"2024-09-21T07:11:14.671587+0000","last_fullsized":"2024-09-21T07:11:14.671587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.926304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650248+0000","last_change":"2024-09-21T07:11:00.549015+0000","last_active":"2024-09-21T07:11:14.650248+0000","last_peered":"2024-09-21T07:11:14.650248+0000","last_clean":"2024-09-21T07:11:14.650248+0000","last_became_active":"2024-09-21T07:11:00.548561+0000","last_became_peered":"2024-09-21T07:11:00.548561+0000","last_unstale":"2024-09-21T07:11:14.650248+0000","last_undegraded":"2024-09-21T07:11:14.650248+0000","last_fullsized":"2024-09-21T07:11:14.650248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:08.386214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653580+0000","last_change":"2024-09-21T07:10:53.489382+0000","last_active":"2024-09-21T07:11:14.653580+0000","last_peered":"2024-09-21T07:11:14.653580+0000","last_clean":"2024-09-21T07:11:14.653580+0000","last_became_active":"2024-09-21T07:10:53.488987+0000","last_became_peered":"2024-09-21T07:10:53.488987+0000","last_unstale":"2024-09-21T07:11:14.653580+0000","last_undegraded":"2024-09-21T07:11:14.653580+0000","last_fullsized":"2024-09-21T07:11:14.653580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.334840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:29.712256+0000","last_change":"2024-09-21T07:10:51.467203+0000","last_active":"2024-09-21T07:11:29.712256+0000","last_peered":"2024-09-21T07:11:29.712256+0000","last_clean":"2024-09-21T07:11:29.712256+0000","last_became_active":"2024-09-21T07:10:51.466737+0000","last_became_peered":"2024-09-21T07:10:51.466737+0000","last_unstale":"2024-09-21T07:11:29.712256+0000","last_undegraded":"2024-09-21T07:11:29.712256+0000","last_fullsized":"2024-09-21T07:11:29.712256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:26.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650890+0000","last_change":"2024-09-21T07:11:00.640801+0000","last_active":"2024-09-21T07:11:14.650890+0000","last_peered":"2024-09-21T07:11:14.650890+0000","last_clean":"2024-09-21T07:11:14.650890+0000","last_became_active":"2024-09-21T07:11:00.640213+0000","last_became_peered":"2024-09-21T07:11:00.640213+0000","last_unstale":"2024-09-21T07:11:14.650890+0000","last_undegraded":"2024-09-21T07:11:14.650890+0000","last_fullsized":"2024-09-21T07:11:14.650890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:55.801831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670363+0000","last_change":"2024-09-21T07:10:53.491166+0000","last_active":"2024-09-21T07:11:14.670363+0000","last_peered":"2024-09-21T07:11:14.670363+0000","last_clean":"2024-09-21T07:11:14.670363+0000","last_became_active":"2024-09-21T07:10:53.490823+0000","last_became_peered":"2024-09-21T07:10:53.490823+0000","last_unstale":"2024-09-21T07:11:14.670363+0000","last_undegraded":"2024-09-21T07:11:14.670363+0000","last_fullsized":"2024-09-21T07:11:14.670363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:48.661634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:31.726028+0000","last_change":"2024-09-21T07:10:51.461220+0000","last_active":"2024-09-21T07:11:31.726028+0000","last_peered":"2024-09-21T07:11:31.726028+0000","last_clean":"2024-09-21T07:11:31.726028+0000","last_became_active":"2024-09-21T07:10:51.460772+0000","last_became_peered":"2024-09-21T07:10:51.460772+0000","last_unstale":"2024-09-21T07:11:31.726028+0000","last_undegraded":"2024-09-21T07:11:31.726028+0000","last_fullsized":"2024-09-21T07:11:31.726028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:56.488273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650843+0000","last_change":"2024-09-21T07:11:00.558487+0000","last_active":"2024-09-21T07:11:14.650843+0000","last_peered":"2024-09-21T07:11:14.650843+0000","last_clean":"2024-09-21T07:11:14.650843+0000","last_became_active":"2024-09-21T07:11:00.557877+0000","last_became_peered":"2024-09-21T07:11:00.557877+0000","last_unstale":"2024-09-21T07:11:14.650843+0000","last_undegraded":"2024-09-21T07:11:14.650843+0000","last_fullsized":"2024-09-21T07:11:14.650843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:14.614603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654321+0000","last_change":"2024-09-21T07:10:53.489309+0000","last_active":"2024-09-21T07:11:14.654321+0000","last_peered":"2024-09-21T07:11:14.654321+0000","last_clean":"2024-09-21T07:11:14.654321+0000","last_became_active":"2024-09-21T07:10:53.488943+0000","last_became_peered":"2024-09-21T07:10:53.488943+0000","last_unstale":"2024-09-21T07:11:14.654321+0000","last_undegraded":"2024-09-21T07:11:14.654321+0000","last_fullsized":"2024-09-21T07:11:14.654321+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.797176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.734172+0000","last_change":"2024-09-21T07:10:51.461078+0000","last_active":"2024-09-21T07:11:32.734172+0000","last_peered":"2024-09-21T07:11:32.734172+0000","last_clean":"2024-09-21T07:11:32.734172+0000","last_became_active":"2024-09-21T07:10:51.460759+0000","last_became_peered":"2024-09-21T07:10:51.460759+0000","last_unstale":"2024-09-21T07:11:32.734172+0000","last_undegraded":"2024-09-21T07:11:32.734172+0000","last_fullsized":"2024-09-21T07:11:32.734172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:37.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650360+0000","last_change":"2024-09-21T07:11:00.554766+0000","last_active":"2024-09-21T07:11:14.650360+0000","last_peered":"2024-09-21T07:11:14.650360+0000","last_clean":"2024-09-21T07:11:14.650360+0000","last_became_active":"2024-09-21T07:11:00.554374+0000","last_became_peered":"2024-09-21T07:11:00.554374+0000","last_unstale":"2024-09-21T07:11:14.650360+0000","last_undegraded":"2024-09-21T07:11:14.650360+0000","last_fullsized":"2024-09-21T07:11:14.650360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:47.038411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651978+0000","last_change":"2024-09-21T07:10:53.487501+0000","last_active":"2024-09-21T07:11:14.651978+0000","last_peered":"2024-09-21T07:11:14.651978+0000","last_clean":"2024-09-21T07:11:14.651978+0000","last_became_active":"2024-09-21T07:10:53.487030+0000","last_became_peered":"2024-09-21T07:10:53.487030+0000","last_unstale":"2024-09-21T07:11:14.651978+0000","last_undegraded":"2024-09-21T07:11:14.651978+0000","last_fullsized":"2024-09-21T07:11:14.651978+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:29.709752+0000","last_change":"2024-09-21T07:10:51.468155+0000","last_active":"2024-09-21T07:11:29.709752+0000","last_peered":"2024-09-21T07:11:29.709752+0000","last_clean":"2024-09-21T07:11:29.709752+0000","last_became_active":"2024-09-21T07:10:51.467663+0000","last_became_peered":"2024-09-21T07:10:51.467663+0000","last_unstale":"2024-09-21T07:11:29.709752+0000","last_undegraded":"2024-09-21T07:11:29.709752+0000","last_fullsized":"2024-09-21T07:11:29.709752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:18.176519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650623+0000","last_change":"2024-09-21T07:11:00.641283+0000","last_active":"2024-09-21T07:11:14.650623+0000","last_peered":"2024-09-21T07:11:14.650623+0000","last_clean":"2024-09-21T07:11:14.650623+0000","last_became_active":"2024-09-21T07:11:00.640715+0000","last_became_peered":"2024-09-21T07:11:00.640715+0000","last_unstale":"2024-09-21T07:11:14.650623+0000","last_undegraded":"2024-09-21T07:11:14.650623+0000","last_fullsized":"2024-09-21T07:11:14.650623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:26.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.656801+0000","last_change":"2024-09-21T07:11:14.656686+0000","last_active":"2024-09-21T07:11:14.656801+0000","last_peered":"2024-09-21T07:11:14.656801+0000","last_clean":"2024-09-21T07:11:14.656801+0000","last_became_active":"2024-09-21T07:11:14.656259+0000","last_became_peered":"2024-09-21T07:11:14.656259+0000","last_unstale":"2024-09-21T07:11:14.656801+0000","last_undegraded":"2024-09-21T07:11:14.656801+0000","last_fullsized":"2024-09-21T07:11:14.656801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:16.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.734017+0000","last_change":"2024-09-21T07:10:52.123260+0000","last_active":"2024-09-21T07:11:32.734017+0000","last_peered":"2024-09-21T07:11:32.734017+0000","last_clean":"2024-09-21T07:11:32.734017+0000","last_became_active":"2024-09-21T07:10:52.122752+0000","last_became_peered":"2024-09-21T07:10:52.122752+0000","last_unstale":"2024-09-21T07:11:32.734017+0000","last_undegraded":"2024-09-21T07:11:32.734017+0000","last_fullsized":"2024-09-21T07:11:32.734017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.041434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650398+0000","last_change":"2024-09-21T07:11:00.549599+0000","last_active":"2024-09-21T07:11:14.650398+0000","last_peered":"2024-09-21T07:11:14.650398+0000","last_clean":"2024-09-21T07:11:14.650398+0000","last_became_active":"2024-09-21T07:11:00.549112+0000","last_became_peered":"2024-09-21T07:11:00.549112+0000","last_unstale":"2024-09-21T07:11:14.650398+0000","last_undegraded":"2024-09-21T07:11:14.650398+0000","last_fullsized":"2024-09-21T07:11:14.650398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:15.209889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671595+0000","last_change":"2024-09-21T07:10:53.487792+0000","last_active":"2024-09-21T07:11:14.671595+0000","last_peered":"2024-09-21T07:11:14.671595+0000","last_clean":"2024-09-21T07:11:14.671595+0000","last_became_active":"2024-09-21T07:10:53.487460+0000","last_became_peered":"2024-09-21T07:10:53.487460+0000","last_unstale":"2024-09-21T07:11:14.671595+0000","last_undegraded":"2024-09-21T07:11:14.671595+0000","last_fullsized":"2024-09-21T07:11:14.671595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:26.329878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:40.499133+0000","last_change":"2024-09-21T07:10:51.461967+0000","last_active":"2024-09-21T07:11:40.499133+0000","last_peered":"2024-09-21T07:11:40.499133+0000","last_clean":"2024-09-21T07:11:40.499133+0000","last_became_active":"2024-09-21T07:10:51.461564+0000","last_became_peered":"2024-09-21T07:10:51.461564+0000","last_unstale":"2024-09-21T07:11:40.499133+0000","last_undegraded":"2024-09-21T07:11:40.499133+0000","last_fullsized":"2024-09-21T07:11:40.499133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:37.211264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669424+0000","last_change":"2024-09-21T07:11:00.640604+0000","last_active":"2024-09-21T07:11:14.669424+0000","last_peered":"2024-09-21T07:11:14.669424+0000","last_clean":"2024-09-21T07:11:14.669424+0000","last_became_active":"2024-09-21T07:11:00.640047+0000","last_became_peered":"2024-09-21T07:11:00.640047+0000","last_unstale":"2024-09-21T07:11:14.669424+0000","last_undegraded":"2024-09-21T07:11:14.669424+0000","last_fullsized":"2024-09-21T07:11:14.669424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:42.640908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670490+0000","last_change":"2024-09-21T07:10:53.473862+0000","last_active":"2024-09-21T07:11:14.670490+0000","last_peered":"2024-09-21T07:11:14.670490+0000","last_clean":"2024-09-21T07:11:14.670490+0000","last_became_active":"2024-09-21T07:10:53.473526+0000","last_became_peered":"2024-09-21T07:10:53.473526+0000","last_unstale":"2024-09-21T07:11:14.670490+0000","last_undegraded":"2024-09-21T07:11:14.670490+0000","last_fullsized":"2024-09-21T07:11:14.670490+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.389566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.736420+0000","last_change":"2024-09-21T07:10:51.468003+0000","last_active":"2024-09-21T07:11:32.736420+0000","last_peered":"2024-09-21T07:11:32.736420+0000","last_clean":"2024-09-21T07:11:32.736420+0000","last_became_active":"2024-09-21T07:10:51.467603+0000","last_became_peered":"2024-09-21T07:10:51.467603+0000","last_unstale":"2024-09-21T07:11:32.736420+0000","last_undegraded":"2024-09-21T07:11:32.736420+0000","last_fullsized":"2024-09-21T07:11:32.736420+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:02.148721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.655132+0000","last_change":"2024-09-21T07:11:00.550434+0000","last_active":"2024-09-21T07:11:14.655132+0000","last_peered":"2024-09-21T07:11:14.655132+0000","last_clean":"2024-09-21T07:11:14.655132+0000","last_became_active":"2024-09-21T07:11:00.549949+0000","last_became_peered":"2024-09-21T07:11:00.549949+0000","last_unstale":"2024-09-21T07:11:14.655132+0000","last_undegraded":"2024-09-21T07:11:14.655132+0000","last_fullsized":"2024-09-21T07:11:14.655132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:53.737978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.656028+0000","last_change":"2024-09-21T07:10:53.487550+0000","last_active":"2024-09-21T07:11:14.656028+0000","last_peered":"2024-09-21T07:11:14.656028+0000","last_clean":"2024-09-21T07:11:14.656028+0000","last_became_active":"2024-09-21T07:10:53.487073+0000","last_became_peered":"2024-09-21T07:10:53.487073+0000","last_unstale":"2024-09-21T07:11:14.656028+0000","last_undegraded":"2024-09-21T07:11:14.656028+0000","last_fullsized":"2024-09-21T07:11:14.656028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:48.841264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.649978+0000","last_change":"2024-09-21T07:10:51.468201+0000","last_active":"2024-09-21T07:11:14.649978+0000","last_peered":"2024-09-21T07:11:14.649978+0000","last_clean":"2024-09-21T07:11:14.649978+0000","last_became_active":"2024-09-21T07:10:51.467754+0000","last_became_peered":"2024-09-21T07:10:51.467754+0000","last_unstale":"2024-09-21T07:11:14.649978+0000","last_undegraded":"2024-09-21T07:11:14.649978+0000","last_fullsized":"2024-09-21T07:11:14.649978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:52.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651986+0000","last_change":"2024-09-21T07:11:00.640653+0000","last_active":"2024-09-21T07:11:14.651986+0000","last_peered":"2024-09-21T07:11:14.651986+0000","last_clean":"2024-09-21T07:11:14.651986+0000","last_became_active":"2024-09-21T07:11:00.640080+0000","last_became_peered":"2024-09-21T07:11:00.640080+0000","last_unstale":"2024-09-21T07:11:14.651986+0000","last_undegraded":"2024-09-21T07:11:14.651986+0000","last_fullsized":"2024-09-21T07:11:14.651986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:24.124088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654470+0000","last_change":"2024-09-21T07:10:53.494222+0000","last_active":"2024-09-21T07:11:14.654470+0000","last_peered":"2024-09-21T07:11:14.654470+0000","last_clean":"2024-09-21T07:11:14.654470+0000","last_became_active":"2024-09-21T07:10:53.493703+0000","last_became_peered":"2024-09-21T07:10:53.493703+0000","last_unstale":"2024-09-21T07:11:14.654470+0000","last_undegraded":"2024-09-21T07:11:14.654470+0000","last_fullsized":"2024-09-21T07:11:14.654470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:21.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:42.760387+0000","last_change":"2024-09-21T07:10:51.461095+0000","last_active":"2024-09-21T07:11:42.760387+0000","last_peered":"2024-09-21T07:11:42.760387+0000","last_clean":"2024-09-21T07:11:42.760387+0000","last_became_active":"2024-09-21T07:10:51.460738+0000","last_became_peered":"2024-09-21T07:10:51.460738+0000","last_unstale":"2024-09-21T07:11:42.760387+0000","last_undegraded":"2024-09-21T07:11:42.760387+0000","last_fullsized":"2024-09-21T07:11:42.760387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:55.593391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670153+0000","last_change":"2024-09-21T07:11:00.544788+0000","last_active":"2024-09-21T07:11:14.670153+0000","last_peered":"2024-09-21T07:11:14.670153+0000","last_clean":"2024-09-21T07:11:14.670153+0000","last_became_active":"2024-09-21T07:11:00.544370+0000","last_became_peered":"2024-09-21T07:11:00.544370+0000","last_unstale":"2024-09-21T07:11:14.670153+0000","last_undegraded":"2024-09-21T07:11:14.670153+0000","last_fullsized":"2024-09-21T07:11:14.670153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.154867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669853+0000","last_change":"2024-09-21T07:10:53.486715+0000","last_active":"2024-09-21T07:11:14.669853+0000","last_peered":"2024-09-21T07:11:14.669853+0000","last_clean":"2024-09-21T07:11:14.669853+0000","last_became_active":"2024-09-21T07:10:53.486315+0000","last_became_peered":"2024-09-21T07:10:53.486315+0000","last_unstale":"2024-09-21T07:11:14.669853+0000","last_undegraded":"2024-09-21T07:11:14.669853+0000","last_fullsized":"2024-09-21T07:11:14.669853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:00.124269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:39.754970+0000","last_change":"2024-09-21T07:10:51.467102+0000","last_active":"2024-09-21T07:11:39.754970+0000","last_peered":"2024-09-21T07:11:39.754970+0000","last_clean":"2024-09-21T07:11:39.754970+0000","last_became_active":"2024-09-21T07:10:51.466721+0000","last_became_peered":"2024-09-21T07:10:51.466721+0000","last_unstale":"2024-09-21T07:11:39.754970+0000","last_undegraded":"2024-09-21T07:11:39.754970+0000","last_fullsized":"2024-09-21T07:11:39.754970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670481+0000","last_change":"2024-09-21T07:11:00.640622+0000","last_active":"2024-09-21T07:11:14.670481+0000","last_peered":"2024-09-21T07:11:14.670481+0000","last_clean":"2024-09-21T07:11:14.670481+0000","last_became_active":"2024-09-21T07:11:00.640104+0000","last_became_peered":"2024-09-21T07:11:00.640104+0000","last_unstale":"2024-09-21T07:11:14.670481+0000","last_undegraded":"2024-09-21T07:11:14.670481+0000","last_fullsized":"2024-09-21T07:11:14.670481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:12.023561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669912+0000","last_change":"2024-09-21T07:10:53.478175+0000","last_active":"2024-09-21T07:11:14.669912+0000","last_peered":"2024-09-21T07:11:14.669912+0000","last_clean":"2024-09-21T07:11:14.669912+0000","last_became_active":"2024-09-21T07:10:53.477831+0000","last_became_peered":"2024-09-21T07:10:53.477831+0000","last_unstale":"2024-09-21T07:11:14.669912+0000","last_undegraded":"2024-09-21T07:11:14.669912+0000","last_fullsized":"2024-09-21T07:11:14.669912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:27.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:30.713919+0000","last_change":"2024-09-21T07:10:51.466318+0000","last_active":"2024-09-21T07:11:30.713919+0000","last_peered":"2024-09-21T07:11:30.713919+0000","last_clean":"2024-09-21T07:11:30.713919+0000","last_became_active":"2024-09-21T07:10:51.465983+0000","last_became_peered":"2024-09-21T07:10:51.465983+0000","last_unstale":"2024-09-21T07:11:30.713919+0000","last_undegraded":"2024-09-21T07:11:30.713919+0000","last_fullsized":"2024-09-21T07:11:30.713919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:08.432949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670591+0000","last_change":"2024-09-21T07:11:00.641364+0000","last_active":"2024-09-21T07:11:14.670591+0000","last_peered":"2024-09-21T07:11:14.670591+0000","last_clean":"2024-09-21T07:11:14.670591+0000","last_became_active":"2024-09-21T07:11:00.640879+0000","last_became_peered":"2024-09-21T07:11:00.640879+0000","last_unstale":"2024-09-21T07:11:14.670591+0000","last_undegraded":"2024-09-21T07:11:14.670591+0000","last_fullsized":"2024-09-21T07:11:14.670591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:16.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670934+0000","last_change":"2024-09-21T07:10:53.483709+0000","last_active":"2024-09-21T07:11:14.670934+0000","last_peered":"2024-09-21T07:11:14.670934+0000","last_clean":"2024-09-21T07:11:14.670934+0000","last_became_active":"2024-09-21T07:10:53.483355+0000","last_became_peered":"2024-09-21T07:10:53.483355+0000","last_unstale":"2024-09-21T07:11:14.670934+0000","last_undegraded":"2024-09-21T07:11:14.670934+0000","last_fullsized":"2024-09-21T07:11:14.670934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.702168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:33.743210+0000","last_change":"2024-09-21T07:10:51.464239+0000","last_active":"2024-09-21T07:11:33.743210+0000","last_peered":"2024-09-21T07:11:33.743210+0000","last_clean":"2024-09-21T07:11:33.743210+0000","last_became_active":"2024-09-21T07:10:51.463828+0000","last_became_peered":"2024-09-21T07:10:51.463828+0000","last_unstale":"2024-09-21T07:11:33.743210+0000","last_undegraded":"2024-09-21T07:11:33.743210+0000","last_fullsized":"2024-09-21T07:11:33.743210+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:09.580668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":109,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653190+0000","last_change":"2024-09-21T07:09:39.332523+0000","last_active":"2024-09-21T07:11:14.653190+0000","last_peered":"2024-09-21T07:11:14.653190+0000","last_clean":"2024-09-21T07:11:14.653190+0000","last_became_active":"2024-09-21T07:09:39.326582+0000","last_became_peered":"2024-09-21T07:09:39.326582+0000","last_unstale":"2024-09-21T07:11:14.653190+0000","last_undegraded":"2024-09-21T07:11:14.653190+0000","last_fullsized":"2024-09-21T07:11:14.653190+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_clean_scrub_stamp":"2024-09-21T07:06:12.748818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.672710+0000","last_change":"2024-09-21T07:11:14.672044+0000","last_active":"2024-09-21T07:11:14.672710+0000","last_peered":"2024-09-21T07:11:14.672710+0000","last_clean":"2024-09-21T07:11:14.672710+0000","last_became_active":"2024-09-21T07:11:14.671513+0000","last_became_peered":"2024-09-21T07:11:14.671513+0000","last_unstale":"2024-09-21T07:11:14.672710+0000","last_undegraded":"2024-09-21T07:11:14.672710+0000","last_fullsized":"2024-09-21T07:11:14.672710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:09.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653435+0000","last_change":"2024-09-21T07:10:53.488678+0000","last_active":"2024-09-21T07:11:14.653435+0000","last_peered":"2024-09-21T07:11:14.653435+0000","last_clean":"2024-09-21T07:11:14.653435+0000","last_became_active":"2024-09-21T07:10:53.488304+0000","last_became_peered":"2024-09-21T07:10:53.488304+0000","last_unstale":"2024-09-21T07:11:14.653435+0000","last_undegraded":"2024-09-21T07:11:14.653435+0000","last_fullsized":"2024-09-21T07:11:14.653435+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:37.696269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:40.758020+0000","last_change":"2024-09-21T07:10:52.123086+0000","last_active":"2024-09-21T07:11:40.758020+0000","last_peered":"2024-09-21T07:11:40.758020+0000","last_clean":"2024-09-21T07:11:40.758020+0000","last_became_active":"2024-09-21T07:10:52.122584+0000","last_became_peered":"2024-09-21T07:10:52.122584+0000","last_unstale":"2024-09-21T07:11:40.758020+0000","last_undegraded":"2024-09-21T07:11:40.758020+0000","last_fullsized":"2024-09-21T07:11:40.758020+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:28.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669266+0000","last_change":"2024-09-21T07:11:00.549595+0000","last_active":"2024-09-21T07:11:14.669266+0000","last_peered":"2024-09-21T07:11:14.669266+0000","last_clean":"2024-09-21T07:11:14.669266+0000","last_became_active":"2024-09-21T07:11:00.549009+0000","last_became_peered":"2024-09-21T07:11:00.549009+0000","last_unstale":"2024-09-21T07:11:14.669266+0000","last_undegraded":"2024-09-21T07:11:14.669266+0000","last_fullsized":"2024-09-21T07:11:14.669266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:59.825381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654167+0000","last_change":"2024-09-21T07:10:53.484336+0000","last_active":"2024-09-21T07:11:14.654167+0000","last_peered":"2024-09-21T07:11:14.654167+0000","last_clean":"2024-09-21T07:11:14.654167+0000","last_became_active":"2024-09-21T07:10:53.483825+0000","last_became_peered":"2024-09-21T07:10:53.483825+0000","last_unstale":"2024-09-21T07:11:14.654167+0000","last_undegraded":"2024-09-21T07:11:14.654167+0000","last_fullsized":"2024-09-21T07:11:14.654167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.545339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.734722+0000","last_change":"2024-09-21T07:10:51.461297+0000","last_active":"2024-09-21T07:11:32.734722+0000","last_peered":"2024-09-21T07:11:32.734722+0000","last_clean":"2024-09-21T07:11:32.734722+0000","last_became_active":"2024-09-21T07:10:51.460600+0000","last_became_peered":"2024-09-21T07:10:51.460600+0000","last_unstale":"2024-09-21T07:11:32.734722+0000","last_undegraded":"2024-09-21T07:11:32.734722+0000","last_fullsized":"2024-09-21T07:11:32.734722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:34.955250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652059+0000","last_change":"2024-09-21T07:11:00.551652+0000","last_active":"2024-09-21T07:11:14.652059+0000","last_peered":"2024-09-21T07:11:14.652059+0000","last_clean":"2024-09-21T07:11:14.652059+0000","last_became_active":"2024-09-21T07:11:00.551236+0000","last_became_peered":"2024-09-21T07:11:00.551236+0000","last_unstale":"2024-09-21T07:11:14.652059+0000","last_undegraded":"2024-09-21T07:11:14.652059+0000","last_fullsized":"2024-09-21T07:11:14.652059+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:28.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654402+0000","last_change":"2024-09-21T07:10:53.487605+0000","last_active":"2024-09-21T07:11:14.654402+0000","last_peered":"2024-09-21T07:11:14.654402+0000","last_clean":"2024-09-21T07:11:14.654402+0000","last_became_active":"2024-09-21T07:10:53.487245+0000","last_became_peered":"2024-09-21T07:10:53.487245+0000","last_unstale":"2024-09-21T07:11:14.654402+0000","last_undegraded":"2024-09-21T07:11:14.654402+0000","last_fullsized":"2024-09-21T07:11:14.654402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:24.490652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.733282+0000","last_change":"2024-09-21T07:10:51.456920+0000","last_active":"2024-09-21T07:11:32.733282+0000","last_peered":"2024-09-21T07:11:32.733282+0000","last_clean":"2024-09-21T07:11:32.733282+0000","last_became_active":"2024-09-21T07:10:51.456500+0000","last_became_peered":"2024-09-21T07:10:51.456500+0000","last_unstale":"2024-09-21T07:11:32.733282+0000","last_undegraded":"2024-09-21T07:11:32.733282+0000","last_fullsized":"2024-09-21T07:11:32.733282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:07.663192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669421+0000","last_change":"2024-09-21T07:11:00.552115+0000","last_active":"2024-09-21T07:11:14.669421+0000","last_peered":"2024-09-21T07:11:14.669421+0000","last_clean":"2024-09-21T07:11:14.669421+0000","last_became_active":"2024-09-21T07:11:00.551647+0000","last_became_peered":"2024-09-21T07:11:00.551647+0000","last_unstale":"2024-09-21T07:11:14.669421+0000","last_undegraded":"2024-09-21T07:11:14.669421+0000","last_fullsized":"2024-09-21T07:11:14.669421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:13.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671859+0000","last_change":"2024-09-21T07:11:14.671714+0000","last_active":"2024-09-21T07:11:14.671859+0000","last_peered":"2024-09-21T07:11:14.671859+0000","last_clean":"2024-09-21T07:11:14.671859+0000","last_became_active":"2024-09-21T07:11:14.671248+0000","last_became_peered":"2024-09-21T07:11:14.671248+0000","last_unstale":"2024-09-21T07:11:14.671859+0000","last_undegraded":"2024-09-21T07:11:14.671859+0000","last_fullsized":"2024-09-21T07:11:14.671859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:36.599916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.709074+0000","last_change":"2024-09-21T07:10:51.464710+0000","last_active":"2024-09-21T07:11:32.709074+0000","last_peered":"2024-09-21T07:11:32.709074+0000","last_clean":"2024-09-21T07:11:32.709074+0000","last_became_active":"2024-09-21T07:10:51.464295+0000","last_became_peered":"2024-09-21T07:10:51.464295+0000","last_unstale":"2024-09-21T07:11:32.709074+0000","last_undegraded":"2024-09-21T07:11:32.709074+0000","last_fullsized":"2024-09-21T07:11:32.709074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:00.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669859+0000","last_change":"2024-09-21T07:11:00.548275+0000","last_active":"2024-09-21T07:11:14.669859+0000","last_peered":"2024-09-21T07:11:14.669859+0000","last_clean":"2024-09-21T07:11:14.669859+0000","last_became_active":"2024-09-21T07:11:00.547777+0000","last_became_peered":"2024-09-21T07:11:00.547777+0000","last_unstale":"2024-09-21T07:11:14.669859+0000","last_undegraded":"2024-09-21T07:11:14.669859+0000","last_fullsized":"2024-09-21T07:11:14.669859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:13.860131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670016+0000","last_change":"2024-09-21T07:10:53.494072+0000","last_active":"2024-09-21T07:11:14.670016+0000","last_peered":"2024-09-21T07:11:14.670016+0000","last_clean":"2024-09-21T07:11:14.670016+0000","last_became_active":"2024-09-21T07:10:53.493493+0000","last_became_peered":"2024-09-21T07:10:53.493493+0000","last_unstale":"2024-09-21T07:11:14.670016+0000","last_undegraded":"2024-09-21T07:11:14.670016+0000","last_fullsized":"2024-09-21T07:11:14.670016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.846641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.736728+0000","last_change":"2024-09-21T07:10:51.468145+0000","last_active":"2024-09-21T07:11:32.736728+0000","last_peered":"2024-09-21T07:11:32.736728+0000","last_clean":"2024-09-21T07:11:32.736728+0000","last_became_active":"2024-09-21T07:10:51.467757+0000","last_became_peered":"2024-09-21T07:10:51.467757+0000","last_unstale":"2024-09-21T07:11:32.736728+0000","last_undegraded":"2024-09-21T07:11:32.736728+0000","last_fullsized":"2024-09-21T07:11:32.736728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:39.150277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670481+0000","last_change":"2024-09-21T07:11:00.548394+0000","last_active":"2024-09-21T07:11:14.670481+0000","last_peered":"2024-09-21T07:11:14.670481+0000","last_clean":"2024-09-21T07:11:14.670481+0000","last_became_active":"2024-09-21T07:11:00.547972+0000","last_became_peered":"2024-09-21T07:11:00.547972+0000","last_unstale":"2024-09-21T07:11:14.670481+0000","last_undegraded":"2024-09-21T07:11:14.670481+0000","last_fullsized":"2024-09-21T07:11:14.670481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:35.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.659342+0000","last_change":"2024-09-21T07:11:14.659248+0000","last_active":"2024-09-21T07:11:14.659342+0000","last_peered":"2024-09-21T07:11:14.659342+0000","last_clean":"2024-09-21T07:11:14.659342+0000","last_became_active":"2024-09-21T07:11:14.658931+0000","last_became_peered":"2024-09-21T07:11:14.658931+0000","last_unstale":"2024-09-21T07:11:14.659342+0000","last_undegraded":"2024-09-21T07:11:14.659342+0000","last_fullsized":"2024-09-21T07:11:14.659342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:12.278964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:42.760205+0000","last_change":"2024-09-21T07:10:51.466302+0000","last_active":"2024-09-21T07:11:42.760205+0000","last_peered":"2024-09-21T07:11:42.760205+0000","last_clean":"2024-09-21T07:11:42.760205+0000","last_became_active":"2024-09-21T07:10:51.465906+0000","last_became_peered":"2024-09-21T07:10:51.465906+0000","last_unstale":"2024-09-21T07:11:42.760205+0000","last_undegraded":"2024-09-21T07:11:42.760205+0000","last_fullsized":"2024-09-21T07:11:42.760205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:39.616338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650405+0000","last_change":"2024-09-21T07:11:00.555600+0000","last_active":"2024-09-21T07:11:14.650405+0000","last_peered":"2024-09-21T07:11:14.650405+0000","last_clean":"2024-09-21T07:11:14.650405+0000","last_became_active":"2024-09-21T07:11:00.555203+0000","last_became_peered":"2024-09-21T07:11:00.555203+0000","last_unstale":"2024-09-21T07:11:14.650405+0000","last_undegraded":"2024-09-21T07:11:14.650405+0000","last_fullsized":"2024-09-21T07:11:14.650405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654049+0000","last_change":"2024-09-21T07:10:53.482493+0000","last_active":"2024-09-21T07:11:14.654049+0000","last_peered":"2024-09-21T07:11:14.654049+0000","last_clean":"2024-09-21T07:11:14.654049+0000","last_became_active":"2024-09-21T07:10:53.481310+0000","last_became_peered":"2024-09-21T07:10:53.481310+0000","last_unstale":"2024-09-21T07:11:14.654049+0000","last_undegraded":"2024-09-21T07:11:14.654049+0000","last_fullsized":"2024-09-21T07:11:14.654049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:41.288008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.735583+0000","last_change":"2024-09-21T07:10:51.468189+0000","last_active":"2024-09-21T07:11:32.735583+0000","last_peered":"2024-09-21T07:11:32.735583+0000","last_clean":"2024-09-21T07:11:32.735583+0000","last_became_active":"2024-09-21T07:10:51.467770+0000","last_became_peered":"2024-09-21T07:10:51.467770+0000","last_unstale":"2024-09-21T07:11:32.735583+0000","last_undegraded":"2024-09-21T07:11:32.735583+0000","last_fullsized":"2024-09-21T07:11:32.735583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:53.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654632+0000","last_change":"2024-09-21T07:11:00.556306+0000","last_active":"2024-09-21T07:11:14.654632+0000","last_peered":"2024-09-21T07:11:14.654632+0000","last_clean":"2024-09-21T07:11:14.654632+0000","last_became_active":"2024-09-21T07:11:00.555770+0000","last_became_peered":"2024-09-21T07:11:00.555770+0000","last_unstale":"2024-09-21T07:11:14.654632+0000","last_undegraded":"2024-09-21T07:11:14.654632+0000","last_fullsized":"2024-09-21T07:11:14.654632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:19.438869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670030+0000","last_change":"2024-09-21T07:10:53.485039+0000","last_active":"2024-09-21T07:11:14.670030+0000","last_peered":"2024-09-21T07:11:14.670030+0000","last_clean":"2024-09-21T07:11:14.670030+0000","last_became_active":"2024-09-21T07:10:53.484672+0000","last_became_peered":"2024-09-21T07:10:53.484672+0000","last_unstale":"2024-09-21T07:11:14.670030+0000","last_undegraded":"2024-09-21T07:11:14.670030+0000","last_fullsized":"2024-09-21T07:11:14.670030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:28.291602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:33.742702+0000","last_change":"2024-09-21T07:10:51.460119+0000","last_active":"2024-09-21T07:11:33.742702+0000","last_peered":"2024-09-21T07:11:33.742702+0000","last_clean":"2024-09-21T07:11:33.742702+0000","last_became_active":"2024-09-21T07:10:51.459690+0000","last_became_peered":"2024-09-21T07:10:51.459690+0000","last_unstale":"2024-09-21T07:11:33.742702+0000","last_undegraded":"2024-09-21T07:11:33.742702+0000","last_fullsized":"2024-09-21T07:11:33.742702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:15.213300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.672946+0000","last_change":"2024-09-21T07:11:14.672269+0000","last_active":"2024-09-21T07:11:14.672946+0000","last_peered":"2024-09-21T07:11:14.672946+0000","last_clean":"2024-09-21T07:11:14.672946+0000","last_became_active":"2024-09-21T07:11:14.671740+0000","last_became_peered":"2024-09-21T07:11:14.671740+0000","last_unstale":"2024-09-21T07:11:14.672946+0000","last_undegraded":"2024-09-21T07:11:14.672946+0000","last_fullsized":"2024-09-21T07:11:14.672946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.600585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652594+0000","last_change":"2024-09-21T07:10:53.487667+0000","last_active":"2024-09-21T07:11:14.652594+0000","last_peered":"2024-09-21T07:11:14.652594+0000","last_clean":"2024-09-21T07:11:14.652594+0000","last_became_active":"2024-09-21T07:10:53.487316+0000","last_became_peered":"2024-09-21T07:10:53.487316+0000","last_unstale":"2024-09-21T07:11:14.652594+0000","last_undegraded":"2024-09-21T07:11:14.652594+0000","last_fullsized":"2024-09-21T07:11:14.652594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:33.545631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'27","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:41.761059+0000","last_change":"2024-09-21T07:10:51.465172+0000","last_active":"2024-09-21T07:11:41.761059+0000","last_peered":"2024-09-21T07:11:41.761059+0000","last_clean":"2024-09-21T07:11:41.761059+0000","last_became_active":"2024-09-21T07:10:51.464655+0000","last_became_peered":"2024-09-21T07:10:51.464655+0000","last_unstale":"2024-09-21T07:11:41.761059+0000","last_undegraded":"2024-09-21T07:11:41.761059+0000","last_fullsized":"2024-09-21T07:11:41.761059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:02.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47481,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":58,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.672745+0000","last_change":"2024-09-21T07:11:14.671892+0000","last_active":"2024-09-21T07:11:14.672745+0000","last_peered":"2024-09-21T07:11:14.672745+0000","last_clean":"2024-09-21T07:11:14.672745+0000","last_became_active":"2024-09-21T07:11:14.671283+0000","last_became_peered":"2024-09-21T07:11:14.671283+0000","last_unstale":"2024-09-21T07:11:14.672745+0000","last_undegraded":"2024-09-21T07:11:14.672745+0000","last_fullsized":"2024-09-21T07:11:14.672745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:54.263127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669478+0000","last_change":"2024-09-21T07:10:53.491873+0000","last_active":"2024-09-21T07:11:14.669478+0000","last_peered":"2024-09-21T07:11:14.669478+0000","last_clean":"2024-09-21T07:11:14.669478+0000","last_became_active":"2024-09-21T07:10:53.491424+0000","last_became_peered":"2024-09-21T07:10:53.491424+0000","last_unstale":"2024-09-21T07:11:14.669478+0000","last_undegraded":"2024-09-21T07:11:14.669478+0000","last_fullsized":"2024-09-21T07:11:14.669478+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.145391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:31.724296+0000","last_change":"2024-09-21T07:10:51.469395+0000","last_active":"2024-09-21T07:11:31.724296+0000","last_peered":"2024-09-21T07:11:31.724296+0000","last_clean":"2024-09-21T07:11:31.724296+0000","last_became_active":"2024-09-21T07:10:51.469015+0000","last_became_peered":"2024-09-21T07:10:51.469015+0000","last_unstale":"2024-09-21T07:11:31.724296+0000","last_undegraded":"2024-09-21T07:11:31.724296+0000","last_fullsized":"2024-09-21T07:11:31.724296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.274950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650611+0000","last_change":"2024-09-21T07:11:00.553164+0000","last_active":"2024-09-21T07:11:14.650611+0000","last_peered":"2024-09-21T07:11:14.650611+0000","last_clean":"2024-09-21T07:11:14.650611+0000","last_became_active":"2024-09-21T07:11:00.551969+0000","last_became_peered":"2024-09-21T07:11:00.551969+0000","last_unstale":"2024-09-21T07:11:14.650611+0000","last_undegraded":"2024-09-21T07:11:14.650611+0000","last_fullsized":"2024-09-21T07:11:14.650611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:53.042065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653104+0000","last_change":"2024-09-21T07:10:53.497110+0000","last_active":"2024-09-21T07:11:14.653104+0000","last_peered":"2024-09-21T07:11:14.653104+0000","last_clean":"2024-09-21T07:11:14.653104+0000","last_became_active":"2024-09-21T07:10:53.496751+0000","last_became_peered":"2024-09-21T07:10:53.496751+0000","last_unstale":"2024-09-21T07:11:14.653104+0000","last_undegraded":"2024-09-21T07:11:14.653104+0000","last_fullsized":"2024-09-21T07:11:14.653104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.531652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.734491+0000","last_change":"2024-09-21T07:10:51.464615+0000","last_active":"2024-09-21T07:11:32.734491+0000","last_peered":"2024-09-21T07:11:32.734491+0000","last_clean":"2024-09-21T07:11:32.734491+0000","last_became_active":"2024-09-21T07:10:51.464258+0000","last_became_peered":"2024-09-21T07:10:51.464258+0000","last_unstale":"2024-09-21T07:11:32.734491+0000","last_undegraded":"2024-09-21T07:11:32.734491+0000","last_fullsized":"2024-09-21T07:11:32.734491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:45.993865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.658255+0000","last_change":"2024-09-21T07:11:14.655255+0000","last_active":"2024-09-21T07:11:14.658255+0000","last_peered":"2024-09-21T07:11:14.658255+0000","last_clean":"2024-09-21T07:11:14.658255+0000","last_became_active":"2024-09-21T07:11:14.654556+0000","last_became_peered":"2024-09-21T07:11:14.654556+0000","last_unstale":"2024-09-21T07:11:14.658255+0000","last_undegraded":"2024-09-21T07:11:14.658255+0000","last_fullsized":"2024-09-21T07:11:14.658255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:44.435834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669921+0000","last_change":"2024-09-21T07:10:53.484990+0000","last_active":"2024-09-21T07:11:14.669921+0000","last_peered":"2024-09-21T07:11:14.669921+0000","last_clean":"2024-09-21T07:11:14.669921+0000","last_became_active":"2024-09-21T07:10:53.484570+0000","last_became_peered":"2024-09-21T07:10:53.484570+0000","last_unstale":"2024-09-21T07:11:14.669921+0000","last_undegraded":"2024-09-21T07:11:14.669921+0000","last_fullsized":"2024-09-21T07:11:14.669921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:28.848203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:41.758692+0000","last_change":"2024-09-21T07:10:51.463378+0000","last_active":"2024-09-21T07:11:41.758692+0000","last_peered":"2024-09-21T07:11:41.758692+0000","last_clean":"2024-09-21T07:11:41.758692+0000","last_became_active":"2024-09-21T07:10:51.462961+0000","last_became_peered":"2024-09-21T07:10:51.462961+0000","last_unstale":"2024-09-21T07:11:41.758692+0000","last_undegraded":"2024-09-21T07:11:41.758692+0000","last_fullsized":"2024-09-21T07:11:41.758692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:22.637603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669649+0000","last_change":"2024-09-21T07:11:00.549758+0000","last_active":"2024-09-21T07:11:14.669649+0000","last_peered":"2024-09-21T07:11:14.669649+0000","last_clean":"2024-09-21T07:11:14.669649+0000","last_became_active":"2024-09-21T07:11:00.549141+0000","last_became_peered":"2024-09-21T07:11:00.549141+0000","last_unstale":"2024-09-21T07:11:14.669649+0000","last_undegraded":"2024-09-21T07:11:14.669649+0000","last_fullsized":"2024-09-21T07:11:14.669649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:27.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653112+0000","last_change":"2024-09-21T07:11:00.550407+0000","last_active":"2024-09-21T07:11:14.653112+0000","last_peered":"2024-09-21T07:11:14.653112+0000","last_clean":"2024-09-21T07:11:14.653112+0000","last_became_active":"2024-09-21T07:11:00.549930+0000","last_became_peered":"2024-09-21T07:11:00.549930+0000","last_unstale":"2024-09-21T07:11:14.653112+0000","last_undegraded":"2024-09-21T07:11:14.653112+0000","last_fullsized":"2024-09-21T07:11:14.653112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:25.924695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.649799+0000","last_change":"2024-09-21T07:10:53.491452+0000","last_active":"2024-09-21T07:11:14.649799+0000","last_peered":"2024-09-21T07:11:14.649799+0000","last_clean":"2024-09-21T07:11:14.649799+0000","last_became_active":"2024-09-21T07:10:53.491106+0000","last_became_peered":"2024-09-21T07:10:53.491106+0000","last_unstale":"2024-09-21T07:11:14.649799+0000","last_undegraded":"2024-09-21T07:11:14.649799+0000","last_fullsized":"2024-09-21T07:11:14.649799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:58.270323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.735396+0000","last_change":"2024-09-21T07:10:51.468433+0000","last_active":"2024-09-21T07:11:32.735396+0000","last_peered":"2024-09-21T07:11:32.735396+0000","last_clean":"2024-09-21T07:11:32.735396+0000","last_became_active":"2024-09-21T07:10:51.467810+0000","last_became_peered":"2024-09-21T07:10:51.467810+0000","last_unstale":"2024-09-21T07:11:32.735396+0000","last_undegraded":"2024-09-21T07:11:32.735396+0000","last_fullsized":"2024-09-21T07:11:32.735396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.787584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654415+0000","last_change":"2024-09-21T07:11:00.556866+0000","last_active":"2024-09-21T07:11:14.654415+0000","last_peered":"2024-09-21T07:11:14.654415+0000","last_clean":"2024-09-21T07:11:14.654415+0000","last_became_active":"2024-09-21T07:11:00.555350+0000","last_became_peered":"2024-09-21T07:11:00.555350+0000","last_unstale":"2024-09-21T07:11:14.654415+0000","last_undegraded":"2024-09-21T07:11:14.654415+0000","last_fullsized":"2024-09-21T07:11:14.654415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:46.296771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669637+0000","last_change":"2024-09-21T07:10:53.487210+0000","last_active":"2024-09-21T07:11:14.669637+0000","last_peered":"2024-09-21T07:11:14.669637+0000","last_clean":"2024-09-21T07:11:14.669637+0000","last_became_active":"2024-09-21T07:10:53.485975+0000","last_became_peered":"2024-09-21T07:10:53.485975+0000","last_unstale":"2024-09-21T07:11:14.669637+0000","last_undegraded":"2024-09-21T07:11:14.669637+0000","last_fullsized":"2024-09-21T07:11:14.669637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:30.713990+0000","last_change":"2024-09-21T07:10:51.456418+0000","last_active":"2024-09-21T07:11:30.713990+0000","last_peered":"2024-09-21T07:11:30.713990+0000","last_clean":"2024-09-21T07:11:30.713990+0000","last_became_active":"2024-09-21T07:10:51.455885+0000","last_became_peered":"2024-09-21T07:10:51.455885+0000","last_unstale":"2024-09-21T07:11:30.713990+0000","last_undegraded":"2024-09-21T07:11:30.713990+0000","last_fullsized":"2024-09-21T07:11:30.713990+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:53.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:31.725529+0000","last_change":"2024-09-21T07:10:51.462544+0000","last_active":"2024-09-21T07:11:31.725529+0000","last_peered":"2024-09-21T07:11:31.725529+0000","last_clean":"2024-09-21T07:11:31.725529+0000","last_became_active":"2024-09-21T07:10:51.462075+0000","last_became_peered":"2024-09-21T07:10:51.462075+0000","last_unstale":"2024-09-21T07:11:31.725529+0000","last_undegraded":"2024-09-21T07:11:31.725529+0000","last_fullsized":"2024-09-21T07:11:31.725529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:09.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670214+0000","last_change":"2024-09-21T07:10:53.492369+0000","last_active":"2024-09-21T07:11:14.670214+0000","last_peered":"2024-09-21T07:11:14.670214+0000","last_clean":"2024-09-21T07:11:14.670214+0000","last_became_active":"2024-09-21T07:10:53.492011+0000","last_became_peered":"2024-09-21T07:10:53.492011+0000","last_unstale":"2024-09-21T07:11:14.670214+0000","last_undegraded":"2024-09-21T07:11:14.670214+0000","last_fullsized":"2024-09-21T07:11:14.670214+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:53.513277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650649+0000","last_change":"2024-09-21T07:11:00.552908+0000","last_active":"2024-09-21T07:11:14.650649+0000","last_peered":"2024-09-21T07:11:14.650649+0000","last_clean":"2024-09-21T07:11:14.650649+0000","last_became_active":"2024-09-21T07:11:00.552303+0000","last_became_peered":"2024-09-21T07:11:00.552303+0000","last_unstale":"2024-09-21T07:11:14.650649+0000","last_undegraded":"2024-09-21T07:11:14.650649+0000","last_fullsized":"2024-09-21T07:11:14.650649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:42.761134+0000","last_change":"2024-09-21T07:10:51.467072+0000","last_active":"2024-09-21T07:11:42.761134+0000","last_peered":"2024-09-21T07:11:42.761134+0000","last_clean":"2024-09-21T07:11:42.761134+0000","last_became_active":"2024-09-21T07:10:51.466671+0000","last_became_peered":"2024-09-21T07:10:51.466671+0000","last_unstale":"2024-09-21T07:11:42.761134+0000","last_undegraded":"2024-09-21T07:11:42.761134+0000","last_fullsized":"2024-09-21T07:11:42.761134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:24.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652141+0000","last_change":"2024-09-21T07:10:53.480057+0000","last_active":"2024-09-21T07:11:14.652141+0000","last_peered":"2024-09-21T07:11:14.652141+0000","last_clean":"2024-09-21T07:11:14.652141+0000","last_became_active":"2024-09-21T07:10:53.479644+0000","last_became_peered":"2024-09-21T07:10:53.479644+0000","last_unstale":"2024-09-21T07:11:14.652141+0000","last_undegraded":"2024-09-21T07:11:14.652141+0000","last_fullsized":"2024-09-21T07:11:14.652141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:34.255547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650784+0000","last_change":"2024-09-21T07:11:00.550259+0000","last_active":"2024-09-21T07:11:14.650784+0000","last_peered":"2024-09-21T07:11:14.650784+0000","last_clean":"2024-09-21T07:11:14.650784+0000","last_became_active":"2024-09-21T07:11:00.549771+0000","last_became_peered":"2024-09-21T07:11:00.549771+0000","last_unstale":"2024-09-21T07:11:14.650784+0000","last_undegraded":"2024-09-21T07:11:14.650784+0000","last_fullsized":"2024-09-21T07:11:14.650784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654149+0000","last_change":"2024-09-21T07:10:53.488022+0000","last_active":"2024-09-21T07:11:14.654149+0000","last_peered":"2024-09-21T07:11:14.654149+0000","last_clean":"2024-09-21T07:11:14.654149+0000","last_became_active":"2024-09-21T07:10:53.487605+0000","last_became_peered":"2024-09-21T07:10:53.487605+0000","last_unstale":"2024-09-21T07:11:14.654149+0000","last_undegraded":"2024-09-21T07:11:14.654149+0000","last_fullsized":"2024-09-21T07:11:14.654149+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:02.074960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650869+0000","last_change":"2024-09-21T07:10:53.484319+0000","last_active":"2024-09-21T07:11:14.650869+0000","last_peered":"2024-09-21T07:11:14.650869+0000","last_clean":"2024-09-21T07:11:14.650869+0000","last_became_active":"2024-09-21T07:10:53.483942+0000","last_became_peered":"2024-09-21T07:10:53.483942+0000","last_unstale":"2024-09-21T07:11:14.650869+0000","last_undegraded":"2024-09-21T07:11:14.650869+0000","last_fullsized":"2024-09-21T07:11:14.650869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:50.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650289+0000","last_change":"2024-09-21T07:10:53.494981+0000","last_active":"2024-09-21T07:11:14.650289+0000","last_peered":"2024-09-21T07:11:14.650289+0000","last_clean":"2024-09-21T07:11:14.650289+0000","last_became_active":"2024-09-21T07:10:53.494580+0000","last_became_peered":"2024-09-21T07:10:53.494580+0000","last_unstale":"2024-09-21T07:11:14.650289+0000","last_undegraded":"2024-09-21T07:11:14.650289+0000","last_fullsized":"2024-09-21T07:11:14.650289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:57.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652181+0000","last_change":"2024-09-21T07:10:53.492971+0000","last_active":"2024-09-21T07:11:14.652181+0000","last_peered":"2024-09-21T07:11:14.652181+0000","last_clean":"2024-09-21T07:11:14.652181+0000","last_became_active":"2024-09-21T07:10:53.492597+0000","last_became_peered":"2024-09-21T07:10:53.492597+0000","last_unstale":"2024-09-21T07:11:14.652181+0000","last_undegraded":"2024-09-21T07:11:14.652181+0000","last_fullsized":"2024-09-21T07:11:14.652181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.931998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670334+0000","last_change":"2024-09-21T07:10:53.485613+0000","last_active":"2024-09-21T07:11:14.670334+0000","last_peered":"2024-09-21T07:11:14.670334+0000","last_clean":"2024-09-21T07:11:14.670334+0000","last_became_active":"2024-09-21T07:10:53.485268+0000","last_became_peered":"2024-09-21T07:10:53.485268+0000","last_unstale":"2024-09-21T07:11:14.670334+0000","last_undegraded":"2024-09-21T07:11:14.670334+0000","last_fullsized":"2024-09-21T07:11:14.670334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:52.496426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.655118+0000","last_change":"2024-09-21T07:10:53.489349+0000","last_active":"2024-09-21T07:11:14.655118+0000","last_peered":"2024-09-21T07:11:14.655118+0000","last_clean":"2024-09-21T07:11:14.655118+0000","last_became_active":"2024-09-21T07:10:53.488986+0000","last_became_peered":"2024-09-21T07:10:53.488986+0000","last_unstale":"2024-09-21T07:11:14.655118+0000","last_undegraded":"2024-09-21T07:11:14.655118+0000","last_fullsized":"2024-09-21T07:11:14.655118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:46.376689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651080+0000","last_change":"2024-09-21T07:10:53.485740+0000","last_active":"2024-09-21T07:11:14.651080+0000","last_peered":"2024-09-21T07:11:14.651080+0000","last_clean":"2024-09-21T07:11:14.651080+0000","last_became_active":"2024-09-21T07:10:53.485375+0000","last_became_peered":"2024-09-21T07:10:53.485375+0000","last_unstale":"2024-09-21T07:11:14.651080+0000","last_undegraded":"2024-09-21T07:11:14.651080+0000","last_fullsized":"2024-09-21T07:11:14.651080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:40.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671496+0000","last_change":"2024-09-21T07:10:53.490211+0000","last_active":"2024-09-21T07:11:14.671496+0000","last_peered":"2024-09-21T07:11:14.671496+0000","last_clean":"2024-09-21T07:11:14.671496+0000","last_became_active":"2024-09-21T07:10:53.489504+0000","last_became_peered":"2024-09-21T07:10:53.489504+0000","last_unstale":"2024-09-21T07:11:14.671496+0000","last_undegraded":"2024-09-21T07:11:14.671496+0000","last_fullsized":"2024-09-21T07:11:14.671496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:50.337307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669771+0000","last_change":"2024-09-21T07:10:53.486064+0000","last_active":"2024-09-21T07:11:14.669771+0000","last_peered":"2024-09-21T07:11:14.669771+0000","last_clean":"2024-09-21T07:11:14.669771+0000","last_became_active":"2024-09-21T07:10:53.485674+0000","last_became_peered":"2024-09-21T07:10:53.485674+0000","last_unstale":"2024-09-21T07:11:14.669771+0000","last_undegraded":"2024-09-21T07:11:14.669771+0000","last_fullsized":"2024-09-21T07:11:14.669771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:55.232795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669833+0000","last_change":"2024-09-21T07:10:53.489008+0000","last_active":"2024-09-21T07:11:14.669833+0000","last_peered":"2024-09-21T07:11:14.669833+0000","last_clean":"2024-09-21T07:11:14.669833+0000","last_became_active":"2024-09-21T07:10:53.488655+0000","last_became_peered":"2024-09-21T07:10:53.488655+0000","last_unstale":"2024-09-21T07:11:14.669833+0000","last_undegraded":"2024-09-21T07:11:14.669833+0000","last_fullsized":"2024-09-21T07:11:14.669833+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:42.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669390+0000","last_change":"2024-09-21T07:10:53.490147+0000","last_active":"2024-09-21T07:11:14.669390+0000","last_peered":"2024-09-21T07:11:14.669390+0000","last_clean":"2024-09-21T07:11:14.669390+0000","last_became_active":"2024-09-21T07:10:53.488389+0000","last_became_peered":"2024-09-21T07:10:53.488389+0000","last_unstale":"2024-09-21T07:11:14.669390+0000","last_undegraded":"2024-09-21T07:11:14.669390+0000","last_fullsized":"2024-09-21T07:11:14.669390+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:17.729856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670191+0000","last_change":"2024-09-21T07:10:53.486557+0000","last_active":"2024-09-21T07:11:14.670191+0000","last_peered":"2024-09-21T07:11:14.670191+0000","last_clean":"2024-09-21T07:11:14.670191+0000","last_became_active":"2024-09-21T07:10:53.486248+0000","last_became_peered":"2024-09-21T07:10:53.486248+0000","last_unstale":"2024-09-21T07:11:14.670191+0000","last_undegraded":"2024-09-21T07:11:14.670191+0000","last_fullsized":"2024-09-21T07:11:14.670191+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.675717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654802+0000","last_change":"2024-09-21T07:10:53.485281+0000","last_active":"2024-09-21T07:11:14.654802+0000","last_peered":"2024-09-21T07:11:14.654802+0000","last_clean":"2024-09-21T07:11:14.654802+0000","last_became_active":"2024-09-21T07:10:53.484732+0000","last_became_peered":"2024-09-21T07:10:53.484732+0000","last_unstale":"2024-09-21T07:11:14.654802+0000","last_undegraded":"2024-09-21T07:11:14.654802+0000","last_fullsized":"2024-09-21T07:11:14.654802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:53.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651038+0000","last_change":"2024-09-21T07:10:53.483192+0000","last_active":"2024-09-21T07:11:14.651038+0000","last_peered":"2024-09-21T07:11:14.651038+0000","last_clean":"2024-09-21T07:11:14.651038+0000","last_became_active":"2024-09-21T07:10:53.482402+0000","last_became_peered":"2024-09-21T07:10:53.482402+0000","last_unstale":"2024-09-21T07:11:14.651038+0000","last_undegraded":"2024-09-21T07:11:14.651038+0000","last_fullsized":"2024-09-21T07:11:14.651038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.159873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650310+0000","last_change":"2024-09-21T07:10:53.481463+0000","last_active":"2024-09-21T07:11:14.650310+0000","last_peered":"2024-09-21T07:11:14.650310+0000","last_clean":"2024-09-21T07:11:14.650310+0000","last_became_active":"2024-09-21T07:10:53.481129+0000","last_became_peered":"2024-09-21T07:10:53.481129+0000","last_unstale":"2024-09-21T07:11:14.650310+0000","last_undegraded":"2024-09-21T07:11:14.650310+0000","last_fullsized":"2024-09-21T07:11:14.650310+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:14.547936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.655954+0000","last_change":"2024-09-21T07:10:53.493009+0000","last_active":"2024-09-21T07:11:14.655954+0000","last_peered":"2024-09-21T07:11:14.655954+0000","last_clean":"2024-09-21T07:11:14.655954+0000","last_became_active":"2024-09-21T07:10:53.492300+0000","last_became_peered":"2024-09-21T07:10:53.492300+0000","last_unstale":"2024-09-21T07:11:14.655954+0000","last_undegraded":"2024-09-21T07:11:14.655954+0000","last_fullsized":"2024-09-21T07:11:14.655954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:09.890248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669036+0000","last_change":"2024-09-21T07:10:53.491149+0000","last_active":"2024-09-21T07:11:14.669036+0000","last_peered":"2024-09-21T07:11:14.669036+0000","last_clean":"2024-09-21T07:11:14.669036+0000","last_became_active":"2024-09-21T07:10:53.490766+0000","last_became_peered":"2024-09-21T07:10:53.490766+0000","last_unstale":"2024-09-21T07:11:14.669036+0000","last_undegraded":"2024-09-21T07:11:14.669036+0000","last_fullsized":"2024-09-21T07:11:14.669036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:52.243083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.672557+0000","last_change":"2024-09-21T07:11:14.672453+0000","last_active":"2024-09-21T07:11:14.672557+0000","last_peered":"2024-09-21T07:11:14.672557+0000","last_clean":"2024-09-21T07:11:14.672557+0000","last_became_active":"2024-09-21T07:11:14.671584+0000","last_became_peered":"2024-09-21T07:11:14.671584+0000","last_unstale":"2024-09-21T07:11:14.672557+0000","last_undegraded":"2024-09-21T07:11:14.672557+0000","last_fullsized":"2024-09-21T07:11:14.672557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:25.746195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652222+0000","last_change":"2024-09-21T07:10:53.496332+0000","last_active":"2024-09-21T07:11:14.652222+0000","last_peered":"2024-09-21T07:11:14.652222+0000","last_clean":"2024-09-21T07:11:14.652222+0000","last_became_active":"2024-09-21T07:10:53.495078+0000","last_became_peered":"2024-09-21T07:10:53.495078+0000","last_unstale":"2024-09-21T07:11:14.652222+0000","last_undegraded":"2024-09-21T07:11:14.652222+0000","last_fullsized":"2024-09-21T07:11:14.652222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:32.415350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670093+0000","last_change":"2024-09-21T07:10:53.478381+0000","last_active":"2024-09-21T07:11:14.670093+0000","last_peered":"2024-09-21T07:11:14.670093+0000","last_clean":"2024-09-21T07:11:14.670093+0000","last_became_active":"2024-09-21T07:10:53.478021+0000","last_became_peered":"2024-09-21T07:10:53.478021+0000","last_unstale":"2024-09-21T07:11:14.670093+0000","last_undegraded":"2024-09-21T07:11:14.670093+0000","last_fullsized":"2024-09-21T07:11:14.670093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:02.496263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651079+0000","last_change":"2024-09-21T07:10:53.485103+0000","last_active":"2024-09-21T07:11:14.651079+0000","last_peered":"2024-09-21T07:11:14.651079+0000","last_clean":"2024-09-21T07:11:14.651079+0000","last_became_active":"2024-09-21T07:10:53.483835+0000","last_became_peered":"2024-09-21T07:10:53.483835+0000","last_unstale":"2024-09-21T07:11:14.651079+0000","last_undegraded":"2024-09-21T07:11:14.651079+0000","last_fullsized":"2024-09-21T07:11:14.651079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:47.775202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653303+0000","last_change":"2024-09-21T07:10:53.490497+0000","last_active":"2024-09-21T07:11:14.653303+0000","last_peered":"2024-09-21T07:11:14.653303+0000","last_clean":"2024-09-21T07:11:14.653303+0000","last_became_active":"2024-09-21T07:10:53.490137+0000","last_became_peered":"2024-09-21T07:10:53.490137+0000","last_unstale":"2024-09-21T07:11:14.653303+0000","last_undegraded":"2024-09-21T07:11:14.653303+0000","last_fullsized":"2024-09-21T07:11:14.653303+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:12.090628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.655486+0000","last_change":"2024-09-21T07:10:53.487118+0000","last_active":"2024-09-21T07:11:14.655486+0000","last_peered":"2024-09-21T07:11:14.655486+0000","last_clean":"2024-09-21T07:11:14.655486+0000","last_became_active":"2024-09-21T07:10:53.486582+0000","last_became_peered":"2024-09-21T07:10:53.486582+0000","last_unstale":"2024-09-21T07:11:14.655486+0000","last_undegraded":"2024-09-21T07:11:14.655486+0000","last_fullsized":"2024-09-21T07:11:14.655486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:00.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670066+0000","last_change":"2024-09-21T07:10:53.497390+0000","last_active":"2024-09-21T07:11:14.670066+0000","last_peered":"2024-09-21T07:11:14.670066+0000","last_clean":"2024-09-21T07:11:14.670066+0000","last_became_active":"2024-09-21T07:10:53.497043+0000","last_became_peered":"2024-09-21T07:10:53.497043+0000","last_unstale":"2024-09-21T07:11:14.670066+0000","last_undegraded":"2024-09-21T07:11:14.670066+0000","last_fullsized":"2024-09-21T07:11:14.670066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:36.912873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670105+0000","last_change":"2024-09-21T07:10:53.484624+0000","last_active":"2024-09-21T07:11:14.670105+0000","last_peered":"2024-09-21T07:11:14.670105+0000","last_clean":"2024-09-21T07:11:14.670105+0000","last_became_active":"2024-09-21T07:10:53.484278+0000","last_became_peered":"2024-09-21T07:10:53.484278+0000","last_unstale":"2024-09-21T07:11:14.670105+0000","last_undegraded":"2024-09-21T07:11:14.670105+0000","last_fullsized":"2024-09-21T07:11:14.670105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:41.464442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652894+0000","last_change":"2024-09-21T07:10:53.478146+0000","last_active":"2024-09-21T07:11:14.652894+0000","last_peered":"2024-09-21T07:11:14.652894+0000","last_clean":"2024-09-21T07:11:14.652894+0000","last_became_active":"2024-09-21T07:10:53.477733+0000","last_became_peered":"2024-09-21T07:10:53.477733+0000","last_unstale":"2024-09-21T07:11:14.652894+0000","last_undegraded":"2024-09-21T07:11:14.652894+0000","last_fullsized":"2024-09-21T07:11:14.652894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:09.159966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.657394+0000","last_change":"2024-09-21T07:11:14.657274+0000","last_active":"2024-09-21T07:11:14.657394+0000","last_peered":"2024-09-21T07:11:14.657394+0000","last_clean":"2024-09-21T07:11:14.657394+0000","last_became_active":"2024-09-21T07:11:14.656826+0000","last_became_peered":"2024-09-21T07:11:14.656826+0000","last_unstale":"2024-09-21T07:11:14.657394+0000","last_undegraded":"2024-09-21T07:11:14.657394+0000","last_fullsized":"2024-09-21T07:11:14.657394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.688373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652116+0000","last_change":"2024-09-21T07:10:53.481411+0000","last_active":"2024-09-21T07:11:14.652116+0000","last_peered":"2024-09-21T07:11:14.652116+0000","last_clean":"2024-09-21T07:11:14.652116+0000","last_became_active":"2024-09-21T07:10:53.481005+0000","last_became_peered":"2024-09-21T07:10:53.481005+0000","last_unstale":"2024-09-21T07:11:14.652116+0000","last_undegraded":"2024-09-21T07:11:14.652116+0000","last_fullsized":"2024-09-21T07:11:14.652116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:41.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651020+0000","last_change":"2024-09-21T07:10:53.487481+0000","last_active":"2024-09-21T07:11:14.651020+0000","last_peered":"2024-09-21T07:11:14.651020+0000","last_clean":"2024-09-21T07:11:14.651020+0000","last_became_active":"2024-09-21T07:10:53.486277+0000","last_became_peered":"2024-09-21T07:10:53.486277+0000","last_unstale":"2024-09-21T07:11:14.651020+0000","last_undegraded":"2024-09-21T07:11:14.651020+0000","last_fullsized":"2024-09-21T07:11:14.651020+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:57.304382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651847+0000","last_change":"2024-09-21T07:10:53.495971+0000","last_active":"2024-09-21T07:11:14.651847+0000","last_peered":"2024-09-21T07:11:14.651847+0000","last_clean":"2024-09-21T07:11:14.651847+0000","last_became_active":"2024-09-21T07:10:53.495124+0000","last_became_peered":"2024-09-21T07:10:53.495124+0000","last_unstale":"2024-09-21T07:11:14.651847+0000","last_undegraded":"2024-09-21T07:11:14.651847+0000","last_fullsized":"2024-09-21T07:11:14.651847+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653213+0000","last_change":"2024-09-21T07:10:53.497538+0000","last_active":"2024-09-21T07:11:14.653213+0000","last_peered":"2024-09-21T07:11:14.653213+0000","last_clean":"2024-09-21T07:11:14.653213+0000","last_became_active":"2024-09-21T07:10:53.496835+0000","last_became_peered":"2024-09-21T07:10:53.496835+0000","last_unstale":"2024-09-21T07:11:14.653213+0000","last_undegraded":"2024-09-21T07:11:14.653213+0000","last_fullsized":"2024-09-21T07:11:14.653213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:17.187282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.655815+0000","last_change":"2024-09-21T07:10:53.492646+0000","last_active":"2024-09-21T07:11:14.655815+0000","last_peered":"2024-09-21T07:11:14.655815+0000","last_clean":"2024-09-21T07:11:14.655815+0000","last_became_active":"2024-09-21T07:10:53.491818+0000","last_became_peered":"2024-09-21T07:10:53.491818+0000","last_unstale":"2024-09-21T07:11:14.655815+0000","last_undegraded":"2024-09-21T07:11:14.655815+0000","last_fullsized":"2024-09-21T07:11:14.655815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:37.094158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54685,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":133,"num_read_kb":125,"num_write":232,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":177383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283164,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710742,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":486697,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906972,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1073152,"data_stored":1125481,"data_compressed":59655,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070497,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":486627,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266726,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":487005,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462955,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":1083893,"data_compressed":59655,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626478,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":482131,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822709,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1015808,"data_stored":1079084,"data_compressed":59655,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986235,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":486596,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182463,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":481839,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378692,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":531253,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542217,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":543970,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":483587,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":49608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:11:48.208 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:11:48.452 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:48 smithi092 ceph-mon[30987]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:11:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:48 smithi092 ceph-mon[30987]: pgmap v299: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-09-21T07:11:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.955+0000 7f50d0322640 1 -- 172.21.15.92:0/930491646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50c8108da0 msgr2=0x7f50c810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.955+0000 7f50d0322640 1 --2- 172.21.15.92:0/930491646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50c8108da0 0x7f50c810f5d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009ca0 tx=0x7f50c002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.955+0000 7f50d0322640 1 -- 172.21.15.92:0/930491646 shutdown_connections 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.955+0000 7f50d0322640 1 --2- 172.21.15.92:0/930491646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50c8108da0 0x7f50c810f5d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.955+0000 7f50d0322640 1 --2- 172.21.15.92:0/930491646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c8108450 0x7f50c8108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.955+0000 7f50d0322640 1 --2- 172.21.15.92:0/930491646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c8102b10 0x7f50c8102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.955+0000 7f50d0322640 1 -- 172.21.15.92:0/930491646 >> 172.21.15.92:0/930491646 conn(0x7f50c80796d0 msgr2=0x7f50c8079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.955+0000 7f50d0322640 1 -- 172.21.15.92:0/930491646 shutdown_connections 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.955+0000 7f50d0322640 1 -- 172.21.15.92:0/930491646 wait complete. 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50d0322640 1 Processor -- start 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50d0322640 1 -- start start 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50d0322640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c8102b10 0x7f50c80ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50d0322640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c8108450 0x7f50c80ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50d0322640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50c8108da0 0x7f50c8100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50d0322640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81129e0 con 0x7f50c8108da0 2024-09-21T07:11:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50d0322640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8112860 con 0x7f50c8108450 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50d0322640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8112b60 con 0x7f50c8102b10 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50ce8bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50c8108da0 0x7f50c8100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50ce8bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50c8108da0 0x7f50c8100110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46340/0 (socket says 172.21.15.92:46340) 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50ce8bf640 1 -- 172.21.15.92:0/3000340227 learned_addr learned my addr 172.21.15.92:0/3000340227 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.956+0000 7f50ce0be640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c8102b10 0x7f50c80ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50cd8bd640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c8108450 0x7f50c80ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50ce8bf640 1 -- 172.21.15.92:0/3000340227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c8102b10 msgr2=0x7f50c80ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50ce8bf640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c8102b10 0x7f50c80ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50ce8bf640 1 -- 172.21.15.92:0/3000340227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c8108450 msgr2=0x7f50c80ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50ce8bf640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c8108450 0x7f50c80ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50ce8bf640 1 -- 172.21.15.92:0/3000340227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c81a8720 con 0x7f50c8108da0 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50cd8bd640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c8108450 0x7f50c80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50ce8bf640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50c8108da0 0x7f50c8100110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f50c0005cc0 tx=0x7f50c0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50bf7fe640 1 -- 172.21.15.92:0/3000340227 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0032e00 con 0x7f50c8108da0 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50d0322640 1 -- 172.21.15.92:0/3000340227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c81a89b0 con 0x7f50c8108da0 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50bf7fe640 1 -- 172.21.15.92:0/3000340227 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f50c00044d0 con 0x7f50c8108da0 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50bf7fe640 1 -- 172.21.15.92:0/3000340227 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0030b70 con 0x7f50c8108da0 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.957+0000 7f50d0322640 1 -- 172.21.15.92:0/3000340227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c81a8ef0 con 0x7f50c8108da0 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.958+0000 7f50d0322640 1 -- 172.21.15.92:0/3000340227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c8102f20 con 0x7f50c8108da0 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.960+0000 7f50bf7fe640 1 -- 172.21.15.92:0/3000340227 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f50c0004680 con 0x7f50c8108da0 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.960+0000 7f50bf7fe640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50b40b65f0 0x7f50b40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.960+0000 7f50ce0be640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50b40b65f0 0x7f50b40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.960+0000 7f50bf7fe640 1 -- 172.21.15.92:0/3000340227 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f50c0108e50 con 0x7f50c8108da0 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.961+0000 7f50ce0be640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50b40b65f0 0x7f50b40b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f50c81010e0 tx=0x7f50c4009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:48.963+0000 7f50bf7fe640 1 -- 172.21.15.92:0/3000340227 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f50c00cf150 con 0x7f50c8108da0 2024-09-21T07:11:49.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:48 smithi175 ceph-mon[34064]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:11:49.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:48 smithi175 ceph-mon[34064]: pgmap v299: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-09-21T07:11:49.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.139+0000 7f50d0322640 1 -- 172.21.15.92:0/3000340227 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50c8063800 con 0x7f50b40b65f0 2024-09-21T07:11:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:48 smithi169 ceph-mon[33705]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:11:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:48 smithi169 ceph-mon[33705]: pgmap v299: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-09-21T07:11:49.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.145+0000 7f50bf7fe640 1 -- 172.21.15.92:0/3000340227 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340667 (secure 0 0 0) 0x7f50c8063800 con 0x7f50b40b65f0 2024-09-21T07:11:49.150 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:49.151 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-21T07:11:49.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 -- 172.21.15.92:0/3000340227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50b40b65f0 msgr2=0x7f50b40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:49.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50b40b65f0 0x7f50b40b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f50c81010e0 tx=0x7f50c4009110 comp rx=0 tx=0).stop 2024-09-21T07:11:49.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 -- 172.21.15.92:0/3000340227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50c8108da0 msgr2=0x7f50c8100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:49.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50c8108da0 0x7f50c8100110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f50c0005cc0 tx=0x7f50c0032a10 comp rx=0 tx=0).stop 2024-09-21T07:11:49.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 -- 172.21.15.92:0/3000340227 shutdown_connections 2024-09-21T07:11:49.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50b40b65f0 0x7f50b40b8b00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50c8108da0 0x7f50c8100110 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c8108450 0x7f50c80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 --2- 172.21.15.92:0/3000340227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c8102b10 0x7f50c80ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 -- 172.21.15.92:0/3000340227 >> 172.21.15.92:0/3000340227 conn(0x7f50c80796d0 msgr2=0x7f50c8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:49.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 -- 172.21.15.92:0/3000340227 shutdown_connections 2024-09-21T07:11:49.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:49.150+0000 7f50d0322640 1 -- 172.21.15.92:0/3000340227 wait complete. 2024-09-21T07:11:49.834 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:49 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:11:49.860 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-21T07:11:47.595755+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645287,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":219,"num_read_kb":199,"num_write":357,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364864,"kb_used_data":11456,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576960,"statfs":{"total":1151940427776,"available":1151566807040,"internally_reserved":0,"allocated":11730944,"data_stored":7758163,"data_compressed":391833,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45439,"num_objects":17,"num_object_clones":0,"num_object_copies":53,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":55,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003225"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:40.756387+0000","last_change":"2024-09-21T07:10:51.463956+0000","last_active":"2024-09-21T07:11:40.756387+0000","last_peered":"2024-09-21T07:11:40.756387+0000","last_clean":"2024-09-21T07:11:40.756387+0000","last_became_active":"2024-09-21T07:10:51.463564+0000","last_became_peered":"2024-09-21T07:10:51.463564+0000","last_unstale":"2024-09-21T07:11:40.756387+0000","last_undegraded":"2024-09-21T07:11:40.756387+0000","last_fullsized":"2024-09-21T07:11:40.756387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671587+0000","last_change":"2024-09-21T07:10:53.484379+0000","last_active":"2024-09-21T07:11:14.671587+0000","last_peered":"2024-09-21T07:11:14.671587+0000","last_clean":"2024-09-21T07:11:14.671587+0000","last_became_active":"2024-09-21T07:10:53.484005+0000","last_became_peered":"2024-09-21T07:10:53.484005+0000","last_unstale":"2024-09-21T07:11:14.671587+0000","last_undegraded":"2024-09-21T07:11:14.671587+0000","last_fullsized":"2024-09-21T07:11:14.671587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:27.665257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650238+0000","last_change":"2024-09-21T07:11:00.552729+0000","last_active":"2024-09-21T07:11:14.650238+0000","last_peered":"2024-09-21T07:11:14.650238+0000","last_clean":"2024-09-21T07:11:14.650238+0000","last_became_active":"2024-09-21T07:11:00.552196+0000","last_became_peered":"2024-09-21T07:11:00.552196+0000","last_unstale":"2024-09-21T07:11:14.650238+0000","last_undegraded":"2024-09-21T07:11:14.650238+0000","last_fullsized":"2024-09-21T07:11:14.650238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:35.942717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671851+0000","last_change":"2024-09-21T07:10:51.467798+0000","last_active":"2024-09-21T07:11:14.671851+0000","last_peered":"2024-09-21T07:11:14.671851+0000","last_clean":"2024-09-21T07:11:14.671851+0000","last_became_active":"2024-09-21T07:10:51.467314+0000","last_became_peered":"2024-09-21T07:10:51.467314+0000","last_unstale":"2024-09-21T07:11:14.671851+0000","last_undegraded":"2024-09-21T07:11:14.671851+0000","last_fullsized":"2024-09-21T07:11:14.671851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:21.944378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653001+0000","last_change":"2024-09-21T07:10:53.494849+0000","last_active":"2024-09-21T07:11:14.653001+0000","last_peered":"2024-09-21T07:11:14.653001+0000","last_clean":"2024-09-21T07:11:14.653001+0000","last_became_active":"2024-09-21T07:10:53.494478+0000","last_became_peered":"2024-09-21T07:10:53.494478+0000","last_unstale":"2024-09-21T07:11:14.653001+0000","last_undegraded":"2024-09-21T07:11:14.653001+0000","last_fullsized":"2024-09-21T07:11:14.653001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:38.383547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650072+0000","last_change":"2024-09-21T07:11:00.558306+0000","last_active":"2024-09-21T07:11:14.650072+0000","last_peered":"2024-09-21T07:11:14.650072+0000","last_clean":"2024-09-21T07:11:14.650072+0000","last_became_active":"2024-09-21T07:11:00.557814+0000","last_became_peered":"2024-09-21T07:11:00.557814+0000","last_unstale":"2024-09-21T07:11:14.650072+0000","last_undegraded":"2024-09-21T07:11:14.650072+0000","last_fullsized":"2024-09-21T07:11:14.650072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:31.401788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:33.742565+0000","last_change":"2024-09-21T07:10:51.466831+0000","last_active":"2024-09-21T07:11:33.742565+0000","last_peered":"2024-09-21T07:11:33.742565+0000","last_clean":"2024-09-21T07:11:33.742565+0000","last_became_active":"2024-09-21T07:10:51.466381+0000","last_became_peered":"2024-09-21T07:10:51.466381+0000","last_unstale":"2024-09-21T07:11:33.742565+0000","last_undegraded":"2024-09-21T07:11:33.742565+0000","last_fullsized":"2024-09-21T07:11:33.742565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.559370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669367+0000","last_change":"2024-09-21T07:10:53.485920+0000","last_active":"2024-09-21T07:11:14.669367+0000","last_peered":"2024-09-21T07:11:14.669367+0000","last_clean":"2024-09-21T07:11:14.669367+0000","last_became_active":"2024-09-21T07:10:53.484689+0000","last_became_peered":"2024-09-21T07:10:53.484689+0000","last_unstale":"2024-09-21T07:11:14.669367+0000","last_undegraded":"2024-09-21T07:11:14.669367+0000","last_fullsized":"2024-09-21T07:11:14.669367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:59.951999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651022+0000","last_change":"2024-09-21T07:11:00.558298+0000","last_active":"2024-09-21T07:11:14.651022+0000","last_peered":"2024-09-21T07:11:14.651022+0000","last_clean":"2024-09-21T07:11:14.651022+0000","last_became_active":"2024-09-21T07:11:00.557738+0000","last_became_peered":"2024-09-21T07:11:00.557738+0000","last_unstale":"2024-09-21T07:11:14.651022+0000","last_undegraded":"2024-09-21T07:11:14.651022+0000","last_fullsized":"2024-09-21T07:11:14.651022+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:03.037820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.736671+0000","last_change":"2024-09-21T07:10:51.464283+0000","last_active":"2024-09-21T07:11:32.736671+0000","last_peered":"2024-09-21T07:11:32.736671+0000","last_clean":"2024-09-21T07:11:32.736671+0000","last_became_active":"2024-09-21T07:10:51.463783+0000","last_became_peered":"2024-09-21T07:10:51.463783+0000","last_unstale":"2024-09-21T07:11:32.736671+0000","last_undegraded":"2024-09-21T07:11:32.736671+0000","last_fullsized":"2024-09-21T07:11:32.736671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:45.298654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671587+0000","last_change":"2024-09-21T07:11:14.671020+0000","last_active":"2024-09-21T07:11:14.671587+0000","last_peered":"2024-09-21T07:11:14.671587+0000","last_clean":"2024-09-21T07:11:14.671587+0000","last_became_active":"2024-09-21T07:11:14.670573+0000","last_became_peered":"2024-09-21T07:11:14.670573+0000","last_unstale":"2024-09-21T07:11:14.671587+0000","last_undegraded":"2024-09-21T07:11:14.671587+0000","last_fullsized":"2024-09-21T07:11:14.671587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.926304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650248+0000","last_change":"2024-09-21T07:11:00.549015+0000","last_active":"2024-09-21T07:11:14.650248+0000","last_peered":"2024-09-21T07:11:14.650248+0000","last_clean":"2024-09-21T07:11:14.650248+0000","last_became_active":"2024-09-21T07:11:00.548561+0000","last_became_peered":"2024-09-21T07:11:00.548561+0000","last_unstale":"2024-09-21T07:11:14.650248+0000","last_undegraded":"2024-09-21T07:11:14.650248+0000","last_fullsized":"2024-09-21T07:11:14.650248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:08.386214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653580+0000","last_change":"2024-09-21T07:10:53.489382+0000","last_active":"2024-09-21T07:11:14.653580+0000","last_peered":"2024-09-21T07:11:14.653580+0000","last_clean":"2024-09-21T07:11:14.653580+0000","last_became_active":"2024-09-21T07:10:53.488987+0000","last_became_peered":"2024-09-21T07:10:53.488987+0000","last_unstale":"2024-09-21T07:11:14.653580+0000","last_undegraded":"2024-09-21T07:11:14.653580+0000","last_fullsized":"2024-09-21T07:11:14.653580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.334840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:29.712256+0000","last_change":"2024-09-21T07:10:51.467203+0000","last_active":"2024-09-21T07:11:29.712256+0000","last_peered":"2024-09-21T07:11:29.712256+0000","last_clean":"2024-09-21T07:11:29.712256+0000","last_became_active":"2024-09-21T07:10:51.466737+0000","last_became_peered":"2024-09-21T07:10:51.466737+0000","last_unstale":"2024-09-21T07:11:29.712256+0000","last_undegraded":"2024-09-21T07:11:29.712256+0000","last_fullsized":"2024-09-21T07:11:29.712256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:26.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650890+0000","last_change":"2024-09-21T07:11:00.640801+0000","last_active":"2024-09-21T07:11:14.650890+0000","last_peered":"2024-09-21T07:11:14.650890+0000","last_clean":"2024-09-21T07:11:14.650890+0000","last_became_active":"2024-09-21T07:11:00.640213+0000","last_became_peered":"2024-09-21T07:11:00.640213+0000","last_unstale":"2024-09-21T07:11:14.650890+0000","last_undegraded":"2024-09-21T07:11:14.650890+0000","last_fullsized":"2024-09-21T07:11:14.650890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:55.801831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670363+0000","last_change":"2024-09-21T07:10:53.491166+0000","last_active":"2024-09-21T07:11:14.670363+0000","last_peered":"2024-09-21T07:11:14.670363+0000","last_clean":"2024-09-21T07:11:14.670363+0000","last_became_active":"2024-09-21T07:10:53.490823+0000","last_became_peered":"2024-09-21T07:10:53.490823+0000","last_unstale":"2024-09-21T07:11:14.670363+0000","last_undegraded":"2024-09-21T07:11:14.670363+0000","last_fullsized":"2024-09-21T07:11:14.670363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:48.661634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:31.726028+0000","last_change":"2024-09-21T07:10:51.461220+0000","last_active":"2024-09-21T07:11:31.726028+0000","last_peered":"2024-09-21T07:11:31.726028+0000","last_clean":"2024-09-21T07:11:31.726028+0000","last_became_active":"2024-09-21T07:10:51.460772+0000","last_became_peered":"2024-09-21T07:10:51.460772+0000","last_unstale":"2024-09-21T07:11:31.726028+0000","last_undegraded":"2024-09-21T07:11:31.726028+0000","last_fullsized":"2024-09-21T07:11:31.726028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:56.488273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650843+0000","last_change":"2024-09-21T07:11:00.558487+0000","last_active":"2024-09-21T07:11:14.650843+0000","last_peered":"2024-09-21T07:11:14.650843+0000","last_clean":"2024-09-21T07:11:14.650843+0000","last_became_active":"2024-09-21T07:11:00.557877+0000","last_became_peered":"2024-09-21T07:11:00.557877+0000","last_unstale":"2024-09-21T07:11:14.650843+0000","last_undegraded":"2024-09-21T07:11:14.650843+0000","last_fullsized":"2024-09-21T07:11:14.650843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:14.614603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654321+0000","last_change":"2024-09-21T07:10:53.489309+0000","last_active":"2024-09-21T07:11:14.654321+0000","last_peered":"2024-09-21T07:11:14.654321+0000","last_clean":"2024-09-21T07:11:14.654321+0000","last_became_active":"2024-09-21T07:10:53.488943+0000","last_became_peered":"2024-09-21T07:10:53.488943+0000","last_unstale":"2024-09-21T07:11:14.654321+0000","last_undegraded":"2024-09-21T07:11:14.654321+0000","last_fullsized":"2024-09-21T07:11:14.654321+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.797176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.734172+0000","last_change":"2024-09-21T07:10:51.461078+0000","last_active":"2024-09-21T07:11:32.734172+0000","last_peered":"2024-09-21T07:11:32.734172+0000","last_clean":"2024-09-21T07:11:32.734172+0000","last_became_active":"2024-09-21T07:10:51.460759+0000","last_became_peered":"2024-09-21T07:10:51.460759+0000","last_unstale":"2024-09-21T07:11:32.734172+0000","last_undegraded":"2024-09-21T07:11:32.734172+0000","last_fullsized":"2024-09-21T07:11:32.734172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:37.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650360+0000","last_change":"2024-09-21T07:11:00.554766+0000","last_active":"2024-09-21T07:11:14.650360+0000","last_peered":"2024-09-21T07:11:14.650360+0000","last_clean":"2024-09-21T07:11:14.650360+0000","last_became_active":"2024-09-21T07:11:00.554374+0000","last_became_peered":"2024-09-21T07:11:00.554374+0000","last_unstale":"2024-09-21T07:11:14.650360+0000","last_undegraded":"2024-09-21T07:11:14.650360+0000","last_fullsized":"2024-09-21T07:11:14.650360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:47.038411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651978+0000","last_change":"2024-09-21T07:10:53.487501+0000","last_active":"2024-09-21T07:11:14.651978+0000","last_peered":"2024-09-21T07:11:14.651978+0000","last_clean":"2024-09-21T07:11:14.651978+0000","last_became_active":"2024-09-21T07:10:53.487030+0000","last_became_peered":"2024-09-21T07:10:53.487030+0000","last_unstale":"2024-09-21T07:11:14.651978+0000","last_undegraded":"2024-09-21T07:11:14.651978+0000","last_fullsized":"2024-09-21T07:11:14.651978+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:29.709752+0000","last_change":"2024-09-21T07:10:51.468155+0000","last_active":"2024-09-21T07:11:29.709752+0000","last_peered":"2024-09-21T07:11:29.709752+0000","last_clean":"2024-09-21T07:11:29.709752+0000","last_became_active":"2024-09-21T07:10:51.467663+0000","last_became_peered":"2024-09-21T07:10:51.467663+0000","last_unstale":"2024-09-21T07:11:29.709752+0000","last_undegraded":"2024-09-21T07:11:29.709752+0000","last_fullsized":"2024-09-21T07:11:29.709752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:18.176519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650623+0000","last_change":"2024-09-21T07:11:00.641283+0000","last_active":"2024-09-21T07:11:14.650623+0000","last_peered":"2024-09-21T07:11:14.650623+0000","last_clean":"2024-09-21T07:11:14.650623+0000","last_became_active":"2024-09-21T07:11:00.640715+0000","last_became_peered":"2024-09-21T07:11:00.640715+0000","last_unstale":"2024-09-21T07:11:14.650623+0000","last_undegraded":"2024-09-21T07:11:14.650623+0000","last_fullsized":"2024-09-21T07:11:14.650623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:26.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.656801+0000","last_change":"2024-09-21T07:11:14.656686+0000","last_active":"2024-09-21T07:11:14.656801+0000","last_peered":"2024-09-21T07:11:14.656801+0000","last_clean":"2024-09-21T07:11:14.656801+0000","last_became_active":"2024-09-21T07:11:14.656259+0000","last_became_peered":"2024-09-21T07:11:14.656259+0000","last_unstale":"2024-09-21T07:11:14.656801+0000","last_undegraded":"2024-09-21T07:11:14.656801+0000","last_fullsized":"2024-09-21T07:11:14.656801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:16.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.734017+0000","last_change":"2024-09-21T07:10:52.123260+0000","last_active":"2024-09-21T07:11:32.734017+0000","last_peered":"2024-09-21T07:11:32.734017+0000","last_clean":"2024-09-21T07:11:32.734017+0000","last_became_active":"2024-09-21T07:10:52.122752+0000","last_became_peered":"2024-09-21T07:10:52.122752+0000","last_unstale":"2024-09-21T07:11:32.734017+0000","last_undegraded":"2024-09-21T07:11:32.734017+0000","last_fullsized":"2024-09-21T07:11:32.734017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.041434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650398+0000","last_change":"2024-09-21T07:11:00.549599+0000","last_active":"2024-09-21T07:11:14.650398+0000","last_peered":"2024-09-21T07:11:14.650398+0000","last_clean":"2024-09-21T07:11:14.650398+0000","last_became_active":"2024-09-21T07:11:00.549112+0000","last_became_peered":"2024-09-21T07:11:00.549112+0000","last_unstale":"2024-09-21T07:11:14.650398+0000","last_undegraded":"2024-09-21T07:11:14.650398+0000","last_fullsized":"2024-09-21T07:11:14.650398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:15.209889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671595+0000","last_change":"2024-09-21T07:10:53.487792+0000","last_active":"2024-09-21T07:11:14.671595+0000","last_peered":"2024-09-21T07:11:14.671595+0000","last_clean":"2024-09-21T07:11:14.671595+0000","last_became_active":"2024-09-21T07:10:53.487460+0000","last_became_peered":"2024-09-21T07:10:53.487460+0000","last_unstale":"2024-09-21T07:11:14.671595+0000","last_undegraded":"2024-09-21T07:11:14.671595+0000","last_fullsized":"2024-09-21T07:11:14.671595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:26.329878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:40.499133+0000","last_change":"2024-09-21T07:10:51.461967+0000","last_active":"2024-09-21T07:11:40.499133+0000","last_peered":"2024-09-21T07:11:40.499133+0000","last_clean":"2024-09-21T07:11:40.499133+0000","last_became_active":"2024-09-21T07:10:51.461564+0000","last_became_peered":"2024-09-21T07:10:51.461564+0000","last_unstale":"2024-09-21T07:11:40.499133+0000","last_undegraded":"2024-09-21T07:11:40.499133+0000","last_fullsized":"2024-09-21T07:11:40.499133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:37.211264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669424+0000","last_change":"2024-09-21T07:11:00.640604+0000","last_active":"2024-09-21T07:11:14.669424+0000","last_peered":"2024-09-21T07:11:14.669424+0000","last_clean":"2024-09-21T07:11:14.669424+0000","last_became_active":"2024-09-21T07:11:00.640047+0000","last_became_peered":"2024-09-21T07:11:00.640047+0000","last_unstale":"2024-09-21T07:11:14.669424+0000","last_undegraded":"2024-09-21T07:11:14.669424+0000","last_fullsized":"2024-09-21T07:11:14.669424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:42.640908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670490+0000","last_change":"2024-09-21T07:10:53.473862+0000","last_active":"2024-09-21T07:11:14.670490+0000","last_peered":"2024-09-21T07:11:14.670490+0000","last_clean":"2024-09-21T07:11:14.670490+0000","last_became_active":"2024-09-21T07:10:53.473526+0000","last_became_peered":"2024-09-21T07:10:53.473526+0000","last_unstale":"2024-09-21T07:11:14.670490+0000","last_undegraded":"2024-09-21T07:11:14.670490+0000","last_fullsized":"2024-09-21T07:11:14.670490+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.389566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.736420+0000","last_change":"2024-09-21T07:10:51.468003+0000","last_active":"2024-09-21T07:11:32.736420+0000","last_peered":"2024-09-21T07:11:32.736420+0000","last_clean":"2024-09-21T07:11:32.736420+0000","last_became_active":"2024-09-21T07:10:51.467603+0000","last_became_peered":"2024-09-21T07:10:51.467603+0000","last_unstale":"2024-09-21T07:11:32.736420+0000","last_undegraded":"2024-09-21T07:11:32.736420+0000","last_fullsized":"2024-09-21T07:11:32.736420+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:02.148721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.655132+0000","last_change":"2024-09-21T07:11:00.550434+0000","last_active":"2024-09-21T07:11:14.655132+0000","last_peered":"2024-09-21T07:11:14.655132+0000","last_clean":"2024-09-21T07:11:14.655132+0000","last_became_active":"2024-09-21T07:11:00.549949+0000","last_became_peered":"2024-09-21T07:11:00.549949+0000","last_unstale":"2024-09-21T07:11:14.655132+0000","last_undegraded":"2024-09-21T07:11:14.655132+0000","last_fullsized":"2024-09-21T07:11:14.655132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:53.737978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.656028+0000","last_change":"2024-09-21T07:10:53.487550+0000","last_active":"2024-09-21T07:11:14.656028+0000","last_peered":"2024-09-21T07:11:14.656028+0000","last_clean":"2024-09-21T07:11:14.656028+0000","last_became_active":"2024-09-21T07:10:53.487073+0000","last_became_peered":"2024-09-21T07:10:53.487073+0000","last_unstale":"2024-09-21T07:11:14.656028+0000","last_undegraded":"2024-09-21T07:11:14.656028+0000","last_fullsized":"2024-09-21T07:11:14.656028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:48.841264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.649978+0000","last_change":"2024-09-21T07:10:51.468201+0000","last_active":"2024-09-21T07:11:14.649978+0000","last_peered":"2024-09-21T07:11:14.649978+0000","last_clean":"2024-09-21T07:11:14.649978+0000","last_became_active":"2024-09-21T07:10:51.467754+0000","last_became_peered":"2024-09-21T07:10:51.467754+0000","last_unstale":"2024-09-21T07:11:14.649978+0000","last_undegraded":"2024-09-21T07:11:14.649978+0000","last_fullsized":"2024-09-21T07:11:14.649978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:52.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651986+0000","last_change":"2024-09-21T07:11:00.640653+0000","last_active":"2024-09-21T07:11:14.651986+0000","last_peered":"2024-09-21T07:11:14.651986+0000","last_clean":"2024-09-21T07:11:14.651986+0000","last_became_active":"2024-09-21T07:11:00.640080+0000","last_became_peered":"2024-09-21T07:11:00.640080+0000","last_unstale":"2024-09-21T07:11:14.651986+0000","last_undegraded":"2024-09-21T07:11:14.651986+0000","last_fullsized":"2024-09-21T07:11:14.651986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:24.124088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654470+0000","last_change":"2024-09-21T07:10:53.494222+0000","last_active":"2024-09-21T07:11:14.654470+0000","last_peered":"2024-09-21T07:11:14.654470+0000","last_clean":"2024-09-21T07:11:14.654470+0000","last_became_active":"2024-09-21T07:10:53.493703+0000","last_became_peered":"2024-09-21T07:10:53.493703+0000","last_unstale":"2024-09-21T07:11:14.654470+0000","last_undegraded":"2024-09-21T07:11:14.654470+0000","last_fullsized":"2024-09-21T07:11:14.654470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:21.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:42.760387+0000","last_change":"2024-09-21T07:10:51.461095+0000","last_active":"2024-09-21T07:11:42.760387+0000","last_peered":"2024-09-21T07:11:42.760387+0000","last_clean":"2024-09-21T07:11:42.760387+0000","last_became_active":"2024-09-21T07:10:51.460738+0000","last_became_peered":"2024-09-21T07:10:51.460738+0000","last_unstale":"2024-09-21T07:11:42.760387+0000","last_undegraded":"2024-09-21T07:11:42.760387+0000","last_fullsized":"2024-09-21T07:11:42.760387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:55.593391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670153+0000","last_change":"2024-09-21T07:11:00.544788+0000","last_active":"2024-09-21T07:11:14.670153+0000","last_peered":"2024-09-21T07:11:14.670153+0000","last_clean":"2024-09-21T07:11:14.670153+0000","last_became_active":"2024-09-21T07:11:00.544370+0000","last_became_peered":"2024-09-21T07:11:00.544370+0000","last_unstale":"2024-09-21T07:11:14.670153+0000","last_undegraded":"2024-09-21T07:11:14.670153+0000","last_fullsized":"2024-09-21T07:11:14.670153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.154867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669853+0000","last_change":"2024-09-21T07:10:53.486715+0000","last_active":"2024-09-21T07:11:14.669853+0000","last_peered":"2024-09-21T07:11:14.669853+0000","last_clean":"2024-09-21T07:11:14.669853+0000","last_became_active":"2024-09-21T07:10:53.486315+0000","last_became_peered":"2024-09-21T07:10:53.486315+0000","last_unstale":"2024-09-21T07:11:14.669853+0000","last_undegraded":"2024-09-21T07:11:14.669853+0000","last_fullsized":"2024-09-21T07:11:14.669853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:00.124269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:44.762406+0000","last_change":"2024-09-21T07:10:51.467102+0000","last_active":"2024-09-21T07:11:44.762406+0000","last_peered":"2024-09-21T07:11:44.762406+0000","last_clean":"2024-09-21T07:11:44.762406+0000","last_became_active":"2024-09-21T07:10:51.466721+0000","last_became_peered":"2024-09-21T07:10:51.466721+0000","last_unstale":"2024-09-21T07:11:44.762406+0000","last_undegraded":"2024-09-21T07:11:44.762406+0000","last_fullsized":"2024-09-21T07:11:44.762406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670481+0000","last_change":"2024-09-21T07:11:00.640622+0000","last_active":"2024-09-21T07:11:14.670481+0000","last_peered":"2024-09-21T07:11:14.670481+0000","last_clean":"2024-09-21T07:11:14.670481+0000","last_became_active":"2024-09-21T07:11:00.640104+0000","last_became_peered":"2024-09-21T07:11:00.640104+0000","last_unstale":"2024-09-21T07:11:14.670481+0000","last_undegraded":"2024-09-21T07:11:14.670481+0000","last_fullsized":"2024-09-21T07:11:14.670481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:12.023561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669912+0000","last_change":"2024-09-21T07:10:53.478175+0000","last_active":"2024-09-21T07:11:14.669912+0000","last_peered":"2024-09-21T07:11:14.669912+0000","last_clean":"2024-09-21T07:11:14.669912+0000","last_became_active":"2024-09-21T07:10:53.477831+0000","last_became_peered":"2024-09-21T07:10:53.477831+0000","last_unstale":"2024-09-21T07:11:14.669912+0000","last_undegraded":"2024-09-21T07:11:14.669912+0000","last_fullsized":"2024-09-21T07:11:14.669912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:27.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:30.713919+0000","last_change":"2024-09-21T07:10:51.466318+0000","last_active":"2024-09-21T07:11:30.713919+0000","last_peered":"2024-09-21T07:11:30.713919+0000","last_clean":"2024-09-21T07:11:30.713919+0000","last_became_active":"2024-09-21T07:10:51.465983+0000","last_became_peered":"2024-09-21T07:10:51.465983+0000","last_unstale":"2024-09-21T07:11:30.713919+0000","last_undegraded":"2024-09-21T07:11:30.713919+0000","last_fullsized":"2024-09-21T07:11:30.713919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:08.432949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670591+0000","last_change":"2024-09-21T07:11:00.641364+0000","last_active":"2024-09-21T07:11:14.670591+0000","last_peered":"2024-09-21T07:11:14.670591+0000","last_clean":"2024-09-21T07:11:14.670591+0000","last_became_active":"2024-09-21T07:11:00.640879+0000","last_became_peered":"2024-09-21T07:11:00.640879+0000","last_unstale":"2024-09-21T07:11:14.670591+0000","last_undegraded":"2024-09-21T07:11:14.670591+0000","last_fullsized":"2024-09-21T07:11:14.670591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:16.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670934+0000","last_change":"2024-09-21T07:10:53.483709+0000","last_active":"2024-09-21T07:11:14.670934+0000","last_peered":"2024-09-21T07:11:14.670934+0000","last_clean":"2024-09-21T07:11:14.670934+0000","last_became_active":"2024-09-21T07:10:53.483355+0000","last_became_peered":"2024-09-21T07:10:53.483355+0000","last_unstale":"2024-09-21T07:11:14.670934+0000","last_undegraded":"2024-09-21T07:11:14.670934+0000","last_fullsized":"2024-09-21T07:11:14.670934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.702168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:33.743210+0000","last_change":"2024-09-21T07:10:51.464239+0000","last_active":"2024-09-21T07:11:33.743210+0000","last_peered":"2024-09-21T07:11:33.743210+0000","last_clean":"2024-09-21T07:11:33.743210+0000","last_became_active":"2024-09-21T07:10:51.463828+0000","last_became_peered":"2024-09-21T07:10:51.463828+0000","last_unstale":"2024-09-21T07:11:33.743210+0000","last_undegraded":"2024-09-21T07:11:33.743210+0000","last_fullsized":"2024-09-21T07:11:33.743210+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:09.580668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":109,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653190+0000","last_change":"2024-09-21T07:09:39.332523+0000","last_active":"2024-09-21T07:11:14.653190+0000","last_peered":"2024-09-21T07:11:14.653190+0000","last_clean":"2024-09-21T07:11:14.653190+0000","last_became_active":"2024-09-21T07:09:39.326582+0000","last_became_peered":"2024-09-21T07:09:39.326582+0000","last_unstale":"2024-09-21T07:11:14.653190+0000","last_undegraded":"2024-09-21T07:11:14.653190+0000","last_fullsized":"2024-09-21T07:11:14.653190+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_clean_scrub_stamp":"2024-09-21T07:06:12.748818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.672710+0000","last_change":"2024-09-21T07:11:14.672044+0000","last_active":"2024-09-21T07:11:14.672710+0000","last_peered":"2024-09-21T07:11:14.672710+0000","last_clean":"2024-09-21T07:11:14.672710+0000","last_became_active":"2024-09-21T07:11:14.671513+0000","last_became_peered":"2024-09-21T07:11:14.671513+0000","last_unstale":"2024-09-21T07:11:14.672710+0000","last_undegraded":"2024-09-21T07:11:14.672710+0000","last_fullsized":"2024-09-21T07:11:14.672710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:09.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653435+0000","last_change":"2024-09-21T07:10:53.488678+0000","last_active":"2024-09-21T07:11:14.653435+0000","last_peered":"2024-09-21T07:11:14.653435+0000","last_clean":"2024-09-21T07:11:14.653435+0000","last_became_active":"2024-09-21T07:10:53.488304+0000","last_became_peered":"2024-09-21T07:10:53.488304+0000","last_unstale":"2024-09-21T07:11:14.653435+0000","last_undegraded":"2024-09-21T07:11:14.653435+0000","last_fullsized":"2024-09-21T07:11:14.653435+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:37.696269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:40.758020+0000","last_change":"2024-09-21T07:10:52.123086+0000","last_active":"2024-09-21T07:11:40.758020+0000","last_peered":"2024-09-21T07:11:40.758020+0000","last_clean":"2024-09-21T07:11:40.758020+0000","last_became_active":"2024-09-21T07:10:52.122584+0000","last_became_peered":"2024-09-21T07:10:52.122584+0000","last_unstale":"2024-09-21T07:11:40.758020+0000","last_undegraded":"2024-09-21T07:11:40.758020+0000","last_fullsized":"2024-09-21T07:11:40.758020+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:28.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669266+0000","last_change":"2024-09-21T07:11:00.549595+0000","last_active":"2024-09-21T07:11:14.669266+0000","last_peered":"2024-09-21T07:11:14.669266+0000","last_clean":"2024-09-21T07:11:14.669266+0000","last_became_active":"2024-09-21T07:11:00.549009+0000","last_became_peered":"2024-09-21T07:11:00.549009+0000","last_unstale":"2024-09-21T07:11:14.669266+0000","last_undegraded":"2024-09-21T07:11:14.669266+0000","last_fullsized":"2024-09-21T07:11:14.669266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:59.825381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654167+0000","last_change":"2024-09-21T07:10:53.484336+0000","last_active":"2024-09-21T07:11:14.654167+0000","last_peered":"2024-09-21T07:11:14.654167+0000","last_clean":"2024-09-21T07:11:14.654167+0000","last_became_active":"2024-09-21T07:10:53.483825+0000","last_became_peered":"2024-09-21T07:10:53.483825+0000","last_unstale":"2024-09-21T07:11:14.654167+0000","last_undegraded":"2024-09-21T07:11:14.654167+0000","last_fullsized":"2024-09-21T07:11:14.654167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.545339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.734722+0000","last_change":"2024-09-21T07:10:51.461297+0000","last_active":"2024-09-21T07:11:32.734722+0000","last_peered":"2024-09-21T07:11:32.734722+0000","last_clean":"2024-09-21T07:11:32.734722+0000","last_became_active":"2024-09-21T07:10:51.460600+0000","last_became_peered":"2024-09-21T07:10:51.460600+0000","last_unstale":"2024-09-21T07:11:32.734722+0000","last_undegraded":"2024-09-21T07:11:32.734722+0000","last_fullsized":"2024-09-21T07:11:32.734722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:34.955250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652059+0000","last_change":"2024-09-21T07:11:00.551652+0000","last_active":"2024-09-21T07:11:14.652059+0000","last_peered":"2024-09-21T07:11:14.652059+0000","last_clean":"2024-09-21T07:11:14.652059+0000","last_became_active":"2024-09-21T07:11:00.551236+0000","last_became_peered":"2024-09-21T07:11:00.551236+0000","last_unstale":"2024-09-21T07:11:14.652059+0000","last_undegraded":"2024-09-21T07:11:14.652059+0000","last_fullsized":"2024-09-21T07:11:14.652059+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:28.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654402+0000","last_change":"2024-09-21T07:10:53.487605+0000","last_active":"2024-09-21T07:11:14.654402+0000","last_peered":"2024-09-21T07:11:14.654402+0000","last_clean":"2024-09-21T07:11:14.654402+0000","last_became_active":"2024-09-21T07:10:53.487245+0000","last_became_peered":"2024-09-21T07:10:53.487245+0000","last_unstale":"2024-09-21T07:11:14.654402+0000","last_undegraded":"2024-09-21T07:11:14.654402+0000","last_fullsized":"2024-09-21T07:11:14.654402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:24.490652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.733282+0000","last_change":"2024-09-21T07:10:51.456920+0000","last_active":"2024-09-21T07:11:32.733282+0000","last_peered":"2024-09-21T07:11:32.733282+0000","last_clean":"2024-09-21T07:11:32.733282+0000","last_became_active":"2024-09-21T07:10:51.456500+0000","last_became_peered":"2024-09-21T07:10:51.456500+0000","last_unstale":"2024-09-21T07:11:32.733282+0000","last_undegraded":"2024-09-21T07:11:32.733282+0000","last_fullsized":"2024-09-21T07:11:32.733282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:07.663192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669421+0000","last_change":"2024-09-21T07:11:00.552115+0000","last_active":"2024-09-21T07:11:14.669421+0000","last_peered":"2024-09-21T07:11:14.669421+0000","last_clean":"2024-09-21T07:11:14.669421+0000","last_became_active":"2024-09-21T07:11:00.551647+0000","last_became_peered":"2024-09-21T07:11:00.551647+0000","last_unstale":"2024-09-21T07:11:14.669421+0000","last_undegraded":"2024-09-21T07:11:14.669421+0000","last_fullsized":"2024-09-21T07:11:14.669421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:13.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671859+0000","last_change":"2024-09-21T07:11:14.671714+0000","last_active":"2024-09-21T07:11:14.671859+0000","last_peered":"2024-09-21T07:11:14.671859+0000","last_clean":"2024-09-21T07:11:14.671859+0000","last_became_active":"2024-09-21T07:11:14.671248+0000","last_became_peered":"2024-09-21T07:11:14.671248+0000","last_unstale":"2024-09-21T07:11:14.671859+0000","last_undegraded":"2024-09-21T07:11:14.671859+0000","last_fullsized":"2024-09-21T07:11:14.671859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:36.599916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.709074+0000","last_change":"2024-09-21T07:10:51.464710+0000","last_active":"2024-09-21T07:11:32.709074+0000","last_peered":"2024-09-21T07:11:32.709074+0000","last_clean":"2024-09-21T07:11:32.709074+0000","last_became_active":"2024-09-21T07:10:51.464295+0000","last_became_peered":"2024-09-21T07:10:51.464295+0000","last_unstale":"2024-09-21T07:11:32.709074+0000","last_undegraded":"2024-09-21T07:11:32.709074+0000","last_fullsized":"2024-09-21T07:11:32.709074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:00.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669859+0000","last_change":"2024-09-21T07:11:00.548275+0000","last_active":"2024-09-21T07:11:14.669859+0000","last_peered":"2024-09-21T07:11:14.669859+0000","last_clean":"2024-09-21T07:11:14.669859+0000","last_became_active":"2024-09-21T07:11:00.547777+0000","last_became_peered":"2024-09-21T07:11:00.547777+0000","last_unstale":"2024-09-21T07:11:14.669859+0000","last_undegraded":"2024-09-21T07:11:14.669859+0000","last_fullsized":"2024-09-21T07:11:14.669859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:13.860131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670016+0000","last_change":"2024-09-21T07:10:53.494072+0000","last_active":"2024-09-21T07:11:14.670016+0000","last_peered":"2024-09-21T07:11:14.670016+0000","last_clean":"2024-09-21T07:11:14.670016+0000","last_became_active":"2024-09-21T07:10:53.493493+0000","last_became_peered":"2024-09-21T07:10:53.493493+0000","last_unstale":"2024-09-21T07:11:14.670016+0000","last_undegraded":"2024-09-21T07:11:14.670016+0000","last_fullsized":"2024-09-21T07:11:14.670016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.846641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.736728+0000","last_change":"2024-09-21T07:10:51.468145+0000","last_active":"2024-09-21T07:11:32.736728+0000","last_peered":"2024-09-21T07:11:32.736728+0000","last_clean":"2024-09-21T07:11:32.736728+0000","last_became_active":"2024-09-21T07:10:51.467757+0000","last_became_peered":"2024-09-21T07:10:51.467757+0000","last_unstale":"2024-09-21T07:11:32.736728+0000","last_undegraded":"2024-09-21T07:11:32.736728+0000","last_fullsized":"2024-09-21T07:11:32.736728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:39.150277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670481+0000","last_change":"2024-09-21T07:11:00.548394+0000","last_active":"2024-09-21T07:11:14.670481+0000","last_peered":"2024-09-21T07:11:14.670481+0000","last_clean":"2024-09-21T07:11:14.670481+0000","last_became_active":"2024-09-21T07:11:00.547972+0000","last_became_peered":"2024-09-21T07:11:00.547972+0000","last_unstale":"2024-09-21T07:11:14.670481+0000","last_undegraded":"2024-09-21T07:11:14.670481+0000","last_fullsized":"2024-09-21T07:11:14.670481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:35.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.659342+0000","last_change":"2024-09-21T07:11:14.659248+0000","last_active":"2024-09-21T07:11:14.659342+0000","last_peered":"2024-09-21T07:11:14.659342+0000","last_clean":"2024-09-21T07:11:14.659342+0000","last_became_active":"2024-09-21T07:11:14.658931+0000","last_became_peered":"2024-09-21T07:11:14.658931+0000","last_unstale":"2024-09-21T07:11:14.659342+0000","last_undegraded":"2024-09-21T07:11:14.659342+0000","last_fullsized":"2024-09-21T07:11:14.659342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:12.278964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:42.760205+0000","last_change":"2024-09-21T07:10:51.466302+0000","last_active":"2024-09-21T07:11:42.760205+0000","last_peered":"2024-09-21T07:11:42.760205+0000","last_clean":"2024-09-21T07:11:42.760205+0000","last_became_active":"2024-09-21T07:10:51.465906+0000","last_became_peered":"2024-09-21T07:10:51.465906+0000","last_unstale":"2024-09-21T07:11:42.760205+0000","last_undegraded":"2024-09-21T07:11:42.760205+0000","last_fullsized":"2024-09-21T07:11:42.760205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:39.616338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650405+0000","last_change":"2024-09-21T07:11:00.555600+0000","last_active":"2024-09-21T07:11:14.650405+0000","last_peered":"2024-09-21T07:11:14.650405+0000","last_clean":"2024-09-21T07:11:14.650405+0000","last_became_active":"2024-09-21T07:11:00.555203+0000","last_became_peered":"2024-09-21T07:11:00.555203+0000","last_unstale":"2024-09-21T07:11:14.650405+0000","last_undegraded":"2024-09-21T07:11:14.650405+0000","last_fullsized":"2024-09-21T07:11:14.650405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654049+0000","last_change":"2024-09-21T07:10:53.482493+0000","last_active":"2024-09-21T07:11:14.654049+0000","last_peered":"2024-09-21T07:11:14.654049+0000","last_clean":"2024-09-21T07:11:14.654049+0000","last_became_active":"2024-09-21T07:10:53.481310+0000","last_became_peered":"2024-09-21T07:10:53.481310+0000","last_unstale":"2024-09-21T07:11:14.654049+0000","last_undegraded":"2024-09-21T07:11:14.654049+0000","last_fullsized":"2024-09-21T07:11:14.654049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:41.288008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.735583+0000","last_change":"2024-09-21T07:10:51.468189+0000","last_active":"2024-09-21T07:11:32.735583+0000","last_peered":"2024-09-21T07:11:32.735583+0000","last_clean":"2024-09-21T07:11:32.735583+0000","last_became_active":"2024-09-21T07:10:51.467770+0000","last_became_peered":"2024-09-21T07:10:51.467770+0000","last_unstale":"2024-09-21T07:11:32.735583+0000","last_undegraded":"2024-09-21T07:11:32.735583+0000","last_fullsized":"2024-09-21T07:11:32.735583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:53.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654632+0000","last_change":"2024-09-21T07:11:00.556306+0000","last_active":"2024-09-21T07:11:14.654632+0000","last_peered":"2024-09-21T07:11:14.654632+0000","last_clean":"2024-09-21T07:11:14.654632+0000","last_became_active":"2024-09-21T07:11:00.555770+0000","last_became_peered":"2024-09-21T07:11:00.555770+0000","last_unstale":"2024-09-21T07:11:14.654632+0000","last_undegraded":"2024-09-21T07:11:14.654632+0000","last_fullsized":"2024-09-21T07:11:14.654632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:19.438869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670030+0000","last_change":"2024-09-21T07:10:53.485039+0000","last_active":"2024-09-21T07:11:14.670030+0000","last_peered":"2024-09-21T07:11:14.670030+0000","last_clean":"2024-09-21T07:11:14.670030+0000","last_became_active":"2024-09-21T07:10:53.484672+0000","last_became_peered":"2024-09-21T07:10:53.484672+0000","last_unstale":"2024-09-21T07:11:14.670030+0000","last_undegraded":"2024-09-21T07:11:14.670030+0000","last_fullsized":"2024-09-21T07:11:14.670030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:28.291602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:33.742702+0000","last_change":"2024-09-21T07:10:51.460119+0000","last_active":"2024-09-21T07:11:33.742702+0000","last_peered":"2024-09-21T07:11:33.742702+0000","last_clean":"2024-09-21T07:11:33.742702+0000","last_became_active":"2024-09-21T07:10:51.459690+0000","last_became_peered":"2024-09-21T07:10:51.459690+0000","last_unstale":"2024-09-21T07:11:33.742702+0000","last_undegraded":"2024-09-21T07:11:33.742702+0000","last_fullsized":"2024-09-21T07:11:33.742702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:15.213300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.672946+0000","last_change":"2024-09-21T07:11:14.672269+0000","last_active":"2024-09-21T07:11:14.672946+0000","last_peered":"2024-09-21T07:11:14.672946+0000","last_clean":"2024-09-21T07:11:14.672946+0000","last_became_active":"2024-09-21T07:11:14.671740+0000","last_became_peered":"2024-09-21T07:11:14.671740+0000","last_unstale":"2024-09-21T07:11:14.672946+0000","last_undegraded":"2024-09-21T07:11:14.672946+0000","last_fullsized":"2024-09-21T07:11:14.672946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.600585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652594+0000","last_change":"2024-09-21T07:10:53.487667+0000","last_active":"2024-09-21T07:11:14.652594+0000","last_peered":"2024-09-21T07:11:14.652594+0000","last_clean":"2024-09-21T07:11:14.652594+0000","last_became_active":"2024-09-21T07:10:53.487316+0000","last_became_peered":"2024-09-21T07:10:53.487316+0000","last_unstale":"2024-09-21T07:11:14.652594+0000","last_undegraded":"2024-09-21T07:11:14.652594+0000","last_fullsized":"2024-09-21T07:11:14.652594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:33.545631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'27","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:41.761059+0000","last_change":"2024-09-21T07:10:51.465172+0000","last_active":"2024-09-21T07:11:41.761059+0000","last_peered":"2024-09-21T07:11:41.761059+0000","last_clean":"2024-09-21T07:11:41.761059+0000","last_became_active":"2024-09-21T07:10:51.464655+0000","last_became_peered":"2024-09-21T07:10:51.464655+0000","last_unstale":"2024-09-21T07:11:41.761059+0000","last_undegraded":"2024-09-21T07:11:41.761059+0000","last_fullsized":"2024-09-21T07:11:41.761059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:02.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47481,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":58,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.672745+0000","last_change":"2024-09-21T07:11:14.671892+0000","last_active":"2024-09-21T07:11:14.672745+0000","last_peered":"2024-09-21T07:11:14.672745+0000","last_clean":"2024-09-21T07:11:14.672745+0000","last_became_active":"2024-09-21T07:11:14.671283+0000","last_became_peered":"2024-09-21T07:11:14.671283+0000","last_unstale":"2024-09-21T07:11:14.672745+0000","last_undegraded":"2024-09-21T07:11:14.672745+0000","last_fullsized":"2024-09-21T07:11:14.672745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:54.263127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669478+0000","last_change":"2024-09-21T07:10:53.491873+0000","last_active":"2024-09-21T07:11:14.669478+0000","last_peered":"2024-09-21T07:11:14.669478+0000","last_clean":"2024-09-21T07:11:14.669478+0000","last_became_active":"2024-09-21T07:10:53.491424+0000","last_became_peered":"2024-09-21T07:10:53.491424+0000","last_unstale":"2024-09-21T07:11:14.669478+0000","last_undegraded":"2024-09-21T07:11:14.669478+0000","last_fullsized":"2024-09-21T07:11:14.669478+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.145391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:31.724296+0000","last_change":"2024-09-21T07:10:51.469395+0000","last_active":"2024-09-21T07:11:31.724296+0000","last_peered":"2024-09-21T07:11:31.724296+0000","last_clean":"2024-09-21T07:11:31.724296+0000","last_became_active":"2024-09-21T07:10:51.469015+0000","last_became_peered":"2024-09-21T07:10:51.469015+0000","last_unstale":"2024-09-21T07:11:31.724296+0000","last_undegraded":"2024-09-21T07:11:31.724296+0000","last_fullsized":"2024-09-21T07:11:31.724296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.274950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650611+0000","last_change":"2024-09-21T07:11:00.553164+0000","last_active":"2024-09-21T07:11:14.650611+0000","last_peered":"2024-09-21T07:11:14.650611+0000","last_clean":"2024-09-21T07:11:14.650611+0000","last_became_active":"2024-09-21T07:11:00.551969+0000","last_became_peered":"2024-09-21T07:11:00.551969+0000","last_unstale":"2024-09-21T07:11:14.650611+0000","last_undegraded":"2024-09-21T07:11:14.650611+0000","last_fullsized":"2024-09-21T07:11:14.650611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:53.042065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653104+0000","last_change":"2024-09-21T07:10:53.497110+0000","last_active":"2024-09-21T07:11:14.653104+0000","last_peered":"2024-09-21T07:11:14.653104+0000","last_clean":"2024-09-21T07:11:14.653104+0000","last_became_active":"2024-09-21T07:10:53.496751+0000","last_became_peered":"2024-09-21T07:10:53.496751+0000","last_unstale":"2024-09-21T07:11:14.653104+0000","last_undegraded":"2024-09-21T07:11:14.653104+0000","last_fullsized":"2024-09-21T07:11:14.653104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.531652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.734491+0000","last_change":"2024-09-21T07:10:51.464615+0000","last_active":"2024-09-21T07:11:32.734491+0000","last_peered":"2024-09-21T07:11:32.734491+0000","last_clean":"2024-09-21T07:11:32.734491+0000","last_became_active":"2024-09-21T07:10:51.464258+0000","last_became_peered":"2024-09-21T07:10:51.464258+0000","last_unstale":"2024-09-21T07:11:32.734491+0000","last_undegraded":"2024-09-21T07:11:32.734491+0000","last_fullsized":"2024-09-21T07:11:32.734491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:45.993865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.658255+0000","last_change":"2024-09-21T07:11:14.655255+0000","last_active":"2024-09-21T07:11:14.658255+0000","last_peered":"2024-09-21T07:11:14.658255+0000","last_clean":"2024-09-21T07:11:14.658255+0000","last_became_active":"2024-09-21T07:11:14.654556+0000","last_became_peered":"2024-09-21T07:11:14.654556+0000","last_unstale":"2024-09-21T07:11:14.658255+0000","last_undegraded":"2024-09-21T07:11:14.658255+0000","last_fullsized":"2024-09-21T07:11:14.658255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:44.435834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669921+0000","last_change":"2024-09-21T07:10:53.484990+0000","last_active":"2024-09-21T07:11:14.669921+0000","last_peered":"2024-09-21T07:11:14.669921+0000","last_clean":"2024-09-21T07:11:14.669921+0000","last_became_active":"2024-09-21T07:10:53.484570+0000","last_became_peered":"2024-09-21T07:10:53.484570+0000","last_unstale":"2024-09-21T07:11:14.669921+0000","last_undegraded":"2024-09-21T07:11:14.669921+0000","last_fullsized":"2024-09-21T07:11:14.669921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:28.848203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:41.758692+0000","last_change":"2024-09-21T07:10:51.463378+0000","last_active":"2024-09-21T07:11:41.758692+0000","last_peered":"2024-09-21T07:11:41.758692+0000","last_clean":"2024-09-21T07:11:41.758692+0000","last_became_active":"2024-09-21T07:10:51.462961+0000","last_became_peered":"2024-09-21T07:10:51.462961+0000","last_unstale":"2024-09-21T07:11:41.758692+0000","last_undegraded":"2024-09-21T07:11:41.758692+0000","last_fullsized":"2024-09-21T07:11:41.758692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:22.637603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669649+0000","last_change":"2024-09-21T07:11:00.549758+0000","last_active":"2024-09-21T07:11:14.669649+0000","last_peered":"2024-09-21T07:11:14.669649+0000","last_clean":"2024-09-21T07:11:14.669649+0000","last_became_active":"2024-09-21T07:11:00.549141+0000","last_became_peered":"2024-09-21T07:11:00.549141+0000","last_unstale":"2024-09-21T07:11:14.669649+0000","last_undegraded":"2024-09-21T07:11:14.669649+0000","last_fullsized":"2024-09-21T07:11:14.669649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:27.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653112+0000","last_change":"2024-09-21T07:11:00.550407+0000","last_active":"2024-09-21T07:11:14.653112+0000","last_peered":"2024-09-21T07:11:14.653112+0000","last_clean":"2024-09-21T07:11:14.653112+0000","last_became_active":"2024-09-21T07:11:00.549930+0000","last_became_peered":"2024-09-21T07:11:00.549930+0000","last_unstale":"2024-09-21T07:11:14.653112+0000","last_undegraded":"2024-09-21T07:11:14.653112+0000","last_fullsized":"2024-09-21T07:11:14.653112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:25.924695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.649799+0000","last_change":"2024-09-21T07:10:53.491452+0000","last_active":"2024-09-21T07:11:14.649799+0000","last_peered":"2024-09-21T07:11:14.649799+0000","last_clean":"2024-09-21T07:11:14.649799+0000","last_became_active":"2024-09-21T07:10:53.491106+0000","last_became_peered":"2024-09-21T07:10:53.491106+0000","last_unstale":"2024-09-21T07:11:14.649799+0000","last_undegraded":"2024-09-21T07:11:14.649799+0000","last_fullsized":"2024-09-21T07:11:14.649799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:58.270323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:32.735396+0000","last_change":"2024-09-21T07:10:51.468433+0000","last_active":"2024-09-21T07:11:32.735396+0000","last_peered":"2024-09-21T07:11:32.735396+0000","last_clean":"2024-09-21T07:11:32.735396+0000","last_became_active":"2024-09-21T07:10:51.467810+0000","last_became_peered":"2024-09-21T07:10:51.467810+0000","last_unstale":"2024-09-21T07:11:32.735396+0000","last_undegraded":"2024-09-21T07:11:32.735396+0000","last_fullsized":"2024-09-21T07:11:32.735396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.787584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654415+0000","last_change":"2024-09-21T07:11:00.556866+0000","last_active":"2024-09-21T07:11:14.654415+0000","last_peered":"2024-09-21T07:11:14.654415+0000","last_clean":"2024-09-21T07:11:14.654415+0000","last_became_active":"2024-09-21T07:11:00.555350+0000","last_became_peered":"2024-09-21T07:11:00.555350+0000","last_unstale":"2024-09-21T07:11:14.654415+0000","last_undegraded":"2024-09-21T07:11:14.654415+0000","last_fullsized":"2024-09-21T07:11:14.654415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:46.296771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669637+0000","last_change":"2024-09-21T07:10:53.487210+0000","last_active":"2024-09-21T07:11:14.669637+0000","last_peered":"2024-09-21T07:11:14.669637+0000","last_clean":"2024-09-21T07:11:14.669637+0000","last_became_active":"2024-09-21T07:10:53.485975+0000","last_became_peered":"2024-09-21T07:10:53.485975+0000","last_unstale":"2024-09-21T07:11:14.669637+0000","last_undegraded":"2024-09-21T07:11:14.669637+0000","last_fullsized":"2024-09-21T07:11:14.669637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:30.713990+0000","last_change":"2024-09-21T07:10:51.456418+0000","last_active":"2024-09-21T07:11:30.713990+0000","last_peered":"2024-09-21T07:11:30.713990+0000","last_clean":"2024-09-21T07:11:30.713990+0000","last_became_active":"2024-09-21T07:10:51.455885+0000","last_became_peered":"2024-09-21T07:10:51.455885+0000","last_unstale":"2024-09-21T07:11:30.713990+0000","last_undegraded":"2024-09-21T07:11:30.713990+0000","last_fullsized":"2024-09-21T07:11:30.713990+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:53.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:31.725529+0000","last_change":"2024-09-21T07:10:51.462544+0000","last_active":"2024-09-21T07:11:31.725529+0000","last_peered":"2024-09-21T07:11:31.725529+0000","last_clean":"2024-09-21T07:11:31.725529+0000","last_became_active":"2024-09-21T07:10:51.462075+0000","last_became_peered":"2024-09-21T07:10:51.462075+0000","last_unstale":"2024-09-21T07:11:31.725529+0000","last_undegraded":"2024-09-21T07:11:31.725529+0000","last_fullsized":"2024-09-21T07:11:31.725529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:09.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670214+0000","last_change":"2024-09-21T07:10:53.492369+0000","last_active":"2024-09-21T07:11:14.670214+0000","last_peered":"2024-09-21T07:11:14.670214+0000","last_clean":"2024-09-21T07:11:14.670214+0000","last_became_active":"2024-09-21T07:10:53.492011+0000","last_became_peered":"2024-09-21T07:10:53.492011+0000","last_unstale":"2024-09-21T07:11:14.670214+0000","last_undegraded":"2024-09-21T07:11:14.670214+0000","last_fullsized":"2024-09-21T07:11:14.670214+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:53.513277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650649+0000","last_change":"2024-09-21T07:11:00.552908+0000","last_active":"2024-09-21T07:11:14.650649+0000","last_peered":"2024-09-21T07:11:14.650649+0000","last_clean":"2024-09-21T07:11:14.650649+0000","last_became_active":"2024-09-21T07:11:00.552303+0000","last_became_peered":"2024-09-21T07:11:00.552303+0000","last_unstale":"2024-09-21T07:11:14.650649+0000","last_undegraded":"2024-09-21T07:11:14.650649+0000","last_fullsized":"2024-09-21T07:11:14.650649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:42.761134+0000","last_change":"2024-09-21T07:10:51.467072+0000","last_active":"2024-09-21T07:11:42.761134+0000","last_peered":"2024-09-21T07:11:42.761134+0000","last_clean":"2024-09-21T07:11:42.761134+0000","last_became_active":"2024-09-21T07:10:51.466671+0000","last_became_peered":"2024-09-21T07:10:51.466671+0000","last_unstale":"2024-09-21T07:11:42.761134+0000","last_undegraded":"2024-09-21T07:11:42.761134+0000","last_fullsized":"2024-09-21T07:11:42.761134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:24.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652141+0000","last_change":"2024-09-21T07:10:53.480057+0000","last_active":"2024-09-21T07:11:14.652141+0000","last_peered":"2024-09-21T07:11:14.652141+0000","last_clean":"2024-09-21T07:11:14.652141+0000","last_became_active":"2024-09-21T07:10:53.479644+0000","last_became_peered":"2024-09-21T07:10:53.479644+0000","last_unstale":"2024-09-21T07:11:14.652141+0000","last_undegraded":"2024-09-21T07:11:14.652141+0000","last_fullsized":"2024-09-21T07:11:14.652141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:34.255547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650784+0000","last_change":"2024-09-21T07:11:00.550259+0000","last_active":"2024-09-21T07:11:14.650784+0000","last_peered":"2024-09-21T07:11:14.650784+0000","last_clean":"2024-09-21T07:11:14.650784+0000","last_became_active":"2024-09-21T07:11:00.549771+0000","last_became_peered":"2024-09-21T07:11:00.549771+0000","last_unstale":"2024-09-21T07:11:14.650784+0000","last_undegraded":"2024-09-21T07:11:14.650784+0000","last_fullsized":"2024-09-21T07:11:14.650784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654149+0000","last_change":"2024-09-21T07:10:53.488022+0000","last_active":"2024-09-21T07:11:14.654149+0000","last_peered":"2024-09-21T07:11:14.654149+0000","last_clean":"2024-09-21T07:11:14.654149+0000","last_became_active":"2024-09-21T07:10:53.487605+0000","last_became_peered":"2024-09-21T07:10:53.487605+0000","last_unstale":"2024-09-21T07:11:14.654149+0000","last_undegraded":"2024-09-21T07:11:14.654149+0000","last_fullsized":"2024-09-21T07:11:14.654149+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:02.074960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650869+0000","last_change":"2024-09-21T07:10:53.484319+0000","last_active":"2024-09-21T07:11:14.650869+0000","last_peered":"2024-09-21T07:11:14.650869+0000","last_clean":"2024-09-21T07:11:14.650869+0000","last_became_active":"2024-09-21T07:10:53.483942+0000","last_became_peered":"2024-09-21T07:10:53.483942+0000","last_unstale":"2024-09-21T07:11:14.650869+0000","last_undegraded":"2024-09-21T07:11:14.650869+0000","last_fullsized":"2024-09-21T07:11:14.650869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:50.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650289+0000","last_change":"2024-09-21T07:10:53.494981+0000","last_active":"2024-09-21T07:11:14.650289+0000","last_peered":"2024-09-21T07:11:14.650289+0000","last_clean":"2024-09-21T07:11:14.650289+0000","last_became_active":"2024-09-21T07:10:53.494580+0000","last_became_peered":"2024-09-21T07:10:53.494580+0000","last_unstale":"2024-09-21T07:11:14.650289+0000","last_undegraded":"2024-09-21T07:11:14.650289+0000","last_fullsized":"2024-09-21T07:11:14.650289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:57.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652181+0000","last_change":"2024-09-21T07:10:53.492971+0000","last_active":"2024-09-21T07:11:14.652181+0000","last_peered":"2024-09-21T07:11:14.652181+0000","last_clean":"2024-09-21T07:11:14.652181+0000","last_became_active":"2024-09-21T07:10:53.492597+0000","last_became_peered":"2024-09-21T07:10:53.492597+0000","last_unstale":"2024-09-21T07:11:14.652181+0000","last_undegraded":"2024-09-21T07:11:14.652181+0000","last_fullsized":"2024-09-21T07:11:14.652181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.931998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670334+0000","last_change":"2024-09-21T07:10:53.485613+0000","last_active":"2024-09-21T07:11:14.670334+0000","last_peered":"2024-09-21T07:11:14.670334+0000","last_clean":"2024-09-21T07:11:14.670334+0000","last_became_active":"2024-09-21T07:10:53.485268+0000","last_became_peered":"2024-09-21T07:10:53.485268+0000","last_unstale":"2024-09-21T07:11:14.670334+0000","last_undegraded":"2024-09-21T07:11:14.670334+0000","last_fullsized":"2024-09-21T07:11:14.670334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:52.496426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.655118+0000","last_change":"2024-09-21T07:10:53.489349+0000","last_active":"2024-09-21T07:11:14.655118+0000","last_peered":"2024-09-21T07:11:14.655118+0000","last_clean":"2024-09-21T07:11:14.655118+0000","last_became_active":"2024-09-21T07:10:53.488986+0000","last_became_peered":"2024-09-21T07:10:53.488986+0000","last_unstale":"2024-09-21T07:11:14.655118+0000","last_undegraded":"2024-09-21T07:11:14.655118+0000","last_fullsized":"2024-09-21T07:11:14.655118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:46.376689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651080+0000","last_change":"2024-09-21T07:10:53.485740+0000","last_active":"2024-09-21T07:11:14.651080+0000","last_peered":"2024-09-21T07:11:14.651080+0000","last_clean":"2024-09-21T07:11:14.651080+0000","last_became_active":"2024-09-21T07:10:53.485375+0000","last_became_peered":"2024-09-21T07:10:53.485375+0000","last_unstale":"2024-09-21T07:11:14.651080+0000","last_undegraded":"2024-09-21T07:11:14.651080+0000","last_fullsized":"2024-09-21T07:11:14.651080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:40.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.671496+0000","last_change":"2024-09-21T07:10:53.490211+0000","last_active":"2024-09-21T07:11:14.671496+0000","last_peered":"2024-09-21T07:11:14.671496+0000","last_clean":"2024-09-21T07:11:14.671496+0000","last_became_active":"2024-09-21T07:10:53.489504+0000","last_became_peered":"2024-09-21T07:10:53.489504+0000","last_unstale":"2024-09-21T07:11:14.671496+0000","last_undegraded":"2024-09-21T07:11:14.671496+0000","last_fullsized":"2024-09-21T07:11:14.671496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:50.337307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669771+0000","last_change":"2024-09-21T07:10:53.486064+0000","last_active":"2024-09-21T07:11:14.669771+0000","last_peered":"2024-09-21T07:11:14.669771+0000","last_clean":"2024-09-21T07:11:14.669771+0000","last_became_active":"2024-09-21T07:10:53.485674+0000","last_became_peered":"2024-09-21T07:10:53.485674+0000","last_unstale":"2024-09-21T07:11:14.669771+0000","last_undegraded":"2024-09-21T07:11:14.669771+0000","last_fullsized":"2024-09-21T07:11:14.669771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:55.232795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669833+0000","last_change":"2024-09-21T07:10:53.489008+0000","last_active":"2024-09-21T07:11:14.669833+0000","last_peered":"2024-09-21T07:11:14.669833+0000","last_clean":"2024-09-21T07:11:14.669833+0000","last_became_active":"2024-09-21T07:10:53.488655+0000","last_became_peered":"2024-09-21T07:10:53.488655+0000","last_unstale":"2024-09-21T07:11:14.669833+0000","last_undegraded":"2024-09-21T07:11:14.669833+0000","last_fullsized":"2024-09-21T07:11:14.669833+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:42.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669390+0000","last_change":"2024-09-21T07:10:53.490147+0000","last_active":"2024-09-21T07:11:14.669390+0000","last_peered":"2024-09-21T07:11:14.669390+0000","last_clean":"2024-09-21T07:11:14.669390+0000","last_became_active":"2024-09-21T07:10:53.488389+0000","last_became_peered":"2024-09-21T07:10:53.488389+0000","last_unstale":"2024-09-21T07:11:14.669390+0000","last_undegraded":"2024-09-21T07:11:14.669390+0000","last_fullsized":"2024-09-21T07:11:14.669390+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:17.729856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670191+0000","last_change":"2024-09-21T07:10:53.486557+0000","last_active":"2024-09-21T07:11:14.670191+0000","last_peered":"2024-09-21T07:11:14.670191+0000","last_clean":"2024-09-21T07:11:14.670191+0000","last_became_active":"2024-09-21T07:10:53.486248+0000","last_became_peered":"2024-09-21T07:10:53.486248+0000","last_unstale":"2024-09-21T07:11:14.670191+0000","last_undegraded":"2024-09-21T07:11:14.670191+0000","last_fullsized":"2024-09-21T07:11:14.670191+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.675717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.654802+0000","last_change":"2024-09-21T07:10:53.485281+0000","last_active":"2024-09-21T07:11:14.654802+0000","last_peered":"2024-09-21T07:11:14.654802+0000","last_clean":"2024-09-21T07:11:14.654802+0000","last_became_active":"2024-09-21T07:10:53.484732+0000","last_became_peered":"2024-09-21T07:10:53.484732+0000","last_unstale":"2024-09-21T07:11:14.654802+0000","last_undegraded":"2024-09-21T07:11:14.654802+0000","last_fullsized":"2024-09-21T07:11:14.654802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:53.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651038+0000","last_change":"2024-09-21T07:10:53.483192+0000","last_active":"2024-09-21T07:11:14.651038+0000","last_peered":"2024-09-21T07:11:14.651038+0000","last_clean":"2024-09-21T07:11:14.651038+0000","last_became_active":"2024-09-21T07:10:53.482402+0000","last_became_peered":"2024-09-21T07:10:53.482402+0000","last_unstale":"2024-09-21T07:11:14.651038+0000","last_undegraded":"2024-09-21T07:11:14.651038+0000","last_fullsized":"2024-09-21T07:11:14.651038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.159873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.650310+0000","last_change":"2024-09-21T07:10:53.481463+0000","last_active":"2024-09-21T07:11:14.650310+0000","last_peered":"2024-09-21T07:11:14.650310+0000","last_clean":"2024-09-21T07:11:14.650310+0000","last_became_active":"2024-09-21T07:10:53.481129+0000","last_became_peered":"2024-09-21T07:10:53.481129+0000","last_unstale":"2024-09-21T07:11:14.650310+0000","last_undegraded":"2024-09-21T07:11:14.650310+0000","last_fullsized":"2024-09-21T07:11:14.650310+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:14.547936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.655954+0000","last_change":"2024-09-21T07:10:53.493009+0000","last_active":"2024-09-21T07:11:14.655954+0000","last_peered":"2024-09-21T07:11:14.655954+0000","last_clean":"2024-09-21T07:11:14.655954+0000","last_became_active":"2024-09-21T07:10:53.492300+0000","last_became_peered":"2024-09-21T07:10:53.492300+0000","last_unstale":"2024-09-21T07:11:14.655954+0000","last_undegraded":"2024-09-21T07:11:14.655954+0000","last_fullsized":"2024-09-21T07:11:14.655954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:09.890248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.669036+0000","last_change":"2024-09-21T07:10:53.491149+0000","last_active":"2024-09-21T07:11:14.669036+0000","last_peered":"2024-09-21T07:11:14.669036+0000","last_clean":"2024-09-21T07:11:14.669036+0000","last_became_active":"2024-09-21T07:10:53.490766+0000","last_became_peered":"2024-09-21T07:10:53.490766+0000","last_unstale":"2024-09-21T07:11:14.669036+0000","last_undegraded":"2024-09-21T07:11:14.669036+0000","last_fullsized":"2024-09-21T07:11:14.669036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:52.243083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.672557+0000","last_change":"2024-09-21T07:11:14.672453+0000","last_active":"2024-09-21T07:11:14.672557+0000","last_peered":"2024-09-21T07:11:14.672557+0000","last_clean":"2024-09-21T07:11:14.672557+0000","last_became_active":"2024-09-21T07:11:14.671584+0000","last_became_peered":"2024-09-21T07:11:14.671584+0000","last_unstale":"2024-09-21T07:11:14.672557+0000","last_undegraded":"2024-09-21T07:11:14.672557+0000","last_fullsized":"2024-09-21T07:11:14.672557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:25.746195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652222+0000","last_change":"2024-09-21T07:10:53.496332+0000","last_active":"2024-09-21T07:11:14.652222+0000","last_peered":"2024-09-21T07:11:14.652222+0000","last_clean":"2024-09-21T07:11:14.652222+0000","last_became_active":"2024-09-21T07:10:53.495078+0000","last_became_peered":"2024-09-21T07:10:53.495078+0000","last_unstale":"2024-09-21T07:11:14.652222+0000","last_undegraded":"2024-09-21T07:11:14.652222+0000","last_fullsized":"2024-09-21T07:11:14.652222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:32.415350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670093+0000","last_change":"2024-09-21T07:10:53.478381+0000","last_active":"2024-09-21T07:11:14.670093+0000","last_peered":"2024-09-21T07:11:14.670093+0000","last_clean":"2024-09-21T07:11:14.670093+0000","last_became_active":"2024-09-21T07:10:53.478021+0000","last_became_peered":"2024-09-21T07:10:53.478021+0000","last_unstale":"2024-09-21T07:11:14.670093+0000","last_undegraded":"2024-09-21T07:11:14.670093+0000","last_fullsized":"2024-09-21T07:11:14.670093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:02.496263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651079+0000","last_change":"2024-09-21T07:10:53.485103+0000","last_active":"2024-09-21T07:11:14.651079+0000","last_peered":"2024-09-21T07:11:14.651079+0000","last_clean":"2024-09-21T07:11:14.651079+0000","last_became_active":"2024-09-21T07:10:53.483835+0000","last_became_peered":"2024-09-21T07:10:53.483835+0000","last_unstale":"2024-09-21T07:11:14.651079+0000","last_undegraded":"2024-09-21T07:11:14.651079+0000","last_fullsized":"2024-09-21T07:11:14.651079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:47.775202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653303+0000","last_change":"2024-09-21T07:10:53.490497+0000","last_active":"2024-09-21T07:11:14.653303+0000","last_peered":"2024-09-21T07:11:14.653303+0000","last_clean":"2024-09-21T07:11:14.653303+0000","last_became_active":"2024-09-21T07:10:53.490137+0000","last_became_peered":"2024-09-21T07:10:53.490137+0000","last_unstale":"2024-09-21T07:11:14.653303+0000","last_undegraded":"2024-09-21T07:11:14.653303+0000","last_fullsized":"2024-09-21T07:11:14.653303+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:12.090628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.655486+0000","last_change":"2024-09-21T07:10:53.487118+0000","last_active":"2024-09-21T07:11:14.655486+0000","last_peered":"2024-09-21T07:11:14.655486+0000","last_clean":"2024-09-21T07:11:14.655486+0000","last_became_active":"2024-09-21T07:10:53.486582+0000","last_became_peered":"2024-09-21T07:10:53.486582+0000","last_unstale":"2024-09-21T07:11:14.655486+0000","last_undegraded":"2024-09-21T07:11:14.655486+0000","last_fullsized":"2024-09-21T07:11:14.655486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:00.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670066+0000","last_change":"2024-09-21T07:10:53.497390+0000","last_active":"2024-09-21T07:11:14.670066+0000","last_peered":"2024-09-21T07:11:14.670066+0000","last_clean":"2024-09-21T07:11:14.670066+0000","last_became_active":"2024-09-21T07:10:53.497043+0000","last_became_peered":"2024-09-21T07:10:53.497043+0000","last_unstale":"2024-09-21T07:11:14.670066+0000","last_undegraded":"2024-09-21T07:11:14.670066+0000","last_fullsized":"2024-09-21T07:11:14.670066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:36.912873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.670105+0000","last_change":"2024-09-21T07:10:53.484624+0000","last_active":"2024-09-21T07:11:14.670105+0000","last_peered":"2024-09-21T07:11:14.670105+0000","last_clean":"2024-09-21T07:11:14.670105+0000","last_became_active":"2024-09-21T07:10:53.484278+0000","last_became_peered":"2024-09-21T07:10:53.484278+0000","last_unstale":"2024-09-21T07:11:14.670105+0000","last_undegraded":"2024-09-21T07:11:14.670105+0000","last_fullsized":"2024-09-21T07:11:14.670105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:41.464442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652894+0000","last_change":"2024-09-21T07:10:53.478146+0000","last_active":"2024-09-21T07:11:14.652894+0000","last_peered":"2024-09-21T07:11:14.652894+0000","last_clean":"2024-09-21T07:11:14.652894+0000","last_became_active":"2024-09-21T07:10:53.477733+0000","last_became_peered":"2024-09-21T07:10:53.477733+0000","last_unstale":"2024-09-21T07:11:14.652894+0000","last_undegraded":"2024-09-21T07:11:14.652894+0000","last_fullsized":"2024-09-21T07:11:14.652894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:09.159966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.657394+0000","last_change":"2024-09-21T07:11:14.657274+0000","last_active":"2024-09-21T07:11:14.657394+0000","last_peered":"2024-09-21T07:11:14.657394+0000","last_clean":"2024-09-21T07:11:14.657394+0000","last_became_active":"2024-09-21T07:11:14.656826+0000","last_became_peered":"2024-09-21T07:11:14.656826+0000","last_unstale":"2024-09-21T07:11:14.657394+0000","last_undegraded":"2024-09-21T07:11:14.657394+0000","last_fullsized":"2024-09-21T07:11:14.657394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.688373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.652116+0000","last_change":"2024-09-21T07:10:53.481411+0000","last_active":"2024-09-21T07:11:14.652116+0000","last_peered":"2024-09-21T07:11:14.652116+0000","last_clean":"2024-09-21T07:11:14.652116+0000","last_became_active":"2024-09-21T07:10:53.481005+0000","last_became_peered":"2024-09-21T07:10:53.481005+0000","last_unstale":"2024-09-21T07:11:14.652116+0000","last_undegraded":"2024-09-21T07:11:14.652116+0000","last_fullsized":"2024-09-21T07:11:14.652116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:41.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651020+0000","last_change":"2024-09-21T07:10:53.487481+0000","last_active":"2024-09-21T07:11:14.651020+0000","last_peered":"2024-09-21T07:11:14.651020+0000","last_clean":"2024-09-21T07:11:14.651020+0000","last_became_active":"2024-09-21T07:10:53.486277+0000","last_became_peered":"2024-09-21T07:10:53.486277+0000","last_unstale":"2024-09-21T07:11:14.651020+0000","last_undegraded":"2024-09-21T07:11:14.651020+0000","last_fullsized":"2024-09-21T07:11:14.651020+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:57.304382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.651847+0000","last_change":"2024-09-21T07:10:53.495971+0000","last_active":"2024-09-21T07:11:14.651847+0000","last_peered":"2024-09-21T07:11:14.651847+0000","last_clean":"2024-09-21T07:11:14.651847+0000","last_became_active":"2024-09-21T07:10:53.495124+0000","last_became_peered":"2024-09-21T07:10:53.495124+0000","last_unstale":"2024-09-21T07:11:14.651847+0000","last_undegraded":"2024-09-21T07:11:14.651847+0000","last_fullsized":"2024-09-21T07:11:14.651847+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.653213+0000","last_change":"2024-09-21T07:10:53.497538+0000","last_active":"2024-09-21T07:11:14.653213+0000","last_peered":"2024-09-21T07:11:14.653213+0000","last_clean":"2024-09-21T07:11:14.653213+0000","last_became_active":"2024-09-21T07:10:53.496835+0000","last_became_peered":"2024-09-21T07:10:53.496835+0000","last_unstale":"2024-09-21T07:11:14.653213+0000","last_undegraded":"2024-09-21T07:11:14.653213+0000","last_fullsized":"2024-09-21T07:11:14.653213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:17.187282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T07:11:14.655815+0000","last_change":"2024-09-21T07:10:53.492646+0000","last_active":"2024-09-21T07:11:14.655815+0000","last_peered":"2024-09-21T07:11:14.655815+0000","last_clean":"2024-09-21T07:11:14.655815+0000","last_became_active":"2024-09-21T07:10:53.491818+0000","last_became_peered":"2024-09-21T07:10:53.491818+0000","last_unstale":"2024-09-21T07:11:14.655815+0000","last_undegraded":"2024-09-21T07:11:14.655815+0000","last_fullsized":"2024-09-21T07:11:14.655815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:37.094158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54685,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":138,"num_read_kb":130,"num_write":232,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":177383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283164,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710742,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":486697,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906972,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1073152,"data_stored":1125481,"data_compressed":59655,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070497,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":486627,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266727,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":487005,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462955,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":1083893,"data_compressed":59655,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626479,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":482131,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822709,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1015808,"data_stored":1079084,"data_compressed":59655,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986235,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":486596,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":481839,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378692,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":531253,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542217,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":543970,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705744,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":483587,"data_compressed":23652,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":49608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:11:49.865 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:11:49.865 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T07:11:49.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T07:11:50.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:49 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:11:50.028 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:49 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:11:50.802 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:50.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:50 smithi092 ceph-mon[30987]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:11:50.957 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:50 smithi092 ceph-mon[30987]: pgmap v300: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 15 op/s 2024-09-21T07:11:51.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:50 smithi175 ceph-mon[34064]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:11:51.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:50 smithi175 ceph-mon[34064]: pgmap v300: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 15 op/s 2024-09-21T07:11:51.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:50 smithi169 ceph-mon[33705]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:11:51.146 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:50 smithi169 ceph-mon[33705]: pgmap v300: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 15 op/s 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.315+0000 7f25ede4d640 1 -- 172.21.15.92:0/3005153467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e81083c0 msgr2=0x7f25e81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.315+0000 7f25ede4d640 1 --2- 172.21.15.92:0/3005153467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e81083c0 0x7f25e81087d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009900 tx=0x7f25d002a410 comp rx=0 tx=0).stop 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.315+0000 7f25ede4d640 1 -- 172.21.15.92:0/3005153467 shutdown_connections 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.315+0000 7f25ede4d640 1 --2- 172.21.15.92:0/3005153467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e8108d10 0x7f25e810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.315+0000 7f25ede4d640 1 --2- 172.21.15.92:0/3005153467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e81083c0 0x7f25e81087d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.315+0000 7f25ede4d640 1 --2- 172.21.15.92:0/3005153467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25e8102a80 0x7f25e8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.315+0000 7f25ede4d640 1 -- 172.21.15.92:0/3005153467 >> 172.21.15.92:0/3005153467 conn(0x7f25e80798c0 msgr2=0x7f25e8079cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.315+0000 7f25ede4d640 1 -- 172.21.15.92:0/3005153467 shutdown_connections 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.315+0000 7f25ede4d640 1 -- 172.21.15.92:0/3005153467 wait complete. 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25ede4d640 1 Processor -- start 2024-09-21T07:11:51.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25ede4d640 1 -- start start 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25ede4d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25e8102a80 0x7f25e8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25ede4d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e81083c0 0x7f25e81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25ede4d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e8108d10 0x7f25e819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25ede4d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25e8112880 con 0x7f25e8108d10 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25ede4d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f25e8112700 con 0x7f25e8102a80 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25ede4d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25e8112a00 con 0x7f25e81083c0 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e77fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25e8102a80 0x7f25e8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e8108d10 0x7f25e819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e77fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25e8102a80 0x7f25e8199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:47826/0 (socket says 172.21.15.92:47826) 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e8108d10 0x7f25e819eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55128/0 (socket says 172.21.15.92:55128) 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e77fe640 1 -- 172.21.15.92:0/190947038 learned_addr learned my addr 172.21.15.92:0/190947038 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:51.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25dffff640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e81083c0 0x7f25e81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e7fff640 1 -- 172.21.15.92:0/190947038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e81083c0 msgr2=0x7f25e81998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e7fff640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e81083c0 0x7f25e81998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e7fff640 1 -- 172.21.15.92:0/190947038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25e8102a80 msgr2=0x7f25e8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e7fff640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25e8102a80 0x7f25e8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e7fff640 1 -- 172.21.15.92:0/190947038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e819f2a0 con 0x7f25e8108d10 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.316+0000 7f25e77fe640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25e8102a80 0x7f25e8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.317+0000 7f25e7fff640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e8108d10 0x7f25e819eb70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009fd0 tx=0x7f25e000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.317+0000 7f25e57fa640 1 -- 172.21.15.92:0/190947038 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e000ce20 con 0x7f25e8108d10 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.317+0000 7f25ede4d640 1 -- 172.21.15.92:0/190947038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e819f590 con 0x7f25e8108d10 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.317+0000 7f25e57fa640 1 -- 172.21.15.92:0/190947038 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25e0005020 con 0x7f25e8108d10 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.317+0000 7f25e57fa640 1 -- 172.21.15.92:0/190947038 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e0010690 con 0x7f25e8108d10 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.317+0000 7f25ede4d640 1 -- 172.21.15.92:0/190947038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e81a5cf0 con 0x7f25e8108d10 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.318+0000 7f25ede4d640 1 -- 172.21.15.92:0/190947038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e8103d00 con 0x7f25e8108d10 2024-09-21T07:11:51.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.319+0000 7f25e57fa640 1 -- 172.21.15.92:0/190947038 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f25e0004a40 con 0x7f25e8108d10 2024-09-21T07:11:51.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.320+0000 7f25e57fa640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25d40b65f0 0x7f25d40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.320+0000 7f25e77fe640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25d40b65f0 0x7f25d40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.320+0000 7f25e57fa640 1 -- 172.21.15.92:0/190947038 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f25e00e7f60 con 0x7f25e8108d10 2024-09-21T07:11:51.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.321+0000 7f25e77fe640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25d40b65f0 0x7f25d40b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25d8005fd0 tx=0x7f25d800b480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.323+0000 7f25e57fa640 1 -- 172.21.15.92:0/190947038 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25e00ae2f0 con 0x7f25e8108d10 2024-09-21T07:11:51.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.612+0000 7f25ede4d640 1 -- 172.21.15.92:0/190947038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f25e8102e90 con 0x7f25e8108d10 2024-09-21T07:11:51.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.621+0000 7f25e57fa640 1 -- 172.21.15.92:0/190947038 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f25e8102e90 con 0x7f25e8108d10 2024-09-21T07:11:51.623 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2024-09-21T07:11:51.623 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQC3ce5miO2xJBAAhIddRufdjPMl/N7q/VVksg== 2024-09-21T07:11:51.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.624+0000 7f25ede4d640 1 -- 172.21.15.92:0/190947038 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25d40b65f0 msgr2=0x7f25d40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.624+0000 7f25ede4d640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25d40b65f0 0x7f25d40b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25d8005fd0 tx=0x7f25d800b480 comp rx=0 tx=0).stop 2024-09-21T07:11:51.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.624+0000 7f25ede4d640 1 -- 172.21.15.92:0/190947038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e8108d10 msgr2=0x7f25e819eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.624+0000 7f25ede4d640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e8108d10 0x7f25e819eb70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009fd0 tx=0x7f25e000ef10 comp rx=0 tx=0).stop 2024-09-21T07:11:51.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.625+0000 7f25ede4d640 1 -- 172.21.15.92:0/190947038 shutdown_connections 2024-09-21T07:11:51.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.625+0000 7f25ede4d640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25d40b65f0 0x7f25d40b8b00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.625+0000 7f25ede4d640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25e8108d10 0x7f25e819eb70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.625+0000 7f25ede4d640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e81083c0 0x7f25e81998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.625+0000 7f25ede4d640 1 --2- 172.21.15.92:0/190947038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25e8102a80 0x7f25e8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.625+0000 7f25ede4d640 1 -- 172.21.15.92:0/190947038 >> 172.21.15.92:0/190947038 conn(0x7f25e80798c0 msgr2=0x7f25e8106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:51.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.625+0000 7f25ede4d640 1 -- 172.21.15.92:0/190947038 shutdown_connections 2024-09-21T07:11:51.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:51.625+0000 7f25ede4d640 1 -- 172.21.15.92:0/190947038 wait complete. 2024-09-21T07:11:51.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:51 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:51.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:51 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:51.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:51 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:51.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:51 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:51.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:51 smithi092 ceph-mon[30987]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.5 KiB/s wr, 11 op/s 2024-09-21T07:11:51.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:51 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:51.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:51 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/190947038' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:11:51.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:51 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:51.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:51 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/190947038' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:11:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:51 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:51 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:51 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:51 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:51 smithi169 ceph-mon[33705]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.5 KiB/s wr, 11 op/s 2024-09-21T07:11:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:51 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:51 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/190947038' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:11:52.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:51 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:51 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/190947038' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:11:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:51 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:51 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:51 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:51 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:51 smithi175 ceph-mon[34064]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.5 KiB/s wr, 11 op/s 2024-09-21T07:11:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:51 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:51 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/190947038' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:11:52.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:51 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:52.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:51 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/190947038' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:11:52.318 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:11:52.318 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T07:11:52.318 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T07:11:52.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T07:11:52.638 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:53.052 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:52 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:11:53.052 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:52 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:11:53.052 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:52 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:53.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:52 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:11:53.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:52 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:11:53.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:52 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.141+0000 7f1c9261b640 1 -- 172.21.15.92:0/912999856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c109df0 msgr2=0x7f1c8c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.141+0000 7f1c9261b640 1 --2- 172.21.15.92:0/912999856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c109df0 0x7f1c8c110620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009ca0 tx=0x7f1c8402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.141+0000 7f1c9261b640 1 -- 172.21.15.92:0/912999856 shutdown_connections 2024-09-21T07:11:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.141+0000 7f1c9261b640 1 --2- 172.21.15.92:0/912999856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c109df0 0x7f1c8c110620 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.141+0000 7f1c9261b640 1 --2- 172.21.15.92:0/912999856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c8c1094a0 0x7f1c8c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.141+0000 7f1c9261b640 1 --2- 172.21.15.92:0/912999856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c8c103b60 0x7f1c8c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.141+0000 7f1c9261b640 1 -- 172.21.15.92:0/912999856 >> 172.21.15.92:0/912999856 conn(0x7f1c8c07b850 msgr2=0x7f1c8c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.141+0000 7f1c9261b640 1 -- 172.21.15.92:0/912999856 shutdown_connections 2024-09-21T07:11:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.141+0000 7f1c9261b640 1 -- 172.21.15.92:0/912999856 wait complete. 2024-09-21T07:11:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.142+0000 7f1c9261b640 1 Processor -- start 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.142+0000 7f1c9261b640 1 -- start start 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c9261b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c8c103b60 0x7f1c8c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c9261b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c8c1094a0 0x7f1c8c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c9261b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c109df0 0x7f1c8c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c9261b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c1139b0 con 0x7f1c8c109df0 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c9261b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c113830 con 0x7f1c8c103b60 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c9261b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c113b30 con 0x7f1c8c1094a0 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c90bb8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c109df0 0x7f1c8c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c90bb8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c109df0 0x7f1c8c19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55150/0 (socket says 172.21.15.92:55150) 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c90bb8640 1 -- 172.21.15.92:0/2244636661 learned_addr learned my addr 172.21.15.92:0/2244636661 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c8bfff640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c8c103b60 0x7f1c8c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c83fff640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c8c1094a0 0x7f1c8c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c90bb8640 1 -- 172.21.15.92:0/2244636661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c8c1094a0 msgr2=0x7f1c8c19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c90bb8640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c8c1094a0 0x7f1c8c19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c90bb8640 1 -- 172.21.15.92:0/2244636661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c8c103b60 msgr2=0x7f1c8c19a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c90bb8640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c8c103b60 0x7f1c8c19a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c90bb8640 1 -- 172.21.15.92:0/2244636661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8c1a0370 con 0x7f1c8c109df0 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c90bb8640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c109df0 0x7f1c8c19fc40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1c84005cc0 tx=0x7f1c84032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c89ffb640 1 -- 172.21.15.92:0/2244636661 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84032e00 con 0x7f1c8c109df0 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c89ffb640 1 -- 172.21.15.92:0/2244636661 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c840044d0 con 0x7f1c8c109df0 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c9261b640 1 -- 172.21.15.92:0/2244636661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8c1a0600 con 0x7f1c8c109df0 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c89ffb640 1 -- 172.21.15.92:0/2244636661 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84030b70 con 0x7f1c8c109df0 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.143+0000 7f1c9261b640 1 -- 172.21.15.92:0/2244636661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8c1a6dc0 con 0x7f1c8c109df0 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.145+0000 7f1c9261b640 1 -- 172.21.15.92:0/2244636661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8c103f70 con 0x7f1c8c109df0 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.146+0000 7f1c89ffb640 1 -- 172.21.15.92:0/2244636661 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f1c84004680 con 0x7f1c8c109df0 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.147+0000 7f1c89ffb640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c780b6670 0x7f1c780b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.147+0000 7f1c8bfff640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c780b6670 0x7f1c780b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.147+0000 7f1c89ffb640 1 -- 172.21.15.92:0/2244636661 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f1c84108a60 con 0x7f1c8c109df0 2024-09-21T07:11:53.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.147+0000 7f1c8bfff640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c780b6670 0x7f1c780b8b80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00bbe0 tx=0x7f1c7c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.152+0000 7f1c89ffb640 1 -- 172.21.15.92:0/2244636661 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c840ced60 con 0x7f1c8c109df0 2024-09-21T07:11:53.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:52 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:11:53.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:52 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:11:53.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:52 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:11:53.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.329+0000 7f1c9261b640 1 -- 172.21.15.92:0/2244636661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f1c8c10b650 con 0x7f1c8c109df0 2024-09-21T07:11:53.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.330+0000 7f1c89ffb640 1 -- 172.21.15.92:0/2244636661 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v55) ==== 86+0+133 (secure 0 0 0) 0x7f1c840d3140 con 0x7f1c8c109df0 2024-09-21T07:11:53.332 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:53.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 -- 172.21.15.92:0/2244636661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c780b6670 msgr2=0x7f1c780b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c780b6670 0x7f1c780b8b80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00bbe0 tx=0x7f1c7c00b390 comp rx=0 tx=0).stop 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 -- 172.21.15.92:0/2244636661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c109df0 msgr2=0x7f1c8c19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c109df0 0x7f1c8c19fc40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1c84005cc0 tx=0x7f1c84032a10 comp rx=0 tx=0).stop 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 -- 172.21.15.92:0/2244636661 shutdown_connections 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c780b6670 0x7f1c780b8b80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c109df0 0x7f1c8c19fc40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c8c1094a0 0x7f1c8c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 --2- 172.21.15.92:0/2244636661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c8c103b60 0x7f1c8c19a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 -- 172.21.15.92:0/2244636661 >> 172.21.15.92:0/2244636661 conn(0x7f1c8c07b850 msgr2=0x7f1c8c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 -- 172.21.15.92:0/2244636661 shutdown_connections 2024-09-21T07:11:53.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:53.334+0000 7f1c9261b640 1 -- 172.21.15.92:0/2244636661 wait complete. 2024-09-21T07:11:54.024 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:53 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2244636661' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:11:54.024 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:53 smithi092 ceph-mon[30987]: pgmap v302: 129 pgs: 129 active+clean; 647 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-21T07:11:54.051 INFO:teuthology.orchestra.run.smithi092.stdout:[{"version":55,"timestamp":"2024-09-21T07:10:43.989988+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T07:11:54.052 INFO:tasks.ceph_manager:config epoch is 55 2024-09-21T07:11:54.052 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T07:11:54.052 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T07:11:54.052 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T07:11:54.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:53 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2244636661' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:11:54.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:53 smithi175 ceph-mon[34064]: pgmap v302: 129 pgs: 129 active+clean; 647 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-21T07:11:54.298 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:54.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:53 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2244636661' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:11:54.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:53 smithi169 ceph-mon[33705]: pgmap v302: 129 pgs: 129 active+clean; 647 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-21T07:11:54.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.781+0000 7f6208325640 1 -- 172.21.15.92:0/3514475068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f620010de70 msgr2=0x7f6200110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.781+0000 7f6208325640 1 --2- 172.21.15.92:0/3514475068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f620010de70 0x7f6200110380 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009900 tx=0x7f61f002a410 comp rx=0 tx=0).stop 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.781+0000 7f6208325640 1 -- 172.21.15.92:0/3514475068 shutdown_connections 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.781+0000 7f6208325640 1 --2- 172.21.15.92:0/3514475068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f620010de70 0x7f6200110380 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.781+0000 7f6208325640 1 --2- 172.21.15.92:0/3514475068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62001052f0 0x7f620010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.781+0000 7f6208325640 1 --2- 172.21.15.92:0/3514475068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62001048c0 0x7f6200104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.781+0000 7f6208325640 1 -- 172.21.15.92:0/3514475068 >> 172.21.15.92:0/3514475068 conn(0x7f6200079770 msgr2=0x7f6200079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.781+0000 7f6208325640 1 -- 172.21.15.92:0/3514475068 shutdown_connections 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.781+0000 7f6208325640 1 -- 172.21.15.92:0/3514475068 wait complete. 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f6208325640 1 Processor -- start 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f6208325640 1 -- start start 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f6208325640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62001048c0 0x7f620019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f6208325640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62001052f0 0x7f620019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f6208325640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f620010de70 0x7f620019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f6208325640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6200113a20 con 0x7f620010de70 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f6208325640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62001138a0 con 0x7f62001048c0 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f6208325640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6200113ba0 con 0x7f62001052f0 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f62068c2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f620010de70 0x7f620019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f62068c2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f620010de70 0x7f620019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55172/0 (socket says 172.21.15.92:55172) 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f62068c2640 1 -- 172.21.15.92:0/2175113516 learned_addr learned my addr 172.21.15.92:0/2175113516 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f62060c1640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62001048c0 0x7f620019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.782+0000 7f62058c0640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62001052f0 0x7f620019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f62068c2640 1 -- 172.21.15.92:0/2175113516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62001052f0 msgr2=0x7f620019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f62068c2640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62001052f0 0x7f620019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f62068c2640 1 -- 172.21.15.92:0/2175113516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62001048c0 msgr2=0x7f620019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f62068c2640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62001048c0 0x7f620019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f62068c2640 1 -- 172.21.15.92:0/2175113516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62001a0480 con 0x7f620010de70 2024-09-21T07:11:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f62058c0640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62001052f0 0x7f620019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f62068c2640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f620010de70 0x7f620019fd50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f61f0005ab0 tx=0x7f61f00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f61ff7fe640 1 -- 172.21.15.92:0/2175113516 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f003f030 con 0x7f620010de70 2024-09-21T07:11:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f6208325640 1 -- 172.21.15.92:0/2175113516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62001a0710 con 0x7f620010de70 2024-09-21T07:11:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f61ff7fe640 1 -- 172.21.15.92:0/2175113516 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61f0003a80 con 0x7f620010de70 2024-09-21T07:11:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f61ff7fe640 1 -- 172.21.15.92:0/2175113516 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0035070 con 0x7f620010de70 2024-09-21T07:11:54.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.783+0000 7f6208325640 1 -- 172.21.15.92:0/2175113516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62001a6ed0 con 0x7f620010de70 2024-09-21T07:11:54.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.784+0000 7f6208325640 1 -- 172.21.15.92:0/2175113516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620006c200 con 0x7f620010de70 2024-09-21T07:11:54.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.786+0000 7f61ff7fe640 1 -- 172.21.15.92:0/2175113516 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f61f0042030 con 0x7f620010de70 2024-09-21T07:11:54.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.786+0000 7f61ff7fe640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61e80b65f0 0x7f61e80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.786+0000 7f62060c1640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61e80b65f0 0x7f61e80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.786+0000 7f61ff7fe640 1 -- 172.21.15.92:0/2175113516 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f61f0108240 con 0x7f620010de70 2024-09-21T07:11:54.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.787+0000 7f62060c1640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61e80b65f0 0x7f61e80b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f61f8005fd0 tx=0x7f61f800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:54.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:54.790+0000 7f61ff7fe640 1 -- 172.21.15.92:0/2175113516 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61f00ce540 con 0x7f620010de70 2024-09-21T07:11:55.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.013+0000 7f6208325640 1 -- 172.21.15.92:0/2175113516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6200104cd0 con 0x7f620010de70 2024-09-21T07:11:55.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.020+0000 7f61ff7fe640 1 -- 172.21.15.92:0/2175113516 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+296454 (secure 0 0 0) 0x7f6200104cd0 con 0x7f620010de70 2024-09-21T07:11:55.027 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.023+0000 7f6208325640 1 -- 172.21.15.92:0/2175113516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61e80b65f0 msgr2=0x7f61e80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61e80b65f0 0x7f61e80b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f61f8005fd0 tx=0x7f61f800b390 comp rx=0 tx=0).stop 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 -- 172.21.15.92:0/2175113516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f620010de70 msgr2=0x7f620019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f620010de70 0x7f620019fd50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f61f0005ab0 tx=0x7f61f00040e0 comp rx=0 tx=0).stop 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 -- 172.21.15.92:0/2175113516 shutdown_connections 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61e80b65f0 0x7f61e80b8b00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f620010de70 0x7f620019fd50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62001052f0 0x7f620019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 --2- 172.21.15.92:0/2175113516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62001048c0 0x7f620019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 -- 172.21.15.92:0/2175113516 >> 172.21.15.92:0/2175113516 conn(0x7f6200079770 msgr2=0x7f6200107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 -- 172.21.15.92:0/2175113516 shutdown_connections 2024-09-21T07:11:55.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:55.024+0000 7f6208325640 1 -- 172.21.15.92:0/2175113516 wait complete. 2024-09-21T07:11:55.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:55 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2175113516' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:11:55.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:55 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2175113516' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:11:55.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:55 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2175113516' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:11:55.770 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":21,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3526511181},{"type":"v1","addr":"172.21.15.92:6801","nonce":3526511181}]},"active_addr":"172.21.15.92:6801/3526511181","active_change":"2024-09-21T07:04:13.495661+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24145,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24149,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.92:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":3437188055}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":3187478097}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":1733618324}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":2082264883}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":1261994659}]}]} 2024-09-21T07:11:55.777 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T07:11:55.777 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T07:11:55.777 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:11:56.023 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:56.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:56 smithi092 ceph-mon[30987]: pgmap v303: 129 pgs: 129 active+clean; 647 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-09-21T07:11:56.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:56 smithi169 ceph-mon[33705]: pgmap v303: 129 pgs: 129 active+clean; 647 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-09-21T07:11:56.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:56 smithi175 ceph-mon[34064]: pgmap v303: 129 pgs: 129 active+clean; 647 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-09-21T07:11:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.497+0000 7fc9fae50640 1 -- 172.21.15.92:0/1426726456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9f41094d0 msgr2=0x7fc9f41098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.497+0000 7fc9fae50640 1 --2- 172.21.15.92:0/1426726456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9f41094d0 0x7fc9f41098e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009900 tx=0x7fc9e402a410 comp rx=0 tx=0).stop 2024-09-21T07:11:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.497+0000 7fc9fae50640 1 -- 172.21.15.92:0/1426726456 shutdown_connections 2024-09-21T07:11:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.497+0000 7fc9fae50640 1 --2- 172.21.15.92:0/1426726456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4109e20 0x7fc9f4110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.497+0000 7fc9fae50640 1 --2- 172.21.15.92:0/1426726456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9f41094d0 0x7fc9f41098e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.497+0000 7fc9fae50640 1 --2- 172.21.15.92:0/1426726456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f4103b90 0x7fc9f4103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.497+0000 7fc9fae50640 1 -- 172.21.15.92:0/1426726456 >> 172.21.15.92:0/1426726456 conn(0x7fc9f40ff5e0 msgr2=0x7fc9f4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.497+0000 7fc9fae50640 1 -- 172.21.15.92:0/1426726456 shutdown_connections 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.497+0000 7fc9fae50640 1 -- 172.21.15.92:0/1426726456 wait complete. 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9fae50640 1 Processor -- start 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9fae50640 1 -- start start 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9fae50640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4103b90 0x7fc9f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9fae50640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f41094d0 0x7fc9f4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9fae50640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9f4109e20 0x7fc9f4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9fae50640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f41139b0 con 0x7fc9f4109e20 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9fae50640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4113830 con 0x7fc9f41094d0 2024-09-21T07:11:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9fae50640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4113b30 con 0x7fc9f4103b90 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9f93ed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9f4109e20 0x7fc9f4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9f93ed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9f4109e20 0x7fc9f4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55196/0 (socket says 172.21.15.92:55196) 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9f93ed640 1 -- 172.21.15.92:0/2811853632 learned_addr learned my addr 172.21.15.92:0/2811853632 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9f8bec640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4103b90 0x7fc9f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9ebfff640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f41094d0 0x7fc9f4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9f93ed640 1 -- 172.21.15.92:0/2811853632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4103b90 msgr2=0x7fc9f4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9f93ed640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4103b90 0x7fc9f4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9f93ed640 1 -- 172.21.15.92:0/2811853632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f41094d0 msgr2=0x7fc9f4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9f93ed640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f41094d0 0x7fc9f4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.498+0000 7fc9f93ed640 1 -- 172.21.15.92:0/2811853632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f41a86e0 con 0x7fc9f4109e20 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.499+0000 7fc9f93ed640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9f4109e20 0x7fc9f4076190 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00b970 tx=0x7fc9ec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.499+0000 7fc9e9ffb640 1 -- 172.21.15.92:0/2811853632 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec019070 con 0x7fc9f4109e20 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.499+0000 7fc9fae50640 1 -- 172.21.15.92:0/2811853632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f41a89d0 con 0x7fc9f4109e20 2024-09-21T07:11:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.499+0000 7fc9e9ffb640 1 -- 172.21.15.92:0/2811853632 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9ec014440 con 0x7fc9f4109e20 2024-09-21T07:11:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.499+0000 7fc9e9ffb640 1 -- 172.21.15.92:0/2811853632 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0075d0 con 0x7fc9f4109e20 2024-09-21T07:11:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.499+0000 7fc9fae50640 1 -- 172.21.15.92:0/2811853632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f41a8f60 con 0x7fc9f4109e20 2024-09-21T07:11:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.500+0000 7fc9fae50640 1 -- 172.21.15.92:0/2811853632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f4103fa0 con 0x7fc9f4109e20 2024-09-21T07:11:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.502+0000 7fc9e9ffb640 1 -- 172.21.15.92:0/2811853632 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fc9ec01c070 con 0x7fc9f4109e20 2024-09-21T07:11:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.502+0000 7fc9e9ffb640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9dc0b65f0 0x7fc9dc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.502+0000 7fc9e9ffb640 1 -- 172.21.15.92:0/2811853632 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7fc9ec0e7300 con 0x7fc9f4109e20 2024-09-21T07:11:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.502+0000 7fc9f8bec640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9dc0b65f0 0x7fc9dc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.503+0000 7fc9f8bec640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9dc0b65f0 0x7fc9dc0b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0005fd0 tx=0x7fc9f0005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.505+0000 7fc9e9ffb640 1 -- 172.21.15.92:0/2811853632 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9ec0ad600 con 0x7fc9f4109e20 2024-09-21T07:11:56.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.687+0000 7fc9fae50640 1 -- 172.21.15.92:0/2811853632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9f402e640 con 0x7fc9f4109e20 2024-09-21T07:11:56.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.689+0000 7fc9e9ffb640 1 -- 172.21.15.92:0/2811853632 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25030 (secure 0 0 0) 0x7fc9ec0b19e0 con 0x7fc9f4109e20 2024-09-21T07:11:56.692 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:56.692 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":84,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:11:14.645823+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:56.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.691+0000 7fc9fae50640 1 -- 172.21.15.92:0/2811853632 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9dc0b65f0 msgr2=0x7fc9dc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.691+0000 7fc9fae50640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9dc0b65f0 0x7fc9dc0b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0005fd0 tx=0x7fc9f0005850 comp rx=0 tx=0).stop 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.691+0000 7fc9fae50640 1 -- 172.21.15.92:0/2811853632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9f4109e20 msgr2=0x7fc9f4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.691+0000 7fc9fae50640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9f4109e20 0x7fc9f4076190 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00b970 tx=0x7fc9ec00be30 comp rx=0 tx=0).stop 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.692+0000 7fc9fae50640 1 -- 172.21.15.92:0/2811853632 shutdown_connections 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.692+0000 7fc9fae50640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9dc0b65f0 0x7fc9dc0b8b00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.692+0000 7fc9fae50640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9f4109e20 0x7fc9f4076190 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.692+0000 7fc9fae50640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f41094d0 0x7fc9f4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.692+0000 7fc9fae50640 1 --2- 172.21.15.92:0/2811853632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4103b90 0x7fc9f4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.692+0000 7fc9fae50640 1 -- 172.21.15.92:0/2811853632 >> 172.21.15.92:0/2811853632 conn(0x7fc9f40ff5e0 msgr2=0x7fc9f4101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.692+0000 7fc9fae50640 1 -- 172.21.15.92:0/2811853632 shutdown_connections 2024-09-21T07:11:56.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:56.692+0000 7fc9fae50640 1 -- 172.21.15.92:0/2811853632 wait complete. 2024-09-21T07:11:57.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:57 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2811853632' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:57.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:57 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2811853632' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:57.413 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T07:11:57.414 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:11:57.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:57 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2811853632' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:57.663 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:58.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.175+0000 7f240b159640 1 -- 172.21.15.92:0/2782528356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2404107be0 msgr2=0x7f2404107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:58.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.175+0000 7f240b159640 1 --2- 172.21.15.92:0/2782528356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2404107be0 0x7f2404107ff0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009900 tx=0x7f23f402a410 comp rx=0 tx=0).stop 2024-09-21T07:11:58.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.175+0000 7f240b159640 1 -- 172.21.15.92:0/2782528356 shutdown_connections 2024-09-21T07:11:58.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.175+0000 7f240b159640 1 --2- 172.21.15.92:0/2782528356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2404108530 0x7f240410ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:58.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.175+0000 7f240b159640 1 --2- 172.21.15.92:0/2782528356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2404107be0 0x7f2404107ff0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:58.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.175+0000 7f240b159640 1 --2- 172.21.15.92:0/2782528356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24041022a0 0x7f24041026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.175+0000 7f240b159640 1 -- 172.21.15.92:0/2782528356 >> 172.21.15.92:0/2782528356 conn(0x7f2404079ec0 msgr2=0x7f240407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.175+0000 7f240b159640 1 -- 172.21.15.92:0/2782528356 shutdown_connections 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.175+0000 7f240b159640 1 -- 172.21.15.92:0/2782528356 wait complete. 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f240b159640 1 Processor -- start 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f240b159640 1 -- start start 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f240b159640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24041022a0 0x7f240419b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f240b159640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2404107be0 0x7f240419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f240b159640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2404108530 0x7f240419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f240b159640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2404112920 con 0x7f2404108530 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f240b159640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24041127a0 con 0x7f2404107be0 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f240b159640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2404112aa0 con 0x7f24041022a0 2024-09-21T07:11:58.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f24096f6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2404108530 0x7f240419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f24096f6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2404108530 0x7f240419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55210/0 (socket says 172.21.15.92:55210) 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f24096f6640 1 -- 172.21.15.92:0/3046343401 learned_addr learned my addr 172.21.15.92:0/3046343401 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f2403fff640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2404107be0 0x7f240419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f2408ef5640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24041022a0 0x7f240419b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f24096f6640 1 -- 172.21.15.92:0/3046343401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24041022a0 msgr2=0x7f240419b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f24096f6640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24041022a0 0x7f240419b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f24096f6640 1 -- 172.21.15.92:0/3046343401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2404107be0 msgr2=0x7f240419b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f24096f6640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2404107be0 0x7f240419b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f24096f6640 1 -- 172.21.15.92:0/3046343401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24041a65a0 con 0x7f2404108530 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f2403fff640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2404107be0 0x7f240419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.176+0000 7f24096f6640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2404108530 0x7f240419bd90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00eaa0 tx=0x7f23fc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:58.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.177+0000 7f2401ffb640 1 -- 172.21.15.92:0/3046343401 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc00cdb0 con 0x7f2404108530 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.177+0000 7f2401ffb640 1 -- 172.21.15.92:0/3046343401 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23fc005020 con 0x7f2404108530 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.177+0000 7f240b159640 1 -- 172.21.15.92:0/3046343401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24041a6890 con 0x7f2404108530 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.177+0000 7f2401ffb640 1 -- 172.21.15.92:0/3046343401 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0116d0 con 0x7f2404108530 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.177+0000 7f240b159640 1 -- 172.21.15.92:0/3046343401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24041a6d50 con 0x7f2404108530 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.178+0000 7f240b159640 1 -- 172.21.15.92:0/3046343401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24041026b0 con 0x7f2404108530 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.180+0000 7f2401ffb640 1 -- 172.21.15.92:0/3046343401 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f23fc0051d0 con 0x7f2404108530 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.181+0000 7f2401ffb640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f23f00b6620 0x7f23f00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.181+0000 7f2408ef5640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f23f00b6620 0x7f23f00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.181+0000 7f2401ffb640 1 -- 172.21.15.92:0/3046343401 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f23fc0e7fa0 con 0x7f2404108530 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.182+0000 7f2408ef5640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f23f00b6620 0x7f23f00b8b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f23ec005fd0 tx=0x7f23ec005e20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:58.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.184+0000 7f2401ffb640 1 -- 172.21.15.92:0/3046343401 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23fc016030 con 0x7f2404108530 2024-09-21T07:11:58.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:58 smithi092 ceph-mon[30987]: pgmap v304: 129 pgs: 129 active+clean; 647 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T07:11:58.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.362+0000 7f240b159640 1 -- 172.21.15.92:0/3046343401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f240410fb30 con 0x7f2404108530 2024-09-21T07:11:58.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.363+0000 7f2401ffb640 1 -- 172.21.15.92:0/3046343401 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25030 (secure 0 0 0) 0x7f240410fb30 con 0x7f2404108530 2024-09-21T07:11:58.366 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:11:58.366 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":84,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:11:14.645823+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 -- 172.21.15.92:0/3046343401 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f23f00b6620 msgr2=0x7f23f00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f23f00b6620 0x7f23f00b8b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f23ec005fd0 tx=0x7f23ec005e20 comp rx=0 tx=0).stop 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 -- 172.21.15.92:0/3046343401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2404108530 msgr2=0x7f240419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2404108530 0x7f240419bd90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00eaa0 tx=0x7f23fc00ef60 comp rx=0 tx=0).stop 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 -- 172.21.15.92:0/3046343401 shutdown_connections 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f23f00b6620 0x7f23f00b8b30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2404108530 0x7f240419bd90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2404107be0 0x7f240419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 --2- 172.21.15.92:0/3046343401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24041022a0 0x7f240419b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 -- 172.21.15.92:0/3046343401 >> 172.21.15.92:0/3046343401 conn(0x7f2404079ec0 msgr2=0x7f2404103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 -- 172.21.15.92:0/3046343401 shutdown_connections 2024-09-21T07:11:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:11:58.366+0000 7f240b159640 1 -- 172.21.15.92:0/3046343401 wait complete. 2024-09-21T07:11:58.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:58 smithi169 ceph-mon[33705]: pgmap v304: 129 pgs: 129 active+clean; 647 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T07:11:58.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:58 smithi175 ceph-mon[34064]: pgmap v304: 129 pgs: 129 active+clean; 647 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T07:11:59.057 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T07:11:59.057 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T07:11:59.058 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T07:11:59.058 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T07:11:59.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T07:11:59.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T07:11:59.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T07:11:59.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T07:11:59.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T07:11:59.061 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T07:11:59.061 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T07:11:59.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T07:11:59.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:11:59 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3046343401' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:59.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:11:59 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3046343401' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:59.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:11:59 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3046343401' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:11:59.753 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:11:59.771 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:00.016 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:00.019 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:00.020 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:00.020 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:00.021 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:00.180 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:00 smithi092 ceph-mon[30987]: pgmap v305: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-21T07:12:00.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:00 smithi169 ceph-mon[33705]: pgmap v305: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-21T07:12:00.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:00 smithi175 ceph-mon[34064]: pgmap v305: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-21T07:12:00.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.497+0000 7f899db7e640 1 -- 172.21.15.92:0/1325413994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8998108cf0 msgr2=0x7f899810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.497+0000 7f899db7e640 1 --2- 172.21.15.92:0/1325413994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8998108cf0 0x7f899810f520 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8990009ca0 tx=0x7f899002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.497+0000 7f899db7e640 1 -- 172.21.15.92:0/1325413994 shutdown_connections 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.497+0000 7f899db7e640 1 --2- 172.21.15.92:0/1325413994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8998108cf0 0x7f899810f520 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.497+0000 7f899db7e640 1 --2- 172.21.15.92:0/1325413994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89981083a0 0x7f89981087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.497+0000 7f899db7e640 1 --2- 172.21.15.92:0/1325413994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8998102a60 0x7f8998102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.497+0000 7f899db7e640 1 -- 172.21.15.92:0/1325413994 >> 172.21.15.92:0/1325413994 conn(0x7f8998079730 msgr2=0x7f8998079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.497+0000 7f899db7e640 1 -- 172.21.15.92:0/1325413994 shutdown_connections 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.497+0000 7f899db7e640 1 -- 172.21.15.92:0/1325413994 wait complete. 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f899db7e640 1 Processor -- start 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f899db7e640 1 -- start start 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f899db7e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8998102a60 0x7f899819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f899db7e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89981083a0 0x7f899819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:00.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f899db7e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8998108cf0 0x7f899819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f899db7e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8998112860 con 0x7f8998102a60 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f899db7e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89981126e0 con 0x7f8998108cf0 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f899db7e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89981129e0 con 0x7f89981083a0 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f89977fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8998102a60 0x7f899819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f89977fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8998102a60 0x7f899819a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51582/0 (socket says 172.21.15.92:51582) 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.498+0000 7f89977fe640 1 -- 172.21.15.92:0/463650952 learned_addr learned my addr 172.21.15.92:0/463650952 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f8997fff640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8998108cf0 0x7f899819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f8996ffd640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89981083a0 0x7f899819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f89977fe640 1 -- 172.21.15.92:0/463650952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89981083a0 msgr2=0x7f899819a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f89977fe640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89981083a0 0x7f899819a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f89977fe640 1 -- 172.21.15.92:0/463650952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8998108cf0 msgr2=0x7f899819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f89977fe640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8998108cf0 0x7f899819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f89977fe640 1 -- 172.21.15.92:0/463650952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89981a0330 con 0x7f8998102a60 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f89977fe640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8998102a60 0x7f899819a3c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f898800ea60 tx=0x7f898800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f8994ff9640 1 -- 172.21.15.92:0/463650952 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898800cde0 con 0x7f8998102a60 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f8994ff9640 1 -- 172.21.15.92:0/463650952 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89880035f0 con 0x7f8998102a60 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89981a0620 con 0x7f8998102a60 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f8994ff9640 1 -- 172.21.15.92:0/463650952 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988010690 con 0x7f8998102a60 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.499+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89981a6d80 con 0x7f8998102a60 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.500+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8998063b50 con 0x7f8998102a60 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.502+0000 7f8994ff9640 1 -- 172.21.15.92:0/463650952 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f8988004000 con 0x7f8998102a60 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.503+0000 7f8994ff9640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89800b6670 0x7f89800b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.503+0000 7f8996ffd640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89800b6670 0x7f89800b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.503+0000 7f8994ff9640 1 -- 172.21.15.92:0/463650952 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f89880e8420 con 0x7f8998102a60 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.503+0000 7f8994ff9640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] conn(0x7f89800c1a00 0x7f89800c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.503+0000 7f8994ff9640 1 -- 172.21.15.92:0/463650952 --> [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8988004490 con 0x7f89800c1a00 2024-09-21T07:12:00.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.503+0000 7f8994ff9640 1 -- 172.21.15.92:0/463650952 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f89880e8900 con 0x7f8998102a60 2024-09-21T07:12:00.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.503+0000 7f8996ffd640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89800b6670 0x7f89800b8b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f899806a310 tx=0x7f898c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:00.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.503+0000 7f8997fff640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] conn(0x7f89800c1a00 0x7f89800c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:00.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.504+0000 7f8997fff640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] conn(0x7f89800c1a00 0x7f89800c3ef0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:00.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.505+0000 7f8994ff9640 1 -- 172.21.15.92:0/463650952 <== osd.1 v2:172.21.15.169:6800/340343580 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8988004490 con 0x7f89800c1a00 2024-09-21T07:12:00.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.518+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 --> [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8998063f80 con 0x7f89800c1a00 2024-09-21T07:12:00.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.519+0000 7f8994ff9640 1 -- 172.21.15.92:0/463650952 <== osd.1 v2:172.21.15.169:6800/340343580 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8998063f80 con 0x7f89800c1a00 2024-09-21T07:12:00.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.519+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 >> [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] conn(0x7f89800c1a00 msgr2=0x7f89800c3ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.519+0000 7f899db7e640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] conn(0x7f89800c1a00 0x7f89800c3ef0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.519+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89800b6670 msgr2=0x7f89800b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.519+0000 7f899db7e640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89800b6670 0x7f89800b8b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f899806a310 tx=0x7f898c005f90 comp rx=0 tx=0).stop 2024-09-21T07:12:00.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.519+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8998102a60 msgr2=0x7f899819a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.519+0000 7f899db7e640 1 --2- 172.21.15.92:0/463650952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8998102a60 0x7f899819a3c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f898800ea60 tx=0x7f898800ef20 comp rx=0 tx=0).stop 2024-09-21T07:12:00.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.519+0000 7f8997fff640 1 -- 172.21.15.92:0/463650952 reap_dead start 2024-09-21T07:12:00.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.520+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 shutdown_connections 2024-09-21T07:12:00.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.520+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 >> 172.21.15.92:0/463650952 conn(0x7f8998079730 msgr2=0x7f899806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:00.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.520+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 shutdown_connections 2024-09-21T07:12:00.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.520+0000 7f899db7e640 1 -- 172.21.15.92:0/463650952 wait complete. 2024-09-21T07:12:00.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.715+0000 7f36c4807640 1 -- 172.21.15.92:0/141444813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c01094a0 msgr2=0x7f36c01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.715+0000 7f36c4807640 1 --2- 172.21.15.92:0/141444813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c01094a0 0x7f36c01098b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009900 tx=0x7f36b402a410 comp rx=0 tx=0).stop 2024-09-21T07:12:00.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.715+0000 7f36c4807640 1 -- 172.21.15.92:0/141444813 shutdown_connections 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.715+0000 7f36c4807640 1 --2- 172.21.15.92:0/141444813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0109df0 0x7f36c0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.715+0000 7f36c4807640 1 --2- 172.21.15.92:0/141444813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c01094a0 0x7f36c01098b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.715+0000 7f36c4807640 1 --2- 172.21.15.92:0/141444813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36c0103b60 0x7f36c0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.715+0000 7f36c4807640 1 -- 172.21.15.92:0/141444813 >> 172.21.15.92:0/141444813 conn(0x7f36c007b850 msgr2=0x7f36c007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.715+0000 7f36c4807640 1 -- 172.21.15.92:0/141444813 shutdown_connections 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.715+0000 7f36c4807640 1 -- 172.21.15.92:0/141444813 wait complete. 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36c4807640 1 Processor -- start 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36c4807640 1 -- start start 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36c4807640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0103b60 0x7f36c019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36c4807640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36c01094a0 0x7f36c019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36c4807640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0109df0 0x7f36c01a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36c4807640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36c0113960 con 0x7f36c0103b60 2024-09-21T07:12:00.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36c4807640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01137e0 con 0x7f36c01094a0 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36c4807640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36c0113ae0 con 0x7f36c0109df0 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0103b60 0x7f36c019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0103b60 0x7f36c019c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51604/0 (socket says 172.21.15.92:51604) 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36be59c640 1 -- 172.21.15.92:0/4222058710 learned_addr learned my addr 172.21.15.92:0/4222058710 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36bed9d640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0109df0 0x7f36c01a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36be59c640 1 -- 172.21.15.92:0/4222058710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0109df0 msgr2=0x7f36c01a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36bdd9b640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36c01094a0 0x7f36c019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36be59c640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0109df0 0x7f36c01a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36be59c640 1 -- 172.21.15.92:0/4222058710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36c01094a0 msgr2=0x7f36c019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36be59c640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36c01094a0 0x7f36c019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36be59c640 1 -- 172.21.15.92:0/4222058710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c01a2600 con 0x7f36c0103b60 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.716+0000 7f36bed9d640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0109df0 0x7f36c01a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:00.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.717+0000 7f36be59c640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0103b60 0x7f36c019c690 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f36b000d950 tx=0x7f36b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.717+0000 7f36af7fe640 1 -- 172.21.15.92:0/4222058710 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b0017070 con 0x7f36c0103b60 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.717+0000 7f36af7fe640 1 -- 172.21.15.92:0/4222058710 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b0009c30 con 0x7f36c0103b60 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.717+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c01a28f0 con 0x7f36c0103b60 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.717+0000 7f36af7fe640 1 -- 172.21.15.92:0/4222058710 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b000f620 con 0x7f36c0103b60 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.717+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c01a9050 con 0x7f36c0103b60 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.718+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36c0107e50 con 0x7f36c0103b60 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.720+0000 7f36af7fe640 1 -- 172.21.15.92:0/4222058710 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f36b0010460 con 0x7f36c0103b60 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.720+0000 7f36af7fe640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a80b65f0 0x7f36a80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.720+0000 7f36bdd9b640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a80b65f0 0x7f36a80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.720+0000 7f36af7fe640 1 -- 172.21.15.92:0/4222058710 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f36b00e7b90 con 0x7f36c0103b60 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.721+0000 7f36af7fe640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] conn(0x7f36a80c1980 0x7f36a80c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.721+0000 7f36af7fe640 1 -- 172.21.15.92:0/4222058710 --> [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36a80c4540 con 0x7f36a80c1980 2024-09-21T07:12:00.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.721+0000 7f36af7fe640 1 -- 172.21.15.92:0/4222058710 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f36b00e7fe0 con 0x7f36c0103b60 2024-09-21T07:12:00.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.721+0000 7f36bdd9b640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a80b65f0 0x7f36a80b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36b4006010 tx=0x7f36b4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:00.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.721+0000 7f36bed9d640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] conn(0x7f36a80c1980 0x7f36a80c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:00.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.721+0000 7f36bed9d640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] conn(0x7f36a80c1980 0x7f36a80c3e70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:00.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.722+0000 7f36af7fe640 1 -- 172.21.15.92:0/4222058710 <== osd.8 v2:172.21.15.175:6816/1197596525 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f36a80c4540 con 0x7f36a80c1980 2024-09-21T07:12:00.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.736+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 --> [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f36c0104de0 con 0x7f36a80c1980 2024-09-21T07:12:00.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.736+0000 7f36af7fe640 1 -- 172.21.15.92:0/4222058710 <== osd.8 v2:172.21.15.175:6816/1197596525 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f36c0104de0 con 0x7f36a80c1980 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.736+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 >> [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] conn(0x7f36a80c1980 msgr2=0x7f36a80c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.736+0000 7f36c4807640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] conn(0x7f36a80c1980 0x7f36a80c3e70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.737+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a80b65f0 msgr2=0x7f36a80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.737+0000 7f36c4807640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f36a80b65f0 0x7f36a80b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36b4006010 tx=0x7f36b4000bc0 comp rx=0 tx=0).stop 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.737+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0103b60 msgr2=0x7f36c019c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.737+0000 7f36c4807640 1 --2- 172.21.15.92:0/4222058710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36c0103b60 0x7f36c019c690 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f36b000d950 tx=0x7f36b000de10 comp rx=0 tx=0).stop 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.737+0000 7f36bed9d640 1 -- 172.21.15.92:0/4222058710 reap_dead start 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.737+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 shutdown_connections 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.737+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 >> 172.21.15.92:0/4222058710 conn(0x7f36c007b850 msgr2=0x7f36c01073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.737+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 shutdown_connections 2024-09-21T07:12:00.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:00.737+0000 7f36c4807640 1 -- 172.21.15.92:0/4222058710 wait complete. 2024-09-21T07:12:01.646 INFO:teuthology.orchestra.run.smithi092.stdout:227633266730 2024-09-21T07:12:01.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T07:12:02.263 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:02.264 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:02.266 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:02.698 INFO:teuthology.orchestra.run.smithi092.stdout:60129542220 2024-09-21T07:12:02.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T07:12:02.932 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:02 smithi092 ceph-mon[30987]: pgmap v306: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T07:12:02.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.930+0000 7f65fa3fb640 1 -- 172.21.15.92:0/884507400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f41049b0 msgr2=0x7f65f4104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:02.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.930+0000 7f65fa3fb640 1 --2- 172.21.15.92:0/884507400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f41049b0 0x7f65f4104dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009900 tx=0x7f65e402a410 comp rx=0 tx=0).stop 2024-09-21T07:12:02.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.930+0000 7f65fa3fb640 1 -- 172.21.15.92:0/884507400 shutdown_connections 2024-09-21T07:12:02.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.930+0000 7f65fa3fb640 1 --2- 172.21.15.92:0/884507400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f410de10 0x7f65f4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:02.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.930+0000 7f65fa3fb640 1 --2- 172.21.15.92:0/884507400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65f4105300 0x7f65f410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.930+0000 7f65fa3fb640 1 --2- 172.21.15.92:0/884507400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f41049b0 0x7f65f4104dc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.930+0000 7f65fa3fb640 1 -- 172.21.15.92:0/884507400 >> 172.21.15.92:0/884507400 conn(0x7f65f4079730 msgr2=0x7f65f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.930+0000 7f65fa3fb640 1 -- 172.21.15.92:0/884507400 shutdown_connections 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.930+0000 7f65fa3fb640 1 -- 172.21.15.92:0/884507400 wait complete. 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65fa3fb640 1 Processor -- start 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65fa3fb640 1 -- start start 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65fa3fb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f41049b0 0x7f65f419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65fa3fb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f4105300 0x7f65f419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65fa3fb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65f410de10 0x7f65f419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65fa3fb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65f4113920 con 0x7f65f4105300 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65fa3fb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65f41137a0 con 0x7f65f410de10 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65fa3fb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65f4113aa0 con 0x7f65f41049b0 2024-09-21T07:12:02.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f4105300 0x7f65f419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f4105300 0x7f65f419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51624/0 (socket says 172.21.15.92:51624) 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.931+0000 7f65ebfff640 1 -- 172.21.15.92:0/2492032877 learned_addr learned my addr 172.21.15.92:0/2492032877 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65f8998640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65f410de10 0x7f65f419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65f3fff640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f41049b0 0x7f65f419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65ebfff640 1 -- 172.21.15.92:0/2492032877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f41049b0 msgr2=0x7f65f419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65ebfff640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f41049b0 0x7f65f419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65ebfff640 1 -- 172.21.15.92:0/2492032877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65f410de10 msgr2=0x7f65f419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65ebfff640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65f410de10 0x7f65f419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65ebfff640 1 -- 172.21.15.92:0/2492032877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f41a03a0 con 0x7f65f4105300 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65f8998640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65f410de10 0x7f65f419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65ebfff640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f4105300 0x7f65f419aa90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00c8c0 tx=0x7f65dc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65f1ffb640 1 -- 172.21.15.92:0/2492032877 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc007bb0 con 0x7f65f4105300 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65f1ffb640 1 -- 172.21.15.92:0/2492032877 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65dc007d50 con 0x7f65f4105300 2024-09-21T07:12:02.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65f1ffb640 1 -- 172.21.15.92:0/2492032877 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0186a0 con 0x7f65f4105300 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f41a0690 con 0x7f65f4105300 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.932+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f41a6eb0 con 0x7f65f4105300 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.933+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65f4063ad0 con 0x7f65f4105300 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.935+0000 7f65f1ffb640 1 -- 172.21.15.92:0/2492032877 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f65dc00fa00 con 0x7f65f4105300 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.936+0000 7f65f1ffb640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65e00b66a0 0x7f65e00b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.936+0000 7f65f3fff640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65e00b66a0 0x7f65e00b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.936+0000 7f65f1ffb640 1 -- 172.21.15.92:0/2492032877 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f65dc0e7e40 con 0x7f65f4105300 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.936+0000 7f65f1ffb640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] conn(0x7f65e00c1a30 0x7f65e00c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.936+0000 7f65f1ffb640 1 -- 172.21.15.92:0/2492032877 --> [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65dc01ee50 con 0x7f65e00c1a30 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.936+0000 7f65f1ffb640 1 -- 172.21.15.92:0/2492032877 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f65dc0e8290 con 0x7f65f4105300 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.936+0000 7f65f3fff640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65e00b66a0 0x7f65e00b8bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f65e4006010 tx=0x7f65e4032c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.936+0000 7f65f8998640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] conn(0x7f65e00c1a30 0x7f65e00c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.937+0000 7f65f8998640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] conn(0x7f65e00c1a30 0x7f65e00c3f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:02.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.938+0000 7f65f1ffb640 1 -- 172.21.15.92:0/2492032877 <== osd.6 v2:172.21.15.92:6818/2465826731 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f65dc01ee50 con 0x7f65e00c1a30 2024-09-21T07:12:02.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.955+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 --> [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f65f4063ed0 con 0x7f65e00c1a30 2024-09-21T07:12:02.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.956+0000 7f65f1ffb640 1 -- 172.21.15.92:0/2492032877 <== osd.6 v2:172.21.15.92:6818/2465826731 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f65f4063ed0 con 0x7f65e00c1a30 2024-09-21T07:12:02.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] conn(0x7f65e00c1a30 msgr2=0x7f65e00c3f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:02.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65fa3fb640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] conn(0x7f65e00c1a30 0x7f65e00c3f20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:02.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65e00b66a0 msgr2=0x7f65e00b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:02.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65fa3fb640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65e00b66a0 0x7f65e00b8bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f65e4006010 tx=0x7f65e4032c80 comp rx=0 tx=0).stop 2024-09-21T07:12:02.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f4105300 msgr2=0x7f65f419aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:02.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65fa3fb640 1 --2- 172.21.15.92:0/2492032877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f4105300 0x7f65f419aa90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00c8c0 tx=0x7f65dc00cd80 comp rx=0 tx=0).stop 2024-09-21T07:12:02.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65f8998640 1 -- 172.21.15.92:0/2492032877 reap_dead start 2024-09-21T07:12:02.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 shutdown_connections 2024-09-21T07:12:02.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 >> 172.21.15.92:0/2492032877 conn(0x7f65f4079730 msgr2=0x7f65f40ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:02.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 shutdown_connections 2024-09-21T07:12:02.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:02.957+0000 7f65fa3fb640 1 -- 172.21.15.92:0/2492032877 wait complete. 2024-09-21T07:12:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:02 smithi175 ceph-mon[34064]: pgmap v306: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T07:12:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:02 smithi169 ceph-mon[33705]: pgmap v306: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T07:12:03.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.716+0000 7f0020c7d640 1 -- 172.21.15.92:0/1214403440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f001c1083a0 msgr2=0x7f001c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:03.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.716+0000 7f0020c7d640 1 --2- 172.21.15.92:0/1214403440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f001c1083a0 0x7f001c1087b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0010009900 tx=0x7f001002a410 comp rx=0 tx=0).stop 2024-09-21T07:12:03.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.716+0000 7f0020c7d640 1 -- 172.21.15.92:0/1214403440 shutdown_connections 2024-09-21T07:12:03.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.716+0000 7f0020c7d640 1 --2- 172.21.15.92:0/1214403440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f001c108cf0 0x7f001c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:03.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.716+0000 7f0020c7d640 1 --2- 172.21.15.92:0/1214403440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f001c1083a0 0x7f001c1087b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:03.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.716+0000 7f0020c7d640 1 --2- 172.21.15.92:0/1214403440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f001c102a60 0x7f001c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:03.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.716+0000 7f0020c7d640 1 -- 172.21.15.92:0/1214403440 >> 172.21.15.92:0/1214403440 conn(0x7f001c079730 msgr2=0x7f001c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:03.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.716+0000 7f0020c7d640 1 -- 172.21.15.92:0/1214403440 shutdown_connections 2024-09-21T07:12:03.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.716+0000 7f0020c7d640 1 -- 172.21.15.92:0/1214403440 wait complete. 2024-09-21T07:12:03.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.717+0000 7f0020c7d640 1 Processor -- start 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.717+0000 7f0020c7d640 1 -- start start 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.717+0000 7f0020c7d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f001c102a60 0x7f001c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.717+0000 7f0020c7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f001c1083a0 0x7f001c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0020c7d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f001c108cf0 0x7f001c19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0020c7d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f001c112810 con 0x7f001c1083a0 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0020c7d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f001c112690 con 0x7f001c108cf0 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0020c7d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f001c112990 con 0x7f001c102a60 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0019d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f001c1083a0 0x7f001c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0019d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f001c1083a0 0x7f001c199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51638/0 (socket says 172.21.15.92:51638) 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0019d9b640 1 -- 172.21.15.92:0/1670592163 learned_addr learned my addr 172.21.15.92:0/1670592163 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f001a59c640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f001c102a60 0x7f001c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0019d9b640 1 -- 172.21.15.92:0/1670592163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f001c102a60 msgr2=0x7f001c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0019d9b640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f001c102a60 0x7f001c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:03.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0019d9b640 1 -- 172.21.15.92:0/1670592163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f001c108cf0 msgr2=0x7f001c19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0019d9b640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f001c108cf0 0x7f001c19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0019d9b640 1 -- 172.21.15.92:0/1670592163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c19f250 con 0x7f001c1083a0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f0019d9b640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f001c1083a0 0x7f001c199880 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0010005940 tx=0x7f00100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.718+0000 7f000b7fe640 1 -- 172.21.15.92:0/1670592163 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001003f030 con 0x7f001c1083a0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.719+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c19f4e0 con 0x7f001c1083a0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.719+0000 7f000b7fe640 1 -- 172.21.15.92:0/1670592163 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0010003c90 con 0x7f001c1083a0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.719+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c1a5ca0 con 0x7f001c1083a0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.719+0000 7f000b7fe640 1 -- 172.21.15.92:0/1670592163 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010035070 con 0x7f001c1083a0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.720+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f001c063b50 con 0x7f001c1083a0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.721+0000 7f000b7fe640 1 -- 172.21.15.92:0/1670592163 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f0010042030 con 0x7f001c1083a0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.722+0000 7f000b7fe640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00040b65f0 0x7f00040b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.722+0000 7f001a59c640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00040b65f0 0x7f00040b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.722+0000 7f000b7fe640 1 -- 172.21.15.92:0/1670592163 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f0010108310 con 0x7f001c1083a0 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.722+0000 7f000b7fe640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] conn(0x7f00040c1980 0x7f00040c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:03.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.722+0000 7f000b7fe640 1 -- 172.21.15.92:0/1670592163 --> [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f001003be50 con 0x7f00040c1980 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.722+0000 7f000b7fe640 1 -- 172.21.15.92:0/1670592163 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f0010108760 con 0x7f001c1083a0 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.723+0000 7f001a59c640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00040b65f0 0x7f00040b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f000c005fd0 tx=0x7f000c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.723+0000 7f001ad9d640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] conn(0x7f00040c1980 0x7f00040c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.723+0000 7f001ad9d640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] conn(0x7f00040c1980 0x7f00040c3e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.724+0000 7f000b7fe640 1 -- 172.21.15.92:0/1670592163 <== osd.11 v2:172.21.15.175:6824/3032208508 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f001003be50 con 0x7f00040c1980 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.738+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 --> [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f001c063f50 con 0x7f00040c1980 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f000b7fe640 1 -- 172.21.15.92:0/1670592163 <== osd.11 v2:172.21.15.175:6824/3032208508 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f001c063f50 con 0x7f00040c1980 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 >> [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] conn(0x7f00040c1980 msgr2=0x7f00040c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f0020c7d640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] conn(0x7f00040c1980 0x7f00040c3e70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00040b65f0 msgr2=0x7f00040b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f0020c7d640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00040b65f0 0x7f00040b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f000c005fd0 tx=0x7f000c00b390 comp rx=0 tx=0).stop 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f001c1083a0 msgr2=0x7f001c199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f0020c7d640 1 --2- 172.21.15.92:0/1670592163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f001c1083a0 0x7f001c199880 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0010005940 tx=0x7f00100042f0 comp rx=0 tx=0).stop 2024-09-21T07:12:03.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f001ad9d640 1 -- 172.21.15.92:0/1670592163 reap_dead start 2024-09-21T07:12:03.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 shutdown_connections 2024-09-21T07:12:03.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 >> 172.21.15.92:0/1670592163 conn(0x7f001c079730 msgr2=0x7f001c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:03.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 shutdown_connections 2024-09-21T07:12:03.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:03.739+0000 7f0020c7d640 1 -- 172.21.15.92:0/1670592163 wait complete. 2024-09-21T07:12:04.468 INFO:teuthology.orchestra.run.smithi092.stdout:300647710747 2024-09-21T07:12:04.468 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T07:12:04.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.632+0000 7f383d5c6640 1 -- 172.21.15.92:0/2113394996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3838102a80 msgr2=0x7f3838102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.632+0000 7f383d5c6640 1 --2- 172.21.15.92:0/2113394996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3838102a80 0x7f3838102e90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3828009900 tx=0x7f382802a410 comp rx=0 tx=0).stop 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.632+0000 7f383d5c6640 1 -- 172.21.15.92:0/2113394996 shutdown_connections 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.632+0000 7f383d5c6640 1 --2- 172.21.15.92:0/2113394996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3838108d10 0x7f383810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.632+0000 7f383d5c6640 1 --2- 172.21.15.92:0/2113394996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38381083c0 0x7f38381087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.632+0000 7f383d5c6640 1 --2- 172.21.15.92:0/2113394996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3838102a80 0x7f3838102e90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.632+0000 7f383d5c6640 1 -- 172.21.15.92:0/2113394996 >> 172.21.15.92:0/2113394996 conn(0x7f3838079740 msgr2=0x7f3838079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.632+0000 7f383d5c6640 1 -- 172.21.15.92:0/2113394996 shutdown_connections 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.632+0000 7f383d5c6640 1 -- 172.21.15.92:0/2113394996 wait complete. 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.633+0000 7f383d5c6640 1 Processor -- start 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.633+0000 7f383d5c6640 1 -- start start 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.633+0000 7f383d5c6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3838102a80 0x7f3838199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.633+0000 7f383d5c6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38381083c0 0x7f38381998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.633+0000 7f383d5c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3838108d10 0x7f383819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:04.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.633+0000 7f383d5c6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3838112890 con 0x7f3838108d10 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.633+0000 7f383d5c6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3838112710 con 0x7f38381083c0 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.633+0000 7f383d5c6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3838112a10 con 0x7f3838102a80 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f38377fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3838108d10 0x7f383819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f38377fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3838108d10 0x7f383819eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51658/0 (socket says 172.21.15.92:51658) 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f38377fe640 1 -- 172.21.15.92:0/1216103710 learned_addr learned my addr 172.21.15.92:0/1216103710 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f382ffff640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38381083c0 0x7f38381998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f3836ffd640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3838102a80 0x7f3838199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f38377fe640 1 -- 172.21.15.92:0/1216103710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3838102a80 msgr2=0x7f3838199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f38377fe640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3838102a80 0x7f3838199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f38377fe640 1 -- 172.21.15.92:0/1216103710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38381083c0 msgr2=0x7f38381998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f38377fe640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38381083c0 0x7f38381998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f38377fe640 1 -- 172.21.15.92:0/1216103710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383819f270 con 0x7f3838108d10 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f382ffff640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38381083c0 0x7f38381998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:04.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f38377fe640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3838108d10 0x7f383819eb40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f383000eaa0 tx=0x7f383000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f3834ff9640 1 -- 172.21.15.92:0/1216103710 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383000cdb0 con 0x7f3838108d10 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383819f560 con 0x7f3838108d10 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f3834ff9640 1 -- 172.21.15.92:0/1216103710 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3830005020 con 0x7f3838108d10 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f3834ff9640 1 -- 172.21.15.92:0/1216103710 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38300116d0 con 0x7f3838108d10 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.634+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38381a5cc0 con 0x7f3838108d10 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.635+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3838063b10 con 0x7f3838108d10 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.637+0000 7f3834ff9640 1 -- 172.21.15.92:0/1216103710 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f38300051d0 con 0x7f3838108d10 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.638+0000 7f3834ff9640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f38240b65f0 0x7f38240b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.638+0000 7f3836ffd640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f38240b65f0 0x7f38240b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.638+0000 7f3834ff9640 1 -- 172.21.15.92:0/1216103710 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f38300e8050 con 0x7f3838108d10 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.638+0000 7f3834ff9640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] conn(0x7f38240c1980 0x7f38240c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.638+0000 7f3834ff9640 1 -- 172.21.15.92:0/1216103710 --> [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3830018ec0 con 0x7f38240c1980 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.638+0000 7f3834ff9640 1 -- 172.21.15.92:0/1216103710 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f38300e84a0 con 0x7f3838108d10 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.639+0000 7f3836ffd640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f38240b65f0 0x7f38240b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3828000c00 tx=0x7f3828009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:04.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.639+0000 7f382ffff640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] conn(0x7f38240c1980 0x7f38240c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:04.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.639+0000 7f382ffff640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] conn(0x7f38240c1980 0x7f38240c3e70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:04.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.640+0000 7f3834ff9640 1 -- 172.21.15.92:0/1216103710 <== osd.2 v2:172.21.15.175:6800/3936276912 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3830018ec0 con 0x7f38240c1980 2024-09-21T07:12:04.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.655+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 --> [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3838063f90 con 0x7f38240c1980 2024-09-21T07:12:04.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.655+0000 7f3834ff9640 1 -- 172.21.15.92:0/1216103710 <== osd.2 v2:172.21.15.175:6800/3936276912 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3838063f90 con 0x7f38240c1980 2024-09-21T07:12:04.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 >> [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] conn(0x7f38240c1980 msgr2=0x7f38240c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:04.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f383d5c6640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] conn(0x7f38240c1980 0x7f38240c3e70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:04.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f38240b65f0 msgr2=0x7f38240b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:04.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f383d5c6640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f38240b65f0 0x7f38240b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3828000c00 tx=0x7f3828009680 comp rx=0 tx=0).stop 2024-09-21T07:12:04.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3838108d10 msgr2=0x7f383819eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:04.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f383d5c6640 1 --2- 172.21.15.92:0/1216103710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3838108d10 0x7f383819eb40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f383000eaa0 tx=0x7f383000ef60 comp rx=0 tx=0).stop 2024-09-21T07:12:04.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f38377fe640 1 -- 172.21.15.92:0/1216103710 reap_dead start 2024-09-21T07:12:04.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 shutdown_connections 2024-09-21T07:12:04.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 >> 172.21.15.92:0/1216103710 conn(0x7f3838079740 msgr2=0x7f3838101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:04.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 shutdown_connections 2024-09-21T07:12:04.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:04.656+0000 7f383d5c6640 1 -- 172.21.15.92:0/1216103710 wait complete. 2024-09-21T07:12:04.885 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:04 smithi092 ceph-mon[30987]: pgmap v307: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T07:12:05.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:04 smithi175 ceph-mon[34064]: pgmap v307: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T07:12:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:04 smithi169 ceph-mon[33705]: pgmap v307: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T07:12:06.105 INFO:teuthology.orchestra.run.smithi092.stdout:81604378697 2024-09-21T07:12:06.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.293+0000 7f630cb2b640 1 -- 172.21.15.92:0/2246935939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6308108cf0 msgr2=0x7f630810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.293+0000 7f630cb2b640 1 --2- 172.21.15.92:0/2246935939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6308108cf0 0x7f630810f520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6300009ca0 tx=0x7f630002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.294+0000 7f630cb2b640 1 -- 172.21.15.92:0/2246935939 shutdown_connections 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.294+0000 7f630cb2b640 1 --2- 172.21.15.92:0/2246935939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6308108cf0 0x7f630810f520 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.294+0000 7f630cb2b640 1 --2- 172.21.15.92:0/2246935939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63081083a0 0x7f63081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.294+0000 7f630cb2b640 1 --2- 172.21.15.92:0/2246935939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6308102a60 0x7f6308102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.294+0000 7f630cb2b640 1 -- 172.21.15.92:0/2246935939 >> 172.21.15.92:0/2246935939 conn(0x7f6308079730 msgr2=0x7f6308079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.294+0000 7f630cb2b640 1 -- 172.21.15.92:0/2246935939 shutdown_connections 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.294+0000 7f630cb2b640 1 -- 172.21.15.92:0/2246935939 wait complete. 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.294+0000 7f630cb2b640 1 Processor -- start 2024-09-21T07:12:06.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f630cb2b640 1 -- start start 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f630cb2b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6308102a60 0x7f630810ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f630cb2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63081083a0 0x7f63081104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f630cb2b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6308108cf0 0x7f6308110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f630cb2b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6308113a40 con 0x7f63081083a0 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f630cb2b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f63081138c0 con 0x7f6308108cf0 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f630cb2b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6308113bc0 con 0x7f6308102a60 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f6305d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63081083a0 0x7f63081104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f6305d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63081083a0 0x7f63081104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51708/0 (socket says 172.21.15.92:51708) 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f6305d9b640 1 -- 172.21.15.92:0/1874492438 learned_addr learned my addr 172.21.15.92:0/1874492438 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f630659c640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6308102a60 0x7f630810ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f6306d9d640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6308108cf0 0x7f6308110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f6305d9b640 1 -- 172.21.15.92:0/1874492438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6308102a60 msgr2=0x7f630810ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f6305d9b640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6308102a60 0x7f630810ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f6305d9b640 1 -- 172.21.15.92:0/1874492438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6308108cf0 msgr2=0x7f6308110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f6305d9b640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6308108cf0 0x7f6308110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.295+0000 7f6305d9b640 1 -- 172.21.15.92:0/1874492438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63081a8730 con 0x7f63081083a0 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.296+0000 7f6305d9b640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63081083a0 0x7f63081104f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00b450 tx=0x7f62fc00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.296+0000 7f62f77fe640 1 -- 172.21.15.92:0/1874492438 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc015020 con 0x7f63081083a0 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.296+0000 7f62f77fe640 1 -- 172.21.15.92:0/1874492438 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62fc011cc0 con 0x7f63081083a0 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.296+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63081a8a20 con 0x7f63081083a0 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.296+0000 7f62f77fe640 1 -- 172.21.15.92:0/1874492438 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc010d00 con 0x7f63081083a0 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.296+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63081a8fb0 con 0x7f63081083a0 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.297+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6308063b50 con 0x7f63081083a0 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.298+0000 7f62f77fe640 1 -- 172.21.15.92:0/1874492438 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f62fc018020 con 0x7f63081083a0 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.299+0000 7f62f77fe640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f62f00b6670 0x7f62f00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.299+0000 7f630659c640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f62f00b6670 0x7f62f00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:06.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.299+0000 7f62f77fe640 1 -- 172.21.15.92:0/1874492438 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f62fc0e76d0 con 0x7f63081083a0 2024-09-21T07:12:06.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.299+0000 7f62f77fe640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] conn(0x7f62f00c1a00 0x7f62f00c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:06.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.300+0000 7f62f77fe640 1 -- 172.21.15.92:0/1874492438 --> [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62fc01ee70 con 0x7f62f00c1a00 2024-09-21T07:12:06.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.300+0000 7f62f77fe640 1 -- 172.21.15.92:0/1874492438 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f62fc0e7b20 con 0x7f63081083a0 2024-09-21T07:12:06.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.300+0000 7f630659c640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f62f00b6670 0x7f62f00b8b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6308111a00 tx=0x7f62f8009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:06.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.300+0000 7f6306d9d640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] conn(0x7f62f00c1a00 0x7f62f00c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:06.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.300+0000 7f6306d9d640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] conn(0x7f62f00c1a00 0x7f62f00c3ef0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:06.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.301+0000 7f62f77fe640 1 -- 172.21.15.92:0/1874492438 <== osd.10 v2:172.21.15.169:6824/3327763720 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f62fc01ee70 con 0x7f62f00c1a00 2024-09-21T07:12:06.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.315+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 --> [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6308063f80 con 0x7f62f00c1a00 2024-09-21T07:12:06.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f62f77fe640 1 -- 172.21.15.92:0/1874492438 <== osd.10 v2:172.21.15.169:6824/3327763720 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6308063f80 con 0x7f62f00c1a00 2024-09-21T07:12:06.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 >> [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] conn(0x7f62f00c1a00 msgr2=0x7f62f00c3ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f630cb2b640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] conn(0x7f62f00c1a00 0x7f62f00c3ef0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f62f00b6670 msgr2=0x7f62f00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f630cb2b640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f62f00b6670 0x7f62f00b8b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6308111a00 tx=0x7f62f8009110 comp rx=0 tx=0).stop 2024-09-21T07:12:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63081083a0 msgr2=0x7f63081104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f630cb2b640 1 --2- 172.21.15.92:0/1874492438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63081083a0 0x7f63081104f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00b450 tx=0x7f62fc00b850 comp rx=0 tx=0).stop 2024-09-21T07:12:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f6306d9d640 1 -- 172.21.15.92:0/1874492438 reap_dead start 2024-09-21T07:12:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 shutdown_connections 2024-09-21T07:12:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 >> 172.21.15.92:0/1874492438 conn(0x7f6308079730 msgr2=0x7f63081052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 shutdown_connections 2024-09-21T07:12:06.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:06.316+0000 7f630cb2b640 1 -- 172.21.15.92:0/1874492438 wait complete. 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.390+0000 7f653f682640 1 -- 172.21.15.92:0/3778840759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65381083a0 msgr2=0x7f65381087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.390+0000 7f653f682640 1 --2- 172.21.15.92:0/3778840759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65381083a0 0x7f65381087b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6534009900 tx=0x7f653402a410 comp rx=0 tx=0).stop 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.390+0000 7f653f682640 1 -- 172.21.15.92:0/3778840759 shutdown_connections 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.390+0000 7f653f682640 1 --2- 172.21.15.92:0/3778840759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6538108cf0 0x7f653810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.390+0000 7f653f682640 1 --2- 172.21.15.92:0/3778840759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65381083a0 0x7f65381087b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.390+0000 7f653f682640 1 --2- 172.21.15.92:0/3778840759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6538102a60 0x7f6538102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.390+0000 7f653f682640 1 -- 172.21.15.92:0/3778840759 >> 172.21.15.92:0/3778840759 conn(0x7f6538079730 msgr2=0x7f6538079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.390+0000 7f653f682640 1 -- 172.21.15.92:0/3778840759 shutdown_connections 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.390+0000 7f653f682640 1 -- 172.21.15.92:0/3778840759 wait complete. 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.391+0000 7f653f682640 1 Processor -- start 2024-09-21T07:12:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.391+0000 7f653f682640 1 -- start start 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.391+0000 7f653f682640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6538102a60 0x7f653819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.391+0000 7f653f682640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65381083a0 0x7f653819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.391+0000 7f653f682640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6538108cf0 0x7f653819bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653f682640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65381128d0 con 0x7f6538108cf0 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653f682640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6538112750 con 0x7f65381083a0 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653f682640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6538112a50 con 0x7f6538102a60 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653dc1f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6538108cf0 0x7f653819bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653dc1f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6538108cf0 0x7f653819bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51686/0 (socket says 172.21.15.92:51686) 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653dc1f640 1 -- 172.21.15.92:0/2588786426 learned_addr learned my addr 172.21.15.92:0/2588786426 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653cc1d640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65381083a0 0x7f653819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653d41e640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6538102a60 0x7f653819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653dc1f640 1 -- 172.21.15.92:0/2588786426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6538102a60 msgr2=0x7f653819b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653dc1f640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6538102a60 0x7f653819b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653dc1f640 1 -- 172.21.15.92:0/2588786426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65381083a0 msgr2=0x7f653819b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653dc1f640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65381083a0 0x7f653819b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653dc1f640 1 -- 172.21.15.92:0/2588786426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65381a6620 con 0x7f6538108cf0 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653d41e640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6538102a60 0x7f653819b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653dc1f640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6538108cf0 0x7f653819bde0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f653000b970 tx=0x7f653000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f652a7fc640 1 -- 172.21.15.92:0/2588786426 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530019070 con 0x7f6538108cf0 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65381a6910 con 0x7f6538108cf0 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f652a7fc640 1 -- 172.21.15.92:0/2588786426 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6530014440 con 0x7f6538108cf0 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f652a7fc640 1 -- 172.21.15.92:0/2588786426 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65300075d0 con 0x7f6538108cf0 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.392+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65381a6e50 con 0x7f6538108cf0 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.393+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6538063b50 con 0x7f6538108cf0 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.395+0000 7f652a7fc640 1 -- 172.21.15.92:0/2588786426 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f653001c070 con 0x7f6538108cf0 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.396+0000 7f652a7fc640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65240b65f0 0x7f65240b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.396+0000 7f653d41e640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65240b65f0 0x7f65240b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.396+0000 7f652a7fc640 1 -- 172.21.15.92:0/2588786426 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f65300e7630 con 0x7f6538108cf0 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.396+0000 7f652a7fc640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] conn(0x7f65240c1980 0x7f65240c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.396+0000 7f652a7fc640 1 -- 172.21.15.92:0/2588786426 --> [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6530018ec0 con 0x7f65240c1980 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.396+0000 7f652a7fc640 1 -- 172.21.15.92:0/2588786426 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f65300e79e0 con 0x7f6538108cf0 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.396+0000 7f653d41e640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65240b65f0 0x7f65240b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f653806c720 tx=0x7f652c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.396+0000 7f653cc1d640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] conn(0x7f65240c1980 0x7f65240c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.397+0000 7f653cc1d640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] conn(0x7f65240c1980 0x7f65240c3e70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.398+0000 7f652a7fc640 1 -- 172.21.15.92:0/2588786426 <== osd.4 v2:172.21.15.169:6808/3000296749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6530018ec0 con 0x7f65240c1980 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.411+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 --> [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6538064000 con 0x7f65240c1980 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f652a7fc640 1 -- 172.21.15.92:0/2588786426 <== osd.4 v2:172.21.15.169:6808/3000296749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6538064000 con 0x7f65240c1980 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 >> [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] conn(0x7f65240c1980 msgr2=0x7f65240c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653f682640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] conn(0x7f65240c1980 0x7f65240c3e70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65240b65f0 msgr2=0x7f65240b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653f682640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65240b65f0 0x7f65240b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f653806c720 tx=0x7f652c008040 comp rx=0 tx=0).stop 2024-09-21T07:12:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6538108cf0 msgr2=0x7f653819bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653f682640 1 --2- 172.21.15.92:0/2588786426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6538108cf0 0x7f653819bde0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f653000b970 tx=0x7f653000be30 comp rx=0 tx=0).stop 2024-09-21T07:12:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653dc1f640 1 -- 172.21.15.92:0/2588786426 reap_dead start 2024-09-21T07:12:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 shutdown_connections 2024-09-21T07:12:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 >> 172.21.15.92:0/2588786426 conn(0x7f6538079730 msgr2=0x7f6538105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 shutdown_connections 2024-09-21T07:12:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:05.412+0000 7f653f682640 1 -- 172.21.15.92:0/2588786426 wait complete. 2024-09-21T07:12:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:06 smithi175 ceph-mon[34064]: pgmap v308: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:12:07.093 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:06 smithi092 ceph-mon[30987]: pgmap v308: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:12:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:06 smithi169 ceph-mon[33705]: pgmap v308: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:12:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.509+0000 7fcfc5782640 1 -- 172.21.15.92:0/3027510694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc0108cf0 msgr2=0x7fcfc010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.509+0000 7fcfc5782640 1 --2- 172.21.15.92:0/3027510694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc0108cf0 0x7fcfc010f520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009ca0 tx=0x7fcfb802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.509+0000 7fcfc5782640 1 -- 172.21.15.92:0/3027510694 shutdown_connections 2024-09-21T07:12:07.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.509+0000 7fcfc5782640 1 --2- 172.21.15.92:0/3027510694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc0108cf0 0x7fcfc010f520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:07.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.509+0000 7fcfc5782640 1 --2- 172.21.15.92:0/3027510694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc01083a0 0x7fcfc01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:07.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.509+0000 7fcfc5782640 1 --2- 172.21.15.92:0/3027510694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc0102a60 0x7fcfc0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:07.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.509+0000 7fcfc5782640 1 -- 172.21.15.92:0/3027510694 >> 172.21.15.92:0/3027510694 conn(0x7fcfc0079730 msgr2=0x7fcfc0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:07.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.509+0000 7fcfc5782640 1 -- 172.21.15.92:0/3027510694 shutdown_connections 2024-09-21T07:12:07.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.509+0000 7fcfc5782640 1 -- 172.21.15.92:0/3027510694 wait complete. 2024-09-21T07:12:07.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfc5782640 1 Processor -- start 2024-09-21T07:12:07.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfc5782640 1 -- start start 2024-09-21T07:12:07.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfc5782640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc0102a60 0x7fcfc019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:07.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfc5782640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc01083a0 0x7fcfc019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfc5782640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc0108cf0 0x7fcfc019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfc5782640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc01139c0 con 0x7fcfc0102a60 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfc5782640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc0113840 con 0x7fcfc0108cf0 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfc5782640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc0113b40 con 0x7fcfc01083a0 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfbeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc0102a60 0x7fcfc019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfbeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc0102a60 0x7fcfc019a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51714/0 (socket says 172.21.15.92:51714) 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.510+0000 7fcfbeffd640 1 -- 172.21.15.92:0/738597103 learned_addr learned my addr 172.21.15.92:0/738597103 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfb67fc640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc01083a0 0x7fcfc019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfbf7fe640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc0108cf0 0x7fcfc019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfbeffd640 1 -- 172.21.15.92:0/738597103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc01083a0 msgr2=0x7fcfc019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfbeffd640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc01083a0 0x7fcfc019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfbeffd640 1 -- 172.21.15.92:0/738597103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc0108cf0 msgr2=0x7fcfc019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfbeffd640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc0108cf0 0x7fcfc019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfbeffd640 1 -- 172.21.15.92:0/738597103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc01a0360 con 0x7fcfc0102a60 2024-09-21T07:12:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfb67fc640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc01083a0 0x7fcfc019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfbeffd640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc0102a60 0x7fcfc019a3f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000d950 tx=0x7fcfb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfbcff9640 1 -- 172.21.15.92:0/738597103 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0017070 con 0x7fcfc0102a60 2024-09-21T07:12:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfbcff9640 1 -- 172.21.15.92:0/738597103 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcfb0009c30 con 0x7fcfc0102a60 2024-09-21T07:12:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfbcff9640 1 -- 172.21.15.92:0/738597103 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000f620 con 0x7fcfc0102a60 2024-09-21T07:12:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc01a0650 con 0x7fcfc0102a60 2024-09-21T07:12:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.511+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc01a6db0 con 0x7fcfc0102a60 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.512+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcfc0063b50 con 0x7fcfc0102a60 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.514+0000 7fcfbcff9640 1 -- 172.21.15.92:0/738597103 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fcfb0010460 con 0x7fcfc0102a60 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.514+0000 7fcfbcff9640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfac0b6670 0x7fcfac0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.515+0000 7fcfb67fc640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfac0b6670 0x7fcfac0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.515+0000 7fcfbcff9640 1 -- 172.21.15.92:0/738597103 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7fcfb00e79a0 con 0x7fcfc0102a60 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.515+0000 7fcfbcff9640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] conn(0x7fcfac0c1a00 0x7fcfac0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.515+0000 7fcfbcff9640 1 -- 172.21.15.92:0/738597103 --> [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfac0c45c0 con 0x7fcfac0c1a00 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.515+0000 7fcfbcff9640 1 -- 172.21.15.92:0/738597103 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fcfb00e7df0 con 0x7fcfc0102a60 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.515+0000 7fcfbf7fe640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] conn(0x7fcfac0c1a00 0x7fcfac0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.515+0000 7fcfb67fc640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfac0b6670 0x7fcfac0b8b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0079d30 tx=0x7fcfa8008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.515+0000 7fcfbf7fe640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] conn(0x7fcfac0c1a00 0x7fcfac0c3ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.516+0000 7fcfbcff9640 1 -- 172.21.15.92:0/738597103 <== osd.9 v2:172.21.15.92:6826/1564956774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcfac0c45c0 con 0x7fcfac0c1a00 2024-09-21T07:12:07.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 --> [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcfc0064020 con 0x7fcfac0c1a00 2024-09-21T07:12:07.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfbcff9640 1 -- 172.21.15.92:0/738597103 <== osd.9 v2:172.21.15.92:6826/1564956774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcfc0064020 con 0x7fcfac0c1a00 2024-09-21T07:12:07.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] conn(0x7fcfac0c1a00 msgr2=0x7fcfac0c3ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:07.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfc5782640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] conn(0x7fcfac0c1a00 0x7fcfac0c3ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:07.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfac0b6670 msgr2=0x7fcfac0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:07.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfc5782640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcfac0b6670 0x7fcfac0b8b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0079d30 tx=0x7fcfa8008040 comp rx=0 tx=0).stop 2024-09-21T07:12:07.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc0102a60 msgr2=0x7fcfc019a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:07.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfc5782640 1 --2- 172.21.15.92:0/738597103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfc0102a60 0x7fcfc019a3f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000d950 tx=0x7fcfb000de10 comp rx=0 tx=0).stop 2024-09-21T07:12:07.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfbf7fe640 1 -- 172.21.15.92:0/738597103 reap_dead start 2024-09-21T07:12:07.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 shutdown_connections 2024-09-21T07:12:07.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.530+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 >> 172.21.15.92:0/738597103 conn(0x7fcfc0079730 msgr2=0x7fcfc01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:07.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.531+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 shutdown_connections 2024-09-21T07:12:07.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:07.531+0000 7fcfc5782640 1 -- 172.21.15.92:0/738597103 wait complete. 2024-09-21T07:12:08.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.247+0000 7f615caec640 1 -- 172.21.15.92:0/3022729607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6158106c30 msgr2=0x7f6158110680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:08.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.247+0000 7f615caec640 1 --2- 172.21.15.92:0/3022729607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6158106c30 0x7f6158110680 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6148009900 tx=0x7f614802a410 comp rx=0 tx=0).stop 2024-09-21T07:12:08.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.247+0000 7f615caec640 1 -- 172.21.15.92:0/3022729607 shutdown_connections 2024-09-21T07:12:08.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.247+0000 7f615caec640 1 --2- 172.21.15.92:0/3022729607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6158106c30 0x7f6158110680 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:08.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.247+0000 7f615caec640 1 --2- 172.21.15.92:0/3022729607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61581062e0 0x7f61581066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:08.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.247+0000 7f615caec640 1 --2- 172.21.15.92:0/3022729607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6158102000 0x7f6158102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:08.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.247+0000 7f615caec640 1 -- 172.21.15.92:0/3022729607 >> 172.21.15.92:0/3022729607 conn(0x7f6158079e40 msgr2=0x7f615807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:08.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.247+0000 7f615caec640 1 -- 172.21.15.92:0/3022729607 shutdown_connections 2024-09-21T07:12:08.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.247+0000 7f615caec640 1 -- 172.21.15.92:0/3022729607 wait complete. 2024-09-21T07:12:08.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.248+0000 7f615caec640 1 Processor -- start 2024-09-21T07:12:08.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.248+0000 7f615caec640 1 -- start start 2024-09-21T07:12:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.248+0000 7f615caec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6158102000 0x7f615819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.248+0000 7f615caec640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61581062e0 0x7f615819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.248+0000 7f615caec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6158106c30 0x7f615819fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.248+0000 7f615caec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6158113980 con 0x7f6158106c30 2024-09-21T07:12:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.248+0000 7f615caec640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6158113800 con 0x7f61581062e0 2024-09-21T07:12:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.248+0000 7f615caec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6158113b00 con 0x7f6158102000 2024-09-21T07:12:08.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f6156d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6158106c30 0x7f615819fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:08.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f6156d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6158106c30 0x7f615819fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51732/0 (socket says 172.21.15.92:51732) 2024-09-21T07:12:08.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f6156d9d640 1 -- 172.21.15.92:0/631451732 learned_addr learned my addr 172.21.15.92:0/631451732 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:08.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f615659c640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6158102000 0x7f615819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:08.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f6155d9b640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61581062e0 0x7f615819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:08.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f6156d9d640 1 -- 172.21.15.92:0/631451732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6158102000 msgr2=0x7f615819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:08.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f6156d9d640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6158102000 0x7f615819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:08.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f6156d9d640 1 -- 172.21.15.92:0/631451732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61581062e0 msgr2=0x7f615819a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:08.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f6156d9d640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61581062e0 0x7f615819a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:08.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f6156d9d640 1 -- 172.21.15.92:0/631451732 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61581a0260 con 0x7f6158106c30 2024-09-21T07:12:08.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f6156d9d640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6158106c30 0x7f615819fb30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6148004770 tx=0x7f6148004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:08.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f614f7fe640 1 -- 172.21.15.92:0/631451732 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614803f030 con 0x7f6158106c30 2024-09-21T07:12:08.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f614f7fe640 1 -- 172.21.15.92:0/631451732 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6148004440 con 0x7f6158106c30 2024-09-21T07:12:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61581a04f0 con 0x7f6158106c30 2024-09-21T07:12:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f614f7fe640 1 -- 172.21.15.92:0/631451732 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148035070 con 0x7f6158106c30 2024-09-21T07:12:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.249+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61581a6cb0 con 0x7f6158106c30 2024-09-21T07:12:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.250+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6158063b50 con 0x7f6158106c30 2024-09-21T07:12:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.252+0000 7f614f7fe640 1 -- 172.21.15.92:0/631451732 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6148042030 con 0x7f6158106c30 2024-09-21T07:12:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.252+0000 7f614f7fe640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61440b6670 0x7f61440b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:08.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.253+0000 7f615659c640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61440b6670 0x7f61440b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:08.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.253+0000 7f614f7fe640 1 -- 172.21.15.92:0/631451732 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f61481080e0 con 0x7f6158106c30 2024-09-21T07:12:08.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.253+0000 7f614f7fe640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] conn(0x7f61440c1a00 0x7f61440c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:08.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.253+0000 7f614f7fe640 1 -- 172.21.15.92:0/631451732 --> [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61440c45c0 con 0x7f61440c1a00 2024-09-21T07:12:08.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.253+0000 7f614f7fe640 1 -- 172.21.15.92:0/631451732 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f6148108530 con 0x7f6158106c30 2024-09-21T07:12:08.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.253+0000 7f615659c640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61440b6670 0x7f61440b8b80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6150005fd0 tx=0x7f6150009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:08.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.253+0000 7f6155d9b640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] conn(0x7f61440c1a00 0x7f61440c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:08.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.254+0000 7f6155d9b640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] conn(0x7f61440c1a00 0x7f61440c3ef0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:08.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.254+0000 7f614f7fe640 1 -- 172.21.15.92:0/631451732 <== osd.5 v2:172.21.15.175:6808/1466838289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f61440c45c0 con 0x7f61440c1a00 2024-09-21T07:12:08.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.268+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 --> [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6158063f80 con 0x7f61440c1a00 2024-09-21T07:12:08.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.269+0000 7f614f7fe640 1 -- 172.21.15.92:0/631451732 <== osd.5 v2:172.21.15.175:6808/1466838289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6158063f80 con 0x7f61440c1a00 2024-09-21T07:12:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.269+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 >> [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] conn(0x7f61440c1a00 msgr2=0x7f61440c3ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.269+0000 7f615caec640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] conn(0x7f61440c1a00 0x7f61440c3ef0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.269+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61440b6670 msgr2=0x7f61440b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.269+0000 7f615caec640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61440b6670 0x7f61440b8b80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6150005fd0 tx=0x7f6150009680 comp rx=0 tx=0).stop 2024-09-21T07:12:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.269+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6158106c30 msgr2=0x7f615819fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.269+0000 7f615caec640 1 --2- 172.21.15.92:0/631451732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6158106c30 0x7f615819fb30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6148004770 tx=0x7f6148004040 comp rx=0 tx=0).stop 2024-09-21T07:12:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.269+0000 7f6156d9d640 1 -- 172.21.15.92:0/631451732 reap_dead start 2024-09-21T07:12:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.270+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 shutdown_connections 2024-09-21T07:12:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.270+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 >> 172.21.15.92:0/631451732 conn(0x7f6158079e40 msgr2=0x7f6158107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.270+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 shutdown_connections 2024-09-21T07:12:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:08.270+0000 7f615caec640 1 -- 172.21.15.92:0/631451732 wait complete. 2024-09-21T07:12:08.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:08 smithi092 ceph-mon[30987]: pgmap v309: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:12:08.885 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:08.887 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:08.898 INFO:teuthology.orchestra.run.smithi092.stdout:180388626483 2024-09-21T07:12:08.898 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T07:12:09.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:08 smithi175 ceph-mon[34064]: pgmap v309: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:12:09.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:08 smithi169 ceph-mon[33705]: pgmap v309: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:12:09.788 INFO:teuthology.orchestra.run.smithi092.stdout:154618822714 2024-09-21T07:12:09.789 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T07:12:10.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.232+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1732091019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16e0109df0 msgr2=0x7f16e0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:10.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.232+0000 7f16e7ee9640 1 --2- 172.21.15.92:0/1732091019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16e0109df0 0x7f16e0110620 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009ca0 tx=0x7f16d802a8e0 comp rx=0 tx=0).stop 2024-09-21T07:12:10.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.233+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1732091019 shutdown_connections 2024-09-21T07:12:10.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.233+0000 7f16e7ee9640 1 --2- 172.21.15.92:0/1732091019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16e0109df0 0x7f16e0110620 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:10.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.233+0000 7f16e7ee9640 1 --2- 172.21.15.92:0/1732091019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16e01094a0 0x7f16e01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:10.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.233+0000 7f16e7ee9640 1 --2- 172.21.15.92:0/1732091019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16e0103b60 0x7f16e0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:10.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.233+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1732091019 >> 172.21.15.92:0/1732091019 conn(0x7f16e007b850 msgr2=0x7f16e007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:10.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.233+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1732091019 shutdown_connections 2024-09-21T07:12:10.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.233+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1732091019 wait complete. 2024-09-21T07:12:10.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.233+0000 7f16e7ee9640 1 Processor -- start 2024-09-21T07:12:10.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.233+0000 7f16e7ee9640 1 -- start start 2024-09-21T07:12:10.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e7ee9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16e0103b60 0x7f16e019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:10.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e7ee9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16e01094a0 0x7f16e019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:10.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e7ee9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16e0109df0 0x7f16e019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:10.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e7ee9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16e01139c0 con 0x7f16e01094a0 2024-09-21T07:12:10.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e7ee9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0113840 con 0x7f16e0109df0 2024-09-21T07:12:10.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e7ee9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0113b40 con 0x7f16e0103b60 2024-09-21T07:12:10.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e5484640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16e01094a0 0x7f16e019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:10.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e5484640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16e01094a0 0x7f16e019a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40036/0 (socket says 172.21.15.92:40036) 2024-09-21T07:12:10.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e5484640 1 -- 172.21.15.92:0/1941634269 learned_addr learned my addr 172.21.15.92:0/1941634269 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:10.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e5c85640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16e0103b60 0x7f16e019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:10.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e6486640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16e0109df0 0x7f16e019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e5484640 1 -- 172.21.15.92:0/1941634269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16e0103b60 msgr2=0x7f16e019a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e5484640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16e0103b60 0x7f16e019a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e5484640 1 -- 172.21.15.92:0/1941634269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16e0109df0 msgr2=0x7f16e019fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e5484640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16e0109df0 0x7f16e019fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e5484640 1 -- 172.21.15.92:0/1941634269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e01a0340 con 0x7f16e01094a0 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e6486640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16e0109df0 0x7f16e019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e5484640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16e01094a0 0x7f16e019a970 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16d4006fd0 tx=0x7f16d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16deffd640 1 -- 172.21.15.92:0/1941634269 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d4011830 con 0x7f16e01094a0 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16deffd640 1 -- 172.21.15.92:0/1941634269 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16d4016070 con 0x7f16e01094a0 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16deffd640 1 -- 172.21.15.92:0/1941634269 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d4010d30 con 0x7f16e01094a0 2024-09-21T07:12:10.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.234+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e01a0630 con 0x7f16e01094a0 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.235+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e01a6d90 con 0x7f16e01094a0 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.235+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f16e0063b50 con 0x7f16e01094a0 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.237+0000 7f16deffd640 1 -- 172.21.15.92:0/1941634269 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f16d40119d0 con 0x7f16e01094a0 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.238+0000 7f16deffd640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16c80b65f0 0x7f16c80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.238+0000 7f16e5c85640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16c80b65f0 0x7f16c80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.238+0000 7f16deffd640 1 -- 172.21.15.92:0/1941634269 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7f16d40e7900 con 0x7f16e01094a0 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.238+0000 7f16deffd640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] conn(0x7f16c80c1980 0x7f16c80c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.238+0000 7f16deffd640 1 -- 172.21.15.92:0/1941634269 --> [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16d4022e50 con 0x7f16c80c1980 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.238+0000 7f16deffd640 1 -- 172.21.15.92:0/1941634269 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f16d40e7d50 con 0x7f16e01094a0 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.238+0000 7f16e5c85640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16c80b65f0 0x7f16c80b8b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f16d0005fd0 tx=0x7f16d000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.239+0000 7f16e6486640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] conn(0x7f16c80c1980 0x7f16c80c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:10.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.239+0000 7f16e6486640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] conn(0x7f16c80c1980 0x7f16c80c3e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:10.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.240+0000 7f16deffd640 1 -- 172.21.15.92:0/1941634269 <== osd.7 v2:172.21.15.169:6816/3631528886 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f16d4022e50 con 0x7f16c80c1980 2024-09-21T07:12:10.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.255+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 --> [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f16e0063fd0 con 0x7f16c80c1980 2024-09-21T07:12:10.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.256+0000 7f16deffd640 1 -- 172.21.15.92:0/1941634269 <== osd.7 v2:172.21.15.169:6816/3631528886 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f16e0063fd0 con 0x7f16c80c1980 2024-09-21T07:12:10.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.256+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 >> [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] conn(0x7f16c80c1980 msgr2=0x7f16c80c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:10.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.256+0000 7f16e7ee9640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] conn(0x7f16c80c1980 0x7f16c80c3e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:10.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.257+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16c80b65f0 msgr2=0x7f16c80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:10.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.257+0000 7f16e7ee9640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16c80b65f0 0x7f16c80b8b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f16d0005fd0 tx=0x7f16d000b390 comp rx=0 tx=0).stop 2024-09-21T07:12:10.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.257+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16e01094a0 msgr2=0x7f16e019a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:10.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.257+0000 7f16e7ee9640 1 --2- 172.21.15.92:0/1941634269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16e01094a0 0x7f16e019a970 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16d4006fd0 tx=0x7f16d400b8e0 comp rx=0 tx=0).stop 2024-09-21T07:12:10.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.257+0000 7f16e6486640 1 -- 172.21.15.92:0/1941634269 reap_dead start 2024-09-21T07:12:10.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.257+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 shutdown_connections 2024-09-21T07:12:10.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.257+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 >> 172.21.15.92:0/1941634269 conn(0x7f16e007b850 msgr2=0x7f16e01054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:10.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.257+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 shutdown_connections 2024-09-21T07:12:10.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:10.257+0000 7f16e7ee9640 1 -- 172.21.15.92:0/1941634269 wait complete. 2024-09-21T07:12:10.734 INFO:teuthology.orchestra.run.smithi092.stdout:133143986240 2024-09-21T07:12:10.735 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T07:12:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:10 smithi175 ceph-mon[34064]: pgmap v310: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T07:12:11.024 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:10 smithi092 ceph-mon[30987]: pgmap v310: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T07:12:11.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.115+0000 7fcd30950640 1 -- 172.21.15.92:0/4256667855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd2c10dec0 msgr2=0x7fcd2c1103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:11.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.115+0000 7fcd30950640 1 --2- 172.21.15.92:0/4256667855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd2c10dec0 0x7fcd2c1103b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009ca0 tx=0x7fcd2402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:11.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.115+0000 7fcd30950640 1 -- 172.21.15.92:0/4256667855 shutdown_connections 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.115+0000 7fcd30950640 1 --2- 172.21.15.92:0/4256667855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd2c10dec0 0x7fcd2c1103b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.115+0000 7fcd30950640 1 --2- 172.21.15.92:0/4256667855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd2c1053b0 0x7fcd2c10d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.115+0000 7fcd30950640 1 --2- 172.21.15.92:0/4256667855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd2c104a60 0x7fcd2c104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.115+0000 7fcd30950640 1 -- 172.21.15.92:0/4256667855 >> 172.21.15.92:0/4256667855 conn(0x7fcd2c0796d0 msgr2=0x7fcd2c079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.115+0000 7fcd30950640 1 -- 172.21.15.92:0/4256667855 shutdown_connections 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.115+0000 7fcd30950640 1 -- 172.21.15.92:0/4256667855 wait complete. 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd30950640 1 Processor -- start 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd30950640 1 -- start start 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd30950640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd2c104a60 0x7fcd2c1027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd30950640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd2c1053b0 0x7fcd2c102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd30950640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd2c10dec0 0x7fcd2c103220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:11.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd30950640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c113a20 con 0x7fcd2c104a60 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd30950640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c1138a0 con 0x7fcd2c1053b0 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd30950640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c113ba0 con 0x7fcd2c10dec0 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd2a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd2c104a60 0x7fcd2c1027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd2a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd2c104a60 0x7fcd2c1027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40056/0 (socket says 172.21.15.92:40056) 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd2a59c640 1 -- 172.21.15.92:0/3694608503 learned_addr learned my addr 172.21.15.92:0/3694608503 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd2ad9d640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd2c10dec0 0x7fcd2c103220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd29d9b640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd2c1053b0 0x7fcd2c102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd2a59c640 1 -- 172.21.15.92:0/3694608503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd2c10dec0 msgr2=0x7fcd2c103220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd2a59c640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd2c10dec0 0x7fcd2c103220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd2a59c640 1 -- 172.21.15.92:0/3694608503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd2c1053b0 msgr2=0x7fcd2c102ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd2a59c640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd2c1053b0 0x7fcd2c102ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd2a59c640 1 -- 172.21.15.92:0/3694608503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2c1a8680 con 0x7fcd2c104a60 2024-09-21T07:12:11.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.116+0000 7fcd29d9b640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd2c1053b0 0x7fcd2c102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.117+0000 7fcd2a59c640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd2c104a60 0x7fcd2c1027a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c920 tx=0x7fcd1c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.117+0000 7fcd237fe640 1 -- 172.21.15.92:0/3694608503 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c007c70 con 0x7fcd2c104a60 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.117+0000 7fcd237fe640 1 -- 172.21.15.92:0/3694608503 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd1c007e10 con 0x7fcd2c104a60 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.117+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2c1a8970 con 0x7fcd2c104a60 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.117+0000 7fcd237fe640 1 -- 172.21.15.92:0/3694608503 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c018710 con 0x7fcd2c104a60 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.118+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2c1a8eb0 con 0x7fcd2c104a60 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.118+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd2c102110 con 0x7fcd2c104a60 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.119+0000 7fcd237fe640 1 -- 172.21.15.92:0/3694608503 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fcd1c00f450 con 0x7fcd2c104a60 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.120+0000 7fcd237fe640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcd180b6670 0x7fcd180b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.120+0000 7fcd29d9b640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcd180b6670 0x7fcd180b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.121+0000 7fcd237fe640 1 -- 172.21.15.92:0/3694608503 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7fcd1c0e7b60 con 0x7fcd2c104a60 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.121+0000 7fcd237fe640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] conn(0x7fcd180c1a00 0x7fcd180c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.121+0000 7fcd237fe640 1 -- 172.21.15.92:0/3694608503 --> [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd180c45c0 con 0x7fcd180c1a00 2024-09-21T07:12:11.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.121+0000 7fcd237fe640 1 -- 172.21.15.92:0/3694608503 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fcd1c0ec240 con 0x7fcd2c104a60 2024-09-21T07:12:11.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.121+0000 7fcd29d9b640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcd180b6670 0x7fcd180b8b80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c10fca0 tx=0x7fcd14005cb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:11.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.121+0000 7fcd2ad9d640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] conn(0x7fcd180c1a00 0x7fcd180c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:11.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.121+0000 7fcd2ad9d640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] conn(0x7fcd180c1a00 0x7fcd180c3ef0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:11.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.122+0000 7fcd237fe640 1 -- 172.21.15.92:0/3694608503 <== osd.3 v2:172.21.15.92:6810/2450473708 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd180c45c0 con 0x7fcd180c1a00 2024-09-21T07:12:11.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.136+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 --> [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcd2c06c260 con 0x7fcd180c1a00 2024-09-21T07:12:11.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.136+0000 7fcd237fe640 1 -- 172.21.15.92:0/3694608503 <== osd.3 v2:172.21.15.92:6810/2450473708 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcd2c06c260 con 0x7fcd180c1a00 2024-09-21T07:12:11.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.136+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] conn(0x7fcd180c1a00 msgr2=0x7fcd180c3ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:11.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.136+0000 7fcd30950640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] conn(0x7fcd180c1a00 0x7fcd180c3ef0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:11.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.136+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcd180b6670 msgr2=0x7fcd180b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:11.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.137+0000 7fcd30950640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcd180b6670 0x7fcd180b8b80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c10fca0 tx=0x7fcd14005cb0 comp rx=0 tx=0).stop 2024-09-21T07:12:11.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.137+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd2c104a60 msgr2=0x7fcd2c1027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:11.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.137+0000 7fcd30950640 1 --2- 172.21.15.92:0/3694608503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd2c104a60 0x7fcd2c1027a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c920 tx=0x7fcd1c00cde0 comp rx=0 tx=0).stop 2024-09-21T07:12:11.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.137+0000 7fcd2ad9d640 1 -- 172.21.15.92:0/3694608503 reap_dead start 2024-09-21T07:12:11.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.137+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 shutdown_connections 2024-09-21T07:12:11.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.137+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 >> 172.21.15.92:0/3694608503 conn(0x7fcd2c0796d0 msgr2=0x7fcd2c100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:11.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.137+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 shutdown_connections 2024-09-21T07:12:11.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:11.137+0000 7fcd30950640 1 -- 172.21.15.92:0/3694608503 wait complete. 2024-09-21T07:12:11.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:10 smithi169 ceph-mon[33705]: pgmap v310: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T07:12:12.059 INFO:teuthology.orchestra.run.smithi092.stdout:201863462961 2024-09-21T07:12:12.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T07:12:12.489 INFO:teuthology.orchestra.run.smithi092.stdout:253403070502 2024-09-21T07:12:12.489 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T07:12:12.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:12 smithi092 ceph-mon[30987]: pgmap v311: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:12:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:12 smithi175 ceph-mon[34064]: pgmap v311: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:12:13.084 INFO:teuthology.orchestra.run.smithi092.stdout:274877906977 2024-09-21T07:12:13.085 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T07:12:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:12 smithi169 ceph-mon[33705]: pgmap v311: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:12:13.495 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:13.535 INFO:teuthology.orchestra.run.smithi092.stdout:107374182469 2024-09-21T07:12:13.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T07:12:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.700+0000 7f20c939e640 1 -- 172.21.15.92:0/854254151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c4105ae0 msgr2=0x7f20c410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.700+0000 7f20c939e640 1 --2- 172.21.15.92:0/854254151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c4105ae0 0x7f20c410f530 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009ca0 tx=0x7f20bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.700+0000 7f20c939e640 1 -- 172.21.15.92:0/854254151 shutdown_connections 2024-09-21T07:12:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.700+0000 7f20c939e640 1 --2- 172.21.15.92:0/854254151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c4105ae0 0x7f20c410f530 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.700+0000 7f20c939e640 1 --2- 172.21.15.92:0/854254151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c4105190 0x7f20c41055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.700+0000 7f20c939e640 1 --2- 172.21.15.92:0/854254151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20c41031c0 0x7f20c41035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.700+0000 7f20c939e640 1 -- 172.21.15.92:0/854254151 >> 172.21.15.92:0/854254151 conn(0x7f20c4077c60 msgr2=0x7f20c40780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.700+0000 7f20c939e640 1 -- 172.21.15.92:0/854254151 shutdown_connections 2024-09-21T07:12:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.700+0000 7f20c939e640 1 -- 172.21.15.92:0/854254151 wait complete. 2024-09-21T07:12:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c939e640 1 Processor -- start 2024-09-21T07:12:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c939e640 1 -- start start 2024-09-21T07:12:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c939e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20c41031c0 0x7f20c4110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c939e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c4105190 0x7f20c4110550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c939e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c4105ae0 0x7f20c4110a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c939e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20c4113990 con 0x7f20c4105190 2024-09-21T07:12:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c939e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20c4113810 con 0x7f20c41031c0 2024-09-21T07:12:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c939e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f20c4113b10 con 0x7f20c4105ae0 2024-09-21T07:12:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c4105190 0x7f20c4110550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c4105190 0x7f20c4110550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40074/0 (socket says 172.21.15.92:40074) 2024-09-21T07:12:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c27fc640 1 -- 172.21.15.92:0/911231122 learned_addr learned my addr 172.21.15.92:0/911231122 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c37fe640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c4105ae0 0x7f20c4110a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c2ffd640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20c41031c0 0x7f20c4110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c27fc640 1 -- 172.21.15.92:0/911231122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c4105ae0 msgr2=0x7f20c4110a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c27fc640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c4105ae0 0x7f20c4110a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c27fc640 1 -- 172.21.15.92:0/911231122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20c41031c0 msgr2=0x7f20c4110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.701+0000 7f20c27fc640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20c41031c0 0x7f20c4110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.702+0000 7f20c27fc640 1 -- 172.21.15.92:0/911231122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c41a8680 con 0x7f20c4105190 2024-09-21T07:12:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.702+0000 7f20c27fc640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c4105190 0x7f20c4110550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00d740 tx=0x7f20ac00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.702+0000 7f20bbfff640 1 -- 172.21.15.92:0/911231122 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac017070 con 0x7f20c4105190 2024-09-21T07:12:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.702+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c41a8970 con 0x7f20c4105190 2024-09-21T07:12:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.702+0000 7f20bbfff640 1 -- 172.21.15.92:0/911231122 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20ac00de50 con 0x7f20c4105190 2024-09-21T07:12:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.702+0000 7f20bbfff640 1 -- 172.21.15.92:0/911231122 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac004c60 con 0x7f20c4105190 2024-09-21T07:12:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.702+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c41a8eb0 con 0x7f20c4105190 2024-09-21T07:12:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.703+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f20c4063b50 con 0x7f20c4105190 2024-09-21T07:12:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.705+0000 7f20bbfff640 1 -- 172.21.15.92:0/911231122 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f20ac004e00 con 0x7f20c4105190 2024-09-21T07:12:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.705+0000 7f20bbfff640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20b00b65f0 0x7f20b00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.705+0000 7f20bbfff640 1 -- 172.21.15.92:0/911231122 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9452+0+0 (secure 0 0 0) 0x7f20ac0e7890 con 0x7f20c4105190 2024-09-21T07:12:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.705+0000 7f20c2ffd640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20b00b65f0 0x7f20b00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.705+0000 7f20bbfff640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] conn(0x7f20b00c1c00 0x7f20b00c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:13.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.706+0000 7f20bbfff640 1 -- 172.21.15.92:0/911231122 --> [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20ac021e50 con 0x7f20b00c1c00 2024-09-21T07:12:13.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.706+0000 7f20bbfff640 1 -- 172.21.15.92:0/911231122 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f20ac0e7ce0 con 0x7f20c4105190 2024-09-21T07:12:13.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.706+0000 7f20c37fe640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] conn(0x7f20b00c1c00 0x7f20b00c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:13.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.706+0000 7f20c2ffd640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20b00b65f0 0x7f20b00b8b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f20c4111a60 tx=0x7f20b400b5b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:13.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.706+0000 7f20c37fe640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] conn(0x7f20b00c1c00 0x7f20b00c40f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:13.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.707+0000 7f20bbfff640 1 -- 172.21.15.92:0/911231122 <== osd.0 v2:172.21.15.92:6802/2549923251 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20ac021e50 con 0x7f20b00c1c00 2024-09-21T07:12:13.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.720+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 --> [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f20c4063f50 con 0x7f20b00c1c00 2024-09-21T07:12:13.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.721+0000 7f20bbfff640 1 -- 172.21.15.92:0/911231122 <== osd.0 v2:172.21.15.92:6802/2549923251 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f20c4063f50 con 0x7f20b00c1c00 2024-09-21T07:12:13.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.721+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] conn(0x7f20b00c1c00 msgr2=0x7f20b00c40f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:13.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.721+0000 7f20c939e640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] conn(0x7f20b00c1c00 0x7f20b00c40f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:13.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.721+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20b00b65f0 msgr2=0x7f20b00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:13.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.721+0000 7f20c939e640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20b00b65f0 0x7f20b00b8b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f20c4111a60 tx=0x7f20b400b5b0 comp rx=0 tx=0).stop 2024-09-21T07:12:13.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.721+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c4105190 msgr2=0x7f20c4110550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:13.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.721+0000 7f20c939e640 1 --2- 172.21.15.92:0/911231122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20c4105190 0x7f20c4110550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00d740 tx=0x7f20ac00dc00 comp rx=0 tx=0).stop 2024-09-21T07:12:13.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.721+0000 7f20c37fe640 1 -- 172.21.15.92:0/911231122 reap_dead start 2024-09-21T07:12:13.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.721+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 shutdown_connections 2024-09-21T07:12:13.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.721+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 >> 172.21.15.92:0/911231122 conn(0x7f20c4077c60 msgr2=0x7f20c41064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:13.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.722+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 shutdown_connections 2024-09-21T07:12:13.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:13.722+0000 7f20c939e640 1 -- 172.21.15.92:0/911231122 wait complete. 2024-09-21T07:12:13.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T07:12:13.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-21T07:12:13.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T07:12:13.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-21T07:12:13.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-09-21T07:12:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T07:12:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-21T07:12:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T07:12:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-21T07:12:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-09-21T07:12:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T07:12:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-21T07:12:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T07:12:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-21T07:12:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-09-21T07:12:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:14.461 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:14.461 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:14.461 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:14.471 INFO:teuthology.orchestra.run.smithi092.stdout:38654705750 2024-09-21T07:12:14.471 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T07:12:14.490 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:14.495 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:14.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:14 smithi092 ceph-mon[30987]: pgmap v312: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:12:14.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T07:12:14.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-21T07:12:14.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T07:12:14.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-21T07:12:14.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:14 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-21T07:12:14.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:14 smithi092 ceph-mon[30987]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T07:12:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:14 smithi175 ceph-mon[34064]: pgmap v312: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:12:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T07:12:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-21T07:12:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T07:12:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-21T07:12:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:14 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-21T07:12:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:14 smithi175 ceph-mon[34064]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T07:12:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:14 smithi169 ceph-mon[33705]: pgmap v312: 129 pgs: 129 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:12:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T07:12:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-21T07:12:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T07:12:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-21T07:12:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:14 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-21T07:12:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:14 smithi169 ceph-mon[33705]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T07:12:15.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.597+0000 7f74ed0bc640 1 -- 172.21.15.92:0/3866935767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74e8108d20 msgr2=0x7f74e810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.597+0000 7f74ed0bc640 1 --2- 172.21.15.92:0/3866935767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74e8108d20 0x7f74e810f550 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009900 tx=0x7f74d802a410 comp rx=0 tx=0).stop 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.597+0000 7f74ed0bc640 1 -- 172.21.15.92:0/3866935767 shutdown_connections 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.597+0000 7f74ed0bc640 1 --2- 172.21.15.92:0/3866935767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74e8108d20 0x7f74e810f550 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.597+0000 7f74ed0bc640 1 --2- 172.21.15.92:0/3866935767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e81083d0 0x7f74e81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.597+0000 7f74ed0bc640 1 --2- 172.21.15.92:0/3866935767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74e8102ae0 0x7f74e8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.597+0000 7f74ed0bc640 1 -- 172.21.15.92:0/3866935767 >> 172.21.15.92:0/3866935767 conn(0x7f74e8079790 msgr2=0x7f74e8079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.597+0000 7f74ed0bc640 1 -- 172.21.15.92:0/3866935767 shutdown_connections 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.597+0000 7f74ed0bc640 1 -- 172.21.15.92:0/3866935767 wait complete. 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74ed0bc640 1 Processor -- start 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74ed0bc640 1 -- start start 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74ed0bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74e8102ae0 0x7f74e819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74ed0bc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e81083d0 0x7f74e819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74ed0bc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74e8108d20 0x7f74e819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74ed0bc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74e81139f0 con 0x7f74e8102ae0 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74ed0bc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8113870 con 0x7f74e81083d0 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74ed0bc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8113b70 con 0x7f74e8108d20 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74e6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74e8102ae0 0x7f74e819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74e6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74e8102ae0 0x7f74e819a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40088/0 (socket says 172.21.15.92:40088) 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.598+0000 7f74e6d9d640 1 -- 172.21.15.92:0/2381799140 learned_addr learned my addr 172.21.15.92:0/2381799140 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74e759e640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74e8108d20 0x7f74e819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74e659c640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e81083d0 0x7f74e819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74e6d9d640 1 -- 172.21.15.92:0/2381799140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74e8108d20 msgr2=0x7f74e819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74e6d9d640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74e8108d20 0x7f74e819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74e6d9d640 1 -- 172.21.15.92:0/2381799140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e81083d0 msgr2=0x7f74e819a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74e6d9d640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e81083d0 0x7f74e819a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74e6d9d640 1 -- 172.21.15.92:0/2381799140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e81a0330 con 0x7f74e8102ae0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74e6d9d640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74e8102ae0 0x7f74e819a3c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f74e000d770 tx=0x7f74e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74cffff640 1 -- 172.21.15.92:0/2381799140 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0017070 con 0x7f74e8102ae0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74ed0bc640 1 -- 172.21.15.92:0/2381799140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e81a0620 con 0x7f74e8102ae0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74cffff640 1 -- 172.21.15.92:0/2381799140 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74e00054b0 con 0x7f74e8102ae0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74ed0bc640 1 -- 172.21.15.92:0/2381799140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e81a6d80 con 0x7f74e8102ae0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.599+0000 7f74cffff640 1 -- 172.21.15.92:0/2381799140 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0020060 con 0x7f74e8102ae0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.600+0000 7f74ed0bc640 1 -- 172.21.15.92:0/2381799140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e8102ef0 con 0x7f74e8102ae0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.602+0000 7f74cffff640 1 -- 172.21.15.92:0/2381799140 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f74e0004c00 con 0x7f74e8102ae0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.602+0000 7f74cffff640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f74d00b65f0 0x7f74d00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.603+0000 7f74e659c640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f74d00b65f0 0x7f74d00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.603+0000 7f74cffff640 1 -- 172.21.15.92:0/2381799140 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f74e00e7980 con 0x7f74e8102ae0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.603+0000 7f74e659c640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f74d00b65f0 0x7f74d00b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f74e8106120 tx=0x7f74dc0094f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:15.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.606+0000 7f74cffff640 1 -- 172.21.15.92:0/2381799140 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74e00adbf0 con 0x7f74e8102ae0 2024-09-21T07:12:15.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.792+0000 7f74ed0bc640 1 -- 172.21.15.92:0/2381799140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f74e802e640 con 0x7f74e8102ae0 2024-09-21T07:12:15.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.792+0000 7f74cffff640 1 -- 172.21.15.92:0/2381799140 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74e00b1fd0 con 0x7f74e8102ae0 2024-09-21T07:12:15.794 INFO:teuthology.orchestra.run.smithi092.stdout:81604378699 2024-09-21T07:12:15.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.794+0000 7f74ed0bc640 1 -- 172.21.15.92:0/2381799140 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f74d00b65f0 msgr2=0x7f74d00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.794+0000 7f74ed0bc640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f74d00b65f0 0x7f74d00b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f74e8106120 tx=0x7f74dc0094f0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.794+0000 7f74ed0bc640 1 -- 172.21.15.92:0/2381799140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74e8102ae0 msgr2=0x7f74e819a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.794+0000 7f74ed0bc640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74e8102ae0 0x7f74e819a3c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f74e000d770 tx=0x7f74e000dc30 comp rx=0 tx=0).stop 2024-09-21T07:12:15.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.795+0000 7f74ed0bc640 1 -- 172.21.15.92:0/2381799140 shutdown_connections 2024-09-21T07:12:15.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.795+0000 7f74ed0bc640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f74d00b65f0 0x7f74d00b8b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.795+0000 7f74ed0bc640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74e8108d20 0x7f74e819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.795+0000 7f74ed0bc640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e81083d0 0x7f74e819a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.795+0000 7f74ed0bc640 1 --2- 172.21.15.92:0/2381799140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74e8102ae0 0x7f74e819a3c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.795+0000 7f74ed0bc640 1 -- 172.21.15.92:0/2381799140 >> 172.21.15.92:0/2381799140 conn(0x7f74e8079790 msgr2=0x7f74e81043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:15.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.795+0000 7f74ed0bc640 1 -- 172.21.15.92:0/2381799140 shutdown_connections 2024-09-21T07:12:15.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.795+0000 7f74ed0bc640 1 -- 172.21.15.92:0/2381799140 wait complete. 2024-09-21T07:12:15.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:15 smithi092 ceph-mon[30987]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T07:12:15.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.923+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2066735437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db4108cf0 msgr2=0x7f5db410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.923+0000 7f5db8b2b640 1 --2- 172.21.15.92:0/2066735437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db4108cf0 0x7f5db410f520 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009ca0 tx=0x7f5dac02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.923+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2066735437 shutdown_connections 2024-09-21T07:12:15.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.923+0000 7f5db8b2b640 1 --2- 172.21.15.92:0/2066735437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db4108cf0 0x7f5db410f520 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.923+0000 7f5db8b2b640 1 --2- 172.21.15.92:0/2066735437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db41083a0 0x7f5db41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.923+0000 7f5db8b2b640 1 --2- 172.21.15.92:0/2066735437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5db4102a60 0x7f5db4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.923+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2066735437 >> 172.21.15.92:0/2066735437 conn(0x7f5db4079730 msgr2=0x7f5db4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.924+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2066735437 shutdown_connections 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.924+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2066735437 wait complete. 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.924+0000 7f5db8b2b640 1 Processor -- start 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.924+0000 7f5db8b2b640 1 -- start start 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db8b2b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db4102a60 0x7f5db419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db8b2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db41083a0 0x7f5db419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db8b2b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5db4108cf0 0x7f5db419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db8b2b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5db4112860 con 0x7f5db41083a0 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db8b2b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5db41126e0 con 0x7f5db4108cf0 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db8b2b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5db41129e0 con 0x7f5db4102a60 2024-09-21T07:12:15.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db41083a0 0x7f5db419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db41083a0 0x7f5db419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40120/0 (socket says 172.21.15.92:40120) 2024-09-21T07:12:15.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db1d9b640 1 -- 172.21.15.92:0/2695236191 learned_addr learned my addr 172.21.15.92:0/2695236191 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:15.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db259c640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db4102a60 0x7f5db419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db2d9d640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5db4108cf0 0x7f5db419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db1d9b640 1 -- 172.21.15.92:0/2695236191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db4102a60 msgr2=0x7f5db419b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db1d9b640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db4102a60 0x7f5db419b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db1d9b640 1 -- 172.21.15.92:0/2695236191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5db4108cf0 msgr2=0x7f5db419bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db1d9b640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5db4108cf0 0x7f5db419bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db1d9b640 1 -- 172.21.15.92:0/2695236191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db41a6430 con 0x7f5db41083a0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db2d9d640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5db4108cf0 0x7f5db419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.925+0000 7f5db1d9b640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db41083a0 0x7f5db419b6b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5da800d740 tx=0x7f5da800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.926+0000 7f5da37fe640 1 -- 172.21.15.92:0/2695236191 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da8017070 con 0x7f5db41083a0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.926+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2695236191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db41a6720 con 0x7f5db41083a0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.926+0000 7f5da37fe640 1 -- 172.21.15.92:0/2695236191 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5da800de50 con 0x7f5db41083a0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.926+0000 7f5da37fe640 1 -- 172.21.15.92:0/2695236191 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da8004c60 con 0x7f5db41083a0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.926+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2695236191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db4198f60 con 0x7f5db41083a0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.927+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2695236191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db4102e70 con 0x7f5db41083a0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.929+0000 7f5da37fe640 1 -- 172.21.15.92:0/2695236191 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f5da8004e00 con 0x7f5db41083a0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.930+0000 7f5da37fe640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5d9c0baa00 0x7f5d9c0bcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.930+0000 7f5db259c640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5d9c0baa00 0x7f5d9c0bcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.931+0000 7f5da37fe640 1 -- 172.21.15.92:0/2695236191 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f5da80e73c0 con 0x7f5db41083a0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.931+0000 7f5db259c640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5d9c0baa00 0x7f5d9c0bcf10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5db406b9e0 tx=0x7f5da400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:15.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.935+0000 7f5da37fe640 1 -- 172.21.15.92:0/2695236191 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5da80ad630 con 0x7f5db41083a0 2024-09-21T07:12:16.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:15 smithi175 ceph-mon[34064]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T07:12:16.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.128+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2695236191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f5db410a550 con 0x7f5db41083a0 2024-09-21T07:12:16.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.129+0000 7f5da37fe640 1 -- 172.21.15.92:0/2695236191 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5da80b1a10 con 0x7f5db41083a0 2024-09-21T07:12:16.131 INFO:teuthology.orchestra.run.smithi092.stdout:227633266733 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2695236191 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5d9c0baa00 msgr2=0x7f5d9c0bcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5d9c0baa00 0x7f5d9c0bcf10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5db406b9e0 tx=0x7f5da400b390 comp rx=0 tx=0).stop 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2695236191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db41083a0 msgr2=0x7f5db419b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db41083a0 0x7f5db419b6b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5da800d740 tx=0x7f5da800dc00 comp rx=0 tx=0).stop 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2695236191 shutdown_connections 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5d9c0baa00 0x7f5d9c0bcf10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5db4108cf0 0x7f5db419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5db41083a0 0x7f5db419b6b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 --2- 172.21.15.92:0/2695236191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db4102a60 0x7f5db419b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2695236191 >> 172.21.15.92:0/2695236191 conn(0x7f5db4079730 msgr2=0x7f5db41043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:16.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2695236191 shutdown_connections 2024-09-21T07:12:16.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.131+0000 7f5db8b2b640 1 -- 172.21.15.92:0/2695236191 wait complete. 2024-09-21T07:12:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:15 smithi169 ceph-mon[33705]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T07:12:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:16 smithi175 ceph-mon[34064]: pgmap v315: 129 pgs: 2 peering, 127 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 8 op/s 2024-09-21T07:12:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:16 smithi175 ceph-mon[34064]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T07:12:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:16 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2381799140' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:12:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:16 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3474039931' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:12:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:16 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2695236191' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:12:17.075 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:16 smithi092 ceph-mon[30987]: pgmap v315: 129 pgs: 2 peering, 127 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 8 op/s 2024-09-21T07:12:17.076 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:16 smithi092 ceph-mon[30987]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T07:12:17.076 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:16 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2381799140' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:12:17.076 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:16 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3474039931' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:12:17.076 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:16 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2695236191' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:12:17.105 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378697 got 81604378699 for osd.2 2024-09-21T07:12:17.106 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:16 smithi169 ceph-mon[33705]: pgmap v315: 129 pgs: 2 peering, 127 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 8 op/s 2024-09-21T07:12:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:16 smithi169 ceph-mon[33705]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T07:12:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:16 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2381799140' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:12:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:16 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3474039931' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:12:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:16 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2695236191' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:12:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.310+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1811621926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c941094a0 msgr2=0x7f1c941098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.310+0000 7f1c98b9d640 1 --2- 172.21.15.92:0/1811621926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c941094a0 0x7f1c941098b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009900 tx=0x7f1c8802a410 comp rx=0 tx=0).stop 2024-09-21T07:12:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.310+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1811621926 shutdown_connections 2024-09-21T07:12:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.310+0000 7f1c98b9d640 1 --2- 172.21.15.92:0/1811621926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c94109df0 0x7f1c94110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.310+0000 7f1c98b9d640 1 --2- 172.21.15.92:0/1811621926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c941094a0 0x7f1c941098b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.310+0000 7f1c98b9d640 1 --2- 172.21.15.92:0/1811621926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c94103b60 0x7f1c94103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.310+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1811621926 >> 172.21.15.92:0/1811621926 conn(0x7f1c9407b850 msgr2=0x7f1c9407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.310+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1811621926 shutdown_connections 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.310+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1811621926 wait complete. 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c98b9d640 1 Processor -- start 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c98b9d640 1 -- start start 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c98b9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c94103b60 0x7f1c9419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c98b9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c941094a0 0x7f1c9419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c98b9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c94109df0 0x7f1c9419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c98b9d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c94113980 con 0x7f1c941094a0 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c98b9d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c94113800 con 0x7f1c94109df0 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c98b9d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1c94113b00 con 0x7f1c94103b60 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c91d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c941094a0 0x7f1c9419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c91d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c941094a0 0x7f1c9419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40146/0 (socket says 172.21.15.92:40146) 2024-09-21T07:12:17.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c91d9b640 1 -- 172.21.15.92:0/1673229276 learned_addr learned my addr 172.21.15.92:0/1673229276 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:17.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c9259c640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c94103b60 0x7f1c9419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c92d9d640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c94109df0 0x7f1c9419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c91d9b640 1 -- 172.21.15.92:0/1673229276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c94103b60 msgr2=0x7f1c9419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c91d9b640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c94103b60 0x7f1c9419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c91d9b640 1 -- 172.21.15.92:0/1673229276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c94109df0 msgr2=0x7f1c9419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c91d9b640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c94109df0 0x7f1c9419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.311+0000 7f1c91d9b640 1 -- 172.21.15.92:0/1673229276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c941a0360 con 0x7f1c941094a0 2024-09-21T07:12:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.312+0000 7f1c91d9b640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c941094a0 0x7f1c9419a990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1c88005940 tx=0x7f1c880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.312+0000 7f1c837fe640 1 -- 172.21.15.92:0/1673229276 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8803f030 con 0x7f1c941094a0 2024-09-21T07:12:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.312+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1673229276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c941a05f0 con 0x7f1c941094a0 2024-09-21T07:12:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.312+0000 7f1c837fe640 1 -- 172.21.15.92:0/1673229276 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c88003c90 con 0x7f1c941094a0 2024-09-21T07:12:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.312+0000 7f1c837fe640 1 -- 172.21.15.92:0/1673229276 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c88035070 con 0x7f1c941094a0 2024-09-21T07:12:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.312+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1673229276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c941a6db0 con 0x7f1c941094a0 2024-09-21T07:12:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.313+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1673229276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c94103f70 con 0x7f1c941094a0 2024-09-21T07:12:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.314+0000 7f1c837fe640 1 -- 172.21.15.92:0/1673229276 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f1c88042030 con 0x7f1c941094a0 2024-09-21T07:12:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.315+0000 7f1c837fe640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c7c0b65f0 0x7f1c7c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.315+0000 7f1c9259c640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c7c0b65f0 0x7f1c7c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.315+0000 7f1c837fe640 1 -- 172.21.15.92:0/1673229276 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f1c88108300 con 0x7f1c941094a0 2024-09-21T07:12:17.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.316+0000 7f1c9259c640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c7c0b65f0 0x7f1c7c0b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c84005c40 tx=0x7f1c8400a590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:17.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.320+0000 7f1c837fe640 1 -- 172.21.15.92:0/1673229276 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c880ce570 con 0x7f1c941094a0 2024-09-21T07:12:17.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.514+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1673229276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1c9410bbe0 con 0x7f1c941094a0 2024-09-21T07:12:17.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.515+0000 7f1c837fe640 1 -- 172.21.15.92:0/1673229276 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1c880d2950 con 0x7f1c941094a0 2024-09-21T07:12:17.517 INFO:teuthology.orchestra.run.smithi092.stdout:133143986242 2024-09-21T07:12:17.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1673229276 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c7c0b65f0 msgr2=0x7f1c7c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c7c0b65f0 0x7f1c7c0b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c84005c40 tx=0x7f1c8400a590 comp rx=0 tx=0).stop 2024-09-21T07:12:17.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1673229276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c941094a0 msgr2=0x7f1c9419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c941094a0 0x7f1c9419a990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1c88005940 tx=0x7f1c880042f0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1673229276 shutdown_connections 2024-09-21T07:12:17.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1c7c0b65f0 0x7f1c7c0b8b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c94109df0 0x7f1c9419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c941094a0 0x7f1c9419a990 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 --2- 172.21.15.92:0/1673229276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c94103b60 0x7f1c9419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1673229276 >> 172.21.15.92:0/1673229276 conn(0x7f1c9407b850 msgr2=0x7f1c941075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:17.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1673229276 shutdown_connections 2024-09-21T07:12:17.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.517+0000 7f1c98b9d640 1 -- 172.21.15.92:0/1673229276 wait complete. 2024-09-21T07:12:17.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.709+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2439997184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741094d0 msgr2=0x7fc3741098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.709+0000 7fc37a2d9640 1 --2- 172.21.15.92:0/2439997184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741094d0 0x7fc3741098e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc368009900 tx=0x7fc36802a410 comp rx=0 tx=0).stop 2024-09-21T07:12:17.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.709+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2439997184 shutdown_connections 2024-09-21T07:12:17.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.709+0000 7fc37a2d9640 1 --2- 172.21.15.92:0/2439997184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc374109e20 0x7fc374110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.709+0000 7fc37a2d9640 1 --2- 172.21.15.92:0/2439997184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741094d0 0x7fc3741098e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.709+0000 7fc37a2d9640 1 --2- 172.21.15.92:0/2439997184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc374103b90 0x7fc374103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.709+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2439997184 >> 172.21.15.92:0/2439997184 conn(0x7fc3740ff600 msgr2=0x7fc374101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:17.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.709+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2439997184 shutdown_connections 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.709+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2439997184 wait complete. 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc37a2d9640 1 Processor -- start 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc37a2d9640 1 -- start start 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc37a2d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc374103b90 0x7fc37419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc37a2d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741094d0 0x7fc37419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc37a2d9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc374109e20 0x7fc37419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc37a2d9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc374113990 con 0x7fc3741094d0 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc37a2d9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc374113810 con 0x7fc374109e20 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc37a2d9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc374113b10 con 0x7fc374103b90 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc3737fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741094d0 0x7fc37419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc3737fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741094d0 0x7fc37419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40154/0 (socket says 172.21.15.92:40154) 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.710+0000 7fc3737fe640 1 -- 172.21.15.92:0/2323698688 learned_addr learned my addr 172.21.15.92:0/2323698688 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc373fff640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc374103b90 0x7fc37419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc378876640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc374109e20 0x7fc37419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc3737fe640 1 -- 172.21.15.92:0/2323698688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc374103b90 msgr2=0x7fc37419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc3737fe640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc374103b90 0x7fc37419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc3737fe640 1 -- 172.21.15.92:0/2323698688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc374109e20 msgr2=0x7fc37419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc3737fe640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc374109e20 0x7fc37419fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc3737fe640 1 -- 172.21.15.92:0/2323698688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3741a0310 con 0x7fc3741094d0 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc373fff640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc374103b90 0x7fc37419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc3737fe640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741094d0 0x7fc37419a940 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc368005940 tx=0x7fc3680040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc3717fa640 1 -- 172.21.15.92:0/2323698688 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36803f030 con 0x7fc3741094d0 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc3717fa640 1 -- 172.21.15.92:0/2323698688 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc368003a80 con 0x7fc3741094d0 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc3717fa640 1 -- 172.21.15.92:0/2323698688 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368035070 con 0x7fc3741094d0 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2323698688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3741a05a0 con 0x7fc3741094d0 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.711+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2323698688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3741a6d60 con 0x7fc3741094d0 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.712+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2323698688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc374103fa0 con 0x7fc3741094d0 2024-09-21T07:12:17.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.714+0000 7fc3717fa640 1 -- 172.21.15.92:0/2323698688 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fc368042030 con 0x7fc3741094d0 2024-09-21T07:12:17.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.714+0000 7fc3717fa640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc35c0b6670 0x7fc35c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.714+0000 7fc373fff640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc35c0b6670 0x7fc35c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.715+0000 7fc3717fa640 1 -- 172.21.15.92:0/2323698688 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc368108370 con 0x7fc3741094d0 2024-09-21T07:12:17.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.715+0000 7fc373fff640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc35c0b6670 0x7fc35c0b8b80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc364005d00 tx=0x7fc364005ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:17.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.718+0000 7fc3717fa640 1 -- 172.21.15.92:0/2323698688 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3680ce5e0 con 0x7fc3741094d0 2024-09-21T07:12:17.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.906+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2323698688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc37419b4d0 con 0x7fc3741094d0 2024-09-21T07:12:17.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.906+0000 7fc3717fa640 1 -- 172.21.15.92:0/2323698688 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc3680d29c0 con 0x7fc3741094d0 2024-09-21T07:12:17.908 INFO:teuthology.orchestra.run.smithi092.stdout:154618822716 2024-09-21T07:12:17.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.908+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2323698688 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc35c0b6670 msgr2=0x7fc35c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.908+0000 7fc37a2d9640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc35c0b6670 0x7fc35c0b8b80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc364005d00 tx=0x7fc364005ed0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.908+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2323698688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741094d0 msgr2=0x7fc37419a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.908+0000 7fc37a2d9640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741094d0 0x7fc37419a940 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc368005940 tx=0x7fc3680040e0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.909+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2323698688 shutdown_connections 2024-09-21T07:12:17.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.909+0000 7fc37a2d9640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc35c0b6670 0x7fc35c0b8b80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.909+0000 7fc37a2d9640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc374109e20 0x7fc37419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.909+0000 7fc37a2d9640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741094d0 0x7fc37419a940 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.909+0000 7fc37a2d9640 1 --2- 172.21.15.92:0/2323698688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc374103b90 0x7fc37419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.909+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2323698688 >> 172.21.15.92:0/2323698688 conn(0x7fc3740ff600 msgr2=0x7fc374101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:17.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.909+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2323698688 shutdown_connections 2024-09-21T07:12:17.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:17.909+0000 7fc37a2d9640 1 -- 172.21.15.92:0/2323698688 wait complete. 2024-09-21T07:12:17.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.811+0000 7feb119f2640 1 -- 172.21.15.92:0/97581567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c108cf0 msgr2=0x7feb0c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.811+0000 7feb119f2640 1 --2- 172.21.15.92:0/97581567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c108cf0 0x7feb0c10f520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feb04009ca0 tx=0x7feb0402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.812+0000 7feb119f2640 1 -- 172.21.15.92:0/97581567 shutdown_connections 2024-09-21T07:12:17.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.812+0000 7feb119f2640 1 --2- 172.21.15.92:0/97581567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c108cf0 0x7feb0c10f520 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.812+0000 7feb119f2640 1 --2- 172.21.15.92:0/97581567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb0c1083a0 0x7feb0c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.812+0000 7feb119f2640 1 --2- 172.21.15.92:0/97581567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb0c102a60 0x7feb0c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.812+0000 7feb119f2640 1 -- 172.21.15.92:0/97581567 >> 172.21.15.92:0/97581567 conn(0x7feb0c079730 msgr2=0x7feb0c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.812+0000 7feb119f2640 1 -- 172.21.15.92:0/97581567 shutdown_connections 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.812+0000 7feb119f2640 1 -- 172.21.15.92:0/97581567 wait complete. 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.812+0000 7feb119f2640 1 Processor -- start 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb119f2640 1 -- start start 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb119f2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb0c102a60 0x7feb0c19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb119f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb0c1083a0 0x7feb0c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb119f2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c108cf0 0x7feb0c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb119f2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c112860 con 0x7feb0c108cf0 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb119f2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c1126e0 con 0x7feb0c102a60 2024-09-21T07:12:17.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb119f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c1129e0 con 0x7feb0c1083a0 2024-09-21T07:12:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb0b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c108cf0 0x7feb0c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb0b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c108cf0 0x7feb0c19bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40100/0 (socket says 172.21.15.92:40100) 2024-09-21T07:12:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb0b7fe640 1 -- 172.21.15.92:0/3474039931 learned_addr learned my addr 172.21.15.92:0/3474039931 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb0a7fc640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb0c1083a0 0x7feb0c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.813+0000 7feb0affd640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb0c102a60 0x7feb0c19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.961 INFO:teuthology.orchestra.run.smithi092.stdout:201863462962 2024-09-21T07:12:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb0b7fe640 1 -- 172.21.15.92:0/3474039931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb0c1083a0 msgr2=0x7feb0c19b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb0b7fe640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb0c1083a0 0x7feb0c19b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb0b7fe640 1 -- 172.21.15.92:0/3474039931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb0c102a60 msgr2=0x7feb0c19b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb0b7fe640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb0c102a60 0x7feb0c19b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb0b7fe640 1 -- 172.21.15.92:0/3474039931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0c1a6340 con 0x7feb0c108cf0 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb0b7fe640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c108cf0 0x7feb0c19bb90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feb04005e30 tx=0x7feb040093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb109f0640 1 -- 172.21.15.92:0/3474039931 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04032d10 con 0x7feb0c108cf0 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb109f0640 1 -- 172.21.15.92:0/3474039931 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb04032eb0 con 0x7feb0c108cf0 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb119f2640 1 -- 172.21.15.92:0/3474039931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0c1a65d0 con 0x7feb0c108cf0 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb119f2640 1 -- 172.21.15.92:0/3474039931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb0c1a6b10 con 0x7feb0c108cf0 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.814+0000 7feb109f0640 1 -- 172.21.15.92:0/3474039931 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04030a60 con 0x7feb0c108cf0 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.815+0000 7feb119f2640 1 -- 172.21.15.92:0/3474039931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb0c102e70 con 0x7feb0c108cf0 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.817+0000 7feb109f0640 1 -- 172.21.15.92:0/3474039931 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7feb04030c00 con 0x7feb0c108cf0 2024-09-21T07:12:17.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.817+0000 7feb109f0640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feaf40baa00 0x7feaf40bcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.818+0000 7feb0affd640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feaf40baa00 0x7feaf40bcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.818+0000 7feb109f0640 1 -- 172.21.15.92:0/3474039931 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7feb04108cb0 con 0x7feb0c108cf0 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.818+0000 7feb0affd640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feaf40baa00 0x7feaf40bcf10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feb0c06b9e0 tx=0x7feafc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:15.822+0000 7feb109f0640 1 -- 172.21.15.92:0/3474039931 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb040cef20 con 0x7feb0c108cf0 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.019+0000 7feb119f2640 1 -- 172.21.15.92:0/3474039931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7feb0c10a530 con 0x7feb0c108cf0 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.020+0000 7feb109f0640 1 -- 172.21.15.92:0/3474039931 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feb040d3300 con 0x7feb0c108cf0 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 -- 172.21.15.92:0/3474039931 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feaf40baa00 msgr2=0x7feaf40bcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feaf40baa00 0x7feaf40bcf10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feb0c06b9e0 tx=0x7feafc005f90 comp rx=0 tx=0).stop 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 -- 172.21.15.92:0/3474039931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c108cf0 msgr2=0x7feb0c19bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c108cf0 0x7feb0c19bb90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feb04005e30 tx=0x7feb040093d0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 -- 172.21.15.92:0/3474039931 shutdown_connections 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feaf40baa00 0x7feaf40bcf10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c108cf0 0x7feb0c19bb90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb0c1083a0 0x7feb0c19b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 --2- 172.21.15.92:0/3474039931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb0c102a60 0x7feb0c19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 -- 172.21.15.92:0/3474039931 >> 172.21.15.92:0/3474039931 conn(0x7feb0c079730 msgr2=0x7feb0c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 -- 172.21.15.92:0/3474039931 shutdown_connections 2024-09-21T07:12:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:16.022+0000 7feb119f2640 1 -- 172.21.15.92:0/3474039931 wait complete. 2024-09-21T07:12:17.964 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:17 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1673229276' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:12:18.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:17 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1673229276' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:12:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:17 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1673229276' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:12:18.638 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462961 got 201863462962 for osd.7 2024-09-21T07:12:18.638 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:18.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:18 smithi092 ceph-mon[30987]: pgmap v316: 129 pgs: 2 peering, 127 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:12:18.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:18 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2323698688' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:12:19.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:18 smithi175 ceph-mon[34064]: pgmap v316: 129 pgs: 2 peering, 127 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:12:19.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:18 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2323698688' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:12:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:18 smithi169 ceph-mon[33705]: pgmap v316: 129 pgs: 2 peering, 127 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:12:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:18 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2323698688' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:12:19.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.585+0000 7fde51d45640 1 -- 172.21.15.92:0/1751857042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde4c102ae0 msgr2=0x7fde4c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:19.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.585+0000 7fde51d45640 1 --2- 172.21.15.92:0/1751857042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde4c102ae0 0x7fde4c102ef0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009900 tx=0x7fde3c02a410 comp rx=0 tx=0).stop 2024-09-21T07:12:19.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.585+0000 7fde51d45640 1 -- 172.21.15.92:0/1751857042 shutdown_connections 2024-09-21T07:12:19.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.585+0000 7fde51d45640 1 --2- 172.21.15.92:0/1751857042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde4c108d70 0x7fde4c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.585+0000 7fde51d45640 1 --2- 172.21.15.92:0/1751857042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde4c108420 0x7fde4c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.585+0000 7fde51d45640 1 --2- 172.21.15.92:0/1751857042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde4c102ae0 0x7fde4c102ef0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.585+0000 7fde51d45640 1 -- 172.21.15.92:0/1751857042 >> 172.21.15.92:0/1751857042 conn(0x7fde4c079770 msgr2=0x7fde4c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.585+0000 7fde51d45640 1 -- 172.21.15.92:0/1751857042 shutdown_connections 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.585+0000 7fde51d45640 1 -- 172.21.15.92:0/1751857042 wait complete. 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.586+0000 7fde51d45640 1 Processor -- start 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde51d45640 1 -- start start 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde51d45640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde4c102ae0 0x7fde4c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde51d45640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde4c108420 0x7fde4c199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde51d45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde4c108d70 0x7fde4c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde51d45640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c112920 con 0x7fde4c108d70 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde51d45640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1127a0 con 0x7fde4c108420 2024-09-21T07:12:19.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde51d45640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c112aa0 con 0x7fde4c102ae0 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde4c108d70 0x7fde4c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde4c108d70 0x7fde4c19ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40178/0 (socket says 172.21.15.92:40178) 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4bfff640 1 -- 172.21.15.92:0/844459054 learned_addr learned my addr 172.21.15.92:0/844459054 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4b7fe640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde4c102ae0 0x7fde4c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4affd640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde4c108420 0x7fde4c199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4bfff640 1 -- 172.21.15.92:0/844459054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde4c102ae0 msgr2=0x7fde4c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4bfff640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde4c102ae0 0x7fde4c1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4bfff640 1 -- 172.21.15.92:0/844459054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde4c108420 msgr2=0x7fde4c199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4bfff640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde4c108420 0x7fde4c199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4bfff640 1 -- 172.21.15.92:0/844459054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4c19f2a0 con 0x7fde4c108d70 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.587+0000 7fde4bfff640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde4c108d70 0x7fde4c19ec30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fde4400cce0 tx=0x7fde4400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.588+0000 7fde48ff9640 1 -- 172.21.15.92:0/844459054 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4400f450 con 0x7fde4c108d70 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.588+0000 7fde48ff9640 1 -- 172.21.15.92:0/844459054 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde4400fa80 con 0x7fde4c108d70 2024-09-21T07:12:19.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.588+0000 7fde51d45640 1 -- 172.21.15.92:0/844459054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4c19f590 con 0x7fde4c108d70 2024-09-21T07:12:19.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.588+0000 7fde48ff9640 1 -- 172.21.15.92:0/844459054 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44018ad0 con 0x7fde4c108d70 2024-09-21T07:12:19.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.588+0000 7fde51d45640 1 -- 172.21.15.92:0/844459054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4c1a5db0 con 0x7fde4c108d70 2024-09-21T07:12:19.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.589+0000 7fde51d45640 1 -- 172.21.15.92:0/844459054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde4c103d60 con 0x7fde4c108d70 2024-09-21T07:12:19.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.591+0000 7fde48ff9640 1 -- 172.21.15.92:0/844459054 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fde4400f5f0 con 0x7fde4c108d70 2024-09-21T07:12:19.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.591+0000 7fde48ff9640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde340b6620 0x7fde340b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:19.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.591+0000 7fde4b7fe640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde340b6620 0x7fde340b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:19.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.591+0000 7fde48ff9640 1 -- 172.21.15.92:0/844459054 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fde440e8240 con 0x7fde4c108d70 2024-09-21T07:12:19.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.592+0000 7fde4b7fe640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde340b6620 0x7fde340b8b30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde3c005f70 tx=0x7fde3c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:19.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.594+0000 7fde48ff9640 1 -- 172.21.15.92:0/844459054 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde44014030 con 0x7fde4c108d70 2024-09-21T07:12:19.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.780+0000 7fde51d45640 1 -- 172.21.15.92:0/844459054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fde4c102ef0 con 0x7fde4c108d70 2024-09-21T07:12:19.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.780+0000 7fde48ff9640 1 -- 172.21.15.92:0/844459054 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fde4c102ef0 con 0x7fde4c108d70 2024-09-21T07:12:19.782 INFO:teuthology.orchestra.run.smithi092.stdout:300647710750 2024-09-21T07:12:19.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 -- 172.21.15.92:0/844459054 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde340b6620 msgr2=0x7fde340b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:19.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde340b6620 0x7fde340b8b30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde3c005f70 tx=0x7fde3c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:12:19.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 -- 172.21.15.92:0/844459054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde4c108d70 msgr2=0x7fde4c19ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:19.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde4c108d70 0x7fde4c19ec30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fde4400cce0 tx=0x7fde4400a620 comp rx=0 tx=0).stop 2024-09-21T07:12:19.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 -- 172.21.15.92:0/844459054 shutdown_connections 2024-09-21T07:12:19.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde340b6620 0x7fde340b8b30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:19.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde4c108d70 0x7fde4c19ec30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:19.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde4c108420 0x7fde4c199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:19.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 --2- 172.21.15.92:0/844459054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde4c102ae0 0x7fde4c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:19.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 -- 172.21.15.92:0/844459054 >> 172.21.15.92:0/844459054 conn(0x7fde4c079770 msgr2=0x7fde4c106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:19.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 -- 172.21.15.92:0/844459054 shutdown_connections 2024-09-21T07:12:19.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:19.782+0000 7fde51d45640 1 -- 172.21.15.92:0/844459054 wait complete. 2024-09-21T07:12:19.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:19 smithi092 ceph-mon[30987]: pgmap v317: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 8 B/s, 2 keys/s, 1 objects/s recovering 2024-09-21T07:12:19.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:19 smithi092 ceph-mon[30987]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T07:12:19.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:19 smithi092 ceph-mon[30987]: Cluster is now healthy 2024-09-21T07:12:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:19 smithi175 ceph-mon[34064]: pgmap v317: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 8 B/s, 2 keys/s, 1 objects/s recovering 2024-09-21T07:12:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:19 smithi175 ceph-mon[34064]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T07:12:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:19 smithi175 ceph-mon[34064]: Cluster is now healthy 2024-09-21T07:12:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:19 smithi169 ceph-mon[33705]: pgmap v317: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 8 B/s, 2 keys/s, 1 objects/s recovering 2024-09-21T07:12:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:19 smithi169 ceph-mon[33705]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T07:12:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:19 smithi169 ceph-mon[33705]: Cluster is now healthy 2024-09-21T07:12:20.149 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822714 got 154618822716 for osd.5 2024-09-21T07:12:20.149 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:20.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/844459054' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:12:20.969 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986240 got 133143986242 for osd.4 2024-09-21T07:12:20.969 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/844459054' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:12:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/844459054' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.156+0000 7f09d5654640 1 -- 172.21.15.92:0/2523855464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0110150 msgr2=0x7f09d0112570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.156+0000 7f09d5654640 1 --2- 172.21.15.92:0/2523855464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0110150 0x7f09d0112570 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f09c8009ca0 tx=0x7f09c802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.156+0000 7f09d5654640 1 -- 172.21.15.92:0/2523855464 shutdown_connections 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.156+0000 7f09d5654640 1 --2- 172.21.15.92:0/2523855464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0110150 0x7f09d0112570 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.156+0000 7f09d5654640 1 --2- 172.21.15.92:0/2523855464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d00760c0 0x7f09d010fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.156+0000 7f09d5654640 1 --2- 172.21.15.92:0/2523855464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09d0075770 0x7f09d0075b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.156+0000 7f09d5654640 1 -- 172.21.15.92:0/2523855464 >> 172.21.15.92:0/2523855464 conn(0x7f09d00ff600 msgr2=0x7f09d0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.156+0000 7f09d5654640 1 -- 172.21.15.92:0/2523855464 shutdown_connections 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.156+0000 7f09d5654640 1 -- 172.21.15.92:0/2523855464 wait complete. 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.156+0000 7f09d5654640 1 Processor -- start 2024-09-21T07:12:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09d5654640 1 -- start start 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09d5654640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09d0075770 0x7f09d019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09d5654640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d00760c0 0x7f09d019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09d5654640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0110150 0x7f09d01a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09d5654640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f09d0115be0 con 0x7f09d0110150 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09d5654640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f09d0115a60 con 0x7f09d0075770 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09d5654640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09d0115d60 con 0x7f09d00760c0 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09cf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0110150 0x7f09d01a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09cf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0110150 0x7f09d01a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45392/0 (socket says 172.21.15.92:45392) 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09cf7fe640 1 -- 172.21.15.92:0/3255119540 learned_addr learned my addr 172.21.15.92:0/3255119540 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09c67fc640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d00760c0 0x7f09d019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09ceffd640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09d0075770 0x7f09d019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09cf7fe640 1 -- 172.21.15.92:0/3255119540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d00760c0 msgr2=0x7f09d019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09cf7fe640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d00760c0 0x7f09d019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09cf7fe640 1 -- 172.21.15.92:0/3255119540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09d0075770 msgr2=0x7f09d019c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09cf7fe640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09d0075770 0x7f09d019c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09cf7fe640 1 -- 172.21.15.92:0/3255119540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d01a24c0 con 0x7f09d0110150 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09c67fc640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d00760c0 0x7f09d019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.157+0000 7f09ceffd640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09d0075770 0x7f09d019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.158+0000 7f09cf7fe640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0110150 0x7f09d01a1e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f09c8031040 tx=0x7f09c8032990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.158+0000 7f09ccff9640 1 -- 172.21.15.92:0/3255119540 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c8032d80 con 0x7f09d0110150 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.158+0000 7f09d5654640 1 -- 172.21.15.92:0/3255119540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d01a2750 con 0x7f09d0110150 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.158+0000 7f09ccff9640 1 -- 172.21.15.92:0/3255119540 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09c80044d0 con 0x7f09d0110150 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.158+0000 7f09ccff9640 1 -- 172.21.15.92:0/3255119540 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c8030b80 con 0x7f09d0110150 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.158+0000 7f09d5654640 1 -- 172.21.15.92:0/3255119540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d01a8fd0 con 0x7f09d0110150 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.159+0000 7f09d5654640 1 -- 172.21.15.92:0/3255119540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d0076c80 con 0x7f09d0110150 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.161+0000 7f09ccff9640 1 -- 172.21.15.92:0/3255119540 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f09c8030d20 con 0x7f09d0110150 2024-09-21T07:12:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.162+0000 7f09ccff9640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09bc0b6620 0x7f09bc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.162+0000 7f09ceffd640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09bc0b6620 0x7f09bc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.162+0000 7f09ccff9640 1 -- 172.21.15.92:0/3255119540 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f09c8108dd0 con 0x7f09d0110150 2024-09-21T07:12:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.163+0000 7f09ceffd640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09bc0b6620 0x7f09bc0b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f09c000abe0 tx=0x7f09c000a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.165+0000 7f09ccff9640 1 -- 172.21.15.92:0/3255119540 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f09c80cf040 con 0x7f09d0110150 2024-09-21T07:12:21.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.356+0000 7f09d5654640 1 -- 172.21.15.92:0/3255119540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f09d01a91a0 con 0x7f09d0110150 2024-09-21T07:12:21.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.357+0000 7f09ccff9640 1 -- 172.21.15.92:0/3255119540 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f09c80d3420 con 0x7f09d0110150 2024-09-21T07:12:21.359 INFO:teuthology.orchestra.run.smithi092.stdout:60129542224 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 -- 172.21.15.92:0/3255119540 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09bc0b6620 msgr2=0x7f09bc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09bc0b6620 0x7f09bc0b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f09c000abe0 tx=0x7f09c000a5c0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 -- 172.21.15.92:0/3255119540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0110150 msgr2=0x7f09d01a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0110150 0x7f09d01a1e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f09c8031040 tx=0x7f09c8032990 comp rx=0 tx=0).stop 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 -- 172.21.15.92:0/3255119540 shutdown_connections 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09bc0b6620 0x7f09bc0b8b30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0110150 0x7f09d01a1e50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09d00760c0 0x7f09d019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 --2- 172.21.15.92:0/3255119540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09d0075770 0x7f09d019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 -- 172.21.15.92:0/3255119540 >> 172.21.15.92:0/3255119540 conn(0x7f09d00ff600 msgr2=0x7f09d0109c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 -- 172.21.15.92:0/3255119540 shutdown_connections 2024-09-21T07:12:21.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.359+0000 7f09d5654640 1 -- 172.21.15.92:0/3255119540 wait complete. 2024-09-21T07:12:21.791 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710747 got 300647710750 for osd.11 2024-09-21T07:12:21.791 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:21.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.986+0000 7f76230ff640 1 -- 172.21.15.92:0/532602150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f761c108d10 msgr2=0x7f761c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:21.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.986+0000 7f76230ff640 1 --2- 172.21.15.92:0/532602150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f761c108d10 0x7f761c10f540 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7614009ca0 tx=0x7f761402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.986+0000 7f76230ff640 1 -- 172.21.15.92:0/532602150 shutdown_connections 2024-09-21T07:12:21.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.986+0000 7f76230ff640 1 --2- 172.21.15.92:0/532602150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f761c108d10 0x7f761c10f540 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.986+0000 7f76230ff640 1 --2- 172.21.15.92:0/532602150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f761c1083c0 0x7f761c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.986+0000 7f76230ff640 1 --2- 172.21.15.92:0/532602150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f761c102a80 0x7f761c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:21.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.986+0000 7f76230ff640 1 -- 172.21.15.92:0/532602150 >> 172.21.15.92:0/532602150 conn(0x7f761c079740 msgr2=0x7f761c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:21.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.986+0000 7f76230ff640 1 -- 172.21.15.92:0/532602150 shutdown_connections 2024-09-21T07:12:21.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.986+0000 7f76230ff640 1 -- 172.21.15.92:0/532602150 wait complete. 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.986+0000 7f76230ff640 1 Processor -- start 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f76230ff640 1 -- start start 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f76230ff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f761c102a80 0x7f761c19b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f76230ff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f761c1083c0 0x7f761c19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f76230ff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f761c108d10 0x7f761c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f76230ff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f761c112880 con 0x7f761c102a80 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f76230ff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f761c112700 con 0x7f761c1083c0 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f76230ff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f761c112a00 con 0x7f761c108d10 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f7620e9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f761c102a80 0x7f761c19b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f7620e9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f761c102a80 0x7f761c19b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45410/0 (socket says 172.21.15.92:45410) 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f7620e9b640 1 -- 172.21.15.92:0/926522328 learned_addr learned my addr 172.21.15.92:0/926522328 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f7620e9b640 1 -- 172.21.15.92:0/926522328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f761c108d10 msgr2=0x7f761c19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:22.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f7620e9b640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f761c108d10 0x7f761c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f761bfff640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f761c1083c0 0x7f761c19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f7620e9b640 1 -- 172.21.15.92:0/926522328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f761c1083c0 msgr2=0x7f761c19b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f7620e9b640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f761c1083c0 0x7f761c19b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f7620e9b640 1 -- 172.21.15.92:0/926522328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761c1a6380 con 0x7f761c102a80 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.987+0000 7f7620e9b640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f761c102a80 0x7f761c19b150 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f760c00d770 tx=0x7f760c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.988+0000 7f7619ffb640 1 -- 172.21.15.92:0/926522328 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c017070 con 0x7f761c102a80 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.988+0000 7f7619ffb640 1 -- 172.21.15.92:0/926522328 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f760c0054b0 con 0x7f761c102a80 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.988+0000 7f76230ff640 1 -- 172.21.15.92:0/926522328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761c1a6670 con 0x7f761c102a80 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.988+0000 7f7619ffb640 1 -- 172.21.15.92:0/926522328 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c004c60 con 0x7f761c102a80 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.988+0000 7f76230ff640 1 -- 172.21.15.92:0/926522328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f761c1a6bb0 con 0x7f761c102a80 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.989+0000 7f76230ff640 1 -- 172.21.15.92:0/926522328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f761c103d00 con 0x7f761c102a80 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.990+0000 7f7619ffb640 1 -- 172.21.15.92:0/926522328 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f760c004e00 con 0x7f761c102a80 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.991+0000 7f7619ffb640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f76040b6670 0x7f76040b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:22.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.991+0000 7f761bfff640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f76040b6670 0x7f76040b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:22.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.991+0000 7f7619ffb640 1 -- 172.21.15.92:0/926522328 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f760c0e7460 con 0x7f761c102a80 2024-09-21T07:12:22.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.992+0000 7f761bfff640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f76040b6670 0x7f76040b8b80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f761c105ed0 tx=0x7f7610005cc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:22.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:21.996+0000 7f7619ffb640 1 -- 172.21.15.92:0/926522328 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f760c0ad6d0 con 0x7f761c102a80 2024-09-21T07:12:22.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:21 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3255119540' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:12:22.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:21 smithi175 ceph-mon[34064]: pgmap v318: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 8 B/s, 2 keys/s, 1 objects/s recovering 2024-09-21T07:12:22.071 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:21 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3255119540' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:12:22.071 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:21 smithi092 ceph-mon[30987]: pgmap v318: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 8 B/s, 2 keys/s, 1 objects/s recovering 2024-09-21T07:12:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:21 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3255119540' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:12:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:21 smithi169 ceph-mon[33705]: pgmap v318: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 8 B/s, 2 keys/s, 1 objects/s recovering 2024-09-21T07:12:22.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.181+0000 7f76230ff640 1 -- 172.21.15.92:0/926522328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f761c102e90 con 0x7f761c102a80 2024-09-21T07:12:22.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.181+0000 7f7619ffb640 1 -- 172.21.15.92:0/926522328 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f760c0b1ab0 con 0x7f761c102a80 2024-09-21T07:12:22.183 INFO:teuthology.orchestra.run.smithi092.stdout:180388626487 2024-09-21T07:12:22.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.183+0000 7f76230ff640 1 -- 172.21.15.92:0/926522328 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f76040b6670 msgr2=0x7f76040b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:22.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.183+0000 7f76230ff640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f76040b6670 0x7f76040b8b80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f761c105ed0 tx=0x7f7610005cc0 comp rx=0 tx=0).stop 2024-09-21T07:12:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.183+0000 7f76230ff640 1 -- 172.21.15.92:0/926522328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f761c102a80 msgr2=0x7f761c19b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.183+0000 7f76230ff640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f761c102a80 0x7f761c19b150 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f760c00d770 tx=0x7f760c00dc30 comp rx=0 tx=0).stop 2024-09-21T07:12:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.184+0000 7f76230ff640 1 -- 172.21.15.92:0/926522328 shutdown_connections 2024-09-21T07:12:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.184+0000 7f76230ff640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f76040b6670 0x7f76040b8b80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.184+0000 7f76230ff640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f761c108d10 0x7f761c19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.184+0000 7f76230ff640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f761c1083c0 0x7f761c19b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.184+0000 7f76230ff640 1 --2- 172.21.15.92:0/926522328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f761c102a80 0x7f761c19b150 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.184+0000 7f76230ff640 1 -- 172.21.15.92:0/926522328 >> 172.21.15.92:0/926522328 conn(0x7f761c079740 msgr2=0x7f761c1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.184+0000 7f76230ff640 1 -- 172.21.15.92:0/926522328 shutdown_connections 2024-09-21T07:12:22.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:22.184+0000 7f76230ff640 1 -- 172.21.15.92:0/926522328 wait complete. 2024-09-21T07:12:23.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:22 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/926522328' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:12:23.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:22 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/926522328' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:12:23.035 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542220 got 60129542224 for osd.1 2024-09-21T07:12:23.035 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:22 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/926522328' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:12:23.464 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266730 got 227633266733 for osd.8 2024-09-21T07:12:23.464 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:23.888 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:23.888 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:23.900 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626483 got 180388626487 for osd.6 2024-09-21T07:12:23.900 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:23.931 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:23.934 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:24.018 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:23 smithi092 ceph-mon[30987]: pgmap v319: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 6 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T07:12:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:23 smithi169 ceph-mon[33705]: pgmap v319: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 6 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T07:12:24.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:23 smithi175 ceph-mon[34064]: pgmap v319: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 6 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T07:12:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.582+0000 7f4491c9b640 1 -- 172.21.15.92:0/613454636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c108420 msgr2=0x7f448c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.582+0000 7f4491c9b640 1 --2- 172.21.15.92:0/613454636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c108420 0x7f448c108830 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4480009900 tx=0x7f448002a410 comp rx=0 tx=0).stop 2024-09-21T07:12:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.582+0000 7f4491c9b640 1 -- 172.21.15.92:0/613454636 shutdown_connections 2024-09-21T07:12:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.582+0000 7f4491c9b640 1 --2- 172.21.15.92:0/613454636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f448c108d70 0x7f448c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.582+0000 7f4491c9b640 1 --2- 172.21.15.92:0/613454636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c108420 0x7f448c108830 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.582+0000 7f4491c9b640 1 --2- 172.21.15.92:0/613454636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c102ae0 0x7f448c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.582+0000 7f4491c9b640 1 -- 172.21.15.92:0/613454636 >> 172.21.15.92:0/613454636 conn(0x7f448c079770 msgr2=0x7f448c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.582+0000 7f4491c9b640 1 -- 172.21.15.92:0/613454636 shutdown_connections 2024-09-21T07:12:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.582+0000 7f4491c9b640 1 -- 172.21.15.92:0/613454636 wait complete. 2024-09-21T07:12:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.583+0000 7f4491c9b640 1 Processor -- start 2024-09-21T07:12:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.583+0000 7f4491c9b640 1 -- start start 2024-09-21T07:12:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f4491c9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c102ae0 0x7f448c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f4491c9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c108420 0x7f448c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f4491c9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f448c108d70 0x7f448c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f4491c9b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f448c1128e0 con 0x7f448c102ae0 2024-09-21T07:12:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f4491c9b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f448c112760 con 0x7f448c108d70 2024-09-21T07:12:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f4491c9b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f448c112a60 con 0x7f448c108420 2024-09-21T07:12:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c102ae0 0x7f448c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c102ae0 0x7f448c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45438/0 (socket says 172.21.15.92:45438) 2024-09-21T07:12:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448b7fe640 1 -- 172.21.15.92:0/2954091790 learned_addr learned my addr 172.21.15.92:0/2954091790 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448bfff640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f448c108d70 0x7f448c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448affd640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c108420 0x7f448c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448b7fe640 1 -- 172.21.15.92:0/2954091790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c108420 msgr2=0x7f448c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448b7fe640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c108420 0x7f448c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448b7fe640 1 -- 172.21.15.92:0/2954091790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f448c108d70 msgr2=0x7f448c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448b7fe640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f448c108d70 0x7f448c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448b7fe640 1 -- 172.21.15.92:0/2954091790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c1a0410 con 0x7f448c102ae0 2024-09-21T07:12:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f448b7fe640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c102ae0 0x7f448c19a4a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f447c00d770 tx=0x7f447c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.584+0000 7f4488ff9640 1 -- 172.21.15.92:0/2954091790 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c017070 con 0x7f448c102ae0 2024-09-21T07:12:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.585+0000 7f4488ff9640 1 -- 172.21.15.92:0/2954091790 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f447c0054b0 con 0x7f448c102ae0 2024-09-21T07:12:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.585+0000 7f4491c9b640 1 -- 172.21.15.92:0/2954091790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448c1a0700 con 0x7f448c102ae0 2024-09-21T07:12:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.585+0000 7f4488ff9640 1 -- 172.21.15.92:0/2954091790 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c004c60 con 0x7f448c102ae0 2024-09-21T07:12:24.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.585+0000 7f4491c9b640 1 -- 172.21.15.92:0/2954091790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448c1a6e60 con 0x7f448c102ae0 2024-09-21T07:12:24.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.586+0000 7f4491c9b640 1 -- 172.21.15.92:0/2954091790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448c103d60 con 0x7f448c102ae0 2024-09-21T07:12:24.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.587+0000 7f4488ff9640 1 -- 172.21.15.92:0/2954091790 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f447c004e00 con 0x7f448c102ae0 2024-09-21T07:12:24.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.588+0000 7f4488ff9640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44740b6670 0x7f44740b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:24.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.588+0000 7f448affd640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44740b6670 0x7f44740b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:24.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.588+0000 7f4488ff9640 1 -- 172.21.15.92:0/2954091790 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f447c0e73b0 con 0x7f448c102ae0 2024-09-21T07:12:24.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.589+0000 7f448affd640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44740b6670 0x7f44740b8b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f44800057c0 tx=0x7f4480000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:24.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.593+0000 7f4488ff9640 1 -- 172.21.15.92:0/2954091790 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f447c0ad620 con 0x7f448c102ae0 2024-09-21T07:12:24.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f4491c9b640 1 -- 172.21.15.92:0/2954091790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f448c10bb50 con 0x7f448c102ae0 2024-09-21T07:12:24.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f4488ff9640 1 -- 172.21.15.92:0/2954091790 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f447c0b1a00 con 0x7f448c102ae0 2024-09-21T07:12:24.779 INFO:teuthology.orchestra.run.smithi092.stdout:38654705752 2024-09-21T07:12:24.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.779+0000 7f4491c9b640 1 -- 172.21.15.92:0/2954091790 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44740b6670 msgr2=0x7f44740b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:24.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.779+0000 7f4491c9b640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44740b6670 0x7f44740b8b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f44800057c0 tx=0x7f4480000bc0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.779+0000 7f4491c9b640 1 -- 172.21.15.92:0/2954091790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c102ae0 msgr2=0x7f448c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:24.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.779+0000 7f4491c9b640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c102ae0 0x7f448c19a4a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f447c00d770 tx=0x7f447c00dc30 comp rx=0 tx=0).stop 2024-09-21T07:12:24.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.779+0000 7f4491c9b640 1 -- 172.21.15.92:0/2954091790 shutdown_connections 2024-09-21T07:12:24.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.779+0000 7f4491c9b640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44740b6670 0x7f44740b8b80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.779+0000 7f4491c9b640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f448c108d70 0x7f448c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.779+0000 7f4491c9b640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c108420 0x7f448c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.779+0000 7f4491c9b640 1 --2- 172.21.15.92:0/2954091790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c102ae0 0x7f448c19a4a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.780+0000 7f4491c9b640 1 -- 172.21.15.92:0/2954091790 >> 172.21.15.92:0/2954091790 conn(0x7f448c079770 msgr2=0x7f448c101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:24.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.780+0000 7f4491c9b640 1 -- 172.21.15.92:0/2954091790 shutdown_connections 2024-09-21T07:12:24.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.780+0000 7f4491c9b640 1 -- 172.21.15.92:0/2954091790 wait complete. 2024-09-21T07:12:24.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f140907e640 1 -- 172.21.15.92:0/1022526920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1404102a60 msgr2=0x7f1404102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:24.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f140907e640 1 --2- 172.21.15.92:0/1022526920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1404102a60 0x7f1404102e70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009900 tx=0x7f13f402a410 comp rx=0 tx=0).stop 2024-09-21T07:12:24.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f140907e640 1 -- 172.21.15.92:0/1022526920 shutdown_connections 2024-09-21T07:12:24.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f140907e640 1 --2- 172.21.15.92:0/1022526920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1404108cf0 0x7f140410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f140907e640 1 --2- 172.21.15.92:0/1022526920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14041083a0 0x7f14041087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f140907e640 1 --2- 172.21.15.92:0/1022526920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1404102a60 0x7f1404102e70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f140907e640 1 -- 172.21.15.92:0/1022526920 >> 172.21.15.92:0/1022526920 conn(0x7f1404079730 msgr2=0x7f1404079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f140907e640 1 -- 172.21.15.92:0/1022526920 shutdown_connections 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f140907e640 1 -- 172.21.15.92:0/1022526920 wait complete. 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.776+0000 7f140907e640 1 Processor -- start 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140907e640 1 -- start start 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140907e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1404102a60 0x7f140419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140907e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14041083a0 0x7f140419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140907e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1404108cf0 0x7f140419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140907e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1404112810 con 0x7f14041083a0 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140907e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1404112690 con 0x7f1404108cf0 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140907e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1404112990 con 0x7f1404102a60 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14041083a0 0x7f140419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14041083a0 0x7f140419b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45470/0 (socket says 172.21.15.92:45470) 2024-09-21T07:12:24.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140259c640 1 -- 172.21.15.92:0/2191081410 learned_addr learned my addr 172.21.15.92:0/2191081410 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f140359e640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1404108cf0 0x7f140419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.777+0000 7f1402d9d640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1404102a60 0x7f140419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f140259c640 1 -- 172.21.15.92:0/2191081410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1404102a60 msgr2=0x7f140419b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f140259c640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1404102a60 0x7f140419b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f140259c640 1 -- 172.21.15.92:0/2191081410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1404108cf0 msgr2=0x7f140419bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f140259c640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1404108cf0 0x7f140419bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f140259c640 1 -- 172.21.15.92:0/2191081410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14041a6450 con 0x7f14041083a0 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f1402d9d640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1404102a60 0x7f140419b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f140359e640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1404108cf0 0x7f140419bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f140259c640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14041083a0 0x7f140419b680 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f13f800d740 tx=0x7f13f800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f13ebfff640 1 -- 172.21.15.92:0/2191081410 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8017070 con 0x7f14041083a0 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f13ebfff640 1 -- 172.21.15.92:0/2191081410 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13f800de50 con 0x7f14041083a0 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f140907e640 1 -- 172.21.15.92:0/2191081410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14041a6740 con 0x7f14041083a0 2024-09-21T07:12:24.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f13ebfff640 1 -- 172.21.15.92:0/2191081410 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8004c60 con 0x7f14041083a0 2024-09-21T07:12:24.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.778+0000 7f140907e640 1 -- 172.21.15.92:0/2191081410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14041a6c30 con 0x7f14041083a0 2024-09-21T07:12:24.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.779+0000 7f140907e640 1 -- 172.21.15.92:0/2191081410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1404102e70 con 0x7f14041083a0 2024-09-21T07:12:24.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.782+0000 7f13ebfff640 1 -- 172.21.15.92:0/2191081410 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f13f8004e00 con 0x7f14041083a0 2024-09-21T07:12:24.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.783+0000 7f13ebfff640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13ec0b65f0 0x7f13ec0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:24.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.783+0000 7f1402d9d640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13ec0b65f0 0x7f13ec0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:24.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.783+0000 7f13ebfff640 1 -- 172.21.15.92:0/2191081410 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f13f80e7790 con 0x7f14041083a0 2024-09-21T07:12:24.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.784+0000 7f1402d9d640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13ec0b65f0 0x7f13ec0b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13f4006010 tx=0x7f13f4005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:24.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.786+0000 7f13ebfff640 1 -- 172.21.15.92:0/2191081410 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13f80ada00 con 0x7f14041083a0 2024-09-21T07:12:24.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:24 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2954091790' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:12:24.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.980+0000 7f140907e640 1 -- 172.21.15.92:0/2191081410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f140402e640 con 0x7f14041083a0 2024-09-21T07:12:24.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.980+0000 7f13ebfff640 1 -- 172.21.15.92:0/2191081410 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f13f80b1de0 con 0x7f14041083a0 2024-09-21T07:12:24.982 INFO:teuthology.orchestra.run.smithi092.stdout:253403070506 2024-09-21T07:12:24.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 -- 172.21.15.92:0/2191081410 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13ec0b65f0 msgr2=0x7f13ec0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:24.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13ec0b65f0 0x7f13ec0b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13f4006010 tx=0x7f13f4005a20 comp rx=0 tx=0).stop 2024-09-21T07:12:24.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 -- 172.21.15.92:0/2191081410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14041083a0 msgr2=0x7f140419b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:24.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14041083a0 0x7f140419b680 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f13f800d740 tx=0x7f13f800dc00 comp rx=0 tx=0).stop 2024-09-21T07:12:24.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 -- 172.21.15.92:0/2191081410 shutdown_connections 2024-09-21T07:12:24.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13ec0b65f0 0x7f13ec0b8b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1404108cf0 0x7f140419bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14041083a0 0x7f140419b680 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 --2- 172.21.15.92:0/2191081410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1404102a60 0x7f140419b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:24.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 -- 172.21.15.92:0/2191081410 >> 172.21.15.92:0/2191081410 conn(0x7f1404079730 msgr2=0x7f1404101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:24.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 -- 172.21.15.92:0/2191081410 shutdown_connections 2024-09-21T07:12:24.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:24.982+0000 7f140907e640 1 -- 172.21.15.92:0/2191081410 wait complete. 2024-09-21T07:12:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:24 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2954091790' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:12:25.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:24 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2954091790' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:12:25.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.658+0000 7f30698f0640 1 -- 172.21.15.92:0/4221118864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3064105270 msgr2=0x7f306410d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:25.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.658+0000 7f30698f0640 1 --2- 172.21.15.92:0/4221118864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3064105270 0x7f306410d8b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f304c009900 tx=0x7f304c02a410 comp rx=0 tx=0).stop 2024-09-21T07:12:25.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.658+0000 7f30698f0640 1 -- 172.21.15.92:0/4221118864 shutdown_connections 2024-09-21T07:12:25.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.658+0000 7f30698f0640 1 --2- 172.21.15.92:0/4221118864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f306410ddf0 0x7f3064110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.658+0000 7f30698f0640 1 --2- 172.21.15.92:0/4221118864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3064105270 0x7f306410d8b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.658+0000 7f30698f0640 1 --2- 172.21.15.92:0/4221118864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3064104840 0x7f3064104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.658+0000 7f30698f0640 1 -- 172.21.15.92:0/4221118864 >> 172.21.15.92:0/4221118864 conn(0x7f3064079730 msgr2=0x7f3064079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.659+0000 7f30698f0640 1 -- 172.21.15.92:0/4221118864 shutdown_connections 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.659+0000 7f30698f0640 1 -- 172.21.15.92:0/4221118864 wait complete. 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.659+0000 7f30698f0640 1 Processor -- start 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.659+0000 7f30698f0640 1 -- start start 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30698f0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3064104840 0x7f306419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30698f0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3064105270 0x7f306419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30698f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f306410ddf0 0x7f306419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30698f0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3064113980 con 0x7f3064105270 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30698f0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3064113800 con 0x7f3064104840 2024-09-21T07:12:25.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30698f0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3064113b00 con 0x7f306410ddf0 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30627fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3064105270 0x7f306419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30627fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3064105270 0x7f306419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45480/0 (socket says 172.21.15.92:45480) 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30627fc640 1 -- 172.21.15.92:0/405850320 learned_addr learned my addr 172.21.15.92:0/405850320 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30637fe640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f306410ddf0 0x7f306419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f3062ffd640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3064104840 0x7f306419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30627fc640 1 -- 172.21.15.92:0/405850320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f306410ddf0 msgr2=0x7f306419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30627fc640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f306410ddf0 0x7f306419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30627fc640 1 -- 172.21.15.92:0/405850320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3064104840 msgr2=0x7f306419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30627fc640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3064104840 0x7f306419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30627fc640 1 -- 172.21.15.92:0/405850320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30641a0380 con 0x7f3064105270 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30637fe640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f306410ddf0 0x7f306419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30627fc640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3064105270 0x7f306419a9b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f304c005940 tx=0x7f304c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:25.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.660+0000 7f30688ee640 1 -- 172.21.15.92:0/405850320 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c03f030 con 0x7f3064105270 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.661+0000 7f30698f0640 1 -- 172.21.15.92:0/405850320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30641a0610 con 0x7f3064105270 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.661+0000 7f30688ee640 1 -- 172.21.15.92:0/405850320 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f304c003a80 con 0x7f3064105270 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.661+0000 7f30688ee640 1 -- 172.21.15.92:0/405850320 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c035070 con 0x7f3064105270 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.661+0000 7f30698f0640 1 -- 172.21.15.92:0/405850320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30641a6dd0 con 0x7f3064105270 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.662+0000 7f30698f0640 1 -- 172.21.15.92:0/405850320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3064104c50 con 0x7f3064105270 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.664+0000 7f30688ee640 1 -- 172.21.15.92:0/405850320 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f304c042030 con 0x7f3064105270 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.665+0000 7f30688ee640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30500b65f0 0x7f30500b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.665+0000 7f3062ffd640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30500b65f0 0x7f30500b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.665+0000 7f30688ee640 1 -- 172.21.15.92:0/405850320 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f304c1083f0 con 0x7f3064105270 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.665+0000 7f3062ffd640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30500b65f0 0x7f30500b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f306406bc00 tx=0x7f30540072f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.668+0000 7f30688ee640 1 -- 172.21.15.92:0/405850320 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f304c0ce660 con 0x7f3064105270 2024-09-21T07:12:25.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.855+0000 7f30698f0640 1 -- 172.21.15.92:0/405850320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f306419b540 con 0x7f3064105270 2024-09-21T07:12:25.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.856+0000 7f30688ee640 1 -- 172.21.15.92:0/405850320 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f304c0d2a40 con 0x7f3064105270 2024-09-21T07:12:25.858 INFO:teuthology.orchestra.run.smithi092.stdout:274877906981 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 -- 172.21.15.92:0/405850320 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30500b65f0 msgr2=0x7f30500b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30500b65f0 0x7f30500b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f306406bc00 tx=0x7f30540072f0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 -- 172.21.15.92:0/405850320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3064105270 msgr2=0x7f306419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3064105270 0x7f306419a9b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f304c005940 tx=0x7f304c0040e0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 -- 172.21.15.92:0/405850320 shutdown_connections 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30500b65f0 0x7f30500b8b00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f306410ddf0 0x7f306419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3064105270 0x7f306419a9b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 --2- 172.21.15.92:0/405850320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3064104840 0x7f306419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 -- 172.21.15.92:0/405850320 >> 172.21.15.92:0/405850320 conn(0x7f3064079730 msgr2=0x7f30641008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 -- 172.21.15.92:0/405850320 shutdown_connections 2024-09-21T07:12:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:25.858+0000 7f30698f0640 1 -- 172.21.15.92:0/405850320 wait complete. 2024-09-21T07:12:26.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:25 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2191081410' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:12:26.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:25 smithi092 ceph-mon[30987]: pgmap v320: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 6 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T07:12:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:25 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2191081410' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:12:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:25 smithi169 ceph-mon[33705]: pgmap v320: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 6 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T07:12:26.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:25 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2191081410' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:12:26.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:25 smithi175 ceph-mon[34064]: pgmap v320: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 6 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T07:12:26.253 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705750 got 38654705752 for osd.0 2024-09-21T07:12:26.254 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:26.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.431+0000 7f16b667f640 1 -- 172.21.15.92:0/2475410209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16b0108d10 msgr2=0x7f16b010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:26.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.431+0000 7f16b667f640 1 --2- 172.21.15.92:0/2475410209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16b0108d10 0x7f16b010f540 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009ca0 tx=0x7f16a802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:26.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.431+0000 7f16b667f640 1 -- 172.21.15.92:0/2475410209 shutdown_connections 2024-09-21T07:12:26.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.431+0000 7f16b667f640 1 --2- 172.21.15.92:0/2475410209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16b0108d10 0x7f16b010f540 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.431+0000 7f16b667f640 1 --2- 172.21.15.92:0/2475410209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b01083c0 0x7f16b01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.431+0000 7f16b667f640 1 --2- 172.21.15.92:0/2475410209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16b0102a80 0x7f16b0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.431+0000 7f16b667f640 1 -- 172.21.15.92:0/2475410209 >> 172.21.15.92:0/2475410209 conn(0x7f16b0079740 msgr2=0x7f16b0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.431+0000 7f16b667f640 1 -- 172.21.15.92:0/2475410209 shutdown_connections 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.432+0000 7f16b667f640 1 -- 172.21.15.92:0/2475410209 wait complete. 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.432+0000 7f16b667f640 1 Processor -- start 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.432+0000 7f16b667f640 1 -- start start 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b667f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16b0102a80 0x7f16b0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b667f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b01083c0 0x7f16b01997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b667f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16b0108d10 0x7f16b019ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b667f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0112880 con 0x7f16b0108d10 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b667f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0112700 con 0x7f16b01083c0 2024-09-21T07:12:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b667f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0112a00 con 0x7f16b0102a80 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b4c1c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16b0108d10 0x7f16b019ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b4c1c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16b0108d10 0x7f16b019ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45502/0 (socket says 172.21.15.92:45502) 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b4c1c640 1 -- 172.21.15.92:0/530605170 learned_addr learned my addr 172.21.15.92:0/530605170 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16affff640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16b0102a80 0x7f16b0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16af7fe640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b01083c0 0x7f16b01997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b4c1c640 1 -- 172.21.15.92:0/530605170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16b0102a80 msgr2=0x7f16b0199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b4c1c640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16b0102a80 0x7f16b0199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b4c1c640 1 -- 172.21.15.92:0/530605170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b01083c0 msgr2=0x7f16b01997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b4c1c640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b01083c0 0x7f16b01997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b4c1c640 1 -- 172.21.15.92:0/530605170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b019f100 con 0x7f16b0108d10 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.433+0000 7f16b4c1c640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16b0108d10 0x7f16b019ea90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f16a8005cc0 tx=0x7f16a8032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.434+0000 7f16ad7fa640 1 -- 172.21.15.92:0/530605170 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8032e00 con 0x7f16b0108d10 2024-09-21T07:12:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.434+0000 7f16ad7fa640 1 -- 172.21.15.92:0/530605170 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16a80044d0 con 0x7f16b0108d10 2024-09-21T07:12:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.434+0000 7f16b667f640 1 -- 172.21.15.92:0/530605170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b019f390 con 0x7f16b0108d10 2024-09-21T07:12:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.434+0000 7f16ad7fa640 1 -- 172.21.15.92:0/530605170 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8030b70 con 0x7f16b0108d10 2024-09-21T07:12:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.434+0000 7f16b667f640 1 -- 172.21.15.92:0/530605170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b019f8d0 con 0x7f16b0108d10 2024-09-21T07:12:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.435+0000 7f16b667f640 1 -- 172.21.15.92:0/530605170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b0103d00 con 0x7f16b0108d10 2024-09-21T07:12:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.437+0000 7f16ad7fa640 1 -- 172.21.15.92:0/530605170 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f16a8030d10 con 0x7f16b0108d10 2024-09-21T07:12:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.437+0000 7f16ad7fa640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16980b6620 0x7f16980b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.438+0000 7f16affff640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16980b6620 0x7f16980b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.438+0000 7f16ad7fa640 1 -- 172.21.15.92:0/530605170 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f16a8108d60 con 0x7f16b0108d10 2024-09-21T07:12:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.438+0000 7f16affff640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16980b6620 0x7f16980b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16a0005fd0 tx=0x7f16a000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.441+0000 7f16ad7fa640 1 -- 172.21.15.92:0/530605170 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16a80cefd0 con 0x7f16b0108d10 2024-09-21T07:12:26.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.620+0000 7f16b667f640 1 -- 172.21.15.92:0/530605170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f16b019a380 con 0x7f16b0108d10 2024-09-21T07:12:26.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.621+0000 7f16ad7fa640 1 -- 172.21.15.92:0/530605170 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f16a80d33b0 con 0x7f16b0108d10 2024-09-21T07:12:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:107374182472 2024-09-21T07:12:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 -- 172.21.15.92:0/530605170 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16980b6620 msgr2=0x7f16980b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16980b6620 0x7f16980b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16a0005fd0 tx=0x7f16a000b390 comp rx=0 tx=0).stop 2024-09-21T07:12:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 -- 172.21.15.92:0/530605170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16b0108d10 msgr2=0x7f16b019ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16b0108d10 0x7f16b019ea90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f16a8005cc0 tx=0x7f16a8032a10 comp rx=0 tx=0).stop 2024-09-21T07:12:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 -- 172.21.15.92:0/530605170 shutdown_connections 2024-09-21T07:12:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f16980b6620 0x7f16980b8b30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16b0108d10 0x7f16b019ea90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b01083c0 0x7f16b01997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:26.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 --2- 172.21.15.92:0/530605170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16b0102a80 0x7f16b0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:26.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 -- 172.21.15.92:0/530605170 >> 172.21.15.92:0/530605170 conn(0x7f16b0079740 msgr2=0x7f16b01043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:26.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 -- 172.21.15.92:0/530605170 shutdown_connections 2024-09-21T07:12:26.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:26.623+0000 7f16b667f640 1 -- 172.21.15.92:0/530605170 wait complete. 2024-09-21T07:12:27.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:26 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/405850320' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:12:27.010 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:26 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/530605170' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:12:27.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:26 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/405850320' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:12:27.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:26 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/530605170' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:12:27.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:26 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/405850320' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:12:27.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:26 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/530605170' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:12:27.437 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906977 got 274877906981 for osd.10 2024-09-21T07:12:27.438 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:28.032 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:27 smithi092 ceph-mon[30987]: pgmap v321: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:12:28.061 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070502 got 253403070506 for osd.9 2024-09-21T07:12:28.061 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:27 smithi169 ceph-mon[33705]: pgmap v321: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:12:28.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:27 smithi175 ceph-mon[34064]: pgmap v321: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:12:28.534 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182469 got 107374182472 for osd.3 2024-09-21T07:12:28.534 DEBUG:teuthology.parallel:result is None 2024-09-21T07:12:28.534 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:12:28.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:12:28.791 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:29.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.293+0000 7f257ef08640 1 -- 172.21.15.92:0/178604906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2578107bf0 msgr2=0x7f25781080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.293+0000 7f257ef08640 1 --2- 172.21.15.92:0/178604906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2578107bf0 0x7f25781080d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2570009cd0 tx=0x7f257002a8e0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.293+0000 7f257ef08640 1 -- 172.21.15.92:0/178604906 shutdown_connections 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.293+0000 7f257ef08640 1 --2- 172.21.15.92:0/178604906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2578107bf0 0x7f25781080d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.293+0000 7f257ef08640 1 --2- 172.21.15.92:0/178604906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2578103100 0x7f2578107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.293+0000 7f257ef08640 1 --2- 172.21.15.92:0/178604906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25781027b0 0x7f2578102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.293+0000 7f257ef08640 1 -- 172.21.15.92:0/178604906 >> 172.21.15.92:0/178604906 conn(0x7f2578079710 msgr2=0x7f2578079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.293+0000 7f257ef08640 1 -- 172.21.15.92:0/178604906 shutdown_connections 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.293+0000 7f257ef08640 1 -- 172.21.15.92:0/178604906 wait complete. 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.294+0000 7f257ef08640 1 Processor -- start 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.294+0000 7f257ef08640 1 -- start start 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.294+0000 7f257ef08640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25781027b0 0x7f25781a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.294+0000 7f257ef08640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2578103100 0x7f25781a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.294+0000 7f257ef08640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2578107bf0 0x7f25781a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.294+0000 7f257ef08640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2578119f70 con 0x7f2578107bf0 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.294+0000 7f257ef08640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2578119df0 con 0x7f25781027b0 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.294+0000 7f257ef08640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f257811a0f0 con 0x7f2578103100 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.294+0000 7f257d4a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2578107bf0 0x7f25781a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.294+0000 7f257d4a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2578107bf0 0x7f25781a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45522/0 (socket says 172.21.15.92:45522) 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257d4a5640 1 -- 172.21.15.92:0/3356463330 learned_addr learned my addr 172.21.15.92:0/3356463330 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257cca4640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25781027b0 0x7f25781a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f256ffff640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2578103100 0x7f25781a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257d4a5640 1 -- 172.21.15.92:0/3356463330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2578103100 msgr2=0x7f25781a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257d4a5640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2578103100 0x7f25781a0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257d4a5640 1 -- 172.21.15.92:0/3356463330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25781027b0 msgr2=0x7f25781a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257d4a5640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25781027b0 0x7f25781a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257d4a5640 1 -- 172.21.15.92:0/3356463330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25781a6930 con 0x7f2578107bf0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f256ffff640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2578103100 0x7f25781a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257cca4640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25781027b0 0x7f25781a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257d4a5640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2578107bf0 0x7f25781a6200 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2570006010 tx=0x7f2570003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f256dffb640 1 -- 172.21.15.92:0/3356463330 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570004450 con 0x7f2578107bf0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f256dffb640 1 -- 172.21.15.92:0/3356463330 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2570003e10 con 0x7f2578107bf0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f256dffb640 1 -- 172.21.15.92:0/3356463330 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25700466e0 con 0x7f2578107bf0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257ef08640 1 -- 172.21.15.92:0/3356463330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25781a6bc0 con 0x7f2578107bf0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.295+0000 7f257ef08640 1 -- 172.21.15.92:0/3356463330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25781ad380 con 0x7f2578107bf0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.296+0000 7f257ef08640 1 -- 172.21.15.92:0/3356463330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f257806c280 con 0x7f2578107bf0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.298+0000 7f256dffb640 1 -- 172.21.15.92:0/3356463330 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f25700305a0 con 0x7f2578107bf0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.298+0000 7f256dffb640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25600b6670 0x7f25600b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.299+0000 7f257cca4640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25600b6670 0x7f25600b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.299+0000 7f256dffb640 1 -- 172.21.15.92:0/3356463330 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f257002e030 con 0x7f2578107bf0 2024-09-21T07:12:29.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.299+0000 7f257cca4640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25600b6670 0x7f25600b8b80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25740058c0 tx=0x7f2574005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:29.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.302+0000 7f256dffb640 1 -- 172.21.15.92:0/3356463330 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f257004b060 con 0x7f2578107bf0 2024-09-21T07:12:29.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.477+0000 7f257ef08640 1 -- 172.21.15.92:0/3356463330 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2578106d20 con 0x7f25600b6670 2024-09-21T07:12:29.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.483+0000 7f256dffb640 1 -- 172.21.15.92:0/3356463330 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340684 (secure 0 0 0) 0x7f2578106d20 con 0x7f25600b6670 2024-09-21T07:12:29.489 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:29.491 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-21T07:12:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.487+0000 7f257ef08640 1 -- 172.21.15.92:0/3356463330 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25600b6670 msgr2=0x7f25600b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.487+0000 7f257ef08640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25600b6670 0x7f25600b8b80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25740058c0 tx=0x7f2574005ec0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.487+0000 7f257ef08640 1 -- 172.21.15.92:0/3356463330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2578107bf0 msgr2=0x7f25781a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.487+0000 7f257ef08640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2578107bf0 0x7f25781a6200 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2570006010 tx=0x7f2570003c20 comp rx=0 tx=0).stop 2024-09-21T07:12:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.487+0000 7f257ef08640 1 -- 172.21.15.92:0/3356463330 shutdown_connections 2024-09-21T07:12:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.487+0000 7f257ef08640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25600b6670 0x7f25600b8b80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.487+0000 7f257ef08640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2578107bf0 0x7f25781a6200 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.487+0000 7f257ef08640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2578103100 0x7f25781a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.487+0000 7f257ef08640 1 --2- 172.21.15.92:0/3356463330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25781027b0 0x7f25781a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:29.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.488+0000 7f257ef08640 1 -- 172.21.15.92:0/3356463330 >> 172.21.15.92:0/3356463330 conn(0x7f2578079710 msgr2=0x7f2578105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:29.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.488+0000 7f257ef08640 1 -- 172.21.15.92:0/3356463330 shutdown_connections 2024-09-21T07:12:29.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:29.488+0000 7f257ef08640 1 -- 172.21.15.92:0/3356463330 wait complete. 2024-09-21T07:12:30.314 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-09-21T07:12:27.608613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664018,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":622,"num_read_kb":420,"num_write":373,"num_write_kb":2297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2951908,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365276,"kb_used_data":11792,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576548,"statfs":{"total":1151940427776,"available":1151566385152,"internally_reserved":0,"allocated":12075008,"data_stored":8034896,"data_compressed":463053,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":68,"num_keys_recovered":17,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003474"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":102,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:20.813196+0000","last_change":"2024-09-21T07:10:51.463956+0000","last_active":"2024-09-21T07:12:20.813196+0000","last_peered":"2024-09-21T07:12:20.813196+0000","last_clean":"2024-09-21T07:12:20.813196+0000","last_became_active":"2024-09-21T07:10:51.463564+0000","last_became_peered":"2024-09-21T07:10:51.463564+0000","last_unstale":"2024-09-21T07:12:20.813196+0000","last_undegraded":"2024-09-21T07:12:20.813196+0000","last_fullsized":"2024-09-21T07:12:20.813196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691838+0000","last_change":"2024-09-21T07:10:53.484379+0000","last_active":"2024-09-21T07:12:14.691838+0000","last_peered":"2024-09-21T07:12:14.691838+0000","last_clean":"2024-09-21T07:12:14.691838+0000","last_became_active":"2024-09-21T07:10:53.484005+0000","last_became_peered":"2024-09-21T07:10:53.484005+0000","last_unstale":"2024-09-21T07:12:14.691838+0000","last_undegraded":"2024-09-21T07:12:14.691838+0000","last_fullsized":"2024-09-21T07:12:14.691838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:27.665257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686808+0000","last_change":"2024-09-21T07:11:00.552729+0000","last_active":"2024-09-21T07:12:14.686808+0000","last_peered":"2024-09-21T07:12:14.686808+0000","last_clean":"2024-09-21T07:12:14.686808+0000","last_became_active":"2024-09-21T07:11:00.552196+0000","last_became_peered":"2024-09-21T07:11:00.552196+0000","last_unstale":"2024-09-21T07:12:14.686808+0000","last_undegraded":"2024-09-21T07:12:14.686808+0000","last_fullsized":"2024-09-21T07:12:14.686808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:35.942717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692116+0000","last_change":"2024-09-21T07:10:51.467798+0000","last_active":"2024-09-21T07:12:14.692116+0000","last_peered":"2024-09-21T07:12:14.692116+0000","last_clean":"2024-09-21T07:12:14.692116+0000","last_became_active":"2024-09-21T07:10:51.467314+0000","last_became_peered":"2024-09-21T07:10:51.467314+0000","last_unstale":"2024-09-21T07:12:14.692116+0000","last_undegraded":"2024-09-21T07:12:14.692116+0000","last_fullsized":"2024-09-21T07:12:14.692116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:21.944378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998757+0000","last_change":"2024-09-21T07:10:53.494849+0000","last_active":"2024-09-21T07:12:14.998757+0000","last_peered":"2024-09-21T07:12:14.998757+0000","last_clean":"2024-09-21T07:12:14.998757+0000","last_became_active":"2024-09-21T07:10:53.494478+0000","last_became_peered":"2024-09-21T07:10:53.494478+0000","last_unstale":"2024-09-21T07:12:14.998757+0000","last_undegraded":"2024-09-21T07:12:14.998757+0000","last_fullsized":"2024-09-21T07:12:14.998757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:38.383547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805630+0000","last_change":"2024-09-21T07:11:00.558306+0000","last_active":"2024-09-21T07:12:14.805630+0000","last_peered":"2024-09-21T07:12:14.805630+0000","last_clean":"2024-09-21T07:12:14.805630+0000","last_became_active":"2024-09-21T07:11:00.557814+0000","last_became_peered":"2024-09-21T07:11:00.557814+0000","last_unstale":"2024-09-21T07:12:14.805630+0000","last_undegraded":"2024-09-21T07:12:14.805630+0000","last_fullsized":"2024-09-21T07:12:14.805630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:31.401788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692968+0000","last_change":"2024-09-21T07:10:51.466831+0000","last_active":"2024-09-21T07:12:14.692968+0000","last_peered":"2024-09-21T07:12:14.692968+0000","last_clean":"2024-09-21T07:12:14.692968+0000","last_became_active":"2024-09-21T07:10:51.466381+0000","last_became_peered":"2024-09-21T07:10:51.466381+0000","last_unstale":"2024-09-21T07:12:14.692968+0000","last_undegraded":"2024-09-21T07:12:14.692968+0000","last_fullsized":"2024-09-21T07:12:14.692968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.559370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692506+0000","last_change":"2024-09-21T07:10:53.485920+0000","last_active":"2024-09-21T07:12:14.692506+0000","last_peered":"2024-09-21T07:12:14.692506+0000","last_clean":"2024-09-21T07:12:14.692506+0000","last_became_active":"2024-09-21T07:10:53.484689+0000","last_became_peered":"2024-09-21T07:10:53.484689+0000","last_unstale":"2024-09-21T07:12:14.692506+0000","last_undegraded":"2024-09-21T07:12:14.692506+0000","last_fullsized":"2024-09-21T07:12:14.692506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:59.951999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806409+0000","last_change":"2024-09-21T07:11:00.558298+0000","last_active":"2024-09-21T07:12:14.806409+0000","last_peered":"2024-09-21T07:12:14.806409+0000","last_clean":"2024-09-21T07:12:14.806409+0000","last_became_active":"2024-09-21T07:11:00.557738+0000","last_became_peered":"2024-09-21T07:11:00.557738+0000","last_unstale":"2024-09-21T07:12:14.806409+0000","last_undegraded":"2024-09-21T07:12:14.806409+0000","last_fullsized":"2024-09-21T07:12:14.806409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:03.037820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692968+0000","last_change":"2024-09-21T07:10:51.464283+0000","last_active":"2024-09-21T07:12:14.692968+0000","last_peered":"2024-09-21T07:12:14.692968+0000","last_clean":"2024-09-21T07:12:14.692968+0000","last_became_active":"2024-09-21T07:10:51.463783+0000","last_became_peered":"2024-09-21T07:10:51.463783+0000","last_unstale":"2024-09-21T07:12:14.692968+0000","last_undegraded":"2024-09-21T07:12:14.692968+0000","last_fullsized":"2024-09-21T07:12:14.692968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:45.298654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689283+0000","last_change":"2024-09-21T07:11:14.671020+0000","last_active":"2024-09-21T07:12:14.689283+0000","last_peered":"2024-09-21T07:12:14.689283+0000","last_clean":"2024-09-21T07:12:14.689283+0000","last_became_active":"2024-09-21T07:11:14.670573+0000","last_became_peered":"2024-09-21T07:11:14.670573+0000","last_unstale":"2024-09-21T07:12:14.689283+0000","last_undegraded":"2024-09-21T07:12:14.689283+0000","last_fullsized":"2024-09-21T07:12:14.689283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.926304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805803+0000","last_change":"2024-09-21T07:11:00.549015+0000","last_active":"2024-09-21T07:12:14.805803+0000","last_peered":"2024-09-21T07:12:14.805803+0000","last_clean":"2024-09-21T07:12:14.805803+0000","last_became_active":"2024-09-21T07:11:00.548561+0000","last_became_peered":"2024-09-21T07:11:00.548561+0000","last_unstale":"2024-09-21T07:12:14.805803+0000","last_undegraded":"2024-09-21T07:12:14.805803+0000","last_fullsized":"2024-09-21T07:12:14.805803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:08.386214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690093+0000","last_change":"2024-09-21T07:10:53.489382+0000","last_active":"2024-09-21T07:12:14.690093+0000","last_peered":"2024-09-21T07:12:14.690093+0000","last_clean":"2024-09-21T07:12:14.690093+0000","last_became_active":"2024-09-21T07:10:53.488987+0000","last_became_peered":"2024-09-21T07:10:53.488987+0000","last_unstale":"2024-09-21T07:12:14.690093+0000","last_undegraded":"2024-09-21T07:12:14.690093+0000","last_fullsized":"2024-09-21T07:12:14.690093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.334840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692455+0000","last_change":"2024-09-21T07:10:51.467203+0000","last_active":"2024-09-21T07:12:14.692455+0000","last_peered":"2024-09-21T07:12:14.692455+0000","last_clean":"2024-09-21T07:12:14.692455+0000","last_became_active":"2024-09-21T07:10:51.466737+0000","last_became_peered":"2024-09-21T07:10:51.466737+0000","last_unstale":"2024-09-21T07:12:14.692455+0000","last_undegraded":"2024-09-21T07:12:14.692455+0000","last_fullsized":"2024-09-21T07:12:14.692455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:26.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806131+0000","last_change":"2024-09-21T07:11:00.640801+0000","last_active":"2024-09-21T07:12:14.806131+0000","last_peered":"2024-09-21T07:12:14.806131+0000","last_clean":"2024-09-21T07:12:14.806131+0000","last_became_active":"2024-09-21T07:11:00.640213+0000","last_became_peered":"2024-09-21T07:11:00.640213+0000","last_unstale":"2024-09-21T07:12:14.806131+0000","last_undegraded":"2024-09-21T07:12:14.806131+0000","last_fullsized":"2024-09-21T07:12:14.806131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:55.801831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691513+0000","last_change":"2024-09-21T07:10:53.491166+0000","last_active":"2024-09-21T07:12:14.691513+0000","last_peered":"2024-09-21T07:12:14.691513+0000","last_clean":"2024-09-21T07:12:14.691513+0000","last_became_active":"2024-09-21T07:10:53.490823+0000","last_became_peered":"2024-09-21T07:10:53.490823+0000","last_unstale":"2024-09-21T07:12:14.691513+0000","last_undegraded":"2024-09-21T07:12:14.691513+0000","last_fullsized":"2024-09-21T07:12:14.691513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:48.661634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686948+0000","last_change":"2024-09-21T07:10:51.461220+0000","last_active":"2024-09-21T07:12:14.686948+0000","last_peered":"2024-09-21T07:12:14.686948+0000","last_clean":"2024-09-21T07:12:14.686948+0000","last_became_active":"2024-09-21T07:10:51.460772+0000","last_became_peered":"2024-09-21T07:10:51.460772+0000","last_unstale":"2024-09-21T07:12:14.686948+0000","last_undegraded":"2024-09-21T07:12:14.686948+0000","last_fullsized":"2024-09-21T07:12:14.686948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:56.488273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806176+0000","last_change":"2024-09-21T07:11:00.558487+0000","last_active":"2024-09-21T07:12:14.806176+0000","last_peered":"2024-09-21T07:12:14.806176+0000","last_clean":"2024-09-21T07:12:14.806176+0000","last_became_active":"2024-09-21T07:11:00.557877+0000","last_became_peered":"2024-09-21T07:11:00.557877+0000","last_unstale":"2024-09-21T07:12:14.806176+0000","last_undegraded":"2024-09-21T07:12:14.806176+0000","last_fullsized":"2024-09-21T07:12:14.806176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:14.614603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689253+0000","last_change":"2024-09-21T07:10:53.489309+0000","last_active":"2024-09-21T07:12:14.689253+0000","last_peered":"2024-09-21T07:12:14.689253+0000","last_clean":"2024-09-21T07:12:14.689253+0000","last_became_active":"2024-09-21T07:10:53.488943+0000","last_became_peered":"2024-09-21T07:10:53.488943+0000","last_unstale":"2024-09-21T07:12:14.689253+0000","last_undegraded":"2024-09-21T07:12:14.689253+0000","last_fullsized":"2024-09-21T07:12:14.689253+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.797176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692016+0000","last_change":"2024-09-21T07:10:51.461078+0000","last_active":"2024-09-21T07:12:14.692016+0000","last_peered":"2024-09-21T07:12:14.692016+0000","last_clean":"2024-09-21T07:12:14.692016+0000","last_became_active":"2024-09-21T07:10:51.460759+0000","last_became_peered":"2024-09-21T07:10:51.460759+0000","last_unstale":"2024-09-21T07:12:14.692016+0000","last_undegraded":"2024-09-21T07:12:14.692016+0000","last_fullsized":"2024-09-21T07:12:14.692016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:37.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689489+0000","last_change":"2024-09-21T07:11:00.554766+0000","last_active":"2024-09-21T07:12:14.689489+0000","last_peered":"2024-09-21T07:12:14.689489+0000","last_clean":"2024-09-21T07:12:14.689489+0000","last_became_active":"2024-09-21T07:11:00.554374+0000","last_became_peered":"2024-09-21T07:11:00.554374+0000","last_unstale":"2024-09-21T07:12:14.689489+0000","last_undegraded":"2024-09-21T07:12:14.689489+0000","last_fullsized":"2024-09-21T07:12:14.689489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:47.038411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692132+0000","last_change":"2024-09-21T07:10:53.487501+0000","last_active":"2024-09-21T07:12:14.692132+0000","last_peered":"2024-09-21T07:12:14.692132+0000","last_clean":"2024-09-21T07:12:14.692132+0000","last_became_active":"2024-09-21T07:10:53.487030+0000","last_became_peered":"2024-09-21T07:10:53.487030+0000","last_unstale":"2024-09-21T07:12:14.692132+0000","last_undegraded":"2024-09-21T07:12:14.692132+0000","last_fullsized":"2024-09-21T07:12:14.692132+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692326+0000","last_change":"2024-09-21T07:10:51.468155+0000","last_active":"2024-09-21T07:12:14.692326+0000","last_peered":"2024-09-21T07:12:14.692326+0000","last_clean":"2024-09-21T07:12:14.692326+0000","last_became_active":"2024-09-21T07:10:51.467663+0000","last_became_peered":"2024-09-21T07:10:51.467663+0000","last_unstale":"2024-09-21T07:12:14.692326+0000","last_undegraded":"2024-09-21T07:12:14.692326+0000","last_fullsized":"2024-09-21T07:12:14.692326+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:18.176519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806247+0000","last_change":"2024-09-21T07:11:00.641283+0000","last_active":"2024-09-21T07:12:14.806247+0000","last_peered":"2024-09-21T07:12:14.806247+0000","last_clean":"2024-09-21T07:12:14.806247+0000","last_became_active":"2024-09-21T07:11:00.640715+0000","last_became_peered":"2024-09-21T07:11:00.640715+0000","last_unstale":"2024-09-21T07:12:14.806247+0000","last_undegraded":"2024-09-21T07:12:14.806247+0000","last_fullsized":"2024-09-21T07:12:14.806247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:26.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998578+0000","last_change":"2024-09-21T07:11:14.656686+0000","last_active":"2024-09-21T07:12:14.998578+0000","last_peered":"2024-09-21T07:12:14.998578+0000","last_clean":"2024-09-21T07:12:14.998578+0000","last_became_active":"2024-09-21T07:11:14.656259+0000","last_became_peered":"2024-09-21T07:11:14.656259+0000","last_unstale":"2024-09-21T07:12:14.998578+0000","last_undegraded":"2024-09-21T07:12:14.998578+0000","last_fullsized":"2024-09-21T07:12:14.998578+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:16.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806709+0000","last_change":"2024-09-21T07:10:52.123260+0000","last_active":"2024-09-21T07:12:14.806709+0000","last_peered":"2024-09-21T07:12:14.806709+0000","last_clean":"2024-09-21T07:12:14.806709+0000","last_became_active":"2024-09-21T07:10:52.122752+0000","last_became_peered":"2024-09-21T07:10:52.122752+0000","last_unstale":"2024-09-21T07:12:14.806709+0000","last_undegraded":"2024-09-21T07:12:14.806709+0000","last_fullsized":"2024-09-21T07:12:14.806709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.041434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686899+0000","last_change":"2024-09-21T07:11:00.549599+0000","last_active":"2024-09-21T07:12:14.686899+0000","last_peered":"2024-09-21T07:12:14.686899+0000","last_clean":"2024-09-21T07:12:14.686899+0000","last_became_active":"2024-09-21T07:11:00.549112+0000","last_became_peered":"2024-09-21T07:11:00.549112+0000","last_unstale":"2024-09-21T07:12:14.686899+0000","last_undegraded":"2024-09-21T07:12:14.686899+0000","last_fullsized":"2024-09-21T07:12:14.686899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:15.209889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692182+0000","last_change":"2024-09-21T07:10:53.487792+0000","last_active":"2024-09-21T07:12:14.692182+0000","last_peered":"2024-09-21T07:12:14.692182+0000","last_clean":"2024-09-21T07:12:14.692182+0000","last_became_active":"2024-09-21T07:10:53.487460+0000","last_became_peered":"2024-09-21T07:10:53.487460+0000","last_unstale":"2024-09-21T07:12:14.692182+0000","last_undegraded":"2024-09-21T07:12:14.692182+0000","last_fullsized":"2024-09-21T07:12:14.692182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:26.329878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'15","reported_seq":71,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.699929+0000","last_change":"2024-09-21T07:12:14.699788+0000","last_active":"2024-09-21T07:12:14.699929+0000","last_peered":"2024-09-21T07:12:14.699929+0000","last_clean":"2024-09-21T07:12:14.699929+0000","last_became_active":"2024-09-21T07:12:14.693355+0000","last_became_peered":"2024-09-21T07:12:14.693355+0000","last_unstale":"2024-09-21T07:12:14.699929+0000","last_undegraded":"2024-09-21T07:12:14.699929+0000","last_fullsized":"2024-09-21T07:12:14.699929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:44.104210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691168+0000","last_change":"2024-09-21T07:11:00.640604+0000","last_active":"2024-09-21T07:12:14.691168+0000","last_peered":"2024-09-21T07:12:14.691168+0000","last_clean":"2024-09-21T07:12:14.691168+0000","last_became_active":"2024-09-21T07:11:00.640047+0000","last_became_peered":"2024-09-21T07:11:00.640047+0000","last_unstale":"2024-09-21T07:12:14.691168+0000","last_undegraded":"2024-09-21T07:12:14.691168+0000","last_fullsized":"2024-09-21T07:12:14.691168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:42.640908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686458+0000","last_change":"2024-09-21T07:10:53.473862+0000","last_active":"2024-09-21T07:12:14.686458+0000","last_peered":"2024-09-21T07:12:14.686458+0000","last_clean":"2024-09-21T07:12:14.686458+0000","last_became_active":"2024-09-21T07:10:53.473526+0000","last_became_peered":"2024-09-21T07:10:53.473526+0000","last_unstale":"2024-09-21T07:12:14.686458+0000","last_undegraded":"2024-09-21T07:12:14.686458+0000","last_fullsized":"2024-09-21T07:12:14.686458+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.389566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693080+0000","last_change":"2024-09-21T07:10:51.468003+0000","last_active":"2024-09-21T07:12:14.693080+0000","last_peered":"2024-09-21T07:12:14.693080+0000","last_clean":"2024-09-21T07:12:14.693080+0000","last_became_active":"2024-09-21T07:10:51.467603+0000","last_became_peered":"2024-09-21T07:10:51.467603+0000","last_unstale":"2024-09-21T07:12:14.693080+0000","last_undegraded":"2024-09-21T07:12:14.693080+0000","last_fullsized":"2024-09-21T07:12:14.693080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:02.148721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690142+0000","last_change":"2024-09-21T07:11:00.550434+0000","last_active":"2024-09-21T07:12:14.690142+0000","last_peered":"2024-09-21T07:12:14.690142+0000","last_clean":"2024-09-21T07:12:14.690142+0000","last_became_active":"2024-09-21T07:11:00.549949+0000","last_became_peered":"2024-09-21T07:11:00.549949+0000","last_unstale":"2024-09-21T07:12:14.690142+0000","last_undegraded":"2024-09-21T07:12:14.690142+0000","last_fullsized":"2024-09-21T07:12:14.690142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:53.737978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690987+0000","last_change":"2024-09-21T07:12:14.690832+0000","last_active":"2024-09-21T07:12:14.690987+0000","last_peered":"2024-09-21T07:12:14.690987+0000","last_clean":"2024-09-21T07:12:14.690987+0000","last_became_active":"2024-09-21T07:12:14.690361+0000","last_became_peered":"2024-09-21T07:12:14.690361+0000","last_unstale":"2024-09-21T07:12:14.690987+0000","last_undegraded":"2024-09-21T07:12:14.690987+0000","last_fullsized":"2024-09-21T07:12:14.690987+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:00.772213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689481+0000","last_change":"2024-09-21T07:10:51.468201+0000","last_active":"2024-09-21T07:12:14.689481+0000","last_peered":"2024-09-21T07:12:14.689481+0000","last_clean":"2024-09-21T07:12:14.689481+0000","last_became_active":"2024-09-21T07:10:51.467754+0000","last_became_peered":"2024-09-21T07:10:51.467754+0000","last_unstale":"2024-09-21T07:12:14.689481+0000","last_undegraded":"2024-09-21T07:12:14.689481+0000","last_fullsized":"2024-09-21T07:12:14.689481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:52.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692141+0000","last_change":"2024-09-21T07:11:00.640653+0000","last_active":"2024-09-21T07:12:14.692141+0000","last_peered":"2024-09-21T07:12:14.692141+0000","last_clean":"2024-09-21T07:12:14.692141+0000","last_became_active":"2024-09-21T07:11:00.640080+0000","last_became_peered":"2024-09-21T07:11:00.640080+0000","last_unstale":"2024-09-21T07:12:14.692141+0000","last_undegraded":"2024-09-21T07:12:14.692141+0000","last_fullsized":"2024-09-21T07:12:14.692141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:24.124088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687161+0000","last_change":"2024-09-21T07:10:53.494222+0000","last_active":"2024-09-21T07:12:14.687161+0000","last_peered":"2024-09-21T07:12:14.687161+0000","last_clean":"2024-09-21T07:12:14.687161+0000","last_became_active":"2024-09-21T07:10:53.493703+0000","last_became_peered":"2024-09-21T07:10:53.493703+0000","last_unstale":"2024-09-21T07:12:14.687161+0000","last_undegraded":"2024-09-21T07:12:14.687161+0000","last_fullsized":"2024-09-21T07:12:14.687161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:21.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":95,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:22.816861+0000","last_change":"2024-09-21T07:10:51.461095+0000","last_active":"2024-09-21T07:12:22.816861+0000","last_peered":"2024-09-21T07:12:22.816861+0000","last_clean":"2024-09-21T07:12:22.816861+0000","last_became_active":"2024-09-21T07:10:51.460738+0000","last_became_peered":"2024-09-21T07:10:51.460738+0000","last_unstale":"2024-09-21T07:12:22.816861+0000","last_undegraded":"2024-09-21T07:12:22.816861+0000","last_fullsized":"2024-09-21T07:12:22.816861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:55.593391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686140+0000","last_change":"2024-09-21T07:11:00.544788+0000","last_active":"2024-09-21T07:12:14.686140+0000","last_peered":"2024-09-21T07:12:14.686140+0000","last_clean":"2024-09-21T07:12:14.686140+0000","last_became_active":"2024-09-21T07:11:00.544370+0000","last_became_peered":"2024-09-21T07:11:00.544370+0000","last_unstale":"2024-09-21T07:12:14.686140+0000","last_undegraded":"2024-09-21T07:12:14.686140+0000","last_fullsized":"2024-09-21T07:12:14.686140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.154867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690622+0000","last_change":"2024-09-21T07:10:53.486715+0000","last_active":"2024-09-21T07:12:14.690622+0000","last_peered":"2024-09-21T07:12:14.690622+0000","last_clean":"2024-09-21T07:12:14.690622+0000","last_became_active":"2024-09-21T07:10:53.486315+0000","last_became_peered":"2024-09-21T07:10:53.486315+0000","last_unstale":"2024-09-21T07:12:14.690622+0000","last_undegraded":"2024-09-21T07:12:14.690622+0000","last_fullsized":"2024-09-21T07:12:14.690622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:00.124269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:24.819146+0000","last_change":"2024-09-21T07:10:51.467102+0000","last_active":"2024-09-21T07:12:24.819146+0000","last_peered":"2024-09-21T07:12:24.819146+0000","last_clean":"2024-09-21T07:12:24.819146+0000","last_became_active":"2024-09-21T07:10:51.466721+0000","last_became_peered":"2024-09-21T07:10:51.466721+0000","last_unstale":"2024-09-21T07:12:24.819146+0000","last_undegraded":"2024-09-21T07:12:24.819146+0000","last_fullsized":"2024-09-21T07:12:24.819146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686140+0000","last_change":"2024-09-21T07:11:00.640622+0000","last_active":"2024-09-21T07:12:14.686140+0000","last_peered":"2024-09-21T07:12:14.686140+0000","last_clean":"2024-09-21T07:12:14.686140+0000","last_became_active":"2024-09-21T07:11:00.640104+0000","last_became_peered":"2024-09-21T07:11:00.640104+0000","last_unstale":"2024-09-21T07:12:14.686140+0000","last_undegraded":"2024-09-21T07:12:14.686140+0000","last_fullsized":"2024-09-21T07:12:14.686140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:12.023561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.685846+0000","last_change":"2024-09-21T07:10:53.478175+0000","last_active":"2024-09-21T07:12:14.685846+0000","last_peered":"2024-09-21T07:12:14.685846+0000","last_clean":"2024-09-21T07:12:14.685846+0000","last_became_active":"2024-09-21T07:10:53.477831+0000","last_became_peered":"2024-09-21T07:10:53.477831+0000","last_unstale":"2024-09-21T07:12:14.685846+0000","last_undegraded":"2024-09-21T07:12:14.685846+0000","last_fullsized":"2024-09-21T07:12:14.685846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:27.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689603+0000","last_change":"2024-09-21T07:10:51.466318+0000","last_active":"2024-09-21T07:12:14.689603+0000","last_peered":"2024-09-21T07:12:14.689603+0000","last_clean":"2024-09-21T07:12:14.689603+0000","last_became_active":"2024-09-21T07:10:51.465983+0000","last_became_peered":"2024-09-21T07:10:51.465983+0000","last_unstale":"2024-09-21T07:12:14.689603+0000","last_undegraded":"2024-09-21T07:12:14.689603+0000","last_fullsized":"2024-09-21T07:12:14.689603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:08.432949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691769+0000","last_change":"2024-09-21T07:11:00.641364+0000","last_active":"2024-09-21T07:12:14.691769+0000","last_peered":"2024-09-21T07:12:14.691769+0000","last_clean":"2024-09-21T07:12:14.691769+0000","last_became_active":"2024-09-21T07:11:00.640879+0000","last_became_peered":"2024-09-21T07:11:00.640879+0000","last_unstale":"2024-09-21T07:12:14.691769+0000","last_undegraded":"2024-09-21T07:12:14.691769+0000","last_fullsized":"2024-09-21T07:12:14.691769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:16.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691763+0000","last_change":"2024-09-21T07:10:53.483709+0000","last_active":"2024-09-21T07:12:14.691763+0000","last_peered":"2024-09-21T07:12:14.691763+0000","last_clean":"2024-09-21T07:12:14.691763+0000","last_became_active":"2024-09-21T07:10:53.483355+0000","last_became_peered":"2024-09-21T07:10:53.483355+0000","last_unstale":"2024-09-21T07:12:14.691763+0000","last_undegraded":"2024-09-21T07:12:14.691763+0000","last_fullsized":"2024-09-21T07:12:14.691763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.702168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806543+0000","last_change":"2024-09-21T07:10:51.464239+0000","last_active":"2024-09-21T07:12:14.806543+0000","last_peered":"2024-09-21T07:12:14.806543+0000","last_clean":"2024-09-21T07:12:14.806543+0000","last_became_active":"2024-09-21T07:10:51.463828+0000","last_became_peered":"2024-09-21T07:10:51.463828+0000","last_unstale":"2024-09-21T07:12:14.806543+0000","last_undegraded":"2024-09-21T07:12:14.806543+0000","last_fullsized":"2024-09-21T07:12:14.806543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:09.580668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690229+0000","last_change":"2024-09-21T07:09:39.332523+0000","last_active":"2024-09-21T07:12:14.690229+0000","last_peered":"2024-09-21T07:12:14.690229+0000","last_clean":"2024-09-21T07:12:14.690229+0000","last_became_active":"2024-09-21T07:09:39.326582+0000","last_became_peered":"2024-09-21T07:09:39.326582+0000","last_unstale":"2024-09-21T07:12:14.690229+0000","last_undegraded":"2024-09-21T07:12:14.690229+0000","last_fullsized":"2024-09-21T07:12:14.690229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_clean_scrub_stamp":"2024-09-21T07:06:12.748818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689849+0000","last_change":"2024-09-21T07:11:14.672044+0000","last_active":"2024-09-21T07:12:14.689849+0000","last_peered":"2024-09-21T07:12:14.689849+0000","last_clean":"2024-09-21T07:12:14.689849+0000","last_became_active":"2024-09-21T07:11:14.671513+0000","last_became_peered":"2024-09-21T07:11:14.671513+0000","last_unstale":"2024-09-21T07:12:14.689849+0000","last_undegraded":"2024-09-21T07:12:14.689849+0000","last_fullsized":"2024-09-21T07:12:14.689849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:09.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690446+0000","last_change":"2024-09-21T07:10:53.488678+0000","last_active":"2024-09-21T07:12:14.690446+0000","last_peered":"2024-09-21T07:12:14.690446+0000","last_clean":"2024-09-21T07:12:14.690446+0000","last_became_active":"2024-09-21T07:10:53.488304+0000","last_became_peered":"2024-09-21T07:10:53.488304+0000","last_unstale":"2024-09-21T07:12:14.690446+0000","last_undegraded":"2024-09-21T07:12:14.690446+0000","last_fullsized":"2024-09-21T07:12:14.690446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:37.696269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":95,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:20.816023+0000","last_change":"2024-09-21T07:10:52.123086+0000","last_active":"2024-09-21T07:12:20.816023+0000","last_peered":"2024-09-21T07:12:20.816023+0000","last_clean":"2024-09-21T07:12:20.816023+0000","last_became_active":"2024-09-21T07:10:52.122584+0000","last_became_peered":"2024-09-21T07:10:52.122584+0000","last_unstale":"2024-09-21T07:12:20.816023+0000","last_undegraded":"2024-09-21T07:12:20.816023+0000","last_fullsized":"2024-09-21T07:12:20.816023+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:28.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692259+0000","last_change":"2024-09-21T07:11:00.549595+0000","last_active":"2024-09-21T07:12:14.692259+0000","last_peered":"2024-09-21T07:12:14.692259+0000","last_clean":"2024-09-21T07:12:14.692259+0000","last_became_active":"2024-09-21T07:11:00.549009+0000","last_became_peered":"2024-09-21T07:11:00.549009+0000","last_unstale":"2024-09-21T07:12:14.692259+0000","last_undegraded":"2024-09-21T07:12:14.692259+0000","last_fullsized":"2024-09-21T07:12:14.692259+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:59.825381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689972+0000","last_change":"2024-09-21T07:10:53.484336+0000","last_active":"2024-09-21T07:12:14.689972+0000","last_peered":"2024-09-21T07:12:14.689972+0000","last_clean":"2024-09-21T07:12:14.689972+0000","last_became_active":"2024-09-21T07:10:53.483825+0000","last_became_peered":"2024-09-21T07:10:53.483825+0000","last_unstale":"2024-09-21T07:12:14.689972+0000","last_undegraded":"2024-09-21T07:12:14.689972+0000","last_fullsized":"2024-09-21T07:12:14.689972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.545339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691318+0000","last_change":"2024-09-21T07:10:51.461297+0000","last_active":"2024-09-21T07:12:14.691318+0000","last_peered":"2024-09-21T07:12:14.691318+0000","last_clean":"2024-09-21T07:12:14.691318+0000","last_became_active":"2024-09-21T07:10:51.460600+0000","last_became_peered":"2024-09-21T07:10:51.460600+0000","last_unstale":"2024-09-21T07:12:14.691318+0000","last_undegraded":"2024-09-21T07:12:14.691318+0000","last_fullsized":"2024-09-21T07:12:14.691318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:34.955250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998527+0000","last_change":"2024-09-21T07:11:00.551652+0000","last_active":"2024-09-21T07:12:14.998527+0000","last_peered":"2024-09-21T07:12:14.998527+0000","last_clean":"2024-09-21T07:12:14.998527+0000","last_became_active":"2024-09-21T07:11:00.551236+0000","last_became_peered":"2024-09-21T07:11:00.551236+0000","last_unstale":"2024-09-21T07:12:14.998527+0000","last_undegraded":"2024-09-21T07:12:14.998527+0000","last_fullsized":"2024-09-21T07:12:14.998527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:28.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690260+0000","last_change":"2024-09-21T07:10:53.487605+0000","last_active":"2024-09-21T07:12:14.690260+0000","last_peered":"2024-09-21T07:12:14.690260+0000","last_clean":"2024-09-21T07:12:14.690260+0000","last_became_active":"2024-09-21T07:10:53.487245+0000","last_became_peered":"2024-09-21T07:10:53.487245+0000","last_unstale":"2024-09-21T07:12:14.690260+0000","last_undegraded":"2024-09-21T07:12:14.690260+0000","last_fullsized":"2024-09-21T07:12:14.690260+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:24.490652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686329+0000","last_change":"2024-09-21T07:10:51.456920+0000","last_active":"2024-09-21T07:12:14.686329+0000","last_peered":"2024-09-21T07:12:14.686329+0000","last_clean":"2024-09-21T07:12:14.686329+0000","last_became_active":"2024-09-21T07:10:51.456500+0000","last_became_peered":"2024-09-21T07:10:51.456500+0000","last_unstale":"2024-09-21T07:12:14.686329+0000","last_undegraded":"2024-09-21T07:12:14.686329+0000","last_fullsized":"2024-09-21T07:12:14.686329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:07.663192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690379+0000","last_change":"2024-09-21T07:11:00.552115+0000","last_active":"2024-09-21T07:12:14.690379+0000","last_peered":"2024-09-21T07:12:14.690379+0000","last_clean":"2024-09-21T07:12:14.690379+0000","last_became_active":"2024-09-21T07:11:00.551647+0000","last_became_peered":"2024-09-21T07:11:00.551647+0000","last_unstale":"2024-09-21T07:12:14.690379+0000","last_undegraded":"2024-09-21T07:12:14.690379+0000","last_fullsized":"2024-09-21T07:12:14.690379+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:13.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689672+0000","last_change":"2024-09-21T07:11:14.671714+0000","last_active":"2024-09-21T07:12:14.689672+0000","last_peered":"2024-09-21T07:12:14.689672+0000","last_clean":"2024-09-21T07:12:14.689672+0000","last_became_active":"2024-09-21T07:11:14.671248+0000","last_became_peered":"2024-09-21T07:11:14.671248+0000","last_unstale":"2024-09-21T07:12:14.689672+0000","last_undegraded":"2024-09-21T07:12:14.689672+0000","last_fullsized":"2024-09-21T07:12:14.689672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:36.599916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692830+0000","last_change":"2024-09-21T07:10:51.464710+0000","last_active":"2024-09-21T07:12:14.692830+0000","last_peered":"2024-09-21T07:12:14.692830+0000","last_clean":"2024-09-21T07:12:14.692830+0000","last_became_active":"2024-09-21T07:10:51.464295+0000","last_became_peered":"2024-09-21T07:10:51.464295+0000","last_unstale":"2024-09-21T07:12:14.692830+0000","last_undegraded":"2024-09-21T07:12:14.692830+0000","last_fullsized":"2024-09-21T07:12:14.692830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:00.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691074+0000","last_change":"2024-09-21T07:11:00.548275+0000","last_active":"2024-09-21T07:12:14.691074+0000","last_peered":"2024-09-21T07:12:14.691074+0000","last_clean":"2024-09-21T07:12:14.691074+0000","last_became_active":"2024-09-21T07:11:00.547777+0000","last_became_peered":"2024-09-21T07:11:00.547777+0000","last_unstale":"2024-09-21T07:12:14.691074+0000","last_undegraded":"2024-09-21T07:12:14.691074+0000","last_fullsized":"2024-09-21T07:12:14.691074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:13.860131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691486+0000","last_change":"2024-09-21T07:10:53.494072+0000","last_active":"2024-09-21T07:12:14.691486+0000","last_peered":"2024-09-21T07:12:14.691486+0000","last_clean":"2024-09-21T07:12:14.691486+0000","last_became_active":"2024-09-21T07:10:53.493493+0000","last_became_peered":"2024-09-21T07:10:53.493493+0000","last_unstale":"2024-09-21T07:12:14.691486+0000","last_undegraded":"2024-09-21T07:12:14.691486+0000","last_fullsized":"2024-09-21T07:12:14.691486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.846641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":57,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692090+0000","last_change":"2024-09-21T07:10:51.468145+0000","last_active":"2024-09-21T07:12:14.692090+0000","last_peered":"2024-09-21T07:12:14.692090+0000","last_clean":"2024-09-21T07:12:14.692090+0000","last_became_active":"2024-09-21T07:10:51.467757+0000","last_became_peered":"2024-09-21T07:10:51.467757+0000","last_unstale":"2024-09-21T07:12:14.692090+0000","last_undegraded":"2024-09-21T07:12:14.692090+0000","last_fullsized":"2024-09-21T07:12:14.692090+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:39.150277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686223+0000","last_change":"2024-09-21T07:11:00.548394+0000","last_active":"2024-09-21T07:12:14.686223+0000","last_peered":"2024-09-21T07:12:14.686223+0000","last_clean":"2024-09-21T07:12:14.686223+0000","last_became_active":"2024-09-21T07:11:00.547972+0000","last_became_peered":"2024-09-21T07:11:00.547972+0000","last_unstale":"2024-09-21T07:12:14.686223+0000","last_undegraded":"2024-09-21T07:12:14.686223+0000","last_fullsized":"2024-09-21T07:12:14.686223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:35.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689447+0000","last_change":"2024-09-21T07:11:14.659248+0000","last_active":"2024-09-21T07:12:14.689447+0000","last_peered":"2024-09-21T07:12:14.689447+0000","last_clean":"2024-09-21T07:12:14.689447+0000","last_became_active":"2024-09-21T07:11:14.658931+0000","last_became_peered":"2024-09-21T07:11:14.658931+0000","last_unstale":"2024-09-21T07:12:14.689447+0000","last_undegraded":"2024-09-21T07:12:14.689447+0000","last_fullsized":"2024-09-21T07:12:14.689447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:12.278964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:22.816732+0000","last_change":"2024-09-21T07:10:51.466302+0000","last_active":"2024-09-21T07:12:22.816732+0000","last_peered":"2024-09-21T07:12:22.816732+0000","last_clean":"2024-09-21T07:12:22.816732+0000","last_became_active":"2024-09-21T07:10:51.465906+0000","last_became_peered":"2024-09-21T07:10:51.465906+0000","last_unstale":"2024-09-21T07:12:22.816732+0000","last_undegraded":"2024-09-21T07:12:22.816732+0000","last_fullsized":"2024-09-21T07:12:22.816732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:39.616338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689493+0000","last_change":"2024-09-21T07:11:00.555600+0000","last_active":"2024-09-21T07:12:14.689493+0000","last_peered":"2024-09-21T07:12:14.689493+0000","last_clean":"2024-09-21T07:12:14.689493+0000","last_became_active":"2024-09-21T07:11:00.555203+0000","last_became_peered":"2024-09-21T07:11:00.555203+0000","last_unstale":"2024-09-21T07:12:14.689493+0000","last_undegraded":"2024-09-21T07:12:14.689493+0000","last_fullsized":"2024-09-21T07:12:14.689493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689820+0000","last_change":"2024-09-21T07:10:53.482493+0000","last_active":"2024-09-21T07:12:14.689820+0000","last_peered":"2024-09-21T07:12:14.689820+0000","last_clean":"2024-09-21T07:12:14.689820+0000","last_became_active":"2024-09-21T07:10:53.481310+0000","last_became_peered":"2024-09-21T07:10:53.481310+0000","last_unstale":"2024-09-21T07:12:14.689820+0000","last_undegraded":"2024-09-21T07:12:14.689820+0000","last_fullsized":"2024-09-21T07:12:14.689820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:41.288008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691236+0000","last_change":"2024-09-21T07:10:51.468189+0000","last_active":"2024-09-21T07:12:14.691236+0000","last_peered":"2024-09-21T07:12:14.691236+0000","last_clean":"2024-09-21T07:12:14.691236+0000","last_became_active":"2024-09-21T07:10:51.467770+0000","last_became_peered":"2024-09-21T07:10:51.467770+0000","last_unstale":"2024-09-21T07:12:14.691236+0000","last_undegraded":"2024-09-21T07:12:14.691236+0000","last_fullsized":"2024-09-21T07:12:14.691236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:53.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689286+0000","last_change":"2024-09-21T07:11:00.556306+0000","last_active":"2024-09-21T07:12:14.689286+0000","last_peered":"2024-09-21T07:12:14.689286+0000","last_clean":"2024-09-21T07:12:14.689286+0000","last_became_active":"2024-09-21T07:11:00.555770+0000","last_became_peered":"2024-09-21T07:11:00.555770+0000","last_unstale":"2024-09-21T07:12:14.689286+0000","last_undegraded":"2024-09-21T07:12:14.689286+0000","last_fullsized":"2024-09-21T07:12:14.689286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:19.438869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686104+0000","last_change":"2024-09-21T07:10:53.485039+0000","last_active":"2024-09-21T07:12:14.686104+0000","last_peered":"2024-09-21T07:12:14.686104+0000","last_clean":"2024-09-21T07:12:14.686104+0000","last_became_active":"2024-09-21T07:10:53.484672+0000","last_became_peered":"2024-09-21T07:10:53.484672+0000","last_unstale":"2024-09-21T07:12:14.686104+0000","last_undegraded":"2024-09-21T07:12:14.686104+0000","last_fullsized":"2024-09-21T07:12:14.686104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:28.291602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.709692+0000","last_change":"2024-09-21T07:12:14.709213+0000","last_active":"2024-09-21T07:12:14.709692+0000","last_peered":"2024-09-21T07:12:14.709692+0000","last_clean":"2024-09-21T07:12:14.709692+0000","last_became_active":"2024-09-21T07:12:14.693406+0000","last_became_peered":"2024-09-21T07:12:14.693406+0000","last_unstale":"2024-09-21T07:12:14.709692+0000","last_undegraded":"2024-09-21T07:12:14.709692+0000","last_fullsized":"2024-09-21T07:12:14.709692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:25.204575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687428+0000","last_change":"2024-09-21T07:11:14.672269+0000","last_active":"2024-09-21T07:12:14.687428+0000","last_peered":"2024-09-21T07:12:14.687428+0000","last_clean":"2024-09-21T07:12:14.687428+0000","last_became_active":"2024-09-21T07:11:14.671740+0000","last_became_peered":"2024-09-21T07:11:14.671740+0000","last_unstale":"2024-09-21T07:12:14.687428+0000","last_undegraded":"2024-09-21T07:12:14.687428+0000","last_fullsized":"2024-09-21T07:12:14.687428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.600585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692826+0000","last_change":"2024-09-21T07:10:53.487667+0000","last_active":"2024-09-21T07:12:14.692826+0000","last_peered":"2024-09-21T07:12:14.692826+0000","last_clean":"2024-09-21T07:12:14.692826+0000","last_became_active":"2024-09-21T07:10:53.487316+0000","last_became_peered":"2024-09-21T07:10:53.487316+0000","last_unstale":"2024-09-21T07:12:14.692826+0000","last_undegraded":"2024-09-21T07:12:14.692826+0000","last_fullsized":"2024-09-21T07:12:14.692826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:33.545631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'34","reported_seq":179,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:21.816447+0000","last_change":"2024-09-21T07:10:51.465172+0000","last_active":"2024-09-21T07:12:21.816447+0000","last_peered":"2024-09-21T07:12:21.816447+0000","last_clean":"2024-09-21T07:12:21.816447+0000","last_became_active":"2024-09-21T07:10:51.464655+0000","last_became_peered":"2024-09-21T07:10:51.464655+0000","last_unstale":"2024-09-21T07:12:21.816447+0000","last_undegraded":"2024-09-21T07:12:21.816447+0000","last_fullsized":"2024-09-21T07:12:21.816447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:02.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66212,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":119,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686973+0000","last_change":"2024-09-21T07:11:14.671892+0000","last_active":"2024-09-21T07:12:14.686973+0000","last_peered":"2024-09-21T07:12:14.686973+0000","last_clean":"2024-09-21T07:12:14.686973+0000","last_became_active":"2024-09-21T07:11:14.671283+0000","last_became_peered":"2024-09-21T07:11:14.671283+0000","last_unstale":"2024-09-21T07:12:14.686973+0000","last_undegraded":"2024-09-21T07:12:14.686973+0000","last_fullsized":"2024-09-21T07:12:14.686973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:54.263127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692555+0000","last_change":"2024-09-21T07:10:53.491873+0000","last_active":"2024-09-21T07:12:14.692555+0000","last_peered":"2024-09-21T07:12:14.692555+0000","last_clean":"2024-09-21T07:12:14.692555+0000","last_became_active":"2024-09-21T07:10:53.491424+0000","last_became_peered":"2024-09-21T07:10:53.491424+0000","last_unstale":"2024-09-21T07:12:14.692555+0000","last_undegraded":"2024-09-21T07:12:14.692555+0000","last_fullsized":"2024-09-21T07:12:14.692555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.145391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691205+0000","last_change":"2024-09-21T07:10:51.469395+0000","last_active":"2024-09-21T07:12:14.691205+0000","last_peered":"2024-09-21T07:12:14.691205+0000","last_clean":"2024-09-21T07:12:14.691205+0000","last_became_active":"2024-09-21T07:10:51.469015+0000","last_became_peered":"2024-09-21T07:10:51.469015+0000","last_unstale":"2024-09-21T07:12:14.691205+0000","last_undegraded":"2024-09-21T07:12:14.691205+0000","last_fullsized":"2024-09-21T07:12:14.691205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.274950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806037+0000","last_change":"2024-09-21T07:11:00.553164+0000","last_active":"2024-09-21T07:12:14.806037+0000","last_peered":"2024-09-21T07:12:14.806037+0000","last_clean":"2024-09-21T07:12:14.806037+0000","last_became_active":"2024-09-21T07:11:00.551969+0000","last_became_peered":"2024-09-21T07:11:00.551969+0000","last_unstale":"2024-09-21T07:12:14.806037+0000","last_undegraded":"2024-09-21T07:12:14.806037+0000","last_fullsized":"2024-09-21T07:12:14.806037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:53.042065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998772+0000","last_change":"2024-09-21T07:10:53.497110+0000","last_active":"2024-09-21T07:12:14.998772+0000","last_peered":"2024-09-21T07:12:14.998772+0000","last_clean":"2024-09-21T07:12:14.998772+0000","last_became_active":"2024-09-21T07:10:53.496751+0000","last_became_peered":"2024-09-21T07:10:53.496751+0000","last_unstale":"2024-09-21T07:12:14.998772+0000","last_undegraded":"2024-09-21T07:12:14.998772+0000","last_fullsized":"2024-09-21T07:12:14.998772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.531652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.812106+0000","last_change":"2024-09-21T07:12:14.811962+0000","last_active":"2024-09-21T07:12:14.812106+0000","last_peered":"2024-09-21T07:12:14.812106+0000","last_clean":"2024-09-21T07:12:14.812106+0000","last_became_active":"2024-09-21T07:12:14.807745+0000","last_became_peered":"2024-09-21T07:12:14.807745+0000","last_unstale":"2024-09-21T07:12:14.812106+0000","last_undegraded":"2024-09-21T07:12:14.812106+0000","last_fullsized":"2024-09-21T07:12:14.812106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:20.292633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691946+0000","last_change":"2024-09-21T07:11:14.655255+0000","last_active":"2024-09-21T07:12:14.691946+0000","last_peered":"2024-09-21T07:12:14.691946+0000","last_clean":"2024-09-21T07:12:14.691946+0000","last_became_active":"2024-09-21T07:11:14.654556+0000","last_became_peered":"2024-09-21T07:11:14.654556+0000","last_unstale":"2024-09-21T07:12:14.691946+0000","last_undegraded":"2024-09-21T07:12:14.691946+0000","last_fullsized":"2024-09-21T07:12:14.691946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:44.435834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692928+0000","last_change":"2024-09-21T07:10:53.484990+0000","last_active":"2024-09-21T07:12:14.692928+0000","last_peered":"2024-09-21T07:12:14.692928+0000","last_clean":"2024-09-21T07:12:14.692928+0000","last_became_active":"2024-09-21T07:10:53.484570+0000","last_became_peered":"2024-09-21T07:10:53.484570+0000","last_unstale":"2024-09-21T07:12:14.692928+0000","last_undegraded":"2024-09-21T07:12:14.692928+0000","last_fullsized":"2024-09-21T07:12:14.692928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:28.848203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":140,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:21.816639+0000","last_change":"2024-09-21T07:10:51.463378+0000","last_active":"2024-09-21T07:12:21.816639+0000","last_peered":"2024-09-21T07:12:21.816639+0000","last_clean":"2024-09-21T07:12:21.816639+0000","last_became_active":"2024-09-21T07:10:51.462961+0000","last_became_peered":"2024-09-21T07:10:51.462961+0000","last_unstale":"2024-09-21T07:12:21.816639+0000","last_undegraded":"2024-09-21T07:12:21.816639+0000","last_fullsized":"2024-09-21T07:12:21.816639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:22.637603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691338+0000","last_change":"2024-09-21T07:11:00.549758+0000","last_active":"2024-09-21T07:12:14.691338+0000","last_peered":"2024-09-21T07:12:14.691338+0000","last_clean":"2024-09-21T07:12:14.691338+0000","last_became_active":"2024-09-21T07:11:00.549141+0000","last_became_peered":"2024-09-21T07:11:00.549141+0000","last_unstale":"2024-09-21T07:12:14.691338+0000","last_undegraded":"2024-09-21T07:12:14.691338+0000","last_fullsized":"2024-09-21T07:12:14.691338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:27.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998395+0000","last_change":"2024-09-21T07:11:00.550407+0000","last_active":"2024-09-21T07:12:14.998395+0000","last_peered":"2024-09-21T07:12:14.998395+0000","last_clean":"2024-09-21T07:12:14.998395+0000","last_became_active":"2024-09-21T07:11:00.549930+0000","last_became_peered":"2024-09-21T07:11:00.549930+0000","last_unstale":"2024-09-21T07:12:14.998395+0000","last_undegraded":"2024-09-21T07:12:14.998395+0000","last_fullsized":"2024-09-21T07:12:14.998395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:25.924695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689068+0000","last_change":"2024-09-21T07:10:53.491452+0000","last_active":"2024-09-21T07:12:14.689068+0000","last_peered":"2024-09-21T07:12:14.689068+0000","last_clean":"2024-09-21T07:12:14.689068+0000","last_became_active":"2024-09-21T07:10:53.491106+0000","last_became_peered":"2024-09-21T07:10:53.491106+0000","last_unstale":"2024-09-21T07:12:14.689068+0000","last_undegraded":"2024-09-21T07:12:14.689068+0000","last_fullsized":"2024-09-21T07:12:14.689068+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:58.270323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690768+0000","last_change":"2024-09-21T07:10:51.468433+0000","last_active":"2024-09-21T07:12:14.690768+0000","last_peered":"2024-09-21T07:12:14.690768+0000","last_clean":"2024-09-21T07:12:14.690768+0000","last_became_active":"2024-09-21T07:10:51.467810+0000","last_became_peered":"2024-09-21T07:10:51.467810+0000","last_unstale":"2024-09-21T07:12:14.690768+0000","last_undegraded":"2024-09-21T07:12:14.690768+0000","last_fullsized":"2024-09-21T07:12:14.690768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.787584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689383+0000","last_change":"2024-09-21T07:11:00.556866+0000","last_active":"2024-09-21T07:12:14.689383+0000","last_peered":"2024-09-21T07:12:14.689383+0000","last_clean":"2024-09-21T07:12:14.689383+0000","last_became_active":"2024-09-21T07:11:00.555350+0000","last_became_peered":"2024-09-21T07:11:00.555350+0000","last_unstale":"2024-09-21T07:12:14.689383+0000","last_undegraded":"2024-09-21T07:12:14.689383+0000","last_fullsized":"2024-09-21T07:12:14.689383+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:46.296771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691394+0000","last_change":"2024-09-21T07:10:53.487210+0000","last_active":"2024-09-21T07:12:14.691394+0000","last_peered":"2024-09-21T07:12:14.691394+0000","last_clean":"2024-09-21T07:12:14.691394+0000","last_became_active":"2024-09-21T07:10:53.485975+0000","last_became_peered":"2024-09-21T07:10:53.485975+0000","last_unstale":"2024-09-21T07:12:14.691394+0000","last_undegraded":"2024-09-21T07:12:14.691394+0000","last_fullsized":"2024-09-21T07:12:14.691394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.685930+0000","last_change":"2024-09-21T07:10:51.456418+0000","last_active":"2024-09-21T07:12:14.685930+0000","last_peered":"2024-09-21T07:12:14.685930+0000","last_clean":"2024-09-21T07:12:14.685930+0000","last_became_active":"2024-09-21T07:10:51.455885+0000","last_became_peered":"2024-09-21T07:10:51.455885+0000","last_unstale":"2024-09-21T07:12:14.685930+0000","last_undegraded":"2024-09-21T07:12:14.685930+0000","last_fullsized":"2024-09-21T07:12:14.685930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:53.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687423+0000","last_change":"2024-09-21T07:10:51.462544+0000","last_active":"2024-09-21T07:12:14.687423+0000","last_peered":"2024-09-21T07:12:14.687423+0000","last_clean":"2024-09-21T07:12:14.687423+0000","last_became_active":"2024-09-21T07:10:51.462075+0000","last_became_peered":"2024-09-21T07:10:51.462075+0000","last_unstale":"2024-09-21T07:12:14.687423+0000","last_undegraded":"2024-09-21T07:12:14.687423+0000","last_fullsized":"2024-09-21T07:12:14.687423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:09.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.694904+0000","last_change":"2024-09-21T07:12:14.694814+0000","last_active":"2024-09-21T07:12:14.694904+0000","last_peered":"2024-09-21T07:12:14.694904+0000","last_clean":"2024-09-21T07:12:14.694904+0000","last_became_active":"2024-09-21T07:12:14.694334+0000","last_became_peered":"2024-09-21T07:12:14.694334+0000","last_unstale":"2024-09-21T07:12:14.694904+0000","last_undegraded":"2024-09-21T07:12:14.694904+0000","last_fullsized":"2024-09-21T07:12:14.694904+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:33.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687029+0000","last_change":"2024-09-21T07:11:00.552908+0000","last_active":"2024-09-21T07:12:14.687029+0000","last_peered":"2024-09-21T07:12:14.687029+0000","last_clean":"2024-09-21T07:12:14.687029+0000","last_became_active":"2024-09-21T07:11:00.552303+0000","last_became_peered":"2024-09-21T07:11:00.552303+0000","last_unstale":"2024-09-21T07:12:14.687029+0000","last_undegraded":"2024-09-21T07:12:14.687029+0000","last_fullsized":"2024-09-21T07:12:14.687029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:22.819077+0000","last_change":"2024-09-21T07:10:51.467072+0000","last_active":"2024-09-21T07:12:22.819077+0000","last_peered":"2024-09-21T07:12:22.819077+0000","last_clean":"2024-09-21T07:12:22.819077+0000","last_became_active":"2024-09-21T07:10:51.466671+0000","last_became_peered":"2024-09-21T07:10:51.466671+0000","last_unstale":"2024-09-21T07:12:22.819077+0000","last_undegraded":"2024-09-21T07:12:22.819077+0000","last_fullsized":"2024-09-21T07:12:22.819077+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:24.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692276+0000","last_change":"2024-09-21T07:10:53.480057+0000","last_active":"2024-09-21T07:12:14.692276+0000","last_peered":"2024-09-21T07:12:14.692276+0000","last_clean":"2024-09-21T07:12:14.692276+0000","last_became_active":"2024-09-21T07:10:53.479644+0000","last_became_peered":"2024-09-21T07:10:53.479644+0000","last_unstale":"2024-09-21T07:12:14.692276+0000","last_undegraded":"2024-09-21T07:12:14.692276+0000","last_fullsized":"2024-09-21T07:12:14.692276+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:34.255547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687321+0000","last_change":"2024-09-21T07:11:00.550259+0000","last_active":"2024-09-21T07:12:14.687321+0000","last_peered":"2024-09-21T07:12:14.687321+0000","last_clean":"2024-09-21T07:12:14.687321+0000","last_became_active":"2024-09-21T07:11:00.549771+0000","last_became_peered":"2024-09-21T07:11:00.549771+0000","last_unstale":"2024-09-21T07:12:14.687321+0000","last_undegraded":"2024-09-21T07:12:14.687321+0000","last_fullsized":"2024-09-21T07:12:14.687321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689157+0000","last_change":"2024-09-21T07:10:53.488022+0000","last_active":"2024-09-21T07:12:14.689157+0000","last_peered":"2024-09-21T07:12:14.689157+0000","last_clean":"2024-09-21T07:12:14.689157+0000","last_became_active":"2024-09-21T07:10:53.487605+0000","last_became_peered":"2024-09-21T07:10:53.487605+0000","last_unstale":"2024-09-21T07:12:14.689157+0000","last_undegraded":"2024-09-21T07:12:14.689157+0000","last_fullsized":"2024-09-21T07:12:14.689157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:02.074960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687303+0000","last_change":"2024-09-21T07:10:53.484319+0000","last_active":"2024-09-21T07:12:14.687303+0000","last_peered":"2024-09-21T07:12:14.687303+0000","last_clean":"2024-09-21T07:12:14.687303+0000","last_became_active":"2024-09-21T07:10:53.483942+0000","last_became_peered":"2024-09-21T07:10:53.483942+0000","last_unstale":"2024-09-21T07:12:14.687303+0000","last_undegraded":"2024-09-21T07:12:14.687303+0000","last_fullsized":"2024-09-21T07:12:14.687303+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:50.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686885+0000","last_change":"2024-09-21T07:10:53.494981+0000","last_active":"2024-09-21T07:12:14.686885+0000","last_peered":"2024-09-21T07:12:14.686885+0000","last_clean":"2024-09-21T07:12:14.686885+0000","last_became_active":"2024-09-21T07:10:53.494580+0000","last_became_peered":"2024-09-21T07:10:53.494580+0000","last_unstale":"2024-09-21T07:12:14.686885+0000","last_undegraded":"2024-09-21T07:12:14.686885+0000","last_fullsized":"2024-09-21T07:12:14.686885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:57.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998628+0000","last_change":"2024-09-21T07:10:53.492971+0000","last_active":"2024-09-21T07:12:14.998628+0000","last_peered":"2024-09-21T07:12:14.998628+0000","last_clean":"2024-09-21T07:12:14.998628+0000","last_became_active":"2024-09-21T07:10:53.492597+0000","last_became_peered":"2024-09-21T07:10:53.492597+0000","last_unstale":"2024-09-21T07:12:14.998628+0000","last_undegraded":"2024-09-21T07:12:14.998628+0000","last_fullsized":"2024-09-21T07:12:14.998628+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.931998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686377+0000","last_change":"2024-09-21T07:10:53.485613+0000","last_active":"2024-09-21T07:12:14.686377+0000","last_peered":"2024-09-21T07:12:14.686377+0000","last_clean":"2024-09-21T07:12:14.686377+0000","last_became_active":"2024-09-21T07:10:53.485268+0000","last_became_peered":"2024-09-21T07:10:53.485268+0000","last_unstale":"2024-09-21T07:12:14.686377+0000","last_undegraded":"2024-09-21T07:12:14.686377+0000","last_fullsized":"2024-09-21T07:12:14.686377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:52.496426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689685+0000","last_change":"2024-09-21T07:10:53.489349+0000","last_active":"2024-09-21T07:12:14.689685+0000","last_peered":"2024-09-21T07:12:14.689685+0000","last_clean":"2024-09-21T07:12:14.689685+0000","last_became_active":"2024-09-21T07:10:53.488986+0000","last_became_peered":"2024-09-21T07:10:53.488986+0000","last_unstale":"2024-09-21T07:12:14.689685+0000","last_undegraded":"2024-09-21T07:12:14.689685+0000","last_fullsized":"2024-09-21T07:12:14.689685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:46.376689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687629+0000","last_change":"2024-09-21T07:10:53.485740+0000","last_active":"2024-09-21T07:12:14.687629+0000","last_peered":"2024-09-21T07:12:14.687629+0000","last_clean":"2024-09-21T07:12:14.687629+0000","last_became_active":"2024-09-21T07:10:53.485375+0000","last_became_peered":"2024-09-21T07:10:53.485375+0000","last_unstale":"2024-09-21T07:12:14.687629+0000","last_undegraded":"2024-09-21T07:12:14.687629+0000","last_fullsized":"2024-09-21T07:12:14.687629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:40.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692279+0000","last_change":"2024-09-21T07:10:53.490211+0000","last_active":"2024-09-21T07:12:14.692279+0000","last_peered":"2024-09-21T07:12:14.692279+0000","last_clean":"2024-09-21T07:12:14.692279+0000","last_became_active":"2024-09-21T07:10:53.489504+0000","last_became_peered":"2024-09-21T07:10:53.489504+0000","last_unstale":"2024-09-21T07:12:14.692279+0000","last_undegraded":"2024-09-21T07:12:14.692279+0000","last_fullsized":"2024-09-21T07:12:14.692279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:50.337307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690586+0000","last_change":"2024-09-21T07:10:53.486064+0000","last_active":"2024-09-21T07:12:14.690586+0000","last_peered":"2024-09-21T07:12:14.690586+0000","last_clean":"2024-09-21T07:12:14.690586+0000","last_became_active":"2024-09-21T07:10:53.485674+0000","last_became_peered":"2024-09-21T07:10:53.485674+0000","last_unstale":"2024-09-21T07:12:14.690586+0000","last_undegraded":"2024-09-21T07:12:14.690586+0000","last_fullsized":"2024-09-21T07:12:14.690586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:55.232795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691515+0000","last_change":"2024-09-21T07:10:53.489008+0000","last_active":"2024-09-21T07:12:14.691515+0000","last_peered":"2024-09-21T07:12:14.691515+0000","last_clean":"2024-09-21T07:12:14.691515+0000","last_became_active":"2024-09-21T07:10:53.488655+0000","last_became_peered":"2024-09-21T07:10:53.488655+0000","last_unstale":"2024-09-21T07:12:14.691515+0000","last_undegraded":"2024-09-21T07:12:14.691515+0000","last_fullsized":"2024-09-21T07:12:14.691515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:42.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692443+0000","last_change":"2024-09-21T07:10:53.490147+0000","last_active":"2024-09-21T07:12:14.692443+0000","last_peered":"2024-09-21T07:12:14.692443+0000","last_clean":"2024-09-21T07:12:14.692443+0000","last_became_active":"2024-09-21T07:10:53.488389+0000","last_became_peered":"2024-09-21T07:10:53.488389+0000","last_unstale":"2024-09-21T07:12:14.692443+0000","last_undegraded":"2024-09-21T07:12:14.692443+0000","last_fullsized":"2024-09-21T07:12:14.692443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:17.729856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686345+0000","last_change":"2024-09-21T07:10:53.486557+0000","last_active":"2024-09-21T07:12:14.686345+0000","last_peered":"2024-09-21T07:12:14.686345+0000","last_clean":"2024-09-21T07:12:14.686345+0000","last_became_active":"2024-09-21T07:10:53.486248+0000","last_became_peered":"2024-09-21T07:10:53.486248+0000","last_unstale":"2024-09-21T07:12:14.686345+0000","last_undegraded":"2024-09-21T07:12:14.686345+0000","last_fullsized":"2024-09-21T07:12:14.686345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.675717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689469+0000","last_change":"2024-09-21T07:10:53.485281+0000","last_active":"2024-09-21T07:12:14.689469+0000","last_peered":"2024-09-21T07:12:14.689469+0000","last_clean":"2024-09-21T07:12:14.689469+0000","last_became_active":"2024-09-21T07:10:53.484732+0000","last_became_peered":"2024-09-21T07:10:53.484732+0000","last_unstale":"2024-09-21T07:12:14.689469+0000","last_undegraded":"2024-09-21T07:12:14.689469+0000","last_fullsized":"2024-09-21T07:12:14.689469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:53.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687471+0000","last_change":"2024-09-21T07:10:53.483192+0000","last_active":"2024-09-21T07:12:14.687471+0000","last_peered":"2024-09-21T07:12:14.687471+0000","last_clean":"2024-09-21T07:12:14.687471+0000","last_became_active":"2024-09-21T07:10:53.482402+0000","last_became_peered":"2024-09-21T07:10:53.482402+0000","last_unstale":"2024-09-21T07:12:14.687471+0000","last_undegraded":"2024-09-21T07:12:14.687471+0000","last_fullsized":"2024-09-21T07:12:14.687471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.159873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689445+0000","last_change":"2024-09-21T07:10:53.481463+0000","last_active":"2024-09-21T07:12:14.689445+0000","last_peered":"2024-09-21T07:12:14.689445+0000","last_clean":"2024-09-21T07:12:14.689445+0000","last_became_active":"2024-09-21T07:10:53.481129+0000","last_became_peered":"2024-09-21T07:10:53.481129+0000","last_unstale":"2024-09-21T07:12:14.689445+0000","last_undegraded":"2024-09-21T07:12:14.689445+0000","last_fullsized":"2024-09-21T07:12:14.689445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:14.547936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689879+0000","last_change":"2024-09-21T07:10:53.493009+0000","last_active":"2024-09-21T07:12:14.689879+0000","last_peered":"2024-09-21T07:12:14.689879+0000","last_clean":"2024-09-21T07:12:14.689879+0000","last_became_active":"2024-09-21T07:10:53.492300+0000","last_became_peered":"2024-09-21T07:10:53.492300+0000","last_unstale":"2024-09-21T07:12:14.689879+0000","last_undegraded":"2024-09-21T07:12:14.689879+0000","last_fullsized":"2024-09-21T07:12:14.689879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:09.890248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692113+0000","last_change":"2024-09-21T07:10:53.491149+0000","last_active":"2024-09-21T07:12:14.692113+0000","last_peered":"2024-09-21T07:12:14.692113+0000","last_clean":"2024-09-21T07:12:14.692113+0000","last_became_active":"2024-09-21T07:10:53.490766+0000","last_became_peered":"2024-09-21T07:10:53.490766+0000","last_unstale":"2024-09-21T07:12:14.692113+0000","last_undegraded":"2024-09-21T07:12:14.692113+0000","last_fullsized":"2024-09-21T07:12:14.692113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:52.243083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998339+0000","last_change":"2024-09-21T07:11:14.672453+0000","last_active":"2024-09-21T07:12:14.998339+0000","last_peered":"2024-09-21T07:12:14.998339+0000","last_clean":"2024-09-21T07:12:14.998339+0000","last_became_active":"2024-09-21T07:11:14.671584+0000","last_became_peered":"2024-09-21T07:11:14.671584+0000","last_unstale":"2024-09-21T07:12:14.998339+0000","last_undegraded":"2024-09-21T07:12:14.998339+0000","last_fullsized":"2024-09-21T07:12:14.998339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:25.746195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998244+0000","last_change":"2024-09-21T07:10:53.496332+0000","last_active":"2024-09-21T07:12:14.998244+0000","last_peered":"2024-09-21T07:12:14.998244+0000","last_clean":"2024-09-21T07:12:14.998244+0000","last_became_active":"2024-09-21T07:10:53.495078+0000","last_became_peered":"2024-09-21T07:10:53.495078+0000","last_unstale":"2024-09-21T07:12:14.998244+0000","last_undegraded":"2024-09-21T07:12:14.998244+0000","last_fullsized":"2024-09-21T07:12:14.998244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:32.415350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686211+0000","last_change":"2024-09-21T07:10:53.478381+0000","last_active":"2024-09-21T07:12:14.686211+0000","last_peered":"2024-09-21T07:12:14.686211+0000","last_clean":"2024-09-21T07:12:14.686211+0000","last_became_active":"2024-09-21T07:10:53.478021+0000","last_became_peered":"2024-09-21T07:10:53.478021+0000","last_unstale":"2024-09-21T07:12:14.686211+0000","last_undegraded":"2024-09-21T07:12:14.686211+0000","last_fullsized":"2024-09-21T07:12:14.686211+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:02.496263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806589+0000","last_change":"2024-09-21T07:10:53.485103+0000","last_active":"2024-09-21T07:12:14.806589+0000","last_peered":"2024-09-21T07:12:14.806589+0000","last_clean":"2024-09-21T07:12:14.806589+0000","last_became_active":"2024-09-21T07:10:53.483835+0000","last_became_peered":"2024-09-21T07:10:53.483835+0000","last_unstale":"2024-09-21T07:12:14.806589+0000","last_undegraded":"2024-09-21T07:12:14.806589+0000","last_fullsized":"2024-09-21T07:12:14.806589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:47.775202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689979+0000","last_change":"2024-09-21T07:10:53.490497+0000","last_active":"2024-09-21T07:12:14.689979+0000","last_peered":"2024-09-21T07:12:14.689979+0000","last_clean":"2024-09-21T07:12:14.689979+0000","last_became_active":"2024-09-21T07:10:53.490137+0000","last_became_peered":"2024-09-21T07:10:53.490137+0000","last_unstale":"2024-09-21T07:12:14.689979+0000","last_undegraded":"2024-09-21T07:12:14.689979+0000","last_fullsized":"2024-09-21T07:12:14.689979+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:12.090628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687793+0000","last_change":"2024-09-21T07:10:53.487118+0000","last_active":"2024-09-21T07:12:14.687793+0000","last_peered":"2024-09-21T07:12:14.687793+0000","last_clean":"2024-09-21T07:12:14.687793+0000","last_became_active":"2024-09-21T07:10:53.486582+0000","last_became_peered":"2024-09-21T07:10:53.486582+0000","last_unstale":"2024-09-21T07:12:14.687793+0000","last_undegraded":"2024-09-21T07:12:14.687793+0000","last_fullsized":"2024-09-21T07:12:14.687793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:00.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693003+0000","last_change":"2024-09-21T07:10:53.497390+0000","last_active":"2024-09-21T07:12:14.693003+0000","last_peered":"2024-09-21T07:12:14.693003+0000","last_clean":"2024-09-21T07:12:14.693003+0000","last_became_active":"2024-09-21T07:10:53.497043+0000","last_became_peered":"2024-09-21T07:10:53.497043+0000","last_unstale":"2024-09-21T07:12:14.693003+0000","last_undegraded":"2024-09-21T07:12:14.693003+0000","last_fullsized":"2024-09-21T07:12:14.693003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:36.912873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691285+0000","last_change":"2024-09-21T07:10:53.484624+0000","last_active":"2024-09-21T07:12:14.691285+0000","last_peered":"2024-09-21T07:12:14.691285+0000","last_clean":"2024-09-21T07:12:14.691285+0000","last_became_active":"2024-09-21T07:10:53.484278+0000","last_became_peered":"2024-09-21T07:10:53.484278+0000","last_unstale":"2024-09-21T07:12:14.691285+0000","last_undegraded":"2024-09-21T07:12:14.691285+0000","last_fullsized":"2024-09-21T07:12:14.691285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:41.464442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689591+0000","last_change":"2024-09-21T07:10:53.478146+0000","last_active":"2024-09-21T07:12:14.689591+0000","last_peered":"2024-09-21T07:12:14.689591+0000","last_clean":"2024-09-21T07:12:14.689591+0000","last_became_active":"2024-09-21T07:10:53.477733+0000","last_became_peered":"2024-09-21T07:10:53.477733+0000","last_unstale":"2024-09-21T07:12:14.689591+0000","last_undegraded":"2024-09-21T07:12:14.689591+0000","last_fullsized":"2024-09-21T07:12:14.689591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:09.159966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687171+0000","last_change":"2024-09-21T07:11:14.657274+0000","last_active":"2024-09-21T07:12:14.687171+0000","last_peered":"2024-09-21T07:12:14.687171+0000","last_clean":"2024-09-21T07:12:14.687171+0000","last_became_active":"2024-09-21T07:11:14.656826+0000","last_became_peered":"2024-09-21T07:11:14.656826+0000","last_unstale":"2024-09-21T07:12:14.687171+0000","last_undegraded":"2024-09-21T07:12:14.687171+0000","last_fullsized":"2024-09-21T07:12:14.687171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.688373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692338+0000","last_change":"2024-09-21T07:10:53.481411+0000","last_active":"2024-09-21T07:12:14.692338+0000","last_peered":"2024-09-21T07:12:14.692338+0000","last_clean":"2024-09-21T07:12:14.692338+0000","last_became_active":"2024-09-21T07:10:53.481005+0000","last_became_peered":"2024-09-21T07:10:53.481005+0000","last_unstale":"2024-09-21T07:12:14.692338+0000","last_undegraded":"2024-09-21T07:12:14.692338+0000","last_fullsized":"2024-09-21T07:12:14.692338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:41.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806458+0000","last_change":"2024-09-21T07:10:53.487481+0000","last_active":"2024-09-21T07:12:14.806458+0000","last_peered":"2024-09-21T07:12:14.806458+0000","last_clean":"2024-09-21T07:12:14.806458+0000","last_became_active":"2024-09-21T07:10:53.486277+0000","last_became_peered":"2024-09-21T07:10:53.486277+0000","last_unstale":"2024-09-21T07:12:14.806458+0000","last_undegraded":"2024-09-21T07:12:14.806458+0000","last_fullsized":"2024-09-21T07:12:14.806458+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:57.304382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998384+0000","last_change":"2024-09-21T07:10:53.495971+0000","last_active":"2024-09-21T07:12:14.998384+0000","last_peered":"2024-09-21T07:12:14.998384+0000","last_clean":"2024-09-21T07:12:14.998384+0000","last_became_active":"2024-09-21T07:10:53.495124+0000","last_became_peered":"2024-09-21T07:10:53.495124+0000","last_unstale":"2024-09-21T07:12:14.998384+0000","last_undegraded":"2024-09-21T07:12:14.998384+0000","last_fullsized":"2024-09-21T07:12:14.998384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998428+0000","last_change":"2024-09-21T07:10:53.497538+0000","last_active":"2024-09-21T07:12:14.998428+0000","last_peered":"2024-09-21T07:12:14.998428+0000","last_clean":"2024-09-21T07:12:14.998428+0000","last_became_active":"2024-09-21T07:10:53.496835+0000","last_became_peered":"2024-09-21T07:10:53.496835+0000","last_unstale":"2024-09-21T07:12:14.998428+0000","last_undegraded":"2024-09-21T07:12:14.998428+0000","last_fullsized":"2024-09-21T07:12:14.998428+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:17.187282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689764+0000","last_change":"2024-09-21T07:10:53.492646+0000","last_active":"2024-09-21T07:12:14.689764+0000","last_peered":"2024-09-21T07:12:14.689764+0000","last_clean":"2024-09-21T07:12:14.689764+0000","last_became_active":"2024-09-21T07:10:53.491818+0000","last_became_peered":"2024-09-21T07:10:53.491818+0000","last_unstale":"2024-09-21T07:12:14.689764+0000","last_undegraded":"2024-09-21T07:12:14.689764+0000","last_fullsized":"2024-09-21T07:12:14.689764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:37.094158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73416,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":541,"num_read_kb":351,"num_write":248,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":68,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":220248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283164,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710751,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":506254,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906981,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1118208,"data_stored":1163701,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070506,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":506116,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":506494,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":1103382,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626488,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":501620,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1040384,"data_stored":1098573,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":506085,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":970752,"data_stored":501328,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378701,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":569405,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542226,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":568862,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":983040,"data_stored":503076,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:12:30.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:12:30.566 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:30.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:30 smithi092 ceph-mon[30987]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:12:30.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:30 smithi092 ceph-mon[30987]: pgmap v322: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:12:31.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:30 smithi175 ceph-mon[34064]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:12:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:30 smithi175 ceph-mon[34064]: pgmap v322: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:12:31.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.070+0000 7fe0cf516640 1 -- 172.21.15.92:0/286590160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c8103180 msgr2=0x7fe0c8103590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.070+0000 7fe0cf516640 1 --2- 172.21.15.92:0/286590160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c8103180 0x7fe0c8103590 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009900 tx=0x7fe0c402a410 comp rx=0 tx=0).stop 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.070+0000 7fe0cf516640 1 -- 172.21.15.92:0/286590160 shutdown_connections 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.070+0000 7fe0cf516640 1 --2- 172.21.15.92:0/286590160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0c8108d00 0x7fe0c810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.070+0000 7fe0cf516640 1 --2- 172.21.15.92:0/286590160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0c81083b0 0x7fe0c81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.070+0000 7fe0cf516640 1 --2- 172.21.15.92:0/286590160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c8103180 0x7fe0c8103590 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.070+0000 7fe0cf516640 1 -- 172.21.15.92:0/286590160 >> 172.21.15.92:0/286590160 conn(0x7fe0c8077c60 msgr2=0x7fe0c80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.070+0000 7fe0cf516640 1 -- 172.21.15.92:0/286590160 shutdown_connections 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.070+0000 7fe0cf516640 1 -- 172.21.15.92:0/286590160 wait complete. 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0cf516640 1 Processor -- start 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0cf516640 1 -- start start 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0cf516640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0c8103180 0x7fe0c819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:31.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0cf516640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c81083b0 0x7fe0c819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0cf516640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0c8108d00 0x7fe0c819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0cf516640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8112870 con 0x7fe0c81083b0 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0cf516640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c81126f0 con 0x7fe0c8108d00 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0cf516640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c81129f0 con 0x7fe0c8103180 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0ccab1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c81083b0 0x7fe0c819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0ccab1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c81083b0 0x7fe0c819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39900/0 (socket says 172.21.15.92:39900) 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0ccab1640 1 -- 172.21.15.92:0/1398214138 learned_addr learned my addr 172.21.15.92:0/1398214138 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0cdab3640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0c8108d00 0x7fe0c819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0cd2b2640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0c8103180 0x7fe0c819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0ccab1640 1 -- 172.21.15.92:0/1398214138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0c8103180 msgr2=0x7fe0c819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0ccab1640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0c8103180 0x7fe0c819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:31.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0ccab1640 1 -- 172.21.15.92:0/1398214138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0c8108d00 msgr2=0x7fe0c819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0ccab1640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0c8108d00 0x7fe0c819fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.071+0000 7fe0ccab1640 1 -- 172.21.15.92:0/1398214138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c81a0380 con 0x7fe0c81083b0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.072+0000 7fe0ccab1640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c81083b0 0x7fe0c819a9b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800d750 tx=0x7fe0b800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.072+0000 7fe0be7fc640 1 -- 172.21.15.92:0/1398214138 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8017070 con 0x7fe0c81083b0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.072+0000 7fe0be7fc640 1 -- 172.21.15.92:0/1398214138 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0b80054b0 con 0x7fe0c81083b0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.072+0000 7fe0cf516640 1 -- 172.21.15.92:0/1398214138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c81a0670 con 0x7fe0c81083b0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.072+0000 7fe0be7fc640 1 -- 172.21.15.92:0/1398214138 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8004bc0 con 0x7fe0c81083b0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.072+0000 7fe0cf516640 1 -- 172.21.15.92:0/1398214138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c81a6dd0 con 0x7fe0c81083b0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.073+0000 7fe0cf516640 1 -- 172.21.15.92:0/1398214138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c8103590 con 0x7fe0c81083b0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.074+0000 7fe0be7fc640 1 -- 172.21.15.92:0/1398214138 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fe0b8009c30 con 0x7fe0c81083b0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.075+0000 7fe0be7fc640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0b40b65f0 0x7fe0b40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.076+0000 7fe0cd2b2640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0b40b65f0 0x7fe0b40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.076+0000 7fe0be7fc640 1 -- 172.21.15.92:0/1398214138 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe0b80e77d0 con 0x7fe0c81083b0 2024-09-21T07:12:31.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.076+0000 7fe0cd2b2640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0b40b65f0 0x7fe0b40b8b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4000c00 tx=0x7fe0c4009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:31.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.079+0000 7fe0be7fc640 1 -- 172.21.15.92:0/1398214138 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0b80ada40 con 0x7fe0c81083b0 2024-09-21T07:12:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:30 smithi169 ceph-mon[33705]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:12:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:30 smithi169 ceph-mon[33705]: pgmap v322: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:12:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.253+0000 7fe0cf516640 1 -- 172.21.15.92:0/1398214138 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0c81061c0 con 0x7fe0b40b65f0 2024-09-21T07:12:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.258+0000 7fe0be7fc640 1 -- 172.21.15.92:0/1398214138 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340689 (secure 0 0 0) 0x7fe0c81061c0 con 0x7fe0b40b65f0 2024-09-21T07:12:31.264 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:31.266 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-21T07:12:31.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 -- 172.21.15.92:0/1398214138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0b40b65f0 msgr2=0x7fe0b40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:31.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0b40b65f0 0x7fe0b40b8b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4000c00 tx=0x7fe0c4009680 comp rx=0 tx=0).stop 2024-09-21T07:12:31.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 -- 172.21.15.92:0/1398214138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c81083b0 msgr2=0x7fe0c819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:31.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c81083b0 0x7fe0c819a9b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800d750 tx=0x7fe0b800dc10 comp rx=0 tx=0).stop 2024-09-21T07:12:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 -- 172.21.15.92:0/1398214138 shutdown_connections 2024-09-21T07:12:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0b40b65f0 0x7fe0b40b8b00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0c8108d00 0x7fe0c819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c81083b0 0x7fe0c819a9b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 --2- 172.21.15.92:0/1398214138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0c8103180 0x7fe0c819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 -- 172.21.15.92:0/1398214138 >> 172.21.15.92:0/1398214138 conn(0x7fe0c8077c60 msgr2=0x7fe0c8101110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 -- 172.21.15.92:0/1398214138 shutdown_connections 2024-09-21T07:12:31.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:31.263+0000 7fe0cf516640 1 -- 172.21.15.92:0/1398214138 wait complete. 2024-09-21T07:12:32.003 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-21T07:12:29.609209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664018,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":662,"num_read_kb":440,"num_write":373,"num_write_kb":2297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2951908,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365276,"kb_used_data":11792,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576548,"statfs":{"total":1151940427776,"available":1151566385152,"internally_reserved":0,"allocated":12075008,"data_stored":8034896,"data_compressed":463053,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":68,"num_keys_recovered":17,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003523"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":107,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:25.820668+0000","last_change":"2024-09-21T07:10:51.463956+0000","last_active":"2024-09-21T07:12:25.820668+0000","last_peered":"2024-09-21T07:12:25.820668+0000","last_clean":"2024-09-21T07:12:25.820668+0000","last_became_active":"2024-09-21T07:10:51.463564+0000","last_became_peered":"2024-09-21T07:10:51.463564+0000","last_unstale":"2024-09-21T07:12:25.820668+0000","last_undegraded":"2024-09-21T07:12:25.820668+0000","last_fullsized":"2024-09-21T07:12:25.820668+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691838+0000","last_change":"2024-09-21T07:10:53.484379+0000","last_active":"2024-09-21T07:12:14.691838+0000","last_peered":"2024-09-21T07:12:14.691838+0000","last_clean":"2024-09-21T07:12:14.691838+0000","last_became_active":"2024-09-21T07:10:53.484005+0000","last_became_peered":"2024-09-21T07:10:53.484005+0000","last_unstale":"2024-09-21T07:12:14.691838+0000","last_undegraded":"2024-09-21T07:12:14.691838+0000","last_fullsized":"2024-09-21T07:12:14.691838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:27.665257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686808+0000","last_change":"2024-09-21T07:11:00.552729+0000","last_active":"2024-09-21T07:12:14.686808+0000","last_peered":"2024-09-21T07:12:14.686808+0000","last_clean":"2024-09-21T07:12:14.686808+0000","last_became_active":"2024-09-21T07:11:00.552196+0000","last_became_peered":"2024-09-21T07:11:00.552196+0000","last_unstale":"2024-09-21T07:12:14.686808+0000","last_undegraded":"2024-09-21T07:12:14.686808+0000","last_fullsized":"2024-09-21T07:12:14.686808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:35.942717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692116+0000","last_change":"2024-09-21T07:10:51.467798+0000","last_active":"2024-09-21T07:12:14.692116+0000","last_peered":"2024-09-21T07:12:14.692116+0000","last_clean":"2024-09-21T07:12:14.692116+0000","last_became_active":"2024-09-21T07:10:51.467314+0000","last_became_peered":"2024-09-21T07:10:51.467314+0000","last_unstale":"2024-09-21T07:12:14.692116+0000","last_undegraded":"2024-09-21T07:12:14.692116+0000","last_fullsized":"2024-09-21T07:12:14.692116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:21.944378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998757+0000","last_change":"2024-09-21T07:10:53.494849+0000","last_active":"2024-09-21T07:12:14.998757+0000","last_peered":"2024-09-21T07:12:14.998757+0000","last_clean":"2024-09-21T07:12:14.998757+0000","last_became_active":"2024-09-21T07:10:53.494478+0000","last_became_peered":"2024-09-21T07:10:53.494478+0000","last_unstale":"2024-09-21T07:12:14.998757+0000","last_undegraded":"2024-09-21T07:12:14.998757+0000","last_fullsized":"2024-09-21T07:12:14.998757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:38.383547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805630+0000","last_change":"2024-09-21T07:11:00.558306+0000","last_active":"2024-09-21T07:12:14.805630+0000","last_peered":"2024-09-21T07:12:14.805630+0000","last_clean":"2024-09-21T07:12:14.805630+0000","last_became_active":"2024-09-21T07:11:00.557814+0000","last_became_peered":"2024-09-21T07:11:00.557814+0000","last_unstale":"2024-09-21T07:12:14.805630+0000","last_undegraded":"2024-09-21T07:12:14.805630+0000","last_fullsized":"2024-09-21T07:12:14.805630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:31.401788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692968+0000","last_change":"2024-09-21T07:10:51.466831+0000","last_active":"2024-09-21T07:12:14.692968+0000","last_peered":"2024-09-21T07:12:14.692968+0000","last_clean":"2024-09-21T07:12:14.692968+0000","last_became_active":"2024-09-21T07:10:51.466381+0000","last_became_peered":"2024-09-21T07:10:51.466381+0000","last_unstale":"2024-09-21T07:12:14.692968+0000","last_undegraded":"2024-09-21T07:12:14.692968+0000","last_fullsized":"2024-09-21T07:12:14.692968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.559370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692506+0000","last_change":"2024-09-21T07:10:53.485920+0000","last_active":"2024-09-21T07:12:14.692506+0000","last_peered":"2024-09-21T07:12:14.692506+0000","last_clean":"2024-09-21T07:12:14.692506+0000","last_became_active":"2024-09-21T07:10:53.484689+0000","last_became_peered":"2024-09-21T07:10:53.484689+0000","last_unstale":"2024-09-21T07:12:14.692506+0000","last_undegraded":"2024-09-21T07:12:14.692506+0000","last_fullsized":"2024-09-21T07:12:14.692506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:59.951999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806409+0000","last_change":"2024-09-21T07:11:00.558298+0000","last_active":"2024-09-21T07:12:14.806409+0000","last_peered":"2024-09-21T07:12:14.806409+0000","last_clean":"2024-09-21T07:12:14.806409+0000","last_became_active":"2024-09-21T07:11:00.557738+0000","last_became_peered":"2024-09-21T07:11:00.557738+0000","last_unstale":"2024-09-21T07:12:14.806409+0000","last_undegraded":"2024-09-21T07:12:14.806409+0000","last_fullsized":"2024-09-21T07:12:14.806409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:03.037820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692968+0000","last_change":"2024-09-21T07:10:51.464283+0000","last_active":"2024-09-21T07:12:14.692968+0000","last_peered":"2024-09-21T07:12:14.692968+0000","last_clean":"2024-09-21T07:12:14.692968+0000","last_became_active":"2024-09-21T07:10:51.463783+0000","last_became_peered":"2024-09-21T07:10:51.463783+0000","last_unstale":"2024-09-21T07:12:14.692968+0000","last_undegraded":"2024-09-21T07:12:14.692968+0000","last_fullsized":"2024-09-21T07:12:14.692968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:45.298654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689283+0000","last_change":"2024-09-21T07:11:14.671020+0000","last_active":"2024-09-21T07:12:14.689283+0000","last_peered":"2024-09-21T07:12:14.689283+0000","last_clean":"2024-09-21T07:12:14.689283+0000","last_became_active":"2024-09-21T07:11:14.670573+0000","last_became_peered":"2024-09-21T07:11:14.670573+0000","last_unstale":"2024-09-21T07:12:14.689283+0000","last_undegraded":"2024-09-21T07:12:14.689283+0000","last_fullsized":"2024-09-21T07:12:14.689283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.926304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805803+0000","last_change":"2024-09-21T07:11:00.549015+0000","last_active":"2024-09-21T07:12:14.805803+0000","last_peered":"2024-09-21T07:12:14.805803+0000","last_clean":"2024-09-21T07:12:14.805803+0000","last_became_active":"2024-09-21T07:11:00.548561+0000","last_became_peered":"2024-09-21T07:11:00.548561+0000","last_unstale":"2024-09-21T07:12:14.805803+0000","last_undegraded":"2024-09-21T07:12:14.805803+0000","last_fullsized":"2024-09-21T07:12:14.805803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:08.386214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690093+0000","last_change":"2024-09-21T07:10:53.489382+0000","last_active":"2024-09-21T07:12:14.690093+0000","last_peered":"2024-09-21T07:12:14.690093+0000","last_clean":"2024-09-21T07:12:14.690093+0000","last_became_active":"2024-09-21T07:10:53.488987+0000","last_became_peered":"2024-09-21T07:10:53.488987+0000","last_unstale":"2024-09-21T07:12:14.690093+0000","last_undegraded":"2024-09-21T07:12:14.690093+0000","last_fullsized":"2024-09-21T07:12:14.690093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.334840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692455+0000","last_change":"2024-09-21T07:10:51.467203+0000","last_active":"2024-09-21T07:12:14.692455+0000","last_peered":"2024-09-21T07:12:14.692455+0000","last_clean":"2024-09-21T07:12:14.692455+0000","last_became_active":"2024-09-21T07:10:51.466737+0000","last_became_peered":"2024-09-21T07:10:51.466737+0000","last_unstale":"2024-09-21T07:12:14.692455+0000","last_undegraded":"2024-09-21T07:12:14.692455+0000","last_fullsized":"2024-09-21T07:12:14.692455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:26.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806131+0000","last_change":"2024-09-21T07:11:00.640801+0000","last_active":"2024-09-21T07:12:14.806131+0000","last_peered":"2024-09-21T07:12:14.806131+0000","last_clean":"2024-09-21T07:12:14.806131+0000","last_became_active":"2024-09-21T07:11:00.640213+0000","last_became_peered":"2024-09-21T07:11:00.640213+0000","last_unstale":"2024-09-21T07:12:14.806131+0000","last_undegraded":"2024-09-21T07:12:14.806131+0000","last_fullsized":"2024-09-21T07:12:14.806131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:55.801831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691513+0000","last_change":"2024-09-21T07:10:53.491166+0000","last_active":"2024-09-21T07:12:14.691513+0000","last_peered":"2024-09-21T07:12:14.691513+0000","last_clean":"2024-09-21T07:12:14.691513+0000","last_became_active":"2024-09-21T07:10:53.490823+0000","last_became_peered":"2024-09-21T07:10:53.490823+0000","last_unstale":"2024-09-21T07:12:14.691513+0000","last_undegraded":"2024-09-21T07:12:14.691513+0000","last_fullsized":"2024-09-21T07:12:14.691513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:48.661634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686948+0000","last_change":"2024-09-21T07:10:51.461220+0000","last_active":"2024-09-21T07:12:14.686948+0000","last_peered":"2024-09-21T07:12:14.686948+0000","last_clean":"2024-09-21T07:12:14.686948+0000","last_became_active":"2024-09-21T07:10:51.460772+0000","last_became_peered":"2024-09-21T07:10:51.460772+0000","last_unstale":"2024-09-21T07:12:14.686948+0000","last_undegraded":"2024-09-21T07:12:14.686948+0000","last_fullsized":"2024-09-21T07:12:14.686948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:56.488273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806176+0000","last_change":"2024-09-21T07:11:00.558487+0000","last_active":"2024-09-21T07:12:14.806176+0000","last_peered":"2024-09-21T07:12:14.806176+0000","last_clean":"2024-09-21T07:12:14.806176+0000","last_became_active":"2024-09-21T07:11:00.557877+0000","last_became_peered":"2024-09-21T07:11:00.557877+0000","last_unstale":"2024-09-21T07:12:14.806176+0000","last_undegraded":"2024-09-21T07:12:14.806176+0000","last_fullsized":"2024-09-21T07:12:14.806176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:14.614603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689253+0000","last_change":"2024-09-21T07:10:53.489309+0000","last_active":"2024-09-21T07:12:14.689253+0000","last_peered":"2024-09-21T07:12:14.689253+0000","last_clean":"2024-09-21T07:12:14.689253+0000","last_became_active":"2024-09-21T07:10:53.488943+0000","last_became_peered":"2024-09-21T07:10:53.488943+0000","last_unstale":"2024-09-21T07:12:14.689253+0000","last_undegraded":"2024-09-21T07:12:14.689253+0000","last_fullsized":"2024-09-21T07:12:14.689253+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.797176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692016+0000","last_change":"2024-09-21T07:10:51.461078+0000","last_active":"2024-09-21T07:12:14.692016+0000","last_peered":"2024-09-21T07:12:14.692016+0000","last_clean":"2024-09-21T07:12:14.692016+0000","last_became_active":"2024-09-21T07:10:51.460759+0000","last_became_peered":"2024-09-21T07:10:51.460759+0000","last_unstale":"2024-09-21T07:12:14.692016+0000","last_undegraded":"2024-09-21T07:12:14.692016+0000","last_fullsized":"2024-09-21T07:12:14.692016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:37.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689489+0000","last_change":"2024-09-21T07:11:00.554766+0000","last_active":"2024-09-21T07:12:14.689489+0000","last_peered":"2024-09-21T07:12:14.689489+0000","last_clean":"2024-09-21T07:12:14.689489+0000","last_became_active":"2024-09-21T07:11:00.554374+0000","last_became_peered":"2024-09-21T07:11:00.554374+0000","last_unstale":"2024-09-21T07:12:14.689489+0000","last_undegraded":"2024-09-21T07:12:14.689489+0000","last_fullsized":"2024-09-21T07:12:14.689489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:47.038411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692132+0000","last_change":"2024-09-21T07:10:53.487501+0000","last_active":"2024-09-21T07:12:14.692132+0000","last_peered":"2024-09-21T07:12:14.692132+0000","last_clean":"2024-09-21T07:12:14.692132+0000","last_became_active":"2024-09-21T07:10:53.487030+0000","last_became_peered":"2024-09-21T07:10:53.487030+0000","last_unstale":"2024-09-21T07:12:14.692132+0000","last_undegraded":"2024-09-21T07:12:14.692132+0000","last_fullsized":"2024-09-21T07:12:14.692132+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692326+0000","last_change":"2024-09-21T07:10:51.468155+0000","last_active":"2024-09-21T07:12:14.692326+0000","last_peered":"2024-09-21T07:12:14.692326+0000","last_clean":"2024-09-21T07:12:14.692326+0000","last_became_active":"2024-09-21T07:10:51.467663+0000","last_became_peered":"2024-09-21T07:10:51.467663+0000","last_unstale":"2024-09-21T07:12:14.692326+0000","last_undegraded":"2024-09-21T07:12:14.692326+0000","last_fullsized":"2024-09-21T07:12:14.692326+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:18.176519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806247+0000","last_change":"2024-09-21T07:11:00.641283+0000","last_active":"2024-09-21T07:12:14.806247+0000","last_peered":"2024-09-21T07:12:14.806247+0000","last_clean":"2024-09-21T07:12:14.806247+0000","last_became_active":"2024-09-21T07:11:00.640715+0000","last_became_peered":"2024-09-21T07:11:00.640715+0000","last_unstale":"2024-09-21T07:12:14.806247+0000","last_undegraded":"2024-09-21T07:12:14.806247+0000","last_fullsized":"2024-09-21T07:12:14.806247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:26.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998578+0000","last_change":"2024-09-21T07:11:14.656686+0000","last_active":"2024-09-21T07:12:14.998578+0000","last_peered":"2024-09-21T07:12:14.998578+0000","last_clean":"2024-09-21T07:12:14.998578+0000","last_became_active":"2024-09-21T07:11:14.656259+0000","last_became_peered":"2024-09-21T07:11:14.656259+0000","last_unstale":"2024-09-21T07:12:14.998578+0000","last_undegraded":"2024-09-21T07:12:14.998578+0000","last_fullsized":"2024-09-21T07:12:14.998578+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:16.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806709+0000","last_change":"2024-09-21T07:10:52.123260+0000","last_active":"2024-09-21T07:12:14.806709+0000","last_peered":"2024-09-21T07:12:14.806709+0000","last_clean":"2024-09-21T07:12:14.806709+0000","last_became_active":"2024-09-21T07:10:52.122752+0000","last_became_peered":"2024-09-21T07:10:52.122752+0000","last_unstale":"2024-09-21T07:12:14.806709+0000","last_undegraded":"2024-09-21T07:12:14.806709+0000","last_fullsized":"2024-09-21T07:12:14.806709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.041434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686899+0000","last_change":"2024-09-21T07:11:00.549599+0000","last_active":"2024-09-21T07:12:14.686899+0000","last_peered":"2024-09-21T07:12:14.686899+0000","last_clean":"2024-09-21T07:12:14.686899+0000","last_became_active":"2024-09-21T07:11:00.549112+0000","last_became_peered":"2024-09-21T07:11:00.549112+0000","last_unstale":"2024-09-21T07:12:14.686899+0000","last_undegraded":"2024-09-21T07:12:14.686899+0000","last_fullsized":"2024-09-21T07:12:14.686899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:15.209889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692182+0000","last_change":"2024-09-21T07:10:53.487792+0000","last_active":"2024-09-21T07:12:14.692182+0000","last_peered":"2024-09-21T07:12:14.692182+0000","last_clean":"2024-09-21T07:12:14.692182+0000","last_became_active":"2024-09-21T07:10:53.487460+0000","last_became_peered":"2024-09-21T07:10:53.487460+0000","last_unstale":"2024-09-21T07:12:14.692182+0000","last_undegraded":"2024-09-21T07:12:14.692182+0000","last_fullsized":"2024-09-21T07:12:14.692182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:26.329878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'15","reported_seq":71,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.699929+0000","last_change":"2024-09-21T07:12:14.699788+0000","last_active":"2024-09-21T07:12:14.699929+0000","last_peered":"2024-09-21T07:12:14.699929+0000","last_clean":"2024-09-21T07:12:14.699929+0000","last_became_active":"2024-09-21T07:12:14.693355+0000","last_became_peered":"2024-09-21T07:12:14.693355+0000","last_unstale":"2024-09-21T07:12:14.699929+0000","last_undegraded":"2024-09-21T07:12:14.699929+0000","last_fullsized":"2024-09-21T07:12:14.699929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:44.104210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691168+0000","last_change":"2024-09-21T07:11:00.640604+0000","last_active":"2024-09-21T07:12:14.691168+0000","last_peered":"2024-09-21T07:12:14.691168+0000","last_clean":"2024-09-21T07:12:14.691168+0000","last_became_active":"2024-09-21T07:11:00.640047+0000","last_became_peered":"2024-09-21T07:11:00.640047+0000","last_unstale":"2024-09-21T07:12:14.691168+0000","last_undegraded":"2024-09-21T07:12:14.691168+0000","last_fullsized":"2024-09-21T07:12:14.691168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:42.640908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686458+0000","last_change":"2024-09-21T07:10:53.473862+0000","last_active":"2024-09-21T07:12:14.686458+0000","last_peered":"2024-09-21T07:12:14.686458+0000","last_clean":"2024-09-21T07:12:14.686458+0000","last_became_active":"2024-09-21T07:10:53.473526+0000","last_became_peered":"2024-09-21T07:10:53.473526+0000","last_unstale":"2024-09-21T07:12:14.686458+0000","last_undegraded":"2024-09-21T07:12:14.686458+0000","last_fullsized":"2024-09-21T07:12:14.686458+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.389566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693080+0000","last_change":"2024-09-21T07:10:51.468003+0000","last_active":"2024-09-21T07:12:14.693080+0000","last_peered":"2024-09-21T07:12:14.693080+0000","last_clean":"2024-09-21T07:12:14.693080+0000","last_became_active":"2024-09-21T07:10:51.467603+0000","last_became_peered":"2024-09-21T07:10:51.467603+0000","last_unstale":"2024-09-21T07:12:14.693080+0000","last_undegraded":"2024-09-21T07:12:14.693080+0000","last_fullsized":"2024-09-21T07:12:14.693080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:02.148721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690142+0000","last_change":"2024-09-21T07:11:00.550434+0000","last_active":"2024-09-21T07:12:14.690142+0000","last_peered":"2024-09-21T07:12:14.690142+0000","last_clean":"2024-09-21T07:12:14.690142+0000","last_became_active":"2024-09-21T07:11:00.549949+0000","last_became_peered":"2024-09-21T07:11:00.549949+0000","last_unstale":"2024-09-21T07:12:14.690142+0000","last_undegraded":"2024-09-21T07:12:14.690142+0000","last_fullsized":"2024-09-21T07:12:14.690142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:53.737978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690987+0000","last_change":"2024-09-21T07:12:14.690832+0000","last_active":"2024-09-21T07:12:14.690987+0000","last_peered":"2024-09-21T07:12:14.690987+0000","last_clean":"2024-09-21T07:12:14.690987+0000","last_became_active":"2024-09-21T07:12:14.690361+0000","last_became_peered":"2024-09-21T07:12:14.690361+0000","last_unstale":"2024-09-21T07:12:14.690987+0000","last_undegraded":"2024-09-21T07:12:14.690987+0000","last_fullsized":"2024-09-21T07:12:14.690987+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:00.772213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689481+0000","last_change":"2024-09-21T07:10:51.468201+0000","last_active":"2024-09-21T07:12:14.689481+0000","last_peered":"2024-09-21T07:12:14.689481+0000","last_clean":"2024-09-21T07:12:14.689481+0000","last_became_active":"2024-09-21T07:10:51.467754+0000","last_became_peered":"2024-09-21T07:10:51.467754+0000","last_unstale":"2024-09-21T07:12:14.689481+0000","last_undegraded":"2024-09-21T07:12:14.689481+0000","last_fullsized":"2024-09-21T07:12:14.689481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:52.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692141+0000","last_change":"2024-09-21T07:11:00.640653+0000","last_active":"2024-09-21T07:12:14.692141+0000","last_peered":"2024-09-21T07:12:14.692141+0000","last_clean":"2024-09-21T07:12:14.692141+0000","last_became_active":"2024-09-21T07:11:00.640080+0000","last_became_peered":"2024-09-21T07:11:00.640080+0000","last_unstale":"2024-09-21T07:12:14.692141+0000","last_undegraded":"2024-09-21T07:12:14.692141+0000","last_fullsized":"2024-09-21T07:12:14.692141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:24.124088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687161+0000","last_change":"2024-09-21T07:10:53.494222+0000","last_active":"2024-09-21T07:12:14.687161+0000","last_peered":"2024-09-21T07:12:14.687161+0000","last_clean":"2024-09-21T07:12:14.687161+0000","last_became_active":"2024-09-21T07:10:53.493703+0000","last_became_peered":"2024-09-21T07:10:53.493703+0000","last_unstale":"2024-09-21T07:12:14.687161+0000","last_undegraded":"2024-09-21T07:12:14.687161+0000","last_fullsized":"2024-09-21T07:12:14.687161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:21.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":95,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:22.816861+0000","last_change":"2024-09-21T07:10:51.461095+0000","last_active":"2024-09-21T07:12:22.816861+0000","last_peered":"2024-09-21T07:12:22.816861+0000","last_clean":"2024-09-21T07:12:22.816861+0000","last_became_active":"2024-09-21T07:10:51.460738+0000","last_became_peered":"2024-09-21T07:10:51.460738+0000","last_unstale":"2024-09-21T07:12:22.816861+0000","last_undegraded":"2024-09-21T07:12:22.816861+0000","last_fullsized":"2024-09-21T07:12:22.816861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:55.593391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686140+0000","last_change":"2024-09-21T07:11:00.544788+0000","last_active":"2024-09-21T07:12:14.686140+0000","last_peered":"2024-09-21T07:12:14.686140+0000","last_clean":"2024-09-21T07:12:14.686140+0000","last_became_active":"2024-09-21T07:11:00.544370+0000","last_became_peered":"2024-09-21T07:11:00.544370+0000","last_unstale":"2024-09-21T07:12:14.686140+0000","last_undegraded":"2024-09-21T07:12:14.686140+0000","last_fullsized":"2024-09-21T07:12:14.686140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.154867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690622+0000","last_change":"2024-09-21T07:10:53.486715+0000","last_active":"2024-09-21T07:12:14.690622+0000","last_peered":"2024-09-21T07:12:14.690622+0000","last_clean":"2024-09-21T07:12:14.690622+0000","last_became_active":"2024-09-21T07:10:53.486315+0000","last_became_peered":"2024-09-21T07:10:53.486315+0000","last_unstale":"2024-09-21T07:12:14.690622+0000","last_undegraded":"2024-09-21T07:12:14.690622+0000","last_fullsized":"2024-09-21T07:12:14.690622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:00.124269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:24.819146+0000","last_change":"2024-09-21T07:10:51.467102+0000","last_active":"2024-09-21T07:12:24.819146+0000","last_peered":"2024-09-21T07:12:24.819146+0000","last_clean":"2024-09-21T07:12:24.819146+0000","last_became_active":"2024-09-21T07:10:51.466721+0000","last_became_peered":"2024-09-21T07:10:51.466721+0000","last_unstale":"2024-09-21T07:12:24.819146+0000","last_undegraded":"2024-09-21T07:12:24.819146+0000","last_fullsized":"2024-09-21T07:12:24.819146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686140+0000","last_change":"2024-09-21T07:11:00.640622+0000","last_active":"2024-09-21T07:12:14.686140+0000","last_peered":"2024-09-21T07:12:14.686140+0000","last_clean":"2024-09-21T07:12:14.686140+0000","last_became_active":"2024-09-21T07:11:00.640104+0000","last_became_peered":"2024-09-21T07:11:00.640104+0000","last_unstale":"2024-09-21T07:12:14.686140+0000","last_undegraded":"2024-09-21T07:12:14.686140+0000","last_fullsized":"2024-09-21T07:12:14.686140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:12.023561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.685846+0000","last_change":"2024-09-21T07:10:53.478175+0000","last_active":"2024-09-21T07:12:14.685846+0000","last_peered":"2024-09-21T07:12:14.685846+0000","last_clean":"2024-09-21T07:12:14.685846+0000","last_became_active":"2024-09-21T07:10:53.477831+0000","last_became_peered":"2024-09-21T07:10:53.477831+0000","last_unstale":"2024-09-21T07:12:14.685846+0000","last_undegraded":"2024-09-21T07:12:14.685846+0000","last_fullsized":"2024-09-21T07:12:14.685846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:27.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689603+0000","last_change":"2024-09-21T07:10:51.466318+0000","last_active":"2024-09-21T07:12:14.689603+0000","last_peered":"2024-09-21T07:12:14.689603+0000","last_clean":"2024-09-21T07:12:14.689603+0000","last_became_active":"2024-09-21T07:10:51.465983+0000","last_became_peered":"2024-09-21T07:10:51.465983+0000","last_unstale":"2024-09-21T07:12:14.689603+0000","last_undegraded":"2024-09-21T07:12:14.689603+0000","last_fullsized":"2024-09-21T07:12:14.689603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:08.432949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691769+0000","last_change":"2024-09-21T07:11:00.641364+0000","last_active":"2024-09-21T07:12:14.691769+0000","last_peered":"2024-09-21T07:12:14.691769+0000","last_clean":"2024-09-21T07:12:14.691769+0000","last_became_active":"2024-09-21T07:11:00.640879+0000","last_became_peered":"2024-09-21T07:11:00.640879+0000","last_unstale":"2024-09-21T07:12:14.691769+0000","last_undegraded":"2024-09-21T07:12:14.691769+0000","last_fullsized":"2024-09-21T07:12:14.691769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:16.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691763+0000","last_change":"2024-09-21T07:10:53.483709+0000","last_active":"2024-09-21T07:12:14.691763+0000","last_peered":"2024-09-21T07:12:14.691763+0000","last_clean":"2024-09-21T07:12:14.691763+0000","last_became_active":"2024-09-21T07:10:53.483355+0000","last_became_peered":"2024-09-21T07:10:53.483355+0000","last_unstale":"2024-09-21T07:12:14.691763+0000","last_undegraded":"2024-09-21T07:12:14.691763+0000","last_fullsized":"2024-09-21T07:12:14.691763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.702168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806543+0000","last_change":"2024-09-21T07:10:51.464239+0000","last_active":"2024-09-21T07:12:14.806543+0000","last_peered":"2024-09-21T07:12:14.806543+0000","last_clean":"2024-09-21T07:12:14.806543+0000","last_became_active":"2024-09-21T07:10:51.463828+0000","last_became_peered":"2024-09-21T07:10:51.463828+0000","last_unstale":"2024-09-21T07:12:14.806543+0000","last_undegraded":"2024-09-21T07:12:14.806543+0000","last_fullsized":"2024-09-21T07:12:14.806543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:09.580668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690229+0000","last_change":"2024-09-21T07:09:39.332523+0000","last_active":"2024-09-21T07:12:14.690229+0000","last_peered":"2024-09-21T07:12:14.690229+0000","last_clean":"2024-09-21T07:12:14.690229+0000","last_became_active":"2024-09-21T07:09:39.326582+0000","last_became_peered":"2024-09-21T07:09:39.326582+0000","last_unstale":"2024-09-21T07:12:14.690229+0000","last_undegraded":"2024-09-21T07:12:14.690229+0000","last_fullsized":"2024-09-21T07:12:14.690229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_clean_scrub_stamp":"2024-09-21T07:06:12.748818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689849+0000","last_change":"2024-09-21T07:11:14.672044+0000","last_active":"2024-09-21T07:12:14.689849+0000","last_peered":"2024-09-21T07:12:14.689849+0000","last_clean":"2024-09-21T07:12:14.689849+0000","last_became_active":"2024-09-21T07:11:14.671513+0000","last_became_peered":"2024-09-21T07:11:14.671513+0000","last_unstale":"2024-09-21T07:12:14.689849+0000","last_undegraded":"2024-09-21T07:12:14.689849+0000","last_fullsized":"2024-09-21T07:12:14.689849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:09.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690446+0000","last_change":"2024-09-21T07:10:53.488678+0000","last_active":"2024-09-21T07:12:14.690446+0000","last_peered":"2024-09-21T07:12:14.690446+0000","last_clean":"2024-09-21T07:12:14.690446+0000","last_became_active":"2024-09-21T07:10:53.488304+0000","last_became_peered":"2024-09-21T07:10:53.488304+0000","last_unstale":"2024-09-21T07:12:14.690446+0000","last_undegraded":"2024-09-21T07:12:14.690446+0000","last_fullsized":"2024-09-21T07:12:14.690446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:37.696269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":100,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:25.823028+0000","last_change":"2024-09-21T07:10:52.123086+0000","last_active":"2024-09-21T07:12:25.823028+0000","last_peered":"2024-09-21T07:12:25.823028+0000","last_clean":"2024-09-21T07:12:25.823028+0000","last_became_active":"2024-09-21T07:10:52.122584+0000","last_became_peered":"2024-09-21T07:10:52.122584+0000","last_unstale":"2024-09-21T07:12:25.823028+0000","last_undegraded":"2024-09-21T07:12:25.823028+0000","last_fullsized":"2024-09-21T07:12:25.823028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:28.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692259+0000","last_change":"2024-09-21T07:11:00.549595+0000","last_active":"2024-09-21T07:12:14.692259+0000","last_peered":"2024-09-21T07:12:14.692259+0000","last_clean":"2024-09-21T07:12:14.692259+0000","last_became_active":"2024-09-21T07:11:00.549009+0000","last_became_peered":"2024-09-21T07:11:00.549009+0000","last_unstale":"2024-09-21T07:12:14.692259+0000","last_undegraded":"2024-09-21T07:12:14.692259+0000","last_fullsized":"2024-09-21T07:12:14.692259+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:59.825381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689972+0000","last_change":"2024-09-21T07:10:53.484336+0000","last_active":"2024-09-21T07:12:14.689972+0000","last_peered":"2024-09-21T07:12:14.689972+0000","last_clean":"2024-09-21T07:12:14.689972+0000","last_became_active":"2024-09-21T07:10:53.483825+0000","last_became_peered":"2024-09-21T07:10:53.483825+0000","last_unstale":"2024-09-21T07:12:14.689972+0000","last_undegraded":"2024-09-21T07:12:14.689972+0000","last_fullsized":"2024-09-21T07:12:14.689972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.545339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691318+0000","last_change":"2024-09-21T07:10:51.461297+0000","last_active":"2024-09-21T07:12:14.691318+0000","last_peered":"2024-09-21T07:12:14.691318+0000","last_clean":"2024-09-21T07:12:14.691318+0000","last_became_active":"2024-09-21T07:10:51.460600+0000","last_became_peered":"2024-09-21T07:10:51.460600+0000","last_unstale":"2024-09-21T07:12:14.691318+0000","last_undegraded":"2024-09-21T07:12:14.691318+0000","last_fullsized":"2024-09-21T07:12:14.691318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:34.955250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998527+0000","last_change":"2024-09-21T07:11:00.551652+0000","last_active":"2024-09-21T07:12:14.998527+0000","last_peered":"2024-09-21T07:12:14.998527+0000","last_clean":"2024-09-21T07:12:14.998527+0000","last_became_active":"2024-09-21T07:11:00.551236+0000","last_became_peered":"2024-09-21T07:11:00.551236+0000","last_unstale":"2024-09-21T07:12:14.998527+0000","last_undegraded":"2024-09-21T07:12:14.998527+0000","last_fullsized":"2024-09-21T07:12:14.998527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:28.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690260+0000","last_change":"2024-09-21T07:10:53.487605+0000","last_active":"2024-09-21T07:12:14.690260+0000","last_peered":"2024-09-21T07:12:14.690260+0000","last_clean":"2024-09-21T07:12:14.690260+0000","last_became_active":"2024-09-21T07:10:53.487245+0000","last_became_peered":"2024-09-21T07:10:53.487245+0000","last_unstale":"2024-09-21T07:12:14.690260+0000","last_undegraded":"2024-09-21T07:12:14.690260+0000","last_fullsized":"2024-09-21T07:12:14.690260+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:24.490652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686329+0000","last_change":"2024-09-21T07:10:51.456920+0000","last_active":"2024-09-21T07:12:14.686329+0000","last_peered":"2024-09-21T07:12:14.686329+0000","last_clean":"2024-09-21T07:12:14.686329+0000","last_became_active":"2024-09-21T07:10:51.456500+0000","last_became_peered":"2024-09-21T07:10:51.456500+0000","last_unstale":"2024-09-21T07:12:14.686329+0000","last_undegraded":"2024-09-21T07:12:14.686329+0000","last_fullsized":"2024-09-21T07:12:14.686329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:07.663192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690379+0000","last_change":"2024-09-21T07:11:00.552115+0000","last_active":"2024-09-21T07:12:14.690379+0000","last_peered":"2024-09-21T07:12:14.690379+0000","last_clean":"2024-09-21T07:12:14.690379+0000","last_became_active":"2024-09-21T07:11:00.551647+0000","last_became_peered":"2024-09-21T07:11:00.551647+0000","last_unstale":"2024-09-21T07:12:14.690379+0000","last_undegraded":"2024-09-21T07:12:14.690379+0000","last_fullsized":"2024-09-21T07:12:14.690379+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:13.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689672+0000","last_change":"2024-09-21T07:11:14.671714+0000","last_active":"2024-09-21T07:12:14.689672+0000","last_peered":"2024-09-21T07:12:14.689672+0000","last_clean":"2024-09-21T07:12:14.689672+0000","last_became_active":"2024-09-21T07:11:14.671248+0000","last_became_peered":"2024-09-21T07:11:14.671248+0000","last_unstale":"2024-09-21T07:12:14.689672+0000","last_undegraded":"2024-09-21T07:12:14.689672+0000","last_fullsized":"2024-09-21T07:12:14.689672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:36.599916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692830+0000","last_change":"2024-09-21T07:10:51.464710+0000","last_active":"2024-09-21T07:12:14.692830+0000","last_peered":"2024-09-21T07:12:14.692830+0000","last_clean":"2024-09-21T07:12:14.692830+0000","last_became_active":"2024-09-21T07:10:51.464295+0000","last_became_peered":"2024-09-21T07:10:51.464295+0000","last_unstale":"2024-09-21T07:12:14.692830+0000","last_undegraded":"2024-09-21T07:12:14.692830+0000","last_fullsized":"2024-09-21T07:12:14.692830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:00.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691074+0000","last_change":"2024-09-21T07:11:00.548275+0000","last_active":"2024-09-21T07:12:14.691074+0000","last_peered":"2024-09-21T07:12:14.691074+0000","last_clean":"2024-09-21T07:12:14.691074+0000","last_became_active":"2024-09-21T07:11:00.547777+0000","last_became_peered":"2024-09-21T07:11:00.547777+0000","last_unstale":"2024-09-21T07:12:14.691074+0000","last_undegraded":"2024-09-21T07:12:14.691074+0000","last_fullsized":"2024-09-21T07:12:14.691074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:13.860131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691486+0000","last_change":"2024-09-21T07:10:53.494072+0000","last_active":"2024-09-21T07:12:14.691486+0000","last_peered":"2024-09-21T07:12:14.691486+0000","last_clean":"2024-09-21T07:12:14.691486+0000","last_became_active":"2024-09-21T07:10:53.493493+0000","last_became_peered":"2024-09-21T07:10:53.493493+0000","last_unstale":"2024-09-21T07:12:14.691486+0000","last_undegraded":"2024-09-21T07:12:14.691486+0000","last_fullsized":"2024-09-21T07:12:14.691486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.846641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":57,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692090+0000","last_change":"2024-09-21T07:10:51.468145+0000","last_active":"2024-09-21T07:12:14.692090+0000","last_peered":"2024-09-21T07:12:14.692090+0000","last_clean":"2024-09-21T07:12:14.692090+0000","last_became_active":"2024-09-21T07:10:51.467757+0000","last_became_peered":"2024-09-21T07:10:51.467757+0000","last_unstale":"2024-09-21T07:12:14.692090+0000","last_undegraded":"2024-09-21T07:12:14.692090+0000","last_fullsized":"2024-09-21T07:12:14.692090+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:39.150277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686223+0000","last_change":"2024-09-21T07:11:00.548394+0000","last_active":"2024-09-21T07:12:14.686223+0000","last_peered":"2024-09-21T07:12:14.686223+0000","last_clean":"2024-09-21T07:12:14.686223+0000","last_became_active":"2024-09-21T07:11:00.547972+0000","last_became_peered":"2024-09-21T07:11:00.547972+0000","last_unstale":"2024-09-21T07:12:14.686223+0000","last_undegraded":"2024-09-21T07:12:14.686223+0000","last_fullsized":"2024-09-21T07:12:14.686223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:35.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689447+0000","last_change":"2024-09-21T07:11:14.659248+0000","last_active":"2024-09-21T07:12:14.689447+0000","last_peered":"2024-09-21T07:12:14.689447+0000","last_clean":"2024-09-21T07:12:14.689447+0000","last_became_active":"2024-09-21T07:11:14.658931+0000","last_became_peered":"2024-09-21T07:11:14.658931+0000","last_unstale":"2024-09-21T07:12:14.689447+0000","last_undegraded":"2024-09-21T07:12:14.689447+0000","last_fullsized":"2024-09-21T07:12:14.689447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:12.278964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":104,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:27.824062+0000","last_change":"2024-09-21T07:10:51.466302+0000","last_active":"2024-09-21T07:12:27.824062+0000","last_peered":"2024-09-21T07:12:27.824062+0000","last_clean":"2024-09-21T07:12:27.824062+0000","last_became_active":"2024-09-21T07:10:51.465906+0000","last_became_peered":"2024-09-21T07:10:51.465906+0000","last_unstale":"2024-09-21T07:12:27.824062+0000","last_undegraded":"2024-09-21T07:12:27.824062+0000","last_fullsized":"2024-09-21T07:12:27.824062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:39.616338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689493+0000","last_change":"2024-09-21T07:11:00.555600+0000","last_active":"2024-09-21T07:12:14.689493+0000","last_peered":"2024-09-21T07:12:14.689493+0000","last_clean":"2024-09-21T07:12:14.689493+0000","last_became_active":"2024-09-21T07:11:00.555203+0000","last_became_peered":"2024-09-21T07:11:00.555203+0000","last_unstale":"2024-09-21T07:12:14.689493+0000","last_undegraded":"2024-09-21T07:12:14.689493+0000","last_fullsized":"2024-09-21T07:12:14.689493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689820+0000","last_change":"2024-09-21T07:10:53.482493+0000","last_active":"2024-09-21T07:12:14.689820+0000","last_peered":"2024-09-21T07:12:14.689820+0000","last_clean":"2024-09-21T07:12:14.689820+0000","last_became_active":"2024-09-21T07:10:53.481310+0000","last_became_peered":"2024-09-21T07:10:53.481310+0000","last_unstale":"2024-09-21T07:12:14.689820+0000","last_undegraded":"2024-09-21T07:12:14.689820+0000","last_fullsized":"2024-09-21T07:12:14.689820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:41.288008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691236+0000","last_change":"2024-09-21T07:10:51.468189+0000","last_active":"2024-09-21T07:12:14.691236+0000","last_peered":"2024-09-21T07:12:14.691236+0000","last_clean":"2024-09-21T07:12:14.691236+0000","last_became_active":"2024-09-21T07:10:51.467770+0000","last_became_peered":"2024-09-21T07:10:51.467770+0000","last_unstale":"2024-09-21T07:12:14.691236+0000","last_undegraded":"2024-09-21T07:12:14.691236+0000","last_fullsized":"2024-09-21T07:12:14.691236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:53.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689286+0000","last_change":"2024-09-21T07:11:00.556306+0000","last_active":"2024-09-21T07:12:14.689286+0000","last_peered":"2024-09-21T07:12:14.689286+0000","last_clean":"2024-09-21T07:12:14.689286+0000","last_became_active":"2024-09-21T07:11:00.555770+0000","last_became_peered":"2024-09-21T07:11:00.555770+0000","last_unstale":"2024-09-21T07:12:14.689286+0000","last_undegraded":"2024-09-21T07:12:14.689286+0000","last_fullsized":"2024-09-21T07:12:14.689286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:19.438869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686104+0000","last_change":"2024-09-21T07:10:53.485039+0000","last_active":"2024-09-21T07:12:14.686104+0000","last_peered":"2024-09-21T07:12:14.686104+0000","last_clean":"2024-09-21T07:12:14.686104+0000","last_became_active":"2024-09-21T07:10:53.484672+0000","last_became_peered":"2024-09-21T07:10:53.484672+0000","last_unstale":"2024-09-21T07:12:14.686104+0000","last_undegraded":"2024-09-21T07:12:14.686104+0000","last_fullsized":"2024-09-21T07:12:14.686104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:28.291602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.709692+0000","last_change":"2024-09-21T07:12:14.709213+0000","last_active":"2024-09-21T07:12:14.709692+0000","last_peered":"2024-09-21T07:12:14.709692+0000","last_clean":"2024-09-21T07:12:14.709692+0000","last_became_active":"2024-09-21T07:12:14.693406+0000","last_became_peered":"2024-09-21T07:12:14.693406+0000","last_unstale":"2024-09-21T07:12:14.709692+0000","last_undegraded":"2024-09-21T07:12:14.709692+0000","last_fullsized":"2024-09-21T07:12:14.709692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:25.204575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687428+0000","last_change":"2024-09-21T07:11:14.672269+0000","last_active":"2024-09-21T07:12:14.687428+0000","last_peered":"2024-09-21T07:12:14.687428+0000","last_clean":"2024-09-21T07:12:14.687428+0000","last_became_active":"2024-09-21T07:11:14.671740+0000","last_became_peered":"2024-09-21T07:11:14.671740+0000","last_unstale":"2024-09-21T07:12:14.687428+0000","last_undegraded":"2024-09-21T07:12:14.687428+0000","last_fullsized":"2024-09-21T07:12:14.687428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.600585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692826+0000","last_change":"2024-09-21T07:10:53.487667+0000","last_active":"2024-09-21T07:12:14.692826+0000","last_peered":"2024-09-21T07:12:14.692826+0000","last_clean":"2024-09-21T07:12:14.692826+0000","last_became_active":"2024-09-21T07:10:53.487316+0000","last_became_peered":"2024-09-21T07:10:53.487316+0000","last_unstale":"2024-09-21T07:12:14.692826+0000","last_undegraded":"2024-09-21T07:12:14.692826+0000","last_fullsized":"2024-09-21T07:12:14.692826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:33.545631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'34","reported_seq":189,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:26.823628+0000","last_change":"2024-09-21T07:10:51.465172+0000","last_active":"2024-09-21T07:12:26.823628+0000","last_peered":"2024-09-21T07:12:26.823628+0000","last_clean":"2024-09-21T07:12:26.823628+0000","last_became_active":"2024-09-21T07:10:51.464655+0000","last_became_peered":"2024-09-21T07:10:51.464655+0000","last_unstale":"2024-09-21T07:12:26.823628+0000","last_undegraded":"2024-09-21T07:12:26.823628+0000","last_fullsized":"2024-09-21T07:12:26.823628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:02.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66212,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":124,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686973+0000","last_change":"2024-09-21T07:11:14.671892+0000","last_active":"2024-09-21T07:12:14.686973+0000","last_peered":"2024-09-21T07:12:14.686973+0000","last_clean":"2024-09-21T07:12:14.686973+0000","last_became_active":"2024-09-21T07:11:14.671283+0000","last_became_peered":"2024-09-21T07:11:14.671283+0000","last_unstale":"2024-09-21T07:12:14.686973+0000","last_undegraded":"2024-09-21T07:12:14.686973+0000","last_fullsized":"2024-09-21T07:12:14.686973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:54.263127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692555+0000","last_change":"2024-09-21T07:10:53.491873+0000","last_active":"2024-09-21T07:12:14.692555+0000","last_peered":"2024-09-21T07:12:14.692555+0000","last_clean":"2024-09-21T07:12:14.692555+0000","last_became_active":"2024-09-21T07:10:53.491424+0000","last_became_peered":"2024-09-21T07:10:53.491424+0000","last_unstale":"2024-09-21T07:12:14.692555+0000","last_undegraded":"2024-09-21T07:12:14.692555+0000","last_fullsized":"2024-09-21T07:12:14.692555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.145391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691205+0000","last_change":"2024-09-21T07:10:51.469395+0000","last_active":"2024-09-21T07:12:14.691205+0000","last_peered":"2024-09-21T07:12:14.691205+0000","last_clean":"2024-09-21T07:12:14.691205+0000","last_became_active":"2024-09-21T07:10:51.469015+0000","last_became_peered":"2024-09-21T07:10:51.469015+0000","last_unstale":"2024-09-21T07:12:14.691205+0000","last_undegraded":"2024-09-21T07:12:14.691205+0000","last_fullsized":"2024-09-21T07:12:14.691205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.274950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806037+0000","last_change":"2024-09-21T07:11:00.553164+0000","last_active":"2024-09-21T07:12:14.806037+0000","last_peered":"2024-09-21T07:12:14.806037+0000","last_clean":"2024-09-21T07:12:14.806037+0000","last_became_active":"2024-09-21T07:11:00.551969+0000","last_became_peered":"2024-09-21T07:11:00.551969+0000","last_unstale":"2024-09-21T07:12:14.806037+0000","last_undegraded":"2024-09-21T07:12:14.806037+0000","last_fullsized":"2024-09-21T07:12:14.806037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:53.042065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998772+0000","last_change":"2024-09-21T07:10:53.497110+0000","last_active":"2024-09-21T07:12:14.998772+0000","last_peered":"2024-09-21T07:12:14.998772+0000","last_clean":"2024-09-21T07:12:14.998772+0000","last_became_active":"2024-09-21T07:10:53.496751+0000","last_became_peered":"2024-09-21T07:10:53.496751+0000","last_unstale":"2024-09-21T07:12:14.998772+0000","last_undegraded":"2024-09-21T07:12:14.998772+0000","last_fullsized":"2024-09-21T07:12:14.998772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.531652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.812106+0000","last_change":"2024-09-21T07:12:14.811962+0000","last_active":"2024-09-21T07:12:14.812106+0000","last_peered":"2024-09-21T07:12:14.812106+0000","last_clean":"2024-09-21T07:12:14.812106+0000","last_became_active":"2024-09-21T07:12:14.807745+0000","last_became_peered":"2024-09-21T07:12:14.807745+0000","last_unstale":"2024-09-21T07:12:14.812106+0000","last_undegraded":"2024-09-21T07:12:14.812106+0000","last_fullsized":"2024-09-21T07:12:14.812106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:20.292633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691946+0000","last_change":"2024-09-21T07:11:14.655255+0000","last_active":"2024-09-21T07:12:14.691946+0000","last_peered":"2024-09-21T07:12:14.691946+0000","last_clean":"2024-09-21T07:12:14.691946+0000","last_became_active":"2024-09-21T07:11:14.654556+0000","last_became_peered":"2024-09-21T07:11:14.654556+0000","last_unstale":"2024-09-21T07:12:14.691946+0000","last_undegraded":"2024-09-21T07:12:14.691946+0000","last_fullsized":"2024-09-21T07:12:14.691946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:44.435834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692928+0000","last_change":"2024-09-21T07:10:53.484990+0000","last_active":"2024-09-21T07:12:14.692928+0000","last_peered":"2024-09-21T07:12:14.692928+0000","last_clean":"2024-09-21T07:12:14.692928+0000","last_became_active":"2024-09-21T07:10:53.484570+0000","last_became_peered":"2024-09-21T07:10:53.484570+0000","last_unstale":"2024-09-21T07:12:14.692928+0000","last_undegraded":"2024-09-21T07:12:14.692928+0000","last_fullsized":"2024-09-21T07:12:14.692928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:28.848203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":150,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:26.823817+0000","last_change":"2024-09-21T07:10:51.463378+0000","last_active":"2024-09-21T07:12:26.823817+0000","last_peered":"2024-09-21T07:12:26.823817+0000","last_clean":"2024-09-21T07:12:26.823817+0000","last_became_active":"2024-09-21T07:10:51.462961+0000","last_became_peered":"2024-09-21T07:10:51.462961+0000","last_unstale":"2024-09-21T07:12:26.823817+0000","last_undegraded":"2024-09-21T07:12:26.823817+0000","last_fullsized":"2024-09-21T07:12:26.823817+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:22.637603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691338+0000","last_change":"2024-09-21T07:11:00.549758+0000","last_active":"2024-09-21T07:12:14.691338+0000","last_peered":"2024-09-21T07:12:14.691338+0000","last_clean":"2024-09-21T07:12:14.691338+0000","last_became_active":"2024-09-21T07:11:00.549141+0000","last_became_peered":"2024-09-21T07:11:00.549141+0000","last_unstale":"2024-09-21T07:12:14.691338+0000","last_undegraded":"2024-09-21T07:12:14.691338+0000","last_fullsized":"2024-09-21T07:12:14.691338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:27.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998395+0000","last_change":"2024-09-21T07:11:00.550407+0000","last_active":"2024-09-21T07:12:14.998395+0000","last_peered":"2024-09-21T07:12:14.998395+0000","last_clean":"2024-09-21T07:12:14.998395+0000","last_became_active":"2024-09-21T07:11:00.549930+0000","last_became_peered":"2024-09-21T07:11:00.549930+0000","last_unstale":"2024-09-21T07:12:14.998395+0000","last_undegraded":"2024-09-21T07:12:14.998395+0000","last_fullsized":"2024-09-21T07:12:14.998395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:25.924695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689068+0000","last_change":"2024-09-21T07:10:53.491452+0000","last_active":"2024-09-21T07:12:14.689068+0000","last_peered":"2024-09-21T07:12:14.689068+0000","last_clean":"2024-09-21T07:12:14.689068+0000","last_became_active":"2024-09-21T07:10:53.491106+0000","last_became_peered":"2024-09-21T07:10:53.491106+0000","last_unstale":"2024-09-21T07:12:14.689068+0000","last_undegraded":"2024-09-21T07:12:14.689068+0000","last_fullsized":"2024-09-21T07:12:14.689068+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:58.270323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690768+0000","last_change":"2024-09-21T07:10:51.468433+0000","last_active":"2024-09-21T07:12:14.690768+0000","last_peered":"2024-09-21T07:12:14.690768+0000","last_clean":"2024-09-21T07:12:14.690768+0000","last_became_active":"2024-09-21T07:10:51.467810+0000","last_became_peered":"2024-09-21T07:10:51.467810+0000","last_unstale":"2024-09-21T07:12:14.690768+0000","last_undegraded":"2024-09-21T07:12:14.690768+0000","last_fullsized":"2024-09-21T07:12:14.690768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.787584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689383+0000","last_change":"2024-09-21T07:11:00.556866+0000","last_active":"2024-09-21T07:12:14.689383+0000","last_peered":"2024-09-21T07:12:14.689383+0000","last_clean":"2024-09-21T07:12:14.689383+0000","last_became_active":"2024-09-21T07:11:00.555350+0000","last_became_peered":"2024-09-21T07:11:00.555350+0000","last_unstale":"2024-09-21T07:12:14.689383+0000","last_undegraded":"2024-09-21T07:12:14.689383+0000","last_fullsized":"2024-09-21T07:12:14.689383+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:46.296771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691394+0000","last_change":"2024-09-21T07:10:53.487210+0000","last_active":"2024-09-21T07:12:14.691394+0000","last_peered":"2024-09-21T07:12:14.691394+0000","last_clean":"2024-09-21T07:12:14.691394+0000","last_became_active":"2024-09-21T07:10:53.485975+0000","last_became_peered":"2024-09-21T07:10:53.485975+0000","last_unstale":"2024-09-21T07:12:14.691394+0000","last_undegraded":"2024-09-21T07:12:14.691394+0000","last_fullsized":"2024-09-21T07:12:14.691394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.685930+0000","last_change":"2024-09-21T07:10:51.456418+0000","last_active":"2024-09-21T07:12:14.685930+0000","last_peered":"2024-09-21T07:12:14.685930+0000","last_clean":"2024-09-21T07:12:14.685930+0000","last_became_active":"2024-09-21T07:10:51.455885+0000","last_became_peered":"2024-09-21T07:10:51.455885+0000","last_unstale":"2024-09-21T07:12:14.685930+0000","last_undegraded":"2024-09-21T07:12:14.685930+0000","last_fullsized":"2024-09-21T07:12:14.685930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:53.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687423+0000","last_change":"2024-09-21T07:10:51.462544+0000","last_active":"2024-09-21T07:12:14.687423+0000","last_peered":"2024-09-21T07:12:14.687423+0000","last_clean":"2024-09-21T07:12:14.687423+0000","last_became_active":"2024-09-21T07:10:51.462075+0000","last_became_peered":"2024-09-21T07:10:51.462075+0000","last_unstale":"2024-09-21T07:12:14.687423+0000","last_undegraded":"2024-09-21T07:12:14.687423+0000","last_fullsized":"2024-09-21T07:12:14.687423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:09.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.694904+0000","last_change":"2024-09-21T07:12:14.694814+0000","last_active":"2024-09-21T07:12:14.694904+0000","last_peered":"2024-09-21T07:12:14.694904+0000","last_clean":"2024-09-21T07:12:14.694904+0000","last_became_active":"2024-09-21T07:12:14.694334+0000","last_became_peered":"2024-09-21T07:12:14.694334+0000","last_unstale":"2024-09-21T07:12:14.694904+0000","last_undegraded":"2024-09-21T07:12:14.694904+0000","last_fullsized":"2024-09-21T07:12:14.694904+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:33.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687029+0000","last_change":"2024-09-21T07:11:00.552908+0000","last_active":"2024-09-21T07:12:14.687029+0000","last_peered":"2024-09-21T07:12:14.687029+0000","last_clean":"2024-09-21T07:12:14.687029+0000","last_became_active":"2024-09-21T07:11:00.552303+0000","last_became_peered":"2024-09-21T07:11:00.552303+0000","last_unstale":"2024-09-21T07:12:14.687029+0000","last_undegraded":"2024-09-21T07:12:14.687029+0000","last_fullsized":"2024-09-21T07:12:14.687029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":104,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:27.825951+0000","last_change":"2024-09-21T07:10:51.467072+0000","last_active":"2024-09-21T07:12:27.825951+0000","last_peered":"2024-09-21T07:12:27.825951+0000","last_clean":"2024-09-21T07:12:27.825951+0000","last_became_active":"2024-09-21T07:10:51.466671+0000","last_became_peered":"2024-09-21T07:10:51.466671+0000","last_unstale":"2024-09-21T07:12:27.825951+0000","last_undegraded":"2024-09-21T07:12:27.825951+0000","last_fullsized":"2024-09-21T07:12:27.825951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:24.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692276+0000","last_change":"2024-09-21T07:10:53.480057+0000","last_active":"2024-09-21T07:12:14.692276+0000","last_peered":"2024-09-21T07:12:14.692276+0000","last_clean":"2024-09-21T07:12:14.692276+0000","last_became_active":"2024-09-21T07:10:53.479644+0000","last_became_peered":"2024-09-21T07:10:53.479644+0000","last_unstale":"2024-09-21T07:12:14.692276+0000","last_undegraded":"2024-09-21T07:12:14.692276+0000","last_fullsized":"2024-09-21T07:12:14.692276+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:34.255547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687321+0000","last_change":"2024-09-21T07:11:00.550259+0000","last_active":"2024-09-21T07:12:14.687321+0000","last_peered":"2024-09-21T07:12:14.687321+0000","last_clean":"2024-09-21T07:12:14.687321+0000","last_became_active":"2024-09-21T07:11:00.549771+0000","last_became_peered":"2024-09-21T07:11:00.549771+0000","last_unstale":"2024-09-21T07:12:14.687321+0000","last_undegraded":"2024-09-21T07:12:14.687321+0000","last_fullsized":"2024-09-21T07:12:14.687321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689157+0000","last_change":"2024-09-21T07:10:53.488022+0000","last_active":"2024-09-21T07:12:14.689157+0000","last_peered":"2024-09-21T07:12:14.689157+0000","last_clean":"2024-09-21T07:12:14.689157+0000","last_became_active":"2024-09-21T07:10:53.487605+0000","last_became_peered":"2024-09-21T07:10:53.487605+0000","last_unstale":"2024-09-21T07:12:14.689157+0000","last_undegraded":"2024-09-21T07:12:14.689157+0000","last_fullsized":"2024-09-21T07:12:14.689157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:02.074960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687303+0000","last_change":"2024-09-21T07:10:53.484319+0000","last_active":"2024-09-21T07:12:14.687303+0000","last_peered":"2024-09-21T07:12:14.687303+0000","last_clean":"2024-09-21T07:12:14.687303+0000","last_became_active":"2024-09-21T07:10:53.483942+0000","last_became_peered":"2024-09-21T07:10:53.483942+0000","last_unstale":"2024-09-21T07:12:14.687303+0000","last_undegraded":"2024-09-21T07:12:14.687303+0000","last_fullsized":"2024-09-21T07:12:14.687303+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:50.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686885+0000","last_change":"2024-09-21T07:10:53.494981+0000","last_active":"2024-09-21T07:12:14.686885+0000","last_peered":"2024-09-21T07:12:14.686885+0000","last_clean":"2024-09-21T07:12:14.686885+0000","last_became_active":"2024-09-21T07:10:53.494580+0000","last_became_peered":"2024-09-21T07:10:53.494580+0000","last_unstale":"2024-09-21T07:12:14.686885+0000","last_undegraded":"2024-09-21T07:12:14.686885+0000","last_fullsized":"2024-09-21T07:12:14.686885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:57.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998628+0000","last_change":"2024-09-21T07:10:53.492971+0000","last_active":"2024-09-21T07:12:14.998628+0000","last_peered":"2024-09-21T07:12:14.998628+0000","last_clean":"2024-09-21T07:12:14.998628+0000","last_became_active":"2024-09-21T07:10:53.492597+0000","last_became_peered":"2024-09-21T07:10:53.492597+0000","last_unstale":"2024-09-21T07:12:14.998628+0000","last_undegraded":"2024-09-21T07:12:14.998628+0000","last_fullsized":"2024-09-21T07:12:14.998628+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.931998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686377+0000","last_change":"2024-09-21T07:10:53.485613+0000","last_active":"2024-09-21T07:12:14.686377+0000","last_peered":"2024-09-21T07:12:14.686377+0000","last_clean":"2024-09-21T07:12:14.686377+0000","last_became_active":"2024-09-21T07:10:53.485268+0000","last_became_peered":"2024-09-21T07:10:53.485268+0000","last_unstale":"2024-09-21T07:12:14.686377+0000","last_undegraded":"2024-09-21T07:12:14.686377+0000","last_fullsized":"2024-09-21T07:12:14.686377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:52.496426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689685+0000","last_change":"2024-09-21T07:10:53.489349+0000","last_active":"2024-09-21T07:12:14.689685+0000","last_peered":"2024-09-21T07:12:14.689685+0000","last_clean":"2024-09-21T07:12:14.689685+0000","last_became_active":"2024-09-21T07:10:53.488986+0000","last_became_peered":"2024-09-21T07:10:53.488986+0000","last_unstale":"2024-09-21T07:12:14.689685+0000","last_undegraded":"2024-09-21T07:12:14.689685+0000","last_fullsized":"2024-09-21T07:12:14.689685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:46.376689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687629+0000","last_change":"2024-09-21T07:10:53.485740+0000","last_active":"2024-09-21T07:12:14.687629+0000","last_peered":"2024-09-21T07:12:14.687629+0000","last_clean":"2024-09-21T07:12:14.687629+0000","last_became_active":"2024-09-21T07:10:53.485375+0000","last_became_peered":"2024-09-21T07:10:53.485375+0000","last_unstale":"2024-09-21T07:12:14.687629+0000","last_undegraded":"2024-09-21T07:12:14.687629+0000","last_fullsized":"2024-09-21T07:12:14.687629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:40.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692279+0000","last_change":"2024-09-21T07:10:53.490211+0000","last_active":"2024-09-21T07:12:14.692279+0000","last_peered":"2024-09-21T07:12:14.692279+0000","last_clean":"2024-09-21T07:12:14.692279+0000","last_became_active":"2024-09-21T07:10:53.489504+0000","last_became_peered":"2024-09-21T07:10:53.489504+0000","last_unstale":"2024-09-21T07:12:14.692279+0000","last_undegraded":"2024-09-21T07:12:14.692279+0000","last_fullsized":"2024-09-21T07:12:14.692279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:50.337307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690586+0000","last_change":"2024-09-21T07:10:53.486064+0000","last_active":"2024-09-21T07:12:14.690586+0000","last_peered":"2024-09-21T07:12:14.690586+0000","last_clean":"2024-09-21T07:12:14.690586+0000","last_became_active":"2024-09-21T07:10:53.485674+0000","last_became_peered":"2024-09-21T07:10:53.485674+0000","last_unstale":"2024-09-21T07:12:14.690586+0000","last_undegraded":"2024-09-21T07:12:14.690586+0000","last_fullsized":"2024-09-21T07:12:14.690586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:55.232795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691515+0000","last_change":"2024-09-21T07:10:53.489008+0000","last_active":"2024-09-21T07:12:14.691515+0000","last_peered":"2024-09-21T07:12:14.691515+0000","last_clean":"2024-09-21T07:12:14.691515+0000","last_became_active":"2024-09-21T07:10:53.488655+0000","last_became_peered":"2024-09-21T07:10:53.488655+0000","last_unstale":"2024-09-21T07:12:14.691515+0000","last_undegraded":"2024-09-21T07:12:14.691515+0000","last_fullsized":"2024-09-21T07:12:14.691515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:42.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692443+0000","last_change":"2024-09-21T07:10:53.490147+0000","last_active":"2024-09-21T07:12:14.692443+0000","last_peered":"2024-09-21T07:12:14.692443+0000","last_clean":"2024-09-21T07:12:14.692443+0000","last_became_active":"2024-09-21T07:10:53.488389+0000","last_became_peered":"2024-09-21T07:10:53.488389+0000","last_unstale":"2024-09-21T07:12:14.692443+0000","last_undegraded":"2024-09-21T07:12:14.692443+0000","last_fullsized":"2024-09-21T07:12:14.692443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:17.729856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686345+0000","last_change":"2024-09-21T07:10:53.486557+0000","last_active":"2024-09-21T07:12:14.686345+0000","last_peered":"2024-09-21T07:12:14.686345+0000","last_clean":"2024-09-21T07:12:14.686345+0000","last_became_active":"2024-09-21T07:10:53.486248+0000","last_became_peered":"2024-09-21T07:10:53.486248+0000","last_unstale":"2024-09-21T07:12:14.686345+0000","last_undegraded":"2024-09-21T07:12:14.686345+0000","last_fullsized":"2024-09-21T07:12:14.686345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.675717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689469+0000","last_change":"2024-09-21T07:10:53.485281+0000","last_active":"2024-09-21T07:12:14.689469+0000","last_peered":"2024-09-21T07:12:14.689469+0000","last_clean":"2024-09-21T07:12:14.689469+0000","last_became_active":"2024-09-21T07:10:53.484732+0000","last_became_peered":"2024-09-21T07:10:53.484732+0000","last_unstale":"2024-09-21T07:12:14.689469+0000","last_undegraded":"2024-09-21T07:12:14.689469+0000","last_fullsized":"2024-09-21T07:12:14.689469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:53.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687471+0000","last_change":"2024-09-21T07:10:53.483192+0000","last_active":"2024-09-21T07:12:14.687471+0000","last_peered":"2024-09-21T07:12:14.687471+0000","last_clean":"2024-09-21T07:12:14.687471+0000","last_became_active":"2024-09-21T07:10:53.482402+0000","last_became_peered":"2024-09-21T07:10:53.482402+0000","last_unstale":"2024-09-21T07:12:14.687471+0000","last_undegraded":"2024-09-21T07:12:14.687471+0000","last_fullsized":"2024-09-21T07:12:14.687471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.159873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689445+0000","last_change":"2024-09-21T07:10:53.481463+0000","last_active":"2024-09-21T07:12:14.689445+0000","last_peered":"2024-09-21T07:12:14.689445+0000","last_clean":"2024-09-21T07:12:14.689445+0000","last_became_active":"2024-09-21T07:10:53.481129+0000","last_became_peered":"2024-09-21T07:10:53.481129+0000","last_unstale":"2024-09-21T07:12:14.689445+0000","last_undegraded":"2024-09-21T07:12:14.689445+0000","last_fullsized":"2024-09-21T07:12:14.689445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:14.547936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689879+0000","last_change":"2024-09-21T07:10:53.493009+0000","last_active":"2024-09-21T07:12:14.689879+0000","last_peered":"2024-09-21T07:12:14.689879+0000","last_clean":"2024-09-21T07:12:14.689879+0000","last_became_active":"2024-09-21T07:10:53.492300+0000","last_became_peered":"2024-09-21T07:10:53.492300+0000","last_unstale":"2024-09-21T07:12:14.689879+0000","last_undegraded":"2024-09-21T07:12:14.689879+0000","last_fullsized":"2024-09-21T07:12:14.689879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:09.890248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692113+0000","last_change":"2024-09-21T07:10:53.491149+0000","last_active":"2024-09-21T07:12:14.692113+0000","last_peered":"2024-09-21T07:12:14.692113+0000","last_clean":"2024-09-21T07:12:14.692113+0000","last_became_active":"2024-09-21T07:10:53.490766+0000","last_became_peered":"2024-09-21T07:10:53.490766+0000","last_unstale":"2024-09-21T07:12:14.692113+0000","last_undegraded":"2024-09-21T07:12:14.692113+0000","last_fullsized":"2024-09-21T07:12:14.692113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:52.243083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998339+0000","last_change":"2024-09-21T07:11:14.672453+0000","last_active":"2024-09-21T07:12:14.998339+0000","last_peered":"2024-09-21T07:12:14.998339+0000","last_clean":"2024-09-21T07:12:14.998339+0000","last_became_active":"2024-09-21T07:11:14.671584+0000","last_became_peered":"2024-09-21T07:11:14.671584+0000","last_unstale":"2024-09-21T07:12:14.998339+0000","last_undegraded":"2024-09-21T07:12:14.998339+0000","last_fullsized":"2024-09-21T07:12:14.998339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:25.746195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998244+0000","last_change":"2024-09-21T07:10:53.496332+0000","last_active":"2024-09-21T07:12:14.998244+0000","last_peered":"2024-09-21T07:12:14.998244+0000","last_clean":"2024-09-21T07:12:14.998244+0000","last_became_active":"2024-09-21T07:10:53.495078+0000","last_became_peered":"2024-09-21T07:10:53.495078+0000","last_unstale":"2024-09-21T07:12:14.998244+0000","last_undegraded":"2024-09-21T07:12:14.998244+0000","last_fullsized":"2024-09-21T07:12:14.998244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:32.415350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686211+0000","last_change":"2024-09-21T07:10:53.478381+0000","last_active":"2024-09-21T07:12:14.686211+0000","last_peered":"2024-09-21T07:12:14.686211+0000","last_clean":"2024-09-21T07:12:14.686211+0000","last_became_active":"2024-09-21T07:10:53.478021+0000","last_became_peered":"2024-09-21T07:10:53.478021+0000","last_unstale":"2024-09-21T07:12:14.686211+0000","last_undegraded":"2024-09-21T07:12:14.686211+0000","last_fullsized":"2024-09-21T07:12:14.686211+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:02.496263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806589+0000","last_change":"2024-09-21T07:10:53.485103+0000","last_active":"2024-09-21T07:12:14.806589+0000","last_peered":"2024-09-21T07:12:14.806589+0000","last_clean":"2024-09-21T07:12:14.806589+0000","last_became_active":"2024-09-21T07:10:53.483835+0000","last_became_peered":"2024-09-21T07:10:53.483835+0000","last_unstale":"2024-09-21T07:12:14.806589+0000","last_undegraded":"2024-09-21T07:12:14.806589+0000","last_fullsized":"2024-09-21T07:12:14.806589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:47.775202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689979+0000","last_change":"2024-09-21T07:10:53.490497+0000","last_active":"2024-09-21T07:12:14.689979+0000","last_peered":"2024-09-21T07:12:14.689979+0000","last_clean":"2024-09-21T07:12:14.689979+0000","last_became_active":"2024-09-21T07:10:53.490137+0000","last_became_peered":"2024-09-21T07:10:53.490137+0000","last_unstale":"2024-09-21T07:12:14.689979+0000","last_undegraded":"2024-09-21T07:12:14.689979+0000","last_fullsized":"2024-09-21T07:12:14.689979+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:12.090628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687793+0000","last_change":"2024-09-21T07:10:53.487118+0000","last_active":"2024-09-21T07:12:14.687793+0000","last_peered":"2024-09-21T07:12:14.687793+0000","last_clean":"2024-09-21T07:12:14.687793+0000","last_became_active":"2024-09-21T07:10:53.486582+0000","last_became_peered":"2024-09-21T07:10:53.486582+0000","last_unstale":"2024-09-21T07:12:14.687793+0000","last_undegraded":"2024-09-21T07:12:14.687793+0000","last_fullsized":"2024-09-21T07:12:14.687793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:00.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693003+0000","last_change":"2024-09-21T07:10:53.497390+0000","last_active":"2024-09-21T07:12:14.693003+0000","last_peered":"2024-09-21T07:12:14.693003+0000","last_clean":"2024-09-21T07:12:14.693003+0000","last_became_active":"2024-09-21T07:10:53.497043+0000","last_became_peered":"2024-09-21T07:10:53.497043+0000","last_unstale":"2024-09-21T07:12:14.693003+0000","last_undegraded":"2024-09-21T07:12:14.693003+0000","last_fullsized":"2024-09-21T07:12:14.693003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:36.912873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691285+0000","last_change":"2024-09-21T07:10:53.484624+0000","last_active":"2024-09-21T07:12:14.691285+0000","last_peered":"2024-09-21T07:12:14.691285+0000","last_clean":"2024-09-21T07:12:14.691285+0000","last_became_active":"2024-09-21T07:10:53.484278+0000","last_became_peered":"2024-09-21T07:10:53.484278+0000","last_unstale":"2024-09-21T07:12:14.691285+0000","last_undegraded":"2024-09-21T07:12:14.691285+0000","last_fullsized":"2024-09-21T07:12:14.691285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:41.464442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689591+0000","last_change":"2024-09-21T07:10:53.478146+0000","last_active":"2024-09-21T07:12:14.689591+0000","last_peered":"2024-09-21T07:12:14.689591+0000","last_clean":"2024-09-21T07:12:14.689591+0000","last_became_active":"2024-09-21T07:10:53.477733+0000","last_became_peered":"2024-09-21T07:10:53.477733+0000","last_unstale":"2024-09-21T07:12:14.689591+0000","last_undegraded":"2024-09-21T07:12:14.689591+0000","last_fullsized":"2024-09-21T07:12:14.689591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:09.159966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687171+0000","last_change":"2024-09-21T07:11:14.657274+0000","last_active":"2024-09-21T07:12:14.687171+0000","last_peered":"2024-09-21T07:12:14.687171+0000","last_clean":"2024-09-21T07:12:14.687171+0000","last_became_active":"2024-09-21T07:11:14.656826+0000","last_became_peered":"2024-09-21T07:11:14.656826+0000","last_unstale":"2024-09-21T07:12:14.687171+0000","last_undegraded":"2024-09-21T07:12:14.687171+0000","last_fullsized":"2024-09-21T07:12:14.687171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.688373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692338+0000","last_change":"2024-09-21T07:10:53.481411+0000","last_active":"2024-09-21T07:12:14.692338+0000","last_peered":"2024-09-21T07:12:14.692338+0000","last_clean":"2024-09-21T07:12:14.692338+0000","last_became_active":"2024-09-21T07:10:53.481005+0000","last_became_peered":"2024-09-21T07:10:53.481005+0000","last_unstale":"2024-09-21T07:12:14.692338+0000","last_undegraded":"2024-09-21T07:12:14.692338+0000","last_fullsized":"2024-09-21T07:12:14.692338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:41.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806458+0000","last_change":"2024-09-21T07:10:53.487481+0000","last_active":"2024-09-21T07:12:14.806458+0000","last_peered":"2024-09-21T07:12:14.806458+0000","last_clean":"2024-09-21T07:12:14.806458+0000","last_became_active":"2024-09-21T07:10:53.486277+0000","last_became_peered":"2024-09-21T07:10:53.486277+0000","last_unstale":"2024-09-21T07:12:14.806458+0000","last_undegraded":"2024-09-21T07:12:14.806458+0000","last_fullsized":"2024-09-21T07:12:14.806458+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:57.304382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998384+0000","last_change":"2024-09-21T07:10:53.495971+0000","last_active":"2024-09-21T07:12:14.998384+0000","last_peered":"2024-09-21T07:12:14.998384+0000","last_clean":"2024-09-21T07:12:14.998384+0000","last_became_active":"2024-09-21T07:10:53.495124+0000","last_became_peered":"2024-09-21T07:10:53.495124+0000","last_unstale":"2024-09-21T07:12:14.998384+0000","last_undegraded":"2024-09-21T07:12:14.998384+0000","last_fullsized":"2024-09-21T07:12:14.998384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998428+0000","last_change":"2024-09-21T07:10:53.497538+0000","last_active":"2024-09-21T07:12:14.998428+0000","last_peered":"2024-09-21T07:12:14.998428+0000","last_clean":"2024-09-21T07:12:14.998428+0000","last_became_active":"2024-09-21T07:10:53.496835+0000","last_became_peered":"2024-09-21T07:10:53.496835+0000","last_unstale":"2024-09-21T07:12:14.998428+0000","last_undegraded":"2024-09-21T07:12:14.998428+0000","last_fullsized":"2024-09-21T07:12:14.998428+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:17.187282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689764+0000","last_change":"2024-09-21T07:10:53.492646+0000","last_active":"2024-09-21T07:12:14.689764+0000","last_peered":"2024-09-21T07:12:14.689764+0000","last_clean":"2024-09-21T07:12:14.689764+0000","last_became_active":"2024-09-21T07:10:53.491818+0000","last_became_peered":"2024-09-21T07:10:53.491818+0000","last_unstale":"2024-09-21T07:12:14.689764+0000","last_undegraded":"2024-09-21T07:12:14.689764+0000","last_fullsized":"2024-09-21T07:12:14.689764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:37.094158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73416,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":581,"num_read_kb":371,"num_write":248,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":68,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":220248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283164,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710752,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":506254,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906982,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1118208,"data_stored":1163701,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070507,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":506116,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":506494,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":1103382,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626488,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":501620,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1040384,"data_stored":1098573,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":506085,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":970752,"data_stored":501328,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378702,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":569405,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542226,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":568862,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":983040,"data_stored":503076,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:12:32.008 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:12:32.008 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T07:12:32.008 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T07:12:32.009 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T07:12:32.292 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.730+0000 7f16998ac640 1 -- 172.21.15.92:0/1525635274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1694108cf0 msgr2=0x7f169410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.730+0000 7f16998ac640 1 --2- 172.21.15.92:0/1525635274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1694108cf0 0x7f169410f520 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f168c009900 tx=0x7f168c02a410 comp rx=0 tx=0).stop 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.730+0000 7f16998ac640 1 -- 172.21.15.92:0/1525635274 shutdown_connections 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.730+0000 7f16998ac640 1 --2- 172.21.15.92:0/1525635274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1694108cf0 0x7f169410f520 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.730+0000 7f16998ac640 1 --2- 172.21.15.92:0/1525635274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16941083a0 0x7f16941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.730+0000 7f16998ac640 1 --2- 172.21.15.92:0/1525635274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1694102a60 0x7f1694102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.730+0000 7f16998ac640 1 -- 172.21.15.92:0/1525635274 >> 172.21.15.92:0/1525635274 conn(0x7f1694079730 msgr2=0x7f1694079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.730+0000 7f16998ac640 1 -- 172.21.15.92:0/1525635274 shutdown_connections 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.730+0000 7f16998ac640 1 -- 172.21.15.92:0/1525635274 wait complete. 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f16998ac640 1 Processor -- start 2024-09-21T07:12:32.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f16998ac640 1 -- start start 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f16998ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1694102a60 0x7f169419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f16998ac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16941083a0 0x7f169419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f16998ac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1694108cf0 0x7f169419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f16998ac640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1694112810 con 0x7f1694102a60 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f16998ac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1694112690 con 0x7f1694108cf0 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f16998ac640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1694112990 con 0x7f16941083a0 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f1692ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1694102a60 0x7f169419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f1692ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1694102a60 0x7f169419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39928/0 (socket says 172.21.15.92:39928) 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.731+0000 7f1692ffd640 1 -- 172.21.15.92:0/968985972 learned_addr learned my addr 172.21.15.92:0/968985972 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f16927fc640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16941083a0 0x7f169419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f1692ffd640 1 -- 172.21.15.92:0/968985972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16941083a0 msgr2=0x7f169419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f16937fe640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1694108cf0 0x7f169419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:32.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f1692ffd640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16941083a0 0x7f169419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f1692ffd640 1 -- 172.21.15.92:0/968985972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1694108cf0 msgr2=0x7f169419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f1692ffd640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1694108cf0 0x7f169419fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f1692ffd640 1 -- 172.21.15.92:0/968985972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16941a0340 con 0x7f1694102a60 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f16927fc640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16941083a0 0x7f169419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f1692ffd640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1694102a60 0x7f169419a3d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f168800e9f0 tx=0x7f168800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f16988aa640 1 -- 172.21.15.92:0/968985972 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168800cd80 con 0x7f1694102a60 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f16988aa640 1 -- 172.21.15.92:0/968985972 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16880054b0 con 0x7f1694102a60 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f16998ac640 1 -- 172.21.15.92:0/968985972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16941a0630 con 0x7f1694102a60 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f16988aa640 1 -- 172.21.15.92:0/968985972 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688010430 con 0x7f1694102a60 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.732+0000 7f16998ac640 1 -- 172.21.15.92:0/968985972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16941a6d90 con 0x7f1694102a60 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.733+0000 7f16998ac640 1 -- 172.21.15.92:0/968985972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1694102e70 con 0x7f1694102a60 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.735+0000 7f16988aa640 1 -- 172.21.15.92:0/968985972 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f16880046c0 con 0x7f1694102a60 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.735+0000 7f16988aa640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f167c0b65f0 0x7f167c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:32.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.735+0000 7f16927fc640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f167c0b65f0 0x7f167c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:32.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.735+0000 7f16988aa640 1 -- 172.21.15.92:0/968985972 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f16880e8060 con 0x7f1694102a60 2024-09-21T07:12:32.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.736+0000 7f16927fc640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f167c0b65f0 0x7f167c0b8b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1694079b80 tx=0x7f16840093c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:32.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.738+0000 7f16988aa640 1 -- 172.21.15.92:0/968985972 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1688056710 con 0x7f1694102a60 2024-09-21T07:12:32.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.954+0000 7f16998ac640 1 -- 172.21.15.92:0/968985972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f169419b500 con 0x7f1694102a60 2024-09-21T07:12:32.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:32 smithi092 ceph-mon[30987]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:12:32.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:32 smithi092 ceph-mon[30987]: pgmap v323: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T07:12:32.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.954+0000 7f16988aa640 1 -- 172.21.15.92:0/968985972 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f16880ae2d0 con 0x7f1694102a60 2024-09-21T07:12:32.956 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:32.957 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:12:32.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 -- 172.21.15.92:0/968985972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f167c0b65f0 msgr2=0x7f167c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:32.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f167c0b65f0 0x7f167c0b8b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1694079b80 tx=0x7f16840093c0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 -- 172.21.15.92:0/968985972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1694102a60 msgr2=0x7f169419a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:32.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1694102a60 0x7f169419a3d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f168800e9f0 tx=0x7f168800edf0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 -- 172.21.15.92:0/968985972 shutdown_connections 2024-09-21T07:12:32.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f167c0b65f0 0x7f167c0b8b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1694108cf0 0x7f169419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16941083a0 0x7f169419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 --2- 172.21.15.92:0/968985972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1694102a60 0x7f169419a3d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:32.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 -- 172.21.15.92:0/968985972 >> 172.21.15.92:0/968985972 conn(0x7f1694079730 msgr2=0x7f169406b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:32.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 -- 172.21.15.92:0/968985972 shutdown_connections 2024-09-21T07:12:32.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:32.956+0000 7f16998ac640 1 -- 172.21.15.92:0/968985972 wait complete. 2024-09-21T07:12:33.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:32 smithi175 ceph-mon[34064]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:12:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:32 smithi175 ceph-mon[34064]: pgmap v323: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T07:12:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:32 smithi169 ceph-mon[33705]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:12:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:32 smithi169 ceph-mon[33705]: pgmap v323: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T07:12:33.570 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T07:12:33.570 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:12:33.830 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:33.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:33 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/968985972' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:12:34.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:33 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/968985972' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:12:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:33 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/968985972' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:12:34.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.302+0000 7f0e020fc640 1 -- 172.21.15.92:0/3194345186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dfc10de10 msgr2=0x7f0dfc110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.302+0000 7f0e020fc640 1 --2- 172.21.15.92:0/3194345186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dfc10de10 0x7f0dfc110300 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009ca0 tx=0x7f0df402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.302+0000 7f0e020fc640 1 -- 172.21.15.92:0/3194345186 shutdown_connections 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.302+0000 7f0e020fc640 1 --2- 172.21.15.92:0/3194345186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dfc10de10 0x7f0dfc110300 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.302+0000 7f0e020fc640 1 --2- 172.21.15.92:0/3194345186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dfc105300 0x7f0dfc10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.302+0000 7f0e020fc640 1 --2- 172.21.15.92:0/3194345186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dfc1049b0 0x7f0dfc104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.302+0000 7f0e020fc640 1 -- 172.21.15.92:0/3194345186 >> 172.21.15.92:0/3194345186 conn(0x7f0dfc079730 msgr2=0x7f0dfc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.302+0000 7f0e020fc640 1 -- 172.21.15.92:0/3194345186 shutdown_connections 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.302+0000 7f0e020fc640 1 -- 172.21.15.92:0/3194345186 wait complete. 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.303+0000 7f0e020fc640 1 Processor -- start 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.303+0000 7f0e020fc640 1 -- start start 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0e020fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dfc1049b0 0x7f0dfc19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0e020fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dfc105300 0x7f0dfc19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0e020fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dfc10de10 0x7f0dfc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:34.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0e020fc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc113a10 con 0x7f0dfc1049b0 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0e020fc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc113890 con 0x7f0dfc105300 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0e020fc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc113b90 con 0x7f0dfc10de10 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dfc1049b0 0x7f0dfc19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dfc1049b0 0x7f0dfc19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39948/0 (socket says 172.21.15.92:39948) 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfb7fe640 1 -- 172.21.15.92:0/3107971605 learned_addr learned my addr 172.21.15.92:0/3107971605 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfaffd640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dfc105300 0x7f0dfc19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfbfff640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dfc10de10 0x7f0dfc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfb7fe640 1 -- 172.21.15.92:0/3107971605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dfc10de10 msgr2=0x7f0dfc19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfb7fe640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dfc10de10 0x7f0dfc19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfb7fe640 1 -- 172.21.15.92:0/3107971605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dfc105300 msgr2=0x7f0dfc19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfb7fe640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dfc105300 0x7f0dfc19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfb7fe640 1 -- 172.21.15.92:0/3107971605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dfc1a0430 con 0x7f0dfc1049b0 2024-09-21T07:12:34.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.304+0000 7f0dfbfff640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dfc10de10 0x7f0dfc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:34.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.305+0000 7f0dfb7fe640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dfc1049b0 0x7f0dfc19a4c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00b450 tx=0x7f0dec00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:34.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.305+0000 7f0df8ff9640 1 -- 172.21.15.92:0/3107971605 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec015020 con 0x7f0dfc1049b0 2024-09-21T07:12:34.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.305+0000 7f0df8ff9640 1 -- 172.21.15.92:0/3107971605 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0dec011d20 con 0x7f0dfc1049b0 2024-09-21T07:12:34.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.305+0000 7f0e020fc640 1 -- 172.21.15.92:0/3107971605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dfc1a0720 con 0x7f0dfc1049b0 2024-09-21T07:12:34.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.305+0000 7f0df8ff9640 1 -- 172.21.15.92:0/3107971605 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec010e10 con 0x7f0dfc1049b0 2024-09-21T07:12:34.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.305+0000 7f0e020fc640 1 -- 172.21.15.92:0/3107971605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dfc1a6e80 con 0x7f0dfc1049b0 2024-09-21T07:12:34.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.306+0000 7f0e020fc640 1 -- 172.21.15.92:0/3107971605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dfc104dc0 con 0x7f0dfc1049b0 2024-09-21T07:12:34.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.307+0000 7f0df8ff9640 1 -- 172.21.15.92:0/3107971605 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f0dec018020 con 0x7f0dfc1049b0 2024-09-21T07:12:34.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.308+0000 7f0df8ff9640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0de80b6670 0x7f0de80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:34.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.309+0000 7f0dfaffd640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0de80b6670 0x7f0de80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:34.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.309+0000 7f0df8ff9640 1 -- 172.21.15.92:0/3107971605 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0dec0e7350 con 0x7f0dfc1049b0 2024-09-21T07:12:34.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.309+0000 7f0dfaffd640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0de80b6670 0x7f0de80b8b80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc10fbf0 tx=0x7f0de400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:34.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.313+0000 7f0df8ff9640 1 -- 172.21.15.92:0/3107971605 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0dec01f020 con 0x7f0dfc1049b0 2024-09-21T07:12:34.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.554+0000 7f0e020fc640 1 -- 172.21.15.92:0/3107971605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dfc1a70b0 con 0x7f0dfc1049b0 2024-09-21T07:12:34.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.555+0000 7f0df8ff9640 1 -- 172.21.15.92:0/3107971605 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7f0dec00d040 con 0x7f0dfc1049b0 2024-09-21T07:12:34.557 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:34.558 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":28,"btime":"2024-09-21T07:11:33:733807+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:11:33.733792+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24649,24625,24608,24583,24566]},"id":1}]} 2024-09-21T07:12:34.558 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 28 2024-09-21T07:12:34.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.557+0000 7f0e020fc640 1 -- 172.21.15.92:0/3107971605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0de80b6670 msgr2=0x7f0de80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:34.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.557+0000 7f0e020fc640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0de80b6670 0x7f0de80b8b80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc10fbf0 tx=0x7f0de400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.557+0000 7f0e020fc640 1 -- 172.21.15.92:0/3107971605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dfc1049b0 msgr2=0x7f0dfc19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:34.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.558+0000 7f0e020fc640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dfc1049b0 0x7f0dfc19a4c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00b450 tx=0x7f0dec00b910 comp rx=0 tx=0).stop 2024-09-21T07:12:34.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.558+0000 7f0e020fc640 1 -- 172.21.15.92:0/3107971605 shutdown_connections 2024-09-21T07:12:34.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.558+0000 7f0e020fc640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0de80b6670 0x7f0de80b8b80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.558+0000 7f0e020fc640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dfc10de10 0x7f0dfc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.558+0000 7f0e020fc640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dfc105300 0x7f0dfc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.558+0000 7f0e020fc640 1 --2- 172.21.15.92:0/3107971605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dfc1049b0 0x7f0dfc19a4c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:34.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.558+0000 7f0e020fc640 1 -- 172.21.15.92:0/3107971605 >> 172.21.15.92:0/3107971605 conn(0x7f0dfc079730 msgr2=0x7f0dfc0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:34.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.558+0000 7f0e020fc640 1 -- 172.21.15.92:0/3107971605 shutdown_connections 2024-09-21T07:12:34.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:34.558+0000 7f0e020fc640 1 -- 172.21.15.92:0/3107971605 wait complete. 2024-09-21T07:12:34.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:34 smithi092 ceph-mon[30987]: pgmap v324: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:12:34.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:34 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3107971605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:12:35.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:34 smithi175 ceph-mon[34064]: pgmap v324: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:12:35.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:34 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3107971605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:12:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:34 smithi169 ceph-mon[33705]: pgmap v324: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:12:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:34 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3107971605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:12:35.243 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:12:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:36.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.982+0000 7f097d14b640 1 -- 172.21.15.92:0/2385286208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0978109df0 msgr2=0x7f0978110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:36.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.982+0000 7f097d14b640 1 --2- 172.21.15.92:0/2385286208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0978109df0 0x7f0978110620 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0970009ca0 tx=0x7f097002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:36.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.982+0000 7f097d14b640 1 -- 172.21.15.92:0/2385286208 shutdown_connections 2024-09-21T07:12:36.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.982+0000 7f097d14b640 1 --2- 172.21.15.92:0/2385286208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0978109df0 0x7f0978110620 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:36.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.982+0000 7f097d14b640 1 --2- 172.21.15.92:0/2385286208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09781094a0 0x7f09781098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:36.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.982+0000 7f097d14b640 1 --2- 172.21.15.92:0/2385286208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0978103b60 0x7f0978103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:36.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.982+0000 7f097d14b640 1 -- 172.21.15.92:0/2385286208 >> 172.21.15.92:0/2385286208 conn(0x7f097807b850 msgr2=0x7f097807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:36.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.982+0000 7f097d14b640 1 -- 172.21.15.92:0/2385286208 shutdown_connections 2024-09-21T07:12:36.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.982+0000 7f097d14b640 1 -- 172.21.15.92:0/2385286208 wait complete. 2024-09-21T07:12:36.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.982+0000 7f097d14b640 1 Processor -- start 2024-09-21T07:12:36.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097d14b640 1 -- start start 2024-09-21T07:12:36.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097d14b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0978103b60 0x7f097819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:36.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097d14b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781094a0 0x7f097819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:36.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097d14b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0978109df0 0x7f097819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:36.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097d14b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f09781139b0 con 0x7f09781094a0 2024-09-21T07:12:36.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097d14b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0978113830 con 0x7f0978103b60 2024-09-21T07:12:36.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097d14b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0978113b30 con 0x7f0978109df0 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781094a0 0x7f097819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781094a0 0x7f097819aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39964/0 (socket says 172.21.15.92:39964) 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097659c640 1 -- 172.21.15.92:0/407113744 learned_addr learned my addr 172.21.15.92:0/407113744 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f0976d9d640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0978103b60 0x7f097819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097759e640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0978109df0 0x7f097819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097659c640 1 -- 172.21.15.92:0/407113744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0978109df0 msgr2=0x7f097819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097659c640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0978109df0 0x7f097819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097659c640 1 -- 172.21.15.92:0/407113744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0978103b60 msgr2=0x7f097819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097659c640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0978103b60 0x7f097819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097659c640 1 -- 172.21.15.92:0/407113744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09781a0370 con 0x7f09781094a0 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.983+0000 7f097759e640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0978109df0 0x7f097819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.984+0000 7f097659c640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781094a0 0x7f097819aa60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f096000c8c0 tx=0x7f096000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:36.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.984+0000 7f096ffff640 1 -- 172.21.15.92:0/407113744 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960007bb0 con 0x7f09781094a0 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.984+0000 7f096ffff640 1 -- 172.21.15.92:0/407113744 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0960007d50 con 0x7f09781094a0 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.984+0000 7f097d14b640 1 -- 172.21.15.92:0/407113744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09781a0660 con 0x7f09781094a0 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.984+0000 7f096ffff640 1 -- 172.21.15.92:0/407113744 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600186a0 con 0x7f09781094a0 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.984+0000 7f097d14b640 1 -- 172.21.15.92:0/407113744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09781a6e80 con 0x7f09781094a0 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.985+0000 7f097d14b640 1 -- 172.21.15.92:0/407113744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0978103f70 con 0x7f09781094a0 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.987+0000 7f096ffff640 1 -- 172.21.15.92:0/407113744 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f096000fa00 con 0x7f09781094a0 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.987+0000 7f096ffff640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09640b6620 0x7f09640b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.987+0000 7f0976d9d640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09640b6620 0x7f09640b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.987+0000 7f096ffff640 1 -- 172.21.15.92:0/407113744 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f09600e7cc0 con 0x7f09781094a0 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.988+0000 7f0976d9d640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09640b6620 0x7f09640b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0968005fd0 tx=0x7f0968005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:36.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:35.990+0000 7f096ffff640 1 -- 172.21.15.92:0/407113744 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0960014030 con 0x7f09781094a0 2024-09-21T07:12:36.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.206+0000 7f097d14b640 1 -- 172.21.15.92:0/407113744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f097819b5f0 con 0x7f09781094a0 2024-09-21T07:12:36.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.207+0000 7f096ffff640 1 -- 172.21.15.92:0/407113744 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7f09600adfc0 con 0x7f09781094a0 2024-09-21T07:12:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:36.209 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":28,"btime":"2024-09-21T07:11:33:733807+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:11:33.733792+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24649,24625,24608,24583,24566]},"id":1}]} 2024-09-21T07:12:36.209 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 28 2024-09-21T07:12:36.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.209+0000 7f097d14b640 1 -- 172.21.15.92:0/407113744 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09640b6620 msgr2=0x7f09640b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:36.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.209+0000 7f097d14b640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09640b6620 0x7f09640b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0968005fd0 tx=0x7f0968005850 comp rx=0 tx=0).stop 2024-09-21T07:12:36.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.209+0000 7f097d14b640 1 -- 172.21.15.92:0/407113744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781094a0 msgr2=0x7f097819aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:36.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.209+0000 7f097d14b640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781094a0 0x7f097819aa60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f096000c8c0 tx=0x7f096000cd80 comp rx=0 tx=0).stop 2024-09-21T07:12:36.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.209+0000 7f097d14b640 1 -- 172.21.15.92:0/407113744 shutdown_connections 2024-09-21T07:12:36.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.209+0000 7f097d14b640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f09640b6620 0x7f09640b8b30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:36.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.209+0000 7f097d14b640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0978109df0 0x7f097819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:36.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.209+0000 7f097d14b640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09781094a0 0x7f097819aa60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:36.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.209+0000 7f097d14b640 1 --2- 172.21.15.92:0/407113744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0978103b60 0x7f097819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:36.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.209+0000 7f097d14b640 1 -- 172.21.15.92:0/407113744 >> 172.21.15.92:0/407113744 conn(0x7f097807b850 msgr2=0x7f0978105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:36.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.210+0000 7f097d14b640 1 -- 172.21.15.92:0/407113744 shutdown_connections 2024-09-21T07:12:36.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:36.210+0000 7f097d14b640 1 -- 172.21.15.92:0/407113744 wait complete. 2024-09-21T07:12:37.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:36 smithi175 ceph-mon[34064]: pgmap v325: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:12:37.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:36 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/407113744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:12:37.100 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:36 smithi092 ceph-mon[30987]: pgmap v325: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:12:37.101 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:36 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/407113744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:12:37.129 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:12:37.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:36 smithi169 ceph-mon[33705]: pgmap v325: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:12:37.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:36 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/407113744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:12:37.375 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:37.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.875+0000 7f88a337f640 1 -- 172.21.15.92:0/3794015861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f889c106c10 msgr2=0x7f889c110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:37.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.875+0000 7f88a337f640 1 --2- 172.21.15.92:0/3794015861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f889c106c10 0x7f889c110650 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8894009ca0 tx=0x7f889402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.875+0000 7f88a337f640 1 -- 172.21.15.92:0/3794015861 shutdown_connections 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.875+0000 7f88a337f640 1 --2- 172.21.15.92:0/3794015861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f889c106c10 0x7f889c110650 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.875+0000 7f88a337f640 1 --2- 172.21.15.92:0/3794015861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f889c1062c0 0x7f889c1066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.875+0000 7f88a337f640 1 --2- 172.21.15.92:0/3794015861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c1020d0 0x7f889c1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.875+0000 7f88a337f640 1 -- 172.21.15.92:0/3794015861 >> 172.21.15.92:0/3794015861 conn(0x7f889c077cc0 msgr2=0x7f889c078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.875+0000 7f88a337f640 1 -- 172.21.15.92:0/3794015861 shutdown_connections 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.875+0000 7f88a337f640 1 -- 172.21.15.92:0/3794015861 wait complete. 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.876+0000 7f88a337f640 1 Processor -- start 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.876+0000 7f88a337f640 1 -- start start 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.876+0000 7f88a337f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f889c1020d0 0x7f889c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.876+0000 7f88a337f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c1062c0 0x7f889c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:37.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.876+0000 7f88a337f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f889c106c10 0x7f889c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.876+0000 7f88a337f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f889c1139e0 con 0x7f889c106c10 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.876+0000 7f88a337f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f889c113860 con 0x7f889c1020d0 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.876+0000 7f88a337f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f889c113b60 con 0x7f889c1062c0 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a191c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f889c106c10 0x7f889c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a191c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f889c106c10 0x7f889c19fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39990/0 (socket says 172.21.15.92:39990) 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a191c640 1 -- 172.21.15.92:0/783017444 learned_addr learned my addr 172.21.15.92:0/783017444 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a091a640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c1062c0 0x7f889c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a111b640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f889c1020d0 0x7f889c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a191c640 1 -- 172.21.15.92:0/783017444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c1062c0 msgr2=0x7f889c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a191c640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c1062c0 0x7f889c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a191c640 1 -- 172.21.15.92:0/783017444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f889c1020d0 msgr2=0x7f889c19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a191c640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f889c1020d0 0x7f889c19a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a191c640 1 -- 172.21.15.92:0/783017444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c1a01e0 con 0x7f889c106c10 2024-09-21T07:12:37.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a111b640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f889c1020d0 0x7f889c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a191c640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f889c106c10 0x7f889c19fb70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8894005cc0 tx=0x7f8894032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88927fc640 1 -- 172.21.15.92:0/783017444 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894032e00 con 0x7f889c106c10 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88927fc640 1 -- 172.21.15.92:0/783017444 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88940044d0 con 0x7f889c106c10 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a337f640 1 -- 172.21.15.92:0/783017444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c1a0470 con 0x7f889c106c10 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88927fc640 1 -- 172.21.15.92:0/783017444 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894030b70 con 0x7f889c106c10 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.877+0000 7f88a337f640 1 -- 172.21.15.92:0/783017444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c1a09b0 con 0x7f889c106c10 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.878+0000 7f88a337f640 1 -- 172.21.15.92:0/783017444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c1024e0 con 0x7f889c106c10 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.880+0000 7f88927fc640 1 -- 172.21.15.92:0/783017444 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f8894030d10 con 0x7f889c106c10 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.880+0000 7f88927fc640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88880b6620 0x7f88880b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.881+0000 7f88a111b640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88880b6620 0x7f88880b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.881+0000 7f88927fc640 1 -- 172.21.15.92:0/783017444 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f8894108e00 con 0x7f889c106c10 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.881+0000 7f88a111b640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88880b6620 0x7f88880b8b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f88980058c0 tx=0x7f8898005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:37.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:37.884+0000 7f88927fc640 1 -- 172.21.15.92:0/783017444 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88940cf070 con 0x7f889c106c10 2024-09-21T07:12:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.065+0000 7f88a337f640 1 -- 172.21.15.92:0/783017444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f889c1a6e90 con 0x7f889c106c10 2024-09-21T07:12:38.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.066+0000 7f88927fc640 1 -- 172.21.15.92:0/783017444 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+25265 (secure 0 0 0) 0x7f88940d3450 con 0x7f889c106c10 2024-09-21T07:12:38.069 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:38.069 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":86,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:12:14.675473+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:12:38.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 -- 172.21.15.92:0/783017444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88880b6620 msgr2=0x7f88880b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:38.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88880b6620 0x7f88880b8b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f88980058c0 tx=0x7f8898005850 comp rx=0 tx=0).stop 2024-09-21T07:12:38.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 -- 172.21.15.92:0/783017444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f889c106c10 msgr2=0x7f889c19fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:38.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f889c106c10 0x7f889c19fb70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8894005cc0 tx=0x7f8894032a10 comp rx=0 tx=0).stop 2024-09-21T07:12:38.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 -- 172.21.15.92:0/783017444 shutdown_connections 2024-09-21T07:12:38.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f88880b6620 0x7f88880b8b30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:38.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f889c106c10 0x7f889c19fb70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:38.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c1062c0 0x7f889c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:38.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 --2- 172.21.15.92:0/783017444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f889c1020d0 0x7f889c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:38.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 -- 172.21.15.92:0/783017444 >> 172.21.15.92:0/783017444 conn(0x7f889c077cc0 msgr2=0x7f889c109530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:38.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 -- 172.21.15.92:0/783017444 shutdown_connections 2024-09-21T07:12:38.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:38.070+0000 7f88a337f640 1 -- 172.21.15.92:0/783017444 wait complete. 2024-09-21T07:12:38.835 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:38 smithi092 ceph-mon[30987]: pgmap v326: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:12:38.836 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:38 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/783017444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:12:38.864 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:12:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:38 smithi175 ceph-mon[34064]: pgmap v326: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:12:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:38 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/783017444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:12:39.110 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:38 smithi169 ceph-mon[33705]: pgmap v326: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:12:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:38 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/783017444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:12:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 -- 172.21.15.92:0/3378071533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc970105330 msgr2=0x7fc97010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 --2- 172.21.15.92:0/3378071533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc970105330 0x7fc97010d970 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc960009900 tx=0x7fc96002a410 comp rx=0 tx=0).stop 2024-09-21T07:12:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 -- 172.21.15.92:0/3378071533 shutdown_connections 2024-09-21T07:12:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 --2- 172.21.15.92:0/3378071533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc97010deb0 0x7fc970110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 --2- 172.21.15.92:0/3378071533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc970105330 0x7fc97010d970 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 --2- 172.21.15.92:0/3378071533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970104900 0x7fc970104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 -- 172.21.15.92:0/3378071533 >> 172.21.15.92:0/3378071533 conn(0x7fc970079770 msgr2=0x7fc970079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 -- 172.21.15.92:0/3378071533 shutdown_connections 2024-09-21T07:12:39.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 -- 172.21.15.92:0/3378071533 wait complete. 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 Processor -- start 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.605+0000 7fc977d31640 1 -- start start 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc977d31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970104900 0x7fc97019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc977d31640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc970105330 0x7fc97019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc977d31640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc97010deb0 0x7fc97019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc977d31640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9701139a0 con 0x7fc97010deb0 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc977d31640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc970113820 con 0x7fc970105330 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc977d31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc970113b20 con 0x7fc970104900 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc9762ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc97010deb0 0x7fc97019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc9762ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc97010deb0 0x7fc97019fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40008/0 (socket says 172.21.15.92:40008) 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc9762ce640 1 -- 172.21.15.92:0/1195510349 learned_addr learned my addr 172.21.15.92:0/1195510349 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc975acd640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970104900 0x7fc97019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:39.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc9752cc640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc970105330 0x7fc97019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc9762ce640 1 -- 172.21.15.92:0/1195510349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970104900 msgr2=0x7fc97019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc9762ce640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970104900 0x7fc97019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc9762ce640 1 -- 172.21.15.92:0/1195510349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc970105330 msgr2=0x7fc97019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc9762ce640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc970105330 0x7fc97019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc9762ce640 1 -- 172.21.15.92:0/1195510349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9701a0360 con 0x7fc97010deb0 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc975acd640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970104900 0x7fc97019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc9762ce640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc97010deb0 0x7fc97019fc30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc96800eaa0 tx=0x7fc96800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.606+0000 7fc966ffd640 1 -- 172.21.15.92:0/1195510349 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96800cdb0 con 0x7fc97010deb0 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.607+0000 7fc966ffd640 1 -- 172.21.15.92:0/1195510349 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc968005020 con 0x7fc97010deb0 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.607+0000 7fc966ffd640 1 -- 172.21.15.92:0/1195510349 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9680116d0 con 0x7fc97010deb0 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.607+0000 7fc977d31640 1 -- 172.21.15.92:0/1195510349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9701a0650 con 0x7fc97010deb0 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.607+0000 7fc977d31640 1 -- 172.21.15.92:0/1195510349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9701a6db0 con 0x7fc97010deb0 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.608+0000 7fc977d31640 1 -- 172.21.15.92:0/1195510349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97006c1c0 con 0x7fc97010deb0 2024-09-21T07:12:39.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.609+0000 7fc966ffd640 1 -- 172.21.15.92:0/1195510349 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fc9680051d0 con 0x7fc97010deb0 2024-09-21T07:12:39.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.610+0000 7fc966ffd640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc95c0b6670 0x7fc95c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:39.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.610+0000 7fc975acd640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc95c0b6670 0x7fc95c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:39.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.610+0000 7fc966ffd640 1 -- 172.21.15.92:0/1195510349 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc9680e7f60 con 0x7fc97010deb0 2024-09-21T07:12:39.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.611+0000 7fc975acd640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc95c0b6670 0x7fc95c0b8b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc96c005d00 tx=0x7fc96c005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:39.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.613+0000 7fc966ffd640 1 -- 172.21.15.92:0/1195510349 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc968016030 con 0x7fc97010deb0 2024-09-21T07:12:39.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.826+0000 7fc977d31640 1 -- 172.21.15.92:0/1195510349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc970104d10 con 0x7fc97010deb0 2024-09-21T07:12:39.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.827+0000 7fc966ffd640 1 -- 172.21.15.92:0/1195510349 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7fc9680ae250 con 0x7fc97010deb0 2024-09-21T07:12:39.829 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:39.829 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":28,"btime":"2024-09-21T07:11:33:733807+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:11:33.733792+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24649,24625,24608,24583,24566]},"id":1}]} 2024-09-21T07:12:39.830 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 28 2024-09-21T07:12:39.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.829+0000 7fc977d31640 1 -- 172.21.15.92:0/1195510349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc95c0b6670 msgr2=0x7fc95c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:39.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.829+0000 7fc977d31640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc95c0b6670 0x7fc95c0b8b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc96c005d00 tx=0x7fc96c005c70 comp rx=0 tx=0).stop 2024-09-21T07:12:39.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.829+0000 7fc977d31640 1 -- 172.21.15.92:0/1195510349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc97010deb0 msgr2=0x7fc97019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:39.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.829+0000 7fc977d31640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc97010deb0 0x7fc97019fc30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc96800eaa0 tx=0x7fc96800ef60 comp rx=0 tx=0).stop 2024-09-21T07:12:39.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.830+0000 7fc977d31640 1 -- 172.21.15.92:0/1195510349 shutdown_connections 2024-09-21T07:12:39.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.830+0000 7fc977d31640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc95c0b6670 0x7fc95c0b8b80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:39.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.830+0000 7fc977d31640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc97010deb0 0x7fc97019fc30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:39.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.830+0000 7fc977d31640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc970105330 0x7fc97019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:39.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.830+0000 7fc977d31640 1 --2- 172.21.15.92:0/1195510349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc970104900 0x7fc97019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:39.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.830+0000 7fc977d31640 1 -- 172.21.15.92:0/1195510349 >> 172.21.15.92:0/1195510349 conn(0x7fc970079770 msgr2=0x7fc9700ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:39.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.830+0000 7fc977d31640 1 -- 172.21.15.92:0/1195510349 shutdown_connections 2024-09-21T07:12:39.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:39.830+0000 7fc977d31640 1 -- 172.21.15.92:0/1195510349 wait complete. 2024-09-21T07:12:40.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:40 smithi092 ceph-mon[30987]: pgmap v327: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:12:40.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:40 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1195510349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:12:40.643 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:10:54.236729+0000', 'modified': '2024-09-21T07:11:33.733792+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24649, 'mds_1': 24625, 'mds_2': 24608, 'mds_3': 24583, 'mds_4': 24566}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14841': {'gid': 14841, 'name': 'h', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6837/2116680832', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 2116680832}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 2116680832}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14859': {'gid': 14859, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6839/1835760933', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 1835760933}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 1835760933}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14871': {'gid': 14871, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6841/752270354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6840', 'nonce': 752270354}, {'type': 'v1', 'addr': '172.21.15.92:6841', 'nonce': 752270354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6833/3784592006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6832', 'nonce': 3784592006}, {'type': 'v1', 'addr': '172.21.15.169:6833', 'nonce': 3784592006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24548': {'gid': 24548, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/1770920559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 1770920559}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 1770920559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24566': {'gid': 24566, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.175:6837/1654191634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1654191634}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1654191634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24583': {'gid': 24583, 'name': 'l', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.175:6833/2860278829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 2860278829}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 2860278829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'b', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.169:6839/44894739', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 44894739}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 44894739}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'f', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.175:6835/2445062283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 2445062283}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 2445062283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.175:6839/3839014225', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3839014225}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3839014225}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24649, 'qdb_cluster': [24649, 24625, 24608, 24583, 24566]} 2024-09-21T07:12:40.643 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T07:12:40.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T07:12:40.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:40 smithi169 ceph-mon[33705]: pgmap v327: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:12:40.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:40 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1195510349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:12:40.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:40 smithi175 ceph-mon[34064]: pgmap v327: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:12:40.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:40 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1195510349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:12:40.895 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:41.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.373+0000 7f2b8249c640 1 -- 172.21.15.92:0/3159510984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c10de10 msgr2=0x7f2b7c110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:41.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.373+0000 7f2b8249c640 1 --2- 172.21.15.92:0/3159510984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c10de10 0x7f2b7c110300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009ca0 tx=0x7f2b7402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.373+0000 7f2b8249c640 1 -- 172.21.15.92:0/3159510984 shutdown_connections 2024-09-21T07:12:41.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.373+0000 7f2b8249c640 1 --2- 172.21.15.92:0/3159510984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c10de10 0x7f2b7c110300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.373+0000 7f2b8249c640 1 --2- 172.21.15.92:0/3159510984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c105300 0x7f2b7c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.373+0000 7f2b8249c640 1 --2- 172.21.15.92:0/3159510984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b7c1049b0 0x7f2b7c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.373+0000 7f2b8249c640 1 -- 172.21.15.92:0/3159510984 >> 172.21.15.92:0/3159510984 conn(0x7f2b7c079730 msgr2=0x7f2b7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:41.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.373+0000 7f2b8249c640 1 -- 172.21.15.92:0/3159510984 shutdown_connections 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.373+0000 7f2b8249c640 1 -- 172.21.15.92:0/3159510984 wait complete. 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.374+0000 7f2b8249c640 1 Processor -- start 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.374+0000 7f2b8249c640 1 -- start start 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b8249c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c1049b0 0x7f2b7c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b8249c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b7c105300 0x7f2b7c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b8249c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c10de10 0x7f2b7c19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b8249c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c113970 con 0x7f2b7c10de10 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b8249c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c1137f0 con 0x7f2b7c1049b0 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b8249c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c113af0 con 0x7f2b7c105300 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b80a39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c10de10 0x7f2b7c19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b80a39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c10de10 0x7f2b7c19fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50330/0 (socket says 172.21.15.92:50330) 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b80a39640 1 -- 172.21.15.92:0/3147334780 learned_addr learned my addr 172.21.15.92:0/3147334780 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b7bfff640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c1049b0 0x7f2b7c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b73fff640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b7c105300 0x7f2b7c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b7bfff640 1 -- 172.21.15.92:0/3147334780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b7c105300 msgr2=0x7f2b7c19a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b7bfff640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b7c105300 0x7f2b7c19a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b7bfff640 1 -- 172.21.15.92:0/3147334780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c10de10 msgr2=0x7f2b7c19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b7bfff640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c10de10 0x7f2b7c19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b7bfff640 1 -- 172.21.15.92:0/3147334780 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c1a02b0 con 0x7f2b7c1049b0 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b73fff640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b7c105300 0x7f2b7c19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.375+0000 7f2b80a39640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c10de10 0x7f2b7c19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.376+0000 7f2b7bfff640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c1049b0 0x7f2b7c19a340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c06bc60 tx=0x7f2b6c00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.376+0000 7f2b79ffb640 1 -- 172.21.15.92:0/3147334780 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c017070 con 0x7f2b7c1049b0 2024-09-21T07:12:41.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.376+0000 7f2b8249c640 1 -- 172.21.15.92:0/3147334780 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7c1a05a0 con 0x7f2b7c1049b0 2024-09-21T07:12:41.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.376+0000 7f2b79ffb640 1 -- 172.21.15.92:0/3147334780 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b6c009c30 con 0x7f2b7c1049b0 2024-09-21T07:12:41.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.376+0000 7f2b79ffb640 1 -- 172.21.15.92:0/3147334780 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00f3c0 con 0x7f2b7c1049b0 2024-09-21T07:12:41.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.376+0000 7f2b8249c640 1 -- 172.21.15.92:0/3147334780 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7c1a6d00 con 0x7f2b7c1049b0 2024-09-21T07:12:41.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.378+0000 7f2b88a10740 1 Processor -- start 2024-09-21T07:12:41.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.378+0000 7f2b88a10740 1 -- start start 2024-09-21T07:12:41.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b6f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b6f8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 0x56000b6f8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b88a10740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56000b66fc10 con 0x56000b351f60 2024-09-21T07:12:41.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b88a10740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56000b65f040 con 0x56000b3290a0 2024-09-21T07:12:41.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b88a10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56000b662e50 con 0x56000b331280 2024-09-21T07:12:41.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b80a39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b6f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b80a39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b6f7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50336/0 (socket says 172.21.15.92:50336) 2024-09-21T07:12:41.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b80a39640 1 -- 172.21.15.92:0/3014457750 learned_addr learned my addr 172.21.15.92:0/3014457750 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:41.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b79ffb640 1 -- 172.21.15.92:0/3147334780 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f2b6c01a070 con 0x7f2b7c1049b0 2024-09-21T07:12:41.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b73fff640 1 --2- 172.21.15.92:0/3014457750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 0x56000b6f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b80a39640 1 -- 172.21.15.92:0/3014457750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 msgr2=0x56000b6f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:41.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b80a39640 1 --2- 172.21.15.92:0/3014457750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 0x56000b6f8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b80a39640 1 -- 172.21.15.92:0/3014457750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 msgr2=0x56000b6f8440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:12:41.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b80a39640 1 --2- 172.21.15.92:0/3014457750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b6f8440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b80a39640 1 -- 172.21.15.92:0/3014457750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000b3bd540 con 0x56000b351f60 2024-09-21T07:12:41.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b73fff640 1 --2- 172.21.15.92:0/3014457750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 0x56000b6f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:41.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.379+0000 7f2b80a39640 1 --2- 172.21.15.92:0/3014457750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b6f7f00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2b74031530 tx=0x7f2b74009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15def2af68d389e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:41.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.380+0000 7f2b727fc640 1 -- 172.21.15.92:0/3014457750 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74031980 con 0x56000b351f60 2024-09-21T07:12:41.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.380+0000 7f2b727fc640 1 -- 172.21.15.92:0/3014457750 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b74036040 con 0x56000b351f60 2024-09-21T07:12:41.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.380+0000 7f2b727fc640 1 -- 172.21.15.92:0/3014457750 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74004510 con 0x56000b351f60 2024-09-21T07:12:41.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.380+0000 7f2b79ffb640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2b680b65f0 0x7f2b680b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.380+0000 7f2b7bfff640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2b680b65f0 0x7f2b680b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.380+0000 7f2b79ffb640 1 -- 172.21.15.92:0/3147334780 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2b6c0e73f0 con 0x7f2b7c1049b0 2024-09-21T07:12:41.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 -- 172.21.15.92:0/3014457750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 msgr2=0x56000b6f7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:41.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b7bfff640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2b680b65f0 0x7f2b680b8b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x56000b6f6b80 tx=0x7f2b6c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:41.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 --2- 172.21.15.92:0/3014457750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b6f7f00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2b74031530 tx=0x7f2b74009a20 comp rx=0 tx=0).stop 2024-09-21T07:12:41.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 -- 172.21.15.92:0/3014457750 shutdown_connections 2024-09-21T07:12:41.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 --2- 172.21.15.92:0/3014457750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 0x56000b6f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 --2- 172.21.15.92:0/3014457750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b6f8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 --2- 172.21.15.92:0/3014457750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b6f7f00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 -- 172.21.15.92:0/3014457750 >> 172.21.15.92:0/3014457750 conn(0x56000b346350 msgr2=0x56000b6f5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:41.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 -- 172.21.15.92:0/3014457750 shutdown_connections 2024-09-21T07:12:41.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 -- 172.21.15.92:0/3014457750 wait complete. 2024-09-21T07:12:41.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 -- start start 2024-09-21T07:12:41.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.381+0000 7f2b88a10740 1 Processor -- start 2024-09-21T07:12:41.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b7039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b703f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b351f60 0x56000b70f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b88a10740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56000b4c05f0 con 0x56000b331280 2024-09-21T07:12:41.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b88a10740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56000b5fa010 con 0x56000b3290a0 2024-09-21T07:12:41.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b88a10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56000b706680 con 0x56000b351f60 2024-09-21T07:12:41.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b88a10740 10 client.0 _ll_register_callbacks cb 0x56000b659340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:12:41.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b73fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b703f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b73fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b703f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50352/0 (socket says 172.21.15.92:50352) 2024-09-21T07:12:41.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b73fff640 1 -- 172.21.15.92:0/306720082 learned_addr learned my addr 172.21.15.92:0/306720082 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:41.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b80a39640 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b351f60 0x56000b70f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b80a39640 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b7039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b73fff640 1 -- 172.21.15.92:0/306720082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b351f60 msgr2=0x56000b70f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:41.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b73fff640 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b351f60 0x56000b70f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b73fff640 1 -- 172.21.15.92:0/306720082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 msgr2=0x56000b7039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:41.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b73fff640 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b7039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b73fff640 1 -- 172.21.15.92:0/306720082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000b627a00 con 0x56000b331280 2024-09-21T07:12:41.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b80a39640 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b351f60 0x56000b70f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:41.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b73fff640 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b703f10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2b64011690 tx=0x7f2b64011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f644d8976abff10a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:41.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.382+0000 7f2b5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:12:41.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/306720082 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64018070 con 0x56000b331280 2024-09-21T07:12:41.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b88a10740 1 -- 172.21.15.92:0/306720082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b74036040 con 0x56000b331280 2024-09-21T07:12:41.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/306720082 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2b6400fb40 con 0x56000b331280 2024-09-21T07:12:41.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/306720082 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b64027050 con 0x56000b331280 2024-09-21T07:12:41.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b88a10740 10 client.15333 fetch_fsmap learned FSMap version 28 2024-09-21T07:12:41.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b88a10740 1 -- 172.21.15.92:0/306720082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56000b712570 con 0x56000b331280 2024-09-21T07:12:41.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/306720082 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b74036040 con 0x56000b331280 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/306720082 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2b6401c400 con 0x56000b331280 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b88a10740 10 client.15333 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b88a10740 10 client.15333 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b88a10740 20 client.15333 populate_metadata read hostname 'smithi092' 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b88a10740 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56000b3108e0 0x56000b7164d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b88a10740 4 client.15333 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.383+0000 7f2b88a10740 1 -- 172.21.15.92:0/306720082 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56000b671b60 con 0x56000b3108e0 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.384+0000 7f2b80a39640 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56000b3108e0 0x56000b7164d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.384+0000 7f2b80a39640 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56000b3108e0 0x56000b7164d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6264160f2839ba81 server_cookie=a1c97ed8e02a2739 in_seq=0 out_seq=0 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.384+0000 7f2b5b7fe640 10 client.15333 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:12:41.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/306720082 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56000b671b60 con 0x56000b3108e0 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b5b7fe640 10 client.15333 handle_command_reply: tid=0 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 client.15333 shutdown 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 -- 172.21.15.92:0/306720082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 msgr2=0x56000b703f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b703f10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2b64011690 tx=0x7f2b64011b50 comp rx=0 tx=0).stop 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 -- 172.21.15.92:0/306720082 shutdown_connections 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56000b3108e0 0x56000b7164d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b351f60 0x56000b70f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b703f10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 --2- 172.21.15.92:0/306720082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b7039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 -- 172.21.15.92:0/306720082 >> 172.21.15.92:0/306720082 conn(0x56000b346350 msgr2=0x56000b6fb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b5b7fe640 0 client.15333 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 -- 172.21.15.92:0/306720082 shutdown_connections 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 1 -- 172.21.15.92:0/306720082 wait complete. 2024-09-21T07:12:41.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.385+0000 7f2b88a10740 20 client.15333 trim_cache size 0 max 16384 2024-09-21T07:12:41.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b88a10740 1 Processor -- start 2024-09-21T07:12:41.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b88a10740 1 -- start start 2024-09-21T07:12:41.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b3290a0 0x56000b702cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b7039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b351f60 0x56000b703ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b88a10740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56000b714810 con 0x56000b331280 2024-09-21T07:12:41.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b88a10740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56000b714ee0 con 0x56000b351f60 2024-09-21T07:12:41.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b88a10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56000b7155b0 con 0x56000b3290a0 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b73fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b7039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b73fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b7039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50358/0 (socket says 172.21.15.92:50358) 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.403+0000 7f2b73fff640 1 -- 172.21.15.92:0/3495441297 learned_addr learned my addr 172.21.15.92:0/3495441297 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b80a39640 1 --2- 172.21.15.92:0/3495441297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b3290a0 0x56000b702cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b73fff640 1 -- 172.21.15.92:0/3495441297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b3290a0 msgr2=0x56000b702cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b73fff640 1 --2- 172.21.15.92:0/3495441297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b3290a0 0x56000b702cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b73fff640 1 -- 172.21.15.92:0/3495441297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b351f60 msgr2=0x56000b703ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b73fff640 1 --2- 172.21.15.92:0/3495441297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b351f60 0x56000b703ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b73fff640 1 -- 172.21.15.92:0/3495441297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000b704870 con 0x56000b331280 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b80a39640 1 --2- 172.21.15.92:0/3495441297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b3290a0 0x56000b702cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b73fff640 1 --2- 172.21.15.92:0/3495441297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b7039b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400b620 tx=0x7f2b6400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8c5cae7e03dbbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:41.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b71ffb640 1 -- 172.21.15.92:0/3495441297 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64031030 con 0x56000b331280 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b71ffb640 1 -- 172.21.15.92:0/3495441297 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b6400fdd0 con 0x56000b331280 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.404+0000 7f2b71ffb640 1 -- 172.21.15.92:0/3495441297 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64018040 con 0x56000b331280 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 -- 172.21.15.92:0/3495441297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 msgr2=0x56000b7039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 --2- 172.21.15.92:0/3495441297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b7039b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400b620 tx=0x7f2b6400bdd0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 -- 172.21.15.92:0/3495441297 shutdown_connections 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 --2- 172.21.15.92:0/3495441297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b351f60 0x56000b703ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 --2- 172.21.15.92:0/3495441297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b331280 0x56000b7039b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 --2- 172.21.15.92:0/3495441297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b3290a0 0x56000b702cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 -- 172.21.15.92:0/3495441297 >> 172.21.15.92:0/3495441297 conn(0x56000b346350 msgr2=0x56000b6fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 -- 172.21.15.92:0/3495441297 shutdown_connections 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 -- 172.21.15.92:0/3495441297 wait complete. 2024-09-21T07:12:41.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 -- start start 2024-09-21T07:12:41.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.405+0000 7f2b88a10740 1 Processor -- start 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b704a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 0x56000b704fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b88a10740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b705510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b88a10740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56000b716350 con 0x56000b351f60 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b88a10740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56000b715c80 con 0x56000b3290a0 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b88a10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56000b716a20 con 0x56000b331280 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b88a10740 10 client.0 _ll_register_callbacks cb 0x7f2b6400ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b80a39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b705510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b80a39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b705510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50372/0 (socket says 172.21.15.92:50372) 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b80a39640 1 -- 172.21.15.92:0/786507225 learned_addr learned my addr 172.21.15.92:0/786507225 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b80a39640 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b704a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b73fff640 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 0x56000b704fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b80a39640 1 -- 172.21.15.92:0/786507225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 msgr2=0x56000b704fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:41.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b80a39640 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 0x56000b704fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b80a39640 1 -- 172.21.15.92:0/786507225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 msgr2=0x56000b704a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b80a39640 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b704a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b80a39640 1 -- 172.21.15.92:0/786507225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000b77f990 con 0x56000b351f60 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b80a39640 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b705510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2b7402ae80 tx=0x7f2b740093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b1aa3d397969ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.406+0000 7f2b5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/786507225 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7404a040 con 0x56000b351f60 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/786507225 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2b74004120 con 0x56000b351f60 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b88a10740 1 -- 172.21.15.92:0/786507225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b6400fdd0 con 0x56000b351f60 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/786507225 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b74004320 con 0x56000b351f60 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b88a10740 10 client.15339 fetch_fsmap learned FSMap version 28 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b88a10740 1 -- 172.21.15.92:0/786507225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56000b780a90 con 0x56000b351f60 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/786507225 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b6400fdd0 con 0x56000b351f60 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/786507225 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2b74030a10 con 0x56000b351f60 2024-09-21T07:12:41.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b88a10740 10 client.15339 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b88a10740 10 client.15339 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b88a10740 20 client.15339 populate_metadata read hostname 'smithi092' 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b88a10740 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56000b2e5c90 0x56000b783f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b88a10740 4 client.15339 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.407+0000 7f2b88a10740 1 -- 172.21.15.92:0/786507225 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "status"}) -- 0x56000b66d610 con 0x56000b2e5c90 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b73fff640 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56000b2e5c90 0x56000b783f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b5b7fe640 10 client.15339 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b73fff640 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56000b2e5c90 0x56000b783f00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2cd5218105c16393 server_cookie=9ee776966099b98b in_seq=0 out_seq=0 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b5b7fe640 1 -- 172.21.15.92:0/786507225 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56000b66d610 con 0x56000b2e5c90 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b5b7fe640 10 client.15339 handle_command_reply: tid=0 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b88a10740 1 client.15339 shutdown 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b88a10740 1 -- 172.21.15.92:0/786507225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 msgr2=0x56000b705510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b88a10740 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b705510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2b7402ae80 tx=0x7f2b740093f0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b88a10740 1 -- 172.21.15.92:0/786507225 shutdown_connections 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b88a10740 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56000b2e5c90 0x56000b783f00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b88a10740 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56000b351f60 0x56000b705510 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b5b7fe640 0 client.15339 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b88a10740 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000b331280 0x56000b704fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b88a10740 1 --2- 172.21.15.92:0/786507225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56000b3290a0 0x56000b704a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.408+0000 7f2b88a10740 1 -- 172.21.15.92:0/786507225 >> 172.21.15.92:0/786507225 conn(0x56000b346350 msgr2=0x56000b6fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b88a10740 1 -- 172.21.15.92:0/786507225 shutdown_connections 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b88a10740 1 -- 172.21.15.92:0/786507225 wait complete. 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b88a10740 20 client.15339 trim_cache size 0 max 16384 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:12:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 4, 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24566, 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 68.683794665999997, 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 28, 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 131.78854303400001 2024-09-21T07:12:41.417 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:12:41.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 -- 172.21.15.92:0/3147334780 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2b680b65f0 msgr2=0x7f2b680b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:41.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2b680b65f0 0x7f2b680b8b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x56000b6f6b80 tx=0x7f2b6c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 -- 172.21.15.92:0/3147334780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c1049b0 msgr2=0x7f2b7c19a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:41.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c1049b0 0x7f2b7c19a340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c06bc60 tx=0x7f2b6c00dde0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 -- 172.21.15.92:0/3147334780 shutdown_connections 2024-09-21T07:12:41.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2b680b65f0 0x7f2b680b8b00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7c10de10 0x7f2b7c19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b7c105300 0x7f2b7c19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 --2- 172.21.15.92:0/3147334780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c1049b0 0x7f2b7c19a340 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:41.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 -- 172.21.15.92:0/3147334780 >> 172.21.15.92:0/3147334780 conn(0x7f2b7c079730 msgr2=0x7f2b7c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:41.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 -- 172.21.15.92:0/3147334780 shutdown_connections 2024-09-21T07:12:41.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:41.409+0000 7f2b8249c640 1 -- 172.21.15.92:0/3147334780 wait complete. 2024-09-21T07:12:42.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.l status 2024-09-21T07:12:42.480 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:42 smithi092 ceph-mon[30987]: pgmap v328: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:12:42.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.957+0000 7f7fd8a22640 1 -- 172.21.15.92:0/607777963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4108cf0 msgr2=0x7f7fd410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:42.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.957+0000 7f7fd8a22640 1 --2- 172.21.15.92:0/607777963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4108cf0 0x7f7fd410f520 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009ca0 tx=0x7f7fcc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.957+0000 7f7fd8a22640 1 -- 172.21.15.92:0/607777963 shutdown_connections 2024-09-21T07:12:42.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.957+0000 7f7fd8a22640 1 --2- 172.21.15.92:0/607777963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4108cf0 0x7f7fd410f520 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.957+0000 7f7fd8a22640 1 --2- 172.21.15.92:0/607777963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd41083a0 0x7f7fd41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.957+0000 7f7fd8a22640 1 --2- 172.21.15.92:0/607777963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd4102a60 0x7f7fd4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.957+0000 7f7fd8a22640 1 -- 172.21.15.92:0/607777963 >> 172.21.15.92:0/607777963 conn(0x7f7fd4079760 msgr2=0x7f7fd4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:42.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.957+0000 7f7fd8a22640 1 -- 172.21.15.92:0/607777963 shutdown_connections 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.957+0000 7f7fd8a22640 1 -- 172.21.15.92:0/607777963 wait complete. 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.958+0000 7f7fd8a22640 1 Processor -- start 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.958+0000 7f7fd8a22640 1 -- start start 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd8a22640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4102a60 0x7f7fd419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd8a22640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd41083a0 0x7f7fd419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd8a22640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4108cf0 0x7f7fd419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd8a22640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd41128b0 con 0x7f7fd4102a60 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd8a22640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4112730 con 0x7f7fd4108cf0 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd8a22640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4112a30 con 0x7f7fd41083a0 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4102a60 0x7f7fd419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4102a60 0x7f7fd419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50382/0 (socket says 172.21.15.92:50382) 2024-09-21T07:12:42.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd259c640 1 -- 172.21.15.92:0/3970191065 learned_addr learned my addr 172.21.15.92:0/3970191065 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd41083a0 0x7f7fd419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4108cf0 0x7f7fd419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd259c640 1 -- 172.21.15.92:0/3970191065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd41083a0 msgr2=0x7f7fd419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd259c640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd41083a0 0x7f7fd419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd259c640 1 -- 172.21.15.92:0/3970191065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4108cf0 msgr2=0x7f7fd419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd259c640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4108cf0 0x7f7fd419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd259c640 1 -- 172.21.15.92:0/3970191065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd41a02e0 con 0x7f7fd4102a60 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fd259c640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4102a60 0x7f7fd419a370 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400d770 tx=0x7f7fc400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.959+0000 7f7fcbfff640 1 -- 172.21.15.92:0/3970191065 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4017070 con 0x7f7fd4102a60 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.960+0000 7f7fd8a22640 1 -- 172.21.15.92:0/3970191065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd41a05d0 con 0x7f7fd4102a60 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.960+0000 7f7fcbfff640 1 -- 172.21.15.92:0/3970191065 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fc40054b0 con 0x7f7fd4102a60 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.960+0000 7f7fcbfff640 1 -- 172.21.15.92:0/3970191065 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4004c60 con 0x7f7fd4102a60 2024-09-21T07:12:42.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.960+0000 7f7fd8a22640 1 -- 172.21.15.92:0/3970191065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd41a6d30 con 0x7f7fd4102a60 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.962+0000 7f7fdef96740 1 Processor -- start 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.962+0000 7f7fdef96740 1 -- start start 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2109f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d3b0a0 0x5625a210a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 0x5625a210a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fdef96740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5625a2081c10 con 0x5625a1d63f60 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fdef96740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5625a2071040 con 0x5625a1d43280 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fdef96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5625a2074e50 con 0x5625a1d3b0a0 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fcbfff640 1 -- 172.21.15.92:0/3970191065 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f7fc4010460 con 0x7f7fd4102a60 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fd2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fd2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2109f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50392/0 (socket says 172.21.15.92:50392) 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/2611889627 learned_addr learned my addr 172.21.15.92:0/2611889627 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fd259c640 1 --2- 172.21.15.92:0/2611889627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d3b0a0 0x5625a210a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/2611889627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 0x5625a210a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/2611889627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d3b0a0 msgr2=0x5625a210a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/2611889627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d3b0a0 0x5625a210a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/2611889627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 msgr2=0x5625a210a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/2611889627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 0x5625a210a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/2611889627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a1dcf540 con 0x5625a1d63f60 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/2611889627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 0x5625a210a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/2611889627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2109f00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009ca0 tx=0x7f7fcc031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2927fa1f5e2e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fc8d99640 1 -- 172.21.15.92:0/2611889627 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0317b0 con 0x5625a1d63f60 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7fc00b65f0 0x7f7fc00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fc8d99640 1 -- 172.21.15.92:0/2611889627 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fcc036030 con 0x5625a1d63f60 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.963+0000 7f7fc8d99640 1 -- 172.21.15.92:0/2611889627 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc004590 con 0x5625a1d63f60 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fd259c640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7fc00b65f0 0x7f7fc00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fcbfff640 1 -- 172.21.15.92:0/3970191065 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f7fc40e7400 con 0x7f7fd4102a60 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fdef96740 1 -- 172.21.15.92:0/2611889627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 msgr2=0x5625a2109f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fd259c640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7fc00b65f0 0x7f7fc00b8b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40acf50 tx=0x7f7fc40d0040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fdef96740 1 --2- 172.21.15.92:0/2611889627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2109f00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009ca0 tx=0x7f7fcc031500 comp rx=0 tx=0).stop 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fdef96740 1 -- 172.21.15.92:0/2611889627 shutdown_connections 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fdef96740 1 --2- 172.21.15.92:0/2611889627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 0x5625a210a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fdef96740 1 --2- 172.21.15.92:0/2611889627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d3b0a0 0x5625a210a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fdef96740 1 --2- 172.21.15.92:0/2611889627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2109f00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fdef96740 1 -- 172.21.15.92:0/2611889627 >> 172.21.15.92:0/2611889627 conn(0x5625a1d58350 msgr2=0x5625a2107df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.964+0000 7f7fdef96740 1 -- 172.21.15.92:0/2611889627 shutdown_connections 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fdef96740 1 -- 172.21.15.92:0/2611889627 wait complete. 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fdef96740 1 -- start start 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fdef96740 1 Processor -- start 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a21159f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 0x5625a2115f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d63f60 0x5625a2121820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fdef96740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5625a1ed25f0 con 0x5625a1d3b0a0 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fdef96740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5625a200c010 con 0x5625a1d63f60 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fdef96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5625a2118500 con 0x5625a1d43280 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fdef96740 10 client.0 _ll_register_callbacks cb 0x5625a206b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fd2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a21159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fd2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a21159f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50394/0 (socket says 172.21.15.92:50394) 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.965+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/1842461314 learned_addr learned my addr 172.21.15.92:0/1842461314 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 0x5625a2115f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/1842461314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 msgr2=0x5625a2115f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 0x5625a2115f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/1842461314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d63f60 msgr2=0x5625a2121820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:42.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d63f60 0x5625a2121820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/1842461314 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a2039a00 con 0x5625a1d3b0a0 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a21159f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc02ade0 tx=0x7f7fcc005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3318d518fa3a1bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/1842461314 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0047d0 con 0x5625a1d3b0a0 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/1842461314 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f7fcc003970 con 0x5625a1d3b0a0 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fdef96740 1 -- 172.21.15.92:0/1842461314 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fcc036030 con 0x5625a1d3b0a0 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/1842461314 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7fcc05e050 con 0x5625a1d3b0a0 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fdef96740 10 client.15351 fetch_fsmap learned FSMap version 28 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.966+0000 7f7fdef96740 1 -- 172.21.15.92:0/1842461314 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5625a21243c0 con 0x5625a1d3b0a0 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/1842461314 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fcc036030 con 0x5625a1d3b0a0 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/1842461314 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7fcc043070 con 0x5625a1d3b0a0 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fdef96740 10 client.15351 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:12:42.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fdef96740 10 client.15351 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fdef96740 20 client.15351 populate_metadata read hostname 'smithi092' 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fdef96740 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5625a1d228e0 0x5625a2127b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fdef96740 4 client.15351 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fdef96740 1 -- 172.21.15.92:0/1842461314 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625a2083b60 con 0x5625a1d228e0 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5625a1d228e0 0x5625a2127b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fb9ffb640 10 client.15351 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.967+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5625a1d228e0 0x5625a2127b30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d352ebed84b62468 server_cookie=20db817ed2b7cf11 in_seq=0 out_seq=0 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/1842461314 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5625a2083b60 con 0x5625a1d228e0 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fb9ffb640 10 client.15351 handle_command_reply: tid=0 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fdef96740 1 client.15351 shutdown 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fdef96740 1 -- 172.21.15.92:0/1842461314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 msgr2=0x5625a21159f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fdef96740 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a21159f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc02ade0 tx=0x7f7fcc005c30 comp rx=0 tx=0).stop 2024-09-21T07:12:42.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fdef96740 1 -- 172.21.15.92:0/1842461314 shutdown_connections 2024-09-21T07:12:42.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fdef96740 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d63f60 0x5625a2121820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fdef96740 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 0x5625a2115f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fdef96740 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5625a1d228e0 0x5625a2127b30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fdef96740 1 --2- 172.21.15.92:0/1842461314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a21159f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fb9ffb640 0 client.15351 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:12:42.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.968+0000 7f7fdef96740 1 -- 172.21.15.92:0/1842461314 >> 172.21.15.92:0/1842461314 conn(0x5625a1d58350 msgr2=0x5625a210d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:42.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.969+0000 7f7fdef96740 1 -- 172.21.15.92:0/1842461314 shutdown_connections 2024-09-21T07:12:42.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.969+0000 7f7fdef96740 1 -- 172.21.15.92:0/1842461314 wait complete. 2024-09-21T07:12:42.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.969+0000 7f7fdef96740 20 client.15351 trim_cache size 0 max 16384 2024-09-21T07:12:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.986+0000 7f7fdef96740 1 Processor -- start 2024-09-21T07:12:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.986+0000 7f7fdef96740 1 -- start start 2024-09-21T07:12:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.986+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d3b0a0 0x5625a2114070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.986+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 0x5625a21145b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.986+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.986+0000 7f7fdef96740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5625a2125e70 con 0x5625a1d63f60 2024-09-21T07:12:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.986+0000 7f7fdef96740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5625a2126540 con 0x5625a1d3b0a0 2024-09-21T07:12:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.986+0000 7f7fdef96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5625a2126c10 con 0x5625a1d43280 2024-09-21T07:12:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fd2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fd2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50398/0 (socket says 172.21.15.92:50398) 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/4239100728 learned_addr learned my addr 172.21.15.92:0/4239100728 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/4239100728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d3b0a0 0x5625a2114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/4239100728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 0x5625a21145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/4239100728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 msgr2=0x5625a21145b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/4239100728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 0x5625a21145b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/4239100728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d3b0a0 msgr2=0x5625a2114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/4239100728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d3b0a0 0x5625a2114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/4239100728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a210c790 con 0x5625a1d63f60 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/4239100728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 0x5625a21145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/4239100728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2107750 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc030a60 tx=0x7f7fcc004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32aacb6c8b780a22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fbbfff640 1 -- 172.21.15.92:0/4239100728 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0047d0 con 0x5625a1d63f60 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fbbfff640 1 -- 172.21.15.92:0/4239100728 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fcc036040 con 0x5625a1d63f60 2024-09-21T07:12:42.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.987+0000 7f7fbbfff640 1 -- 172.21.15.92:0/4239100728 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc030870 con 0x5625a1d63f60 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.988+0000 7f7fdef96740 1 -- 172.21.15.92:0/4239100728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 msgr2=0x5625a2107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.988+0000 7f7fdef96740 1 --2- 172.21.15.92:0/4239100728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2107750 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc030a60 tx=0x7f7fcc004520 comp rx=0 tx=0).stop 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.988+0000 7f7fdef96740 1 -- 172.21.15.92:0/4239100728 shutdown_connections 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.988+0000 7f7fdef96740 1 --2- 172.21.15.92:0/4239100728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d63f60 0x5625a2107750 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.988+0000 7f7fdef96740 1 --2- 172.21.15.92:0/4239100728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d43280 0x5625a21145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.988+0000 7f7fdef96740 1 --2- 172.21.15.92:0/4239100728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d3b0a0 0x5625a2114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.988+0000 7f7fdef96740 1 -- 172.21.15.92:0/4239100728 >> 172.21.15.92:0/4239100728 conn(0x5625a1d58350 msgr2=0x5625a21109a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.988+0000 7f7fdef96740 1 -- 172.21.15.92:0/4239100728 shutdown_connections 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.988+0000 7f7fdef96740 1 -- 172.21.15.92:0/4239100728 wait complete. 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.988+0000 7f7fdef96740 1 -- start start 2024-09-21T07:12:42.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fdef96740 1 Processor -- start 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a212a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 0x5625a212a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fdef96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d63f60 0x5625a212c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fdef96740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5625a21279b0 con 0x5625a1d3b0a0 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fdef96740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5625a21272e0 con 0x5625a1d43280 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fdef96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5625a2128080 con 0x5625a1d63f60 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fdef96740 10 client.0 _ll_register_callbacks cb 0x7f7fcc031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fd2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a212a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fd2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a212a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50402/0 (socket says 172.21.15.92:50402) 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/2808811466 learned_addr learned my addr 172.21.15.92:0/2808811466 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 0x5625a212a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/2808811466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d63f60 msgr2=0x5625a212c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d63f60 0x5625a212c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/2808811466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 msgr2=0x5625a212a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 0x5625a212a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fd2d9d640 1 -- 172.21.15.92:0/2808811466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a212afd0 con 0x5625a1d3b0a0 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 0x5625a212a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fd2d9d640 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a212a2a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc02ade0 tx=0x7f7fcc0306e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0533fa0d1a32db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.989+0000 7f7fb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/2808811466 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc030850 con 0x5625a1d3b0a0 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/2808811466 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f7fcc004b40 con 0x5625a1d3b0a0 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fdef96740 1 -- 172.21.15.92:0/2808811466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fcc036040 con 0x5625a1d3b0a0 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/2808811466 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7fcc003970 con 0x5625a1d3b0a0 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fdef96740 10 client.15357 fetch_fsmap learned FSMap version 28 2024-09-21T07:12:42.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fdef96740 1 -- 172.21.15.92:0/2808811466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5625a2193450 con 0x5625a1d3b0a0 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/2808811466 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fcc036040 con 0x5625a1d3b0a0 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/2808811466 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7fcc043070 con 0x5625a1d3b0a0 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fdef96740 10 client.15357 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fdef96740 10 client.15357 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fdef96740 20 client.15357 populate_metadata read hostname 'smithi092' 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fdef96740 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5625a1cf7c90 0x5625a2196920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fdef96740 4 client.15357 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.990+0000 7f7fdef96740 1 -- 172.21.15.92:0/2808811466 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "status"}) -- 0x5625a207f610 con 0x5625a1cf7c90 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.991+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5625a1cf7c90 0x5625a2196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.991+0000 7f7fb9ffb640 10 client.15357 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.991+0000 7f7fc9d9b640 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5625a1cf7c90 0x5625a2196920 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dac6ccad7837638d server_cookie=d00ab65e9e6e78b4 in_seq=0 out_seq=0 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.991+0000 7f7fb9ffb640 1 -- 172.21.15.92:0/2808811466 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5625a207f610 con 0x5625a1cf7c90 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.991+0000 7f7fb9ffb640 10 client.15357 handle_command_reply: tid=0 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.991+0000 7f7fdef96740 1 client.15357 shutdown 2024-09-21T07:12:42.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 1 -- 172.21.15.92:0/2808811466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 msgr2=0x5625a212a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a212a2a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc02ade0 tx=0x7f7fcc0306e0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 1 -- 172.21.15.92:0/2808811466 shutdown_connections 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a1d63f60 0x5625a212c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625a1d43280 0x5625a212a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5625a1cf7c90 0x5625a2196920 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 1 --2- 172.21.15.92:0/2808811466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5625a1d3b0a0 0x5625a212a2a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 1 -- 172.21.15.92:0/2808811466 >> 172.21.15.92:0/2808811466 conn(0x5625a1d58350 msgr2=0x5625a2114030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fb9ffb640 0 client.15357 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 1 -- 172.21.15.92:0/2808811466 shutdown_connections 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 1 -- 172.21.15.92:0/2808811466 wait complete. 2024-09-21T07:12:42.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fdef96740 20 client.15357 trim_cache size 0 max 16384 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 3, 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24583, 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 71.277453105999996, 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 28, 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 151.061857043 2024-09-21T07:12:42.999 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:12:43.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fd8a22640 1 -- 172.21.15.92:0/3970191065 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7fc00b65f0 msgr2=0x7f7fc00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:43.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fd8a22640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7fc00b65f0 0x7f7fc00b8b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40acf50 tx=0x7f7fc40d0040 comp rx=0 tx=0).stop 2024-09-21T07:12:43.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fd8a22640 1 -- 172.21.15.92:0/3970191065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4102a60 msgr2=0x7f7fd419a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:43.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fd8a22640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4102a60 0x7f7fd419a370 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400d770 tx=0x7f7fc400dc30 comp rx=0 tx=0).stop 2024-09-21T07:12:43.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fd8a22640 1 -- 172.21.15.92:0/3970191065 shutdown_connections 2024-09-21T07:12:43.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fd8a22640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7fc00b65f0 0x7f7fc00b8b00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:43.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fd8a22640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fd4108cf0 0x7f7fd419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:43.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fd8a22640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd41083a0 0x7f7fd419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:43.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fd8a22640 1 --2- 172.21.15.92:0/3970191065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fd4102a60 0x7f7fd419a370 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:43.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.992+0000 7f7fd8a22640 1 -- 172.21.15.92:0/3970191065 >> 172.21.15.92:0/3970191065 conn(0x7f7fd4079760 msgr2=0x7f7fd406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:43.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.993+0000 7f7fd8a22640 1 -- 172.21.15.92:0/3970191065 shutdown_connections 2024-09-21T07:12:43.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:42.993+0000 7f7fd8a22640 1 -- 172.21.15.92:0/3970191065 wait complete. 2024-09-21T07:12:43.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:42 smithi175 ceph-mon[34064]: pgmap v328: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:12:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:42 smithi169 ceph-mon[33705]: pgmap v328: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:12:43.762 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:12:44.035 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:44.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 -- 172.21.15.92:0/3837138828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff874103b90 msgr2=0x7ff874103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 --2- 172.21.15.92:0/3837138828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff874103b90 0x7ff874103fa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff870009860 tx=0x7ff87002a340 comp rx=0 tx=0).stop 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 -- 172.21.15.92:0/3837138828 shutdown_connections 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 --2- 172.21.15.92:0/3837138828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff874109e20 0x7ff874110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 --2- 172.21.15.92:0/3837138828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8741094d0 0x7ff8741098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 --2- 172.21.15.92:0/3837138828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff874103b90 0x7ff874103fa0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 -- 172.21.15.92:0/3837138828 >> 172.21.15.92:0/3837138828 conn(0x7ff8740ff600 msgr2=0x7ff874101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 -- 172.21.15.92:0/3837138828 shutdown_connections 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 -- 172.21.15.92:0/3837138828 wait complete. 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 Processor -- start 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.563+0000 7ff87c671640 1 -- start start 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87c671640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff874103b90 0x7ff87419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87c671640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8741094d0 0x7ff87419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87c671640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff874109e20 0x7ff87419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87c671640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff874113990 con 0x7ff874103b90 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87c671640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff874113810 con 0x7ff8741094d0 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87c671640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff874113b10 con 0x7ff874109e20 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87a40d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff874103b90 0x7ff87419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87a40d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff874103b90 0x7ff87419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50426/0 (socket says 172.21.15.92:50426) 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87a40d640 1 -- 172.21.15.92:0/3039958306 learned_addr learned my addr 172.21.15.92:0/3039958306 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff879c0c640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8741094d0 0x7ff87419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff874109e20 0x7ff87419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87a40d640 1 -- 172.21.15.92:0/3039958306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff874109e20 msgr2=0x7ff87419fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87a40d640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff874109e20 0x7ff87419fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87a40d640 1 -- 172.21.15.92:0/3039958306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8741094d0 msgr2=0x7ff87419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87a40d640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8741094d0 0x7ff87419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff87a40d640 1 -- 172.21.15.92:0/3039958306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8741a0330 con 0x7ff874103b90 2024-09-21T07:12:44.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.564+0000 7ff879c0c640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8741094d0 0x7ff87419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:12:44.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.565+0000 7ff87a40d640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff874103b90 0x7ff87419a3c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff8700057c0 tx=0x7ff87002ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:44.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.565+0000 7ff86b7fe640 1 -- 172.21.15.92:0/3039958306 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870040020 con 0x7ff874103b90 2024-09-21T07:12:44.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.565+0000 7ff86b7fe640 1 -- 172.21.15.92:0/3039958306 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8700044d0 con 0x7ff874103b90 2024-09-21T07:12:44.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.565+0000 7ff86b7fe640 1 -- 172.21.15.92:0/3039958306 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870037040 con 0x7ff874103b90 2024-09-21T07:12:44.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.565+0000 7ff87c671640 1 -- 172.21.15.92:0/3039958306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8741a05c0 con 0x7ff874103b90 2024-09-21T07:12:44.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.565+0000 7ff87c671640 1 -- 172.21.15.92:0/3039958306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8741a6d80 con 0x7ff874103b90 2024-09-21T07:12:44.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.567+0000 7ff882be5740 1 Processor -- start 2024-09-21T07:12:44.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff882be5740 1 -- start start 2024-09-21T07:12:44.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff86b7fe640 1 -- 172.21.15.92:0/3039958306 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7ff870043020 con 0x7ff874103b90 2024-09-21T07:12:44.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff882be5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c72f60 0x557983018f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff882be5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x557983019440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff882be5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x557983019980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff882be5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557982f90c10 con 0x557982c52280 2024-09-21T07:12:44.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff882be5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557982f80040 con 0x557982c4a0a0 2024-09-21T07:12:44.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff882be5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557982f83e50 con 0x557982c72f60 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff879c0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x557983019980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff879c0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x557983019980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50436/0 (socket says 172.21.15.92:50436) 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff879c0c640 1 -- 172.21.15.92:0/3712704145 learned_addr learned my addr 172.21.15.92:0/3712704145 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/3712704145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c72f60 0x557983018f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.568+0000 7ff87a40d640 1 --2- 172.21.15.92:0/3712704145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x557983019440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff879c0c640 1 -- 172.21.15.92:0/3712704145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c72f60 msgr2=0x557983018f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff879c0c640 1 --2- 172.21.15.92:0/3712704145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c72f60 0x557983018f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff879c0c640 1 -- 172.21.15.92:0/3712704145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 msgr2=0x557983019440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff879c0c640 1 --2- 172.21.15.92:0/3712704145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x557983019440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff879c0c640 1 -- 172.21.15.92:0/3712704145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557982cde540 con 0x557982c52280 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff879c0c640 1 --2- 172.21.15.92:0/3712704145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x557983019980 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff864011470 tx=0x7ff864011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2bc2dca76142c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff86b7fe640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff8600b6670 0x7ff8600b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff868ff9640 1 -- 172.21.15.92:0/3712704145 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86401e070 con 0x557982c52280 2024-09-21T07:12:44.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff868ff9640 1 -- 172.21.15.92:0/3712704145 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff864004310 con 0x557982c52280 2024-09-21T07:12:44.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff868ff9640 1 -- 172.21.15.92:0/3712704145 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86400f810 con 0x557982c52280 2024-09-21T07:12:44.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff8600b6670 0x7ff8600b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.569+0000 7ff86b7fe640 1 -- 172.21.15.92:0/3039958306 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff870107880 con 0x7ff874103b90 2024-09-21T07:12:44.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.570+0000 7ff882be5740 1 -- 172.21.15.92:0/3712704145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 msgr2=0x557983019980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.570+0000 7ff882be5740 1 --2- 172.21.15.92:0/3712704145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x557983019980 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff864011470 tx=0x7ff864011930 comp rx=0 tx=0).stop 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.570+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff8600b6670 0x7ff8600b8b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff86c005fd0 tx=0x7ff86c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.570+0000 7ff882be5740 1 -- 172.21.15.92:0/3712704145 shutdown_connections 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.570+0000 7ff882be5740 1 --2- 172.21.15.92:0/3712704145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x557983019980 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.570+0000 7ff882be5740 1 --2- 172.21.15.92:0/3712704145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x557983019440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.570+0000 7ff882be5740 1 --2- 172.21.15.92:0/3712704145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c72f60 0x557983018f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.570+0000 7ff882be5740 1 -- 172.21.15.92:0/3712704145 >> 172.21.15.92:0/3712704145 conn(0x557982c67350 msgr2=0x557983016df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.570+0000 7ff882be5740 1 -- 172.21.15.92:0/3712704145 shutdown_connections 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.570+0000 7ff882be5740 1 -- 172.21.15.92:0/3712704145 wait complete. 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff882be5740 1 -- start start 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff882be5740 1 Processor -- start 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff882be5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x557983028dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff882be5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c52280 0x557983029310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff882be5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c72f60 0x557983034da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff882be5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557982de15f0 con 0x557982c72f60 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff882be5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557982f1b010 con 0x557982c4a0a0 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff882be5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55798302ba40 con 0x557982c52280 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff882be5740 10 client.0 _ll_register_callbacks cb 0x557982f7a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff87ac0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c72f60 0x557983034da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff87ac0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c72f60 0x557983034da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50452/0 (socket says 172.21.15.92:50452) 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff87ac0e640 1 -- 172.21.15.92:0/828717844 learned_addr learned my addr 172.21.15.92:0/828717844 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff879c0c640 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c52280 0x557983029310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff87a40d640 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x557983028dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff87ac0e640 1 -- 172.21.15.92:0/828717844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c52280 msgr2=0x557983029310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c52280 0x557983029310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.571+0000 7ff87ac0e640 1 -- 172.21.15.92:0/828717844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 msgr2=0x557983028dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:44.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x557983028dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff87ac0e640 1 -- 172.21.15.92:0/828717844 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557982f48a00 con 0x557982c72f60 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff87a40d640 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x557983028dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c72f60 0x557983034da0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff86c003fd0 tx=0x7ff86c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd165d265a5ec6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff85dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff85dffb640 1 -- 172.21.15.92:0/828717844 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c00f8b0 con 0x557982c72f60 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff882be5740 1 -- 172.21.15.92:0/828717844 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff864004310 con 0x557982c72f60 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff85dffb640 1 -- 172.21.15.92:0/828717844 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff86c00fa50 con 0x557982c72f60 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff85dffb640 1 -- 172.21.15.92:0/828717844 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff86c00fc50 con 0x557982c72f60 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff882be5740 10 client.15369 fetch_fsmap learned FSMap version 28 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff882be5740 1 -- 172.21.15.92:0/828717844 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557983037a50 con 0x557982c72f60 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff85dffb640 1 -- 172.21.15.92:0/828717844 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff864004310 con 0x557982c72f60 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.572+0000 7ff85dffb640 1 -- 172.21.15.92:0/828717844 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff86c026070 con 0x557982c72f60 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.573+0000 7ff882be5740 10 client.15369 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:12:44.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.573+0000 7ff882be5740 10 client.15369 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.573+0000 7ff882be5740 20 client.15369 populate_metadata read hostname 'smithi092' 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.573+0000 7ff882be5740 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557982c318e0 0x55798303b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.573+0000 7ff882be5740 4 client.15369 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.573+0000 7ff882be5740 1 -- 172.21.15.92:0/828717844 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557982f92b60 con 0x557982c318e0 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.573+0000 7ff87a40d640 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557982c318e0 0x55798303b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.573+0000 7ff87a40d640 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557982c318e0 0x55798303b570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=876f8dbabbc7bde0 server_cookie=b383040d6ef4d9ba in_seq=0 out_seq=0 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.573+0000 7ff85dffb640 10 client.15369 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff85dffb640 1 -- 172.21.15.92:0/828717844 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557982f92b60 con 0x557982c318e0 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff85dffb640 10 client.15369 handle_command_reply: tid=0 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 client.15369 shutdown 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 -- 172.21.15.92:0/828717844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c72f60 msgr2=0x557983034da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c72f60 0x557983034da0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff86c003fd0 tx=0x7ff86c004ab0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 -- 172.21.15.92:0/828717844 shutdown_connections 2024-09-21T07:12:44.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557982c318e0 0x55798303b570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c72f60 0x557983034da0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c52280 0x557983029310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff85dffb640 0 client.15369 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:12:44.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 --2- 172.21.15.92:0/828717844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x557983028dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 -- 172.21.15.92:0/828717844 >> 172.21.15.92:0/828717844 conn(0x557982c67350 msgr2=0x55798301a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:44.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 -- 172.21.15.92:0/828717844 shutdown_connections 2024-09-21T07:12:44.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.574+0000 7ff882be5740 1 -- 172.21.15.92:0/828717844 wait complete. 2024-09-21T07:12:44.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.575+0000 7ff882be5740 20 client.15369 trim_cache size 0 max 16384 2024-09-21T07:12:44.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.592+0000 7ff882be5740 1 Processor -- start 2024-09-21T07:12:44.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.592+0000 7ff882be5740 1 -- start start 2024-09-21T07:12:44.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff882be5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c318e0 0x557983034d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff882be5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c4a0a0 0x557983035250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff882be5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c52280 0x557983016600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff882be5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5579830398b0 con 0x557982c4a0a0 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff882be5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557983039f80 con 0x557982c318e0 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff882be5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55798303a650 con 0x557982c52280 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff879c0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c4a0a0 0x557983035250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff879c0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c4a0a0 0x557983035250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50464/0 (socket says 172.21.15.92:50464) 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff879c0c640 1 -- 172.21.15.92:0/2700626734 learned_addr learned my addr 172.21.15.92:0/2700626734 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff87a40d640 1 --2- 172.21.15.92:0/2700626734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c318e0 0x557983034d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/2700626734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c52280 0x557983016600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff879c0c640 1 -- 172.21.15.92:0/2700626734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c52280 msgr2=0x557983016600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff879c0c640 1 --2- 172.21.15.92:0/2700626734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c52280 0x557983016600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff879c0c640 1 -- 172.21.15.92:0/2700626734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c318e0 msgr2=0x557983034d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:44.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff879c0c640 1 --2- 172.21.15.92:0/2700626734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c318e0 0x557983034d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff879c0c640 1 -- 172.21.15.92:0/2700626734 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579830396e0 con 0x557982c4a0a0 2024-09-21T07:12:44.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.593+0000 7ff879c0c640 1 --2- 172.21.15.92:0/2700626734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c4a0a0 0x557983035250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff864009670 tx=0x7ff864009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52914901b65c7bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:44.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff85ffff640 1 -- 172.21.15.92:0/2700626734 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86401e040 con 0x557982c4a0a0 2024-09-21T07:12:44.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff85ffff640 1 -- 172.21.15.92:0/2700626734 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff86401f040 con 0x557982c4a0a0 2024-09-21T07:12:44.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff85ffff640 1 -- 172.21.15.92:0/2700626734 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86400f4e0 con 0x557982c4a0a0 2024-09-21T07:12:44.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff882be5740 1 -- 172.21.15.92:0/2700626734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c4a0a0 msgr2=0x557983035250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:44.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff882be5740 1 --2- 172.21.15.92:0/2700626734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c4a0a0 0x557983035250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff864009670 tx=0x7ff864009d00 comp rx=0 tx=0).stop 2024-09-21T07:12:44.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff882be5740 1 -- 172.21.15.92:0/2700626734 shutdown_connections 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff882be5740 1 --2- 172.21.15.92:0/2700626734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c52280 0x557983016600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff882be5740 1 --2- 172.21.15.92:0/2700626734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c4a0a0 0x557983035250 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff882be5740 1 --2- 172.21.15.92:0/2700626734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c318e0 0x557983034d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff882be5740 1 -- 172.21.15.92:0/2700626734 >> 172.21.15.92:0/2700626734 conn(0x557982c67350 msgr2=0x557983023d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff882be5740 1 -- 172.21.15.92:0/2700626734 shutdown_connections 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.594+0000 7ff882be5740 1 -- 172.21.15.92:0/2700626734 wait complete. 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff882be5740 1 -- start start 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff882be5740 1 Processor -- start 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff882be5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c318e0 0x557983044120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff882be5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x55798303d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff882be5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x55798303dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff882be5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55798303b3f0 con 0x557982c52280 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff882be5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55798303ad20 con 0x557982c4a0a0 2024-09-21T07:12:44.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff882be5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55798303bac0 con 0x557982c318e0 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff882be5740 10 client.0 _ll_register_callbacks cb 0x7ff86c009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff87ac0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x55798303dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff87ac0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x55798303dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50466/0 (socket says 172.21.15.92:50466) 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff87ac0e640 1 -- 172.21.15.92:0/3208747658 learned_addr learned my addr 172.21.15.92:0/3208747658 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff87a40d640 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c318e0 0x557983044120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.595+0000 7ff879c0c640 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x55798303d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff87ac0e640 1 -- 172.21.15.92:0/3208747658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c318e0 msgr2=0x557983044120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c318e0 0x557983044120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff87ac0e640 1 -- 172.21.15.92:0/3208747658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 msgr2=0x55798303d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x55798303d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff87ac0e640 1 -- 172.21.15.92:0/3208747658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55798303e3e0 con 0x557982c52280 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff87ac0e640 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x55798303dc70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff86c028510 tx=0x7ff86c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53740b52015797e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff85dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:12:44.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff85dffb640 1 -- 172.21.15.92:0/3208747658 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c004b20 con 0x557982c52280 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff85dffb640 1 -- 172.21.15.92:0/3208747658 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff86c004cc0 con 0x557982c52280 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff882be5740 1 -- 172.21.15.92:0/3208747658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff86401f040 con 0x557982c52280 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff85dffb640 1 -- 172.21.15.92:0/3208747658 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff86c041050 con 0x557982c52280 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff882be5740 10 client.15375 fetch_fsmap learned FSMap version 28 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff882be5740 1 -- 172.21.15.92:0/3208747658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5579830a6aa0 con 0x557982c52280 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.596+0000 7ff85dffb640 1 -- 172.21.15.92:0/3208747658 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff86401f040 con 0x557982c52280 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.597+0000 7ff85dffb640 1 -- 172.21.15.92:0/3208747658 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff86c026050 con 0x557982c52280 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.597+0000 7ff882be5740 10 client.15375 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.597+0000 7ff882be5740 10 client.15375 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.597+0000 7ff882be5740 20 client.15375 populate_metadata read hostname 'smithi092' 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.597+0000 7ff882be5740 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557982c72f60 0x5579830aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.597+0000 7ff882be5740 4 client.15375 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.597+0000 7ff882be5740 1 -- 172.21.15.92:0/3208747658 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "status"}) -- 0x557982f8e610 con 0x557982c72f60 2024-09-21T07:12:44.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.597+0000 7ff87a40d640 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557982c72f60 0x5579830aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.597+0000 7ff85dffb640 10 client.15375 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.597+0000 7ff87a40d640 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557982c72f60 0x5579830aa3f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=389bbf680ffbe09 server_cookie=30f08f9a3f0647a9 in_seq=0 out_seq=0 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff85dffb640 1 -- 172.21.15.92:0/3208747658 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x557982f8e610 con 0x557982c72f60 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff85dffb640 10 client.15375 handle_command_reply: tid=0 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 client.15375 shutdown 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 -- 172.21.15.92:0/3208747658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 msgr2=0x55798303dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x55798303dc70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff86c028510 tx=0x7ff86c004a40 comp rx=0 tx=0).stop 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 -- 172.21.15.92:0/3208747658 shutdown_connections 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557982c72f60 0x5579830aa3f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557982c52280 0x55798303dc70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557982c4a0a0 0x55798303d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 --2- 172.21.15.92:0/3208747658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557982c318e0 0x557983044120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 -- 172.21.15.92:0/3208747658 >> 172.21.15.92:0/3208747658 conn(0x557982c67350 msgr2=0x557983016600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:44.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff85dffb640 0 client.15375 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 -- 172.21.15.92:0/3208747658 shutdown_connections 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 1 -- 172.21.15.92:0/3208747658 wait complete. 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff882be5740 20 client.15375 trim_cache size 0 max 16384 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 2, 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24608, 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:12:44.605 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 73.893989374, 2024-09-21T07:12:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 28, 2024-09-21T07:12:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:12:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T07:12:44.606 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 120.74178496 2024-09-21T07:12:44.606 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:12:44.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff87c671640 1 -- 172.21.15.92:0/3039958306 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff8600b6670 msgr2=0x7ff8600b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff87c671640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff8600b6670 0x7ff8600b8b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff86c005fd0 tx=0x7ff86c009500 comp rx=0 tx=0).stop 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff87c671640 1 -- 172.21.15.92:0/3039958306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff874103b90 msgr2=0x7ff87419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.598+0000 7ff87c671640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff874103b90 0x7ff87419a3c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff8700057c0 tx=0x7ff87002ae60 comp rx=0 tx=0).stop 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.599+0000 7ff87c671640 1 -- 172.21.15.92:0/3039958306 shutdown_connections 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.599+0000 7ff87c671640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff8600b6670 0x7ff8600b8b80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.599+0000 7ff87c671640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff874109e20 0x7ff87419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.599+0000 7ff87c671640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8741094d0 0x7ff87419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.599+0000 7ff87c671640 1 --2- 172.21.15.92:0/3039958306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff874103b90 0x7ff87419a3c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.599+0000 7ff87c671640 1 -- 172.21.15.92:0/3039958306 >> 172.21.15.92:0/3039958306 conn(0x7ff8740ff600 msgr2=0x7ff874101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.599+0000 7ff87c671640 1 -- 172.21.15.92:0/3039958306 shutdown_connections 2024-09-21T07:12:44.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:44.599+0000 7ff87c671640 1 -- 172.21.15.92:0/3039958306 wait complete. 2024-09-21T07:12:44.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:44 smithi092 ceph-mon[30987]: pgmap v329: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:12:45.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:44 smithi175 ceph-mon[34064]: pgmap v329: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:12:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:44 smithi169 ceph-mon[33705]: pgmap v329: 129 pgs: 129 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:12:45.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T07:12:45.702 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:46.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.197+0000 7feab1dc5640 1 -- 172.21.15.92:0/3131570570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaac102a60 msgr2=0x7feaac102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:46.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.197+0000 7feab1dc5640 1 --2- 172.21.15.92:0/3131570570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaac102a60 0x7feaac102e70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009900 tx=0x7fea9c02a410 comp rx=0 tx=0).stop 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.197+0000 7feab1dc5640 1 -- 172.21.15.92:0/3131570570 shutdown_connections 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.197+0000 7feab1dc5640 1 --2- 172.21.15.92:0/3131570570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feaac108cf0 0x7feaac10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.197+0000 7feab1dc5640 1 --2- 172.21.15.92:0/3131570570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feaac1083a0 0x7feaac1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.197+0000 7feab1dc5640 1 --2- 172.21.15.92:0/3131570570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaac102a60 0x7feaac102e70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.197+0000 7feab1dc5640 1 -- 172.21.15.92:0/3131570570 >> 172.21.15.92:0/3131570570 conn(0x7feaac079730 msgr2=0x7feaac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.197+0000 7feab1dc5640 1 -- 172.21.15.92:0/3131570570 shutdown_connections 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.197+0000 7feab1dc5640 1 -- 172.21.15.92:0/3131570570 wait complete. 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.198+0000 7feab1dc5640 1 Processor -- start 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.198+0000 7feab1dc5640 1 -- start start 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.198+0000 7feab1dc5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feaac102a60 0x7feaac19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.198+0000 7feab1dc5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feaac1083a0 0x7feaac19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.198+0000 7feab1dc5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaac108cf0 0x7feaac19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.198+0000 7feab1dc5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feaac113930 con 0x7feaac108cf0 2024-09-21T07:12:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.198+0000 7feab1dc5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feaac1137b0 con 0x7feaac102a60 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.198+0000 7feab1dc5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feaac113ab0 con 0x7feaac1083a0 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaac108cf0 0x7feaac19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaac108cf0 0x7feaac19fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50484/0 (socket says 172.21.15.92:50484) 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaabfff640 1 -- 172.21.15.92:0/2121073731 learned_addr learned my addr 172.21.15.92:0/2121073731 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaab7fe640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feaac102a60 0x7feaac19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaa2ffd640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feaac1083a0 0x7feaac19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaabfff640 1 -- 172.21.15.92:0/2121073731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feaac1083a0 msgr2=0x7feaac19a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaabfff640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feaac1083a0 0x7feaac19a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaabfff640 1 -- 172.21.15.92:0/2121073731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feaac102a60 msgr2=0x7feaac19a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaabfff640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feaac102a60 0x7feaac19a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaabfff640 1 -- 172.21.15.92:0/2121073731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac1a02d0 con 0x7feaac108cf0 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaabfff640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaac108cf0 0x7feaac19fba0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7feaa400eaa0 tx=0x7feaa400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaa97fa640 1 -- 172.21.15.92:0/2121073731 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa400cdb0 con 0x7feaac108cf0 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaa97fa640 1 -- 172.21.15.92:0/2121073731 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feaa4005020 con 0x7feaac108cf0 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feab1dc5640 1 -- 172.21.15.92:0/2121073731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaac1a05c0 con 0x7feaac108cf0 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feaa97fa640 1 -- 172.21.15.92:0/2121073731 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa40116d0 con 0x7feaac108cf0 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.199+0000 7feab1dc5640 1 -- 172.21.15.92:0/2121073731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaac1a6d20 con 0x7feaac108cf0 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feab8339740 1 Processor -- start 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feaa97fa640 1 -- 172.21.15.92:0/2121073731 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7feaa40051d0 con 0x7feaac108cf0 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feab8339740 1 -- start start 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feab8339740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da5ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feab8339740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da60440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feab8339740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da60980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feab8339740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55df3d9d7c10 con 0x55df3d6b9f60 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feab8339740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55df3d9c7040 con 0x55df3d699280 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feab8339740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55df3d9cae50 con 0x55df3d6910a0 2024-09-21T07:12:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feaa2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da5ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feaa2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da5ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50490/0 (socket says 172.21.15.92:50490) 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.202+0000 7feaa2ffd640 1 -- 172.21.15.92:0/3445608787 learned_addr learned my addr 172.21.15.92:0/3445608787 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaab7fe640 1 --2- 172.21.15.92:0/3445608787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da60440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa2ffd640 1 -- 172.21.15.92:0/3445608787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 msgr2=0x55df3da60440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa2ffd640 1 --2- 172.21.15.92:0/3445608787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da60440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa2ffd640 1 -- 172.21.15.92:0/3445608787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 msgr2=0x55df3da60980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa2ffd640 1 --2- 172.21.15.92:0/3445608787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da60980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa2ffd640 1 -- 172.21.15.92:0/3445608787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3d725540 con 0x55df3d6b9f60 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaab7fe640 1 --2- 172.21.15.92:0/3445608787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da60440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa97fa640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fea980b65e0 0x7fea980b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa2ffd640 1 --2- 172.21.15.92:0/3445608787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da5ff00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fea9400bd00 tx=0x7fea94011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6597e2cd96f8685b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaab7fe640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fea980b65e0 0x7fea980b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa1ffb640 1 -- 172.21.15.92:0/3445608787 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9401a400 con 0x55df3d6b9f60 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa1ffb640 1 -- 172.21.15.92:0/3445608787 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea9401aa30 con 0x55df3d6b9f60 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa97fa640 1 -- 172.21.15.92:0/2121073731 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7feaa40e7960 con 0x7feaac108cf0 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.203+0000 7feaa1ffb640 1 -- 172.21.15.92:0/3445608787 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea94012950 con 0x55df3d6b9f60 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.204+0000 7feab8339740 1 -- 172.21.15.92:0/3445608787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 msgr2=0x55df3da5ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.204+0000 7feab8339740 1 --2- 172.21.15.92:0/3445608787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da5ff00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fea9400bd00 tx=0x7fea94011750 comp rx=0 tx=0).stop 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.204+0000 7feaab7fe640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fea980b65e0 0x7fea980b8af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0057c0 tx=0x7fea9c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.204+0000 7feab8339740 1 -- 172.21.15.92:0/3445608787 shutdown_connections 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.204+0000 7feab8339740 1 --2- 172.21.15.92:0/3445608787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da60980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.204+0000 7feab8339740 1 --2- 172.21.15.92:0/3445608787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da60440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.204+0000 7feab8339740 1 --2- 172.21.15.92:0/3445608787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da5ff00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.204+0000 7feab8339740 1 -- 172.21.15.92:0/3445608787 >> 172.21.15.92:0/3445608787 conn(0x55df3d6ae350 msgr2=0x55df3da5ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.204+0000 7feab8339740 1 -- 172.21.15.92:0/3445608787 shutdown_connections 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.204+0000 7feab8339740 1 -- 172.21.15.92:0/3445608787 wait complete. 2024-09-21T07:12:46.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feab8339740 1 -- start start 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feab8339740 1 Processor -- start 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feab8339740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da6b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feab8339740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da6bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feab8339740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da779d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feab8339740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55df3d8285f0 con 0x55df3d6b9f60 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feab8339740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55df3d962010 con 0x55df3d699280 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feab8339740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55df3da6e6e0 con 0x55df3d6910a0 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feab8339740 10 client.0 _ll_register_callbacks cb 0x55df3d9c1340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feaabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da779d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feaabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da779d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50504/0 (socket says 172.21.15.92:50504) 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.205+0000 7feaabfff640 1 -- 172.21.15.92:0/2705568604 learned_addr learned my addr 172.21.15.92:0/2705568604 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feaa2ffd640 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da6bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feaab7fe640 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da6b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feaabfff640 1 -- 172.21.15.92:0/2705568604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 msgr2=0x55df3da6b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feaabfff640 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da6b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feaabfff640 1 -- 172.21.15.92:0/2705568604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 msgr2=0x55df3da6bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feaabfff640 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da6bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feaabfff640 1 -- 172.21.15.92:0/2705568604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3d98fa00 con 0x55df3d6b9f60 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feaa2ffd640 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da6bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feaab7fe640 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da6b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feaabfff640 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da779d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009270 tx=0x7feaa4005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e490b97a20c82a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7fea8affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7fea8affd640 1 -- 172.21.15.92:0/2705568604 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa401f030 con 0x55df3d6b9f60 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7fea8affd640 1 -- 172.21.15.92:0/2705568604 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7feaa40a8f80 con 0x55df3d6b9f60 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feab8339740 1 -- 172.21.15.92:0/2705568604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea9401aa30 con 0x55df3d6b9f60 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7fea8affd640 1 -- 172.21.15.92:0/2705568604 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feaa40b2110 con 0x55df3d6b9f60 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feab8339740 10 client.15387 fetch_fsmap learned FSMap version 28 2024-09-21T07:12:46.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7feab8339740 1 -- 172.21.15.92:0/2705568604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55df3da7a5a0 con 0x55df3d6b9f60 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7fea8affd640 1 -- 172.21.15.92:0/2705568604 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea9401aa30 con 0x55df3d6b9f60 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.206+0000 7fea8affd640 1 -- 172.21.15.92:0/2705568604 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feaa400f040 con 0x55df3d6b9f60 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.207+0000 7feab8339740 10 client.15387 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.207+0000 7feab8339740 10 client.15387 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.207+0000 7feab8339740 20 client.15387 populate_metadata read hostname 'smithi092' 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.207+0000 7feab8339740 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55df3d6788e0 0x55df3da7dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.207+0000 7feab8339740 4 client.15387 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.207+0000 7feab8339740 1 -- 172.21.15.92:0/2705568604 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df3d9d9b60 con 0x55df3d6788e0 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.207+0000 7feaab7fe640 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55df3d6788e0 0x55df3da7dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.207+0000 7fea8affd640 10 client.15387 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.207+0000 7feaab7fe640 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55df3d6788e0 0x55df3da7dfc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d6596bc038001381 server_cookie=c0dcfb66548933cd in_seq=0 out_seq=0 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7fea8affd640 1 -- 172.21.15.92:0/2705568604 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df3d9d9b60 con 0x55df3d6788e0 2024-09-21T07:12:46.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7fea8affd640 10 client.15387 handle_command_reply: tid=0 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7feab8339740 1 client.15387 shutdown 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7feab8339740 1 -- 172.21.15.92:0/2705568604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 msgr2=0x55df3da779d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7feab8339740 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da779d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009270 tx=0x7feaa4005720 comp rx=0 tx=0).stop 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7feab8339740 1 -- 172.21.15.92:0/2705568604 shutdown_connections 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7feab8339740 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55df3d6788e0 0x55df3da7dfc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7fea8affd640 0 client.15387 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7feab8339740 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6b9f60 0x55df3da779d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7feab8339740 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da6bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7feab8339740 1 --2- 172.21.15.92:0/2705568604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da6b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.208+0000 7feab8339740 1 -- 172.21.15.92:0/2705568604 >> 172.21.15.92:0/2705568604 conn(0x55df3d6ae350 msgr2=0x55df3da630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.209+0000 7feab8339740 1 -- 172.21.15.92:0/2705568604 shutdown_connections 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.209+0000 7feab8339740 1 -- 172.21.15.92:0/2705568604 wait complete. 2024-09-21T07:12:46.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.209+0000 7feab8339740 20 client.15387 trim_cache size 0 max 16384 2024-09-21T07:12:46.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feab8339740 1 Processor -- start 2024-09-21T07:12:46.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feab8339740 1 -- start start 2024-09-21T07:12:46.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feab8339740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6788e0 0x55df3da66020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feab8339740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da77940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feab8339740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da77e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feab8339740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55df3da7c300 con 0x55df3d6788e0 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feab8339740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55df3da7c9d0 con 0x55df3d699280 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feab8339740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55df3da7d0a0 con 0x55df3d6910a0 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feaab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6788e0 0x55df3da66020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feaab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6788e0 0x55df3da66020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50516/0 (socket says 172.21.15.92:50516) 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feaab7fe640 1 -- 172.21.15.92:0/3176923526 learned_addr learned my addr 172.21.15.92:0/3176923526 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feaa2ffd640 1 --2- 172.21.15.92:0/3176923526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da77940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feaabfff640 1 --2- 172.21.15.92:0/3176923526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da77e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feaab7fe640 1 -- 172.21.15.92:0/3176923526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 msgr2=0x55df3da77940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feaab7fe640 1 --2- 172.21.15.92:0/3176923526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da77940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feaab7fe640 1 -- 172.21.15.92:0/3176923526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 msgr2=0x55df3da77e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feaab7fe640 1 --2- 172.21.15.92:0/3176923526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da77e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.228+0000 7feaab7fe640 1 -- 172.21.15.92:0/3176923526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3da6c840 con 0x55df3d6788e0 2024-09-21T07:12:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.229+0000 7feaab7fe640 1 --2- 172.21.15.92:0/3176923526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6788e0 0x55df3da66020 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fea9c02a930 tx=0x7fea9c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b326b6cc98d4910 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.229+0000 7feaa17fa640 1 -- 172.21.15.92:0/3176923526 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c055070 con 0x55df3d6788e0 2024-09-21T07:12:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.229+0000 7feaa17fa640 1 -- 172.21.15.92:0/3176923526 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea9c004300 con 0x55df3d6788e0 2024-09-21T07:12:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.229+0000 7feaa17fa640 1 -- 172.21.15.92:0/3176923526 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c035050 con 0x55df3d6788e0 2024-09-21T07:12:46.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 -- 172.21.15.92:0/3176923526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6788e0 msgr2=0x55df3da66020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 --2- 172.21.15.92:0/3176923526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6788e0 0x55df3da66020 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fea9c02a930 tx=0x7fea9c03e000 comp rx=0 tx=0).stop 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 -- 172.21.15.92:0/3176923526 shutdown_connections 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 --2- 172.21.15.92:0/3176923526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d699280 0x55df3da77e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 --2- 172.21.15.92:0/3176923526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da77940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 --2- 172.21.15.92:0/3176923526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d6788e0 0x55df3da66020 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 -- 172.21.15.92:0/3176923526 >> 172.21.15.92:0/3176923526 conn(0x55df3d6ae350 msgr2=0x55df3da66980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 -- 172.21.15.92:0/3176923526 shutdown_connections 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 -- 172.21.15.92:0/3176923526 wait complete. 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 -- start start 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.230+0000 7feab8339740 1 Processor -- start 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feab8339740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d6788e0 0x55df3da80360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feab8339740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da808a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feab8339740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d699280 0x55df3da80de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feab8339740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55df3da7de40 con 0x55df3d699280 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feab8339740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55df3da7d770 con 0x55df3d6788e0 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feab8339740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55df3da7e510 con 0x55df3d6910a0 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feab8339740 10 client.0 _ll_register_callbacks cb 0x7feaa4005b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d699280 0x55df3da80de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d699280 0x55df3da80de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50522/0 (socket says 172.21.15.92:50522) 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaabfff640 1 -- 172.21.15.92:0/2760974225 learned_addr learned my addr 172.21.15.92:0/2760974225 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaa2ffd640 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da808a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaab7fe640 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d6788e0 0x55df3da80360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaabfff640 1 -- 172.21.15.92:0/2760974225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 msgr2=0x55df3da808a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaabfff640 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da808a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaabfff640 1 -- 172.21.15.92:0/2760974225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d6788e0 msgr2=0x55df3da80360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaabfff640 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d6788e0 0x55df3da80360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaabfff640 1 -- 172.21.15.92:0/2760974225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3da85c20 con 0x55df3d699280 2024-09-21T07:12:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7feaabfff640 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d699280 0x55df3da80de0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7feaa40a9bb0 tx=0x7feaa4009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972585d8e459224f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7fea8affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.231+0000 7fea8affd640 1 -- 172.21.15.92:0/2760974225 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa40c8060 con 0x55df3d699280 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7fea8affd640 1 -- 172.21.15.92:0/2760974225 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7feaa40ac500 con 0x55df3d699280 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7feab8339740 1 -- 172.21.15.92:0/2760974225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea9c004300 con 0x55df3d699280 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7fea8affd640 1 -- 172.21.15.92:0/2760974225 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feaa405c070 con 0x55df3d699280 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7feab8339740 10 client.15393 fetch_fsmap learned FSMap version 28 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7feab8339740 1 -- 172.21.15.92:0/2760974225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55df3dae9830 con 0x55df3d699280 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7fea8affd640 1 -- 172.21.15.92:0/2760974225 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea9c004300 con 0x55df3d699280 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7fea8affd640 1 -- 172.21.15.92:0/2760974225 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feaa4004a40 con 0x55df3d699280 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7feab8339740 10 client.15393 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7feab8339740 10 client.15393 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7feab8339740 20 client.15393 populate_metadata read hostname 'smithi092' 2024-09-21T07:12:46.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7feab8339740 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55df3d6b9f60 0x55df3daed060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7feab8339740 4 client.15393 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7feab8339740 1 -- 172.21.15.92:0/2760974225 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "status"}) -- 0x55df3d9d5610 con 0x55df3d6b9f60 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.232+0000 7feaab7fe640 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55df3d6b9f60 0x55df3daed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7fea8affd640 10 client.15393 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feaab7fe640 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55df3d6b9f60 0x55df3daed060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb44487c92d776c4 server_cookie=5f747ea0b47a660d in_seq=0 out_seq=0 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7fea8affd640 1 -- 172.21.15.92:0/2760974225 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55df3d9d5610 con 0x55df3d6b9f60 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7fea8affd640 10 client.15393 handle_command_reply: tid=0 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feab8339740 1 client.15393 shutdown 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feab8339740 1 -- 172.21.15.92:0/2760974225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d699280 msgr2=0x55df3da80de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feab8339740 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d699280 0x55df3da80de0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7feaa40a9bb0 tx=0x7feaa4009710 comp rx=0 tx=0).stop 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feab8339740 1 -- 172.21.15.92:0/2760974225 shutdown_connections 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feab8339740 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55df3d6b9f60 0x55df3daed060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feab8339740 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df3d699280 0x55df3da80de0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feab8339740 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df3d6910a0 0x55df3da808a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7fea8affd640 0 client.15393 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:12:46.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feab8339740 1 --2- 172.21.15.92:0/2760974225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df3d6788e0 0x55df3da80360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feab8339740 1 -- 172.21.15.92:0/2760974225 >> 172.21.15.92:0/2760974225 conn(0x55df3d6ae350 msgr2=0x55df3da5d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:46.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.233+0000 7feab8339740 1 -- 172.21.15.92:0/2760974225 shutdown_connections 2024-09-21T07:12:46.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab8339740 1 -- 172.21.15.92:0/2760974225 wait complete. 2024-09-21T07:12:46.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab8339740 20 client.15393 trim_cache size 0 max 16384 2024-09-21T07:12:46.240 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 1, 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24625, 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 76.533491686999994, 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 28, 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 139.234980315 2024-09-21T07:12:46.241 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:12:46.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 -- 172.21.15.92:0/2121073731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fea980b65e0 msgr2=0x7fea980b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:46.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fea980b65e0 0x7fea980b8af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0057c0 tx=0x7fea9c0058d0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 -- 172.21.15.92:0/2121073731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaac108cf0 msgr2=0x7feaac19fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:46.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaac108cf0 0x7feaac19fba0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7feaa400eaa0 tx=0x7feaa400ef60 comp rx=0 tx=0).stop 2024-09-21T07:12:46.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 -- 172.21.15.92:0/2121073731 shutdown_connections 2024-09-21T07:12:46.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fea980b65e0 0x7fea980b8af0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaac108cf0 0x7feaac19fba0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feaac1083a0 0x7feaac19a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 --2- 172.21.15.92:0/2121073731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feaac102a60 0x7feaac19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:46.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 -- 172.21.15.92:0/2121073731 >> 172.21.15.92:0/2121073731 conn(0x7feaac079730 msgr2=0x7feaac101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:46.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 -- 172.21.15.92:0/2121073731 shutdown_connections 2024-09-21T07:12:46.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:46.234+0000 7feab1dc5640 1 -- 172.21.15.92:0/2121073731 wait complete. 2024-09-21T07:12:46.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:46 smithi092 ceph-mon[30987]: pgmap v330: 129 pgs: 129 active+clean; 649 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:12:46.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:46 smithi092 ceph-mon[30987]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T07:12:46.968 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:12:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:46 smithi175 ceph-mon[34064]: pgmap v330: 129 pgs: 129 active+clean; 649 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:12:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:46 smithi175 ceph-mon[34064]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T07:12:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:46 smithi169 ceph-mon[33705]: pgmap v330: 129 pgs: 129 active+clean; 649 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:12:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:46 smithi169 ceph-mon[33705]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T07:12:47.214 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:47.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.707+0000 7f9b43c33640 1 -- 172.21.15.92:0/2431352730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b3c103b60 msgr2=0x7f9b3c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:47.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.707+0000 7f9b43c33640 1 --2- 172.21.15.92:0/2431352730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b3c103b60 0x7f9b3c103f70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009900 tx=0x7f9b3802a410 comp rx=0 tx=0).stop 2024-09-21T07:12:47.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.707+0000 7f9b43c33640 1 -- 172.21.15.92:0/2431352730 shutdown_connections 2024-09-21T07:12:47.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.707+0000 7f9b43c33640 1 --2- 172.21.15.92:0/2431352730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b3c109df0 0x7f9b3c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.707+0000 7f9b43c33640 1 --2- 172.21.15.92:0/2431352730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b3c1094a0 0x7f9b3c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.707+0000 7f9b43c33640 1 --2- 172.21.15.92:0/2431352730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b3c103b60 0x7f9b3c103f70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.707+0000 7f9b43c33640 1 -- 172.21.15.92:0/2431352730 >> 172.21.15.92:0/2431352730 conn(0x7f9b3c07b850 msgr2=0x7f9b3c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:47.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.708+0000 7f9b43c33640 1 -- 172.21.15.92:0/2431352730 shutdown_connections 2024-09-21T07:12:47.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.708+0000 7f9b43c33640 1 -- 172.21.15.92:0/2431352730 wait complete. 2024-09-21T07:12:47.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.708+0000 7f9b43c33640 1 Processor -- start 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.708+0000 7f9b43c33640 1 -- start start 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.708+0000 7f9b43c33640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b3c103b60 0x7f9b3c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.708+0000 7f9b43c33640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b3c1094a0 0x7f9b3c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.708+0000 7f9b43c33640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b3c109df0 0x7f9b3c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.708+0000 7f9b43c33640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c113960 con 0x7f9b3c109df0 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b43c33640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c1137e0 con 0x7f9b3c1094a0 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b43c33640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c113ae0 con 0x7f9b3c103b60 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b421d0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b3c109df0 0x7f9b3c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b421d0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b3c109df0 0x7f9b3c19fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50532/0 (socket says 172.21.15.92:50532) 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b421d0640 1 -- 172.21.15.92:0/593126740 learned_addr learned my addr 172.21.15.92:0/593126740 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:47.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b411ce640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b3c1094a0 0x7f9b3c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b419cf640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b3c103b60 0x7f9b3c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b421d0640 1 -- 172.21.15.92:0/593126740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b3c103b60 msgr2=0x7f9b3c19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:47.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b421d0640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b3c103b60 0x7f9b3c19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b421d0640 1 -- 172.21.15.92:0/593126740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b3c1094a0 msgr2=0x7f9b3c19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b421d0640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b3c1094a0 0x7f9b3c19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b421d0640 1 -- 172.21.15.92:0/593126740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c1a0340 con 0x7f9b3c109df0 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b421d0640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b3c109df0 0x7f9b3c19fc10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400eaa0 tx=0x7f9b3400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b32ffd640 1 -- 172.21.15.92:0/593126740 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400cdb0 con 0x7f9b3c109df0 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b43c33640 1 -- 172.21.15.92:0/593126740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c1a0630 con 0x7f9b3c109df0 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b32ffd640 1 -- 172.21.15.92:0/593126740 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b34005020 con 0x7f9b3c109df0 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b32ffd640 1 -- 172.21.15.92:0/593126740 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b340116d0 con 0x7f9b3c109df0 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.709+0000 7f9b43c33640 1 -- 172.21.15.92:0/593126740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c1a6d90 con 0x7f9b3c109df0 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.712+0000 7f9b4a1a7740 1 Processor -- start 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b32ffd640 1 -- 172.21.15.92:0/593126740 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f9b34004b20 con 0x7f9b3c109df0 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b4a1a7740 1 -- start start 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f9ff60 0x559b06345f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f770a0 0x559b06346440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b06346980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b062bdc10 con 0x559b05f7f280 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b062ad040 con 0x559b05f9ff60 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559b062b0e50 con 0x559b05f770a0 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b411ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b06346980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b411ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b06346980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50548/0 (socket says 172.21.15.92:50548) 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.713+0000 7f9b411ce640 1 -- 172.21.15.92:0/3109083070 learned_addr learned my addr 172.21.15.92:0/3109083070 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b411ce640 1 --2- 172.21.15.92:0/3109083070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f9ff60 0x559b06345f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b419cf640 1 --2- 172.21.15.92:0/3109083070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f770a0 0x559b06346440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b411ce640 1 -- 172.21.15.92:0/3109083070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f770a0 msgr2=0x559b06346440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b411ce640 1 --2- 172.21.15.92:0/3109083070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f770a0 0x559b06346440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b32ffd640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b280b6560 0x7f9b280b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b411ce640 1 -- 172.21.15.92:0/3109083070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f9ff60 msgr2=0x559b06345f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b411ce640 1 --2- 172.21.15.92:0/3109083070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f9ff60 0x559b06345f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b411ce640 1 -- 172.21.15.92:0/3109083070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0600b540 con 0x559b05f7f280 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b421d0640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b280b6560 0x7f9b280b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b411ce640 1 --2- 172.21.15.92:0/3109083070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b06346980 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c012540 tx=0x7f9b2c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd198af0bb7e4bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b32ffd640 1 -- 172.21.15.92:0/593126740 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9b340e79d0 con 0x7f9b3c109df0 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b27fff640 1 -- 172.21.15.92:0/3109083070 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c004300 con 0x559b05f7f280 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b27fff640 1 -- 172.21.15.92:0/3109083070 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b2c0044a0 con 0x559b05f7f280 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.714+0000 7f9b27fff640 1 -- 172.21.15.92:0/3109083070 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0035f0 con 0x559b05f7f280 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.715+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3109083070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 msgr2=0x559b06346980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.715+0000 7f9b421d0640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b280b6560 0x7f9b280b8a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9b340aa9c0 tx=0x7f9b340de140 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.715+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3109083070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b06346980 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c012540 tx=0x7f9b2c005c90 comp rx=0 tx=0).stop 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.715+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3109083070 shutdown_connections 2024-09-21T07:12:47.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.715+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3109083070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b06346980 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.715+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3109083070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f770a0 0x559b06346440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.715+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3109083070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f9ff60 0x559b06345f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.715+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3109083070 >> 172.21.15.92:0/3109083070 conn(0x559b05f94350 msgr2=0x559b06343df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:47.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.715+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3109083070 shutdown_connections 2024-09-21T07:12:47.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.715+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3109083070 wait complete. 2024-09-21T07:12:47.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.716+0000 7f9b4a1a7740 1 -- start start 2024-09-21T07:12:47.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.716+0000 7f9b4a1a7740 1 Processor -- start 2024-09-21T07:12:47.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.716+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f770a0 0x559b063519a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.716+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f7f280 0x559b06351ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.716+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f9ff60 0x559b0635d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.716+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b0610e5f0 con 0x559b05f9ff60 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.716+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b06248010 con 0x559b05f7f280 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.716+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559b063546e0 con 0x559b05f770a0 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.716+0000 7f9b4a1a7740 10 client.0 _ll_register_callbacks cb 0x559b062a7340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b411ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f9ff60 0x559b0635d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b411ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f9ff60 0x559b0635d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50560/0 (socket says 172.21.15.92:50560) 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b411ce640 1 -- 172.21.15.92:0/3803642750 learned_addr learned my addr 172.21.15.92:0/3803642750 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b419cf640 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f7f280 0x559b06351ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b411ce640 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f770a0 0x559b063519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b411ce640 1 -- 172.21.15.92:0/3803642750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f770a0 msgr2=0x559b063519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b411ce640 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f770a0 0x559b063519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b411ce640 1 -- 172.21.15.92:0/3803642750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f7f280 msgr2=0x559b06351ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b411ce640 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f7f280 0x559b06351ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b411ce640 1 -- 172.21.15.92:0/3803642750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b06275a00 con 0x559b05f9ff60 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b411ce640 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f9ff60 0x559b0635d9d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x559b06353ff0 tx=0x7f9b2c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a335c6c7b24640c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b257fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b257fa640 1 -- 172.21.15.92:0/3803642750 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c004960 con 0x559b05f9ff60 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b257fa640 1 -- 172.21.15.92:0/3803642750 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9b2c004fd0 con 0x559b05f9ff60 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.717+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3803642750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b2c0044a0 con 0x559b05f9ff60 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b257fa640 1 -- 172.21.15.92:0/3803642750 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b2c0051d0 con 0x559b05f9ff60 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b4a1a7740 10 client.15405 fetch_fsmap learned FSMap version 28 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3803642750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b063605d0 con 0x559b05f9ff60 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b257fa640 1 -- 172.21.15.92:0/3803642750 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b2c0044a0 con 0x559b05f9ff60 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b257fa640 1 -- 172.21.15.92:0/3803642750 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9b2c01c020 con 0x559b05f9ff60 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b4a1a7740 10 client.15405 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b4a1a7740 10 client.15405 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b4a1a7740 20 client.15405 populate_metadata read hostname 'smithi092' 2024-09-21T07:12:47.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b05f5e8e0 0x559b06363d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b4a1a7740 4 client.15405 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:12:47.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.718+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3803642750 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b062bfb60 con 0x559b05f5e8e0 2024-09-21T07:12:47.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.719+0000 7f9b419cf640 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b05f5e8e0 0x559b06363d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.719+0000 7f9b257fa640 10 client.15405 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:12:47.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.719+0000 7f9b419cf640 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b05f5e8e0 0x559b06363d80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a351d66916626a11 server_cookie=ba10ff5c7b98f249 in_seq=0 out_seq=0 2024-09-21T07:12:47.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b257fa640 1 -- 172.21.15.92:0/3803642750 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b062bfb60 con 0x559b05f5e8e0 2024-09-21T07:12:47.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b257fa640 10 client.15405 handle_command_reply: tid=0 2024-09-21T07:12:47.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 client.15405 shutdown 2024-09-21T07:12:47.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3803642750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f9ff60 msgr2=0x559b0635d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:47.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f9ff60 0x559b0635d9d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x559b06353ff0 tx=0x7f9b2c005f30 comp rx=0 tx=0).stop 2024-09-21T07:12:47.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3803642750 shutdown_connections 2024-09-21T07:12:47.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b05f5e8e0 0x559b06363d80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b257fa640 0 client.15405 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:12:47.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f9ff60 0x559b0635d9d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f7f280 0x559b06351ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3803642750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f770a0 0x559b063519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3803642750 >> 172.21.15.92:0/3803642750 conn(0x559b05f94350 msgr2=0x559b063490e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:47.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3803642750 shutdown_connections 2024-09-21T07:12:47.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3803642750 wait complete. 2024-09-21T07:12:47.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.720+0000 7f9b4a1a7740 20 client.15405 trim_cache size 0 max 16384 2024-09-21T07:12:47.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.738+0000 7f9b4a1a7740 1 Processor -- start 2024-09-21T07:12:47.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.738+0000 7f9b4a1a7740 1 -- start start 2024-09-21T07:12:47.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f5e8e0 0x559b0635d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f770a0 0x559b0635de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f7f280 0x559b06351980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b063620c0 con 0x559b05f770a0 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b06362790 con 0x559b05f5e8e0 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559b06362e60 con 0x559b05f7f280 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b419cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f770a0 0x559b0635de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b419cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f770a0 0x559b0635de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50576/0 (socket says 172.21.15.92:50576) 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b419cf640 1 -- 172.21.15.92:0/3449139927 learned_addr learned my addr 172.21.15.92:0/3449139927 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b411ce640 1 --2- 172.21.15.92:0/3449139927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f5e8e0 0x559b0635d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b419cf640 1 -- 172.21.15.92:0/3449139927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f7f280 msgr2=0x559b06351980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b419cf640 1 --2- 172.21.15.92:0/3449139927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f7f280 0x559b06351980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b419cf640 1 -- 172.21.15.92:0/3449139927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f5e8e0 msgr2=0x559b0635d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b419cf640 1 --2- 172.21.15.92:0/3449139927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f5e8e0 0x559b0635d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b419cf640 1 -- 172.21.15.92:0/3449139927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b063449f0 con 0x559b05f770a0 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b411ce640 1 --2- 172.21.15.92:0/3449139927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f5e8e0 0x559b0635d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:47.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b419cf640 1 --2- 172.21.15.92:0/3449139927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f770a0 0x559b0635de80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802a930 tx=0x7f9b38004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed8fd0bf436aac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:47.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b277fe640 1 -- 172.21.15.92:0/3449139927 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38035040 con 0x559b05f770a0 2024-09-21T07:12:47.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b277fe640 1 -- 172.21.15.92:0/3449139927 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b38004490 con 0x559b05f770a0 2024-09-21T07:12:47.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.739+0000 7f9b277fe640 1 -- 172.21.15.92:0/3449139927 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38003e60 con 0x559b05f770a0 2024-09-21T07:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.740+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3449139927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f770a0 msgr2=0x559b0635de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.740+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3449139927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f770a0 0x559b0635de80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802a930 tx=0x7f9b38004360 comp rx=0 tx=0).stop 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.740+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3449139927 shutdown_connections 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.740+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3449139927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f7f280 0x559b06351980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.740+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3449139927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f770a0 0x559b0635de80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.740+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/3449139927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f5e8e0 0x559b0635d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.740+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3449139927 >> 172.21.15.92:0/3449139927 conn(0x559b05f94350 msgr2=0x559b0634c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.740+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3449139927 shutdown_connections 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.740+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/3449139927 wait complete. 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.741+0000 7f9b4a1a7740 1 -- start start 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.741+0000 7f9b4a1a7740 1 Processor -- start 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.741+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f5e8e0 0x559b063657d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.741+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f770a0 0x559b06365d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.741+0000 7f9b4a1a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b0636add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.741+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b06363c00 con 0x559b05f7f280 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.741+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b06363530 con 0x559b05f770a0 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.741+0000 7f9b4a1a7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559b063642d0 con 0x559b05f5e8e0 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b4a1a7740 10 client.0 _ll_register_callbacks cb 0x7f9b2c0123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b411ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b0636add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b411ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b0636add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50584/0 (socket says 172.21.15.92:50584) 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b411ce640 1 -- 172.21.15.92:0/1603962474 learned_addr learned my addr 172.21.15.92:0/1603962474 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b411ce640 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f5e8e0 0x559b063657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b419cf640 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f770a0 0x559b06365d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b411ce640 1 -- 172.21.15.92:0/1603962474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f5e8e0 msgr2=0x559b063657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b411ce640 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f5e8e0 0x559b063657d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b411ce640 1 -- 172.21.15.92:0/1603962474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f770a0 msgr2=0x559b06365d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b411ce640 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f770a0 0x559b06365d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b411ce640 1 -- 172.21.15.92:0/1603962474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0636b440 con 0x559b05f7f280 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b411ce640 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b0636add0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00b8a0 tx=0x7f9b2c00bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bce1af4015f04b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b257fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b257fa640 1 -- 172.21.15.92:0/1603962474 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c012140 con 0x559b05f7f280 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b257fa640 1 -- 172.21.15.92:0/1603962474 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9b2c004960 con 0x559b05f7f280 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/1603962474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b38004490 con 0x559b05f7f280 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b257fa640 1 -- 172.21.15.92:0/1603962474 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b2c03f050 con 0x559b05f7f280 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b4a1a7740 10 client.15411 fetch_fsmap learned FSMap version 28 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.742+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/1603962474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b0636c7a0 con 0x559b05f7f280 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.743+0000 7f9b257fa640 1 -- 172.21.15.92:0/1603962474 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b38004490 con 0x559b05f7f280 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.743+0000 7f9b257fa640 1 -- 172.21.15.92:0/1603962474 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9b2c035030 con 0x559b05f7f280 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.743+0000 7f9b4a1a7740 10 client.15411 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.743+0000 7f9b4a1a7740 10 client.15411 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.743+0000 7f9b4a1a7740 20 client.15411 populate_metadata read hostname 'smithi092' 2024-09-21T07:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.743+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b05f9ff60 0x559b063d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:47.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.743+0000 7f9b4a1a7740 4 client.15411 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:12:47.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.743+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/1603962474 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "status"}) -- 0x559b062bb610 con 0x559b05f9ff60 2024-09-21T07:12:47.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.743+0000 7f9b419cf640 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b05f9ff60 0x559b063d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:47.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b257fa640 10 client.15411 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b419cf640 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b05f9ff60 0x559b063d2330 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b316742a41f7fea server_cookie=ae908ddfee656300 in_seq=0 out_seq=0 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b257fa640 1 -- 172.21.15.92:0/1603962474 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x559b062bb610 con 0x559b05f9ff60 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b257fa640 10 client.15411 handle_command_reply: tid=0 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 client.15411 shutdown 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/1603962474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 msgr2=0x559b0636add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b0636add0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00b8a0 tx=0x7f9b2c00bd40 comp rx=0 tx=0).stop 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/1603962474 shutdown_connections 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b05f9ff60 0x559b063d2330 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b05f7f280 0x559b0636add0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b05f770a0 0x559b06365d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b257fa640 0 client.15411 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 --2- 172.21.15.92:0/1603962474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b05f5e8e0 0x559b063657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/1603962474 >> 172.21.15.92:0/1603962474 conn(0x559b05f94350 msgr2=0x559b0634ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:47.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/1603962474 shutdown_connections 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 1 -- 172.21.15.92:0/1603962474 wait complete. 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.744+0000 7f9b4a1a7740 20 client.15411 trim_cache size 0 max 16384 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24649, 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 113.257458091, 2024-09-21T07:12:47.752 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 28, 2024-09-21T07:12:47.753 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:12:47.753 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T07:12:47.753 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 132.910865855 2024-09-21T07:12:47.753 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:12:47.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 -- 172.21.15.92:0/593126740 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b280b6560 msgr2=0x7f9b280b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:47.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b280b6560 0x7f9b280b8a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9b340aa9c0 tx=0x7f9b340de140 comp rx=0 tx=0).stop 2024-09-21T07:12:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 -- 172.21.15.92:0/593126740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b3c109df0 msgr2=0x7f9b3c19fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b3c109df0 0x7f9b3c19fc10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400eaa0 tx=0x7f9b3400ef60 comp rx=0 tx=0).stop 2024-09-21T07:12:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 -- 172.21.15.92:0/593126740 shutdown_connections 2024-09-21T07:12:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b280b6560 0x7f9b280b8a70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b3c109df0 0x7f9b3c19fc10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b3c1094a0 0x7f9b3c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 --2- 172.21.15.92:0/593126740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b3c103b60 0x7f9b3c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 -- 172.21.15.92:0/593126740 >> 172.21.15.92:0/593126740 conn(0x7f9b3c07b850 msgr2=0x7f9b3c1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 -- 172.21.15.92:0/593126740 shutdown_connections 2024-09-21T07:12:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:47.745+0000 7f9b43c33640 1 -- 172.21.15.92:0/593126740 wait complete. 2024-09-21T07:12:48.494 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T07:12:48.495 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:12:48.503 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T07:12:48.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T07:12:48.749 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:48 smithi092 ceph-mon[30987]: pgmap v331: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T07:12:49.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:48 smithi175 ceph-mon[34064]: pgmap v331: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T07:12:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:48 smithi169 ceph-mon[33705]: pgmap v331: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T07:12:49.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.278+0000 7f3fe7c49640 1 -- 172.21.15.92:0/3786654234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe0103100 msgr2=0x7f3fe0107630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.278+0000 7f3fe7c49640 1 --2- 172.21.15.92:0/3786654234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe0103100 0x7f3fe0107630 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009930 tx=0x7f3fd002a420 comp rx=0 tx=0).stop 2024-09-21T07:12:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.278+0000 7f3fe7c49640 1 -- 172.21.15.92:0/3786654234 shutdown_connections 2024-09-21T07:12:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.278+0000 7f3fe7c49640 1 --2- 172.21.15.92:0/3786654234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe0107bf0 0x7f3fe01080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.278+0000 7f3fe7c49640 1 --2- 172.21.15.92:0/3786654234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe0103100 0x7f3fe0107630 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.278+0000 7f3fe7c49640 1 --2- 172.21.15.92:0/3786654234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fe01027b0 0x7f3fe0102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.278+0000 7f3fe7c49640 1 -- 172.21.15.92:0/3786654234 >> 172.21.15.92:0/3786654234 conn(0x7f3fe0079710 msgr2=0x7f3fe0079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.279+0000 7f3fe7c49640 1 -- 172.21.15.92:0/3786654234 shutdown_connections 2024-09-21T07:12:49.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.279+0000 7f3fe7c49640 1 -- 172.21.15.92:0/3786654234 wait complete. 2024-09-21T07:12:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.279+0000 7f3fe7c49640 1 Processor -- start 2024-09-21T07:12:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.279+0000 7f3fe7c49640 1 -- start start 2024-09-21T07:12:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe7c49640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe01027b0 0x7f3fe01a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe7c49640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fe0103100 0x7f3fe01a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe7c49640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe0107bf0 0x7f3fe01a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe7c49640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0119f10 con 0x7f3fe01027b0 2024-09-21T07:12:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe7c49640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0119d90 con 0x7f3fe0103100 2024-09-21T07:12:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe7c49640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe011a090 con 0x7f3fe0107bf0 2024-09-21T07:12:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe59e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe01027b0 0x7f3fe01a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe59e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe01027b0 0x7f3fe01a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50610/0 (socket says 172.21.15.92:50610) 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe59e5640 1 -- 172.21.15.92:0/2697112291 learned_addr learned my addr 172.21.15.92:0/2697112291 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe61e6640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe0107bf0 0x7f3fe01a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe51e4640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fe0103100 0x7f3fe01a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe59e5640 1 -- 172.21.15.92:0/2697112291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe0107bf0 msgr2=0x7f3fe01a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe59e5640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe0107bf0 0x7f3fe01a6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe59e5640 1 -- 172.21.15.92:0/2697112291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fe0103100 msgr2=0x7f3fe01a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe59e5640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fe0103100 0x7f3fe01a0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe59e5640 1 -- 172.21.15.92:0/2697112291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe01a69b0 con 0x7f3fe01027b0 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe51e4640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fe0103100 0x7f3fe01a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fe59e5640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe01027b0 0x7f3fe01a0a40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400eab0 tx=0x7f3fd400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.280+0000 7f3fdeffd640 1 -- 172.21.15.92:0/2697112291 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400ce40 con 0x7f3fe01027b0 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.281+0000 7f3fdeffd640 1 -- 172.21.15.92:0/2697112291 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fd4011900 con 0x7f3fe01027b0 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.281+0000 7f3fdeffd640 1 -- 172.21.15.92:0/2697112291 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4010990 con 0x7f3fe01027b0 2024-09-21T07:12:49.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.281+0000 7f3fe7c49640 1 -- 172.21.15.92:0/2697112291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe01a6ca0 con 0x7f3fe01027b0 2024-09-21T07:12:49.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.281+0000 7f3fe7c49640 1 -- 172.21.15.92:0/2697112291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe01ad400 con 0x7f3fe01027b0 2024-09-21T07:12:49.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.282+0000 7f3fe7c49640 1 -- 172.21.15.92:0/2697112291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe006c280 con 0x7f3fe01027b0 2024-09-21T07:12:49.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.283+0000 7f3fdeffd640 1 -- 172.21.15.92:0/2697112291 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f3fd4011470 con 0x7f3fe01027b0 2024-09-21T07:12:49.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.284+0000 7f3fdeffd640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3fc80b6560 0x7f3fc80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:49.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.284+0000 7f3fe51e4640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3fc80b6560 0x7f3fc80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:49.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.284+0000 7f3fdeffd640 1 -- 172.21.15.92:0/2697112291 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3fd40e7f20 con 0x7f3fe01027b0 2024-09-21T07:12:49.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.284+0000 7f3fe51e4640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3fc80b6560 0x7f3fc80b8a70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0006010 tx=0x7f3fd0000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:49.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.287+0000 7f3fdeffd640 1 -- 172.21.15.92:0/2697112291 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3fd4016030 con 0x7f3fe01027b0 2024-09-21T07:12:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.481+0000 7f3fe7c49640 1 -- 172.21.15.92:0/2697112291 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f3fe0106d20 con 0x7f3fc80b6560 2024-09-21T07:12:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.482+0000 7f3fdeffd640 1 -- 172.21.15.92:0/2697112291 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f3fe0106d20 con 0x7f3fc80b6560 2024-09-21T07:12:49.484 INFO:teuthology.orchestra.run.smithi092.stdout:Backend: cephadm 2024-09-21T07:12:49.484 INFO:teuthology.orchestra.run.smithi092.stdout:Available: Yes 2024-09-21T07:12:49.484 INFO:teuthology.orchestra.run.smithi092.stdout:Paused: No 2024-09-21T07:12:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.484+0000 7f3fe7c49640 1 -- 172.21.15.92:0/2697112291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3fc80b6560 msgr2=0x7f3fc80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.484+0000 7f3fe7c49640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3fc80b6560 0x7f3fc80b8a70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0006010 tx=0x7f3fd0000bc0 comp rx=0 tx=0).stop 2024-09-21T07:12:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.485+0000 7f3fe7c49640 1 -- 172.21.15.92:0/2697112291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe01027b0 msgr2=0x7f3fe01a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.485+0000 7f3fe7c49640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe01027b0 0x7f3fe01a0a40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400eab0 tx=0x7f3fd400ef70 comp rx=0 tx=0).stop 2024-09-21T07:12:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.485+0000 7f3fe7c49640 1 -- 172.21.15.92:0/2697112291 shutdown_connections 2024-09-21T07:12:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.485+0000 7f3fe7c49640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3fc80b6560 0x7f3fc80b8a70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.485+0000 7f3fe7c49640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe0107bf0 0x7f3fe01a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.485+0000 7f3fe7c49640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3fe0103100 0x7f3fe01a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.485+0000 7f3fe7c49640 1 --2- 172.21.15.92:0/2697112291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe01027b0 0x7f3fe01a0a40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.485+0000 7f3fe7c49640 1 -- 172.21.15.92:0/2697112291 >> 172.21.15.92:0/2697112291 conn(0x7f3fe0079710 msgr2=0x7f3fe0105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.485+0000 7f3fe7c49640 1 -- 172.21.15.92:0/2697112291 shutdown_connections 2024-09-21T07:12:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:49.485+0000 7f3fe7c49640 1 -- 172.21.15.92:0/2697112291 wait complete. 2024-09-21T07:12:50.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T07:12:50.485 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:50.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:50 smithi092 ceph-mon[30987]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:50.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:50 smithi092 ceph-mon[30987]: pgmap v332: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T07:12:50.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.978+0000 7fad388ff640 1 -- 172.21.15.92:0/3689933094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad34102a60 msgr2=0x7fad34102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:50.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.978+0000 7fad388ff640 1 --2- 172.21.15.92:0/3689933094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad34102a60 0x7fad34102e70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fad24009900 tx=0x7fad2402a410 comp rx=0 tx=0).stop 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.978+0000 7fad388ff640 1 -- 172.21.15.92:0/3689933094 shutdown_connections 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.978+0000 7fad388ff640 1 --2- 172.21.15.92:0/3689933094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad34108cf0 0x7fad3410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.978+0000 7fad388ff640 1 --2- 172.21.15.92:0/3689933094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad341083a0 0x7fad341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.978+0000 7fad388ff640 1 --2- 172.21.15.92:0/3689933094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad34102a60 0x7fad34102e70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.978+0000 7fad388ff640 1 -- 172.21.15.92:0/3689933094 >> 172.21.15.92:0/3689933094 conn(0x7fad34079730 msgr2=0x7fad34079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.978+0000 7fad388ff640 1 -- 172.21.15.92:0/3689933094 shutdown_connections 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.978+0000 7fad388ff640 1 -- 172.21.15.92:0/3689933094 wait complete. 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad388ff640 1 Processor -- start 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad388ff640 1 -- start start 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad388ff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad34102a60 0x7fad3419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad388ff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341083a0 0x7fad3419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad388ff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad34108cf0 0x7fad3419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:50.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad388ff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fad34113930 con 0x7fad34108cf0 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad388ff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fad341137b0 con 0x7fad34102a60 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad388ff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad34113ab0 con 0x7fad341083a0 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad32d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad34108cf0 0x7fad3419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad32d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad34108cf0 0x7fad3419fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42204/0 (socket says 172.21.15.92:42204) 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.979+0000 7fad32d9d640 1 -- 172.21.15.92:0/2224591194 learned_addr learned my addr 172.21.15.92:0/2224591194 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad3259c640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad34102a60 0x7fad3419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad31d9b640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341083a0 0x7fad3419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad32d9d640 1 -- 172.21.15.92:0/2224591194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341083a0 msgr2=0x7fad3419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad32d9d640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341083a0 0x7fad3419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad32d9d640 1 -- 172.21.15.92:0/2224591194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad34102a60 msgr2=0x7fad3419a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad32d9d640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad34102a60 0x7fad3419a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad32d9d640 1 -- 172.21.15.92:0/2224591194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad341a0330 con 0x7fad34108cf0 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad31d9b640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341083a0 0x7fad3419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:50.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad32d9d640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad34108cf0 0x7fad3419fc00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00cad0 tx=0x7fad2c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad237fe640 1 -- 172.21.15.92:0/2224591194 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c00ae20 con 0x7fad34108cf0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad388ff640 1 -- 172.21.15.92:0/2224591194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad341a0620 con 0x7fad34108cf0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad237fe640 1 -- 172.21.15.92:0/2224591194 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad2c005020 con 0x7fad34108cf0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad237fe640 1 -- 172.21.15.92:0/2224591194 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c00f6b0 con 0x7fad34108cf0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.980+0000 7fad388ff640 1 -- 172.21.15.92:0/2224591194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad341a6d80 con 0x7fad34108cf0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.981+0000 7fad388ff640 1 -- 172.21.15.92:0/2224591194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad34103ce0 con 0x7fad34108cf0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.983+0000 7fad237fe640 1 -- 172.21.15.92:0/2224591194 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fad2c0051d0 con 0x7fad34108cf0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.983+0000 7fad237fe640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fad1c0b6560 0x7fad1c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.983+0000 7fad3259c640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fad1c0b6560 0x7fad1c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.983+0000 7fad237fe640 1 -- 172.21.15.92:0/2224591194 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fad2c0e7c00 con 0x7fad34108cf0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.984+0000 7fad3259c640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fad1c0b6560 0x7fad1c0b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad240057c0 tx=0x7fad240058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:50.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:50.986+0000 7fad237fe640 1 -- 172.21.15.92:0/2224591194 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad2c014030 con 0x7fad34108cf0 2024-09-21T07:12:51.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:50 smithi175 ceph-mon[34064]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:51.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:50 smithi175 ceph-mon[34064]: pgmap v332: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T07:12:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:50 smithi169 ceph-mon[33705]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:50 smithi169 ceph-mon[33705]: pgmap v332: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T07:12:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.173+0000 7fad388ff640 1 -- 172.21.15.92:0/2224591194 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fad34063800 con 0x7fad1c0b6560 2024-09-21T07:12:51.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.185+0000 7fad237fe640 1 -- 172.21.15.92:0/2224591194 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fad34063800 con 0x7fad1c0b6560 2024-09-21T07:12:51.187 INFO:teuthology.orchestra.run.smithi092.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T07:12:51.187 INFO:teuthology.orchestra.run.smithi092.stdout:mds.a smithi092 running (2m) 59s ago 2m 83.2M - 19.3.0-5120-g18432218 ddce307e1f32 1068d396bab3 2024-09-21T07:12:51.187 INFO:teuthology.orchestra.run.smithi092.stdout:mds.b smithi169 running (2m) 60s ago 2m 85.1M - 19.3.0-5120-g18432218 ddce307e1f32 9c04609fae8d 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mds.c smithi175 running (2m) 60s ago 2m 87.7M - 19.3.0-5120-g18432218 ddce307e1f32 e8af9bae0688 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mds.d smithi092 running (2m) 59s ago 2m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 5c4964628a8c 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mds.e smithi169 running (2m) 60s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 032f8a712570 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mds.f smithi175 running (2m) 60s ago 2m 85.4M - 19.3.0-5120-g18432218 ddce307e1f32 9488da2c92ef 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mds.g smithi092 running (2m) 59s ago 2m 83.4M - 19.3.0-5120-g18432218 ddce307e1f32 ee112da5b2b7 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mds.h smithi169 running (2m) 60s ago 2m 83.1M - 19.3.0-5120-g18432218 ddce307e1f32 5ca148c1383d 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mds.i smithi175 running (2m) 60s ago 2m 96.4M - 19.3.0-5120-g18432218 ddce307e1f32 af8396561968 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mds.j smithi092 running (2m) 59s ago 2m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 c66e82f8f177 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mds.k smithi169 running (2m) 60s ago 2m 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 df9288155f36 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mds.l smithi175 running (2m) 60s ago 2m 85.8M - 19.3.0-5120-g18432218 ddce307e1f32 4a49adc8976f 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.x smithi092 *:9283,8765 running (10m) 59s ago 10m 588M - 19.3.0-5120-g18432218 ddce307e1f32 91da80ed985b 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.y smithi169 *:8443,8765 running (8m) 60s ago 8m 524M - 19.3.0-5120-g18432218 ddce307e1f32 1d315b83ec91 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.z smithi175 *:8443,8765 running (8m) 60s ago 8m 524M - 19.3.0-5120-g18432218 ddce307e1f32 aab098ccbcb8 2024-09-21T07:12:51.188 INFO:teuthology.orchestra.run.smithi092.stdout:mon.a smithi092 running (10m) 59s ago 10m 120M 2048M 19.3.0-5120-g18432218 ddce307e1f32 a452205d9dca 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:mon.b smithi169 running (8m) 60s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 20f3cdf1dfe8 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:mon.c smithi175 running (9m) 60s ago 9m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 03a4403fc4cc 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 smithi092 running (7m) 59s ago 7m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 e1181f18ffcf 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 smithi169 running (7m) 60s ago 7m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ed630779088f 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 smithi175 running (6m) 60s ago 6m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a89fd8286cf8 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 smithi092 running (6m) 59s ago 6m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 4ac82081db89 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 smithi169 running (5m) 60s ago 5m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 890813c3a09e 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 smithi175 running (5m) 60s ago 5m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ec7f2a5d5674 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 smithi092 running (5m) 59s ago 5m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 d2d28fe2b5a1 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 smithi169 running (4m) 60s ago 4m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 67de1579b5f9 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.8 smithi175 running (4m) 60s ago 4m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 6f2579e078c5 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.9 smithi092 running (3m) 59s ago 3m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f0d9d7a990be 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.10 smithi169 running (3m) 60s ago 3m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 004422d9502b 2024-09-21T07:12:51.189 INFO:teuthology.orchestra.run.smithi092.stdout:osd.11 smithi175 running (2m) 60s ago 2m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 08574e9f387c 2024-09-21T07:12:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.187+0000 7fad388ff640 1 -- 172.21.15.92:0/2224591194 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fad1c0b6560 msgr2=0x7fad1c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.187+0000 7fad388ff640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fad1c0b6560 0x7fad1c0b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad240057c0 tx=0x7fad240058d0 comp rx=0 tx=0).stop 2024-09-21T07:12:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.187+0000 7fad388ff640 1 -- 172.21.15.92:0/2224591194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad34108cf0 msgr2=0x7fad3419fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.187+0000 7fad388ff640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad34108cf0 0x7fad3419fc00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00cad0 tx=0x7fad2c00cf90 comp rx=0 tx=0).stop 2024-09-21T07:12:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.188+0000 7fad388ff640 1 -- 172.21.15.92:0/2224591194 shutdown_connections 2024-09-21T07:12:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.188+0000 7fad388ff640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fad1c0b6560 0x7fad1c0b8a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.188+0000 7fad388ff640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad34108cf0 0x7fad3419fc00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.188+0000 7fad388ff640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341083a0 0x7fad3419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.188+0000 7fad388ff640 1 --2- 172.21.15.92:0/2224591194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad34102a60 0x7fad3419a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.188+0000 7fad388ff640 1 -- 172.21.15.92:0/2224591194 >> 172.21.15.92:0/2224591194 conn(0x7fad34079730 msgr2=0x7fad341015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.188+0000 7fad388ff640 1 -- 172.21.15.92:0/2224591194 shutdown_connections 2024-09-21T07:12:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:51.188+0000 7fad388ff640 1 -- 172.21.15.92:0/2224591194 wait complete. 2024-09-21T07:12:52.008 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T07:12:52.268 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:52.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.771+0000 7fce412d2640 1 -- 172.21.15.92:0/705518031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce3c10de10 msgr2=0x7fce3c110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:52.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.771+0000 7fce412d2640 1 --2- 172.21.15.92:0/705518031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce3c10de10 0x7fce3c110300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fce34009900 tx=0x7fce3402a410 comp rx=0 tx=0).stop 2024-09-21T07:12:52.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.772+0000 7fce412d2640 1 -- 172.21.15.92:0/705518031 shutdown_connections 2024-09-21T07:12:52.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.772+0000 7fce412d2640 1 --2- 172.21.15.92:0/705518031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce3c10de10 0x7fce3c110300 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.772+0000 7fce412d2640 1 --2- 172.21.15.92:0/705518031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3c105300 0x7fce3c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.772+0000 7fce412d2640 1 --2- 172.21.15.92:0/705518031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce3c1049b0 0x7fce3c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.772+0000 7fce412d2640 1 -- 172.21.15.92:0/705518031 >> 172.21.15.92:0/705518031 conn(0x7fce3c079730 msgr2=0x7fce3c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.772+0000 7fce412d2640 1 -- 172.21.15.92:0/705518031 shutdown_connections 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.772+0000 7fce412d2640 1 -- 172.21.15.92:0/705518031 wait complete. 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.772+0000 7fce412d2640 1 Processor -- start 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.772+0000 7fce412d2640 1 -- start start 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce412d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce3c1049b0 0x7fce3c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce412d2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce3c105300 0x7fce3c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce412d2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3c10de10 0x7fce3c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce412d2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c113920 con 0x7fce3c1049b0 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce412d2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1137a0 con 0x7fce3c105300 2024-09-21T07:12:52.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce412d2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c113aa0 con 0x7fce3c10de10 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce3c1049b0 0x7fce3c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce3c1049b0 0x7fce3c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42222/0 (socket says 172.21.15.92:42222) 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3affd640 1 -- 172.21.15.92:0/3472373257 learned_addr learned my addr 172.21.15.92:0/3472373257 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3a7fc640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce3c105300 0x7fce3c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3b7fe640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3c10de10 0x7fce3c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3affd640 1 -- 172.21.15.92:0/3472373257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3c10de10 msgr2=0x7fce3c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3affd640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3c10de10 0x7fce3c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3affd640 1 -- 172.21.15.92:0/3472373257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce3c105300 msgr2=0x7fce3c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3affd640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce3c105300 0x7fce3c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3affd640 1 -- 172.21.15.92:0/3472373257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c1a02a0 con 0x7fce3c1049b0 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.773+0000 7fce3affd640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce3c1049b0 0x7fce3c19a330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00ebc0 tx=0x7fce2c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:52.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.774+0000 7fce33fff640 1 -- 172.21.15.92:0/3472373257 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c003b70 con 0x7fce3c1049b0 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.774+0000 7fce33fff640 1 -- 172.21.15.92:0/3472373257 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce2c003d10 con 0x7fce3c1049b0 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.774+0000 7fce412d2640 1 -- 172.21.15.92:0/3472373257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c1a0590 con 0x7fce3c1049b0 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.774+0000 7fce33fff640 1 -- 172.21.15.92:0/3472373257 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0196e0 con 0x7fce3c1049b0 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.774+0000 7fce412d2640 1 -- 172.21.15.92:0/3472373257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c1a6cf0 con 0x7fce3c1049b0 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.775+0000 7fce412d2640 1 -- 172.21.15.92:0/3472373257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c104dc0 con 0x7fce3c1049b0 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.776+0000 7fce33fff640 1 -- 172.21.15.92:0/3472373257 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fce2c004b60 con 0x7fce3c1049b0 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.777+0000 7fce33fff640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fce280b6560 0x7fce280b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.777+0000 7fce3a7fc640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fce280b6560 0x7fce280b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.777+0000 7fce33fff640 1 -- 172.21.15.92:0/3472373257 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fce2c0e81f0 con 0x7fce3c1049b0 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.777+0000 7fce3a7fc640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fce280b6560 0x7fce280b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fce3c1023e0 tx=0x7fce2400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:52.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.780+0000 7fce33fff640 1 -- 172.21.15.92:0/3472373257 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce2c0ae650 con 0x7fce3c1049b0 2024-09-21T07:12:52.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:52 smithi169 ceph-mon[33705]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:52.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:52 smithi169 ceph-mon[33705]: pgmap v333: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:12:52.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:52 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:12:52.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.980+0000 7fce412d2640 1 -- 172.21.15.92:0/3472373257 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fce3c063800 con 0x7fce280b6560 2024-09-21T07:12:52.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:52 smithi092 ceph-mon[30987]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:52.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:52 smithi092 ceph-mon[30987]: pgmap v333: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:12:52.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:52 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:12:52.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.986+0000 7fce33fff640 1 -- 172.21.15.92:0/3472373257 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fce3c063800 con 0x7fce280b6560 2024-09-21T07:12:52.988 INFO:teuthology.orchestra.run.smithi092.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T07:12:52.988 INFO:teuthology.orchestra.run.smithi092.stdout:mds.all 12/12 62s ago 2m smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi169=b;smithi169=e;smithi169=h;smithi169=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-21T07:12:52.988 INFO:teuthology.orchestra.run.smithi092.stdout:mgr 3/3 62s ago 8m smithi092=x;smithi169=y;smithi175=z;count:3 2024-09-21T07:12:52.988 INFO:teuthology.orchestra.run.smithi092.stdout:mon 3/3 62s ago 9m smithi092:172.21.15.92=a;smithi169:172.21.15.169=b;smithi175:172.21.15.175=c;count:3 2024-09-21T07:12:52.988 INFO:teuthology.orchestra.run.smithi092.stdout:osd 12 62s ago - 2024-09-21T07:12:52.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 -- 172.21.15.92:0/3472373257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fce280b6560 msgr2=0x7fce280b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:52.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fce280b6560 0x7fce280b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fce3c1023e0 tx=0x7fce2400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 -- 172.21.15.92:0/3472373257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce3c1049b0 msgr2=0x7fce3c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:52.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce3c1049b0 0x7fce3c19a330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00ebc0 tx=0x7fce2c00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 -- 172.21.15.92:0/3472373257 shutdown_connections 2024-09-21T07:12:52.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fce280b6560 0x7fce280b8a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3c10de10 0x7fce3c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce3c105300 0x7fce3c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 --2- 172.21.15.92:0/3472373257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce3c1049b0 0x7fce3c19a330 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:52.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 -- 172.21.15.92:0/3472373257 >> 172.21.15.92:0/3472373257 conn(0x7fce3c079730 msgr2=0x7fce3c100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:52.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 -- 172.21.15.92:0/3472373257 shutdown_connections 2024-09-21T07:12:52.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:52.988+0000 7fce412d2640 1 -- 172.21.15.92:0/3472373257 wait complete. 2024-09-21T07:12:53.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:52 smithi175 ceph-mon[34064]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:53.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:52 smithi175 ceph-mon[34064]: pgmap v333: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:12:53.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:52 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:12:53.903 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T07:12:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:54 smithi092 ceph-mon[30987]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:54 smithi092 ceph-mon[30987]: pgmap v334: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:12:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:54 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:54 smithi175 ceph-mon[34064]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:54.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:54 smithi175 ceph-mon[34064]: pgmap v334: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:12:54.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:54 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:54 smithi169 ceph-mon[33705]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:54.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:54 smithi169 ceph-mon[33705]: pgmap v334: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:12:54.894 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:54 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:54.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.973+0000 7f5eec0c8640 1 -- 172.21.15.92:0/4164713879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee41083a0 msgr2=0x7f5ee41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:54.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.973+0000 7f5eec0c8640 1 --2- 172.21.15.92:0/4164713879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee41083a0 0x7f5ee41087b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009900 tx=0x7f5ed402a410 comp rx=0 tx=0).stop 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.973+0000 7f5eec0c8640 1 -- 172.21.15.92:0/4164713879 shutdown_connections 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.973+0000 7f5eec0c8640 1 --2- 172.21.15.92:0/4164713879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ee4108cf0 0x7f5ee410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.973+0000 7f5eec0c8640 1 --2- 172.21.15.92:0/4164713879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee41083a0 0x7f5ee41087b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.973+0000 7f5eec0c8640 1 --2- 172.21.15.92:0/4164713879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee4102a60 0x7f5ee4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.973+0000 7f5eec0c8640 1 -- 172.21.15.92:0/4164713879 >> 172.21.15.92:0/4164713879 conn(0x7f5ee4079730 msgr2=0x7f5ee4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.973+0000 7f5eec0c8640 1 -- 172.21.15.92:0/4164713879 shutdown_connections 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.973+0000 7f5eec0c8640 1 -- 172.21.15.92:0/4164713879 wait complete. 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.974+0000 7f5eec0c8640 1 Processor -- start 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.974+0000 7f5eec0c8640 1 -- start start 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.974+0000 7f5eec0c8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ee4102a60 0x7f5ee419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.974+0000 7f5eec0c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee41083a0 0x7f5ee419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.974+0000 7f5eec0c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee4108cf0 0x7f5ee419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:54.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.974+0000 7f5eec0c8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee4112810 con 0x7f5ee4108cf0 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.974+0000 7f5eec0c8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee4112690 con 0x7f5ee4102a60 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.974+0000 7f5eec0c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee4112990 con 0x7f5ee41083a0 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eea665640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee4108cf0 0x7f5ee419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eea665640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee4108cf0 0x7f5ee419bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42240/0 (socket says 172.21.15.92:42240) 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eea665640 1 -- 172.21.15.92:0/124214318 learned_addr learned my addr 172.21.15.92:0/124214318 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5ee9663640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee41083a0 0x7f5ee419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5ee9e64640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ee4102a60 0x7f5ee419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eea665640 1 -- 172.21.15.92:0/124214318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee41083a0 msgr2=0x7f5ee419b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eea665640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee41083a0 0x7f5ee419b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eea665640 1 -- 172.21.15.92:0/124214318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ee4102a60 msgr2=0x7f5ee419b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eea665640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ee4102a60 0x7f5ee419b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eea665640 1 -- 172.21.15.92:0/124214318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee41a64a0 con 0x7f5ee4108cf0 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5ee9e64640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ee4102a60 0x7f5ee419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:12:54.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eea665640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee4108cf0 0x7f5ee419bc60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009fd0 tx=0x7f5edc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5edaffd640 1 -- 172.21.15.92:0/124214318 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc017070 con 0x7f5ee4108cf0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5edaffd640 1 -- 172.21.15.92:0/124214318 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5edc003e00 con 0x7f5ee4108cf0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eec0c8640 1 -- 172.21.15.92:0/124214318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee41a6790 con 0x7f5ee4108cf0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5edaffd640 1 -- 172.21.15.92:0/124214318 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc010460 con 0x7f5ee4108cf0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.975+0000 7f5eec0c8640 1 -- 172.21.15.92:0/124214318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee41a6c50 con 0x7f5ee4108cf0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.976+0000 7f5eec0c8640 1 -- 172.21.15.92:0/124214318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee4102e70 con 0x7f5ee4108cf0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.978+0000 7f5edaffd640 1 -- 172.21.15.92:0/124214318 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f5edc003970 con 0x7f5ee4108cf0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.978+0000 7f5edaffd640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5ed00b6560 0x7f5ed00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.979+0000 7f5ee9e64640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5ed00b6560 0x7f5ed00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.979+0000 7f5edaffd640 1 -- 172.21.15.92:0/124214318 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f5edc0e7940 con 0x7f5ee4108cf0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.979+0000 7f5ee9e64640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5ed00b6560 0x7f5ed00b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5ee406b9e0 tx=0x7f5ee0005e70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:54.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:54.982+0000 7f5edaffd640 1 -- 172.21.15.92:0/124214318 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5edc0add10 con 0x7f5ee4108cf0 2024-09-21T07:12:55.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.196+0000 7f5eec0c8640 1 -- 172.21.15.92:0/124214318 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5ee4063800 con 0x7f5ed00b6560 2024-09-21T07:12:55.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.198+0000 7f5edaffd640 1 -- 172.21.15.92:0/124214318 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f5ee4063800 con 0x7f5ed00b6560 2024-09-21T07:12:55.200 INFO:teuthology.orchestra.run.smithi092.stdout:HOST ADDR LABELS STATUS 2024-09-21T07:12:55.200 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 172.21.15.92 2024-09-21T07:12:55.200 INFO:teuthology.orchestra.run.smithi092.stdout:smithi169 172.21.15.169 2024-09-21T07:12:55.200 INFO:teuthology.orchestra.run.smithi092.stdout:smithi175 172.21.15.175 2024-09-21T07:12:55.200 INFO:teuthology.orchestra.run.smithi092.stdout:3 hosts in cluster 2024-09-21T07:12:55.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.200+0000 7f5eec0c8640 1 -- 172.21.15.92:0/124214318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5ed00b6560 msgr2=0x7f5ed00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:55.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.200+0000 7f5eec0c8640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5ed00b6560 0x7f5ed00b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5ee406b9e0 tx=0x7f5ee0005e70 comp rx=0 tx=0).stop 2024-09-21T07:12:55.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.200+0000 7f5eec0c8640 1 -- 172.21.15.92:0/124214318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee4108cf0 msgr2=0x7f5ee419bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:55.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.200+0000 7f5eec0c8640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee4108cf0 0x7f5ee419bc60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009fd0 tx=0x7f5edc00b260 comp rx=0 tx=0).stop 2024-09-21T07:12:55.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.200+0000 7f5eec0c8640 1 -- 172.21.15.92:0/124214318 shutdown_connections 2024-09-21T07:12:55.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.200+0000 7f5eec0c8640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f5ed00b6560 0x7f5ed00b8a70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:55.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.200+0000 7f5eec0c8640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ee4108cf0 0x7f5ee419bc60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:55.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.200+0000 7f5eec0c8640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ee41083a0 0x7f5ee419b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:55.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.200+0000 7f5eec0c8640 1 --2- 172.21.15.92:0/124214318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ee4102a60 0x7f5ee419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:55.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.200+0000 7f5eec0c8640 1 -- 172.21.15.92:0/124214318 >> 172.21.15.92:0/124214318 conn(0x7f5ee4079730 msgr2=0x7f5ee4104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:55.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.201+0000 7f5eec0c8640 1 -- 172.21.15.92:0/124214318 shutdown_connections 2024-09-21T07:12:55.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:55.201+0000 7f5eec0c8640 1 -- 172.21.15.92:0/124214318 wait complete. 2024-09-21T07:12:55.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T07:12:56.116 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:56 smithi175 ceph-mon[34064]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:56 smithi175 ceph-mon[34064]: pgmap v335: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:12:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:12:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:12:56.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:56 smithi092 ceph-mon[30987]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:56 smithi092 ceph-mon[30987]: pgmap v335: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:56.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:56 smithi169 ceph-mon[33705]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:56.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:56.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:56.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:56 smithi169 ceph-mon[33705]: pgmap v335: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:12:56.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:12:56.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:12:56.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:12:56.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.632+0000 7f1fd295d640 1 -- 172.21.15.92:0/269489625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fcc103b60 msgr2=0x7f1fcc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:56.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.632+0000 7f1fd295d640 1 --2- 172.21.15.92:0/269489625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fcc103b60 0x7f1fcc103f70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009900 tx=0x7f1fbc02a410 comp rx=0 tx=0).stop 2024-09-21T07:12:56.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.632+0000 7f1fd295d640 1 -- 172.21.15.92:0/269489625 shutdown_connections 2024-09-21T07:12:56.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.632+0000 7f1fd295d640 1 --2- 172.21.15.92:0/269489625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fcc109df0 0x7f1fcc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:56.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.632+0000 7f1fd295d640 1 --2- 172.21.15.92:0/269489625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fcc1094a0 0x7f1fcc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:56.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.632+0000 7f1fd295d640 1 --2- 172.21.15.92:0/269489625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fcc103b60 0x7f1fcc103f70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:56.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.632+0000 7f1fd295d640 1 -- 172.21.15.92:0/269489625 >> 172.21.15.92:0/269489625 conn(0x7f1fcc07b850 msgr2=0x7f1fcc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:56.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.632+0000 7f1fd295d640 1 -- 172.21.15.92:0/269489625 shutdown_connections 2024-09-21T07:12:56.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.632+0000 7f1fd295d640 1 -- 172.21.15.92:0/269489625 wait complete. 2024-09-21T07:12:56.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fd295d640 1 Processor -- start 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fd295d640 1 -- start start 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fd295d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fcc103b60 0x7f1fcc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fd295d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fcc1094a0 0x7f1fcc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fd295d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fcc109df0 0x7f1fcc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fd295d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc113960 con 0x7f1fcc1094a0 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fd295d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1137e0 con 0x7f1fcc109df0 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fd295d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc113ae0 con 0x7f1fcc103b60 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fcb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fcc1094a0 0x7f1fcc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fcb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fcc1094a0 0x7f1fcc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42256/0 (socket says 172.21.15.92:42256) 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fcb7fe640 1 -- 172.21.15.92:0/3563808636 learned_addr learned my addr 172.21.15.92:0/3563808636 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fcbfff640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fcc103b60 0x7f1fcc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.633+0000 7f1fd0efa640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fcc109df0 0x7f1fcc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fcb7fe640 1 -- 172.21.15.92:0/3563808636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fcc103b60 msgr2=0x7f1fcc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:56.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fcb7fe640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fcc103b60 0x7f1fcc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fcb7fe640 1 -- 172.21.15.92:0/3563808636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fcc109df0 msgr2=0x7f1fcc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fcb7fe640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fcc109df0 0x7f1fcc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fcb7fe640 1 -- 172.21.15.92:0/3563808636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc1a8690 con 0x7f1fcc1094a0 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fcbfff640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fcc103b60 0x7f1fcc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fd0efa640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fcc109df0 0x7f1fcc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fcb7fe640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fcc1094a0 0x7f1fcc075c50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1fc000d740 tx=0x7f1fc000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fc97fa640 1 -- 172.21.15.92:0/3563808636 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0017070 con 0x7f1fcc1094a0 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fc97fa640 1 -- 172.21.15.92:0/3563808636 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1fc000de50 con 0x7f1fcc1094a0 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fd295d640 1 -- 172.21.15.92:0/3563808636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fcc1a8980 con 0x7f1fcc1094a0 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fc97fa640 1 -- 172.21.15.92:0/3563808636 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc000f620 con 0x7f1fcc1094a0 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.634+0000 7f1fd295d640 1 -- 172.21.15.92:0/3563808636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fcc1a8ec0 con 0x7f1fcc1094a0 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.635+0000 7f1fd295d640 1 -- 172.21.15.92:0/3563808636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fcc103f70 con 0x7f1fcc1094a0 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.637+0000 7f1fc97fa640 1 -- 172.21.15.92:0/3563808636 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f1fc001a070 con 0x7f1fcc1094a0 2024-09-21T07:12:56.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.637+0000 7f1fc97fa640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1fb40b6560 0x7f1fb40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:56.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.637+0000 7f1fcbfff640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1fb40b6560 0x7f1fb40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:56.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.637+0000 7f1fc97fa640 1 -- 172.21.15.92:0/3563808636 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f1fc00e7320 con 0x7f1fcc1094a0 2024-09-21T07:12:56.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.638+0000 7f1fcbfff640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1fb40b6560 0x7f1fb40b8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc006010 tx=0x7f1fbc005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:56.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.640+0000 7f1fc97fa640 1 -- 172.21.15.92:0/3563808636 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1fc00ad6f0 con 0x7f1fcc1094a0 2024-09-21T07:12:56.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.825+0000 7f1fd295d640 1 -- 172.21.15.92:0/3563808636 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f1fcc063800 con 0x7f1fb40b6560 2024-09-21T07:12:56.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.827+0000 7f1fc97fa640 1 -- 172.21.15.92:0/3563808636 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f1fcc063800 con 0x7f1fb40b6560 2024-09-21T07:12:56.829 INFO:teuthology.orchestra.run.smithi092.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T07:12:56.829 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QM400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T07:12:56.829 INFO:teuthology.orchestra.run.smithi092.stdout:smithi169 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300LN400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T07:12:56.829 INFO:teuthology.orchestra.run.smithi092.stdout:smithi175 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300M0400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T07:12:56.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 -- 172.21.15.92:0/3563808636 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1fb40b6560 msgr2=0x7f1fb40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:56.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1fb40b6560 0x7f1fb40b8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc006010 tx=0x7f1fbc005a20 comp rx=0 tx=0).stop 2024-09-21T07:12:56.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 -- 172.21.15.92:0/3563808636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fcc1094a0 msgr2=0x7f1fcc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:56.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fcc1094a0 0x7f1fcc075c50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1fc000d740 tx=0x7f1fc000dc00 comp rx=0 tx=0).stop 2024-09-21T07:12:56.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 -- 172.21.15.92:0/3563808636 shutdown_connections 2024-09-21T07:12:56.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1fb40b6560 0x7f1fb40b8a70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:56.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fcc109df0 0x7f1fcc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:56.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fcc1094a0 0x7f1fcc075c50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:56.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 --2- 172.21.15.92:0/3563808636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fcc103b60 0x7f1fcc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:56.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 -- 172.21.15.92:0/3563808636 >> 172.21.15.92:0/3563808636 conn(0x7f1fcc07b850 msgr2=0x7f1fcc107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:56.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 -- 172.21.15.92:0/3563808636 shutdown_connections 2024-09-21T07:12:56.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:56.829+0000 7f1fd295d640 1 -- 172.21.15.92:0/3563808636 wait complete. 2024-09-21T07:12:57.528 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:12:57.538 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T07:12:57.539 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T07:12:57.787 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:58.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.231+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4279314981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd301094a0 msgr2=0x7fbd301098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.231+0000 7fbd37cf4640 1 --2- 172.21.15.92:0/4279314981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd301094a0 0x7fbd301098b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009900 tx=0x7fbd2402a410 comp rx=0 tx=0).stop 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.231+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4279314981 shutdown_connections 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.231+0000 7fbd37cf4640 1 --2- 172.21.15.92:0/4279314981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd30109df0 0x7fbd30110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.231+0000 7fbd37cf4640 1 --2- 172.21.15.92:0/4279314981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd301094a0 0x7fbd301098b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.232+0000 7fbd37cf4640 1 --2- 172.21.15.92:0/4279314981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd30103b60 0x7fbd30103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.232+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4279314981 >> 172.21.15.92:0/4279314981 conn(0x7fbd3007b850 msgr2=0x7fbd3007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.232+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4279314981 shutdown_connections 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.232+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4279314981 wait complete. 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd37cf4640 1 Processor -- start 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd37cf4640 1 -- start start 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd37cf4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd30103b60 0x7fbd3019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:58.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd37cf4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd301094a0 0x7fbd3019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd37cf4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd30109df0 0x7fbd3019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd37cf4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbd301139a0 con 0x7fbd30109df0 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd37cf4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd30113820 con 0x7fbd301094a0 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd37cf4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd30113b20 con 0x7fbd30103b60 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd36291640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd30109df0 0x7fbd3019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd36291640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd30109df0 0x7fbd3019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42266/0 (socket says 172.21.15.92:42266) 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd36291640 1 -- 172.21.15.92:0/4086344286 learned_addr learned my addr 172.21.15.92:0/4086344286 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.233+0000 7fbd35a90640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd30103b60 0x7fbd3019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd3528f640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd301094a0 0x7fbd3019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd36291640 1 -- 172.21.15.92:0/4086344286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd30103b60 msgr2=0x7fbd3019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd36291640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd30103b60 0x7fbd3019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd36291640 1 -- 172.21.15.92:0/4086344286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd301094a0 msgr2=0x7fbd3019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:58.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd36291640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd301094a0 0x7fbd3019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd36291640 1 -- 172.21.15.92:0/4086344286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd301a0480 con 0x7fbd30109df0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd36291640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd30109df0 0x7fbd3019fd50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800b970 tx=0x7fbd2800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd22ffd640 1 -- 172.21.15.92:0/4086344286 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28019070 con 0x7fbd30109df0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4086344286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd301a0770 con 0x7fbd30109df0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd22ffd640 1 -- 172.21.15.92:0/4086344286 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd28014440 con 0x7fbd30109df0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd22ffd640 1 -- 172.21.15.92:0/4086344286 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd280075d0 con 0x7fbd30109df0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.234+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4086344286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd300755f0 con 0x7fbd30109df0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.235+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4086344286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd30104de0 con 0x7fbd30109df0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.237+0000 7fbd22ffd640 1 -- 172.21.15.92:0/4086344286 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fbd2801c070 con 0x7fbd30109df0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.238+0000 7fbd22ffd640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbd1c0ba970 0x7fbd1c0bce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.238+0000 7fbd35a90640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbd1c0ba970 0x7fbd1c0bce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.238+0000 7fbd22ffd640 1 -- 172.21.15.92:0/4086344286 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fbd280e7190 con 0x7fbd30109df0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.238+0000 7fbd35a90640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbd1c0ba970 0x7fbd1c0bce80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c005fd0 tx=0x7fbd2c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:58.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.241+0000 7fbd22ffd640 1 -- 172.21.15.92:0/4086344286 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbd280b1940 con 0x7fbd30109df0 2024-09-21T07:12:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.460+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4086344286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbd30103f70 con 0x7fbd30109df0 2024-09-21T07:12:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.460+0000 7fbd22ffd640 1 -- 172.21.15.92:0/4086344286 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3134 (secure 0 0 0) 0x7fbd280b6880 con 0x7fbd30109df0 2024-09-21T07:12:58.462 INFO:teuthology.orchestra.run.smithi092.stdout:e28 2024-09-21T07:12:58.462 INFO:teuthology.orchestra.run.smithi092.stdout:btime 2024-09-21T07:11:33:733807+0000 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:legacy client fscid: 1 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:Filesystem 'cephfs' (1) 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:fs_name cephfs 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 28 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-09-21T07:10:54.236729+0000 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:modified 2024-09-21T07:11:33.733792+0000 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:tableserver 0 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:root 0 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:session_timeout 300 2024-09-21T07:12:58.463 INFO:teuthology.orchestra.run.smithi092.stdout:session_autoclose 300 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:max_file_size 1099511627776 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:max_xattr_size 65536 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:required_client_features {} 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:last_failure 0 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:last_failure_osd_epoch 0 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:max_mds 5 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:in 0,1,2,3,4 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:up {0=24649,1=24625,2=24608,3=24583,4=24566} 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:failed 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:damaged 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:stopped 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:data_pools [3,4] 2024-09-21T07:12:58.464 INFO:teuthology.orchestra.run.smithi092.stdout:metadata_pool 2 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:inline_data disabled 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:balancer 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:bal_rank_mask -1 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:standby_count_wanted 0 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:qdb_cluster leader: 24649 members: 24649,24625,24608,24583,24566 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.i{0:24649} state up:active seq 6 addr [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.e{0:24548} state up:standby-replay seq 1 addr [v2:172.21.15.169:6834/1770920559,v1:172.21.15.169:6835/1770920559] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.f{1:24625} state up:active seq 17 addr [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.k{1:24527} state up:standby-replay seq 1 addr [v2:172.21.15.169:6832/3784592006,v1:172.21.15.169:6833/3784592006] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b{2:24608} state up:active seq 13 addr [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a{2:14871} state up:standby-replay seq 1 addr [v2:172.21.15.92:6840/752270354,v1:172.21.15.92:6841/752270354] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.l{3:24583} state up:active seq 21 addr [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.g{3:14859} state up:standby-replay seq 1 addr [v2:172.21.15.92:6838/1835760933,v1:172.21.15.92:6839/1835760933] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c{4:24566} state up:active seq 17 addr [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.465 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.h{4:14841} state up:standby-replay seq 1 addr [v2:172.21.15.169:6836/2116680832,v1:172.21.15.169:6837/2116680832] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.466 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:58.466 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:58.466 INFO:teuthology.orchestra.run.smithi092.stdout:Standby daemons: 2024-09-21T07:12:58.466 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:12:58.466 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.j{-1:14790} state up:standby seq 1 addr [v2:172.21.15.92:6834/4146602671,v1:172.21.15.92:6835/4146602671] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.466 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d{-1:14802} state up:standby seq 1 addr [v2:172.21.15.92:6836/445790137,v1:172.21.15.92:6837/445790137] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 28 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4086344286 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbd1c0ba970 msgr2=0x7fbd1c0bce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbd1c0ba970 0x7fbd1c0bce80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c005fd0 tx=0x7fbd2c00b390 comp rx=0 tx=0).stop 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4086344286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd30109df0 msgr2=0x7fbd3019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd30109df0 0x7fbd3019fd50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800b970 tx=0x7fbd2800be30 comp rx=0 tx=0).stop 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4086344286 shutdown_connections 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbd1c0ba970 0x7fbd1c0bce80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd30109df0 0x7fbd3019fd50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd301094a0 0x7fbd3019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 --2- 172.21.15.92:0/4086344286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd30103b60 0x7fbd3019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4086344286 >> 172.21.15.92:0/4086344286 conn(0x7fbd3007b850 msgr2=0x7fbd30105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4086344286 shutdown_connections 2024-09-21T07:12:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:58.464+0000 7fbd37cf4640 1 -- 172.21.15.92:0/4086344286 wait complete. 2024-09-21T07:12:58.824 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:58 smithi092 ceph-mon[30987]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:58.824 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:58 smithi092 ceph-mon[30987]: pgmap v336: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T07:12:58.824 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:12:58 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4086344286' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:12:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:58 smithi175 ceph-mon[34064]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:58 smithi175 ceph-mon[34064]: pgmap v336: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T07:12:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:12:58 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/4086344286' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:12:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:58 smithi169 ceph-mon[33705]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:12:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:58 smithi169 ceph-mon[33705]: pgmap v336: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T07:12:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:12:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/4086344286' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:12:59.162 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T07:12:59.411 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.926+0000 7f9b77f10640 1 -- 172.21.15.92:0/570760375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b7010de60 msgr2=0x7f9b70110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.926+0000 7f9b77f10640 1 --2- 172.21.15.92:0/570760375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b7010de60 0x7f9b70110330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009900 tx=0x7f9b6802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.926+0000 7f9b77f10640 1 -- 172.21.15.92:0/570760375 shutdown_connections 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.926+0000 7f9b77f10640 1 --2- 172.21.15.92:0/570760375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b7010de60 0x7f9b70110330 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.926+0000 7f9b77f10640 1 --2- 172.21.15.92:0/570760375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b70105380 0x7f9b7010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.926+0000 7f9b77f10640 1 --2- 172.21.15.92:0/570760375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b70104a30 0x7f9b70104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.926+0000 7f9b77f10640 1 -- 172.21.15.92:0/570760375 >> 172.21.15.92:0/570760375 conn(0x7f9b700797b0 msgr2=0x7f9b70079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.926+0000 7f9b77f10640 1 -- 172.21.15.92:0/570760375 shutdown_connections 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.926+0000 7f9b77f10640 1 -- 172.21.15.92:0/570760375 wait complete. 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.926+0000 7f9b77f10640 1 Processor -- start 2024-09-21T07:12:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.927+0000 7f9b77f10640 1 -- start start 2024-09-21T07:12:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.927+0000 7f9b77f10640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b70104a30 0x7f9b7019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.927+0000 7f9b77f10640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b70105380 0x7f9b7019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.927+0000 7f9b77f10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b7010de60 0x7f9b7019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.927+0000 7f9b77f10640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b70113950 con 0x7f9b7010de60 2024-09-21T07:12:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.927+0000 7f9b77f10640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b701137d0 con 0x7f9b70105380 2024-09-21T07:12:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.927+0000 7f9b77f10640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b70113ad0 con 0x7f9b70104a30 2024-09-21T07:12:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b75cac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b70104a30 0x7f9b7019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b754ab640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b70105380 0x7f9b7019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b764ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b7010de60 0x7f9b7019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b764ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b7010de60 0x7f9b7019fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59918/0 (socket says 172.21.15.92:59918) 2024-09-21T07:12:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b764ad640 1 -- 172.21.15.92:0/3680686375 learned_addr learned my addr 172.21.15.92:0/3680686375 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b764ad640 1 -- 172.21.15.92:0/3680686375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b70104a30 msgr2=0x7f9b7019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b764ad640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b70104a30 0x7f9b7019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b764ad640 1 -- 172.21.15.92:0/3680686375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b70105380 msgr2=0x7f9b7019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b764ad640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b70105380 0x7f9b7019a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b764ad640 1 -- 172.21.15.92:0/3680686375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b701a0210 con 0x7f9b7010de60 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b764ad640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b7010de60 0x7f9b7019fba0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b68005ab0 tx=0x7f9b680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b6effd640 1 -- 172.21.15.92:0/3680686375 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6803f030 con 0x7f9b7010de60 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b6effd640 1 -- 172.21.15.92:0/3680686375 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b68003c90 con 0x7f9b7010de60 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b77f10640 1 -- 172.21.15.92:0/3680686375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b701a04a0 con 0x7f9b7010de60 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.928+0000 7f9b6effd640 1 -- 172.21.15.92:0/3680686375 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b68035070 con 0x7f9b7010de60 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.929+0000 7f9b77f10640 1 -- 172.21.15.92:0/3680686375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b701a0980 con 0x7f9b7010de60 2024-09-21T07:12:59.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.930+0000 7f9b77f10640 1 -- 172.21.15.92:0/3680686375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b70104e40 con 0x7f9b7010de60 2024-09-21T07:12:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.931+0000 7f9b6effd640 1 -- 172.21.15.92:0/3680686375 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f9b68042030 con 0x7f9b7010de60 2024-09-21T07:12:59.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.932+0000 7f9b6effd640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b580b6590 0x7f9b580b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:59.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.932+0000 7f9b75cac640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b580b6590 0x7f9b580b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:59.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.933+0000 7f9b6effd640 1 -- 172.21.15.92:0/3680686375 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9b68108150 con 0x7f9b7010de60 2024-09-21T07:12:59.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.933+0000 7f9b75cac640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b580b6590 0x7f9b580b8aa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9b60005c40 tx=0x7f9b6000a590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:59.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:12:59.936+0000 7f9b6effd640 1 -- 172.21.15.92:0/3680686375 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9b680ce520 con 0x7f9b7010de60 2024-09-21T07:13:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.115+0000 7f9b77f10640 1 -- 172.21.15.92:0/3680686375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f9b7019b490 con 0x7f9b7010de60 2024-09-21T07:13:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.116+0000 7f9b6effd640 1 -- 172.21.15.92:0/3680686375 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v86) ==== 56+0+6121 (secure 0 0 0) 0x7f9b7019b490 con 0x7f9b7010de60 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 86 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-09-21T07:02:28.951051+0000 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:modified 2024-09-21T07:12:14.675473+0000 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:crush_version 27 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:full_ratio 0.95 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:backfillfull_ratio 0.9 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:nearfull_ratio 0.85 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:require_min_compat_client luminous 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:min_compat_client luminous 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:require_osd_release squid 2024-09-21T07:13:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:stretch_mode_enabled false 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:max_osd 12 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 up in weight 1 up_from 9 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6802/2549923251,v1:172.21.15.92:6803/2549923251] [v2:172.21.15.92:6804/2549923251,v1:172.21.15.92:6805/2549923251] exists,up 6f883948-e8ec-4370-9f8d-6ce7095732ef 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 up in weight 1 up_from 14 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/340343580,v1:172.21.15.169:6801/340343580] [v2:172.21.15.169:6802/340343580,v1:172.21.15.169:6803/340343580] exists,up 517c0676-0dfb-4f27-b98b-bf86a8e5d788 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 up in weight 1 up_from 19 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/3936276912,v1:172.21.15.175:6801/3936276912] [v2:172.21.15.175:6802/3936276912,v1:172.21.15.175:6803/3936276912] exists,up 71eb34bc-7d93-40d7-aa32-140aa96d10cb 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 up in weight 1 up_from 25 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6810/2450473708,v1:172.21.15.92:6811/2450473708] [v2:172.21.15.92:6812/2450473708,v1:172.21.15.92:6813/2450473708] exists,up fa947193-b87b-4ce9-a59f-5277dfefbbae 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 up in weight 1 up_from 31 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6808/3000296749,v1:172.21.15.169:6809/3000296749] [v2:172.21.15.169:6810/3000296749,v1:172.21.15.169:6811/3000296749] exists,up 0b727711-c462-405e-b7dd-4cef2e5ee2ab 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 up in weight 1 up_from 36 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/1466838289,v1:172.21.15.175:6809/1466838289] [v2:172.21.15.175:6810/1466838289,v1:172.21.15.175:6811/1466838289] exists,up 6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 up in weight 1 up_from 42 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6818/2465826731,v1:172.21.15.92:6819/2465826731] [v2:172.21.15.92:6820/2465826731,v1:172.21.15.92:6821/2465826731] exists,up 3f91ad74-d901-41cc-bda8-b038fb38b605 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 up in weight 1 up_from 47 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6816/3631528886,v1:172.21.15.169:6817/3631528886] [v2:172.21.15.169:6818/3631528886,v1:172.21.15.169:6819/3631528886] exists,up f073d2c0-5006-4331-ba84-7c1b91fc70ee 2024-09-21T07:13:00.119 INFO:teuthology.orchestra.run.smithi092.stdout:osd.8 up in weight 1 up_from 53 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/1197596525,v1:172.21.15.175:6817/1197596525] [v2:172.21.15.175:6818/1197596525,v1:172.21.15.175:6819/1197596525] exists,up 84dbd9fc-2024-44fc-9cb4-82ccdbcb34db 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:osd.9 up in weight 1 up_from 59 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6826/1564956774,v1:172.21.15.92:6827/1564956774] [v2:172.21.15.92:6828/1564956774,v1:172.21.15.92:6829/1564956774] exists,up 62fc48a5-f735-4d12-80bd-e79e4ca6ab1a 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:osd.10 up in weight 1 up_from 64 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6824/3327763720,v1:172.21.15.169:6825/3327763720] [v2:172.21.15.169:6826/3327763720,v1:172.21.15.169:6827/3327763720] exists,up 5d002dc8-64fa-44f0-96aa-6161922b449f 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:osd.11 up in weight 1 up_from 70 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/3032208508,v1:172.21.15.175:6825/3032208508] [v2:172.21.15.175:6826/3032208508,v1:172.21.15.175:6827/3032208508] exists,up 825d45a4-6d88-45ce-ade4-5fd417f751d6 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.6 [8,11] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.13 [2,11] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.16 [2,4] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.5 [3,9] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.6 [3,8] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.e [4,8] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.10 [5,9] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.1b [4,6] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.1d [5,9] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.31 [4,6] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.3a [4,7] 2024-09-21T07:13:00.120 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 4.5 [9,10] 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 4.10 [9,8] 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 4.12 [9,10] 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 4.15 [5,10] 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/3394957298 expires 2024-09-22T07:04:13.495486+0000 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/2875922154 expires 2024-09-22T07:04:13.495486+0000 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/55970926 expires 2024-09-22T07:03:15.831617+0000 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/587317102 expires 2024-09-22T07:04:13.495486+0000 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/4259087529 expires 2024-09-22T07:02:51.153241+0000 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/4259087529 expires 2024-09-22T07:02:51.153241+0000 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/1080149377 expires 2024-09-22T07:03:15.831617+0000 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/360775984 expires 2024-09-22T07:03:15.831617+0000 2024-09-21T07:13:00.121 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/3362034077 expires 2024-09-22T07:02:51.153241+0000 2024-09-21T07:13:00.122 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/55970926 expires 2024-09-22T07:03:15.831617+0000 2024-09-21T07:13:00.122 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/3955243221 expires 2024-09-22T07:02:51.153241+0000 2024-09-21T07:13:00.122 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/750676858 expires 2024-09-22T07:03:15.831617+0000 2024-09-21T07:13:00.122 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/2534333723 expires 2024-09-22T07:04:13.495486+0000 2024-09-21T07:13:00.122 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/3806081909 expires 2024-09-22T07:02:51.153241+0000 2024-09-21T07:13:00.122 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/587317102 expires 2024-09-22T07:04:13.495486+0000 2024-09-21T07:13:00.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 -- 172.21.15.92:0/3680686375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b580b6590 msgr2=0x7f9b580b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b580b6590 0x7f9b580b8aa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9b60005c40 tx=0x7f9b6000a590 comp rx=0 tx=0).stop 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 -- 172.21.15.92:0/3680686375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b7010de60 msgr2=0x7f9b7019fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b7010de60 0x7f9b7019fba0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b68005ab0 tx=0x7f9b680042f0 comp rx=0 tx=0).stop 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 -- 172.21.15.92:0/3680686375 shutdown_connections 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9b580b6590 0x7f9b580b8aa0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b7010de60 0x7f9b7019fba0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b70105380 0x7f9b7019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 --2- 172.21.15.92:0/3680686375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b70104a30 0x7f9b7019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 -- 172.21.15.92:0/3680686375 >> 172.21.15.92:0/3680686375 conn(0x7f9b700797b0 msgr2=0x7f9b70100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 -- 172.21.15.92:0/3680686375 shutdown_connections 2024-09-21T07:13:00.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:00.118+0000 7f9b77f10640 1 -- 172.21.15.92:0/3680686375 wait complete. 2024-09-21T07:13:00.778 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T07:13:00.789 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:13:00.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:00 smithi092 ceph-mon[30987]: pgmap v337: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 12 op/s 2024-09-21T07:13:00.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:00 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3680686375' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:13:01.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:00 smithi175 ceph-mon[34064]: pgmap v337: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 12 op/s 2024-09-21T07:13:01.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:00 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3680686375' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:13:01.035 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:00 smithi169 ceph-mon[33705]: pgmap v337: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 12 op/s 2024-09-21T07:13:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:00 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3680686375' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.502+0000 7fd969e90640 1 -- 172.21.15.92:0/2686146261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9641083a0 msgr2=0x7fd9641087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.502+0000 7fd969e90640 1 --2- 172.21.15.92:0/2686146261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9641083a0 0x7fd9641087b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd958009900 tx=0x7fd95802a410 comp rx=0 tx=0).stop 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.502+0000 7fd969e90640 1 -- 172.21.15.92:0/2686146261 shutdown_connections 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.502+0000 7fd969e90640 1 --2- 172.21.15.92:0/2686146261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd964108cf0 0x7fd96410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.502+0000 7fd969e90640 1 --2- 172.21.15.92:0/2686146261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9641083a0 0x7fd9641087b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.502+0000 7fd969e90640 1 --2- 172.21.15.92:0/2686146261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd964102a60 0x7fd964102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.502+0000 7fd969e90640 1 -- 172.21.15.92:0/2686146261 >> 172.21.15.92:0/2686146261 conn(0x7fd964079730 msgr2=0x7fd964079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.502+0000 7fd969e90640 1 -- 172.21.15.92:0/2686146261 shutdown_connections 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.502+0000 7fd969e90640 1 -- 172.21.15.92:0/2686146261 wait complete. 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.503+0000 7fd969e90640 1 Processor -- start 2024-09-21T07:13:01.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.503+0000 7fd969e90640 1 -- start start 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.503+0000 7fd969e90640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964102a60 0x7fd96419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.503+0000 7fd969e90640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9641083a0 0x7fd96419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.503+0000 7fd969e90640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd964108cf0 0x7fd9641a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.503+0000 7fd969e90640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd964112810 con 0x7fd964102a60 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.503+0000 7fd969e90640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd964112690 con 0x7fd9641083a0 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.503+0000 7fd969e90640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd964112990 con 0x7fd964108cf0 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.503+0000 7fd9637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964102a60 0x7fd96419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd9637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964102a60 0x7fd96419c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59928/0 (socket says 172.21.15.92:59928) 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd9637fe640 1 -- 172.21.15.92:0/3590182464 learned_addr learned my addr 172.21.15.92:0/3590182464 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd963fff640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd964108cf0 0x7fd9641a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd962ffd640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9641083a0 0x7fd96419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd9637fe640 1 -- 172.21.15.92:0/3590182464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd964108cf0 msgr2=0x7fd9641a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd9637fe640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd964108cf0 0x7fd9641a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:01.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd9637fe640 1 -- 172.21.15.92:0/3590182464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9641083a0 msgr2=0x7fd96419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd9637fe640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9641083a0 0x7fd96419cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd9637fe640 1 -- 172.21.15.92:0/3590182464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9641a2540 con 0x7fd964102a60 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd963fff640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd964108cf0 0x7fd9641a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd9637fe640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964102a60 0x7fd96419c5d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd95400c890 tx=0x7fd95400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd960ff9640 1 -- 172.21.15.92:0/3590182464 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954004220 con 0x7fd964102a60 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd969e90640 1 -- 172.21.15.92:0/3590182464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9641a2830 con 0x7fd964102a60 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd960ff9640 1 -- 172.21.15.92:0/3590182464 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd954007e40 con 0x7fd964102a60 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd960ff9640 1 -- 172.21.15.92:0/3590182464 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954004a00 con 0x7fd964102a60 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.504+0000 7fd969e90640 1 -- 172.21.15.92:0/3590182464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9641a8f90 con 0x7fd964102a60 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.506+0000 7fd969e90640 1 -- 172.21.15.92:0/3590182464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd964103ce0 con 0x7fd964102a60 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.507+0000 7fd960ff9640 1 -- 172.21.15.92:0/3590182464 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fd9540079b0 con 0x7fd964102a60 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.508+0000 7fd960ff9640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd94c0b6560 0x7fd94c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.508+0000 7fd962ffd640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd94c0b6560 0x7fd94c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:01.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.508+0000 7fd960ff9640 1 -- 172.21.15.92:0/3590182464 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd9540e75a0 con 0x7fd964102a60 2024-09-21T07:13:01.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.508+0000 7fd962ffd640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd94c0b6560 0x7fd94c0b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd958006010 tx=0x7fd958032c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:01.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.512+0000 7fd960ff9640 1 -- 172.21.15.92:0/3590182464 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd954014030 con 0x7fd964102a60 2024-09-21T07:13:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.726+0000 7fd969e90640 1 -- 172.21.15.92:0/3590182464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd964100c90 con 0x7fd964102a60 2024-09-21T07:13:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.727+0000 7fd960ff9640 1 -- 172.21.15.92:0/3590182464 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7fd9540ad970 con 0x7fd964102a60 2024-09-21T07:13:01.729 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:01.729 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":28,"btime":"2024-09-21T07:11:33:733807+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:11:33.733792+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24649,24625,24608,24583,24566]},"id":1}]} 2024-09-21T07:13:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 28 2024-09-21T07:13:01.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 -- 172.21.15.92:0/3590182464 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd94c0b6560 msgr2=0x7fd94c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:01.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd94c0b6560 0x7fd94c0b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd958006010 tx=0x7fd958032c80 comp rx=0 tx=0).stop 2024-09-21T07:13:01.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 -- 172.21.15.92:0/3590182464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964102a60 msgr2=0x7fd96419c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:01.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964102a60 0x7fd96419c5d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd95400c890 tx=0x7fd95400cd50 comp rx=0 tx=0).stop 2024-09-21T07:13:01.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 -- 172.21.15.92:0/3590182464 shutdown_connections 2024-09-21T07:13:01.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd94c0b6560 0x7fd94c0b8a70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:01.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd964108cf0 0x7fd9641a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:01.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9641083a0 0x7fd96419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:01.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 --2- 172.21.15.92:0/3590182464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964102a60 0x7fd96419c5d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:01.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 -- 172.21.15.92:0/3590182464 >> 172.21.15.92:0/3590182464 conn(0x7fd964079730 msgr2=0x7fd964104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:01.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 -- 172.21.15.92:0/3590182464 shutdown_connections 2024-09-21T07:13:01.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:01.729+0000 7fd969e90640 1 -- 172.21.15.92:0/3590182464 wait complete. 2024-09-21T07:13:02.405 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:13:02.650 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:02 smithi175 ceph-mon[34064]: pgmap v338: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:13:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:02 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3590182464' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:03.048 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:02 smithi092 ceph-mon[30987]: pgmap v338: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:13:03.048 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:02 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3590182464' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:02 smithi169 ceph-mon[33705]: pgmap v338: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:13:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:02 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3590182464' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:03.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.135+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3034700750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b8109df0 msgr2=0x7fb4b8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:03.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.135+0000 7fb4be0d1640 1 --2- 172.21.15.92:0/3034700750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b8109df0 0x7fb4b8110620 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0009ca0 tx=0x7fb4b002a8e0 comp rx=0 tx=0).stop 2024-09-21T07:13:03.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.135+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3034700750 shutdown_connections 2024-09-21T07:13:03.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.135+0000 7fb4be0d1640 1 --2- 172.21.15.92:0/3034700750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b8109df0 0x7fb4b8110620 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:03.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.135+0000 7fb4be0d1640 1 --2- 172.21.15.92:0/3034700750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4b81094a0 0x7fb4b81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:03.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.135+0000 7fb4be0d1640 1 --2- 172.21.15.92:0/3034700750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4b8103b60 0x7fb4b8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:03.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.135+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3034700750 >> 172.21.15.92:0/3034700750 conn(0x7fb4b807b850 msgr2=0x7fb4b807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:03.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.135+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3034700750 shutdown_connections 2024-09-21T07:13:03.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.135+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3034700750 wait complete. 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.135+0000 7fb4be0d1640 1 Processor -- start 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4be0d1640 1 -- start start 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4be0d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4b8103b60 0x7fb4b819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4be0d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4b81094a0 0x7fb4b819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4be0d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b8109df0 0x7fb4b819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4be0d1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b8113a20 con 0x7fb4b8109df0 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4be0d1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b81138a0 con 0x7fb4b8103b60 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4be0d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b8113ba0 con 0x7fb4b81094a0 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b8109df0 0x7fb4b819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b8109df0 0x7fb4b819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59958/0 (socket says 172.21.15.92:59958) 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4b7fff640 1 -- 172.21.15.92:0/3559669843 learned_addr learned my addr 172.21.15.92:0/3559669843 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4aeffd640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4b81094a0 0x7fb4b819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4b7fff640 1 -- 172.21.15.92:0/3559669843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4b81094a0 msgr2=0x7fb4b819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:03.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4b77fe640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4b8103b60 0x7fb4b819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4b7fff640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4b81094a0 0x7fb4b819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4b7fff640 1 -- 172.21.15.92:0/3559669843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4b8103b60 msgr2=0x7fb4b819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4b7fff640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4b8103b60 0x7fb4b819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4b7fff640 1 -- 172.21.15.92:0/3559669843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b81a0480 con 0x7fb4b8109df0 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.136+0000 7fb4b77fe640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4b8103b60 0x7fb4b819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.137+0000 7fb4b7fff640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b8109df0 0x7fb4b819fd50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0006010 tx=0x7fb4b0003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.137+0000 7fb4b57fa640 1 -- 172.21.15.92:0/3559669843 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0004240 con 0x7fb4b8109df0 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.137+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3559669843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b81a0710 con 0x7fb4b8109df0 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.137+0000 7fb4b57fa640 1 -- 172.21.15.92:0/3559669843 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4b00305e0 con 0x7fb4b8109df0 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.137+0000 7fb4b57fa640 1 -- 172.21.15.92:0/3559669843 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b003b660 con 0x7fb4b8109df0 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.137+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3559669843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b81a6ed0 con 0x7fb4b8109df0 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.138+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3559669843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b8104de0 con 0x7fb4b8109df0 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.140+0000 7fb4b57fa640 1 -- 172.21.15.92:0/3559669843 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fb4b0030790 con 0x7fb4b8109df0 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.140+0000 7fb4b57fa640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb4a40b6560 0x7fb4a40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:03.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.140+0000 7fb4b77fe640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb4a40b6560 0x7fb4a40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:03.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.140+0000 7fb4b57fa640 1 -- 172.21.15.92:0/3559669843 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fb4b0108e60 con 0x7fb4b8109df0 2024-09-21T07:13:03.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.141+0000 7fb4b77fe640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb4a40b6560 0x7fb4a40b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8006fd0 tx=0x7fb4a8008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:03.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.143+0000 7fb4b57fa640 1 -- 172.21.15.92:0/3559669843 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4b00cf230 con 0x7fb4b8109df0 2024-09-21T07:13:03.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.361+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3559669843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4b8103ff0 con 0x7fb4b8109df0 2024-09-21T07:13:03.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.362+0000 7fb4b57fa640 1 -- 172.21.15.92:0/3559669843 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7fb4b8103ff0 con 0x7fb4b8109df0 2024-09-21T07:13:03.365 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:03.365 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":28,"btime":"2024-09-21T07:11:33:733807+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:11:33.733792+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24649,24625,24608,24583,24566]},"id":1}]} 2024-09-21T07:13:03.365 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 28 2024-09-21T07:13:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.364+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3559669843 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb4a40b6560 msgr2=0x7fb4a40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.364+0000 7fb4be0d1640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb4a40b6560 0x7fb4a40b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8006fd0 tx=0x7fb4a8008040 comp rx=0 tx=0).stop 2024-09-21T07:13:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.364+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3559669843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b8109df0 msgr2=0x7fb4b819fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.364+0000 7fb4be0d1640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b8109df0 0x7fb4b819fd50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0006010 tx=0x7fb4b0003c90 comp rx=0 tx=0).stop 2024-09-21T07:13:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.364+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3559669843 shutdown_connections 2024-09-21T07:13:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.364+0000 7fb4be0d1640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb4a40b6560 0x7fb4a40b8a70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.364+0000 7fb4be0d1640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b8109df0 0x7fb4b819fd50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.364+0000 7fb4be0d1640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4b81094a0 0x7fb4b819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.364+0000 7fb4be0d1640 1 --2- 172.21.15.92:0/3559669843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4b8103b60 0x7fb4b819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.364+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3559669843 >> 172.21.15.92:0/3559669843 conn(0x7fb4b807b850 msgr2=0x7fb4b8107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.365+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3559669843 shutdown_connections 2024-09-21T07:13:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:03.365+0000 7fb4be0d1640 1 -- 172.21.15.92:0/3559669843 wait complete. 2024-09-21T07:13:04.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:03 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3559669843' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:04.079 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:03 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3559669843' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:04.108 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:13:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:03 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3559669843' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:04.358 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:04.792 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:04 smithi092 ceph-mon[30987]: pgmap v339: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:13:04.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.880+0000 7f98d662a640 1 -- 172.21.15.92:0/330887929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d01083c0 msgr2=0x7f98d01087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:04.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.880+0000 7f98d662a640 1 --2- 172.21.15.92:0/330887929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d01083c0 0x7f98d01087d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009900 tx=0x7f98c402a410 comp rx=0 tx=0).stop 2024-09-21T07:13:04.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.880+0000 7f98d662a640 1 -- 172.21.15.92:0/330887929 shutdown_connections 2024-09-21T07:13:04.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.880+0000 7f98d662a640 1 --2- 172.21.15.92:0/330887929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98d0108d10 0x7f98d010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:04.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.880+0000 7f98d662a640 1 --2- 172.21.15.92:0/330887929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d01083c0 0x7f98d01087d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:04.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.880+0000 7f98d662a640 1 --2- 172.21.15.92:0/330887929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d0102ad0 0x7f98d0102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:04.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.880+0000 7f98d662a640 1 -- 172.21.15.92:0/330887929 >> 172.21.15.92:0/330887929 conn(0x7f98d00796d0 msgr2=0x7f98d0079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:04.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.880+0000 7f98d662a640 1 -- 172.21.15.92:0/330887929 shutdown_connections 2024-09-21T07:13:04.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.880+0000 7f98d662a640 1 -- 172.21.15.92:0/330887929 wait complete. 2024-09-21T07:13:04.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98d662a640 1 Processor -- start 2024-09-21T07:13:04.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98d662a640 1 -- start start 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98d662a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d0102ad0 0x7f98d0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98d662a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d01083c0 0x7f98d01998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98d662a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98d0108d10 0x7f98d019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98d662a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0112880 con 0x7f98d0102ad0 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98d662a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0112700 con 0x7f98d0108d10 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98d662a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0112a00 con 0x7f98d01083c0 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d0102ad0 0x7f98d0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d0102ad0 0x7f98d0199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59974/0 (socket says 172.21.15.92:59974) 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98cffff640 1 -- 172.21.15.92:0/1436366669 learned_addr learned my addr 172.21.15.92:0/1436366669 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98d4bc7640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98d0108d10 0x7f98d019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98cf7fe640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d01083c0 0x7f98d01998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:04.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98cffff640 1 -- 172.21.15.92:0/1436366669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d01083c0 msgr2=0x7f98d01998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:04.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98cffff640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d01083c0 0x7f98d01998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:04.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98cffff640 1 -- 172.21.15.92:0/1436366669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98d0108d10 msgr2=0x7f98d019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:04.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.881+0000 7f98cffff640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98d0108d10 0x7f98d019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:04.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.882+0000 7f98cffff640 1 -- 172.21.15.92:0/1436366669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d019f280 con 0x7f98d0102ad0 2024-09-21T07:13:04.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.882+0000 7f98d4bc7640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98d0108d10 0x7f98d019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:04.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.882+0000 7f98cffff640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d0102ad0 0x7f98d0199310 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f98c000e9f0 tx=0x7f98c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:04.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.882+0000 7f98cd7fa640 1 -- 172.21.15.92:0/1436366669 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c000cd80 con 0x7f98d0102ad0 2024-09-21T07:13:04.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.882+0000 7f98d662a640 1 -- 172.21.15.92:0/1436366669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d019f570 con 0x7f98d0102ad0 2024-09-21T07:13:04.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.882+0000 7f98cd7fa640 1 -- 172.21.15.92:0/1436366669 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98c00054b0 con 0x7f98d0102ad0 2024-09-21T07:13:04.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.882+0000 7f98cd7fa640 1 -- 172.21.15.92:0/1436366669 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0010430 con 0x7f98d0102ad0 2024-09-21T07:13:04.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.882+0000 7f98d662a640 1 -- 172.21.15.92:0/1436366669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d01a5cd0 con 0x7f98d0102ad0 2024-09-21T07:13:04.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.883+0000 7f98d662a640 1 -- 172.21.15.92:0/1436366669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d0103d00 con 0x7f98d0102ad0 2024-09-21T07:13:04.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.885+0000 7f98cd7fa640 1 -- 172.21.15.92:0/1436366669 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f98c00046c0 con 0x7f98d0102ad0 2024-09-21T07:13:04.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.886+0000 7f98cd7fa640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98b80b6560 0x7f98b80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:04.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.886+0000 7f98cf7fe640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98b80b6560 0x7f98b80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:04.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.886+0000 7f98cd7fa640 1 -- 172.21.15.92:0/1436366669 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f98c00e7ed0 con 0x7f98d0102ad0 2024-09-21T07:13:04.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.887+0000 7f98cf7fe640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98b80b6560 0x7f98b80b8a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f98c4006010 tx=0x7f98c4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:04.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:04.889+0000 7f98cd7fa640 1 -- 172.21.15.92:0/1436366669 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f98c0056710 con 0x7f98d0102ad0 2024-09-21T07:13:05.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:04 smithi175 ceph-mon[34064]: pgmap v339: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:13:05.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.067+0000 7f98d662a640 1 -- 172.21.15.92:0/1436366669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98d010ab40 con 0x7f98d0102ad0 2024-09-21T07:13:05.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.068+0000 7f98cd7fa640 1 -- 172.21.15.92:0/1436366669 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+25265 (secure 0 0 0) 0x7f98c00ae2a0 con 0x7f98d0102ad0 2024-09-21T07:13:05.072 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:05.072 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":86,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:12:14.675473+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:13:05.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.070+0000 7f98d662a640 1 -- 172.21.15.92:0/1436366669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98b80b6560 msgr2=0x7f98b80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:05.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.070+0000 7f98d662a640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98b80b6560 0x7f98b80b8a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f98c4006010 tx=0x7f98c4000bc0 comp rx=0 tx=0).stop 2024-09-21T07:13:05.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.071+0000 7f98d662a640 1 -- 172.21.15.92:0/1436366669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d0102ad0 msgr2=0x7f98d0199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:05.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.071+0000 7f98d662a640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d0102ad0 0x7f98d0199310 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f98c000e9f0 tx=0x7f98c000edf0 comp rx=0 tx=0).stop 2024-09-21T07:13:05.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.071+0000 7f98d662a640 1 -- 172.21.15.92:0/1436366669 shutdown_connections 2024-09-21T07:13:05.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.071+0000 7f98d662a640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98b80b6560 0x7f98b80b8a70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:05.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.071+0000 7f98d662a640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98d0108d10 0x7f98d019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:05.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.071+0000 7f98d662a640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d01083c0 0x7f98d01998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:05.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.071+0000 7f98d662a640 1 --2- 172.21.15.92:0/1436366669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d0102ad0 0x7f98d0199310 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:05.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.071+0000 7f98d662a640 1 -- 172.21.15.92:0/1436366669 >> 172.21.15.92:0/1436366669 conn(0x7f98d00796d0 msgr2=0x7f98d0104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:05.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.071+0000 7f98d662a640 1 -- 172.21.15.92:0/1436366669 shutdown_connections 2024-09-21T07:13:05.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:05.071+0000 7f98d662a640 1 -- 172.21.15.92:0/1436366669 wait complete. 2024-09-21T07:13:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:04 smithi169 ceph-mon[33705]: pgmap v339: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:13:05.693 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:10:54.236729+0000', 'modified': '2024-09-21T07:11:33.733792+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24649, 'mds_1': 24625, 'mds_2': 24608, 'mds_3': 24583, 'mds_4': 24566}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14841': {'gid': 14841, 'name': 'h', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6837/2116680832', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 2116680832}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 2116680832}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14859': {'gid': 14859, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6839/1835760933', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 1835760933}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 1835760933}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14871': {'gid': 14871, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6841/752270354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6840', 'nonce': 752270354}, {'type': 'v1', 'addr': '172.21.15.92:6841', 'nonce': 752270354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6833/3784592006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6832', 'nonce': 3784592006}, {'type': 'v1', 'addr': '172.21.15.169:6833', 'nonce': 3784592006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24548': {'gid': 24548, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/1770920559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 1770920559}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 1770920559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24566': {'gid': 24566, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.175:6837/1654191634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1654191634}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1654191634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24583': {'gid': 24583, 'name': 'l', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.175:6833/2860278829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 2860278829}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 2860278829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'b', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.169:6839/44894739', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 44894739}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 44894739}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'f', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.175:6835/2445062283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 2445062283}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 2445062283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.175:6839/3839014225', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3839014225}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3839014225}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24649, 'qdb_cluster': [24649, 24625, 24608, 24583, 24566]} 2024-09-21T07:13:05.693 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T07:13:05.693 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T07:13:05.942 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:06.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:05 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1436366669' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:06.062 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:05 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1436366669' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:06.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:05 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1436366669' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.429+0000 7f119ccbf640 1 -- 172.21.15.92:0/1561155899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1198109df0 msgr2=0x7f1198110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.429+0000 7f119ccbf640 1 --2- 172.21.15.92:0/1561155899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1198109df0 0x7f1198110620 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1190009ca0 tx=0x7f119002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.429+0000 7f119ccbf640 1 -- 172.21.15.92:0/1561155899 shutdown_connections 2024-09-21T07:13:06.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.429+0000 7f119ccbf640 1 --2- 172.21.15.92:0/1561155899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1198109df0 0x7f1198110620 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.429+0000 7f119ccbf640 1 --2- 172.21.15.92:0/1561155899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11981094a0 0x7f11981098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.429+0000 7f119ccbf640 1 --2- 172.21.15.92:0/1561155899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1198103b60 0x7f1198103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.429+0000 7f119ccbf640 1 -- 172.21.15.92:0/1561155899 >> 172.21.15.92:0/1561155899 conn(0x7f119807b850 msgr2=0x7f119807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.429+0000 7f119ccbf640 1 -- 172.21.15.92:0/1561155899 shutdown_connections 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.429+0000 7f119ccbf640 1 -- 172.21.15.92:0/1561155899 wait complete. 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.430+0000 7f119ccbf640 1 Processor -- start 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.430+0000 7f119ccbf640 1 -- start start 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.430+0000 7f119ccbf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1198103b60 0x7f119819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.430+0000 7f119ccbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11981094a0 0x7f119819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.430+0000 7f119ccbf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1198109df0 0x7f119819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f119ccbf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11981139b0 con 0x7f11981094a0 2024-09-21T07:13:06.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f119ccbf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1198113830 con 0x7f1198103b60 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f119ccbf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1198113b30 con 0x7f1198109df0 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1195d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11981094a0 0x7f119819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1195d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11981094a0 0x7f119819a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60004/0 (socket says 172.21.15.92:60004) 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1195d9b640 1 -- 172.21.15.92:0/3755762523 learned_addr learned my addr 172.21.15.92:0/3755762523 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f119659c640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1198103b60 0x7f119819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1196d9d640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1198109df0 0x7f119819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1195d9b640 1 -- 172.21.15.92:0/3755762523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1198109df0 msgr2=0x7f119819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1195d9b640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1198109df0 0x7f119819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1195d9b640 1 -- 172.21.15.92:0/3755762523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1198103b60 msgr2=0x7f119819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1195d9b640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1198103b60 0x7f119819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1195d9b640 1 -- 172.21.15.92:0/3755762523 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11981a02b0 con 0x7f11981094a0 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1196d9d640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1198109df0 0x7f119819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f1195d9b640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11981094a0 0x7f119819a9a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f118000d740 tx=0x7f118000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f118f7fe640 1 -- 172.21.15.92:0/3755762523 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180017070 con 0x7f11981094a0 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f118f7fe640 1 -- 172.21.15.92:0/3755762523 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1180010460 con 0x7f11981094a0 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f119ccbf640 1 -- 172.21.15.92:0/3755762523 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11981a05a0 con 0x7f11981094a0 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.431+0000 7f118f7fe640 1 -- 172.21.15.92:0/3755762523 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118000f620 con 0x7f11981094a0 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.432+0000 7f119ccbf640 1 -- 172.21.15.92:0/3755762523 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11981a6dc0 con 0x7f11981094a0 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.434+0000 7f11a3233740 1 Processor -- start 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.434+0000 7f11a3233740 1 -- start start 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.434+0000 7f118f7fe640 1 -- 172.21.15.92:0/3755762523 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f118001a070 con 0x7f11981094a0 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f11a3233740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c92151f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f11a3233740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92152440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f11a3233740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c92152980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f11a3233740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c920c9c10 con 0x558c91d830a0 2024-09-21T07:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f11a3233740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c920b9040 con 0x558c91d8b280 2024-09-21T07:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f11a3233740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c920bce50 con 0x558c91dabf60 2024-09-21T07:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f119659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f119659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60020/0 (socket says 172.21.15.92:60020) 2024-09-21T07:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f119659c640 1 -- 172.21.15.92:0/1784206747 learned_addr learned my addr 172.21.15.92:0/1784206747 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:06.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f1196d9d640 1 --2- 172.21.15.92:0/1784206747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c92151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f1195d9b640 1 --2- 172.21.15.92:0/1784206747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c92152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f119659c640 1 -- 172.21.15.92:0/1784206747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 msgr2=0x558c92151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f119659c640 1 --2- 172.21.15.92:0/1784206747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c92151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f119659c640 1 -- 172.21.15.92:0/1784206747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 msgr2=0x558c92152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f119659c640 1 --2- 172.21.15.92:0/1784206747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c92152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f119659c640 1 -- 172.21.15.92:0/1784206747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c91e17540 con 0x558c91d830a0 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f1195d9b640 1 --2- 172.21.15.92:0/1784206747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c92152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f119659c640 1 --2- 172.21.15.92:0/1784206747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92152440 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f118800ad00 tx=0x7f118800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53e668c52865137 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.435+0000 7f118f7fe640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11840b6610 0x7f11840b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.436+0000 7f1196d9d640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11840b6610 0x7f11840b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.436+0000 7f118cff9640 1 -- 172.21.15.92:0/1784206747 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118801d070 con 0x558c91d830a0 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.436+0000 7f118f7fe640 1 -- 172.21.15.92:0/3755762523 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f11800e7110 con 0x7f11981094a0 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.436+0000 7f118cff9640 1 -- 172.21.15.92:0/1784206747 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1188018ad0 con 0x558c91d830a0 2024-09-21T07:13:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.436+0000 7f118cff9640 1 -- 172.21.15.92:0/1784206747 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11880109d0 con 0x558c91d830a0 2024-09-21T07:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.436+0000 7f11a3233740 1 -- 172.21.15.92:0/1784206747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 msgr2=0x558c92152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 --2- 172.21.15.92:0/1784206747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92152440 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f118800ad00 tx=0x7f118800f790 comp rx=0 tx=0).stop 2024-09-21T07:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.436+0000 7f1196d9d640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11840b6610 0x7f11840b8b20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1190006010 tx=0x7f1190009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 -- 172.21.15.92:0/1784206747 shutdown_connections 2024-09-21T07:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 --2- 172.21.15.92:0/1784206747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c92152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 --2- 172.21.15.92:0/1784206747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92152440 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 --2- 172.21.15.92:0/1784206747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c92151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 -- 172.21.15.92:0/1784206747 >> 172.21.15.92:0/1784206747 conn(0x558c91da0350 msgr2=0x558c9214fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 -- 172.21.15.92:0/1784206747 shutdown_connections 2024-09-21T07:13:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 -- 172.21.15.92:0/1784206747 wait complete. 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 -- start start 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 Processor -- start 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91d830a0 0x558c9215d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c9215df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91dabf60 0x558c921699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.437+0000 7f11a3233740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c91f1a5f0 con 0x558c91dabf60 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f11a3233740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c92054010 con 0x558c91d8b280 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f11a3233740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c921606e0 con 0x558c91d830a0 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f11a3233740 10 client.0 _ll_register_callbacks cb 0x558c920b3340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f1196d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91dabf60 0x558c921699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f1196d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91dabf60 0x558c921699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60034/0 (socket says 172.21.15.92:60034) 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f1196d9d640 1 -- 172.21.15.92:0/1423075509 learned_addr learned my addr 172.21.15.92:0/1423075509 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f119659c640 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91d830a0 0x558c9215d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f1195d9b640 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c9215df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f1196d9d640 1 -- 172.21.15.92:0/1423075509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91d830a0 msgr2=0x558c9215d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f1196d9d640 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91d830a0 0x558c9215d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f1196d9d640 1 -- 172.21.15.92:0/1423075509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 msgr2=0x558c9215df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f1196d9d640 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c9215df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f1196d9d640 1 -- 172.21.15.92:0/1423075509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c92081a00 con 0x558c91dabf60 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f1196d9d640 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91dabf60 0x558c921699d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1190003f30 tx=0x7f119002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87e04d170e7f734 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f117dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f117dffb640 1 -- 172.21.15.92:0/1423075509 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190031760 con 0x558c91dabf60 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f117dffb640 1 -- 172.21.15.92:0/1423075509 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f1190004250 con 0x558c91dabf60 2024-09-21T07:13:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f11a3233740 1 -- 172.21.15.92:0/1423075509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1188018ad0 con 0x558c91dabf60 2024-09-21T07:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.438+0000 7f117dffb640 1 -- 172.21.15.92:0/1423075509 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1190004450 con 0x558c91dabf60 2024-09-21T07:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f11a3233740 10 client.15483 fetch_fsmap learned FSMap version 28 2024-09-21T07:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f11a3233740 1 -- 172.21.15.92:0/1423075509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c9216c600 con 0x558c91dabf60 2024-09-21T07:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f117dffb640 1 -- 172.21.15.92:0/1423075509 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1188018ad0 con 0x558c91dabf60 2024-09-21T07:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f117dffb640 1 -- 172.21.15.92:0/1423075509 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1190051070 con 0x558c91dabf60 2024-09-21T07:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f11a3233740 10 client.15483 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f11a3233740 10 client.15483 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f11a3233740 20 client.15483 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f11a3233740 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c91d6a8e0 0x558c92170140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f11a3233740 4 client.15483 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f11a3233740 1 -- 172.21.15.92:0/1423075509 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c920cbb60 con 0x558c91d6a8e0 2024-09-21T07:13:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.439+0000 7f119659c640 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c91d6a8e0 0x558c92170140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.440+0000 7f117dffb640 10 client.15483 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:13:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.440+0000 7f119659c640 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c91d6a8e0 0x558c92170140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=192989098721d4b5 server_cookie=b60a9ef90e6e26e5 in_seq=0 out_seq=0 2024-09-21T07:13:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f117dffb640 1 -- 172.21.15.92:0/1423075509 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c920cbb60 con 0x558c91d6a8e0 2024-09-21T07:13:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f117dffb640 10 client.15483 handle_command_reply: tid=0 2024-09-21T07:13:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 client.15483 shutdown 2024-09-21T07:13:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 -- 172.21.15.92:0/1423075509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91dabf60 msgr2=0x558c921699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91dabf60 0x558c921699d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1190003f30 tx=0x7f119002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 -- 172.21.15.92:0/1423075509 shutdown_connections 2024-09-21T07:13:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c91d6a8e0 0x558c92170140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91dabf60 0x558c921699d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c9215df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f117dffb640 0 client.15483 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:13:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 --2- 172.21.15.92:0/1423075509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91d830a0 0x558c9215d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 -- 172.21.15.92:0/1423075509 >> 172.21.15.92:0/1423075509 conn(0x558c91da0350 msgr2=0x558c92155090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 -- 172.21.15.92:0/1423075509 shutdown_connections 2024-09-21T07:13:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 1 -- 172.21.15.92:0/1423075509 wait complete. 2024-09-21T07:13:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.441+0000 7f11a3233740 20 client.15483 trim_cache size 0 max 16384 2024-09-21T07:13:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f11a3233740 1 Processor -- start 2024-09-21T07:13:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f11a3233740 1 -- start start 2024-09-21T07:13:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f11a3233740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92158020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f11a3233740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c92158980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f11a3233740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c92158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f11a3233740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c9216e480 con 0x558c91d830a0 2024-09-21T07:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f11a3233740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c9216eb50 con 0x558c91d8b280 2024-09-21T07:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f11a3233740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c9216f220 con 0x558c91dabf60 2024-09-21T07:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f119659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f119659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60042/0 (socket says 172.21.15.92:60042) 2024-09-21T07:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.459+0000 7f119659c640 1 -- 172.21.15.92:0/214974363 learned_addr learned my addr 172.21.15.92:0/214974363 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:06.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f1196d9d640 1 --2- 172.21.15.92:0/214974363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c92158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f1195d9b640 1 --2- 172.21.15.92:0/214974363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c92158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f119659c640 1 -- 172.21.15.92:0/214974363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 msgr2=0x558c92158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f119659c640 1 --2- 172.21.15.92:0/214974363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c92158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f119659c640 1 -- 172.21.15.92:0/214974363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 msgr2=0x558c92158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f119659c640 1 --2- 172.21.15.92:0/214974363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c92158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f119659c640 1 -- 172.21.15.92:0/214974363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c92154790 con 0x558c91d830a0 2024-09-21T07:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f119659c640 1 --2- 172.21.15.92:0/214974363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92158020 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x558c92150b80 tx=0x7f118800a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae402b7f3506234 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f117ffff640 1 -- 172.21.15.92:0/214974363 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118801d040 con 0x558c91d830a0 2024-09-21T07:13:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f117ffff640 1 -- 172.21.15.92:0/214974363 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1188018a90 con 0x558c91d830a0 2024-09-21T07:13:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.460+0000 7f117ffff640 1 -- 172.21.15.92:0/214974363 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188005510 con 0x558c91d830a0 2024-09-21T07:13:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.461+0000 7f11a3233740 1 -- 172.21.15.92:0/214974363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 msgr2=0x558c92158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.461+0000 7f11a3233740 1 --2- 172.21.15.92:0/214974363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92158020 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x558c92150b80 tx=0x7f118800a2d0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.461+0000 7f11a3233740 1 -- 172.21.15.92:0/214974363 shutdown_connections 2024-09-21T07:13:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.461+0000 7f11a3233740 1 --2- 172.21.15.92:0/214974363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c92158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.461+0000 7f11a3233740 1 --2- 172.21.15.92:0/214974363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d8b280 0x558c92158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.461+0000 7f11a3233740 1 --2- 172.21.15.92:0/214974363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d830a0 0x558c92158020 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.461+0000 7f11a3233740 1 -- 172.21.15.92:0/214974363 >> 172.21.15.92:0/214974363 conn(0x558c91da0350 msgr2=0x558c9215d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.461+0000 7f11a3233740 1 -- 172.21.15.92:0/214974363 shutdown_connections 2024-09-21T07:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.461+0000 7f11a3233740 1 -- 172.21.15.92:0/214974363 wait complete. 2024-09-21T07:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f11a3233740 1 -- start start 2024-09-21T07:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f11a3233740 1 Processor -- start 2024-09-21T07:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f11a3233740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d830a0 0x558c92178c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f11a3233740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d8b280 0x558c92172100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f11a3233740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c921726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f11a3233740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c9216ffc0 con 0x558c91d8b280 2024-09-21T07:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f11a3233740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c9216f8f0 con 0x558c91d830a0 2024-09-21T07:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f11a3233740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c92170690 con 0x558c91dabf60 2024-09-21T07:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f11a3233740 10 client.0 _ll_register_callbacks cb 0x7f1190003dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f1195d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d8b280 0x558c92172100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f1195d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d8b280 0x558c92172100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60056/0 (socket says 172.21.15.92:60056) 2024-09-21T07:13:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f1195d9b640 1 -- 172.21.15.92:0/2137643551 learned_addr learned my addr 172.21.15.92:0/2137643551 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f119659c640 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d830a0 0x558c92178c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f1196d9d640 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c921726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f1195d9b640 1 -- 172.21.15.92:0/2137643551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 msgr2=0x558c921726c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f1195d9b640 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c921726c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f1195d9b640 1 -- 172.21.15.92:0/2137643551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d830a0 msgr2=0x558c92178c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f1195d9b640 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d830a0 0x558c92178c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f1195d9b640 1 -- 172.21.15.92:0/2137643551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c92172e50 con 0x558c91d8b280 2024-09-21T07:13:06.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.462+0000 7f1196d9d640 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c921726c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f1195d9b640 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d8b280 0x558c92172100 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f11800e7470 tx=0x7f11800ac610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a905a63fbfb7476b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f117dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f117dffb640 1 -- 172.21.15.92:0/2137643551 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180021040 con 0x558c91d8b280 2024-09-21T07:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f117dffb640 1 -- 172.21.15.92:0/2137643551 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f11800a9050 con 0x558c91d8b280 2024-09-21T07:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f11a3233740 1 -- 172.21.15.92:0/2137643551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1188018a90 con 0x558c91d8b280 2024-09-21T07:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f117dffb640 1 -- 172.21.15.92:0/2137643551 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11800b18c0 con 0x558c91d8b280 2024-09-21T07:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f11a3233740 10 client.15489 fetch_fsmap learned FSMap version 28 2024-09-21T07:13:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f11a3233740 1 -- 172.21.15.92:0/2137643551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c921db610 con 0x558c91d8b280 2024-09-21T07:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f117dffb640 1 -- 172.21.15.92:0/2137643551 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1188018a90 con 0x558c91d8b280 2024-09-21T07:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f117dffb640 1 -- 172.21.15.92:0/2137643551 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1180094070 con 0x558c91d8b280 2024-09-21T07:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f11a3233740 10 client.15489 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f11a3233740 10 client.15489 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f11a3233740 20 client.15489 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f11a3233740 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c91d3fc90 0x558c921dee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f11a3233740 4 client.15489 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.463+0000 7f11a3233740 1 -- 172.21.15.92:0/2137643551 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "status"}) -- 0x558c920c7610 con 0x558c91d3fc90 2024-09-21T07:13:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f119659c640 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c91d3fc90 0x558c921dee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f117dffb640 10 client.15489 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:13:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f119659c640 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c91d3fc90 0x558c921dee40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=58d2af117c7df144 server_cookie=423af0b3ce36b8eb in_seq=0 out_seq=0 2024-09-21T07:13:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f117dffb640 1 -- 172.21.15.92:0/2137643551 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558c920c7610 con 0x558c91d3fc90 2024-09-21T07:13:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f117dffb640 10 client.15489 handle_command_reply: tid=0 2024-09-21T07:13:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f11a3233740 1 client.15489 shutdown 2024-09-21T07:13:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f11a3233740 1 -- 172.21.15.92:0/2137643551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d8b280 msgr2=0x558c92172100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f11a3233740 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d8b280 0x558c92172100 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f11800e7470 tx=0x7f11800ac610 comp rx=0 tx=0).stop 2024-09-21T07:13:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f11a3233740 1 -- 172.21.15.92:0/2137643551 shutdown_connections 2024-09-21T07:13:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f11a3233740 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c91d3fc90 0x558c921dee40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f11a3233740 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c91dabf60 0x558c921726c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f11a3233740 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c91d8b280 0x558c92172100 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f11a3233740 1 --2- 172.21.15.92:0/2137643551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c91d830a0 0x558c92178c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f11a3233740 1 -- 172.21.15.92:0/2137643551 >> 172.21.15.92:0/2137643551 conn(0x558c91da0350 msgr2=0x558c92158980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.464+0000 7f117dffb640 0 client.15489 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:13:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f11a3233740 1 -- 172.21.15.92:0/2137643551 shutdown_connections 2024-09-21T07:13:06.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f11a3233740 1 -- 172.21.15.92:0/2137643551 wait complete. 2024-09-21T07:13:06.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f11a3233740 20 client.15489 trim_cache size 0 max 16384 2024-09-21T07:13:06.483 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:06.483 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:13:06.483 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 4, 2024-09-21T07:13:06.484 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24566, 2024-09-21T07:13:06.484 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:13:06.484 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:13:06.484 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:13:06.484 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 93.740877198999996, 2024-09-21T07:13:06.484 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 28, 2024-09-21T07:13:06.484 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:13:06.484 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T07:13:06.484 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 156.845625692 2024-09-21T07:13:06.485 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:06.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 -- 172.21.15.92:0/3755762523 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11840b6610 msgr2=0x7f11840b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:06.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11840b6610 0x7f11840b8b20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1190006010 tx=0x7f1190009360 comp rx=0 tx=0).stop 2024-09-21T07:13:06.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 -- 172.21.15.92:0/3755762523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11981094a0 msgr2=0x7f119819a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:06.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11981094a0 0x7f119819a9a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f118000d740 tx=0x7f118000db40 comp rx=0 tx=0).stop 2024-09-21T07:13:06.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 -- 172.21.15.92:0/3755762523 shutdown_connections 2024-09-21T07:13:06.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11840b6610 0x7f11840b8b20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1198109df0 0x7f119819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11981094a0 0x7f119819a9a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 --2- 172.21.15.92:0/3755762523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1198103b60 0x7f119819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:06.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 -- 172.21.15.92:0/3755762523 >> 172.21.15.92:0/3755762523 conn(0x7f119807b850 msgr2=0x7f1198107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:06.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 -- 172.21.15.92:0/3755762523 shutdown_connections 2024-09-21T07:13:06.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:06.465+0000 7f119ccbf640 1 -- 172.21.15.92:0/3755762523 wait complete. 2024-09-21T07:13:07.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:06 smithi175 ceph-mon[34064]: pgmap v340: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:13:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:06 smithi092 ceph-mon[30987]: pgmap v340: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:13:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:06 smithi169 ceph-mon[33705]: pgmap v340: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:13:07.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.l status 2024-09-21T07:13:07.415 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:07.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.890+0000 7fa525872640 1 -- 172.21.15.92:0/2745103966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa520105db0 msgr2=0x7fa5201061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:07.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.890+0000 7fa525872640 1 --2- 172.21.15.92:0/2745103966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa520105db0 0x7fa5201061c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa510009900 tx=0x7fa51002a410 comp rx=0 tx=0).stop 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.890+0000 7fa525872640 1 -- 172.21.15.92:0/2745103966 shutdown_connections 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.890+0000 7fa525872640 1 --2- 172.21.15.92:0/2745103966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa52010c040 0x7fa520112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.890+0000 7fa525872640 1 --2- 172.21.15.92:0/2745103966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa52010b6f0 0x7fa52010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.890+0000 7fa525872640 1 --2- 172.21.15.92:0/2745103966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa520105db0 0x7fa5201061c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.890+0000 7fa525872640 1 -- 172.21.15.92:0/2745103966 >> 172.21.15.92:0/2745103966 conn(0x7fa5201017c0 msgr2=0x7fa520103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.890+0000 7fa525872640 1 -- 172.21.15.92:0/2745103966 shutdown_connections 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.890+0000 7fa525872640 1 -- 172.21.15.92:0/2745103966 wait complete. 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.890+0000 7fa525872640 1 Processor -- start 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa525872640 1 -- start start 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa525872640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa520105db0 0x7fa52019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa525872640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa52010b6f0 0x7fa52019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa525872640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa52010c040 0x7fa5201a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa525872640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa520115bb0 con 0x7fa52010b6f0 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa525872640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa520115a30 con 0x7fa520105db0 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa525872640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa520115d30 con 0x7fa52010c040 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa52010b6f0 0x7fa52019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa52010b6f0 0x7fa52019cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60066/0 (socket says 172.21.15.92:60066) 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51e7fc640 1 -- 172.21.15.92:0/760668152 learned_addr learned my addr 172.21.15.92:0/760668152 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51effd640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa520105db0 0x7fa52019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa52010c040 0x7fa5201a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51e7fc640 1 -- 172.21.15.92:0/760668152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa52010c040 msgr2=0x7fa5201a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51e7fc640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa52010c040 0x7fa5201a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51e7fc640 1 -- 172.21.15.92:0/760668152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa520105db0 msgr2=0x7fa52019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:07.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51e7fc640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa520105db0 0x7fa52019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51e7fc640 1 -- 172.21.15.92:0/760668152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5201a2590 con 0x7fa52010b6f0 2024-09-21T07:13:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa52010c040 0x7fa5201a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.891+0000 7fa51effd640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa520105db0 0x7fa52019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.892+0000 7fa51e7fc640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa52010b6f0 0x7fa52019cbc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa51400d740 tx=0x7fa51400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.892+0000 7fa524870640 1 -- 172.21.15.92:0/760668152 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514017070 con 0x7fa52010b6f0 2024-09-21T07:13:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.892+0000 7fa524870640 1 -- 172.21.15.92:0/760668152 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa51400de50 con 0x7fa52010b6f0 2024-09-21T07:13:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.892+0000 7fa525872640 1 -- 172.21.15.92:0/760668152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5201a2880 con 0x7fa52010b6f0 2024-09-21T07:13:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.892+0000 7fa524870640 1 -- 172.21.15.92:0/760668152 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51400f620 con 0x7fa52010b6f0 2024-09-21T07:13:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.892+0000 7fa525872640 1 -- 172.21.15.92:0/760668152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5201a8fe0 con 0x7fa52010b6f0 2024-09-21T07:13:07.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.895+0000 7fa52bde6740 1 Processor -- start 2024-09-21T07:13:07.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.895+0000 7fa52bde6740 1 -- start start 2024-09-21T07:13:07.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.895+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d348883f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.895+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d348884440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.895+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d348884980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.895+0000 7fa52bde6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d3487fbc10 con 0x55d3484bd280 2024-09-21T07:13:07.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.895+0000 7fa52bde6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d3487eb040 con 0x55d3484ddf60 2024-09-21T07:13:07.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.895+0000 7fa52bde6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d3487eee50 con 0x55d3484b50a0 2024-09-21T07:13:07.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.895+0000 7fa524870640 1 -- 172.21.15.92:0/760668152 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fa51401a070 con 0x7fa52010b6f0 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.895+0000 7fa51f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d348883f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d348883f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:37290/0 (socket says 172.21.15.92:37290) 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51f7fe640 1 -- 172.21.15.92:0/34902068 learned_addr learned my addr 172.21.15.92:0/34902068 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51effd640 1 --2- 172.21.15.92:0/34902068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d348884440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51e7fc640 1 --2- 172.21.15.92:0/34902068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d348884980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51f7fe640 1 -- 172.21.15.92:0/34902068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 msgr2=0x55d348884440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/34902068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d348884440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51f7fe640 1 -- 172.21.15.92:0/34902068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 msgr2=0x55d348884980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/34902068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d348884980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51f7fe640 1 -- 172.21.15.92:0/34902068 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d348549540 con 0x55d3484ddf60 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51e7fc640 1 --2- 172.21.15.92:0/34902068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d348884980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/34902068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d348883f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa518009f10 tx=0x7fa51800e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e23c2dc230d9a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa524870640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa5080b6560 0x7fa5080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.896+0000 7fa505ffb640 1 -- 172.21.15.92:0/34902068 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa518016070 con 0x55d3484ddf60 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa51effd640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa5080b6560 0x7fa5080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa505ffb640 1 -- 172.21.15.92:0/34902068 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa518004d20 con 0x55d3484ddf60 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa505ffb640 1 -- 172.21.15.92:0/34902068 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5180116d0 con 0x55d3484ddf60 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa524870640 1 -- 172.21.15.92:0/760668152 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa5140e7310 con 0x7fa52010b6f0 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa52bde6740 1 -- 172.21.15.92:0/34902068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 msgr2=0x55d348883f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa51effd640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa5080b6560 0x7fa5080b8a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa510000c00 tx=0x7fa510009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa52bde6740 1 --2- 172.21.15.92:0/34902068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d348883f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa518009f10 tx=0x7fa51800e6c0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa52bde6740 1 -- 172.21.15.92:0/34902068 shutdown_connections 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa52bde6740 1 --2- 172.21.15.92:0/34902068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d348884980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa52bde6740 1 --2- 172.21.15.92:0/34902068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d348884440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa52bde6740 1 --2- 172.21.15.92:0/34902068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d348883f00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.897+0000 7fa52bde6740 1 -- 172.21.15.92:0/34902068 >> 172.21.15.92:0/34902068 conn(0x55d3484d2350 msgr2=0x55d348881df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.898+0000 7fa52bde6740 1 -- 172.21.15.92:0/34902068 shutdown_connections 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.898+0000 7fa52bde6740 1 -- 172.21.15.92:0/34902068 wait complete. 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.898+0000 7fa52bde6740 1 -- start start 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.898+0000 7fa52bde6740 1 Processor -- start 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.898+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d34888f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.898+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484bd280 0x55d34888ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484ddf60 0x55d34889b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa52bde6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d34864c5f0 con 0x55d3484ddf60 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa52bde6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d348786010 con 0x55d3484bd280 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa52bde6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d3488926e0 con 0x55d3484b50a0 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa52bde6740 10 client.0 _ll_register_callbacks cb 0x55d3487e5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484ddf60 0x55d34889b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484ddf60 0x55d34889b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60086/0 (socket says 172.21.15.92:60086) 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1247274912 learned_addr learned my addr 172.21.15.92:0/1247274912 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51effd640 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d34888f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51e7fc640 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484bd280 0x55d34888ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1247274912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 msgr2=0x55d34888f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d34888f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1247274912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484bd280 msgr2=0x55d34888ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484bd280 0x55d34888ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1247274912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3487b3a00 con 0x55d3484ddf60 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484ddf60 0x55d34889b9d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa5180054c0 tx=0x7fa5180054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4728b9cfe8dc75b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa4feffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa4feffd640 1 -- 172.21.15.92:0/1247274912 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa518016040 con 0x55d3484ddf60 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa4feffd640 1 -- 172.21.15.92:0/1247274912 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa518003970 con 0x55d3484ddf60 2024-09-21T07:13:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.899+0000 7fa52bde6740 1 -- 172.21.15.92:0/1247274912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa518004d20 con 0x55d3484ddf60 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa4feffd640 1 -- 172.21.15.92:0/1247274912 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa518009ae0 con 0x55d3484ddf60 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa52bde6740 10 client.15501 fetch_fsmap learned FSMap version 28 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa52bde6740 1 -- 172.21.15.92:0/1247274912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d34889e600 con 0x55d3484ddf60 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa4feffd640 1 -- 172.21.15.92:0/1247274912 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa518004d20 con 0x55d3484ddf60 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa4feffd640 1 -- 172.21.15.92:0/1247274912 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa51800f040 con 0x55d3484ddf60 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa52bde6740 10 client.15501 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa52bde6740 10 client.15501 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa52bde6740 20 client.15501 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa52bde6740 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d34849c8e0 0x55d3488a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa52bde6740 4 client.15501 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa52bde6740 1 -- 172.21.15.92:0/1247274912 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3487fdb60 con 0x55d34849c8e0 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.900+0000 7fa51effd640 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d34849c8e0 0x55d3488a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.901+0000 7fa51effd640 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d34849c8e0 0x55d3488a1c90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f9d8750e7c7c141b server_cookie=59f285601a5c5242 in_seq=0 out_seq=0 2024-09-21T07:13:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.901+0000 7fa4feffd640 10 client.15501 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa4feffd640 1 -- 172.21.15.92:0/1247274912 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3487fdb60 con 0x55d34849c8e0 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa4feffd640 10 client.15501 handle_command_reply: tid=0 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 client.15501 shutdown 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 -- 172.21.15.92:0/1247274912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484ddf60 msgr2=0x55d34889b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484ddf60 0x55d34889b9d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa5180054c0 tx=0x7fa5180054f0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 -- 172.21.15.92:0/1247274912 shutdown_connections 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d34849c8e0 0x55d3488a1c90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484ddf60 0x55d34889b9d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484bd280 0x55d34888ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 --2- 172.21.15.92:0/1247274912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d34888f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 -- 172.21.15.92:0/1247274912 >> 172.21.15.92:0/1247274912 conn(0x55d3484d2350 msgr2=0x55d3488870e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa4feffd640 0 client.15501 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 -- 172.21.15.92:0/1247274912 shutdown_connections 2024-09-21T07:13:07.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 1 -- 172.21.15.92:0/1247274912 wait complete. 2024-09-21T07:13:07.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.902+0000 7fa52bde6740 20 client.15501 trim_cache size 0 max 16384 2024-09-21T07:13:07.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa52bde6740 1 Processor -- start 2024-09-21T07:13:07.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa52bde6740 1 -- start start 2024-09-21T07:13:07.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484b50a0 0x55d348885a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484bd280 0x55d34889b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d34889be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa52bde6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d34889ffd0 con 0x55d3484b50a0 2024-09-21T07:13:07.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa52bde6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d3488a06a0 con 0x55d3484ddf60 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa52bde6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d3488a0d70 con 0x55d3484bd280 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa51effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484b50a0 0x55d348885a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa51effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484b50a0 0x55d348885a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60096/0 (socket says 172.21.15.92:60096) 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.920+0000 7fa51effd640 1 -- 172.21.15.92:0/411218414 learned_addr learned my addr 172.21.15.92:0/411218414 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa51e7fc640 1 --2- 172.21.15.92:0/411218414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484bd280 0x55d34889b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/411218414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d34889be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa51effd640 1 -- 172.21.15.92:0/411218414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484bd280 msgr2=0x55d34889b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa51effd640 1 --2- 172.21.15.92:0/411218414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484bd280 0x55d34889b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa51effd640 1 -- 172.21.15.92:0/411218414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 msgr2=0x55d34889be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa51effd640 1 --2- 172.21.15.92:0/411218414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d34889be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa51effd640 1 -- 172.21.15.92:0/411218414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d348890a80 con 0x55d3484b50a0 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/411218414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d34889be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa51effd640 1 --2- 172.21.15.92:0/411218414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484b50a0 0x55d348885a10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa510009900 tx=0x7fa51003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd625d3e54296324 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:07.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa5057fa640 1 -- 172.21.15.92:0/411218414 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510035040 con 0x55d3484b50a0 2024-09-21T07:13:07.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa5057fa640 1 -- 172.21.15.92:0/411218414 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa510055070 con 0x55d3484b50a0 2024-09-21T07:13:07.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.921+0000 7fa5057fa640 1 -- 172.21.15.92:0/411218414 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51003c440 con 0x55d3484b50a0 2024-09-21T07:13:07.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 -- 172.21.15.92:0/411218414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484b50a0 msgr2=0x55d348885a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:07.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 --2- 172.21.15.92:0/411218414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484b50a0 0x55d348885a10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa510009900 tx=0x7fa51003e000 comp rx=0 tx=0).stop 2024-09-21T07:13:07.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 -- 172.21.15.92:0/411218414 shutdown_connections 2024-09-21T07:13:07.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 --2- 172.21.15.92:0/411218414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d34889be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 --2- 172.21.15.92:0/411218414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484bd280 0x55d34889b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 --2- 172.21.15.92:0/411218414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484b50a0 0x55d348885a10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 -- 172.21.15.92:0/411218414 >> 172.21.15.92:0/411218414 conn(0x55d3484d2350 msgr2=0x55d34887cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 -- 172.21.15.92:0/411218414 shutdown_connections 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 -- 172.21.15.92:0/411218414 wait complete. 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 -- start start 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.922+0000 7fa52bde6740 1 Processor -- start 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d3488a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d3488a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa52bde6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d34890b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa52bde6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d3488a1b10 con 0x55d3484bd280 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa52bde6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d3488a1440 con 0x55d3484ddf60 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa52bde6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d3488a21e0 con 0x55d3484b50a0 2024-09-21T07:13:07.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa52bde6740 10 client.0 _ll_register_callbacks cb 0x7fa5140eacc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d3488a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d3488a3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60098/0 (socket says 172.21.15.92:60098) 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51e7fc640 1 -- 172.21.15.92:0/396623001 learned_addr learned my addr 172.21.15.92:0/396623001 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51effd640 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d3488a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51f7fe640 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d34890b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51e7fc640 1 -- 172.21.15.92:0/396623001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 msgr2=0x55d3488a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51e7fc640 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d3488a36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51e7fc640 1 -- 172.21.15.92:0/396623001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 msgr2=0x55d34890b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51e7fc640 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d34890b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51e7fc640 1 -- 172.21.15.92:0/396623001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d34890b690 con 0x55d3484bd280 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa51e7fc640 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d3488a3be0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa5140aa250 tx=0x7fa514010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb5e4331e5c6eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.923+0000 7fa4feffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa4feffd640 1 -- 172.21.15.92:0/396623001 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514021040 con 0x55d3484bd280 2024-09-21T07:13:07.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa4feffd640 1 -- 172.21.15.92:0/396623001 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa5140a8b30 con 0x55d3484bd280 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa52bde6740 1 -- 172.21.15.92:0/396623001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa510055070 con 0x55d3484bd280 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa4feffd640 1 -- 172.21.15.92:0/396623001 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa5140acdb0 con 0x55d3484bd280 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa52bde6740 10 client.15507 fetch_fsmap learned FSMap version 28 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa52bde6740 1 -- 172.21.15.92:0/396623001 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d34890c820 con 0x55d3484bd280 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa4feffd640 1 -- 172.21.15.92:0/396623001 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa510055070 con 0x55d3484bd280 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa4feffd640 1 -- 172.21.15.92:0/396623001 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa5140abcb0 con 0x55d3484bd280 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa52bde6740 10 client.15507 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa52bde6740 10 client.15507 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa52bde6740 20 client.15507 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa52bde6740 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d348471c90 0x55d348910130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa52bde6740 4 client.15507 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.924+0000 7fa52bde6740 1 -- 172.21.15.92:0/396623001 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "status"}) -- 0x55d3487f9610 con 0x55d348471c90 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa51effd640 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d348471c90 0x55d348910130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:07.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa51effd640 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d348471c90 0x55d348910130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d8ba265de777308 server_cookie=7d91b4b65b99694d in_seq=0 out_seq=0 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa4feffd640 10 client.15507 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa4feffd640 1 -- 172.21.15.92:0/396623001 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d3487f9610 con 0x55d348471c90 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa4feffd640 10 client.15507 handle_command_reply: tid=0 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa52bde6740 1 client.15507 shutdown 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa52bde6740 1 -- 172.21.15.92:0/396623001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 msgr2=0x55d3488a3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa52bde6740 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d3488a3be0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa5140aa250 tx=0x7fa514010f90 comp rx=0 tx=0).stop 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa52bde6740 1 -- 172.21.15.92:0/396623001 shutdown_connections 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa52bde6740 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d3484ddf60 0x55d34890b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa52bde6740 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d348471c90 0x55d348910130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa52bde6740 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d3484bd280 0x55d3488a3be0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa52bde6740 1 --2- 172.21.15.92:0/396623001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3484b50a0 0x55d3488a36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa4feffd640 0 client.15507 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.925+0000 7fa52bde6740 1 -- 172.21.15.92:0/396623001 >> 172.21.15.92:0/396623001 conn(0x55d3484d2350 msgr2=0x55d34887cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa52bde6740 1 -- 172.21.15.92:0/396623001 shutdown_connections 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa52bde6740 1 -- 172.21.15.92:0/396623001 wait complete. 2024-09-21T07:13:07.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa52bde6740 20 client.15507 trim_cache size 0 max 16384 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 3, 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24583, 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 96.211161227000005, 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 28, 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T07:13:07.933 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 175.99556565500001 2024-09-21T07:13:07.934 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:07.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 -- 172.21.15.92:0/760668152 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa5080b6560 msgr2=0x7fa5080b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:07.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa5080b6560 0x7fa5080b8a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa510000c00 tx=0x7fa510009560 comp rx=0 tx=0).stop 2024-09-21T07:13:07.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 -- 172.21.15.92:0/760668152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa52010b6f0 msgr2=0x7fa52019cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:07.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa52010b6f0 0x7fa52019cbc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa51400d740 tx=0x7fa51400dc00 comp rx=0 tx=0).stop 2024-09-21T07:13:07.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 -- 172.21.15.92:0/760668152 shutdown_connections 2024-09-21T07:13:07.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa5080b6560 0x7fa5080b8a70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa52010c040 0x7fa5201a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa52010b6f0 0x7fa52019cbc0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 --2- 172.21.15.92:0/760668152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa520105db0 0x7fa52019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:07.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 -- 172.21.15.92:0/760668152 >> 172.21.15.92:0/760668152 conn(0x7fa5201017c0 msgr2=0x7fa520109ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:07.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 -- 172.21.15.92:0/760668152 shutdown_connections 2024-09-21T07:13:07.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:07.926+0000 7fa525872640 1 -- 172.21.15.92:0/760668152 wait complete. 2024-09-21T07:13:08.636 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:13:08.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:08 smithi092 ceph-mon[30987]: pgmap v341: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:13:08.883 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:09.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:08 smithi175 ceph-mon[34064]: pgmap v341: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:13:09.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:08 smithi169 ceph-mon[33705]: pgmap v341: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:13:09.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.341+0000 7faeca50d640 1 -- 172.21.15.92:0/4034052648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec410de60 msgr2=0x7faec4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:09.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.341+0000 7faeca50d640 1 --2- 172.21.15.92:0/4034052648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec410de60 0x7faec4110330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faebc009ca0 tx=0x7faebc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.341+0000 7faeca50d640 1 -- 172.21.15.92:0/4034052648 shutdown_connections 2024-09-21T07:13:09.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.341+0000 7faeca50d640 1 --2- 172.21.15.92:0/4034052648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec410de60 0x7faec4110330 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.341+0000 7faeca50d640 1 --2- 172.21.15.92:0/4034052648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faec4105380 0x7faec410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.341+0000 7faeca50d640 1 --2- 172.21.15.92:0/4034052648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec4104a30 0x7faec4104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.341+0000 7faeca50d640 1 -- 172.21.15.92:0/4034052648 >> 172.21.15.92:0/4034052648 conn(0x7faec4079760 msgr2=0x7faec4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.341+0000 7faeca50d640 1 -- 172.21.15.92:0/4034052648 shutdown_connections 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.341+0000 7faeca50d640 1 -- 172.21.15.92:0/4034052648 wait complete. 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faeca50d640 1 Processor -- start 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faeca50d640 1 -- start start 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faeca50d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4104a30 0x7faec4102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faeca50d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec4105380 0x7faec4102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faeca50d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faec410de60 0x7faec41031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faeca50d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faec41139c0 con 0x7faec4104a30 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faeca50d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faec4113840 con 0x7faec410de60 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faeca50d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faec4113b40 con 0x7faec4105380 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faec3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4104a30 0x7faec4102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faec3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4104a30 0x7faec4102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60128/0 (socket says 172.21.15.92:60128) 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faec3fff640 1 -- 172.21.15.92:0/1763826405 learned_addr learned my addr 172.21.15.92:0/1763826405 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faec410de60 0x7faec41031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faec37fe640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec4105380 0x7faec4102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faec3fff640 1 -- 172.21.15.92:0/1763826405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec4105380 msgr2=0x7faec4102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faec3fff640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec4105380 0x7faec4102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faec3fff640 1 -- 172.21.15.92:0/1763826405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faec410de60 msgr2=0x7faec41031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.342+0000 7faec3fff640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faec410de60 0x7faec41031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.343+0000 7faec3fff640 1 -- 172.21.15.92:0/1763826405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec41a8580 con 0x7faec4104a30 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.343+0000 7faec37fe640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec4105380 0x7faec4102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.343+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faec410de60 0x7faec41031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.343+0000 7faec3fff640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4104a30 0x7faec4102770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faeb400d950 tx=0x7faeb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.343+0000 7faec17fa640 1 -- 172.21.15.92:0/1763826405 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4017070 con 0x7faec4104a30 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.343+0000 7faeca50d640 1 -- 172.21.15.92:0/1763826405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec41a8870 con 0x7faec4104a30 2024-09-21T07:13:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.343+0000 7faec17fa640 1 -- 172.21.15.92:0/1763826405 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faeb4009c30 con 0x7faec4104a30 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.343+0000 7faec17fa640 1 -- 172.21.15.92:0/1763826405 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb400f620 con 0x7faec4104a30 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.343+0000 7faeca50d640 1 -- 172.21.15.92:0/1763826405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec41a8d60 con 0x7faec4104a30 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.345+0000 7faed0a81740 1 Processor -- start 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.345+0000 7faed0a81740 1 -- start start 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec17fa640 1 -- 172.21.15.92:0/1763826405 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7faeb401a070 con 0x7faec4104a30 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faed0a81740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df2108f60 0x557df24aef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faed0a81740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e00a0 0x557df24af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faed0a81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e8280 0x557df24af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faed0a81740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557df2426c10 con 0x557df2108f60 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faed0a81740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557df2416040 con 0x557df20e00a0 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faed0a81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557df2419e50 con 0x557df20e8280 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec8aaa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df2108f60 0x557df24aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec8aaa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df2108f60 0x557df24aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60142/0 (socket says 172.21.15.92:60142) 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec8aaa640 1 -- 172.21.15.92:0/1750760702 learned_addr learned my addr 172.21.15.92:0/1750760702 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec3fff640 1 --2- 172.21.15.92:0/1750760702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e00a0 0x557df24af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec37fe640 1 --2- 172.21.15.92:0/1750760702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e8280 0x557df24af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec8aaa640 1 -- 172.21.15.92:0/1750760702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e8280 msgr2=0x557df24af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1750760702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e8280 0x557df24af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec8aaa640 1 -- 172.21.15.92:0/1750760702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e00a0 msgr2=0x557df24af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1750760702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e00a0 0x557df24af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec8aaa640 1 -- 172.21.15.92:0/1750760702 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557df2174540 con 0x557df2108f60 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.346+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1750760702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df2108f60 0x557df24aef00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faebc009a60 tx=0x7faebc031610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8c6dff72e44783 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.347+0000 7faec17fa640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faeac0b6560 0x7faeac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.347+0000 7faeaa7fc640 1 -- 172.21.15.92:0/1750760702 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc031b80 con 0x557df2108f60 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.347+0000 7faec3fff640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faeac0b6560 0x7faeac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.347+0000 7faeaa7fc640 1 -- 172.21.15.92:0/1750760702 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faebc036040 con 0x557df2108f60 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.347+0000 7faeaa7fc640 1 -- 172.21.15.92:0/1750760702 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc004570 con 0x557df2108f60 2024-09-21T07:13:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.347+0000 7faec17fa640 1 -- 172.21.15.92:0/1763826405 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7faeb40e73a0 con 0x7faec4104a30 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 -- 172.21.15.92:0/1750760702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df2108f60 msgr2=0x557df24aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faec3fff640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faeac0b6560 0x7faeac0b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x557df24adb80 tx=0x7faeb4010000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 --2- 172.21.15.92:0/1750760702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df2108f60 0x557df24aef00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faebc009a60 tx=0x7faebc031610 comp rx=0 tx=0).stop 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 -- 172.21.15.92:0/1750760702 shutdown_connections 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 --2- 172.21.15.92:0/1750760702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e8280 0x557df24af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 --2- 172.21.15.92:0/1750760702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e00a0 0x557df24af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 --2- 172.21.15.92:0/1750760702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df2108f60 0x557df24aef00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 -- 172.21.15.92:0/1750760702 >> 172.21.15.92:0/1750760702 conn(0x557df20fd350 msgr2=0x557df24acdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 -- 172.21.15.92:0/1750760702 shutdown_connections 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 -- 172.21.15.92:0/1750760702 wait complete. 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 -- start start 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.348+0000 7faed0a81740 1 Processor -- start 2024-09-21T07:13:09.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faed0a81740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20e00a0 0x557df24ba7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faed0a81740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e8280 0x557df24bad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faed0a81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df2108f60 0x557df24c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faed0a81740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557df22775f0 con 0x557df20e00a0 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faed0a81740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557df23b1010 con 0x557df20e8280 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faed0a81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557df24bd680 con 0x557df2108f60 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faed0a81740 10 client.0 _ll_register_callbacks cb 0x557df2410340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec8aaa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20e00a0 0x557df24ba7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec8aaa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20e00a0 0x557df24ba7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60146/0 (socket says 172.21.15.92:60146) 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec8aaa640 1 -- 172.21.15.92:0/1594803068 learned_addr learned my addr 172.21.15.92:0/1594803068 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec37fe640 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e8280 0x557df24bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec8aaa640 1 -- 172.21.15.92:0/1594803068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df2108f60 msgr2=0x557df24c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df2108f60 0x557df24c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec8aaa640 1 -- 172.21.15.92:0/1594803068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e8280 msgr2=0x557df24bad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:09.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e8280 0x557df24bad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec8aaa640 1 -- 172.21.15.92:0/1594803068 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557df23dea00 con 0x557df20e00a0 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec37fe640 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e8280 0x557df24bad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20e00a0 0x557df24ba7a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faebc004250 tx=0x7faebc031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7709d595f12541b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faea37fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faea37fe640 1 -- 172.21.15.92:0/1594803068 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc031d80 con 0x557df20e00a0 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faea37fe640 1 -- 172.21.15.92:0/1594803068 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7faebc0042f0 con 0x557df20e00a0 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.349+0000 7faed0a81740 1 -- 172.21.15.92:0/1594803068 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faebc036040 con 0x557df20e00a0 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faea37fe640 1 -- 172.21.15.92:0/1594803068 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faebc0044f0 con 0x557df20e00a0 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faed0a81740 10 client.15519 fetch_fsmap learned FSMap version 28 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faed0a81740 1 -- 172.21.15.92:0/1594803068 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557df24c95a0 con 0x557df20e00a0 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faea37fe640 1 -- 172.21.15.92:0/1594803068 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faebc036040 con 0x557df20e00a0 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faea37fe640 1 -- 172.21.15.92:0/1594803068 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7faebc058030 con 0x557df20e00a0 2024-09-21T07:13:09.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faed0a81740 10 client.15519 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:13:09.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faed0a81740 10 client.15519 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:13:09.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faed0a81740 20 client.15519 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:09.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faed0a81740 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557df20c78e0 0x557df24ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faed0a81740 4 client.15519 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:09.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.350+0000 7faed0a81740 1 -- 172.21.15.92:0/1594803068 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557df2428b60 con 0x557df20c78e0 2024-09-21T07:13:09.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.351+0000 7faec37fe640 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557df20c78e0 0x557df24ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.351+0000 7faec37fe640 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557df20c78e0 0x557df24ccb30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a72863aafcb00915 server_cookie=b9895a826b07bcba in_seq=0 out_seq=0 2024-09-21T07:13:09.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.351+0000 7faea37fe640 10 client.15519 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:13:09.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faea37fe640 1 -- 172.21.15.92:0/1594803068 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557df2428b60 con 0x557df20c78e0 2024-09-21T07:13:09.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faea37fe640 10 client.15519 handle_command_reply: tid=0 2024-09-21T07:13:09.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 client.15519 shutdown 2024-09-21T07:13:09.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 -- 172.21.15.92:0/1594803068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20e00a0 msgr2=0x557df24ba7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:09.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20e00a0 0x557df24ba7a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faebc004250 tx=0x7faebc031980 comp rx=0 tx=0).stop 2024-09-21T07:13:09.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 -- 172.21.15.92:0/1594803068 shutdown_connections 2024-09-21T07:13:09.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557df20c78e0 0x557df24ccb30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df2108f60 0x557df24c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faea37fe640 0 client.15519 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:13:09.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e8280 0x557df24bad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 --2- 172.21.15.92:0/1594803068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20e00a0 0x557df24ba7a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 -- 172.21.15.92:0/1594803068 >> 172.21.15.92:0/1594803068 conn(0x557df20fd350 msgr2=0x557df24b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:09.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 -- 172.21.15.92:0/1594803068 shutdown_connections 2024-09-21T07:13:09.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 1 -- 172.21.15.92:0/1594803068 wait complete. 2024-09-21T07:13:09.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.352+0000 7faed0a81740 20 client.15519 trim_cache size 0 max 16384 2024-09-21T07:13:09.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faed0a81740 1 Processor -- start 2024-09-21T07:13:09.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faed0a81740 1 -- start start 2024-09-21T07:13:09.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faed0a81740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faed0a81740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e00a0 0x557df24acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faed0a81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e8280 0x557df24c6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faed0a81740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557df24cae70 con 0x557df20c78e0 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faed0a81740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557df24cb540 con 0x557df20e00a0 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faed0a81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557df24cbc10 con 0x557df20e8280 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faec8aaa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faec8aaa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60152/0 (socket says 172.21.15.92:60152) 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faec8aaa640 1 -- 172.21.15.92:0/1502567805 learned_addr learned my addr 172.21.15.92:0/1502567805 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faec37fe640 1 --2- 172.21.15.92:0/1502567805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e00a0 0x557df24acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faec8aaa640 1 -- 172.21.15.92:0/1502567805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e8280 msgr2=0x557df24c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1502567805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e8280 0x557df24c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faec8aaa640 1 -- 172.21.15.92:0/1502567805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e00a0 msgr2=0x557df24acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1502567805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e00a0 0x557df24acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.371+0000 7faec8aaa640 1 -- 172.21.15.92:0/1502567805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557df24a7080 con 0x557df20c78e0 2024-09-21T07:13:09.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.372+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1502567805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24ccb30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7faebc030880 tx=0x7faebc031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93642c52ddcd6b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:09.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.372+0000 7faea9ffb640 1 -- 172.21.15.92:0/1502567805 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc004280 con 0x557df20c78e0 2024-09-21T07:13:09.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.372+0000 7faea9ffb640 1 -- 172.21.15.92:0/1502567805 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faebc036040 con 0x557df20c78e0 2024-09-21T07:13:09.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.372+0000 7faea9ffb640 1 -- 172.21.15.92:0/1502567805 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc003970 con 0x557df20c78e0 2024-09-21T07:13:09.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 -- 172.21.15.92:0/1502567805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 msgr2=0x557df24ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:09.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 --2- 172.21.15.92:0/1502567805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24ccb30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7faebc030880 tx=0x7faebc031a70 comp rx=0 tx=0).stop 2024-09-21T07:13:09.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 -- 172.21.15.92:0/1502567805 shutdown_connections 2024-09-21T07:13:09.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 --2- 172.21.15.92:0/1502567805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e8280 0x557df24c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 --2- 172.21.15.92:0/1502567805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e00a0 0x557df24acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 --2- 172.21.15.92:0/1502567805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24ccb30 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 -- 172.21.15.92:0/1502567805 >> 172.21.15.92:0/1502567805 conn(0x557df20fd350 msgr2=0x557df24ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 -- 172.21.15.92:0/1502567805 shutdown_connections 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 -- 172.21.15.92:0/1502567805 wait complete. 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 -- start start 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.373+0000 7faed0a81740 1 Processor -- start 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faed0a81740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faed0a81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e00a0 0x557df24cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faed0a81740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e8280 0x557df24cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faed0a81740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557df24cc9b0 con 0x557df20c78e0 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faed0a81740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557df24cc2e0 con 0x557df20e8280 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faed0a81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557df24cd080 con 0x557df20e00a0 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faed0a81740 10 client.0 _ll_register_callbacks cb 0x7faebc0314e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:09.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faec8aaa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faec8aaa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24d5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60168/0 (socket says 172.21.15.92:60168) 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faec8aaa640 1 -- 172.21.15.92:0/1800524051 learned_addr learned my addr 172.21.15.92:0/1800524051 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faec37fe640 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e00a0 0x557df24cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faec8aaa640 1 -- 172.21.15.92:0/1800524051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e00a0 msgr2=0x557df24cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e00a0 0x557df24cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faec8aaa640 1 -- 172.21.15.92:0/1800524051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e8280 msgr2=0x557df24cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e8280 0x557df24cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faec8aaa640 1 -- 172.21.15.92:0/1800524051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557df24b1d60 con 0x557df20c78e0 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faec8aaa640 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24d5700 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7faebc002230 tx=0x7faebc031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2db9190aef85da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faea37fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faea37fe640 1 -- 172.21.15.92:0/1800524051 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc003d80 con 0x557df20c78e0 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faea37fe640 1 -- 172.21.15.92:0/1800524051 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7faebc003f20 con 0x557df20c78e0 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.374+0000 7faed0a81740 1 -- 172.21.15.92:0/1800524051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faebc036040 con 0x557df20c78e0 2024-09-21T07:13:09.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faea37fe640 1 -- 172.21.15.92:0/1800524051 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faebc004120 con 0x557df20c78e0 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faed0a81740 10 client.15525 fetch_fsmap learned FSMap version 28 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faed0a81740 1 -- 172.21.15.92:0/1800524051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557df2538000 con 0x557df20c78e0 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faea37fe640 1 -- 172.21.15.92:0/1800524051 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faebc036040 con 0x557df20c78e0 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faea37fe640 1 -- 172.21.15.92:0/1800524051 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7faebc058040 con 0x557df20c78e0 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faed0a81740 10 client.15525 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faed0a81740 10 client.15525 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faed0a81740 20 client.15525 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faed0a81740 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557df2108f60 0x557df253b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faed0a81740 4 client.15525 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faed0a81740 1 -- 172.21.15.92:0/1800524051 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "status"}) -- 0x557df2424610 con 0x557df2108f60 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.375+0000 7faec37fe640 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557df2108f60 0x557df253b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faea37fe640 10 client.15525 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faec37fe640 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557df2108f60 0x557df253b3e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db24b01a1ebbe870 server_cookie=d80da671f021e10f in_seq=0 out_seq=0 2024-09-21T07:13:09.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faea37fe640 1 -- 172.21.15.92:0/1800524051 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557df2424610 con 0x557df2108f60 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faea37fe640 10 client.15525 handle_command_reply: tid=0 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faed0a81740 1 client.15525 shutdown 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faed0a81740 1 -- 172.21.15.92:0/1800524051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 msgr2=0x557df24d5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faed0a81740 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24d5700 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7faebc002230 tx=0x7faebc031840 comp rx=0 tx=0).stop 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faed0a81740 1 -- 172.21.15.92:0/1800524051 shutdown_connections 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faed0a81740 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557df2108f60 0x557df253b3e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faed0a81740 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557df20e8280 0x557df24cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faed0a81740 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557df20e00a0 0x557df24cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faed0a81740 1 --2- 172.21.15.92:0/1800524051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557df20c78e0 0x557df24d5700 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faed0a81740 1 -- 172.21.15.92:0/1800524051 >> 172.21.15.92:0/1800524051 conn(0x557df20fd350 msgr2=0x557df24ab3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faea37fe640 0 client.15525 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.376+0000 7faed0a81740 1 -- 172.21.15.92:0/1800524051 shutdown_connections 2024-09-21T07:13:09.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faed0a81740 1 -- 172.21.15.92:0/1800524051 wait complete. 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faed0a81740 20 client.15525 trim_cache size 0 max 16384 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 2, 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24608, 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 98.672546639999993, 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 28, 2024-09-21T07:13:09.383 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:13:09.384 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T07:13:09.384 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 145.52034273500001 2024-09-21T07:13:09.384 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:09.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 -- 172.21.15.92:0/1763826405 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faeac0b6560 msgr2=0x7faeac0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:09.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faeac0b6560 0x7faeac0b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x557df24adb80 tx=0x7faeb4010000 comp rx=0 tx=0).stop 2024-09-21T07:13:09.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 -- 172.21.15.92:0/1763826405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4104a30 msgr2=0x7faec4102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:09.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4104a30 0x7faec4102770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faeb400d950 tx=0x7faeb400de10 comp rx=0 tx=0).stop 2024-09-21T07:13:09.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 -- 172.21.15.92:0/1763826405 shutdown_connections 2024-09-21T07:13:09.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faeac0b6560 0x7faeac0b8a70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faec410de60 0x7faec41031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec4105380 0x7faec4102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 --2- 172.21.15.92:0/1763826405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4104a30 0x7faec4102770 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:09.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 -- 172.21.15.92:0/1763826405 >> 172.21.15.92:0/1763826405 conn(0x7faec4079760 msgr2=0x7faec4107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:09.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 -- 172.21.15.92:0/1763826405 shutdown_connections 2024-09-21T07:13:09.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:09.377+0000 7faeca50d640 1 -- 172.21.15.92:0/1763826405 wait complete. 2024-09-21T07:13:10.087 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T07:13:10.332 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:10.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.801+0000 7f457d83b640 1 -- 172.21.15.92:0/1874730189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4578108cf0 msgr2=0x7f457810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:10.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.801+0000 7f457d83b640 1 --2- 172.21.15.92:0/1874730189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4578108cf0 0x7f457810f520 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4570009ca0 tx=0x7f457002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.801+0000 7f457d83b640 1 -- 172.21.15.92:0/1874730189 shutdown_connections 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.801+0000 7f457d83b640 1 --2- 172.21.15.92:0/1874730189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4578108cf0 0x7f457810f520 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.801+0000 7f457d83b640 1 --2- 172.21.15.92:0/1874730189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45781083a0 0x7f45781087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.801+0000 7f457d83b640 1 --2- 172.21.15.92:0/1874730189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4578102a60 0x7f4578102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.801+0000 7f457d83b640 1 -- 172.21.15.92:0/1874730189 >> 172.21.15.92:0/1874730189 conn(0x7f4578079730 msgr2=0x7f4578079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.801+0000 7f457d83b640 1 -- 172.21.15.92:0/1874730189 shutdown_connections 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.801+0000 7f457d83b640 1 -- 172.21.15.92:0/1874730189 wait complete. 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.802+0000 7f457d83b640 1 Processor -- start 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.802+0000 7f457d83b640 1 -- start start 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f457d83b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4578102a60 0x7f457819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f457d83b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45781083a0 0x7f457819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f457d83b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4578108cf0 0x7f457819fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f457d83b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4578113960 con 0x7f4578102a60 2024-09-21T07:13:10.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f457d83b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45781137e0 con 0x7f4578108cf0 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f457d83b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4578113ae0 con 0x7f45781083a0 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f4576ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4578102a60 0x7f457819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f4576ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4578102a60 0x7f457819a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33060/0 (socket says 172.21.15.92:33060) 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f4576ffd640 1 -- 172.21.15.92:0/475205002 learned_addr learned my addr 172.21.15.92:0/475205002 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f456e7fc640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45781083a0 0x7f457819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f45777fe640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4578108cf0 0x7f457819fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f4576ffd640 1 -- 172.21.15.92:0/475205002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45781083a0 msgr2=0x7f457819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f4576ffd640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45781083a0 0x7f457819a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f4576ffd640 1 -- 172.21.15.92:0/475205002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4578108cf0 msgr2=0x7f457819fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f4576ffd640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4578108cf0 0x7f457819fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f4576ffd640 1 -- 172.21.15.92:0/475205002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45781a0300 con 0x7f4578102a60 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f45777fe640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4578108cf0 0x7f457819fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f456e7fc640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45781083a0 0x7f457819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:10.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f4576ffd640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4578102a60 0x7f457819a390 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f456800d770 tx=0x7f456800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f457c839640 1 -- 172.21.15.92:0/475205002 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568017070 con 0x7f4578102a60 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f457d83b640 1 -- 172.21.15.92:0/475205002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45781a05f0 con 0x7f4578102a60 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f457c839640 1 -- 172.21.15.92:0/475205002 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45680054b0 con 0x7f4578102a60 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.803+0000 7f457c839640 1 -- 172.21.15.92:0/475205002 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568004c60 con 0x7f4578102a60 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.804+0000 7f457d83b640 1 -- 172.21.15.92:0/475205002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45781a6d50 con 0x7f4578102a60 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f4583daf740 1 Processor -- start 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f4583daf740 1 -- start start 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f457c839640 1 -- 172.21.15.92:0/475205002 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f4568004e00 con 0x7f4578102a60 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f4583daf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0becf3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f4583daf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be9250a0 0x55b0becf4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f4583daf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 0x55b0becf4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f4583daf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b0bec6bc10 con 0x55b0be94df60 2024-09-21T07:13:10.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f4583daf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b0bec5b040 con 0x55b0be9250a0 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f4583daf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b0bec5ee50 con 0x55b0be92d280 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f45777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0becf3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f45777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0becf3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33062/0 (socket says 172.21.15.92:33062) 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.806+0000 7f45777fe640 1 -- 172.21.15.92:0/351380375 learned_addr learned my addr 172.21.15.92:0/351380375 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f4576ffd640 1 --2- 172.21.15.92:0/351380375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be9250a0 0x55b0becf4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f456e7fc640 1 --2- 172.21.15.92:0/351380375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 0x55b0becf4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f45777fe640 1 -- 172.21.15.92:0/351380375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 msgr2=0x55b0becf4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f45777fe640 1 --2- 172.21.15.92:0/351380375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 0x55b0becf4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f45777fe640 1 -- 172.21.15.92:0/351380375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be9250a0 msgr2=0x55b0becf4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f45777fe640 1 --2- 172.21.15.92:0/351380375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be9250a0 0x55b0becf4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f45777fe640 1 -- 172.21.15.92:0/351380375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0be9b9540 con 0x55b0be94df60 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f457c839640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f45640b6560 0x7f45640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f45777fe640 1 --2- 172.21.15.92:0/351380375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0becf3f00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4570031500 tx=0x7f4570031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd901251250821c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:10.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f4576ffd640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f45640b6560 0x7f45640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f457c839640 1 -- 172.21.15.92:0/475205002 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f45680e7350 con 0x7f4578102a60 2024-09-21T07:13:10.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f456dffb640 1 -- 172.21.15.92:0/351380375 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570031980 con 0x55b0be94df60 2024-09-21T07:13:10.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f456dffb640 1 -- 172.21.15.92:0/351380375 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4570036070 con 0x55b0be94df60 2024-09-21T07:13:10.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.807+0000 7f456dffb640 1 -- 172.21.15.92:0/351380375 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570004570 con 0x55b0be94df60 2024-09-21T07:13:10.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.808+0000 7f4583daf740 1 -- 172.21.15.92:0/351380375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 msgr2=0x55b0becf3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:10.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.808+0000 7f4576ffd640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f45640b6560 0x7f45640b8a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55b0becf2b80 tx=0x7f4568094040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:10.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.808+0000 7f4583daf740 1 --2- 172.21.15.92:0/351380375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0becf3f00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4570031500 tx=0x7f4570031530 comp rx=0 tx=0).stop 2024-09-21T07:13:10.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.808+0000 7f4583daf740 1 -- 172.21.15.92:0/351380375 shutdown_connections 2024-09-21T07:13:10.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.808+0000 7f4583daf740 1 --2- 172.21.15.92:0/351380375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 0x55b0becf4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.808+0000 7f4583daf740 1 --2- 172.21.15.92:0/351380375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be9250a0 0x55b0becf4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.808+0000 7f4583daf740 1 --2- 172.21.15.92:0/351380375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0becf3f00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.808+0000 7f4583daf740 1 -- 172.21.15.92:0/351380375 >> 172.21.15.92:0/351380375 conn(0x55b0be942350 msgr2=0x55b0becf1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.808+0000 7f4583daf740 1 -- 172.21.15.92:0/351380375 shutdown_connections 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.808+0000 7f4583daf740 1 -- 172.21.15.92:0/351380375 wait complete. 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f4583daf740 1 -- start start 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f4583daf740 1 Processor -- start 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f4583daf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be9250a0 0x55b0becff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f4583daf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be92d280 0x55b0becffef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f4583daf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed0b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f4583daf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b0beabc5f0 con 0x55b0be94df60 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f4583daf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b0bebf6010 con 0x55b0be92d280 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f4583daf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b0bed02680 con 0x55b0be9250a0 2024-09-21T07:13:10.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f4583daf740 10 client.0 _ll_register_callbacks cb 0x55b0bec55340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f45777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed0b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f45777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed0b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33072/0 (socket says 172.21.15.92:33072) 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f45777fe640 1 -- 172.21.15.92:0/1426871246 learned_addr learned my addr 172.21.15.92:0/1426871246 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f456e7fc640 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be92d280 0x55b0becffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.809+0000 7f45777fe640 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be9250a0 0x55b0becff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f45777fe640 1 -- 172.21.15.92:0/1426871246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be9250a0 msgr2=0x55b0becff9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f45777fe640 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be9250a0 0x55b0becff9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f45777fe640 1 -- 172.21.15.92:0/1426871246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be92d280 msgr2=0x55b0becffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f45777fe640 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be92d280 0x55b0becffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f45777fe640 1 -- 172.21.15.92:0/1426871246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0bec23a00 con 0x55b0be94df60 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f45777fe640 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed0b9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4570004270 tx=0x7f4570004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c11d772be687eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f4556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f4556ffd640 1 -- 172.21.15.92:0/1426871246 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570049040 con 0x55b0be94df60 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f4556ffd640 1 -- 172.21.15.92:0/1426871246 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4570031b80 con 0x55b0be94df60 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f4583daf740 1 -- 172.21.15.92:0/1426871246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4570036070 con 0x55b0be94df60 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f4556ffd640 1 -- 172.21.15.92:0/1426871246 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4570031d80 con 0x55b0be94df60 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f4583daf740 10 client.15537 fetch_fsmap learned FSMap version 28 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f4583daf740 1 -- 172.21.15.92:0/1426871246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b0bed0e580 con 0x55b0be94df60 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f4556ffd640 1 -- 172.21.15.92:0/1426871246 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4570036070 con 0x55b0be94df60 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.810+0000 7f4556ffd640 1 -- 172.21.15.92:0/1426871246 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4570030a10 con 0x55b0be94df60 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.811+0000 7f4583daf740 10 client.15537 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.811+0000 7f4583daf740 10 client.15537 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.811+0000 7f4583daf740 20 client.15537 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.811+0000 7f4583daf740 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b0be90c8e0 0x55b0bed11a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.811+0000 7f4583daf740 4 client.15537 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.811+0000 7f4583daf740 1 -- 172.21.15.92:0/1426871246 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0bec6db60 con 0x55b0be90c8e0 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.811+0000 7f456e7fc640 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b0be90c8e0 0x55b0bed11a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.811+0000 7f4556ffd640 10 client.15537 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.811+0000 7f456e7fc640 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b0be90c8e0 0x55b0bed11a90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b40c1e4c3f201de server_cookie=9d7a34940e3d9d81 in_seq=0 out_seq=0 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4556ffd640 1 -- 172.21.15.92:0/1426871246 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0bec6db60 con 0x55b0be90c8e0 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4556ffd640 10 client.15537 handle_command_reply: tid=0 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 client.15537 shutdown 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 -- 172.21.15.92:0/1426871246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 msgr2=0x55b0bed0b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed0b9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4570004270 tx=0x7f4570004170 comp rx=0 tx=0).stop 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 -- 172.21.15.92:0/1426871246 shutdown_connections 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b0be90c8e0 0x55b0bed11a90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed0b9a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be92d280 0x55b0becffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4556ffd640 0 client.15537 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 --2- 172.21.15.92:0/1426871246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be9250a0 0x55b0becff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 -- 172.21.15.92:0/1426871246 >> 172.21.15.92:0/1426871246 conn(0x55b0be942350 msgr2=0x55b0becf70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:10.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 -- 172.21.15.92:0/1426871246 shutdown_connections 2024-09-21T07:13:10.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.812+0000 7f4583daf740 1 -- 172.21.15.92:0/1426871246 wait complete. 2024-09-21T07:13:10.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.813+0000 7f4583daf740 20 client.15537 trim_cache size 0 max 16384 2024-09-21T07:13:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.830+0000 7f4583daf740 1 Processor -- start 2024-09-21T07:13:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.830+0000 7f4583daf740 1 -- start start 2024-09-21T07:13:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f4583daf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be9250a0 0x55b0bed0ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f4583daf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be92d280 0x55b0bed11a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f4583daf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be94df60 0x55b0bed0b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f4583daf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b0bed0fdd0 con 0x55b0be9250a0 2024-09-21T07:13:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f4583daf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b0bed104a0 con 0x55b0be92d280 2024-09-21T07:13:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f4583daf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b0bed10b70 con 0x55b0be94df60 2024-09-21T07:13:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f45777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be9250a0 0x55b0bed0ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f45777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be9250a0 0x55b0bed0ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33082/0 (socket says 172.21.15.92:33082) 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f45777fe640 1 -- 172.21.15.92:0/3602782399 learned_addr learned my addr 172.21.15.92:0/3602782399 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f45777fe640 1 -- 172.21.15.92:0/3602782399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be94df60 msgr2=0x55b0bed0b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f45777fe640 1 --2- 172.21.15.92:0/3602782399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be94df60 0x55b0bed0b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f45777fe640 1 -- 172.21.15.92:0/3602782399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be92d280 msgr2=0x55b0bed11a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f456e7fc640 1 --2- 172.21.15.92:0/3602782399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be92d280 0x55b0bed11a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f45777fe640 1 --2- 172.21.15.92:0/3602782399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be92d280 0x55b0bed11a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f45777fe640 1 -- 172.21.15.92:0/3602782399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0becfdcb0 con 0x55b0be9250a0 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f45777fe640 1 --2- 172.21.15.92:0/3602782399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be9250a0 0x55b0bed0ff50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4570009620 tx=0x7f4570009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a68af63140a597 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f456d7fa640 1 -- 172.21.15.92:0/3602782399 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457005f030 con 0x55b0be9250a0 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f456d7fa640 1 -- 172.21.15.92:0/3602782399 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4570036040 con 0x55b0be9250a0 2024-09-21T07:13:10.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.831+0000 7f456d7fa640 1 -- 172.21.15.92:0/3602782399 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570031980 con 0x55b0be9250a0 2024-09-21T07:13:10.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.832+0000 7f4583daf740 1 -- 172.21.15.92:0/3602782399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be9250a0 msgr2=0x55b0bed0ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:10.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.832+0000 7f4583daf740 1 --2- 172.21.15.92:0/3602782399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be9250a0 0x55b0bed0ff50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4570009620 tx=0x7f4570009a20 comp rx=0 tx=0).stop 2024-09-21T07:13:10.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.832+0000 7f4583daf740 1 -- 172.21.15.92:0/3602782399 shutdown_connections 2024-09-21T07:13:10.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.832+0000 7f4583daf740 1 --2- 172.21.15.92:0/3602782399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be94df60 0x55b0bed0b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.832+0000 7f4583daf740 1 --2- 172.21.15.92:0/3602782399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be92d280 0x55b0bed11a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.832+0000 7f4583daf740 1 --2- 172.21.15.92:0/3602782399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be9250a0 0x55b0bed0ff50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.832+0000 7f4583daf740 1 -- 172.21.15.92:0/3602782399 >> 172.21.15.92:0/3602782399 conn(0x55b0be942350 msgr2=0x55b0becfa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:10.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.832+0000 7f4583daf740 1 -- 172.21.15.92:0/3602782399 shutdown_connections 2024-09-21T07:13:10.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.832+0000 7f4583daf740 1 -- 172.21.15.92:0/3602782399 wait complete. 2024-09-21T07:13:10.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f4583daf740 1 -- start start 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f4583daf740 1 Processor -- start 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f4583daf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be9250a0 0x55b0bed1a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f4583daf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 0x55b0bed13880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f4583daf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed13dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f4583daf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b0bed11910 con 0x55b0be94df60 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f4583daf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b0bed11240 con 0x55b0be9250a0 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f4583daf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b0bed11fe0 con 0x55b0be92d280 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f4583daf740 10 client.0 _ll_register_callbacks cb 0x7f4570031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f45777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed13dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f45777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed13dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33086/0 (socket says 172.21.15.92:33086) 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f45777fe640 1 -- 172.21.15.92:0/751935353 learned_addr learned my addr 172.21.15.92:0/751935353 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.833+0000 7f45777fe640 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be9250a0 0x55b0bed1a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f456e7fc640 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 0x55b0bed13880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f45777fe640 1 -- 172.21.15.92:0/751935353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 msgr2=0x55b0bed13880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f45777fe640 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 0x55b0bed13880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f45777fe640 1 -- 172.21.15.92:0/751935353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be9250a0 msgr2=0x55b0bed1a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f45777fe640 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be9250a0 0x55b0bed1a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f45777fe640 1 -- 172.21.15.92:0/751935353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0bed14400 con 0x55b0be94df60 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f456e7fc640 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 0x55b0bed13880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f45777fe640 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed13dc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4570009ca0 tx=0x7f45700317f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec27076a3c22b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f4556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f4556ffd640 1 -- 172.21.15.92:0/751935353 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457005f040 con 0x55b0be94df60 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f4556ffd640 1 -- 172.21.15.92:0/751935353 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f45700046d0 con 0x55b0be94df60 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f4583daf740 1 -- 172.21.15.92:0/751935353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4570036040 con 0x55b0be94df60 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f4556ffd640 1 -- 172.21.15.92:0/751935353 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4570004b40 con 0x55b0be94df60 2024-09-21T07:13:10.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f4583daf740 10 client.15543 fetch_fsmap learned FSMap version 28 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f4583daf740 1 -- 172.21.15.92:0/751935353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b0bed19e00 con 0x55b0be94df60 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.834+0000 7f4556ffd640 1 -- 172.21.15.92:0/751935353 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4570036040 con 0x55b0be94df60 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.835+0000 7f4556ffd640 1 -- 172.21.15.92:0/751935353 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f45700305c0 con 0x55b0be94df60 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.835+0000 7f4583daf740 10 client.15543 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.835+0000 7f4583daf740 10 client.15543 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.835+0000 7f4583daf740 20 client.15543 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.835+0000 7f4583daf740 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b0be8e1c90 0x55b0bed80390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.835+0000 7f4583daf740 4 client.15543 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.835+0000 7f4583daf740 1 -- 172.21.15.92:0/751935353 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "status"}) -- 0x55b0bec69610 con 0x55b0be8e1c90 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.835+0000 7f456e7fc640 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b0be8e1c90 0x55b0bed80390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.835+0000 7f456e7fc640 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b0be8e1c90 0x55b0bed80390 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=45c9d5ac74b0578c server_cookie=46a94138094dd144 in_seq=0 out_seq=0 2024-09-21T07:13:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.835+0000 7f4556ffd640 10 client.15543 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4556ffd640 1 -- 172.21.15.92:0/751935353 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b0bec69610 con 0x55b0be8e1c90 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4556ffd640 10 client.15543 handle_command_reply: tid=0 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 client.15543 shutdown 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 -- 172.21.15.92:0/751935353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 msgr2=0x55b0bed13dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed13dc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4570009ca0 tx=0x7f45700317f0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 -- 172.21.15.92:0/751935353 shutdown_connections 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b0be8e1c90 0x55b0bed80390 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0be94df60 0x55b0bed13dc0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0be92d280 0x55b0bed13880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4556ffd640 0 client.15543 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 --2- 172.21.15.92:0/751935353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0be9250a0 0x55b0bed1a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 -- 172.21.15.92:0/751935353 >> 172.21.15.92:0/751935353 conn(0x55b0be942350 msgr2=0x55b0becf1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 -- 172.21.15.92:0/751935353 shutdown_connections 2024-09-21T07:13:10.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 1 -- 172.21.15.92:0/751935353 wait complete. 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.836+0000 7f4583daf740 20 client.15543 trim_cache size 0 max 16384 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 1, 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24625, 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 101.13598780300001, 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 28, 2024-09-21T07:13:10.843 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:13:10.844 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T07:13:10.844 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 163.83747498700001 2024-09-21T07:13:10.844 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:10.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 -- 172.21.15.92:0/475205002 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f45640b6560 msgr2=0x7f45640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:10.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f45640b6560 0x7f45640b8a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55b0becf2b80 tx=0x7f4568094040 comp rx=0 tx=0).stop 2024-09-21T07:13:10.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 -- 172.21.15.92:0/475205002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4578102a60 msgr2=0x7f457819a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:10.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4578102a60 0x7f457819a390 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f456800d770 tx=0x7f456800dc30 comp rx=0 tx=0).stop 2024-09-21T07:13:10.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 -- 172.21.15.92:0/475205002 shutdown_connections 2024-09-21T07:13:10.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f45640b6560 0x7f45640b8a70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4578108cf0 0x7f457819fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45781083a0 0x7f457819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 --2- 172.21.15.92:0/475205002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4578102a60 0x7f457819a390 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:10.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 -- 172.21.15.92:0/475205002 >> 172.21.15.92:0/475205002 conn(0x7f4578079730 msgr2=0x7f4578104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:10.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 -- 172.21.15.92:0/475205002 shutdown_connections 2024-09-21T07:13:10.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:10.837+0000 7f457d83b640 1 -- 172.21.15.92:0/475205002 wait complete. 2024-09-21T07:13:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:10 smithi175 ceph-mon[34064]: pgmap v342: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:13:11.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:10 smithi092 ceph-mon[30987]: pgmap v342: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:13:11.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:10 smithi169 ceph-mon[33705]: pgmap v342: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:13:11.547 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:13:11.796 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:12.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.294+0000 7f6f71922640 1 -- 172.21.15.92:0/805353366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c102ae0 msgr2=0x7f6f6c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.294+0000 7f6f71922640 1 --2- 172.21.15.92:0/805353366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c102ae0 0x7f6f6c102ef0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009ca0 tx=0x7f6f5c02a8e0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.294+0000 7f6f71922640 1 -- 172.21.15.92:0/805353366 shutdown_connections 2024-09-21T07:13:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.294+0000 7f6f71922640 1 --2- 172.21.15.92:0/805353366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f6c108d20 0x7f6f6c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.294+0000 7f6f71922640 1 --2- 172.21.15.92:0/805353366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f6c1083d0 0x7f6f6c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.294+0000 7f6f71922640 1 --2- 172.21.15.92:0/805353366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c102ae0 0x7f6f6c102ef0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.294+0000 7f6f71922640 1 -- 172.21.15.92:0/805353366 >> 172.21.15.92:0/805353366 conn(0x7f6f6c079790 msgr2=0x7f6f6c079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.294+0000 7f6f71922640 1 -- 172.21.15.92:0/805353366 shutdown_connections 2024-09-21T07:13:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.294+0000 7f6f71922640 1 -- 172.21.15.92:0/805353366 wait complete. 2024-09-21T07:13:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f71922640 1 Processor -- start 2024-09-21T07:13:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f71922640 1 -- start start 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f71922640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f6c102ae0 0x7f6f6c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f71922640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c1083d0 0x7f6f6c199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f71922640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f6c108d20 0x7f6f6c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f71922640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c1128d0 con 0x7f6f6c1083d0 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f71922640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c112750 con 0x7f6f6c108d20 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f71922640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c112a50 con 0x7f6f6c102ae0 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f6a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c1083d0 0x7f6f6c199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f6a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c1083d0 0x7f6f6c199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33112/0 (socket says 172.21.15.92:33112) 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f6a7fc640 1 -- 172.21.15.92:0/777152760 learned_addr learned my addr 172.21.15.92:0/777152760 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.295+0000 7f6f6affd640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f6c102ae0 0x7f6f6c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f6a7fc640 1 -- 172.21.15.92:0/777152760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f6c102ae0 msgr2=0x7f6f6c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f6c102ae0 0x7f6f6c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f6a7fc640 1 -- 172.21.15.92:0/777152760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f6c108d20 msgr2=0x7f6f6c19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f6c108d20 0x7f6f6c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f6a7fc640 1 -- 172.21.15.92:0/777152760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c19f270 con 0x7f6f6c1083d0 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f6affd640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f6c102ae0 0x7f6f6c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c1083d0 0x7f6f6c199960 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6f54006fd0 tx=0x7f6f5400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f70920640 1 -- 172.21.15.92:0/777152760 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54011830 con 0x7f6f6c1083d0 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f71922640 1 -- 172.21.15.92:0/777152760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6c19f560 con 0x7f6f6c1083d0 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f70920640 1 -- 172.21.15.92:0/777152760 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f54016070 con 0x7f6f6c1083d0 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f70920640 1 -- 172.21.15.92:0/777152760 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54010d30 con 0x7f6f6c1083d0 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.296+0000 7f6f71922640 1 -- 172.21.15.92:0/777152760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6c1a5d80 con 0x7f6f6c1083d0 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f77e96740 1 Processor -- start 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f77e96740 1 -- start start 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f70920640 1 -- 172.21.15.92:0/777152760 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f6f540119d0 con 0x7f6f6c1083d0 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 0x557668f96f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668f97440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bd0280 0x557668f97980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f77e96740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557668f0ec10 con 0x557668bc80a0 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f77e96740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557668efe040 con 0x557668bf0f60 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f77e96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557668f01e50 con 0x557668bd0280 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f6affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668f97440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f6affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668f97440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33122/0 (socket says 172.21.15.92:33122) 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f6affd640 1 -- 172.21.15.92:0/1668257222 learned_addr learned my addr 172.21.15.92:0/1668257222 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f6b7fe640 1 --2- 172.21.15.92:0/1668257222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 0x557668f96f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/1668257222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bd0280 0x557668f97980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.299+0000 7f6f6affd640 1 -- 172.21.15.92:0/1668257222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bd0280 msgr2=0x557668f97980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f6affd640 1 --2- 172.21.15.92:0/1668257222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bd0280 0x557668f97980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f6affd640 1 -- 172.21.15.92:0/1668257222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 msgr2=0x557668f96f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f6affd640 1 --2- 172.21.15.92:0/1668257222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 0x557668f96f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f6affd640 1 -- 172.21.15.92:0/1668257222 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557668c5c540 con 0x557668bc80a0 2024-09-21T07:13:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f6b7fe640 1 --2- 172.21.15.92:0/1668257222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 0x557668f96f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f70920640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6f580b6590 0x7f6f580b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f6affd640 1 --2- 172.21.15.92:0/1668257222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668f97440 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c035000 tx=0x7f6f5c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cece53215c5849c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f6b7fe640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6f580b6590 0x7f6f580b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f70920640 1 -- 172.21.15.92:0/777152760 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6f540e6e20 con 0x7f6f6c1083d0 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f61ffb640 1 -- 172.21.15.92:0/1668257222 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c031b40 con 0x557668bc80a0 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f61ffb640 1 -- 172.21.15.92:0/1668257222 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f5c036040 con 0x557668bc80a0 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.300+0000 7f6f61ffb640 1 -- 172.21.15.92:0/1668257222 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0045e0 con 0x557668bc80a0 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f77e96740 1 -- 172.21.15.92:0/1668257222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 msgr2=0x557668f97440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f6b7fe640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6f580b6590 0x7f6f580b8aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400ab70 tx=0x7f6f64005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f77e96740 1 --2- 172.21.15.92:0/1668257222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668f97440 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c035000 tx=0x7f6f5c009a20 comp rx=0 tx=0).stop 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f77e96740 1 -- 172.21.15.92:0/1668257222 shutdown_connections 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f77e96740 1 --2- 172.21.15.92:0/1668257222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bd0280 0x557668f97980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f77e96740 1 --2- 172.21.15.92:0/1668257222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668f97440 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f77e96740 1 --2- 172.21.15.92:0/1668257222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 0x557668f96f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f77e96740 1 -- 172.21.15.92:0/1668257222 >> 172.21.15.92:0/1668257222 conn(0x557668be5350 msgr2=0x557668f94df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f77e96740 1 -- 172.21.15.92:0/1668257222 shutdown_connections 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f77e96740 1 -- 172.21.15.92:0/1668257222 wait complete. 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.301+0000 7f6f77e96740 1 -- start start 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f77e96740 1 Processor -- start 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fa2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bd0280 0x557668fa2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 0x557668fb0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f77e96740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557668d5f5f0 con 0x557668bc80a0 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f77e96740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557668e99010 con 0x557668bf0f60 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f77e96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557668fa7830 con 0x557668bd0280 2024-09-21T07:13:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f77e96740 10 client.0 _ll_register_callbacks cb 0x557668ef8340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f6affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fa2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f6affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fa2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33128/0 (socket says 172.21.15.92:33128) 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f6affd640 1 -- 172.21.15.92:0/857750592 learned_addr learned my addr 172.21.15.92:0/857750592 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bd0280 0x557668fa2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f6b7fe640 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 0x557668fb0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f6affd640 1 -- 172.21.15.92:0/857750592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bd0280 msgr2=0x557668fa2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f6affd640 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bd0280 0x557668fa2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f6affd640 1 -- 172.21.15.92:0/857750592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 msgr2=0x557668fb0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.302+0000 7f6f6affd640 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 0x557668fb0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f6affd640 1 -- 172.21.15.92:0/857750592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557668ec6a00 con 0x557668bc80a0 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f6affd640 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fa2a80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0094b0 tx=0x7f6f5c009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef047a4661f4b08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f4affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f4affd640 1 -- 172.21.15.92:0/857750592 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c051020 con 0x557668bc80a0 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f4affd640 1 -- 172.21.15.92:0/857750592 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6f5c004340 con 0x557668bc80a0 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f77e96740 1 -- 172.21.15.92:0/857750592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f5c036040 con 0x557668bc80a0 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f4affd640 1 -- 172.21.15.92:0/857750592 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f5c05c050 con 0x557668bc80a0 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f77e96740 10 client.15555 fetch_fsmap learned FSMap version 28 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f77e96740 1 -- 172.21.15.92:0/857750592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557668fb37b0 con 0x557668bc80a0 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f4affd640 1 -- 172.21.15.92:0/857750592 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f5c036040 con 0x557668bc80a0 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f4affd640 1 -- 172.21.15.92:0/857750592 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6f5c04c030 con 0x557668bc80a0 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f77e96740 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f77e96740 10 client.15555 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.303+0000 7f6f77e96740 20 client.15555 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.304+0000 7f6f77e96740 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557668baf8e0 0x557668fb6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.304+0000 7f6f77e96740 4 client.15555 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.304+0000 7f6f77e96740 1 -- 172.21.15.92:0/857750592 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557668f10b60 con 0x557668baf8e0 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.304+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557668baf8e0 0x557668fb6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.304+0000 7f6f4affd640 10 client.15555 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.304+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557668baf8e0 0x557668fb6df0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e3622630f4052e9 server_cookie=9c05f14c2434514 in_seq=0 out_seq=0 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f4affd640 1 -- 172.21.15.92:0/857750592 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557668f10b60 con 0x557668baf8e0 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f4affd640 10 client.15555 handle_command_reply: tid=0 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 client.15555 shutdown 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 -- 172.21.15.92:0/857750592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 msgr2=0x557668fa2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fa2a80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0094b0 tx=0x7f6f5c009910 comp rx=0 tx=0).stop 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 -- 172.21.15.92:0/857750592 shutdown_connections 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557668baf8e0 0x557668fb6df0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bf0f60 0x557668fb0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bd0280 0x557668fa2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 --2- 172.21.15.92:0/857750592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fa2a80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 -- 172.21.15.92:0/857750592 >> 172.21.15.92:0/857750592 conn(0x557668be5350 msgr2=0x557668f9a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f4affd640 0 client.15555 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 -- 172.21.15.92:0/857750592 shutdown_connections 2024-09-21T07:13:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.305+0000 7f6f77e96740 1 -- 172.21.15.92:0/857750592 wait complete. 2024-09-21T07:13:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.306+0000 7f6f77e96740 20 client.15555 trim_cache size 0 max 16384 2024-09-21T07:13:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.323+0000 7f6f77e96740 1 Processor -- start 2024-09-21T07:13:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.323+0000 7f6f77e96740 1 -- start start 2024-09-21T07:13:12.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fb6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bd0280 0x557668fa2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 0x557668fa2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f77e96740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557668fb5130 con 0x557668bc80a0 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f77e96740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557668fb5800 con 0x557668bd0280 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f77e96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557668fb5ed0 con 0x557668bf0f60 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fb6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fb6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33138/0 (socket says 172.21.15.92:33138) 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6affd640 1 -- 172.21.15.92:0/3207454869 learned_addr learned my addr 172.21.15.92:0/3207454869 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6b7fe640 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 0x557668fa2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bd0280 0x557668fa2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6affd640 1 -- 172.21.15.92:0/3207454869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 msgr2=0x557668fa2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6affd640 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 0x557668fa2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6affd640 1 -- 172.21.15.92:0/3207454869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bd0280 msgr2=0x557668fa2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6affd640 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bd0280 0x557668fa2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6affd640 1 -- 172.21.15.92:0/3207454869 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557668fa0d80 con 0x557668bc80a0 2024-09-21T07:13:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bd0280 0x557668fa2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6b7fe640 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 0x557668fa2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.324+0000 7f6f6affd640 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fb6050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0094e0 tx=0x7f6f5c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816c684562b3c33e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.325+0000 7f6f617fa640 1 -- 172.21.15.92:0/3207454869 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c051040 con 0x557668bc80a0 2024-09-21T07:13:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.325+0000 7f6f617fa640 1 -- 172.21.15.92:0/3207454869 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f5c036070 con 0x557668bc80a0 2024-09-21T07:13:12.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.325+0000 7f6f617fa640 1 -- 172.21.15.92:0/3207454869 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c049040 con 0x557668bc80a0 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.325+0000 7f6f77e96740 1 -- 172.21.15.92:0/3207454869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 msgr2=0x557668fb6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.325+0000 7f6f77e96740 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fb6050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0094e0 tx=0x7f6f5c009360 comp rx=0 tx=0).stop 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.325+0000 7f6f77e96740 1 -- 172.21.15.92:0/3207454869 shutdown_connections 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.325+0000 7f6f77e96740 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 0x557668fa2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.325+0000 7f6f77e96740 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bd0280 0x557668fa2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.325+0000 7f6f77e96740 1 --2- 172.21.15.92:0/3207454869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bc80a0 0x557668fb6050 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.325+0000 7f6f77e96740 1 -- 172.21.15.92:0/3207454869 >> 172.21.15.92:0/3207454869 conn(0x557668be5350 msgr2=0x557668f94750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.326+0000 7f6f77e96740 1 -- 172.21.15.92:0/3207454869 shutdown_connections 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.326+0000 7f6f77e96740 1 -- 172.21.15.92:0/3207454869 wait complete. 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.326+0000 7f6f77e96740 1 -- start start 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.326+0000 7f6f77e96740 1 Processor -- start 2024-09-21T07:13:12.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.326+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bc80a0 0x557668fbf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.326+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bd0280 0x557668fbfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.326+0000 7f6f77e96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 0x557668fb8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.326+0000 7f6f77e96740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557668fb6c70 con 0x557668bd0280 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.326+0000 7f6f77e96740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557668fb65a0 con 0x557668bc80a0 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.326+0000 7f6f77e96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557668fb7340 con 0x557668bf0f60 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f77e96740 10 client.0 _ll_register_callbacks cb 0x7f6f5c031500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bd0280 0x557668fbfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bd0280 0x557668fbfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33152/0 (socket says 172.21.15.92:33152) 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6a7fc640 1 -- 172.21.15.92:0/1442959793 learned_addr learned my addr 172.21.15.92:0/1442959793 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6affd640 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bc80a0 0x557668fbf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6b7fe640 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 0x557668fb8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6a7fc640 1 -- 172.21.15.92:0/1442959793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 msgr2=0x557668fb8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 0x557668fb8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6a7fc640 1 -- 172.21.15.92:0/1442959793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bc80a0 msgr2=0x557668fbf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bc80a0 0x557668fbf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6a7fc640 1 -- 172.21.15.92:0/1442959793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557668fb91b0 con 0x557668bd0280 2024-09-21T07:13:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f6a7fc640 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bd0280 0x557668fbfa10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6f540a9d60 tx=0x7f6f5400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4180cb4dd7817d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f4affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f4affd640 1 -- 172.21.15.92:0/1442959793 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54010ed0 con 0x557668bd0280 2024-09-21T07:13:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f4affd640 1 -- 172.21.15.92:0/1442959793 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6f54011cc0 con 0x557668bd0280 2024-09-21T07:13:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f77e96740 1 -- 172.21.15.92:0/1442959793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f5c036070 con 0x557668bd0280 2024-09-21T07:13:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f4affd640 1 -- 172.21.15.92:0/1442959793 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f540a9140 con 0x557668bd0280 2024-09-21T07:13:12.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f77e96740 10 client.15561 fetch_fsmap learned FSMap version 28 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.327+0000 7f6f77e96740 1 -- 172.21.15.92:0/1442959793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557668fbeb40 con 0x557668bd0280 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f4affd640 1 -- 172.21.15.92:0/1442959793 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f5c036070 con 0x557668bd0280 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f4affd640 1 -- 172.21.15.92:0/1442959793 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6f540a8d60 con 0x557668bd0280 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f77e96740 10 client.15561 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f77e96740 10 client.15561 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f77e96740 20 client.15561 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f77e96740 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557668b84c90 0x557669025690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f77e96740 4 client.15561 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f77e96740 1 -- 172.21.15.92:0/1442959793 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "status"}) -- 0x557668f0c610 con 0x557668b84c90 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f6affd640 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557668b84c90 0x557669025690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f4affd640 10 client.15561 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.328+0000 7f6f6affd640 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557668b84c90 0x557669025690 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74f0f08a18bde616 server_cookie=6353fa4caf5d2dbe in_seq=0 out_seq=0 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f4affd640 1 -- 172.21.15.92:0/1442959793 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557668f0c610 con 0x557668b84c90 2024-09-21T07:13:12.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f4affd640 10 client.15561 handle_command_reply: tid=0 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 client.15561 shutdown 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 -- 172.21.15.92:0/1442959793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bd0280 msgr2=0x557668fbfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bd0280 0x557668fbfa10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6f540a9d60 tx=0x7f6f5400bf90 comp rx=0 tx=0).stop 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 -- 172.21.15.92:0/1442959793 shutdown_connections 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557668b84c90 0x557669025690 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557668bf0f60 0x557668fb8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557668bd0280 0x557668fbfa10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 --2- 172.21.15.92:0/1442959793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557668bc80a0 0x557668fbf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f4affd640 0 client.15561 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 -- 172.21.15.92:0/1442959793 >> 172.21.15.92:0/1442959793 conn(0x557668be5350 msgr2=0x557668f9da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 -- 172.21.15.92:0/1442959793 shutdown_connections 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 1 -- 172.21.15.92:0/1442959793 wait complete. 2024-09-21T07:13:12.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.329+0000 7f6f77e96740 20 client.15561 trim_cache size 0 max 16384 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24649, 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 137.84231808600001, 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 28, 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T07:13:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 157.49572764000001 2024-09-21T07:13:12.338 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:12.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 -- 172.21.15.92:0/777152760 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6f580b6590 msgr2=0x7f6f580b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:12.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6f580b6590 0x7f6f580b8aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400ab70 tx=0x7f6f64005e50 comp rx=0 tx=0).stop 2024-09-21T07:13:12.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 -- 172.21.15.92:0/777152760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c1083d0 msgr2=0x7f6f6c199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:12.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c1083d0 0x7f6f6c199960 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6f54006fd0 tx=0x7f6f5400b8e0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 -- 172.21.15.92:0/777152760 shutdown_connections 2024-09-21T07:13:12.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6f580b6590 0x7f6f580b8aa0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f6c108d20 0x7f6f6c19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c1083d0 0x7f6f6c199960 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 --2- 172.21.15.92:0/777152760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f6c102ae0 0x7f6f6c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:12.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 -- 172.21.15.92:0/777152760 >> 172.21.15.92:0/777152760 conn(0x7f6f6c079790 msgr2=0x7f6f6c106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:12.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 -- 172.21.15.92:0/777152760 shutdown_connections 2024-09-21T07:13:12.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:12.330+0000 7f6f71922640 1 -- 172.21.15.92:0/777152760 wait complete. 2024-09-21T07:13:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:12 smithi175 ceph-mon[34064]: pgmap v343: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:13:13.096 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:12 smithi092 ceph-mon[30987]: pgmap v343: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:13:13.129 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T07:13:13.147 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T07:13:13.148 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-21T07:13:13.148 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-21T07:13:13.148 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:13:13.148 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:13.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:13.148 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-21T07:13:13.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:12 smithi169 ceph-mon[33705]: pgmap v343: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:13:13.167 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T07:13:13.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:13.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:13:13.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:13.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-09-21T07:13:13.337 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T07:13:13.337 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T07:13:13.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T07:13:13.586 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:14.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.048+0000 7fe755991640 1 -- 172.21.15.92:0/2169589478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7501049c0 msgr2=0x7fe750104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:14.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.048+0000 7fe755991640 1 --2- 172.21.15.92:0/2169589478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7501049c0 0x7fe750104dd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe740009ca0 tx=0x7fe74002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:14.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.048+0000 7fe755991640 1 -- 172.21.15.92:0/2169589478 shutdown_connections 2024-09-21T07:13:14.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.048+0000 7fe755991640 1 --2- 172.21.15.92:0/2169589478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe75010de20 0x7fe750110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:14.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.048+0000 7fe755991640 1 --2- 172.21.15.92:0/2169589478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe750105310 0x7fe75010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.048+0000 7fe755991640 1 --2- 172.21.15.92:0/2169589478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7501049c0 0x7fe750104dd0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.048+0000 7fe755991640 1 -- 172.21.15.92:0/2169589478 >> 172.21.15.92:0/2169589478 conn(0x7fe750079730 msgr2=0x7fe750079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.048+0000 7fe755991640 1 -- 172.21.15.92:0/2169589478 shutdown_connections 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.048+0000 7fe755991640 1 -- 172.21.15.92:0/2169589478 wait complete. 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe755991640 1 Processor -- start 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe755991640 1 -- start start 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe755991640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7501049c0 0x7fe75019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe755991640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe750105310 0x7fe75019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe755991640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe75010de20 0x7fe75019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe755991640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe7501139a0 con 0x7fe75010de20 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe755991640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe750113820 con 0x7fe750105310 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe755991640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe750113b20 con 0x7fe7501049c0 2024-09-21T07:13:14.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe74f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe75010de20 0x7fe75019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe74f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe75010de20 0x7fe75019fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33172/0 (socket says 172.21.15.92:33172) 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.049+0000 7fe74f7fe640 1 -- 172.21.15.92:0/619179650 learned_addr learned my addr 172.21.15.92:0/619179650 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe74effd640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7501049c0 0x7fe75019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe74e7fc640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe750105310 0x7fe75019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe74f7fe640 1 -- 172.21.15.92:0/619179650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7501049c0 msgr2=0x7fe75019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe74f7fe640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7501049c0 0x7fe75019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe74f7fe640 1 -- 172.21.15.92:0/619179650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe750105310 msgr2=0x7fe75019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe74f7fe640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe750105310 0x7fe75019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe74f7fe640 1 -- 172.21.15.92:0/619179650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7501a0420 con 0x7fe75010de20 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe74e7fc640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe750105310 0x7fe75019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe74f7fe640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe75010de20 0x7fe75019fcf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe74800c970 tx=0x7fe74800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe75498f640 1 -- 172.21.15.92:0/619179650 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748007bb0 con 0x7fe75010de20 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe755991640 1 -- 172.21.15.92:0/619179650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501a0710 con 0x7fe75010de20 2024-09-21T07:13:14.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe75498f640 1 -- 172.21.15.92:0/619179650 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe748007d50 con 0x7fe75010de20 2024-09-21T07:13:14.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe75498f640 1 -- 172.21.15.92:0/619179650 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748004d50 con 0x7fe75010de20 2024-09-21T07:13:14.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.050+0000 7fe755991640 1 -- 172.21.15.92:0/619179650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501a6e70 con 0x7fe75010de20 2024-09-21T07:13:14.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.051+0000 7fe755991640 1 -- 172.21.15.92:0/619179650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe75006c280 con 0x7fe75010de20 2024-09-21T07:13:14.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.053+0000 7fe75498f640 1 -- 172.21.15.92:0/619179650 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fe748004f10 con 0x7fe75010de20 2024-09-21T07:13:14.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.054+0000 7fe75498f640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe7380b65e0 0x7fe7380b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:14.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.054+0000 7fe74effd640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe7380b65e0 0x7fe7380b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:14.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.054+0000 7fe75498f640 1 -- 172.21.15.92:0/619179650 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe7480e7910 con 0x7fe75010de20 2024-09-21T07:13:14.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.054+0000 7fe74effd640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe7380b65e0 0x7fe7380b8af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe740000f80 tx=0x7fe740009890 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:14.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.057+0000 7fe75498f640 1 -- 172.21.15.92:0/619179650 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe748014030 con 0x7fe75010de20 2024-09-21T07:13:14.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.272+0000 7fe755991640 1 -- 172.21.15.92:0/619179650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe750104dd0 con 0x7fe75010de20 2024-09-21T07:13:14.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.273+0000 7fe75498f640 1 -- 172.21.15.92:0/619179650 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7fe7480adc80 con 0x7fe75010de20 2024-09-21T07:13:14.275 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T07:13:14.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 -- 172.21.15.92:0/619179650 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe7380b65e0 msgr2=0x7fe7380b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:14.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe7380b65e0 0x7fe7380b8af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe740000f80 tx=0x7fe740009890 comp rx=0 tx=0).stop 2024-09-21T07:13:14.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 -- 172.21.15.92:0/619179650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe75010de20 msgr2=0x7fe75019fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:14.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe75010de20 0x7fe75019fcf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe74800c970 tx=0x7fe74800ce30 comp rx=0 tx=0).stop 2024-09-21T07:13:14.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 -- 172.21.15.92:0/619179650 shutdown_connections 2024-09-21T07:13:14.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe7380b65e0 0x7fe7380b8af0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:14.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe75010de20 0x7fe75019fcf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:14.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe750105310 0x7fe75019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:14.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 --2- 172.21.15.92:0/619179650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7501049c0 0x7fe75019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:14.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 -- 172.21.15.92:0/619179650 >> 172.21.15.92:0/619179650 conn(0x7fe750079730 msgr2=0x7fe750100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:14.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 -- 172.21.15.92:0/619179650 shutdown_connections 2024-09-21T07:13:14.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:14.275+0000 7fe755991640 1 -- 172.21.15.92:0/619179650 wait complete. 2024-09-21T07:13:14.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:14 smithi092 ceph-mon[30987]: pgmap v344: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:13:14.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:14 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/619179650' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:13:15.003 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:13:15.003 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:13:15.003 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-09-21T07:13:15.003 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:13:15.003 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:15.003 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:13:15.003 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:13:15.004 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:13:15.004 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:13:15.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:15.004 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-09-21T07:13:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:14 smithi175 ceph-mon[34064]: pgmap v344: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:13:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:14 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/619179650' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:13:15.021 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:13:15.021 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:13:15.021 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:13:15.021 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:13:15.022 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-21T07:13:15.022 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:13:15.022 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:13:15.022 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:13:15.022 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2024-09-21T07:13:15.022 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:13:15.022 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:13:15.022 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2024-09-21T07:13:15.023 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:13:15.023 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:13:15.023 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:13:15.023 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:13:15.023 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T07:13:15.023 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42139sec preferred_lft 42139sec 2024-09-21T07:13:15.023 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-21T07:13:15.023 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:13:15.023 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:13:15.024 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:13:15.024 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-21T07:13:15.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:13:15.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2024-09-21T07:13:15.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2024-09-21T07:13:15.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:13:15.024 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-21T07:13:15.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:13:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:14 smithi169 ceph-mon[33705]: pgmap v344: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:13:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:14 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/619179650' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:13:15.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:13:15.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:15.165 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:13:15.190 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-09-21T07:13:15.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:15.191 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-09-21T07:13:15.247 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-09-21T07:13:15.248 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:13:15.248 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:13:15.248 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:13:15.248 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:13:15.248 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:13:15.248 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-21T07:13:15.248 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:13:15.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:13:15.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:13:15.249 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-21T07:13:15.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:13:15.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:13:15.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:15.374 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-21T07:13:15.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:15.391 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-09-21T07:13:15.447 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:13:15.447 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-21T07:13:15.447 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:13:15.447 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T07:13:15.447 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-21T07:13:15.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:13:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:13:15.564 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T07:13:15.564 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:13:15.564 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-21T07:13:15.564 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T07:13:15.564 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:13:15.565 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T07:13:15.565 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T07:13:15.565 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T07:13:15.565 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-21T07:13:15.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:13:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:13:15.677 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:13:15.677 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-21T07:13:15.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-09-21T07:13:15.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:13:15.678 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-21T07:13:15.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:13:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:13:15.755 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-21T07:13:15.756 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:13:15.756 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:13:15.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:13:15.771 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:15.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-09-21T07:13:15.893 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:13:15.950 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2024-09-21T07:13:15.951 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:13:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2024-09-21T07:13:15.953 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2024-09-21T07:13:15.953 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:13:15.953 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/34edce966ac4de38bf9c8a1f54a2758fd0073664ae9a081c1170c4e56dcf58ac/merged 2024-09-21T07:13:15.953 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/a07ceeb3fa0c0949a1d20c11f0000f1f3df31f8a6e94736f87ba23ac5b7bdc6b/merged 2024-09-21T07:13:15.953 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/0 2024-09-21T07:13:15.953 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:13:15.953 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/ef0a9feff7cd43331a5796bf8349f921b372e32961a17c7cc73fc6cf35fe1f93/merged 2024-09-21T07:13:15.953 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/698e11a63cd62172272f02b7a52c7cb7c0defe9c500777231eda6565d03c5c69/merged 2024-09-21T07:13:15.953 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/2b800a5980bdd021b915f1c4e4a44406908415dc03aa1759dffdf17c2bb549e2/merged 2024-09-21T07:13:15.954 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c94d506025720fdba2d4cdbc9c1b2f7beb32022e69d747fc04fc4cd8a5c4ca01/merged 2024-09-21T07:13:15.954 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/5cb03c57ca9c7d75ad577198240a8823055e29c5f8edfa965984b274e21e1628/merged 2024-09-21T07:13:15.954 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4e69f5e86b63d786f8a5aedabcab65ae6e801d469396af325fafe2a60f14f970/merged 2024-09-21T07:13:15.954 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c1795127ce5350675dd0216437be5c9452eb313f1c404b8388c9431ad958bf49/merged 2024-09-21T07:13:15.954 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4125d8548753bfcdddc533d562bd1a3d9f7fab11a7280000a3418e147f891849/merged 2024-09-21T07:13:15.954 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2024-09-21T07:13:15.954 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:13:15.954 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:13:15.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:15.954 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-09-21T07:13:16.006 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T07:13:16.006 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/af3d21b7-6fdf-4360-94cc-b40a9c192877 --client_fs=cephfs) 2024-09-21T07:13:16.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-09-21T07:13:16.073 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2024-09-21T07:13:16.132 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2024-09-21T07:13:16.133 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/34edce966ac4de38bf9c8a1f54a2758fd0073664ae9a081c1170c4e56dcf58ac/merged 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/a07ceeb3fa0c0949a1d20c11f0000f1f3df31f8a6e94736f87ba23ac5b7bdc6b/merged 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/0 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/ef0a9feff7cd43331a5796bf8349f921b372e32961a17c7cc73fc6cf35fe1f93/merged 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/698e11a63cd62172272f02b7a52c7cb7c0defe9c500777231eda6565d03c5c69/merged 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/2b800a5980bdd021b915f1c4e4a44406908415dc03aa1759dffdf17c2bb549e2/merged 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c94d506025720fdba2d4cdbc9c1b2f7beb32022e69d747fc04fc4cd8a5c4ca01/merged 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/5cb03c57ca9c7d75ad577198240a8823055e29c5f8edfa965984b274e21e1628/merged 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4e69f5e86b63d786f8a5aedabcab65ae6e801d469396af325fafe2a60f14f970/merged 2024-09-21T07:13:16.134 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c1795127ce5350675dd0216437be5c9452eb313f1c404b8388c9431ad958bf49/merged 2024-09-21T07:13:16.135 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4125d8548753bfcdddc533d562bd1a3d9f7fab11a7280000a3418e147f891849/merged 2024-09-21T07:13:16.135 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2024-09-21T07:13:16.135 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:13:16.135 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:13:16.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:16.135 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-09-21T07:13:16.142 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:2024-09-21T07:13:16.140+0000 7fa700d8e480 -1 init, newargv = 0x7fa6e4056f60 newargc=15 2024-09-21T07:13:16.142 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[86257]: starting ceph client 2024-09-21T07:13:16.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[86257]: starting fuse 2024-09-21T07:13:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:16 smithi175 ceph-mon[34064]: pgmap v345: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:13:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:16 smithi092 ceph-mon[30987]: pgmap v345: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:13:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:16 smithi169 ceph-mon[33705]: pgmap v345: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:13:17.259 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-09-21T07:13:17.289 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:13:17.347 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2024-09-21T07:13:17.347 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2024-09-21T07:13:17.347 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2024-09-21T07:13:17.347 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2024-09-21T07:13:17.348 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/34edce966ac4de38bf9c8a1f54a2758fd0073664ae9a081c1170c4e56dcf58ac/merged 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/a07ceeb3fa0c0949a1d20c11f0000f1f3df31f8a6e94736f87ba23ac5b7bdc6b/merged 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/0 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/ef0a9feff7cd43331a5796bf8349f921b372e32961a17c7cc73fc6cf35fe1f93/merged 2024-09-21T07:13:17.349 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/698e11a63cd62172272f02b7a52c7cb7c0defe9c500777231eda6565d03c5c69/merged 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/2b800a5980bdd021b915f1c4e4a44406908415dc03aa1759dffdf17c2bb549e2/merged 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c94d506025720fdba2d4cdbc9c1b2f7beb32022e69d747fc04fc4cd8a5c4ca01/merged 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/5cb03c57ca9c7d75ad577198240a8823055e29c5f8edfa965984b274e21e1628/merged 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4e69f5e86b63d786f8a5aedabcab65ae6e801d469396af325fafe2a60f14f970/merged 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c1795127ce5350675dd0216437be5c9452eb313f1c404b8388c9431ad958bf49/merged 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4125d8548753bfcdddc533d562bd1a3d9f7fab11a7280000a3418e147f891849/merged 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run.smithi092.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:17.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:17.351 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-09-21T07:13:17.404 INFO:teuthology.orchestra.run.smithi092.stdout:120 2024-09-21T07:13:17.404 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T07:13:17.404 DEBUG:teuthology.orchestra.run.smithi092:> sudo stdin-killer -- python3 -c ' 2024-09-21T07:13:17.404 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2024-09-21T07:13:17.404 DEBUG:teuthology.orchestra.run.smithi092:> import re 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> import os 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T07:13:17.405 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T07:13:17.406 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T07:13:17.406 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2024-09-21T07:13:17.406 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2024-09-21T07:13:17.406 DEBUG:teuthology.orchestra.run.smithi092:> return f 2024-09-21T07:13:17.406 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T07:13:17.406 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-21T07:13:17.406 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.0")) 2024-09-21T07:13:17.406 DEBUG:teuthology.orchestra.run.smithi092:> ' 2024-09-21T07:13:17.526 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.0.86257.asok 2024-09-21T07:13:17.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:13:17.537 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.86257.asok 2024-09-21T07:13:17.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:17.537 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.86257.asok status 2024-09-21T07:13:17.680 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:17.680 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2024-09-21T07:13:17.680 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T07:13:17.680 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:13:17.680 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "0", 2024-09-21T07:13:17.680 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2024-09-21T07:13:17.680 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-21T07:13:17.680 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "86257", 2024-09-21T07:13:17.680 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/volumes/qa/sv_0/af3d21b7-6fdf-4360-94cc-b40a9c192877" 2024-09-21T07:13:17.680 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:13:17.682 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2024-09-21T07:13:17.682 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2024-09-21T07:13:17.682 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 15573, 2024-09-21T07:13:17.682 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2024-09-21T07:13:17.682 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 15573 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 620488500 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-09-21T07:13:17.683 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 620488500 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.15573 192.168.0.1:0/620488500", 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "192.168.0.1:0/620488500", 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 5, 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 28, 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 86, 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2024-09-21T07:13:17.684 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:17.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:17.689 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2024-09-21T07:13:17.689 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:17.705 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2024-09-21T07:13:17.705 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:17.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:13:17.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:17.772 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T07:13:17.782 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T07:13:17.782 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T07:13:17.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-21T07:13:17.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 -- 172.21.15.92:0/94611526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a581029e0 msgr2=0x7f6a58102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:17.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 --2- 172.21.15.92:0/94611526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a581029e0 0x7f6a58102df0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009900 tx=0x7f6a5402a410 comp rx=0 tx=0).stop 2024-09-21T07:13:17.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 -- 172.21.15.92:0/94611526 shutdown_connections 2024-09-21T07:13:17.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 --2- 172.21.15.92:0/94611526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a58108c50 0x7f6a5810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:17.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 --2- 172.21.15.92:0/94611526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a58108300 0x7f6a58108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:17.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 --2- 172.21.15.92:0/94611526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a581029e0 0x7f6a58102df0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:17.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 -- 172.21.15.92:0/94611526 >> 172.21.15.92:0/94611526 conn(0x7f6a580784e0 msgr2=0x7f6a580788f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:17.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 -- 172.21.15.92:0/94611526 shutdown_connections 2024-09-21T07:13:17.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 -- 172.21.15.92:0/94611526 wait complete. 2024-09-21T07:13:17.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 Processor -- start 2024-09-21T07:13:17.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.923+0000 7f6a6047e640 1 -- start start 2024-09-21T07:13:17.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a6047e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a581029e0 0x7f6a5819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:17.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a6047e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a58108300 0x7f6a5819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:17.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a6047e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a58108c50 0x7f6a5819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:17.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a6047e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6a58112810 con 0x7f6a58108c50 2024-09-21T07:13:17.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a6047e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6a58112690 con 0x7f6a58108300 2024-09-21T07:13:17.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a6047e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a58112990 con 0x7f6a581029e0 2024-09-21T07:13:17.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5ea1b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a58108c50 0x7f6a5819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:17.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5ea1b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a58108c50 0x7f6a5819bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33186/0 (socket says 172.21.15.92:33186) 2024-09-21T07:13:17.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5ea1b640 1 -- 172.21.15.92:0/3192747163 learned_addr learned my addr 172.21.15.92:0/3192747163 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:17.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5da19640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a58108300 0x7f6a5819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:17.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5e21a640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a581029e0 0x7f6a5819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:17.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5ea1b640 1 -- 172.21.15.92:0/3192747163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a581029e0 msgr2=0x7f6a5819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5ea1b640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a581029e0 0x7f6a5819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5ea1b640 1 -- 172.21.15.92:0/3192747163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a58108300 msgr2=0x7f6a5819b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5ea1b640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a58108300 0x7f6a5819b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5ea1b640 1 -- 172.21.15.92:0/3192747163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a581a6480 con 0x7f6a58108c50 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a5ea1b640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a58108c50 0x7f6a5819bc40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000eaa0 tx=0x7f6a5000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a4f7fe640 1 -- 172.21.15.92:0/3192747163 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000cdb0 con 0x7f6a58108c50 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a4f7fe640 1 -- 172.21.15.92:0/3192747163 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a50005020 con 0x7f6a58108c50 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a6047e640 1 -- 172.21.15.92:0/3192747163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a581a6770 con 0x7f6a58108c50 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.924+0000 7f6a4f7fe640 1 -- 172.21.15.92:0/3192747163 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a500116d0 con 0x7f6a58108c50 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.925+0000 7f6a6047e640 1 -- 172.21.15.92:0/3192747163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a581a6c70 con 0x7f6a58108c50 2024-09-21T07:13:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.926+0000 7f6a6047e640 1 -- 172.21.15.92:0/3192747163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a58103c40 con 0x7f6a58108c50 2024-09-21T07:13:17.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.927+0000 7f6a4f7fe640 1 -- 172.21.15.92:0/3192747163 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f6a500051d0 con 0x7f6a58108c50 2024-09-21T07:13:17.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.928+0000 7f6a4f7fe640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a440b6560 0x7f6a440b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:17.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.928+0000 7f6a5e21a640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a440b6560 0x7f6a440b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:17.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.929+0000 7f6a4f7fe640 1 -- 172.21.15.92:0/3192747163 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6a500e7d70 con 0x7f6a58108c50 2024-09-21T07:13:17.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.929+0000 7f6a5e21a640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a440b6560 0x7f6a440b8a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6a5806c540 tx=0x7f6a54000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:17.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:17.932+0000 7f6a4f7fe640 1 -- 172.21.15.92:0/3192747163 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a50016030 con 0x7f6a58108c50 2024-09-21T07:13:18.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.146+0000 7f6a6047e640 1 -- 172.21.15.92:0/3192747163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f6a58102df0 con 0x7f6a58108c50 2024-09-21T07:13:18.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.719+0000 7f6a4f7fe640 1 -- 172.21.15.92:0/3192747163 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f6a500b2520 con 0x7f6a58108c50 2024-09-21T07:13:18.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 -- 172.21.15.92:0/3192747163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a440b6560 msgr2=0x7f6a440b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:18.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a440b6560 0x7f6a440b8a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6a5806c540 tx=0x7f6a54000bc0 comp rx=0 tx=0).stop 2024-09-21T07:13:18.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 -- 172.21.15.92:0/3192747163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a58108c50 msgr2=0x7f6a5819bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:18.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a58108c50 0x7f6a5819bc40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000eaa0 tx=0x7f6a5000ef60 comp rx=0 tx=0).stop 2024-09-21T07:13:18.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 -- 172.21.15.92:0/3192747163 shutdown_connections 2024-09-21T07:13:18.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a440b6560 0x7f6a440b8a70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:18.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a58108c50 0x7f6a5819bc40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:18.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a58108300 0x7f6a5819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:18.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 --2- 172.21.15.92:0/3192747163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a581029e0 0x7f6a5819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:18.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 -- 172.21.15.92:0/3192747163 >> 172.21.15.92:0/3192747163 conn(0x7f6a580784e0 msgr2=0x7f6a58106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:18.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 -- 172.21.15.92:0/3192747163 shutdown_connections 2024-09-21T07:13:18.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.722+0000 7f6a6047e640 1 -- 172.21.15.92:0/3192747163 wait complete. 2024-09-21T07:13:18.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-21T07:13:18.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.848+0000 7f2d5277b640 1 -- 172.21.15.92:0/2137299157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c103170 msgr2=0x7f2d4c103580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:18.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.848+0000 7f2d5277b640 1 --2- 172.21.15.92:0/2137299157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c103170 0x7f2d4c103580 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009900 tx=0x7f2d3c02a410 comp rx=0 tx=0).stop 2024-09-21T07:13:18.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.848+0000 7f2d5277b640 1 -- 172.21.15.92:0/2137299157 shutdown_connections 2024-09-21T07:13:18.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.848+0000 7f2d5277b640 1 --2- 172.21.15.92:0/2137299157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4c108c80 0x7f2d4c10f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:18.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.848+0000 7f2d5277b640 1 --2- 172.21.15.92:0/2137299157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d4c108330 0x7f2d4c108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:18.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.848+0000 7f2d5277b640 1 --2- 172.21.15.92:0/2137299157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c103170 0x7f2d4c103580 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:18.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.848+0000 7f2d5277b640 1 -- 172.21.15.92:0/2137299157 >> 172.21.15.92:0/2137299157 conn(0x7f2d4c079e90 msgr2=0x7f2d4c07a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:18.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.848+0000 7f2d5277b640 1 -- 172.21.15.92:0/2137299157 shutdown_connections 2024-09-21T07:13:18.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.848+0000 7f2d5277b640 1 -- 172.21.15.92:0/2137299157 wait complete. 2024-09-21T07:13:18.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d5277b640 1 Processor -- start 2024-09-21T07:13:18.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d5277b640 1 -- start start 2024-09-21T07:13:18.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d5277b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d4c103170 0x7f2d4c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:18.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d5277b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4c108330 0x7f2d4c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:18.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d5277b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c108c80 0x7f2d4c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:18.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d5277b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c1127f0 con 0x7f2d4c108c80 2024-09-21T07:13:18.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d5277b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c112670 con 0x7f2d4c108330 2024-09-21T07:13:18.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d5277b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c112970 con 0x7f2d4c103170 2024-09-21T07:13:18.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d50d18640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c108c80 0x7f2d4c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d50d18640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c108c80 0x7f2d4c19fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33200/0 (socket says 172.21.15.92:33200) 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d50d18640 1 -- 172.21.15.92:0/227984531 learned_addr learned my addr 172.21.15.92:0/227984531 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d4bfff640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d4c103170 0x7f2d4c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d43fff640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4c108330 0x7f2d4c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d50d18640 1 -- 172.21.15.92:0/227984531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d4c103170 msgr2=0x7f2d4c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d50d18640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d4c103170 0x7f2d4c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d50d18640 1 -- 172.21.15.92:0/227984531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4c108330 msgr2=0x7f2d4c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d50d18640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4c108330 0x7f2d4c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d50d18640 1 -- 172.21.15.92:0/227984531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4c1a03b0 con 0x7f2d4c108c80 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d43fff640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4c108330 0x7f2d4c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.849+0000 7f2d4bfff640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d4c103170 0x7f2d4c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:18.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.850+0000 7f2d50d18640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c108c80 0x7f2d4c19fcb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400cad0 tx=0x7f2d4400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:18.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.850+0000 7f2d49ffb640 1 -- 172.21.15.92:0/227984531 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400ae20 con 0x7f2d4c108c80 2024-09-21T07:13:18.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.850+0000 7f2d5277b640 1 -- 172.21.15.92:0/227984531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d4c1a06a0 con 0x7f2d4c108c80 2024-09-21T07:13:18.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.850+0000 7f2d49ffb640 1 -- 172.21.15.92:0/227984531 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d44005020 con 0x7f2d4c108c80 2024-09-21T07:13:18.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.850+0000 7f2d49ffb640 1 -- 172.21.15.92:0/227984531 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400f6b0 con 0x7f2d4c108c80 2024-09-21T07:13:18.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.850+0000 7f2d5277b640 1 -- 172.21.15.92:0/227984531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d4c1a6e30 con 0x7f2d4c108c80 2024-09-21T07:13:18.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.851+0000 7f2d5277b640 1 -- 172.21.15.92:0/227984531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d4c103580 con 0x7f2d4c108c80 2024-09-21T07:13:18.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.853+0000 7f2d49ffb640 1 -- 172.21.15.92:0/227984531 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f2d440051d0 con 0x7f2d4c108c80 2024-09-21T07:13:18.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.853+0000 7f2d49ffb640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d380b6560 0x7f2d380b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:18.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.853+0000 7f2d4bfff640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d380b6560 0x7f2d380b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:18.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.853+0000 7f2d49ffb640 1 -- 172.21.15.92:0/227984531 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2d440e7c80 con 0x7f2d4c108c80 2024-09-21T07:13:18.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.854+0000 7f2d4bfff640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d380b6560 0x7f2d380b8a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c000c00 tx=0x7f2d3c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:18.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:18.856+0000 7f2d49ffb640 1 -- 172.21.15.92:0/227984531 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d44014030 con 0x7f2d4c108c80 2024-09-21T07:13:19.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:18 smithi175 ceph-mon[34064]: pgmap v346: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T07:13:19.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:18 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3192747163' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T07:13:19.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.059+0000 7f2d5277b640 1 -- 172.21.15.92:0/227984531 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f2d4c063800 con 0x7f2d380b6560 2024-09-21T07:13:19.067 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:18 smithi092 ceph-mon[30987]: pgmap v346: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T07:13:19.067 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:18 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3192747163' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T07:13:19.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.078+0000 7f2d49ffb640 1 -- 172.21.15.92:0/227984531 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f2d4c063800 con 0x7f2d380b6560 2024-09-21T07:13:19.080 INFO:teuthology.orchestra.run.smithi092.stdout:{} 2024-09-21T07:13:19.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 -- 172.21.15.92:0/227984531 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d380b6560 msgr2=0x7f2d380b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d380b6560 0x7f2d380b8a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c000c00 tx=0x7f2d3c005a20 comp rx=0 tx=0).stop 2024-09-21T07:13:19.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 -- 172.21.15.92:0/227984531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c108c80 msgr2=0x7f2d4c19fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c108c80 0x7f2d4c19fcb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400cad0 tx=0x7f2d4400cf90 comp rx=0 tx=0).stop 2024-09-21T07:13:19.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 -- 172.21.15.92:0/227984531 shutdown_connections 2024-09-21T07:13:19.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d380b6560 0x7f2d380b8a70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c108c80 0x7f2d4c19fcb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4c108330 0x7f2d4c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 --2- 172.21.15.92:0/227984531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d4c103170 0x7f2d4c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 -- 172.21.15.92:0/227984531 >> 172.21.15.92:0/227984531 conn(0x7f2d4c079e90 msgr2=0x7f2d4c102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:19.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 -- 172.21.15.92:0/227984531 shutdown_connections 2024-09-21T07:13:19.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.080+0000 7f2d5277b640 1 -- 172.21.15.92:0/227984531 wait complete. 2024-09-21T07:13:19.093 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T07:13:19.104 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T07:13:19.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:13:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:18 smithi169 ceph-mon[33705]: pgmap v346: 129 pgs: 129 active+clean; 649 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T07:13:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:18 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3192747163' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T07:13:19.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.234+0000 7fc070bda640 1 -- 172.21.15.92:0/981149314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc06c1083e0 msgr2=0x7fc06c10ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.234+0000 7fc070bda640 1 --2- 172.21.15.92:0/981149314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc06c1083e0 0x7fc06c10ec10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc064009ca0 tx=0x7fc06402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.234+0000 7fc070bda640 1 -- 172.21.15.92:0/981149314 shutdown_connections 2024-09-21T07:13:19.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.234+0000 7fc070bda640 1 --2- 172.21.15.92:0/981149314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc06c1083e0 0x7fc06c10ec10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.234+0000 7fc070bda640 1 --2- 172.21.15.92:0/981149314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc06c107a90 0x7fc06c107ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.234+0000 7fc070bda640 1 --2- 172.21.15.92:0/981149314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc06c1021b0 0x7fc06c1025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.234+0000 7fc070bda640 1 -- 172.21.15.92:0/981149314 >> 172.21.15.92:0/981149314 conn(0x7fc06c079d00 msgr2=0x7fc06c07a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:19.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.234+0000 7fc070bda640 1 -- 172.21.15.92:0/981149314 shutdown_connections 2024-09-21T07:13:19.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.234+0000 7fc070bda640 1 -- 172.21.15.92:0/981149314 wait complete. 2024-09-21T07:13:19.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.235+0000 7fc070bda640 1 Processor -- start 2024-09-21T07:13:19.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.235+0000 7fc070bda640 1 -- start start 2024-09-21T07:13:19.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.235+0000 7fc070bda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc06c1021b0 0x7fc06c19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.235+0000 7fc070bda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc06c107a90 0x7fc06c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.235+0000 7fc070bda640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc06c1083e0 0x7fc06c19fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.235+0000 7fc070bda640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c113910 con 0x7fc06c1021b0 2024-09-21T07:13:19.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.235+0000 7fc070bda640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c113790 con 0x7fc06c1083e0 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.235+0000 7fc070bda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c113a90 con 0x7fc06c107a90 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc06c1021b0 0x7fc06c19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc06c1021b0 0x7fc06c19a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33228/0 (socket says 172.21.15.92:33228) 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06a59c640 1 -- 172.21.15.92:0/2035667010 learned_addr learned my addr 172.21.15.92:0/2035667010 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc069d9b640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc06c107a90 0x7fc06c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06ad9d640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc06c1083e0 0x7fc06c19fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06a59c640 1 -- 172.21.15.92:0/2035667010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc06c107a90 msgr2=0x7fc06c19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06a59c640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc06c107a90 0x7fc06c19a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06a59c640 1 -- 172.21.15.92:0/2035667010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc06c1083e0 msgr2=0x7fc06c19fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06a59c640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc06c1083e0 0x7fc06c19fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06a59c640 1 -- 172.21.15.92:0/2035667010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c1a0200 con 0x7fc06c1021b0 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06ad9d640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc06c1083e0 0x7fc06c19fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc06a59c640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc06c1021b0 0x7fc06c19a2d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc06000d950 tx=0x7fc06000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:19.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc05b7fe640 1 -- 172.21.15.92:0/2035667010 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060017070 con 0x7fc06c1021b0 2024-09-21T07:13:19.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc05b7fe640 1 -- 172.21.15.92:0/2035667010 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc060009c30 con 0x7fc06c1021b0 2024-09-21T07:13:19.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc070bda640 1 -- 172.21.15.92:0/2035667010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06c1a04f0 con 0x7fc06c1021b0 2024-09-21T07:13:19.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc05b7fe640 1 -- 172.21.15.92:0/2035667010 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06000f620 con 0x7fc06c1021b0 2024-09-21T07:13:19.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.236+0000 7fc070bda640 1 -- 172.21.15.92:0/2035667010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc06c1a6c80 con 0x7fc06c1021b0 2024-09-21T07:13:19.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.237+0000 7fc070bda640 1 -- 172.21.15.92:0/2035667010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc06c1025c0 con 0x7fc06c1021b0 2024-09-21T07:13:19.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.239+0000 7fc05b7fe640 1 -- 172.21.15.92:0/2035667010 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fc060010460 con 0x7fc06c1021b0 2024-09-21T07:13:19.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.240+0000 7fc05b7fe640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc0540b6560 0x7fc0540b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.240+0000 7fc069d9b640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc0540b6560 0x7fc0540b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.240+0000 7fc05b7fe640 1 -- 172.21.15.92:0/2035667010 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc0600e7450 con 0x7fc06c1021b0 2024-09-21T07:13:19.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.240+0000 7fc069d9b640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc0540b6560 0x7fc0540b8a70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc06c1056e0 tx=0x7fc05c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:19.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.243+0000 7fc05b7fe640 1 -- 172.21.15.92:0/2035667010 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0600ad820 con 0x7fc06c1021b0 2024-09-21T07:13:19.362 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:13:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:13:19.064+0000 7fc75925a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:13:19.362 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:13:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:13:19.064+0000 7fc75925a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:13:19.362 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:13:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:13:19.064+0000 7fc75925a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:13:19.362 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:13:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:13:19.064+0000 7fc75925a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:13:19.362 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:13:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:13:19.064+0000 7fc75925a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:13:19.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.425+0000 7fc070bda640 1 -- 172.21.15.92:0/2035667010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc06c02e640 con 0x7fc06c1021b0 2024-09-21T07:13:19.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.427+0000 7fc05b7fe640 1 -- 172.21.15.92:0/2035667010 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+25265 (secure 0 0 0) 0x7fc060009de0 con 0x7fc06c1021b0 2024-09-21T07:13:19.429 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:19.429 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":86,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:12:14.675473+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:13:19.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 -- 172.21.15.92:0/2035667010 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc0540b6560 msgr2=0x7fc0540b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc0540b6560 0x7fc0540b8a70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc06c1056e0 tx=0x7fc05c00b410 comp rx=0 tx=0).stop 2024-09-21T07:13:19.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 -- 172.21.15.92:0/2035667010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc06c1021b0 msgr2=0x7fc06c19a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc06c1021b0 0x7fc06c19a2d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc06000d950 tx=0x7fc06000de10 comp rx=0 tx=0).stop 2024-09-21T07:13:19.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 -- 172.21.15.92:0/2035667010 shutdown_connections 2024-09-21T07:13:19.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc0540b6560 0x7fc0540b8a70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc06c1083e0 0x7fc06c19fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc06c107a90 0x7fc06c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 --2- 172.21.15.92:0/2035667010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc06c1021b0 0x7fc06c19a2d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 -- 172.21.15.92:0/2035667010 >> 172.21.15.92:0/2035667010 conn(0x7fc06c079d00 msgr2=0x7fc06c103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:19.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 -- 172.21.15.92:0/2035667010 shutdown_connections 2024-09-21T07:13:19.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.429+0000 7fc070bda640 1 -- 172.21.15.92:0/2035667010 wait complete. 2024-09-21T07:13:19.443 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:06:11.822418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:10:50.128666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:10:52.137256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T07:10:58.524238+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T07:13:19.443 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:13:19.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.555+0000 7f39e447e640 1 -- 172.21.15.92:0/1706892085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39dc1082c0 msgr2=0x7f39dc1086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.555+0000 7f39e447e640 1 --2- 172.21.15.92:0/1706892085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39dc1082c0 0x7f39dc1086d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009900 tx=0x7f39cc02a410 comp rx=0 tx=0).stop 2024-09-21T07:13:19.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.555+0000 7f39e447e640 1 -- 172.21.15.92:0/1706892085 shutdown_connections 2024-09-21T07:13:19.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.555+0000 7f39e447e640 1 --2- 172.21.15.92:0/1706892085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39dc108c10 0x7f39dc10f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.555+0000 7f39e447e640 1 --2- 172.21.15.92:0/1706892085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39dc1082c0 0x7f39dc1086d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.555+0000 7f39e447e640 1 --2- 172.21.15.92:0/1706892085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39dc102990 0x7f39dc102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.555+0000 7f39e447e640 1 -- 172.21.15.92:0/1706892085 >> 172.21.15.92:0/1706892085 conn(0x7f39dc0fe3b0 msgr2=0x7f39dc100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:19.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.555+0000 7f39e447e640 1 -- 172.21.15.92:0/1706892085 shutdown_connections 2024-09-21T07:13:19.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.555+0000 7f39e447e640 1 -- 172.21.15.92:0/1706892085 wait complete. 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e447e640 1 Processor -- start 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e447e640 1 -- start start 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e447e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39dc102990 0x7f39dc19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e447e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39dc1082c0 0x7f39dc19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e447e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39dc108c10 0x7f39dc19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e447e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc112780 con 0x7f39dc102990 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e447e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc112600 con 0x7f39dc108c10 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e447e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc112900 con 0x7f39dc1082c0 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e221a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39dc102990 0x7f39dc19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e221a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39dc102990 0x7f39dc19b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33252/0 (socket says 172.21.15.92:33252) 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e221a640 1 -- 172.21.15.92:0/1227847573 learned_addr learned my addr 172.21.15.92:0/1227847573 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e1a19640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39dc1082c0 0x7f39dc19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e2a1b640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39dc108c10 0x7f39dc19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e221a640 1 -- 172.21.15.92:0/1227847573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39dc1082c0 msgr2=0x7f39dc19b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e221a640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39dc1082c0 0x7f39dc19b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e221a640 1 -- 172.21.15.92:0/1227847573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39dc108c10 msgr2=0x7f39dc19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e221a640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39dc108c10 0x7f39dc19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e221a640 1 -- 172.21.15.92:0/1227847573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39dc1a6400 con 0x7f39dc102990 2024-09-21T07:13:19.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.556+0000 7f39e2a1b640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39dc108c10 0x7f39dc19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:19.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.557+0000 7f39e221a640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39dc102990 0x7f39dc19b1d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f39d800e9f0 tx=0x7f39d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:19.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.557+0000 7f39d37fe640 1 -- 172.21.15.92:0/1227847573 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d800cd80 con 0x7f39dc102990 2024-09-21T07:13:19.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.557+0000 7f39d37fe640 1 -- 172.21.15.92:0/1227847573 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39d80054b0 con 0x7f39dc102990 2024-09-21T07:13:19.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.557+0000 7f39e447e640 1 -- 172.21.15.92:0/1227847573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39dc1a66f0 con 0x7f39dc102990 2024-09-21T07:13:19.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.557+0000 7f39d37fe640 1 -- 172.21.15.92:0/1227847573 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8010430 con 0x7f39dc102990 2024-09-21T07:13:19.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.557+0000 7f39e447e640 1 -- 172.21.15.92:0/1227847573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39dc1a6bc0 con 0x7f39dc102990 2024-09-21T07:13:19.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.558+0000 7f39e447e640 1 -- 172.21.15.92:0/1227847573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39dc102da0 con 0x7f39dc102990 2024-09-21T07:13:19.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.559+0000 7f39d37fe640 1 -- 172.21.15.92:0/1227847573 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f39d80046c0 con 0x7f39dc102990 2024-09-21T07:13:19.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.560+0000 7f39d37fe640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f39c80b6560 0x7f39c80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.560+0000 7f39e1a19640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f39c80b6560 0x7f39c80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.560+0000 7f39d37fe640 1 -- 172.21.15.92:0/1227847573 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f39d80e7eb0 con 0x7f39dc102990 2024-09-21T07:13:19.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.561+0000 7f39e1a19640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f39c80b6560 0x7f39c80b8a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f39cc005940 tx=0x7f39cc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:19.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.563+0000 7f39d37fe640 1 -- 172.21.15.92:0/1227847573 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39d8056710 con 0x7f39dc102990 2024-09-21T07:13:19.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.742+0000 7f39d37fe640 1 -- 172.21.15.92:0/1227847573 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7f39d80a9df0 con 0x7f39dc102990 2024-09-21T07:13:19.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.745+0000 7f39e447e640 1 -- 172.21.15.92:0/1227847573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f39dc02e640 con 0x7f39dc102990 2024-09-21T07:13:19.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.745+0000 7f39d37fe640 1 -- 172.21.15.92:0/1227847573 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7f39d80ae280 con 0x7f39dc102990 2024-09-21T07:13:19.747 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2024-09-21T07:13:19.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.747+0000 7f39e447e640 1 -- 172.21.15.92:0/1227847573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f39c80b6560 msgr2=0x7f39c80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.747+0000 7f39e447e640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f39c80b6560 0x7f39c80b8a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f39cc005940 tx=0x7f39cc0058d0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.747+0000 7f39e447e640 1 -- 172.21.15.92:0/1227847573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39dc102990 msgr2=0x7f39dc19b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.747+0000 7f39e447e640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39dc102990 0x7f39dc19b1d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f39d800e9f0 tx=0x7f39d800edf0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.747+0000 7f39e447e640 1 -- 172.21.15.92:0/1227847573 shutdown_connections 2024-09-21T07:13:19.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.747+0000 7f39e447e640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f39c80b6560 0x7f39c80b8a70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.747+0000 7f39e447e640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39dc108c10 0x7f39dc19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.747+0000 7f39e447e640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39dc1082c0 0x7f39dc19b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.747+0000 7f39e447e640 1 --2- 172.21.15.92:0/1227847573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39dc102990 0x7f39dc19b1d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.747+0000 7f39e447e640 1 -- 172.21.15.92:0/1227847573 >> 172.21.15.92:0/1227847573 conn(0x7f39dc0fe3b0 msgr2=0x7f39dc1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:19.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.748+0000 7f39e447e640 1 -- 172.21.15.92:0/1227847573 shutdown_connections 2024-09-21T07:13:19.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.748+0000 7f39e447e640 1 -- 172.21.15.92:0/1227847573 wait complete. 2024-09-21T07:13:19.761 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T07:13:19.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 -- 172.21.15.92:0/1424812701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdef01083c0 msgr2=0x7fdef010ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 --2- 172.21.15.92:0/1424812701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdef01083c0 0x7fdef010ebf0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009ca0 tx=0x7fdee802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 -- 172.21.15.92:0/1424812701 shutdown_connections 2024-09-21T07:13:19.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 --2- 172.21.15.92:0/1424812701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdef01083c0 0x7fdef010ebf0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 --2- 172.21.15.92:0/1424812701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdef0107a70 0x7fdef0107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 --2- 172.21.15.92:0/1424812701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef0102140 0x7fdef0102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 -- 172.21.15.92:0/1424812701 >> 172.21.15.92:0/1424812701 conn(0x7fdef0079e10 msgr2=0x7fdef007a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 -- 172.21.15.92:0/1424812701 shutdown_connections 2024-09-21T07:13:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 -- 172.21.15.92:0/1424812701 wait complete. 2024-09-21T07:13:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 Processor -- start 2024-09-21T07:13:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.872+0000 7fdef6b01640 1 -- start start 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdef6b01640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdef0102140 0x7fdef019b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdef6b01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdef0107a70 0x7fdef019b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdef6b01640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef01083c0 0x7fdef019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdef6b01640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdef0111f90 con 0x7fdef0107a70 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdef6b01640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdef0111e10 con 0x7fdef0102140 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdef6b01640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdef0112110 con 0x7fdef01083c0 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdeeffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdef0107a70 0x7fdef019b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdeeffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdef0107a70 0x7fdef019b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55428/0 (socket says 172.21.15.92:55428) 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdeeffff640 1 -- 172.21.15.92:0/3067049103 learned_addr learned my addr 172.21.15.92:0/3067049103 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdef489d640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdef0102140 0x7fdef019b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdef509e640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef01083c0 0x7fdef019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdeeffff640 1 -- 172.21.15.92:0/3067049103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef01083c0 msgr2=0x7fdef019bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdeeffff640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef01083c0 0x7fdef019bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdeeffff640 1 -- 172.21.15.92:0/3067049103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdef0102140 msgr2=0x7fdef019b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdeeffff640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdef0102140 0x7fdef019b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdeeffff640 1 -- 172.21.15.92:0/3067049103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef01a6390 con 0x7fdef0107a70 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdef509e640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef01083c0 0x7fdef019bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.873+0000 7fdeeffff640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdef0107a70 0x7fdef019b640 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c970 tx=0x7fdee400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.874+0000 7fdeedffb640 1 -- 172.21.15.92:0/3067049103 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4007bb0 con 0x7fdef0107a70 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.874+0000 7fdeedffb640 1 -- 172.21.15.92:0/3067049103 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdee4007d50 con 0x7fdef0107a70 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.874+0000 7fdef6b01640 1 -- 172.21.15.92:0/3067049103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef01a6680 con 0x7fdef0107a70 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.874+0000 7fdeedffb640 1 -- 172.21.15.92:0/3067049103 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4004da0 con 0x7fdef0107a70 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.874+0000 7fdef6b01640 1 -- 172.21.15.92:0/3067049103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef01a6bd0 con 0x7fdef0107a70 2024-09-21T07:13:19.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.875+0000 7fdef6b01640 1 -- 172.21.15.92:0/3067049103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef0102550 con 0x7fdef0107a70 2024-09-21T07:13:19.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.876+0000 7fdeedffb640 1 -- 172.21.15.92:0/3067049103 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7fdee4004f80 con 0x7fdef0107a70 2024-09-21T07:13:19.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.877+0000 7fdeedffb640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fded80b65f0 0x7fded80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:19.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.877+0000 7fdef489d640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fded80b65f0 0x7fded80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:19.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.877+0000 7fdeedffb640 1 -- 172.21.15.92:0/3067049103 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdee40e7810 con 0x7fdef0107a70 2024-09-21T07:13:19.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.878+0000 7fdef489d640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fded80b65f0 0x7fded80b8b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdee0005fd0 tx=0x7fdee0005e20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:19.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:19.881+0000 7fdeedffb640 1 -- 172.21.15.92:0/3067049103 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdee4014030 con 0x7fdef0107a70 2024-09-21T07:13:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:19 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3192747163' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T07:13:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:19 smithi175 ceph-mon[34064]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:13:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:19 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2035667010' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:20.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.060+0000 7fdef6b01640 1 -- 172.21.15.92:0/3067049103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdef01a7050 con 0x7fdef0107a70 2024-09-21T07:13:20.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.060+0000 7fdeedffb640 1 -- 172.21.15.92:0/3067049103 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7fdee40ada80 con 0x7fdef0107a70 2024-09-21T07:13:20.062 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2024-09-21T07:13:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 -- 172.21.15.92:0/3067049103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fded80b65f0 msgr2=0x7fded80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fded80b65f0 0x7fded80b8b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdee0005fd0 tx=0x7fdee0005e20 comp rx=0 tx=0).stop 2024-09-21T07:13:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 -- 172.21.15.92:0/3067049103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdef0107a70 msgr2=0x7fdef019b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdef0107a70 0x7fdef019b640 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c970 tx=0x7fdee400ce30 comp rx=0 tx=0).stop 2024-09-21T07:13:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 -- 172.21.15.92:0/3067049103 shutdown_connections 2024-09-21T07:13:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fded80b65f0 0x7fded80b8b00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef01083c0 0x7fdef019bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdef0107a70 0x7fdef019b640 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 --2- 172.21.15.92:0/3067049103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdef0102140 0x7fdef019b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 -- 172.21.15.92:0/3067049103 >> 172.21.15.92:0/3067049103 conn(0x7fdef0079e10 msgr2=0x7fdef0100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 -- 172.21.15.92:0/3067049103 shutdown_connections 2024-09-21T07:13:20.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.062+0000 7fdef6b01640 1 -- 172.21.15.92:0/3067049103 wait complete. 2024-09-21T07:13:20.074 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:19 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3192747163' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T07:13:20.075 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:19 smithi092 ceph-mon[30987]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:13:20.075 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:19 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2035667010' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:20.076 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T07:13:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:19 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3192747163' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T07:13:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:19 smithi169 ceph-mon[33705]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:13:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:19 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2035667010' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:20.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.187+0000 7fb826913640 1 -- 172.21.15.92:0/4249183567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8201030f0 msgr2=0x7fb820103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.187+0000 7fb826913640 1 --2- 172.21.15.92:0/4249183567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8201030f0 0x7fb820103500 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb810009900 tx=0x7fb81002a410 comp rx=0 tx=0).stop 2024-09-21T07:13:20.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.187+0000 7fb826913640 1 -- 172.21.15.92:0/4249183567 shutdown_connections 2024-09-21T07:13:20.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.187+0000 7fb826913640 1 --2- 172.21.15.92:0/4249183567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb820105a00 0x7fb82010f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.187+0000 7fb826913640 1 --2- 172.21.15.92:0/4249183567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8201050b0 0x7fb8201054c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.187+0000 7fb826913640 1 --2- 172.21.15.92:0/4249183567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8201030f0 0x7fb820103500 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.187+0000 7fb826913640 1 -- 172.21.15.92:0/4249183567 >> 172.21.15.92:0/4249183567 conn(0x7fb820079e10 msgr2=0x7fb82007a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:20.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.187+0000 7fb826913640 1 -- 172.21.15.92:0/4249183567 shutdown_connections 2024-09-21T07:13:20.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.187+0000 7fb826913640 1 -- 172.21.15.92:0/4249183567 wait complete. 2024-09-21T07:13:20.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb826913640 1 Processor -- start 2024-09-21T07:13:20.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb826913640 1 -- start start 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb826913640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8201030f0 0x7fb820199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb826913640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8201050b0 0x7fb8201998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb826913640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb820105a00 0x7fb82019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb826913640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8201127b0 con 0x7fb8201030f0 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb826913640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb820112630 con 0x7fb820105a00 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb826913640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb820112930 con 0x7fb8201050b0 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb81ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8201030f0 0x7fb820199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb81ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8201030f0 0x7fb820199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55444/0 (socket says 172.21.15.92:55444) 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb81ffff640 1 -- 172.21.15.92:0/2451592445 learned_addr learned my addr 172.21.15.92:0/2451592445 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.188+0000 7fb81f7fe640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8201050b0 0x7fb8201998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:20.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb824eb0640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb820105a00 0x7fb82019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb81ffff640 1 -- 172.21.15.92:0/2451592445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8201050b0 msgr2=0x7fb8201998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb81ffff640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8201050b0 0x7fb8201998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb81ffff640 1 -- 172.21.15.92:0/2451592445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb820105a00 msgr2=0x7fb82019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb81ffff640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb820105a00 0x7fb82019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb81ffff640 1 -- 172.21.15.92:0/2451592445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82019f1b0 con 0x7fb8201030f0 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb81ffff640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8201030f0 0x7fb820199310 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb810009230 tx=0x7fb810004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb81d7fa640 1 -- 172.21.15.92:0/2451592445 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810035050 con 0x7fb8201030f0 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb826913640 1 -- 172.21.15.92:0/2451592445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82019f440 con 0x7fb8201030f0 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb81d7fa640 1 -- 172.21.15.92:0/2451592445 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb810003c80 con 0x7fb8201030f0 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb81d7fa640 1 -- 172.21.15.92:0/2451592445 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810039ce0 con 0x7fb8201030f0 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.189+0000 7fb826913640 1 -- 172.21.15.92:0/2451592445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82019f930 con 0x7fb8201030f0 2024-09-21T07:13:20.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.190+0000 7fb826913640 1 -- 172.21.15.92:0/2451592445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb820103500 con 0x7fb8201030f0 2024-09-21T07:13:20.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.192+0000 7fb81d7fa640 1 -- 172.21.15.92:0/2451592445 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7fb8100394e0 con 0x7fb8201030f0 2024-09-21T07:13:20.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.193+0000 7fb81d7fa640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb80c0b6670 0x7fb80c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:20.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.193+0000 7fb81f7fe640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb80c0b6670 0x7fb80c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:20.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.193+0000 7fb81d7fa640 1 -- 172.21.15.92:0/2451592445 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fb81010a420 con 0x7fb8201030f0 2024-09-21T07:13:20.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.193+0000 7fb81f7fe640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb80c0b6670 0x7fb80c0b8b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb82007a900 tx=0x7fb80800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:20.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.196+0000 7fb81d7fa640 1 -- 172.21.15.92:0/2451592445 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8100d0630 con 0x7fb8201030f0 2024-09-21T07:13:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.372+0000 7fb826913640 1 -- 172.21.15.92:0/2451592445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb82010a470 con 0x7fb8201030f0 2024-09-21T07:13:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.373+0000 7fb81d7fa640 1 -- 172.21.15.92:0/2451592445 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7fb8100d4a10 con 0x7fb8201030f0 2024-09-21T07:13:20.375 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2024-09-21T07:13:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 -- 172.21.15.92:0/2451592445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb80c0b6670 msgr2=0x7fb80c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb80c0b6670 0x7fb80c0b8b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb82007a900 tx=0x7fb80800b390 comp rx=0 tx=0).stop 2024-09-21T07:13:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 -- 172.21.15.92:0/2451592445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8201030f0 msgr2=0x7fb820199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8201030f0 0x7fb820199310 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb810009230 tx=0x7fb810004270 comp rx=0 tx=0).stop 2024-09-21T07:13:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 -- 172.21.15.92:0/2451592445 shutdown_connections 2024-09-21T07:13:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb80c0b6670 0x7fb80c0b8b80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb820105a00 0x7fb82019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8201050b0 0x7fb8201998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 --2- 172.21.15.92:0/2451592445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8201030f0 0x7fb820199310 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 -- 172.21.15.92:0/2451592445 >> 172.21.15.92:0/2451592445 conn(0x7fb820079e10 msgr2=0x7fb820106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 -- 172.21.15.92:0/2451592445 shutdown_connections 2024-09-21T07:13:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.375+0000 7fb826913640 1 -- 172.21.15.92:0/2451592445 wait complete. 2024-09-21T07:13:20.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.498+0000 7f1edd04a640 1 -- 172.21.15.92:0/2912568352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed81082e0 msgr2=0x7f1ed81086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.498+0000 7f1edd04a640 1 --2- 172.21.15.92:0/2912568352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed81082e0 0x7f1ed81086f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009900 tx=0x7f1ec802a410 comp rx=0 tx=0).stop 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.498+0000 7f1edd04a640 1 -- 172.21.15.92:0/2912568352 shutdown_connections 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.498+0000 7f1edd04a640 1 --2- 172.21.15.92:0/2912568352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed8108c30 0x7f1ed810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.498+0000 7f1edd04a640 1 --2- 172.21.15.92:0/2912568352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed81082e0 0x7f1ed81086f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.498+0000 7f1edd04a640 1 --2- 172.21.15.92:0/2912568352 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed81029b0 0x7f1ed8102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.498+0000 7f1edd04a640 1 -- 172.21.15.92:0/2912568352 >> 172.21.15.92:0/2912568352 conn(0x7f1ed80fe3f0 msgr2=0x7f1ed8100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.498+0000 7f1edd04a640 1 -- 172.21.15.92:0/2912568352 shutdown_connections 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.498+0000 7f1edd04a640 1 -- 172.21.15.92:0/2912568352 wait complete. 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.499+0000 7f1edd04a640 1 Processor -- start 2024-09-21T07:13:20.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.499+0000 7f1edd04a640 1 -- start start 2024-09-21T07:13:20.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.499+0000 7f1edd04a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed81029b0 0x7f1ed819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:20.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.499+0000 7f1edd04a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed81082e0 0x7f1ed819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:20.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.499+0000 7f1edd04a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed8108c30 0x7f1ed819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:20.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.499+0000 7f1edd04a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81127a0 con 0x7f1ed81082e0 2024-09-21T07:13:20.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.499+0000 7f1edd04a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8112620 con 0x7f1ed81029b0 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.499+0000 7f1edd04a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8112920 con 0x7f1ed8108c30 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed81082e0 0x7f1ed819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed81082e0 0x7f1ed819b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55464/0 (socket says 172.21.15.92:55464) 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed659c640 1 -- 172.21.15.92:0/1061683743 learned_addr learned my addr 172.21.15.92:0/1061683743 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed759e640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed8108c30 0x7f1ed819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed6d9d640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed81029b0 0x7f1ed819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed659c640 1 -- 172.21.15.92:0/1061683743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed8108c30 msgr2=0x7f1ed819bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed659c640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed8108c30 0x7f1ed819bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed659c640 1 -- 172.21.15.92:0/1061683743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed81029b0 msgr2=0x7f1ed819b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed659c640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed81029b0 0x7f1ed819b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed659c640 1 -- 172.21.15.92:0/1061683743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed81a63f0 con 0x7f1ed81082e0 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ed659c640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed81082e0 0x7f1ed819b670 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8005940 tx=0x7f1ec80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:20.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ecffff640 1 -- 172.21.15.92:0/1061683743 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec803f030 con 0x7f1ed81082e0 2024-09-21T07:13:20.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ecffff640 1 -- 172.21.15.92:0/1061683743 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ec8003a80 con 0x7f1ed81082e0 2024-09-21T07:13:20.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1edd04a640 1 -- 172.21.15.92:0/1061683743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed81a6680 con 0x7f1ed81082e0 2024-09-21T07:13:20.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1ecffff640 1 -- 172.21.15.92:0/1061683743 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8035070 con 0x7f1ed81082e0 2024-09-21T07:13:20.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.500+0000 7f1edd04a640 1 -- 172.21.15.92:0/1061683743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed81a6b70 con 0x7f1ed81082e0 2024-09-21T07:13:20.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.501+0000 7f1edd04a640 1 -- 172.21.15.92:0/1061683743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed8103c20 con 0x7f1ed81082e0 2024-09-21T07:13:20.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.503+0000 7f1ecffff640 1 -- 172.21.15.92:0/1061683743 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7f1ec8042030 con 0x7f1ed81082e0 2024-09-21T07:13:20.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.503+0000 7f1ecffff640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ec40b65f0 0x7f1ec40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:20.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.504+0000 7f1ed6d9d640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ec40b65f0 0x7f1ec40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:20.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.504+0000 7f1ecffff640 1 -- 172.21.15.92:0/1061683743 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f1ec8108230 con 0x7f1ed81082e0 2024-09-21T07:13:20.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.504+0000 7f1ed6d9d640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ec40b65f0 0x7f1ec40b8b00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1ed806c460 tx=0x7f1ec000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:20.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.507+0000 7f1ecffff640 1 -- 172.21.15.92:0/1061683743 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ec80d2880 con 0x7f1ed81082e0 2024-09-21T07:13:20.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.684+0000 7f1edd04a640 1 -- 172.21.15.92:0/1061683743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1ed806bd10 con 0x7f1ed81082e0 2024-09-21T07:13:20.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.684+0000 7f1ecffff640 1 -- 172.21.15.92:0/1061683743 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) ==== 103+0+11 (secure 0 0 0) 0x7f1ec80d77c0 con 0x7f1ed81082e0 2024-09-21T07:13:20.686 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2024-09-21T07:13:20.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.686+0000 7f1edd04a640 1 -- 172.21.15.92:0/1061683743 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ec40b65f0 msgr2=0x7f1ec40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.686+0000 7f1edd04a640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ec40b65f0 0x7f1ec40b8b00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1ed806c460 tx=0x7f1ec000b410 comp rx=0 tx=0).stop 2024-09-21T07:13:20.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.686+0000 7f1edd04a640 1 -- 172.21.15.92:0/1061683743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed81082e0 msgr2=0x7f1ed819b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:20.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.686+0000 7f1edd04a640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed81082e0 0x7f1ed819b670 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8005940 tx=0x7f1ec80040e0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.687+0000 7f1edd04a640 1 -- 172.21.15.92:0/1061683743 shutdown_connections 2024-09-21T07:13:20.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.687+0000 7f1edd04a640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ec40b65f0 0x7f1ec40b8b00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.687+0000 7f1edd04a640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed8108c30 0x7f1ed819bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.687+0000 7f1edd04a640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed81082e0 0x7f1ed819b670 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.687+0000 7f1edd04a640 1 --2- 172.21.15.92:0/1061683743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ed81029b0 0x7f1ed819b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:20.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.687+0000 7f1edd04a640 1 -- 172.21.15.92:0/1061683743 >> 172.21.15.92:0/1061683743 conn(0x7f1ed80fe3f0 msgr2=0x7f1ed8100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:20.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.687+0000 7f1edd04a640 1 -- 172.21.15.92:0/1061683743 shutdown_connections 2024-09-21T07:13:20.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:20.687+0000 7f1edd04a640 1 -- 172.21.15.92:0/1061683743 wait complete. 2024-09-21T07:13:20.700 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T07:13:20.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:13:20.948 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:20 smithi175 ceph-mon[34064]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:20 smithi175 ceph-mon[34064]: pgmap v347: 129 pgs: 129 active+clean; 651 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-21T07:13:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:20 smithi175 ceph-mon[34064]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-09-21T07:13:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1227847573' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3067049103' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2451592445' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1061683743' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.069 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:20 smithi092 ceph-mon[30987]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:21.069 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:20 smithi092 ceph-mon[30987]: pgmap v347: 129 pgs: 129 active+clean; 651 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-21T07:13:21.069 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:20 smithi092 ceph-mon[30987]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-09-21T07:13:21.069 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1227847573' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.069 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3067049103' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.070 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2451592445' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.070 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1061683743' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:20 smithi169 ceph-mon[33705]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:20 smithi169 ceph-mon[33705]: pgmap v347: 129 pgs: 129 active+clean; 651 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-09-21T07:13:21.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:20 smithi169 ceph-mon[33705]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-09-21T07:13:21.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1227847573' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3067049103' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2451592445' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1061683743' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T07:13:21.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.451+0000 7f98ea81b640 1 -- 172.21.15.92:0/3072145216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98e41083d0 msgr2=0x7f98e41087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.451+0000 7f98ea81b640 1 --2- 172.21.15.92:0/3072145216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98e41083d0 0x7f98e41087e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009900 tx=0x7f98cc02a410 comp rx=0 tx=0).stop 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.451+0000 7f98ea81b640 1 -- 172.21.15.92:0/3072145216 shutdown_connections 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.451+0000 7f98ea81b640 1 --2- 172.21.15.92:0/3072145216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98e4108d20 0x7f98e410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.451+0000 7f98ea81b640 1 --2- 172.21.15.92:0/3072145216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98e41083d0 0x7f98e41087e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.451+0000 7f98ea81b640 1 --2- 172.21.15.92:0/3072145216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98e4102ae0 0x7f98e4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.451+0000 7f98ea81b640 1 -- 172.21.15.92:0/3072145216 >> 172.21.15.92:0/3072145216 conn(0x7f98e4079760 msgr2=0x7f98e4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.451+0000 7f98ea81b640 1 -- 172.21.15.92:0/3072145216 shutdown_connections 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.451+0000 7f98ea81b640 1 -- 172.21.15.92:0/3072145216 wait complete. 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.452+0000 7f98ea81b640 1 Processor -- start 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.452+0000 7f98ea81b640 1 -- start start 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.452+0000 7f98ea81b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98e4102ae0 0x7f98e4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.452+0000 7f98ea81b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98e41083d0 0x7f98e41998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:21.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.452+0000 7f98ea81b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98e4108d20 0x7f98e419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.452+0000 7f98ea81b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f98e4112880 con 0x7f98e4102ae0 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.452+0000 7f98ea81b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f98e4112700 con 0x7f98e4108d20 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98ea81b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98e4112a00 con 0x7f98e41083d0 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98e4102ae0 0x7f98e4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98e4102ae0 0x7f98e4199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55478/0 (socket says 172.21.15.92:55478) 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e3fff640 1 -- 172.21.15.92:0/2693801999 learned_addr learned my addr 172.21.15.92:0/2693801999 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98dbfff640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98e41083d0 0x7f98e41998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e8db8640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98e4108d20 0x7f98e419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e3fff640 1 -- 172.21.15.92:0/2693801999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98e41083d0 msgr2=0x7f98e41998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e3fff640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98e41083d0 0x7f98e41998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e3fff640 1 -- 172.21.15.92:0/2693801999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98e4108d20 msgr2=0x7f98e419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e3fff640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98e4108d20 0x7f98e419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:21.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e3fff640 1 -- 172.21.15.92:0/2693801999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e419f280 con 0x7f98e4102ae0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e3fff640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98e4102ae0 0x7f98e4199310 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f98d400b4a0 tx=0x7f98d400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e1ffb640 1 -- 172.21.15.92:0/2693801999 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4014070 con 0x7f98e4102ae0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e1ffb640 1 -- 172.21.15.92:0/2693801999 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98d4010aa0 con 0x7f98e4102ae0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98e1ffb640 1 -- 172.21.15.92:0/2693801999 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4017b70 con 0x7f98e4102ae0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98ea81b640 1 -- 172.21.15.92:0/2693801999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e419f570 con 0x7f98e4102ae0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.453+0000 7f98ea81b640 1 -- 172.21.15.92:0/2693801999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e41a5cd0 con 0x7f98e4102ae0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.454+0000 7f98ea81b640 1 -- 172.21.15.92:0/2693801999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e4102ef0 con 0x7f98e4102ae0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.456+0000 7f98e1ffb640 1 -- 172.21.15.92:0/2693801999 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7f98d4017070 con 0x7f98e4102ae0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.456+0000 7f98e1ffb640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98d00b6670 0x7f98d00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.457+0000 7f98dbfff640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98d00b6670 0x7f98d00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.457+0000 7f98e1ffb640 1 -- 172.21.15.92:0/2693801999 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f98d40e6e20 con 0x7f98e4102ae0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.457+0000 7f98dbfff640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98d00b6670 0x7f98d00b8b80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f98cc005ec0 tx=0x7f98cc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:21.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.460+0000 7f98e1ffb640 1 -- 172.21.15.92:0/2693801999 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f98d40b1470 con 0x7f98e4102ae0 2024-09-21T07:13:21.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.671+0000 7f98ea81b640 1 -- 172.21.15.92:0/2693801999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98e419a440 con 0x7f98e4102ae0 2024-09-21T07:13:21.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.672+0000 7f98e1ffb640 1 -- 172.21.15.92:0/2693801999 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f98e419a440 con 0x7f98e4102ae0 2024-09-21T07:13:21.674 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:21.674 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:13:21.675 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:13:21.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.674+0000 7f98ea81b640 1 -- 172.21.15.92:0/2693801999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98d00b6670 msgr2=0x7f98d00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:21.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.674+0000 7f98ea81b640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98d00b6670 0x7f98d00b8b80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f98cc005ec0 tx=0x7f98cc0058d0 comp rx=0 tx=0).stop 2024-09-21T07:13:21.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.674+0000 7f98ea81b640 1 -- 172.21.15.92:0/2693801999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98e4102ae0 msgr2=0x7f98e4199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:21.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.674+0000 7f98ea81b640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98e4102ae0 0x7f98e4199310 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f98d400b4a0 tx=0x7f98d400b960 comp rx=0 tx=0).stop 2024-09-21T07:13:21.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.674+0000 7f98ea81b640 1 -- 172.21.15.92:0/2693801999 shutdown_connections 2024-09-21T07:13:21.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.675+0000 7f98ea81b640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f98d00b6670 0x7f98d00b8b80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:21.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.675+0000 7f98ea81b640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98e4108d20 0x7f98e419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:21.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.675+0000 7f98ea81b640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98e41083d0 0x7f98e41998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:21.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.675+0000 7f98ea81b640 1 --2- 172.21.15.92:0/2693801999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98e4102ae0 0x7f98e4199310 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:21.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.675+0000 7f98ea81b640 1 -- 172.21.15.92:0/2693801999 >> 172.21.15.92:0/2693801999 conn(0x7f98e4079760 msgr2=0x7f98e4105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:21.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.675+0000 7f98ea81b640 1 -- 172.21.15.92:0/2693801999 shutdown_connections 2024-09-21T07:13:21.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:21.675+0000 7f98ea81b640 1 -- 172.21.15.92:0/2693801999 wait complete. 2024-09-21T07:13:22.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:21 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2693801999' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:21 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2693801999' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:21 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2693801999' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:22.300 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T07:13:22.301 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T07:13:22.301 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:13:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.413+0000 7faa18664640 1 -- 172.21.15.92:0/3850914744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa101082e0 msgr2=0x7faa101086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.413+0000 7faa18664640 1 --2- 172.21.15.92:0/3850914744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa101082e0 0x7faa101086f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faa04009900 tx=0x7faa0402a410 comp rx=0 tx=0).stop 2024-09-21T07:13:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.413+0000 7faa18664640 1 -- 172.21.15.92:0/3850914744 shutdown_connections 2024-09-21T07:13:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.413+0000 7faa18664640 1 --2- 172.21.15.92:0/3850914744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa10108c30 0x7faa1010f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.413+0000 7faa18664640 1 --2- 172.21.15.92:0/3850914744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa101082e0 0x7faa101086f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.413+0000 7faa18664640 1 --2- 172.21.15.92:0/3850914744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa101029b0 0x7faa10102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.413+0000 7faa18664640 1 -- 172.21.15.92:0/3850914744 >> 172.21.15.92:0/3850914744 conn(0x7faa1007a750 msgr2=0x7faa1007ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.413+0000 7faa18664640 1 -- 172.21.15.92:0/3850914744 shutdown_connections 2024-09-21T07:13:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.413+0000 7faa18664640 1 -- 172.21.15.92:0/3850914744 wait complete. 2024-09-21T07:13:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa18664640 1 Processor -- start 2024-09-21T07:13:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa18664640 1 -- start start 2024-09-21T07:13:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa18664640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa101029b0 0x7faa10199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa18664640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa101082e0 0x7faa101997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa18664640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa10108c30 0x7faa1019ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa18664640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa101127a0 con 0x7faa10108c30 2024-09-21T07:13:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa18664640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa10112620 con 0x7faa101029b0 2024-09-21T07:13:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa18664640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa10112920 con 0x7faa101082e0 2024-09-21T07:13:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa16c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa10108c30 0x7faa1019ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa16c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa10108c30 0x7faa1019ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55502/0 (socket says 172.21.15.92:55502) 2024-09-21T07:13:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa16c01640 1 -- 172.21.15.92:0/659813041 learned_addr learned my addr 172.21.15.92:0/659813041 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:22.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa15bff640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa101082e0 0x7faa101997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa16c01640 1 -- 172.21.15.92:0/659813041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa101082e0 msgr2=0x7faa101997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa16c01640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa101082e0 0x7faa101997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa16c01640 1 -- 172.21.15.92:0/659813041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa101029b0 msgr2=0x7faa10199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa16400640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa101029b0 0x7faa10199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa16c01640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa101029b0 0x7faa10199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa16c01640 1 -- 172.21.15.92:0/659813041 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1019f0c0 con 0x7faa10108c30 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa15bff640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa101082e0 0x7faa101997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.414+0000 7faa16c01640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa10108c30 0x7faa1019ea50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faa0800eaa0 tx=0x7faa0800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.415+0000 7faa037fe640 1 -- 172.21.15.92:0/659813041 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0800cdb0 con 0x7faa10108c30 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.415+0000 7faa037fe640 1 -- 172.21.15.92:0/659813041 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa08005020 con 0x7faa10108c30 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.415+0000 7faa18664640 1 -- 172.21.15.92:0/659813041 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1019f3b0 con 0x7faa10108c30 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.415+0000 7faa037fe640 1 -- 172.21.15.92:0/659813041 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080116d0 con 0x7faa10108c30 2024-09-21T07:13:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.415+0000 7faa18664640 1 -- 172.21.15.92:0/659813041 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa101a5bd0 con 0x7faa10108c30 2024-09-21T07:13:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.416+0000 7faa18664640 1 -- 172.21.15.92:0/659813041 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa10103c20 con 0x7faa10108c30 2024-09-21T07:13:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.417+0000 7faa037fe640 1 -- 172.21.15.92:0/659813041 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7faa080051d0 con 0x7faa10108c30 2024-09-21T07:13:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.418+0000 7faa037fe640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b65f0 0x7fa9fc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:22.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.418+0000 7faa16400640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b65f0 0x7fa9fc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:22.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.418+0000 7faa037fe640 1 -- 172.21.15.92:0/659813041 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7faa080e8030 con 0x7faa10108c30 2024-09-21T07:13:22.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.419+0000 7faa16400640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b65f0 0x7fa9fc0b8b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00ba40 tx=0x7faa0c005cc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:22.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.422+0000 7faa037fe640 1 -- 172.21.15.92:0/659813041 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa08016030 con 0x7faa10108c30 2024-09-21T07:13:22.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.599+0000 7faa18664640 1 -- 172.21.15.92:0/659813041 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa10063800 con 0x7fa9fc0b65f0 2024-09-21T07:13:22.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.604+0000 7faa037fe640 1 -- 172.21.15.92:0/659813041 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340813 (secure 0 0 0) 0x7faa10063800 con 0x7fa9fc0b65f0 2024-09-21T07:13:22.611 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:22.613 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-21T07:13:22.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 -- 172.21.15.92:0/659813041 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b65f0 msgr2=0x7fa9fc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:22.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b65f0 0x7fa9fc0b8b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00ba40 tx=0x7faa0c005cc0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 -- 172.21.15.92:0/659813041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa10108c30 msgr2=0x7faa1019ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:22.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa10108c30 0x7faa1019ea50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faa0800eaa0 tx=0x7faa0800ef60 comp rx=0 tx=0).stop 2024-09-21T07:13:22.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 -- 172.21.15.92:0/659813041 shutdown_connections 2024-09-21T07:13:22.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b65f0 0x7fa9fc0b8b00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa10108c30 0x7faa1019ea50 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa101082e0 0x7faa101997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 --2- 172.21.15.92:0/659813041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa101029b0 0x7faa10199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 -- 172.21.15.92:0/659813041 >> 172.21.15.92:0/659813041 conn(0x7faa1007a750 msgr2=0x7faa10106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:22.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 -- 172.21.15.92:0/659813041 shutdown_connections 2024-09-21T07:13:22.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.608+0000 7faa18664640 1 -- 172.21.15.92:0/659813041 wait complete. 2024-09-21T07:13:22.622 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-21T07:13:21.624726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667405,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1180,"num_read_kb":703,"num_write":399,"num_write_kb":2318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2951908,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":829,"ondisk_log_size":829,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369364,"kb_used_data":11796,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572460,"statfs":{"total":1151940427776,"available":1151562199040,"internally_reserved":0,"allocated":12079104,"data_stored":8051144,"data_compressed":463053,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2856,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":17,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003657"},"pg_stats":[{"pgid":"2.1f","version":"86'14","reported_seq":159,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.161324+0000","last_change":"2024-09-21T07:10:51.463956+0000","last_active":"2024-09-21T07:13:16.161324+0000","last_peered":"2024-09-21T07:13:16.161324+0000","last_clean":"2024-09-21T07:13:16.161324+0000","last_became_active":"2024-09-21T07:10:51.463564+0000","last_became_peered":"2024-09-21T07:10:51.463564+0000","last_unstale":"2024-09-21T07:13:16.161324+0000","last_undegraded":"2024-09-21T07:13:16.161324+0000","last_fullsized":"2024-09-21T07:13:16.161324+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838602+0000","last_change":"2024-09-21T07:10:53.484379+0000","last_active":"2024-09-21T07:12:43.838602+0000","last_peered":"2024-09-21T07:12:43.838602+0000","last_clean":"2024-09-21T07:12:43.838602+0000","last_became_active":"2024-09-21T07:10:53.484005+0000","last_became_peered":"2024-09-21T07:10:53.484005+0000","last_unstale":"2024-09-21T07:12:43.838602+0000","last_undegraded":"2024-09-21T07:12:43.838602+0000","last_fullsized":"2024-09-21T07:12:43.838602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:27.665257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686808+0000","last_change":"2024-09-21T07:11:00.552729+0000","last_active":"2024-09-21T07:12:14.686808+0000","last_peered":"2024-09-21T07:12:14.686808+0000","last_clean":"2024-09-21T07:12:14.686808+0000","last_became_active":"2024-09-21T07:11:00.552196+0000","last_became_peered":"2024-09-21T07:11:00.552196+0000","last_unstale":"2024-09-21T07:12:14.686808+0000","last_undegraded":"2024-09-21T07:12:14.686808+0000","last_fullsized":"2024-09-21T07:12:14.686808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:35.942717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692173+0000","last_change":"2024-09-21T07:10:51.467798+0000","last_active":"2024-09-21T07:12:14.692173+0000","last_peered":"2024-09-21T07:12:14.692173+0000","last_clean":"2024-09-21T07:12:14.692173+0000","last_became_active":"2024-09-21T07:10:51.467314+0000","last_became_peered":"2024-09-21T07:10:51.467314+0000","last_unstale":"2024-09-21T07:12:14.692173+0000","last_undegraded":"2024-09-21T07:12:14.692173+0000","last_fullsized":"2024-09-21T07:12:14.692173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:21.944378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839226+0000","last_change":"2024-09-21T07:10:53.494849+0000","last_active":"2024-09-21T07:12:43.839226+0000","last_peered":"2024-09-21T07:12:43.839226+0000","last_clean":"2024-09-21T07:12:43.839226+0000","last_became_active":"2024-09-21T07:10:53.494478+0000","last_became_peered":"2024-09-21T07:10:53.494478+0000","last_unstale":"2024-09-21T07:12:43.839226+0000","last_undegraded":"2024-09-21T07:12:43.839226+0000","last_fullsized":"2024-09-21T07:12:43.839226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:38.383547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805630+0000","last_change":"2024-09-21T07:11:00.558306+0000","last_active":"2024-09-21T07:12:14.805630+0000","last_peered":"2024-09-21T07:12:14.805630+0000","last_clean":"2024-09-21T07:12:14.805630+0000","last_became_active":"2024-09-21T07:11:00.557814+0000","last_became_peered":"2024-09-21T07:11:00.557814+0000","last_unstale":"2024-09-21T07:12:14.805630+0000","last_undegraded":"2024-09-21T07:12:14.805630+0000","last_fullsized":"2024-09-21T07:12:14.805630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:31.401788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692968+0000","last_change":"2024-09-21T07:10:51.466831+0000","last_active":"2024-09-21T07:12:14.692968+0000","last_peered":"2024-09-21T07:12:14.692968+0000","last_clean":"2024-09-21T07:12:14.692968+0000","last_became_active":"2024-09-21T07:10:51.466381+0000","last_became_peered":"2024-09-21T07:10:51.466381+0000","last_unstale":"2024-09-21T07:12:14.692968+0000","last_undegraded":"2024-09-21T07:12:14.692968+0000","last_fullsized":"2024-09-21T07:12:14.692968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.559370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843453+0000","last_change":"2024-09-21T07:10:53.485920+0000","last_active":"2024-09-21T07:12:43.843453+0000","last_peered":"2024-09-21T07:12:43.843453+0000","last_clean":"2024-09-21T07:12:43.843453+0000","last_became_active":"2024-09-21T07:10:53.484689+0000","last_became_peered":"2024-09-21T07:10:53.484689+0000","last_unstale":"2024-09-21T07:12:43.843453+0000","last_undegraded":"2024-09-21T07:12:43.843453+0000","last_fullsized":"2024-09-21T07:12:43.843453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:59.951999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806409+0000","last_change":"2024-09-21T07:11:00.558298+0000","last_active":"2024-09-21T07:12:14.806409+0000","last_peered":"2024-09-21T07:12:14.806409+0000","last_clean":"2024-09-21T07:12:14.806409+0000","last_became_active":"2024-09-21T07:11:00.557738+0000","last_became_peered":"2024-09-21T07:11:00.557738+0000","last_unstale":"2024-09-21T07:12:14.806409+0000","last_undegraded":"2024-09-21T07:12:14.806409+0000","last_fullsized":"2024-09-21T07:12:14.806409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:03.037820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692968+0000","last_change":"2024-09-21T07:10:51.464283+0000","last_active":"2024-09-21T07:12:14.692968+0000","last_peered":"2024-09-21T07:12:14.692968+0000","last_clean":"2024-09-21T07:12:14.692968+0000","last_became_active":"2024-09-21T07:10:51.463783+0000","last_became_peered":"2024-09-21T07:10:51.463783+0000","last_unstale":"2024-09-21T07:12:14.692968+0000","last_undegraded":"2024-09-21T07:12:14.692968+0000","last_fullsized":"2024-09-21T07:12:14.692968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:45.298654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842942+0000","last_change":"2024-09-21T07:11:14.671020+0000","last_active":"2024-09-21T07:12:43.842942+0000","last_peered":"2024-09-21T07:12:43.842942+0000","last_clean":"2024-09-21T07:12:43.842942+0000","last_became_active":"2024-09-21T07:11:14.670573+0000","last_became_peered":"2024-09-21T07:11:14.670573+0000","last_unstale":"2024-09-21T07:12:43.842942+0000","last_undegraded":"2024-09-21T07:12:43.842942+0000","last_fullsized":"2024-09-21T07:12:43.842942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.926304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805803+0000","last_change":"2024-09-21T07:11:00.549015+0000","last_active":"2024-09-21T07:12:14.805803+0000","last_peered":"2024-09-21T07:12:14.805803+0000","last_clean":"2024-09-21T07:12:14.805803+0000","last_became_active":"2024-09-21T07:11:00.548561+0000","last_became_peered":"2024-09-21T07:11:00.548561+0000","last_unstale":"2024-09-21T07:12:14.805803+0000","last_undegraded":"2024-09-21T07:12:14.805803+0000","last_fullsized":"2024-09-21T07:12:14.805803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:08.386214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841440+0000","last_change":"2024-09-21T07:10:53.489382+0000","last_active":"2024-09-21T07:12:43.841440+0000","last_peered":"2024-09-21T07:12:43.841440+0000","last_clean":"2024-09-21T07:12:43.841440+0000","last_became_active":"2024-09-21T07:10:53.488987+0000","last_became_peered":"2024-09-21T07:10:53.488987+0000","last_unstale":"2024-09-21T07:12:43.841440+0000","last_undegraded":"2024-09-21T07:12:43.841440+0000","last_fullsized":"2024-09-21T07:12:43.841440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.334840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692508+0000","last_change":"2024-09-21T07:10:51.467203+0000","last_active":"2024-09-21T07:12:14.692508+0000","last_peered":"2024-09-21T07:12:14.692508+0000","last_clean":"2024-09-21T07:12:14.692508+0000","last_became_active":"2024-09-21T07:10:51.466737+0000","last_became_peered":"2024-09-21T07:10:51.466737+0000","last_unstale":"2024-09-21T07:12:14.692508+0000","last_undegraded":"2024-09-21T07:12:14.692508+0000","last_fullsized":"2024-09-21T07:12:14.692508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:26.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806191+0000","last_change":"2024-09-21T07:11:00.640801+0000","last_active":"2024-09-21T07:12:14.806191+0000","last_peered":"2024-09-21T07:12:14.806191+0000","last_clean":"2024-09-21T07:12:14.806191+0000","last_became_active":"2024-09-21T07:11:00.640213+0000","last_became_peered":"2024-09-21T07:11:00.640213+0000","last_unstale":"2024-09-21T07:12:14.806191+0000","last_undegraded":"2024-09-21T07:12:14.806191+0000","last_fullsized":"2024-09-21T07:12:14.806191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:55.801831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841160+0000","last_change":"2024-09-21T07:10:53.491166+0000","last_active":"2024-09-21T07:12:43.841160+0000","last_peered":"2024-09-21T07:12:43.841160+0000","last_clean":"2024-09-21T07:12:43.841160+0000","last_became_active":"2024-09-21T07:10:53.490823+0000","last_became_peered":"2024-09-21T07:10:53.490823+0000","last_unstale":"2024-09-21T07:12:43.841160+0000","last_undegraded":"2024-09-21T07:12:43.841160+0000","last_fullsized":"2024-09-21T07:12:43.841160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:48.661634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:02.728825+0000","last_change":"2024-09-21T07:10:51.461220+0000","last_active":"2024-09-21T07:13:02.728825+0000","last_peered":"2024-09-21T07:13:02.728825+0000","last_clean":"2024-09-21T07:13:02.728825+0000","last_became_active":"2024-09-21T07:10:51.460772+0000","last_became_peered":"2024-09-21T07:10:51.460772+0000","last_unstale":"2024-09-21T07:13:02.728825+0000","last_undegraded":"2024-09-21T07:13:02.728825+0000","last_fullsized":"2024-09-21T07:13:02.728825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:56.488273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806249+0000","last_change":"2024-09-21T07:11:00.558487+0000","last_active":"2024-09-21T07:12:14.806249+0000","last_peered":"2024-09-21T07:12:14.806249+0000","last_clean":"2024-09-21T07:12:14.806249+0000","last_became_active":"2024-09-21T07:11:00.557877+0000","last_became_peered":"2024-09-21T07:11:00.557877+0000","last_unstale":"2024-09-21T07:12:14.806249+0000","last_undegraded":"2024-09-21T07:12:14.806249+0000","last_fullsized":"2024-09-21T07:12:14.806249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:14.614603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840073+0000","last_change":"2024-09-21T07:10:53.489309+0000","last_active":"2024-09-21T07:12:43.840073+0000","last_peered":"2024-09-21T07:12:43.840073+0000","last_clean":"2024-09-21T07:12:43.840073+0000","last_became_active":"2024-09-21T07:10:53.488943+0000","last_became_peered":"2024-09-21T07:10:53.488943+0000","last_unstale":"2024-09-21T07:12:43.840073+0000","last_undegraded":"2024-09-21T07:12:43.840073+0000","last_fullsized":"2024-09-21T07:12:43.840073+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.797176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692071+0000","last_change":"2024-09-21T07:10:51.461078+0000","last_active":"2024-09-21T07:12:14.692071+0000","last_peered":"2024-09-21T07:12:14.692071+0000","last_clean":"2024-09-21T07:12:14.692071+0000","last_became_active":"2024-09-21T07:10:51.460759+0000","last_became_peered":"2024-09-21T07:10:51.460759+0000","last_unstale":"2024-09-21T07:12:14.692071+0000","last_undegraded":"2024-09-21T07:12:14.692071+0000","last_fullsized":"2024-09-21T07:12:14.692071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:37.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:11:00.554766+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:11:00.554374+0000","last_became_peered":"2024-09-21T07:11:00.554374+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:47.038411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825773+0000","last_change":"2024-09-21T07:10:53.487501+0000","last_active":"2024-09-21T07:12:43.825773+0000","last_peered":"2024-09-21T07:12:43.825773+0000","last_clean":"2024-09-21T07:12:43.825773+0000","last_became_active":"2024-09-21T07:10:53.487030+0000","last_became_peered":"2024-09-21T07:10:53.487030+0000","last_unstale":"2024-09-21T07:12:43.825773+0000","last_undegraded":"2024-09-21T07:12:43.825773+0000","last_fullsized":"2024-09-21T07:12:43.825773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692397+0000","last_change":"2024-09-21T07:10:51.468155+0000","last_active":"2024-09-21T07:12:14.692397+0000","last_peered":"2024-09-21T07:12:14.692397+0000","last_clean":"2024-09-21T07:12:14.692397+0000","last_became_active":"2024-09-21T07:10:51.467663+0000","last_became_peered":"2024-09-21T07:10:51.467663+0000","last_unstale":"2024-09-21T07:12:14.692397+0000","last_undegraded":"2024-09-21T07:12:14.692397+0000","last_fullsized":"2024-09-21T07:12:14.692397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:18.176519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806311+0000","last_change":"2024-09-21T07:11:00.641283+0000","last_active":"2024-09-21T07:12:14.806311+0000","last_peered":"2024-09-21T07:12:14.806311+0000","last_clean":"2024-09-21T07:12:14.806311+0000","last_became_active":"2024-09-21T07:11:00.640715+0000","last_became_peered":"2024-09-21T07:11:00.640715+0000","last_unstale":"2024-09-21T07:12:14.806311+0000","last_undegraded":"2024-09-21T07:12:14.806311+0000","last_fullsized":"2024-09-21T07:12:14.806311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:26.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842481+0000","last_change":"2024-09-21T07:11:14.656686+0000","last_active":"2024-09-21T07:12:43.842481+0000","last_peered":"2024-09-21T07:12:43.842481+0000","last_clean":"2024-09-21T07:12:43.842481+0000","last_became_active":"2024-09-21T07:11:14.656259+0000","last_became_peered":"2024-09-21T07:11:14.656259+0000","last_unstale":"2024-09-21T07:12:43.842481+0000","last_undegraded":"2024-09-21T07:12:43.842481+0000","last_fullsized":"2024-09-21T07:12:43.842481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:16.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806776+0000","last_change":"2024-09-21T07:10:52.123260+0000","last_active":"2024-09-21T07:12:14.806776+0000","last_peered":"2024-09-21T07:12:14.806776+0000","last_clean":"2024-09-21T07:12:14.806776+0000","last_became_active":"2024-09-21T07:10:52.122752+0000","last_became_peered":"2024-09-21T07:10:52.122752+0000","last_unstale":"2024-09-21T07:12:14.806776+0000","last_undegraded":"2024-09-21T07:12:14.806776+0000","last_fullsized":"2024-09-21T07:12:14.806776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.041434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686989+0000","last_change":"2024-09-21T07:11:00.549599+0000","last_active":"2024-09-21T07:12:14.686989+0000","last_peered":"2024-09-21T07:12:14.686989+0000","last_clean":"2024-09-21T07:12:14.686989+0000","last_became_active":"2024-09-21T07:11:00.549112+0000","last_became_peered":"2024-09-21T07:11:00.549112+0000","last_unstale":"2024-09-21T07:12:14.686989+0000","last_undegraded":"2024-09-21T07:12:14.686989+0000","last_fullsized":"2024-09-21T07:12:14.686989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:15.209889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.828092+0000","last_change":"2024-09-21T07:10:53.487792+0000","last_active":"2024-09-21T07:12:43.828092+0000","last_peered":"2024-09-21T07:12:43.828092+0000","last_clean":"2024-09-21T07:12:43.828092+0000","last_became_active":"2024-09-21T07:10:53.487460+0000","last_became_peered":"2024-09-21T07:10:53.487460+0000","last_unstale":"2024-09-21T07:12:43.828092+0000","last_undegraded":"2024-09-21T07:12:43.828092+0000","last_fullsized":"2024-09-21T07:12:43.828092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:26.329878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'17","reported_seq":74,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:02.651907+0000","last_change":"2024-09-21T07:12:14.699788+0000","last_active":"2024-09-21T07:13:02.651907+0000","last_peered":"2024-09-21T07:13:02.651907+0000","last_clean":"2024-09-21T07:13:02.651907+0000","last_became_active":"2024-09-21T07:12:14.693355+0000","last_became_peered":"2024-09-21T07:12:14.693355+0000","last_unstale":"2024-09-21T07:13:02.651907+0000","last_undegraded":"2024-09-21T07:13:02.651907+0000","last_fullsized":"2024-09-21T07:13:02.651907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:44.104210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691224+0000","last_change":"2024-09-21T07:11:00.640604+0000","last_active":"2024-09-21T07:12:14.691224+0000","last_peered":"2024-09-21T07:12:14.691224+0000","last_clean":"2024-09-21T07:12:14.691224+0000","last_became_active":"2024-09-21T07:11:00.640047+0000","last_became_peered":"2024-09-21T07:11:00.640047+0000","last_unstale":"2024-09-21T07:12:14.691224+0000","last_undegraded":"2024-09-21T07:12:14.691224+0000","last_fullsized":"2024-09-21T07:12:14.691224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:42.640908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834870+0000","last_change":"2024-09-21T07:10:53.473862+0000","last_active":"2024-09-21T07:12:43.834870+0000","last_peered":"2024-09-21T07:12:43.834870+0000","last_clean":"2024-09-21T07:12:43.834870+0000","last_became_active":"2024-09-21T07:10:53.473526+0000","last_became_peered":"2024-09-21T07:10:53.473526+0000","last_unstale":"2024-09-21T07:12:43.834870+0000","last_undegraded":"2024-09-21T07:12:43.834870+0000","last_fullsized":"2024-09-21T07:12:43.834870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.389566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693155+0000","last_change":"2024-09-21T07:10:51.468003+0000","last_active":"2024-09-21T07:12:14.693155+0000","last_peered":"2024-09-21T07:12:14.693155+0000","last_clean":"2024-09-21T07:12:14.693155+0000","last_became_active":"2024-09-21T07:10:51.467603+0000","last_became_peered":"2024-09-21T07:10:51.467603+0000","last_unstale":"2024-09-21T07:12:14.693155+0000","last_undegraded":"2024-09-21T07:12:14.693155+0000","last_fullsized":"2024-09-21T07:12:14.693155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:02.148721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690206+0000","last_change":"2024-09-21T07:11:00.550434+0000","last_active":"2024-09-21T07:12:14.690206+0000","last_peered":"2024-09-21T07:12:14.690206+0000","last_clean":"2024-09-21T07:12:14.690206+0000","last_became_active":"2024-09-21T07:11:00.549949+0000","last_became_peered":"2024-09-21T07:11:00.549949+0000","last_unstale":"2024-09-21T07:12:14.690206+0000","last_undegraded":"2024-09-21T07:12:14.690206+0000","last_fullsized":"2024-09-21T07:12:14.690206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:53.737978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839518+0000","last_change":"2024-09-21T07:12:14.690832+0000","last_active":"2024-09-21T07:12:43.839518+0000","last_peered":"2024-09-21T07:12:43.839518+0000","last_clean":"2024-09-21T07:12:43.839518+0000","last_became_active":"2024-09-21T07:12:14.690361+0000","last_became_peered":"2024-09-21T07:12:14.690361+0000","last_unstale":"2024-09-21T07:12:43.839518+0000","last_undegraded":"2024-09-21T07:12:43.839518+0000","last_fullsized":"2024-09-21T07:12:43.839518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:00.772213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:10:51.468201+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:10:51.467754+0000","last_became_peered":"2024-09-21T07:10:51.467754+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:52.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692198+0000","last_change":"2024-09-21T07:11:00.640653+0000","last_active":"2024-09-21T07:12:14.692198+0000","last_peered":"2024-09-21T07:12:14.692198+0000","last_clean":"2024-09-21T07:12:14.692198+0000","last_became_active":"2024-09-21T07:11:00.640080+0000","last_became_peered":"2024-09-21T07:11:00.640080+0000","last_unstale":"2024-09-21T07:12:14.692198+0000","last_undegraded":"2024-09-21T07:12:14.692198+0000","last_fullsized":"2024-09-21T07:12:14.692198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:24.124088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840328+0000","last_change":"2024-09-21T07:10:53.494222+0000","last_active":"2024-09-21T07:12:43.840328+0000","last_peered":"2024-09-21T07:12:43.840328+0000","last_clean":"2024-09-21T07:12:43.840328+0000","last_became_active":"2024-09-21T07:10:53.493703+0000","last_became_peered":"2024-09-21T07:10:53.493703+0000","last_unstale":"2024-09-21T07:12:43.840328+0000","last_undegraded":"2024-09-21T07:12:43.840328+0000","last_fullsized":"2024-09-21T07:12:43.840328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:21.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:17.897550+0000","last_change":"2024-09-21T07:10:51.461095+0000","last_active":"2024-09-21T07:13:17.897550+0000","last_peered":"2024-09-21T07:13:17.897550+0000","last_clean":"2024-09-21T07:13:17.897550+0000","last_became_active":"2024-09-21T07:10:51.460738+0000","last_became_peered":"2024-09-21T07:10:51.460738+0000","last_unstale":"2024-09-21T07:13:17.897550+0000","last_undegraded":"2024-09-21T07:13:17.897550+0000","last_fullsized":"2024-09-21T07:13:17.897550+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:55.593391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686398+0000","last_change":"2024-09-21T07:11:00.544788+0000","last_active":"2024-09-21T07:12:14.686398+0000","last_peered":"2024-09-21T07:12:14.686398+0000","last_clean":"2024-09-21T07:12:14.686398+0000","last_became_active":"2024-09-21T07:11:00.544370+0000","last_became_peered":"2024-09-21T07:11:00.544370+0000","last_unstale":"2024-09-21T07:12:14.686398+0000","last_undegraded":"2024-09-21T07:12:14.686398+0000","last_fullsized":"2024-09-21T07:12:14.686398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.154867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839305+0000","last_change":"2024-09-21T07:10:53.486715+0000","last_active":"2024-09-21T07:12:43.839305+0000","last_peered":"2024-09-21T07:12:43.839305+0000","last_clean":"2024-09-21T07:12:43.839305+0000","last_became_active":"2024-09-21T07:10:53.486315+0000","last_became_peered":"2024-09-21T07:10:53.486315+0000","last_unstale":"2024-09-21T07:12:43.839305+0000","last_undegraded":"2024-09-21T07:12:43.839305+0000","last_fullsized":"2024-09-21T07:12:43.839305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:00.124269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'7","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:19.899057+0000","last_change":"2024-09-21T07:10:51.467102+0000","last_active":"2024-09-21T07:13:19.899057+0000","last_peered":"2024-09-21T07:13:19.899057+0000","last_clean":"2024-09-21T07:13:19.899057+0000","last_became_active":"2024-09-21T07:10:51.466721+0000","last_became_peered":"2024-09-21T07:10:51.466721+0000","last_unstale":"2024-09-21T07:13:19.899057+0000","last_undegraded":"2024-09-21T07:13:19.899057+0000","last_fullsized":"2024-09-21T07:13:19.899057+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686198+0000","last_change":"2024-09-21T07:11:00.640622+0000","last_active":"2024-09-21T07:12:14.686198+0000","last_peered":"2024-09-21T07:12:14.686198+0000","last_clean":"2024-09-21T07:12:14.686198+0000","last_became_active":"2024-09-21T07:11:00.640104+0000","last_became_peered":"2024-09-21T07:11:00.640104+0000","last_unstale":"2024-09-21T07:12:14.686198+0000","last_undegraded":"2024-09-21T07:12:14.686198+0000","last_fullsized":"2024-09-21T07:12:14.686198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:12.023561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825104+0000","last_change":"2024-09-21T07:10:53.478175+0000","last_active":"2024-09-21T07:12:43.825104+0000","last_peered":"2024-09-21T07:12:43.825104+0000","last_clean":"2024-09-21T07:12:43.825104+0000","last_became_active":"2024-09-21T07:10:53.477831+0000","last_became_peered":"2024-09-21T07:10:53.477831+0000","last_unstale":"2024-09-21T07:12:43.825104+0000","last_undegraded":"2024-09-21T07:12:43.825104+0000","last_fullsized":"2024-09-21T07:12:43.825104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:27.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689665+0000","last_change":"2024-09-21T07:10:51.466318+0000","last_active":"2024-09-21T07:12:14.689665+0000","last_peered":"2024-09-21T07:12:14.689665+0000","last_clean":"2024-09-21T07:12:14.689665+0000","last_became_active":"2024-09-21T07:10:51.465983+0000","last_became_peered":"2024-09-21T07:10:51.465983+0000","last_unstale":"2024-09-21T07:12:14.689665+0000","last_undegraded":"2024-09-21T07:12:14.689665+0000","last_fullsized":"2024-09-21T07:12:14.689665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:08.432949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691834+0000","last_change":"2024-09-21T07:11:00.641364+0000","last_active":"2024-09-21T07:12:14.691834+0000","last_peered":"2024-09-21T07:12:14.691834+0000","last_clean":"2024-09-21T07:12:14.691834+0000","last_became_active":"2024-09-21T07:11:00.640879+0000","last_became_peered":"2024-09-21T07:11:00.640879+0000","last_unstale":"2024-09-21T07:12:14.691834+0000","last_undegraded":"2024-09-21T07:12:14.691834+0000","last_fullsized":"2024-09-21T07:12:14.691834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:16.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825148+0000","last_change":"2024-09-21T07:10:53.483709+0000","last_active":"2024-09-21T07:12:43.825148+0000","last_peered":"2024-09-21T07:12:43.825148+0000","last_clean":"2024-09-21T07:12:43.825148+0000","last_became_active":"2024-09-21T07:10:53.483355+0000","last_became_peered":"2024-09-21T07:10:53.483355+0000","last_unstale":"2024-09-21T07:12:43.825148+0000","last_undegraded":"2024-09-21T07:12:43.825148+0000","last_fullsized":"2024-09-21T07:12:43.825148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.702168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806593+0000","last_change":"2024-09-21T07:10:51.464239+0000","last_active":"2024-09-21T07:12:14.806593+0000","last_peered":"2024-09-21T07:12:14.806593+0000","last_clean":"2024-09-21T07:12:14.806593+0000","last_became_active":"2024-09-21T07:10:51.463828+0000","last_became_peered":"2024-09-21T07:10:51.463828+0000","last_unstale":"2024-09-21T07:12:14.806593+0000","last_undegraded":"2024-09-21T07:12:14.806593+0000","last_fullsized":"2024-09-21T07:12:14.806593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:09.580668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690229+0000","last_change":"2024-09-21T07:09:39.332523+0000","last_active":"2024-09-21T07:12:14.690229+0000","last_peered":"2024-09-21T07:12:14.690229+0000","last_clean":"2024-09-21T07:12:14.690229+0000","last_became_active":"2024-09-21T07:09:39.326582+0000","last_became_peered":"2024-09-21T07:09:39.326582+0000","last_unstale":"2024-09-21T07:12:14.690229+0000","last_undegraded":"2024-09-21T07:12:14.690229+0000","last_fullsized":"2024-09-21T07:12:14.690229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_clean_scrub_stamp":"2024-09-21T07:06:12.748818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690079+0000","last_change":"2024-09-21T07:11:14.672044+0000","last_active":"2024-09-21T07:12:14.690079+0000","last_peered":"2024-09-21T07:12:14.690079+0000","last_clean":"2024-09-21T07:12:14.690079+0000","last_became_active":"2024-09-21T07:11:14.671513+0000","last_became_peered":"2024-09-21T07:11:14.671513+0000","last_unstale":"2024-09-21T07:12:14.690079+0000","last_undegraded":"2024-09-21T07:12:14.690079+0000","last_fullsized":"2024-09-21T07:12:14.690079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:09.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842250+0000","last_change":"2024-09-21T07:10:53.488678+0000","last_active":"2024-09-21T07:12:43.842250+0000","last_peered":"2024-09-21T07:12:43.842250+0000","last_clean":"2024-09-21T07:12:43.842250+0000","last_became_active":"2024-09-21T07:10:53.488304+0000","last_became_peered":"2024-09-21T07:10:53.488304+0000","last_unstale":"2024-09-21T07:12:43.842250+0000","last_undegraded":"2024-09-21T07:12:43.842250+0000","last_fullsized":"2024-09-21T07:12:43.842250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:37.696269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.897310+0000","last_change":"2024-09-21T07:10:52.123086+0000","last_active":"2024-09-21T07:13:16.897310+0000","last_peered":"2024-09-21T07:13:16.897310+0000","last_clean":"2024-09-21T07:13:16.897310+0000","last_became_active":"2024-09-21T07:10:52.122584+0000","last_became_peered":"2024-09-21T07:10:52.122584+0000","last_unstale":"2024-09-21T07:13:16.897310+0000","last_undegraded":"2024-09-21T07:13:16.897310+0000","last_fullsized":"2024-09-21T07:13:16.897310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:28.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692332+0000","last_change":"2024-09-21T07:11:00.549595+0000","last_active":"2024-09-21T07:12:14.692332+0000","last_peered":"2024-09-21T07:12:14.692332+0000","last_clean":"2024-09-21T07:12:14.692332+0000","last_became_active":"2024-09-21T07:11:00.549009+0000","last_became_peered":"2024-09-21T07:11:00.549009+0000","last_unstale":"2024-09-21T07:12:14.692332+0000","last_undegraded":"2024-09-21T07:12:14.692332+0000","last_fullsized":"2024-09-21T07:12:14.692332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:59.825381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836215+0000","last_change":"2024-09-21T07:10:53.484336+0000","last_active":"2024-09-21T07:12:43.836215+0000","last_peered":"2024-09-21T07:12:43.836215+0000","last_clean":"2024-09-21T07:12:43.836215+0000","last_became_active":"2024-09-21T07:10:53.483825+0000","last_became_peered":"2024-09-21T07:10:53.483825+0000","last_unstale":"2024-09-21T07:12:43.836215+0000","last_undegraded":"2024-09-21T07:12:43.836215+0000","last_fullsized":"2024-09-21T07:12:43.836215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.545339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691375+0000","last_change":"2024-09-21T07:10:51.461297+0000","last_active":"2024-09-21T07:12:14.691375+0000","last_peered":"2024-09-21T07:12:14.691375+0000","last_clean":"2024-09-21T07:12:14.691375+0000","last_became_active":"2024-09-21T07:10:51.460600+0000","last_became_peered":"2024-09-21T07:10:51.460600+0000","last_unstale":"2024-09-21T07:12:14.691375+0000","last_undegraded":"2024-09-21T07:12:14.691375+0000","last_fullsized":"2024-09-21T07:12:14.691375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:34.955250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998589+0000","last_change":"2024-09-21T07:11:00.551652+0000","last_active":"2024-09-21T07:12:14.998589+0000","last_peered":"2024-09-21T07:12:14.998589+0000","last_clean":"2024-09-21T07:12:14.998589+0000","last_became_active":"2024-09-21T07:11:00.551236+0000","last_became_peered":"2024-09-21T07:11:00.551236+0000","last_unstale":"2024-09-21T07:12:14.998589+0000","last_undegraded":"2024-09-21T07:12:14.998589+0000","last_fullsized":"2024-09-21T07:12:14.998589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:28.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833526+0000","last_change":"2024-09-21T07:10:53.487605+0000","last_active":"2024-09-21T07:12:43.833526+0000","last_peered":"2024-09-21T07:12:43.833526+0000","last_clean":"2024-09-21T07:12:43.833526+0000","last_became_active":"2024-09-21T07:10:53.487245+0000","last_became_peered":"2024-09-21T07:10:53.487245+0000","last_unstale":"2024-09-21T07:12:43.833526+0000","last_undegraded":"2024-09-21T07:12:43.833526+0000","last_fullsized":"2024-09-21T07:12:43.833526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:24.490652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686405+0000","last_change":"2024-09-21T07:10:51.456920+0000","last_active":"2024-09-21T07:12:14.686405+0000","last_peered":"2024-09-21T07:12:14.686405+0000","last_clean":"2024-09-21T07:12:14.686405+0000","last_became_active":"2024-09-21T07:10:51.456500+0000","last_became_peered":"2024-09-21T07:10:51.456500+0000","last_unstale":"2024-09-21T07:12:14.686405+0000","last_undegraded":"2024-09-21T07:12:14.686405+0000","last_fullsized":"2024-09-21T07:12:14.686405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:07.663192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690452+0000","last_change":"2024-09-21T07:11:00.552115+0000","last_active":"2024-09-21T07:12:14.690452+0000","last_peered":"2024-09-21T07:12:14.690452+0000","last_clean":"2024-09-21T07:12:14.690452+0000","last_became_active":"2024-09-21T07:11:00.551647+0000","last_became_peered":"2024-09-21T07:11:00.551647+0000","last_unstale":"2024-09-21T07:12:14.690452+0000","last_undegraded":"2024-09-21T07:12:14.690452+0000","last_fullsized":"2024-09-21T07:12:14.690452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:13.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834739+0000","last_change":"2024-09-21T07:11:14.671714+0000","last_active":"2024-09-21T07:12:43.834739+0000","last_peered":"2024-09-21T07:12:43.834739+0000","last_clean":"2024-09-21T07:12:43.834739+0000","last_became_active":"2024-09-21T07:11:14.671248+0000","last_became_peered":"2024-09-21T07:11:14.671248+0000","last_unstale":"2024-09-21T07:12:43.834739+0000","last_undegraded":"2024-09-21T07:12:43.834739+0000","last_fullsized":"2024-09-21T07:12:43.834739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:36.599916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:06.740009+0000","last_change":"2024-09-21T07:10:51.464710+0000","last_active":"2024-09-21T07:13:06.740009+0000","last_peered":"2024-09-21T07:13:06.740009+0000","last_clean":"2024-09-21T07:13:06.740009+0000","last_became_active":"2024-09-21T07:10:51.464295+0000","last_became_peered":"2024-09-21T07:10:51.464295+0000","last_unstale":"2024-09-21T07:13:06.740009+0000","last_undegraded":"2024-09-21T07:13:06.740009+0000","last_fullsized":"2024-09-21T07:13:06.740009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:00.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691150+0000","last_change":"2024-09-21T07:11:00.548275+0000","last_active":"2024-09-21T07:12:14.691150+0000","last_peered":"2024-09-21T07:12:14.691150+0000","last_clean":"2024-09-21T07:12:14.691150+0000","last_became_active":"2024-09-21T07:11:00.547777+0000","last_became_peered":"2024-09-21T07:11:00.547777+0000","last_unstale":"2024-09-21T07:12:14.691150+0000","last_undegraded":"2024-09-21T07:12:14.691150+0000","last_fullsized":"2024-09-21T07:12:14.691150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:13.860131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840327+0000","last_change":"2024-09-21T07:10:53.494072+0000","last_active":"2024-09-21T07:12:43.840327+0000","last_peered":"2024-09-21T07:12:43.840327+0000","last_clean":"2024-09-21T07:12:43.840327+0000","last_became_active":"2024-09-21T07:10:53.493493+0000","last_became_peered":"2024-09-21T07:10:53.493493+0000","last_unstale":"2024-09-21T07:12:43.840327+0000","last_undegraded":"2024-09-21T07:12:43.840327+0000","last_fullsized":"2024-09-21T07:12:43.840327+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.846641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":58,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692149+0000","last_change":"2024-09-21T07:10:51.468145+0000","last_active":"2024-09-21T07:12:14.692149+0000","last_peered":"2024-09-21T07:12:14.692149+0000","last_clean":"2024-09-21T07:12:14.692149+0000","last_became_active":"2024-09-21T07:10:51.467757+0000","last_became_peered":"2024-09-21T07:10:51.467757+0000","last_unstale":"2024-09-21T07:12:14.692149+0000","last_undegraded":"2024-09-21T07:12:14.692149+0000","last_fullsized":"2024-09-21T07:12:14.692149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:39.150277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686223+0000","last_change":"2024-09-21T07:11:00.548394+0000","last_active":"2024-09-21T07:12:14.686223+0000","last_peered":"2024-09-21T07:12:14.686223+0000","last_clean":"2024-09-21T07:12:14.686223+0000","last_became_active":"2024-09-21T07:11:00.547972+0000","last_became_peered":"2024-09-21T07:11:00.547972+0000","last_unstale":"2024-09-21T07:12:14.686223+0000","last_undegraded":"2024-09-21T07:12:14.686223+0000","last_fullsized":"2024-09-21T07:12:14.686223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:35.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.819250+0000","last_change":"2024-09-21T07:11:14.659248+0000","last_active":"2024-09-21T07:12:43.819250+0000","last_peered":"2024-09-21T07:12:43.819250+0000","last_clean":"2024-09-21T07:12:43.819250+0000","last_became_active":"2024-09-21T07:11:14.658931+0000","last_became_peered":"2024-09-21T07:11:14.658931+0000","last_unstale":"2024-09-21T07:12:43.819250+0000","last_undegraded":"2024-09-21T07:12:43.819250+0000","last_fullsized":"2024-09-21T07:12:43.819250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:12.278964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'9","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:18.898289+0000","last_change":"2024-09-21T07:10:51.466302+0000","last_active":"2024-09-21T07:13:18.898289+0000","last_peered":"2024-09-21T07:13:18.898289+0000","last_clean":"2024-09-21T07:13:18.898289+0000","last_became_active":"2024-09-21T07:10:51.465906+0000","last_became_peered":"2024-09-21T07:10:51.465906+0000","last_unstale":"2024-09-21T07:13:18.898289+0000","last_undegraded":"2024-09-21T07:13:18.898289+0000","last_fullsized":"2024-09-21T07:13:18.898289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:39.616338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689493+0000","last_change":"2024-09-21T07:11:00.555600+0000","last_active":"2024-09-21T07:12:14.689493+0000","last_peered":"2024-09-21T07:12:14.689493+0000","last_clean":"2024-09-21T07:12:14.689493+0000","last_became_active":"2024-09-21T07:11:00.555203+0000","last_became_peered":"2024-09-21T07:11:00.555203+0000","last_unstale":"2024-09-21T07:12:14.689493+0000","last_undegraded":"2024-09-21T07:12:14.689493+0000","last_fullsized":"2024-09-21T07:12:14.689493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838290+0000","last_change":"2024-09-21T07:10:53.482493+0000","last_active":"2024-09-21T07:12:43.838290+0000","last_peered":"2024-09-21T07:12:43.838290+0000","last_clean":"2024-09-21T07:12:43.838290+0000","last_became_active":"2024-09-21T07:10:53.481310+0000","last_became_peered":"2024-09-21T07:10:53.481310+0000","last_unstale":"2024-09-21T07:12:43.838290+0000","last_undegraded":"2024-09-21T07:12:43.838290+0000","last_fullsized":"2024-09-21T07:12:43.838290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:41.288008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691304+0000","last_change":"2024-09-21T07:10:51.468189+0000","last_active":"2024-09-21T07:12:14.691304+0000","last_peered":"2024-09-21T07:12:14.691304+0000","last_clean":"2024-09-21T07:12:14.691304+0000","last_became_active":"2024-09-21T07:10:51.467770+0000","last_became_peered":"2024-09-21T07:10:51.467770+0000","last_unstale":"2024-09-21T07:12:14.691304+0000","last_undegraded":"2024-09-21T07:12:14.691304+0000","last_fullsized":"2024-09-21T07:12:14.691304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:53.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689286+0000","last_change":"2024-09-21T07:11:00.556306+0000","last_active":"2024-09-21T07:12:14.689286+0000","last_peered":"2024-09-21T07:12:14.689286+0000","last_clean":"2024-09-21T07:12:14.689286+0000","last_became_active":"2024-09-21T07:11:00.555770+0000","last_became_peered":"2024-09-21T07:11:00.555770+0000","last_unstale":"2024-09-21T07:12:14.689286+0000","last_undegraded":"2024-09-21T07:12:14.689286+0000","last_fullsized":"2024-09-21T07:12:14.689286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:19.438869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839202+0000","last_change":"2024-09-21T07:10:53.485039+0000","last_active":"2024-09-21T07:12:43.839202+0000","last_peered":"2024-09-21T07:12:43.839202+0000","last_clean":"2024-09-21T07:12:43.839202+0000","last_became_active":"2024-09-21T07:10:53.484672+0000","last_became_peered":"2024-09-21T07:10:53.484672+0000","last_unstale":"2024-09-21T07:12:43.839202+0000","last_undegraded":"2024-09-21T07:12:43.839202+0000","last_fullsized":"2024-09-21T07:12:43.839202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:28.291602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.709692+0000","last_change":"2024-09-21T07:12:14.709213+0000","last_active":"2024-09-21T07:12:14.709692+0000","last_peered":"2024-09-21T07:12:14.709692+0000","last_clean":"2024-09-21T07:12:14.709692+0000","last_became_active":"2024-09-21T07:12:14.693406+0000","last_became_peered":"2024-09-21T07:12:14.693406+0000","last_unstale":"2024-09-21T07:12:14.709692+0000","last_undegraded":"2024-09-21T07:12:14.709692+0000","last_fullsized":"2024-09-21T07:12:14.709692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:25.204575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687428+0000","last_change":"2024-09-21T07:11:14.672269+0000","last_active":"2024-09-21T07:12:14.687428+0000","last_peered":"2024-09-21T07:12:14.687428+0000","last_clean":"2024-09-21T07:12:14.687428+0000","last_became_active":"2024-09-21T07:11:14.671740+0000","last_became_peered":"2024-09-21T07:11:14.671740+0000","last_unstale":"2024-09-21T07:12:14.687428+0000","last_undegraded":"2024-09-21T07:12:14.687428+0000","last_fullsized":"2024-09-21T07:12:14.687428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.600585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831504+0000","last_change":"2024-09-21T07:10:53.487667+0000","last_active":"2024-09-21T07:12:43.831504+0000","last_peered":"2024-09-21T07:12:43.831504+0000","last_clean":"2024-09-21T07:12:43.831504+0000","last_became_active":"2024-09-21T07:10:53.487316+0000","last_became_peered":"2024-09-21T07:10:53.487316+0000","last_unstale":"2024-09-21T07:12:43.831504+0000","last_undegraded":"2024-09-21T07:12:43.831504+0000","last_fullsized":"2024-09-21T07:12:43.831504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:33.545631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'39","reported_seq":297,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.897154+0000","last_change":"2024-09-21T07:10:51.465172+0000","last_active":"2024-09-21T07:13:16.897154+0000","last_peered":"2024-09-21T07:13:16.897154+0000","last_clean":"2024-09-21T07:13:16.897154+0000","last_became_active":"2024-09-21T07:10:51.464655+0000","last_became_peered":"2024-09-21T07:10:51.464655+0000","last_unstale":"2024-09-21T07:13:16.897154+0000","last_undegraded":"2024-09-21T07:13:16.897154+0000","last_fullsized":"2024-09-21T07:13:16.897154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:02.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66954,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":176,"num_write":41,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686973+0000","last_change":"2024-09-21T07:11:14.671892+0000","last_active":"2024-09-21T07:12:14.686973+0000","last_peered":"2024-09-21T07:12:14.686973+0000","last_clean":"2024-09-21T07:12:14.686973+0000","last_became_active":"2024-09-21T07:11:14.671283+0000","last_became_peered":"2024-09-21T07:11:14.671283+0000","last_unstale":"2024-09-21T07:12:14.686973+0000","last_undegraded":"2024-09-21T07:12:14.686973+0000","last_fullsized":"2024-09-21T07:12:14.686973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:54.263127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839267+0000","last_change":"2024-09-21T07:10:53.491873+0000","last_active":"2024-09-21T07:12:43.839267+0000","last_peered":"2024-09-21T07:12:43.839267+0000","last_clean":"2024-09-21T07:12:43.839267+0000","last_became_active":"2024-09-21T07:10:53.491424+0000","last_became_peered":"2024-09-21T07:10:53.491424+0000","last_unstale":"2024-09-21T07:12:43.839267+0000","last_undegraded":"2024-09-21T07:12:43.839267+0000","last_fullsized":"2024-09-21T07:12:43.839267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.145391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691247+0000","last_change":"2024-09-21T07:10:51.469395+0000","last_active":"2024-09-21T07:12:14.691247+0000","last_peered":"2024-09-21T07:12:14.691247+0000","last_clean":"2024-09-21T07:12:14.691247+0000","last_became_active":"2024-09-21T07:10:51.469015+0000","last_became_peered":"2024-09-21T07:10:51.469015+0000","last_unstale":"2024-09-21T07:12:14.691247+0000","last_undegraded":"2024-09-21T07:12:14.691247+0000","last_fullsized":"2024-09-21T07:12:14.691247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.274950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806037+0000","last_change":"2024-09-21T07:11:00.553164+0000","last_active":"2024-09-21T07:12:14.806037+0000","last_peered":"2024-09-21T07:12:14.806037+0000","last_clean":"2024-09-21T07:12:14.806037+0000","last_became_active":"2024-09-21T07:11:00.551969+0000","last_became_peered":"2024-09-21T07:11:00.551969+0000","last_unstale":"2024-09-21T07:12:14.806037+0000","last_undegraded":"2024-09-21T07:12:14.806037+0000","last_fullsized":"2024-09-21T07:12:14.806037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:53.042065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841473+0000","last_change":"2024-09-21T07:10:53.497110+0000","last_active":"2024-09-21T07:12:43.841473+0000","last_peered":"2024-09-21T07:12:43.841473+0000","last_clean":"2024-09-21T07:12:43.841473+0000","last_became_active":"2024-09-21T07:10:53.496751+0000","last_became_peered":"2024-09-21T07:10:53.496751+0000","last_unstale":"2024-09-21T07:12:43.841473+0000","last_undegraded":"2024-09-21T07:12:43.841473+0000","last_fullsized":"2024-09-21T07:12:43.841473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.531652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.812563+0000","last_change":"2024-09-21T07:12:14.811962+0000","last_active":"2024-09-21T07:12:14.812563+0000","last_peered":"2024-09-21T07:12:14.812563+0000","last_clean":"2024-09-21T07:12:14.812563+0000","last_became_active":"2024-09-21T07:12:14.807745+0000","last_became_peered":"2024-09-21T07:12:14.807745+0000","last_unstale":"2024-09-21T07:12:14.812563+0000","last_undegraded":"2024-09-21T07:12:14.812563+0000","last_fullsized":"2024-09-21T07:12:14.812563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:20.292633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691946+0000","last_change":"2024-09-21T07:11:14.655255+0000","last_active":"2024-09-21T07:12:14.691946+0000","last_peered":"2024-09-21T07:12:14.691946+0000","last_clean":"2024-09-21T07:12:14.691946+0000","last_became_active":"2024-09-21T07:11:14.654556+0000","last_became_peered":"2024-09-21T07:11:14.654556+0000","last_unstale":"2024-09-21T07:12:14.691946+0000","last_undegraded":"2024-09-21T07:12:14.691946+0000","last_fullsized":"2024-09-21T07:12:14.691946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:44.435834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843700+0000","last_change":"2024-09-21T07:10:53.484990+0000","last_active":"2024-09-21T07:12:43.843700+0000","last_peered":"2024-09-21T07:12:43.843700+0000","last_clean":"2024-09-21T07:12:43.843700+0000","last_became_active":"2024-09-21T07:10:53.484570+0000","last_became_peered":"2024-09-21T07:10:53.484570+0000","last_unstale":"2024-09-21T07:12:43.843700+0000","last_undegraded":"2024-09-21T07:12:43.843700+0000","last_fullsized":"2024-09-21T07:12:43.843700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:28.848203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":254,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.896951+0000","last_change":"2024-09-21T07:10:51.463378+0000","last_active":"2024-09-21T07:13:16.896951+0000","last_peered":"2024-09-21T07:13:16.896951+0000","last_clean":"2024-09-21T07:13:16.896951+0000","last_became_active":"2024-09-21T07:10:51.462961+0000","last_became_peered":"2024-09-21T07:10:51.462961+0000","last_unstale":"2024-09-21T07:13:16.896951+0000","last_undegraded":"2024-09-21T07:13:16.896951+0000","last_fullsized":"2024-09-21T07:13:16.896951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:22.637603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691338+0000","last_change":"2024-09-21T07:11:00.549758+0000","last_active":"2024-09-21T07:12:14.691338+0000","last_peered":"2024-09-21T07:12:14.691338+0000","last_clean":"2024-09-21T07:12:14.691338+0000","last_became_active":"2024-09-21T07:11:00.549141+0000","last_became_peered":"2024-09-21T07:11:00.549141+0000","last_unstale":"2024-09-21T07:12:14.691338+0000","last_undegraded":"2024-09-21T07:12:14.691338+0000","last_fullsized":"2024-09-21T07:12:14.691338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:27.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998447+0000","last_change":"2024-09-21T07:11:00.550407+0000","last_active":"2024-09-21T07:12:14.998447+0000","last_peered":"2024-09-21T07:12:14.998447+0000","last_clean":"2024-09-21T07:12:14.998447+0000","last_became_active":"2024-09-21T07:11:00.549930+0000","last_became_peered":"2024-09-21T07:11:00.549930+0000","last_unstale":"2024-09-21T07:12:14.998447+0000","last_undegraded":"2024-09-21T07:12:14.998447+0000","last_fullsized":"2024-09-21T07:12:14.998447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:25.924695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841002+0000","last_change":"2024-09-21T07:10:53.491452+0000","last_active":"2024-09-21T07:12:43.841002+0000","last_peered":"2024-09-21T07:12:43.841002+0000","last_clean":"2024-09-21T07:12:43.841002+0000","last_became_active":"2024-09-21T07:10:53.491106+0000","last_became_peered":"2024-09-21T07:10:53.491106+0000","last_unstale":"2024-09-21T07:12:43.841002+0000","last_undegraded":"2024-09-21T07:12:43.841002+0000","last_fullsized":"2024-09-21T07:12:43.841002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:58.270323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690834+0000","last_change":"2024-09-21T07:10:51.468433+0000","last_active":"2024-09-21T07:12:14.690834+0000","last_peered":"2024-09-21T07:12:14.690834+0000","last_clean":"2024-09-21T07:12:14.690834+0000","last_became_active":"2024-09-21T07:10:51.467810+0000","last_became_peered":"2024-09-21T07:10:51.467810+0000","last_unstale":"2024-09-21T07:12:14.690834+0000","last_undegraded":"2024-09-21T07:12:14.690834+0000","last_fullsized":"2024-09-21T07:12:14.690834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.787584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689774+0000","last_change":"2024-09-21T07:11:00.556866+0000","last_active":"2024-09-21T07:12:14.689774+0000","last_peered":"2024-09-21T07:12:14.689774+0000","last_clean":"2024-09-21T07:12:14.689774+0000","last_became_active":"2024-09-21T07:11:00.555350+0000","last_became_peered":"2024-09-21T07:11:00.555350+0000","last_unstale":"2024-09-21T07:12:14.689774+0000","last_undegraded":"2024-09-21T07:12:14.689774+0000","last_fullsized":"2024-09-21T07:12:14.689774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:46.296771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830507+0000","last_change":"2024-09-21T07:10:53.487210+0000","last_active":"2024-09-21T07:12:43.830507+0000","last_peered":"2024-09-21T07:12:43.830507+0000","last_clean":"2024-09-21T07:12:43.830507+0000","last_became_active":"2024-09-21T07:10:53.485975+0000","last_became_peered":"2024-09-21T07:10:53.485975+0000","last_unstale":"2024-09-21T07:12:43.830507+0000","last_undegraded":"2024-09-21T07:12:43.830507+0000","last_fullsized":"2024-09-21T07:12:43.830507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.685994+0000","last_change":"2024-09-21T07:10:51.456418+0000","last_active":"2024-09-21T07:12:14.685994+0000","last_peered":"2024-09-21T07:12:14.685994+0000","last_clean":"2024-09-21T07:12:14.685994+0000","last_became_active":"2024-09-21T07:10:51.455885+0000","last_became_peered":"2024-09-21T07:10:51.455885+0000","last_unstale":"2024-09-21T07:12:14.685994+0000","last_undegraded":"2024-09-21T07:12:14.685994+0000","last_fullsized":"2024-09-21T07:12:14.685994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:53.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687423+0000","last_change":"2024-09-21T07:10:51.462544+0000","last_active":"2024-09-21T07:12:14.687423+0000","last_peered":"2024-09-21T07:12:14.687423+0000","last_clean":"2024-09-21T07:12:14.687423+0000","last_became_active":"2024-09-21T07:10:51.462075+0000","last_became_peered":"2024-09-21T07:10:51.462075+0000","last_unstale":"2024-09-21T07:12:14.687423+0000","last_undegraded":"2024-09-21T07:12:14.687423+0000","last_fullsized":"2024-09-21T07:12:14.687423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:09.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.837792+0000","last_change":"2024-09-21T07:12:14.694814+0000","last_active":"2024-09-21T07:12:43.837792+0000","last_peered":"2024-09-21T07:12:43.837792+0000","last_clean":"2024-09-21T07:12:43.837792+0000","last_became_active":"2024-09-21T07:12:14.694334+0000","last_became_peered":"2024-09-21T07:12:14.694334+0000","last_unstale":"2024-09-21T07:12:43.837792+0000","last_undegraded":"2024-09-21T07:12:43.837792+0000","last_fullsized":"2024-09-21T07:12:43.837792+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:33.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687029+0000","last_change":"2024-09-21T07:11:00.552908+0000","last_active":"2024-09-21T07:12:14.687029+0000","last_peered":"2024-09-21T07:12:14.687029+0000","last_clean":"2024-09-21T07:12:14.687029+0000","last_became_active":"2024-09-21T07:11:00.552303+0000","last_became_peered":"2024-09-21T07:11:00.552303+0000","last_unstale":"2024-09-21T07:12:14.687029+0000","last_undegraded":"2024-09-21T07:12:14.687029+0000","last_fullsized":"2024-09-21T07:12:14.687029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'8","reported_seq":158,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:17.899377+0000","last_change":"2024-09-21T07:10:51.467072+0000","last_active":"2024-09-21T07:13:17.899377+0000","last_peered":"2024-09-21T07:13:17.899377+0000","last_clean":"2024-09-21T07:13:17.899377+0000","last_became_active":"2024-09-21T07:10:51.466671+0000","last_became_peered":"2024-09-21T07:10:51.466671+0000","last_unstale":"2024-09-21T07:13:17.899377+0000","last_undegraded":"2024-09-21T07:13:17.899377+0000","last_fullsized":"2024-09-21T07:13:17.899377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:24.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833720+0000","last_change":"2024-09-21T07:10:53.480057+0000","last_active":"2024-09-21T07:12:43.833720+0000","last_peered":"2024-09-21T07:12:43.833720+0000","last_clean":"2024-09-21T07:12:43.833720+0000","last_became_active":"2024-09-21T07:10:53.479644+0000","last_became_peered":"2024-09-21T07:10:53.479644+0000","last_unstale":"2024-09-21T07:12:43.833720+0000","last_undegraded":"2024-09-21T07:12:43.833720+0000","last_fullsized":"2024-09-21T07:12:43.833720+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:34.255547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687321+0000","last_change":"2024-09-21T07:11:00.550259+0000","last_active":"2024-09-21T07:12:14.687321+0000","last_peered":"2024-09-21T07:12:14.687321+0000","last_clean":"2024-09-21T07:12:14.687321+0000","last_became_active":"2024-09-21T07:11:00.549771+0000","last_became_peered":"2024-09-21T07:11:00.549771+0000","last_unstale":"2024-09-21T07:12:14.687321+0000","last_undegraded":"2024-09-21T07:12:14.687321+0000","last_fullsized":"2024-09-21T07:12:14.687321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839385+0000","last_change":"2024-09-21T07:10:53.488022+0000","last_active":"2024-09-21T07:12:43.839385+0000","last_peered":"2024-09-21T07:12:43.839385+0000","last_clean":"2024-09-21T07:12:43.839385+0000","last_became_active":"2024-09-21T07:10:53.487605+0000","last_became_peered":"2024-09-21T07:10:53.487605+0000","last_unstale":"2024-09-21T07:12:43.839385+0000","last_undegraded":"2024-09-21T07:12:43.839385+0000","last_fullsized":"2024-09-21T07:12:43.839385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:02.074960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833306+0000","last_change":"2024-09-21T07:10:53.484319+0000","last_active":"2024-09-21T07:12:43.833306+0000","last_peered":"2024-09-21T07:12:43.833306+0000","last_clean":"2024-09-21T07:12:43.833306+0000","last_became_active":"2024-09-21T07:10:53.483942+0000","last_became_peered":"2024-09-21T07:10:53.483942+0000","last_unstale":"2024-09-21T07:12:43.833306+0000","last_undegraded":"2024-09-21T07:12:43.833306+0000","last_fullsized":"2024-09-21T07:12:43.833306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:50.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840566+0000","last_change":"2024-09-21T07:10:53.494981+0000","last_active":"2024-09-21T07:12:43.840566+0000","last_peered":"2024-09-21T07:12:43.840566+0000","last_clean":"2024-09-21T07:12:43.840566+0000","last_became_active":"2024-09-21T07:10:53.494580+0000","last_became_peered":"2024-09-21T07:10:53.494580+0000","last_unstale":"2024-09-21T07:12:43.840566+0000","last_undegraded":"2024-09-21T07:12:43.840566+0000","last_fullsized":"2024-09-21T07:12:43.840566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:57.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842588+0000","last_change":"2024-09-21T07:10:53.492971+0000","last_active":"2024-09-21T07:12:43.842588+0000","last_peered":"2024-09-21T07:12:43.842588+0000","last_clean":"2024-09-21T07:12:43.842588+0000","last_became_active":"2024-09-21T07:10:53.492597+0000","last_became_peered":"2024-09-21T07:10:53.492597+0000","last_unstale":"2024-09-21T07:12:43.842588+0000","last_undegraded":"2024-09-21T07:12:43.842588+0000","last_fullsized":"2024-09-21T07:12:43.842588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.931998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836994+0000","last_change":"2024-09-21T07:10:53.485613+0000","last_active":"2024-09-21T07:12:43.836994+0000","last_peered":"2024-09-21T07:12:43.836994+0000","last_clean":"2024-09-21T07:12:43.836994+0000","last_became_active":"2024-09-21T07:10:53.485268+0000","last_became_peered":"2024-09-21T07:10:53.485268+0000","last_unstale":"2024-09-21T07:12:43.836994+0000","last_undegraded":"2024-09-21T07:12:43.836994+0000","last_fullsized":"2024-09-21T07:12:43.836994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:52.496426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831297+0000","last_change":"2024-09-21T07:10:53.489349+0000","last_active":"2024-09-21T07:12:43.831297+0000","last_peered":"2024-09-21T07:12:43.831297+0000","last_clean":"2024-09-21T07:12:43.831297+0000","last_became_active":"2024-09-21T07:10:53.488986+0000","last_became_peered":"2024-09-21T07:10:53.488986+0000","last_unstale":"2024-09-21T07:12:43.831297+0000","last_undegraded":"2024-09-21T07:12:43.831297+0000","last_fullsized":"2024-09-21T07:12:43.831297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:46.376689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.832429+0000","last_change":"2024-09-21T07:10:53.485740+0000","last_active":"2024-09-21T07:12:43.832429+0000","last_peered":"2024-09-21T07:12:43.832429+0000","last_clean":"2024-09-21T07:12:43.832429+0000","last_became_active":"2024-09-21T07:10:53.485375+0000","last_became_peered":"2024-09-21T07:10:53.485375+0000","last_unstale":"2024-09-21T07:12:43.832429+0000","last_undegraded":"2024-09-21T07:12:43.832429+0000","last_fullsized":"2024-09-21T07:12:43.832429+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:40.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838894+0000","last_change":"2024-09-21T07:10:53.490211+0000","last_active":"2024-09-21T07:12:43.838894+0000","last_peered":"2024-09-21T07:12:43.838894+0000","last_clean":"2024-09-21T07:12:43.838894+0000","last_became_active":"2024-09-21T07:10:53.489504+0000","last_became_peered":"2024-09-21T07:10:53.489504+0000","last_unstale":"2024-09-21T07:12:43.838894+0000","last_undegraded":"2024-09-21T07:12:43.838894+0000","last_fullsized":"2024-09-21T07:12:43.838894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:50.337307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.837945+0000","last_change":"2024-09-21T07:10:53.486064+0000","last_active":"2024-09-21T07:12:43.837945+0000","last_peered":"2024-09-21T07:12:43.837945+0000","last_clean":"2024-09-21T07:12:43.837945+0000","last_became_active":"2024-09-21T07:10:53.485674+0000","last_became_peered":"2024-09-21T07:10:53.485674+0000","last_unstale":"2024-09-21T07:12:43.837945+0000","last_undegraded":"2024-09-21T07:12:43.837945+0000","last_fullsized":"2024-09-21T07:12:43.837945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:55.232795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838941+0000","last_change":"2024-09-21T07:10:53.489008+0000","last_active":"2024-09-21T07:12:43.838941+0000","last_peered":"2024-09-21T07:12:43.838941+0000","last_clean":"2024-09-21T07:12:43.838941+0000","last_became_active":"2024-09-21T07:10:53.488655+0000","last_became_peered":"2024-09-21T07:10:53.488655+0000","last_unstale":"2024-09-21T07:12:43.838941+0000","last_undegraded":"2024-09-21T07:12:43.838941+0000","last_fullsized":"2024-09-21T07:12:43.838941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:42.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843962+0000","last_change":"2024-09-21T07:10:53.490147+0000","last_active":"2024-09-21T07:12:43.843962+0000","last_peered":"2024-09-21T07:12:43.843962+0000","last_clean":"2024-09-21T07:12:43.843962+0000","last_became_active":"2024-09-21T07:10:53.488389+0000","last_became_peered":"2024-09-21T07:10:53.488389+0000","last_unstale":"2024-09-21T07:12:43.843962+0000","last_undegraded":"2024-09-21T07:12:43.843962+0000","last_fullsized":"2024-09-21T07:12:43.843962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:17.729856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840459+0000","last_change":"2024-09-21T07:10:53.486557+0000","last_active":"2024-09-21T07:12:43.840459+0000","last_peered":"2024-09-21T07:12:43.840459+0000","last_clean":"2024-09-21T07:12:43.840459+0000","last_became_active":"2024-09-21T07:10:53.486248+0000","last_became_peered":"2024-09-21T07:10:53.486248+0000","last_unstale":"2024-09-21T07:12:43.840459+0000","last_undegraded":"2024-09-21T07:12:43.840459+0000","last_fullsized":"2024-09-21T07:12:43.840459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.675717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833816+0000","last_change":"2024-09-21T07:10:53.485281+0000","last_active":"2024-09-21T07:12:43.833816+0000","last_peered":"2024-09-21T07:12:43.833816+0000","last_clean":"2024-09-21T07:12:43.833816+0000","last_became_active":"2024-09-21T07:10:53.484732+0000","last_became_peered":"2024-09-21T07:10:53.484732+0000","last_unstale":"2024-09-21T07:12:43.833816+0000","last_undegraded":"2024-09-21T07:12:43.833816+0000","last_fullsized":"2024-09-21T07:12:43.833816+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:53.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836869+0000","last_change":"2024-09-21T07:10:53.483192+0000","last_active":"2024-09-21T07:12:43.836869+0000","last_peered":"2024-09-21T07:12:43.836869+0000","last_clean":"2024-09-21T07:12:43.836869+0000","last_became_active":"2024-09-21T07:10:53.482402+0000","last_became_peered":"2024-09-21T07:10:53.482402+0000","last_unstale":"2024-09-21T07:12:43.836869+0000","last_undegraded":"2024-09-21T07:12:43.836869+0000","last_fullsized":"2024-09-21T07:12:43.836869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.159873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843080+0000","last_change":"2024-09-21T07:10:53.481463+0000","last_active":"2024-09-21T07:12:43.843080+0000","last_peered":"2024-09-21T07:12:43.843080+0000","last_clean":"2024-09-21T07:12:43.843080+0000","last_became_active":"2024-09-21T07:10:53.481129+0000","last_became_peered":"2024-09-21T07:10:53.481129+0000","last_unstale":"2024-09-21T07:12:43.843080+0000","last_undegraded":"2024-09-21T07:12:43.843080+0000","last_fullsized":"2024-09-21T07:12:43.843080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:14.547936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840480+0000","last_change":"2024-09-21T07:10:53.493009+0000","last_active":"2024-09-21T07:12:43.840480+0000","last_peered":"2024-09-21T07:12:43.840480+0000","last_clean":"2024-09-21T07:12:43.840480+0000","last_became_active":"2024-09-21T07:10:53.492300+0000","last_became_peered":"2024-09-21T07:10:53.492300+0000","last_unstale":"2024-09-21T07:12:43.840480+0000","last_undegraded":"2024-09-21T07:12:43.840480+0000","last_fullsized":"2024-09-21T07:12:43.840480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:09.890248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843437+0000","last_change":"2024-09-21T07:10:53.491149+0000","last_active":"2024-09-21T07:12:43.843437+0000","last_peered":"2024-09-21T07:12:43.843437+0000","last_clean":"2024-09-21T07:12:43.843437+0000","last_became_active":"2024-09-21T07:10:53.490766+0000","last_became_peered":"2024-09-21T07:10:53.490766+0000","last_unstale":"2024-09-21T07:12:43.843437+0000","last_undegraded":"2024-09-21T07:12:43.843437+0000","last_fullsized":"2024-09-21T07:12:43.843437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:52.243083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840492+0000","last_change":"2024-09-21T07:11:14.672453+0000","last_active":"2024-09-21T07:12:43.840492+0000","last_peered":"2024-09-21T07:12:43.840492+0000","last_clean":"2024-09-21T07:12:43.840492+0000","last_became_active":"2024-09-21T07:11:14.671584+0000","last_became_peered":"2024-09-21T07:11:14.671584+0000","last_unstale":"2024-09-21T07:12:43.840492+0000","last_undegraded":"2024-09-21T07:12:43.840492+0000","last_fullsized":"2024-09-21T07:12:43.840492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:25.746195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839098+0000","last_change":"2024-09-21T07:10:53.496332+0000","last_active":"2024-09-21T07:12:43.839098+0000","last_peered":"2024-09-21T07:12:43.839098+0000","last_clean":"2024-09-21T07:12:43.839098+0000","last_became_active":"2024-09-21T07:10:53.495078+0000","last_became_peered":"2024-09-21T07:10:53.495078+0000","last_unstale":"2024-09-21T07:12:43.839098+0000","last_undegraded":"2024-09-21T07:12:43.839098+0000","last_fullsized":"2024-09-21T07:12:43.839098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:32.415350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838131+0000","last_change":"2024-09-21T07:10:53.478381+0000","last_active":"2024-09-21T07:12:43.838131+0000","last_peered":"2024-09-21T07:12:43.838131+0000","last_clean":"2024-09-21T07:12:43.838131+0000","last_became_active":"2024-09-21T07:10:53.478021+0000","last_became_peered":"2024-09-21T07:10:53.478021+0000","last_unstale":"2024-09-21T07:12:43.838131+0000","last_undegraded":"2024-09-21T07:12:43.838131+0000","last_fullsized":"2024-09-21T07:12:43.838131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:02.496263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.821141+0000","last_change":"2024-09-21T07:10:53.485103+0000","last_active":"2024-09-21T07:12:43.821141+0000","last_peered":"2024-09-21T07:12:43.821141+0000","last_clean":"2024-09-21T07:12:43.821141+0000","last_became_active":"2024-09-21T07:10:53.483835+0000","last_became_peered":"2024-09-21T07:10:53.483835+0000","last_unstale":"2024-09-21T07:12:43.821141+0000","last_undegraded":"2024-09-21T07:12:43.821141+0000","last_fullsized":"2024-09-21T07:12:43.821141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:47.775202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842539+0000","last_change":"2024-09-21T07:10:53.490497+0000","last_active":"2024-09-21T07:12:43.842539+0000","last_peered":"2024-09-21T07:12:43.842539+0000","last_clean":"2024-09-21T07:12:43.842539+0000","last_became_active":"2024-09-21T07:10:53.490137+0000","last_became_peered":"2024-09-21T07:10:53.490137+0000","last_unstale":"2024-09-21T07:12:43.842539+0000","last_undegraded":"2024-09-21T07:12:43.842539+0000","last_fullsized":"2024-09-21T07:12:43.842539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:12.090628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842305+0000","last_change":"2024-09-21T07:10:53.487118+0000","last_active":"2024-09-21T07:12:43.842305+0000","last_peered":"2024-09-21T07:12:43.842305+0000","last_clean":"2024-09-21T07:12:43.842305+0000","last_became_active":"2024-09-21T07:10:53.486582+0000","last_became_peered":"2024-09-21T07:10:53.486582+0000","last_unstale":"2024-09-21T07:12:43.842305+0000","last_undegraded":"2024-09-21T07:12:43.842305+0000","last_fullsized":"2024-09-21T07:12:43.842305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:00.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839468+0000","last_change":"2024-09-21T07:10:53.497390+0000","last_active":"2024-09-21T07:12:43.839468+0000","last_peered":"2024-09-21T07:12:43.839468+0000","last_clean":"2024-09-21T07:12:43.839468+0000","last_became_active":"2024-09-21T07:10:53.497043+0000","last_became_peered":"2024-09-21T07:10:53.497043+0000","last_unstale":"2024-09-21T07:12:43.839468+0000","last_undegraded":"2024-09-21T07:12:43.839468+0000","last_fullsized":"2024-09-21T07:12:43.839468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:36.912873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.829496+0000","last_change":"2024-09-21T07:10:53.484624+0000","last_active":"2024-09-21T07:12:43.829496+0000","last_peered":"2024-09-21T07:12:43.829496+0000","last_clean":"2024-09-21T07:12:43.829496+0000","last_became_active":"2024-09-21T07:10:53.484278+0000","last_became_peered":"2024-09-21T07:10:53.484278+0000","last_unstale":"2024-09-21T07:12:43.829496+0000","last_undegraded":"2024-09-21T07:12:43.829496+0000","last_fullsized":"2024-09-21T07:12:43.829496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:41.464442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836192+0000","last_change":"2024-09-21T07:10:53.478146+0000","last_active":"2024-09-21T07:12:43.836192+0000","last_peered":"2024-09-21T07:12:43.836192+0000","last_clean":"2024-09-21T07:12:43.836192+0000","last_became_active":"2024-09-21T07:10:53.477733+0000","last_became_peered":"2024-09-21T07:10:53.477733+0000","last_unstale":"2024-09-21T07:12:43.836192+0000","last_undegraded":"2024-09-21T07:12:43.836192+0000","last_fullsized":"2024-09-21T07:12:43.836192+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:09.159966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839738+0000","last_change":"2024-09-21T07:11:14.657274+0000","last_active":"2024-09-21T07:12:43.839738+0000","last_peered":"2024-09-21T07:12:43.839738+0000","last_clean":"2024-09-21T07:12:43.839738+0000","last_became_active":"2024-09-21T07:11:14.656826+0000","last_became_peered":"2024-09-21T07:11:14.656826+0000","last_unstale":"2024-09-21T07:12:43.839738+0000","last_undegraded":"2024-09-21T07:12:43.839738+0000","last_fullsized":"2024-09-21T07:12:43.839738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.688373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830031+0000","last_change":"2024-09-21T07:10:53.481411+0000","last_active":"2024-09-21T07:12:43.830031+0000","last_peered":"2024-09-21T07:12:43.830031+0000","last_clean":"2024-09-21T07:12:43.830031+0000","last_became_active":"2024-09-21T07:10:53.481005+0000","last_became_peered":"2024-09-21T07:10:53.481005+0000","last_unstale":"2024-09-21T07:12:43.830031+0000","last_undegraded":"2024-09-21T07:12:43.830031+0000","last_fullsized":"2024-09-21T07:12:43.830031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:41.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.823757+0000","last_change":"2024-09-21T07:10:53.487481+0000","last_active":"2024-09-21T07:12:43.823757+0000","last_peered":"2024-09-21T07:12:43.823757+0000","last_clean":"2024-09-21T07:12:43.823757+0000","last_became_active":"2024-09-21T07:10:53.486277+0000","last_became_peered":"2024-09-21T07:10:53.486277+0000","last_unstale":"2024-09-21T07:12:43.823757+0000","last_undegraded":"2024-09-21T07:12:43.823757+0000","last_fullsized":"2024-09-21T07:12:43.823757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:57.304382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840517+0000","last_change":"2024-09-21T07:10:53.495971+0000","last_active":"2024-09-21T07:12:43.840517+0000","last_peered":"2024-09-21T07:12:43.840517+0000","last_clean":"2024-09-21T07:12:43.840517+0000","last_became_active":"2024-09-21T07:10:53.495124+0000","last_became_peered":"2024-09-21T07:10:53.495124+0000","last_unstale":"2024-09-21T07:12:43.840517+0000","last_undegraded":"2024-09-21T07:12:43.840517+0000","last_fullsized":"2024-09-21T07:12:43.840517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839940+0000","last_change":"2024-09-21T07:10:53.497538+0000","last_active":"2024-09-21T07:12:43.839940+0000","last_peered":"2024-09-21T07:12:43.839940+0000","last_clean":"2024-09-21T07:12:43.839940+0000","last_became_active":"2024-09-21T07:10:53.496835+0000","last_became_peered":"2024-09-21T07:10:53.496835+0000","last_unstale":"2024-09-21T07:12:43.839940+0000","last_undegraded":"2024-09-21T07:12:43.839940+0000","last_fullsized":"2024-09-21T07:12:43.839940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:17.187282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840355+0000","last_change":"2024-09-21T07:10:53.492646+0000","last_active":"2024-09-21T07:12:43.840355+0000","last_peered":"2024-09-21T07:12:43.840355+0000","last_clean":"2024-09-21T07:12:43.840355+0000","last_became_active":"2024-09-21T07:10:53.491818+0000","last_became_peered":"2024-09-21T07:10:53.491818+0000","last_unstale":"2024-09-21T07:12:43.840355+0000","last_undegraded":"2024-09-21T07:12:43.840355+0000","last_fullsized":"2024-09-21T07:12:43.840355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:37.094158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76803,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1099,"num_read_kb":634,"num_write":274,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":68,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":237278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283164,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710762,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":506747,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906992,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712876,"statfs":{"total":95995035648,"available":95961985024,"internally_reserved":0,"allocated":1118208,"data_stored":1165077,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070517,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":506116,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266746,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":506494,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462975,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1105143,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626499,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":502113,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822729,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":1099207,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986255,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":506719,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":501328,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378712,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":571274,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542237,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":577357,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705763,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":983040,"data_stored":503569,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":70376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:13:22.627 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:13:22.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.771+0000 7fd8580de640 1 -- 172.21.15.92:0/733126103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8501047b0 msgr2=0x7fd850104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:22.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.771+0000 7fd8580de640 1 --2- 172.21.15.92:0/733126103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8501047b0 0x7fd850104bc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd848009900 tx=0x7fd84802a410 comp rx=0 tx=0).stop 2024-09-21T07:13:22.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.771+0000 7fd8580de640 1 -- 172.21.15.92:0/733126103 shutdown_connections 2024-09-21T07:13:22.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.771+0000 7fd8580de640 1 --2- 172.21.15.92:0/733126103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd85010dd60 0x7fd850110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.771+0000 7fd8580de640 1 --2- 172.21.15.92:0/733126103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd850105190 0x7fd85010d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.771+0000 7fd8580de640 1 --2- 172.21.15.92:0/733126103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8501047b0 0x7fd850104bc0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.771+0000 7fd8580de640 1 -- 172.21.15.92:0/733126103 >> 172.21.15.92:0/733126103 conn(0x7fd8500fe380 msgr2=0x7fd8501007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:22.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.771+0000 7fd8580de640 1 -- 172.21.15.92:0/733126103 shutdown_connections 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.771+0000 7fd8580de640 1 -- 172.21.15.92:0/733126103 wait complete. 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd8580de640 1 Processor -- start 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd8580de640 1 -- start start 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd8580de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8501047b0 0x7fd85019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd8580de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd850105190 0x7fd85019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd8580de640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd85010dd60 0x7fd85019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd8580de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8501138b0 con 0x7fd8501047b0 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd8580de640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd850113730 con 0x7fd85010dd60 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd8580de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd850113a30 con 0x7fd850105190 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd855e7a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8501047b0 0x7fd85019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd855e7a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8501047b0 0x7fd85019a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55526/0 (socket says 172.21.15.92:55526) 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd855e7a640 1 -- 172.21.15.92:0/3149190757 learned_addr learned my addr 172.21.15.92:0/3149190757 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd85667b640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd85010dd60 0x7fd85019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd855679640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd850105190 0x7fd85019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd855e7a640 1 -- 172.21.15.92:0/3149190757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd850105190 msgr2=0x7fd85019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd855e7a640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd850105190 0x7fd85019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd855e7a640 1 -- 172.21.15.92:0/3149190757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd85010dd60 msgr2=0x7fd85019fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd855e7a640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd85010dd60 0x7fd85019fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.772+0000 7fd855e7a640 1 -- 172.21.15.92:0/3149190757 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8501a0230 con 0x7fd8501047b0 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.773+0000 7fd855e7a640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8501047b0 0x7fd85019a390 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd848009a20 tx=0x7fd848004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.773+0000 7fd84effd640 1 -- 172.21.15.92:0/3149190757 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84803f030 con 0x7fd8501047b0 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.773+0000 7fd84effd640 1 -- 172.21.15.92:0/3149190757 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8480035f0 con 0x7fd8501047b0 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.773+0000 7fd8580de640 1 -- 172.21.15.92:0/3149190757 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8501a04c0 con 0x7fd8501047b0 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.773+0000 7fd84effd640 1 -- 172.21.15.92:0/3149190757 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848035070 con 0x7fd8501047b0 2024-09-21T07:13:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.773+0000 7fd8580de640 1 -- 172.21.15.92:0/3149190757 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8501a6d40 con 0x7fd8501047b0 2024-09-21T07:13:22.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.774+0000 7fd8580de640 1 -- 172.21.15.92:0/3149190757 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85006ad60 con 0x7fd8501047b0 2024-09-21T07:13:22.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.775+0000 7fd84effd640 1 -- 172.21.15.92:0/3149190757 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7fd848003a60 con 0x7fd8501047b0 2024-09-21T07:13:22.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.776+0000 7fd84effd640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8380b6670 0x7fd8380b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:22.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.776+0000 7fd855679640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8380b6670 0x7fd8380b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:22.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.776+0000 7fd84effd640 1 -- 172.21.15.92:0/3149190757 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd848108930 con 0x7fd8501047b0 2024-09-21T07:13:22.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.776+0000 7fd855679640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8380b6670 0x7fd8380b8b80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd85010fd00 tx=0x7fd844008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:22.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.779+0000 7fd84effd640 1 -- 172.21.15.92:0/3149190757 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8480ceba0 con 0x7fd8501047b0 2024-09-21T07:13:22.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.953+0000 7fd8580de640 1 -- 172.21.15.92:0/3149190757 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd850063800 con 0x7fd8380b6670 2024-09-21T07:13:22.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.959+0000 7fd84effd640 1 -- 172.21.15.92:0/3149190757 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340813 (secure 0 0 0) 0x7fd850063800 con 0x7fd8380b6670 2024-09-21T07:13:22.964 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:22.965 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-21T07:13:22.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 -- 172.21.15.92:0/3149190757 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8380b6670 msgr2=0x7fd8380b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:22.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8380b6670 0x7fd8380b8b80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd85010fd00 tx=0x7fd844008040 comp rx=0 tx=0).stop 2024-09-21T07:13:22.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 -- 172.21.15.92:0/3149190757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8501047b0 msgr2=0x7fd85019a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:22.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8501047b0 0x7fd85019a390 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd848009a20 tx=0x7fd848004270 comp rx=0 tx=0).stop 2024-09-21T07:13:22.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 -- 172.21.15.92:0/3149190757 shutdown_connections 2024-09-21T07:13:22.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8380b6670 0x7fd8380b8b80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd85010dd60 0x7fd85019fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd850105190 0x7fd85019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 --2- 172.21.15.92:0/3149190757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8501047b0 0x7fd85019a390 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:22.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 -- 172.21.15.92:0/3149190757 >> 172.21.15.92:0/3149190757 conn(0x7fd8500fe380 msgr2=0x7fd8500fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:22.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 -- 172.21.15.92:0/3149190757 shutdown_connections 2024-09-21T07:13:22.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:22.962+0000 7fd8580de640 1 -- 172.21.15.92:0/3149190757 wait complete. 2024-09-21T07:13:22.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:22 smithi092 ceph-mon[30987]: pgmap v348: 129 pgs: 129 active+clean; 652 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T07:13:22.975 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-21T07:13:21.624726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667405,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1180,"num_read_kb":703,"num_write":399,"num_write_kb":2318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2951908,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":829,"ondisk_log_size":829,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369364,"kb_used_data":11796,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572460,"statfs":{"total":1151940427776,"available":1151562199040,"internally_reserved":0,"allocated":12079104,"data_stored":8051144,"data_compressed":463053,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2856,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":17,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003657"},"pg_stats":[{"pgid":"2.1f","version":"86'14","reported_seq":159,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.161324+0000","last_change":"2024-09-21T07:10:51.463956+0000","last_active":"2024-09-21T07:13:16.161324+0000","last_peered":"2024-09-21T07:13:16.161324+0000","last_clean":"2024-09-21T07:13:16.161324+0000","last_became_active":"2024-09-21T07:10:51.463564+0000","last_became_peered":"2024-09-21T07:10:51.463564+0000","last_unstale":"2024-09-21T07:13:16.161324+0000","last_undegraded":"2024-09-21T07:13:16.161324+0000","last_fullsized":"2024-09-21T07:13:16.161324+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838602+0000","last_change":"2024-09-21T07:10:53.484379+0000","last_active":"2024-09-21T07:12:43.838602+0000","last_peered":"2024-09-21T07:12:43.838602+0000","last_clean":"2024-09-21T07:12:43.838602+0000","last_became_active":"2024-09-21T07:10:53.484005+0000","last_became_peered":"2024-09-21T07:10:53.484005+0000","last_unstale":"2024-09-21T07:12:43.838602+0000","last_undegraded":"2024-09-21T07:12:43.838602+0000","last_fullsized":"2024-09-21T07:12:43.838602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:27.665257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686808+0000","last_change":"2024-09-21T07:11:00.552729+0000","last_active":"2024-09-21T07:12:14.686808+0000","last_peered":"2024-09-21T07:12:14.686808+0000","last_clean":"2024-09-21T07:12:14.686808+0000","last_became_active":"2024-09-21T07:11:00.552196+0000","last_became_peered":"2024-09-21T07:11:00.552196+0000","last_unstale":"2024-09-21T07:12:14.686808+0000","last_undegraded":"2024-09-21T07:12:14.686808+0000","last_fullsized":"2024-09-21T07:12:14.686808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:35.942717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692173+0000","last_change":"2024-09-21T07:10:51.467798+0000","last_active":"2024-09-21T07:12:14.692173+0000","last_peered":"2024-09-21T07:12:14.692173+0000","last_clean":"2024-09-21T07:12:14.692173+0000","last_became_active":"2024-09-21T07:10:51.467314+0000","last_became_peered":"2024-09-21T07:10:51.467314+0000","last_unstale":"2024-09-21T07:12:14.692173+0000","last_undegraded":"2024-09-21T07:12:14.692173+0000","last_fullsized":"2024-09-21T07:12:14.692173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:21.944378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839226+0000","last_change":"2024-09-21T07:10:53.494849+0000","last_active":"2024-09-21T07:12:43.839226+0000","last_peered":"2024-09-21T07:12:43.839226+0000","last_clean":"2024-09-21T07:12:43.839226+0000","last_became_active":"2024-09-21T07:10:53.494478+0000","last_became_peered":"2024-09-21T07:10:53.494478+0000","last_unstale":"2024-09-21T07:12:43.839226+0000","last_undegraded":"2024-09-21T07:12:43.839226+0000","last_fullsized":"2024-09-21T07:12:43.839226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:38.383547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805630+0000","last_change":"2024-09-21T07:11:00.558306+0000","last_active":"2024-09-21T07:12:14.805630+0000","last_peered":"2024-09-21T07:12:14.805630+0000","last_clean":"2024-09-21T07:12:14.805630+0000","last_became_active":"2024-09-21T07:11:00.557814+0000","last_became_peered":"2024-09-21T07:11:00.557814+0000","last_unstale":"2024-09-21T07:12:14.805630+0000","last_undegraded":"2024-09-21T07:12:14.805630+0000","last_fullsized":"2024-09-21T07:12:14.805630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:31.401788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692968+0000","last_change":"2024-09-21T07:10:51.466831+0000","last_active":"2024-09-21T07:12:14.692968+0000","last_peered":"2024-09-21T07:12:14.692968+0000","last_clean":"2024-09-21T07:12:14.692968+0000","last_became_active":"2024-09-21T07:10:51.466381+0000","last_became_peered":"2024-09-21T07:10:51.466381+0000","last_unstale":"2024-09-21T07:12:14.692968+0000","last_undegraded":"2024-09-21T07:12:14.692968+0000","last_fullsized":"2024-09-21T07:12:14.692968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.559370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843453+0000","last_change":"2024-09-21T07:10:53.485920+0000","last_active":"2024-09-21T07:12:43.843453+0000","last_peered":"2024-09-21T07:12:43.843453+0000","last_clean":"2024-09-21T07:12:43.843453+0000","last_became_active":"2024-09-21T07:10:53.484689+0000","last_became_peered":"2024-09-21T07:10:53.484689+0000","last_unstale":"2024-09-21T07:12:43.843453+0000","last_undegraded":"2024-09-21T07:12:43.843453+0000","last_fullsized":"2024-09-21T07:12:43.843453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:59.951999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806409+0000","last_change":"2024-09-21T07:11:00.558298+0000","last_active":"2024-09-21T07:12:14.806409+0000","last_peered":"2024-09-21T07:12:14.806409+0000","last_clean":"2024-09-21T07:12:14.806409+0000","last_became_active":"2024-09-21T07:11:00.557738+0000","last_became_peered":"2024-09-21T07:11:00.557738+0000","last_unstale":"2024-09-21T07:12:14.806409+0000","last_undegraded":"2024-09-21T07:12:14.806409+0000","last_fullsized":"2024-09-21T07:12:14.806409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:03.037820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692968+0000","last_change":"2024-09-21T07:10:51.464283+0000","last_active":"2024-09-21T07:12:14.692968+0000","last_peered":"2024-09-21T07:12:14.692968+0000","last_clean":"2024-09-21T07:12:14.692968+0000","last_became_active":"2024-09-21T07:10:51.463783+0000","last_became_peered":"2024-09-21T07:10:51.463783+0000","last_unstale":"2024-09-21T07:12:14.692968+0000","last_undegraded":"2024-09-21T07:12:14.692968+0000","last_fullsized":"2024-09-21T07:12:14.692968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:45.298654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842942+0000","last_change":"2024-09-21T07:11:14.671020+0000","last_active":"2024-09-21T07:12:43.842942+0000","last_peered":"2024-09-21T07:12:43.842942+0000","last_clean":"2024-09-21T07:12:43.842942+0000","last_became_active":"2024-09-21T07:11:14.670573+0000","last_became_peered":"2024-09-21T07:11:14.670573+0000","last_unstale":"2024-09-21T07:12:43.842942+0000","last_undegraded":"2024-09-21T07:12:43.842942+0000","last_fullsized":"2024-09-21T07:12:43.842942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.926304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805803+0000","last_change":"2024-09-21T07:11:00.549015+0000","last_active":"2024-09-21T07:12:14.805803+0000","last_peered":"2024-09-21T07:12:14.805803+0000","last_clean":"2024-09-21T07:12:14.805803+0000","last_became_active":"2024-09-21T07:11:00.548561+0000","last_became_peered":"2024-09-21T07:11:00.548561+0000","last_unstale":"2024-09-21T07:12:14.805803+0000","last_undegraded":"2024-09-21T07:12:14.805803+0000","last_fullsized":"2024-09-21T07:12:14.805803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:08.386214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841440+0000","last_change":"2024-09-21T07:10:53.489382+0000","last_active":"2024-09-21T07:12:43.841440+0000","last_peered":"2024-09-21T07:12:43.841440+0000","last_clean":"2024-09-21T07:12:43.841440+0000","last_became_active":"2024-09-21T07:10:53.488987+0000","last_became_peered":"2024-09-21T07:10:53.488987+0000","last_unstale":"2024-09-21T07:12:43.841440+0000","last_undegraded":"2024-09-21T07:12:43.841440+0000","last_fullsized":"2024-09-21T07:12:43.841440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.334840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692508+0000","last_change":"2024-09-21T07:10:51.467203+0000","last_active":"2024-09-21T07:12:14.692508+0000","last_peered":"2024-09-21T07:12:14.692508+0000","last_clean":"2024-09-21T07:12:14.692508+0000","last_became_active":"2024-09-21T07:10:51.466737+0000","last_became_peered":"2024-09-21T07:10:51.466737+0000","last_unstale":"2024-09-21T07:12:14.692508+0000","last_undegraded":"2024-09-21T07:12:14.692508+0000","last_fullsized":"2024-09-21T07:12:14.692508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:26.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806191+0000","last_change":"2024-09-21T07:11:00.640801+0000","last_active":"2024-09-21T07:12:14.806191+0000","last_peered":"2024-09-21T07:12:14.806191+0000","last_clean":"2024-09-21T07:12:14.806191+0000","last_became_active":"2024-09-21T07:11:00.640213+0000","last_became_peered":"2024-09-21T07:11:00.640213+0000","last_unstale":"2024-09-21T07:12:14.806191+0000","last_undegraded":"2024-09-21T07:12:14.806191+0000","last_fullsized":"2024-09-21T07:12:14.806191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:55.801831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841160+0000","last_change":"2024-09-21T07:10:53.491166+0000","last_active":"2024-09-21T07:12:43.841160+0000","last_peered":"2024-09-21T07:12:43.841160+0000","last_clean":"2024-09-21T07:12:43.841160+0000","last_became_active":"2024-09-21T07:10:53.490823+0000","last_became_peered":"2024-09-21T07:10:53.490823+0000","last_unstale":"2024-09-21T07:12:43.841160+0000","last_undegraded":"2024-09-21T07:12:43.841160+0000","last_fullsized":"2024-09-21T07:12:43.841160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:48.661634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:02.728825+0000","last_change":"2024-09-21T07:10:51.461220+0000","last_active":"2024-09-21T07:13:02.728825+0000","last_peered":"2024-09-21T07:13:02.728825+0000","last_clean":"2024-09-21T07:13:02.728825+0000","last_became_active":"2024-09-21T07:10:51.460772+0000","last_became_peered":"2024-09-21T07:10:51.460772+0000","last_unstale":"2024-09-21T07:13:02.728825+0000","last_undegraded":"2024-09-21T07:13:02.728825+0000","last_fullsized":"2024-09-21T07:13:02.728825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:56.488273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806249+0000","last_change":"2024-09-21T07:11:00.558487+0000","last_active":"2024-09-21T07:12:14.806249+0000","last_peered":"2024-09-21T07:12:14.806249+0000","last_clean":"2024-09-21T07:12:14.806249+0000","last_became_active":"2024-09-21T07:11:00.557877+0000","last_became_peered":"2024-09-21T07:11:00.557877+0000","last_unstale":"2024-09-21T07:12:14.806249+0000","last_undegraded":"2024-09-21T07:12:14.806249+0000","last_fullsized":"2024-09-21T07:12:14.806249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:14.614603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840073+0000","last_change":"2024-09-21T07:10:53.489309+0000","last_active":"2024-09-21T07:12:43.840073+0000","last_peered":"2024-09-21T07:12:43.840073+0000","last_clean":"2024-09-21T07:12:43.840073+0000","last_became_active":"2024-09-21T07:10:53.488943+0000","last_became_peered":"2024-09-21T07:10:53.488943+0000","last_unstale":"2024-09-21T07:12:43.840073+0000","last_undegraded":"2024-09-21T07:12:43.840073+0000","last_fullsized":"2024-09-21T07:12:43.840073+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.797176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692071+0000","last_change":"2024-09-21T07:10:51.461078+0000","last_active":"2024-09-21T07:12:14.692071+0000","last_peered":"2024-09-21T07:12:14.692071+0000","last_clean":"2024-09-21T07:12:14.692071+0000","last_became_active":"2024-09-21T07:10:51.460759+0000","last_became_peered":"2024-09-21T07:10:51.460759+0000","last_unstale":"2024-09-21T07:12:14.692071+0000","last_undegraded":"2024-09-21T07:12:14.692071+0000","last_fullsized":"2024-09-21T07:12:14.692071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:37.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:11:00.554766+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:11:00.554374+0000","last_became_peered":"2024-09-21T07:11:00.554374+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:47.038411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825773+0000","last_change":"2024-09-21T07:10:53.487501+0000","last_active":"2024-09-21T07:12:43.825773+0000","last_peered":"2024-09-21T07:12:43.825773+0000","last_clean":"2024-09-21T07:12:43.825773+0000","last_became_active":"2024-09-21T07:10:53.487030+0000","last_became_peered":"2024-09-21T07:10:53.487030+0000","last_unstale":"2024-09-21T07:12:43.825773+0000","last_undegraded":"2024-09-21T07:12:43.825773+0000","last_fullsized":"2024-09-21T07:12:43.825773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692397+0000","last_change":"2024-09-21T07:10:51.468155+0000","last_active":"2024-09-21T07:12:14.692397+0000","last_peered":"2024-09-21T07:12:14.692397+0000","last_clean":"2024-09-21T07:12:14.692397+0000","last_became_active":"2024-09-21T07:10:51.467663+0000","last_became_peered":"2024-09-21T07:10:51.467663+0000","last_unstale":"2024-09-21T07:12:14.692397+0000","last_undegraded":"2024-09-21T07:12:14.692397+0000","last_fullsized":"2024-09-21T07:12:14.692397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:18.176519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806311+0000","last_change":"2024-09-21T07:11:00.641283+0000","last_active":"2024-09-21T07:12:14.806311+0000","last_peered":"2024-09-21T07:12:14.806311+0000","last_clean":"2024-09-21T07:12:14.806311+0000","last_became_active":"2024-09-21T07:11:00.640715+0000","last_became_peered":"2024-09-21T07:11:00.640715+0000","last_unstale":"2024-09-21T07:12:14.806311+0000","last_undegraded":"2024-09-21T07:12:14.806311+0000","last_fullsized":"2024-09-21T07:12:14.806311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:26.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842481+0000","last_change":"2024-09-21T07:11:14.656686+0000","last_active":"2024-09-21T07:12:43.842481+0000","last_peered":"2024-09-21T07:12:43.842481+0000","last_clean":"2024-09-21T07:12:43.842481+0000","last_became_active":"2024-09-21T07:11:14.656259+0000","last_became_peered":"2024-09-21T07:11:14.656259+0000","last_unstale":"2024-09-21T07:12:43.842481+0000","last_undegraded":"2024-09-21T07:12:43.842481+0000","last_fullsized":"2024-09-21T07:12:43.842481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:16.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806776+0000","last_change":"2024-09-21T07:10:52.123260+0000","last_active":"2024-09-21T07:12:14.806776+0000","last_peered":"2024-09-21T07:12:14.806776+0000","last_clean":"2024-09-21T07:12:14.806776+0000","last_became_active":"2024-09-21T07:10:52.122752+0000","last_became_peered":"2024-09-21T07:10:52.122752+0000","last_unstale":"2024-09-21T07:12:14.806776+0000","last_undegraded":"2024-09-21T07:12:14.806776+0000","last_fullsized":"2024-09-21T07:12:14.806776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.041434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686989+0000","last_change":"2024-09-21T07:11:00.549599+0000","last_active":"2024-09-21T07:12:14.686989+0000","last_peered":"2024-09-21T07:12:14.686989+0000","last_clean":"2024-09-21T07:12:14.686989+0000","last_became_active":"2024-09-21T07:11:00.549112+0000","last_became_peered":"2024-09-21T07:11:00.549112+0000","last_unstale":"2024-09-21T07:12:14.686989+0000","last_undegraded":"2024-09-21T07:12:14.686989+0000","last_fullsized":"2024-09-21T07:12:14.686989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:15.209889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.828092+0000","last_change":"2024-09-21T07:10:53.487792+0000","last_active":"2024-09-21T07:12:43.828092+0000","last_peered":"2024-09-21T07:12:43.828092+0000","last_clean":"2024-09-21T07:12:43.828092+0000","last_became_active":"2024-09-21T07:10:53.487460+0000","last_became_peered":"2024-09-21T07:10:53.487460+0000","last_unstale":"2024-09-21T07:12:43.828092+0000","last_undegraded":"2024-09-21T07:12:43.828092+0000","last_fullsized":"2024-09-21T07:12:43.828092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:26.329878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'17","reported_seq":74,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:02.651907+0000","last_change":"2024-09-21T07:12:14.699788+0000","last_active":"2024-09-21T07:13:02.651907+0000","last_peered":"2024-09-21T07:13:02.651907+0000","last_clean":"2024-09-21T07:13:02.651907+0000","last_became_active":"2024-09-21T07:12:14.693355+0000","last_became_peered":"2024-09-21T07:12:14.693355+0000","last_unstale":"2024-09-21T07:13:02.651907+0000","last_undegraded":"2024-09-21T07:13:02.651907+0000","last_fullsized":"2024-09-21T07:13:02.651907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:44.104210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691224+0000","last_change":"2024-09-21T07:11:00.640604+0000","last_active":"2024-09-21T07:12:14.691224+0000","last_peered":"2024-09-21T07:12:14.691224+0000","last_clean":"2024-09-21T07:12:14.691224+0000","last_became_active":"2024-09-21T07:11:00.640047+0000","last_became_peered":"2024-09-21T07:11:00.640047+0000","last_unstale":"2024-09-21T07:12:14.691224+0000","last_undegraded":"2024-09-21T07:12:14.691224+0000","last_fullsized":"2024-09-21T07:12:14.691224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:42.640908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834870+0000","last_change":"2024-09-21T07:10:53.473862+0000","last_active":"2024-09-21T07:12:43.834870+0000","last_peered":"2024-09-21T07:12:43.834870+0000","last_clean":"2024-09-21T07:12:43.834870+0000","last_became_active":"2024-09-21T07:10:53.473526+0000","last_became_peered":"2024-09-21T07:10:53.473526+0000","last_unstale":"2024-09-21T07:12:43.834870+0000","last_undegraded":"2024-09-21T07:12:43.834870+0000","last_fullsized":"2024-09-21T07:12:43.834870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.389566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693155+0000","last_change":"2024-09-21T07:10:51.468003+0000","last_active":"2024-09-21T07:12:14.693155+0000","last_peered":"2024-09-21T07:12:14.693155+0000","last_clean":"2024-09-21T07:12:14.693155+0000","last_became_active":"2024-09-21T07:10:51.467603+0000","last_became_peered":"2024-09-21T07:10:51.467603+0000","last_unstale":"2024-09-21T07:12:14.693155+0000","last_undegraded":"2024-09-21T07:12:14.693155+0000","last_fullsized":"2024-09-21T07:12:14.693155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:02.148721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690206+0000","last_change":"2024-09-21T07:11:00.550434+0000","last_active":"2024-09-21T07:12:14.690206+0000","last_peered":"2024-09-21T07:12:14.690206+0000","last_clean":"2024-09-21T07:12:14.690206+0000","last_became_active":"2024-09-21T07:11:00.549949+0000","last_became_peered":"2024-09-21T07:11:00.549949+0000","last_unstale":"2024-09-21T07:12:14.690206+0000","last_undegraded":"2024-09-21T07:12:14.690206+0000","last_fullsized":"2024-09-21T07:12:14.690206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:53.737978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839518+0000","last_change":"2024-09-21T07:12:14.690832+0000","last_active":"2024-09-21T07:12:43.839518+0000","last_peered":"2024-09-21T07:12:43.839518+0000","last_clean":"2024-09-21T07:12:43.839518+0000","last_became_active":"2024-09-21T07:12:14.690361+0000","last_became_peered":"2024-09-21T07:12:14.690361+0000","last_unstale":"2024-09-21T07:12:43.839518+0000","last_undegraded":"2024-09-21T07:12:43.839518+0000","last_fullsized":"2024-09-21T07:12:43.839518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:00.772213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:10:51.468201+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:10:51.467754+0000","last_became_peered":"2024-09-21T07:10:51.467754+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:52.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692198+0000","last_change":"2024-09-21T07:11:00.640653+0000","last_active":"2024-09-21T07:12:14.692198+0000","last_peered":"2024-09-21T07:12:14.692198+0000","last_clean":"2024-09-21T07:12:14.692198+0000","last_became_active":"2024-09-21T07:11:00.640080+0000","last_became_peered":"2024-09-21T07:11:00.640080+0000","last_unstale":"2024-09-21T07:12:14.692198+0000","last_undegraded":"2024-09-21T07:12:14.692198+0000","last_fullsized":"2024-09-21T07:12:14.692198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:24.124088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840328+0000","last_change":"2024-09-21T07:10:53.494222+0000","last_active":"2024-09-21T07:12:43.840328+0000","last_peered":"2024-09-21T07:12:43.840328+0000","last_clean":"2024-09-21T07:12:43.840328+0000","last_became_active":"2024-09-21T07:10:53.493703+0000","last_became_peered":"2024-09-21T07:10:53.493703+0000","last_unstale":"2024-09-21T07:12:43.840328+0000","last_undegraded":"2024-09-21T07:12:43.840328+0000","last_fullsized":"2024-09-21T07:12:43.840328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:21.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:17.897550+0000","last_change":"2024-09-21T07:10:51.461095+0000","last_active":"2024-09-21T07:13:17.897550+0000","last_peered":"2024-09-21T07:13:17.897550+0000","last_clean":"2024-09-21T07:13:17.897550+0000","last_became_active":"2024-09-21T07:10:51.460738+0000","last_became_peered":"2024-09-21T07:10:51.460738+0000","last_unstale":"2024-09-21T07:13:17.897550+0000","last_undegraded":"2024-09-21T07:13:17.897550+0000","last_fullsized":"2024-09-21T07:13:17.897550+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:55.593391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686398+0000","last_change":"2024-09-21T07:11:00.544788+0000","last_active":"2024-09-21T07:12:14.686398+0000","last_peered":"2024-09-21T07:12:14.686398+0000","last_clean":"2024-09-21T07:12:14.686398+0000","last_became_active":"2024-09-21T07:11:00.544370+0000","last_became_peered":"2024-09-21T07:11:00.544370+0000","last_unstale":"2024-09-21T07:12:14.686398+0000","last_undegraded":"2024-09-21T07:12:14.686398+0000","last_fullsized":"2024-09-21T07:12:14.686398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.154867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839305+0000","last_change":"2024-09-21T07:10:53.486715+0000","last_active":"2024-09-21T07:12:43.839305+0000","last_peered":"2024-09-21T07:12:43.839305+0000","last_clean":"2024-09-21T07:12:43.839305+0000","last_became_active":"2024-09-21T07:10:53.486315+0000","last_became_peered":"2024-09-21T07:10:53.486315+0000","last_unstale":"2024-09-21T07:12:43.839305+0000","last_undegraded":"2024-09-21T07:12:43.839305+0000","last_fullsized":"2024-09-21T07:12:43.839305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:00.124269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'7","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:19.899057+0000","last_change":"2024-09-21T07:10:51.467102+0000","last_active":"2024-09-21T07:13:19.899057+0000","last_peered":"2024-09-21T07:13:19.899057+0000","last_clean":"2024-09-21T07:13:19.899057+0000","last_became_active":"2024-09-21T07:10:51.466721+0000","last_became_peered":"2024-09-21T07:10:51.466721+0000","last_unstale":"2024-09-21T07:13:19.899057+0000","last_undegraded":"2024-09-21T07:13:19.899057+0000","last_fullsized":"2024-09-21T07:13:19.899057+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686198+0000","last_change":"2024-09-21T07:11:00.640622+0000","last_active":"2024-09-21T07:12:14.686198+0000","last_peered":"2024-09-21T07:12:14.686198+0000","last_clean":"2024-09-21T07:12:14.686198+0000","last_became_active":"2024-09-21T07:11:00.640104+0000","last_became_peered":"2024-09-21T07:11:00.640104+0000","last_unstale":"2024-09-21T07:12:14.686198+0000","last_undegraded":"2024-09-21T07:12:14.686198+0000","last_fullsized":"2024-09-21T07:12:14.686198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:12.023561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825104+0000","last_change":"2024-09-21T07:10:53.478175+0000","last_active":"2024-09-21T07:12:43.825104+0000","last_peered":"2024-09-21T07:12:43.825104+0000","last_clean":"2024-09-21T07:12:43.825104+0000","last_became_active":"2024-09-21T07:10:53.477831+0000","last_became_peered":"2024-09-21T07:10:53.477831+0000","last_unstale":"2024-09-21T07:12:43.825104+0000","last_undegraded":"2024-09-21T07:12:43.825104+0000","last_fullsized":"2024-09-21T07:12:43.825104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:27.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689665+0000","last_change":"2024-09-21T07:10:51.466318+0000","last_active":"2024-09-21T07:12:14.689665+0000","last_peered":"2024-09-21T07:12:14.689665+0000","last_clean":"2024-09-21T07:12:14.689665+0000","last_became_active":"2024-09-21T07:10:51.465983+0000","last_became_peered":"2024-09-21T07:10:51.465983+0000","last_unstale":"2024-09-21T07:12:14.689665+0000","last_undegraded":"2024-09-21T07:12:14.689665+0000","last_fullsized":"2024-09-21T07:12:14.689665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:08.432949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691834+0000","last_change":"2024-09-21T07:11:00.641364+0000","last_active":"2024-09-21T07:12:14.691834+0000","last_peered":"2024-09-21T07:12:14.691834+0000","last_clean":"2024-09-21T07:12:14.691834+0000","last_became_active":"2024-09-21T07:11:00.640879+0000","last_became_peered":"2024-09-21T07:11:00.640879+0000","last_unstale":"2024-09-21T07:12:14.691834+0000","last_undegraded":"2024-09-21T07:12:14.691834+0000","last_fullsized":"2024-09-21T07:12:14.691834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:16.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825148+0000","last_change":"2024-09-21T07:10:53.483709+0000","last_active":"2024-09-21T07:12:43.825148+0000","last_peered":"2024-09-21T07:12:43.825148+0000","last_clean":"2024-09-21T07:12:43.825148+0000","last_became_active":"2024-09-21T07:10:53.483355+0000","last_became_peered":"2024-09-21T07:10:53.483355+0000","last_unstale":"2024-09-21T07:12:43.825148+0000","last_undegraded":"2024-09-21T07:12:43.825148+0000","last_fullsized":"2024-09-21T07:12:43.825148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.702168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806593+0000","last_change":"2024-09-21T07:10:51.464239+0000","last_active":"2024-09-21T07:12:14.806593+0000","last_peered":"2024-09-21T07:12:14.806593+0000","last_clean":"2024-09-21T07:12:14.806593+0000","last_became_active":"2024-09-21T07:10:51.463828+0000","last_became_peered":"2024-09-21T07:10:51.463828+0000","last_unstale":"2024-09-21T07:12:14.806593+0000","last_undegraded":"2024-09-21T07:12:14.806593+0000","last_fullsized":"2024-09-21T07:12:14.806593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:09.580668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690229+0000","last_change":"2024-09-21T07:09:39.332523+0000","last_active":"2024-09-21T07:12:14.690229+0000","last_peered":"2024-09-21T07:12:14.690229+0000","last_clean":"2024-09-21T07:12:14.690229+0000","last_became_active":"2024-09-21T07:09:39.326582+0000","last_became_peered":"2024-09-21T07:09:39.326582+0000","last_unstale":"2024-09-21T07:12:14.690229+0000","last_undegraded":"2024-09-21T07:12:14.690229+0000","last_fullsized":"2024-09-21T07:12:14.690229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_clean_scrub_stamp":"2024-09-21T07:06:12.748818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690079+0000","last_change":"2024-09-21T07:11:14.672044+0000","last_active":"2024-09-21T07:12:14.690079+0000","last_peered":"2024-09-21T07:12:14.690079+0000","last_clean":"2024-09-21T07:12:14.690079+0000","last_became_active":"2024-09-21T07:11:14.671513+0000","last_became_peered":"2024-09-21T07:11:14.671513+0000","last_unstale":"2024-09-21T07:12:14.690079+0000","last_undegraded":"2024-09-21T07:12:14.690079+0000","last_fullsized":"2024-09-21T07:12:14.690079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:09.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842250+0000","last_change":"2024-09-21T07:10:53.488678+0000","last_active":"2024-09-21T07:12:43.842250+0000","last_peered":"2024-09-21T07:12:43.842250+0000","last_clean":"2024-09-21T07:12:43.842250+0000","last_became_active":"2024-09-21T07:10:53.488304+0000","last_became_peered":"2024-09-21T07:10:53.488304+0000","last_unstale":"2024-09-21T07:12:43.842250+0000","last_undegraded":"2024-09-21T07:12:43.842250+0000","last_fullsized":"2024-09-21T07:12:43.842250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:37.696269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.897310+0000","last_change":"2024-09-21T07:10:52.123086+0000","last_active":"2024-09-21T07:13:16.897310+0000","last_peered":"2024-09-21T07:13:16.897310+0000","last_clean":"2024-09-21T07:13:16.897310+0000","last_became_active":"2024-09-21T07:10:52.122584+0000","last_became_peered":"2024-09-21T07:10:52.122584+0000","last_unstale":"2024-09-21T07:13:16.897310+0000","last_undegraded":"2024-09-21T07:13:16.897310+0000","last_fullsized":"2024-09-21T07:13:16.897310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:28.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692332+0000","last_change":"2024-09-21T07:11:00.549595+0000","last_active":"2024-09-21T07:12:14.692332+0000","last_peered":"2024-09-21T07:12:14.692332+0000","last_clean":"2024-09-21T07:12:14.692332+0000","last_became_active":"2024-09-21T07:11:00.549009+0000","last_became_peered":"2024-09-21T07:11:00.549009+0000","last_unstale":"2024-09-21T07:12:14.692332+0000","last_undegraded":"2024-09-21T07:12:14.692332+0000","last_fullsized":"2024-09-21T07:12:14.692332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:59.825381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836215+0000","last_change":"2024-09-21T07:10:53.484336+0000","last_active":"2024-09-21T07:12:43.836215+0000","last_peered":"2024-09-21T07:12:43.836215+0000","last_clean":"2024-09-21T07:12:43.836215+0000","last_became_active":"2024-09-21T07:10:53.483825+0000","last_became_peered":"2024-09-21T07:10:53.483825+0000","last_unstale":"2024-09-21T07:12:43.836215+0000","last_undegraded":"2024-09-21T07:12:43.836215+0000","last_fullsized":"2024-09-21T07:12:43.836215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.545339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691375+0000","last_change":"2024-09-21T07:10:51.461297+0000","last_active":"2024-09-21T07:12:14.691375+0000","last_peered":"2024-09-21T07:12:14.691375+0000","last_clean":"2024-09-21T07:12:14.691375+0000","last_became_active":"2024-09-21T07:10:51.460600+0000","last_became_peered":"2024-09-21T07:10:51.460600+0000","last_unstale":"2024-09-21T07:12:14.691375+0000","last_undegraded":"2024-09-21T07:12:14.691375+0000","last_fullsized":"2024-09-21T07:12:14.691375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:34.955250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998589+0000","last_change":"2024-09-21T07:11:00.551652+0000","last_active":"2024-09-21T07:12:14.998589+0000","last_peered":"2024-09-21T07:12:14.998589+0000","last_clean":"2024-09-21T07:12:14.998589+0000","last_became_active":"2024-09-21T07:11:00.551236+0000","last_became_peered":"2024-09-21T07:11:00.551236+0000","last_unstale":"2024-09-21T07:12:14.998589+0000","last_undegraded":"2024-09-21T07:12:14.998589+0000","last_fullsized":"2024-09-21T07:12:14.998589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:28.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833526+0000","last_change":"2024-09-21T07:10:53.487605+0000","last_active":"2024-09-21T07:12:43.833526+0000","last_peered":"2024-09-21T07:12:43.833526+0000","last_clean":"2024-09-21T07:12:43.833526+0000","last_became_active":"2024-09-21T07:10:53.487245+0000","last_became_peered":"2024-09-21T07:10:53.487245+0000","last_unstale":"2024-09-21T07:12:43.833526+0000","last_undegraded":"2024-09-21T07:12:43.833526+0000","last_fullsized":"2024-09-21T07:12:43.833526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:24.490652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686405+0000","last_change":"2024-09-21T07:10:51.456920+0000","last_active":"2024-09-21T07:12:14.686405+0000","last_peered":"2024-09-21T07:12:14.686405+0000","last_clean":"2024-09-21T07:12:14.686405+0000","last_became_active":"2024-09-21T07:10:51.456500+0000","last_became_peered":"2024-09-21T07:10:51.456500+0000","last_unstale":"2024-09-21T07:12:14.686405+0000","last_undegraded":"2024-09-21T07:12:14.686405+0000","last_fullsized":"2024-09-21T07:12:14.686405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:07.663192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690452+0000","last_change":"2024-09-21T07:11:00.552115+0000","last_active":"2024-09-21T07:12:14.690452+0000","last_peered":"2024-09-21T07:12:14.690452+0000","last_clean":"2024-09-21T07:12:14.690452+0000","last_became_active":"2024-09-21T07:11:00.551647+0000","last_became_peered":"2024-09-21T07:11:00.551647+0000","last_unstale":"2024-09-21T07:12:14.690452+0000","last_undegraded":"2024-09-21T07:12:14.690452+0000","last_fullsized":"2024-09-21T07:12:14.690452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:13.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834739+0000","last_change":"2024-09-21T07:11:14.671714+0000","last_active":"2024-09-21T07:12:43.834739+0000","last_peered":"2024-09-21T07:12:43.834739+0000","last_clean":"2024-09-21T07:12:43.834739+0000","last_became_active":"2024-09-21T07:11:14.671248+0000","last_became_peered":"2024-09-21T07:11:14.671248+0000","last_unstale":"2024-09-21T07:12:43.834739+0000","last_undegraded":"2024-09-21T07:12:43.834739+0000","last_fullsized":"2024-09-21T07:12:43.834739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:36.599916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:06.740009+0000","last_change":"2024-09-21T07:10:51.464710+0000","last_active":"2024-09-21T07:13:06.740009+0000","last_peered":"2024-09-21T07:13:06.740009+0000","last_clean":"2024-09-21T07:13:06.740009+0000","last_became_active":"2024-09-21T07:10:51.464295+0000","last_became_peered":"2024-09-21T07:10:51.464295+0000","last_unstale":"2024-09-21T07:13:06.740009+0000","last_undegraded":"2024-09-21T07:13:06.740009+0000","last_fullsized":"2024-09-21T07:13:06.740009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:00.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691150+0000","last_change":"2024-09-21T07:11:00.548275+0000","last_active":"2024-09-21T07:12:14.691150+0000","last_peered":"2024-09-21T07:12:14.691150+0000","last_clean":"2024-09-21T07:12:14.691150+0000","last_became_active":"2024-09-21T07:11:00.547777+0000","last_became_peered":"2024-09-21T07:11:00.547777+0000","last_unstale":"2024-09-21T07:12:14.691150+0000","last_undegraded":"2024-09-21T07:12:14.691150+0000","last_fullsized":"2024-09-21T07:12:14.691150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:13.860131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840327+0000","last_change":"2024-09-21T07:10:53.494072+0000","last_active":"2024-09-21T07:12:43.840327+0000","last_peered":"2024-09-21T07:12:43.840327+0000","last_clean":"2024-09-21T07:12:43.840327+0000","last_became_active":"2024-09-21T07:10:53.493493+0000","last_became_peered":"2024-09-21T07:10:53.493493+0000","last_unstale":"2024-09-21T07:12:43.840327+0000","last_undegraded":"2024-09-21T07:12:43.840327+0000","last_fullsized":"2024-09-21T07:12:43.840327+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.846641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":58,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692149+0000","last_change":"2024-09-21T07:10:51.468145+0000","last_active":"2024-09-21T07:12:14.692149+0000","last_peered":"2024-09-21T07:12:14.692149+0000","last_clean":"2024-09-21T07:12:14.692149+0000","last_became_active":"2024-09-21T07:10:51.467757+0000","last_became_peered":"2024-09-21T07:10:51.467757+0000","last_unstale":"2024-09-21T07:12:14.692149+0000","last_undegraded":"2024-09-21T07:12:14.692149+0000","last_fullsized":"2024-09-21T07:12:14.692149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:39.150277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686223+0000","last_change":"2024-09-21T07:11:00.548394+0000","last_active":"2024-09-21T07:12:14.686223+0000","last_peered":"2024-09-21T07:12:14.686223+0000","last_clean":"2024-09-21T07:12:14.686223+0000","last_became_active":"2024-09-21T07:11:00.547972+0000","last_became_peered":"2024-09-21T07:11:00.547972+0000","last_unstale":"2024-09-21T07:12:14.686223+0000","last_undegraded":"2024-09-21T07:12:14.686223+0000","last_fullsized":"2024-09-21T07:12:14.686223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:35.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.819250+0000","last_change":"2024-09-21T07:11:14.659248+0000","last_active":"2024-09-21T07:12:43.819250+0000","last_peered":"2024-09-21T07:12:43.819250+0000","last_clean":"2024-09-21T07:12:43.819250+0000","last_became_active":"2024-09-21T07:11:14.658931+0000","last_became_peered":"2024-09-21T07:11:14.658931+0000","last_unstale":"2024-09-21T07:12:43.819250+0000","last_undegraded":"2024-09-21T07:12:43.819250+0000","last_fullsized":"2024-09-21T07:12:43.819250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:12.278964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'9","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:18.898289+0000","last_change":"2024-09-21T07:10:51.466302+0000","last_active":"2024-09-21T07:13:18.898289+0000","last_peered":"2024-09-21T07:13:18.898289+0000","last_clean":"2024-09-21T07:13:18.898289+0000","last_became_active":"2024-09-21T07:10:51.465906+0000","last_became_peered":"2024-09-21T07:10:51.465906+0000","last_unstale":"2024-09-21T07:13:18.898289+0000","last_undegraded":"2024-09-21T07:13:18.898289+0000","last_fullsized":"2024-09-21T07:13:18.898289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:39.616338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689493+0000","last_change":"2024-09-21T07:11:00.555600+0000","last_active":"2024-09-21T07:12:14.689493+0000","last_peered":"2024-09-21T07:12:14.689493+0000","last_clean":"2024-09-21T07:12:14.689493+0000","last_became_active":"2024-09-21T07:11:00.555203+0000","last_became_peered":"2024-09-21T07:11:00.555203+0000","last_unstale":"2024-09-21T07:12:14.689493+0000","last_undegraded":"2024-09-21T07:12:14.689493+0000","last_fullsized":"2024-09-21T07:12:14.689493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838290+0000","last_change":"2024-09-21T07:10:53.482493+0000","last_active":"2024-09-21T07:12:43.838290+0000","last_peered":"2024-09-21T07:12:43.838290+0000","last_clean":"2024-09-21T07:12:43.838290+0000","last_became_active":"2024-09-21T07:10:53.481310+0000","last_became_peered":"2024-09-21T07:10:53.481310+0000","last_unstale":"2024-09-21T07:12:43.838290+0000","last_undegraded":"2024-09-21T07:12:43.838290+0000","last_fullsized":"2024-09-21T07:12:43.838290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:41.288008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691304+0000","last_change":"2024-09-21T07:10:51.468189+0000","last_active":"2024-09-21T07:12:14.691304+0000","last_peered":"2024-09-21T07:12:14.691304+0000","last_clean":"2024-09-21T07:12:14.691304+0000","last_became_active":"2024-09-21T07:10:51.467770+0000","last_became_peered":"2024-09-21T07:10:51.467770+0000","last_unstale":"2024-09-21T07:12:14.691304+0000","last_undegraded":"2024-09-21T07:12:14.691304+0000","last_fullsized":"2024-09-21T07:12:14.691304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:53.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689286+0000","last_change":"2024-09-21T07:11:00.556306+0000","last_active":"2024-09-21T07:12:14.689286+0000","last_peered":"2024-09-21T07:12:14.689286+0000","last_clean":"2024-09-21T07:12:14.689286+0000","last_became_active":"2024-09-21T07:11:00.555770+0000","last_became_peered":"2024-09-21T07:11:00.555770+0000","last_unstale":"2024-09-21T07:12:14.689286+0000","last_undegraded":"2024-09-21T07:12:14.689286+0000","last_fullsized":"2024-09-21T07:12:14.689286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:19.438869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839202+0000","last_change":"2024-09-21T07:10:53.485039+0000","last_active":"2024-09-21T07:12:43.839202+0000","last_peered":"2024-09-21T07:12:43.839202+0000","last_clean":"2024-09-21T07:12:43.839202+0000","last_became_active":"2024-09-21T07:10:53.484672+0000","last_became_peered":"2024-09-21T07:10:53.484672+0000","last_unstale":"2024-09-21T07:12:43.839202+0000","last_undegraded":"2024-09-21T07:12:43.839202+0000","last_fullsized":"2024-09-21T07:12:43.839202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:28.291602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.709692+0000","last_change":"2024-09-21T07:12:14.709213+0000","last_active":"2024-09-21T07:12:14.709692+0000","last_peered":"2024-09-21T07:12:14.709692+0000","last_clean":"2024-09-21T07:12:14.709692+0000","last_became_active":"2024-09-21T07:12:14.693406+0000","last_became_peered":"2024-09-21T07:12:14.693406+0000","last_unstale":"2024-09-21T07:12:14.709692+0000","last_undegraded":"2024-09-21T07:12:14.709692+0000","last_fullsized":"2024-09-21T07:12:14.709692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:25.204575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687428+0000","last_change":"2024-09-21T07:11:14.672269+0000","last_active":"2024-09-21T07:12:14.687428+0000","last_peered":"2024-09-21T07:12:14.687428+0000","last_clean":"2024-09-21T07:12:14.687428+0000","last_became_active":"2024-09-21T07:11:14.671740+0000","last_became_peered":"2024-09-21T07:11:14.671740+0000","last_unstale":"2024-09-21T07:12:14.687428+0000","last_undegraded":"2024-09-21T07:12:14.687428+0000","last_fullsized":"2024-09-21T07:12:14.687428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.600585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831504+0000","last_change":"2024-09-21T07:10:53.487667+0000","last_active":"2024-09-21T07:12:43.831504+0000","last_peered":"2024-09-21T07:12:43.831504+0000","last_clean":"2024-09-21T07:12:43.831504+0000","last_became_active":"2024-09-21T07:10:53.487316+0000","last_became_peered":"2024-09-21T07:10:53.487316+0000","last_unstale":"2024-09-21T07:12:43.831504+0000","last_undegraded":"2024-09-21T07:12:43.831504+0000","last_fullsized":"2024-09-21T07:12:43.831504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:33.545631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'39","reported_seq":297,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.897154+0000","last_change":"2024-09-21T07:10:51.465172+0000","last_active":"2024-09-21T07:13:16.897154+0000","last_peered":"2024-09-21T07:13:16.897154+0000","last_clean":"2024-09-21T07:13:16.897154+0000","last_became_active":"2024-09-21T07:10:51.464655+0000","last_became_peered":"2024-09-21T07:10:51.464655+0000","last_unstale":"2024-09-21T07:13:16.897154+0000","last_undegraded":"2024-09-21T07:13:16.897154+0000","last_fullsized":"2024-09-21T07:13:16.897154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:02.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66954,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":176,"num_write":41,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686973+0000","last_change":"2024-09-21T07:11:14.671892+0000","last_active":"2024-09-21T07:12:14.686973+0000","last_peered":"2024-09-21T07:12:14.686973+0000","last_clean":"2024-09-21T07:12:14.686973+0000","last_became_active":"2024-09-21T07:11:14.671283+0000","last_became_peered":"2024-09-21T07:11:14.671283+0000","last_unstale":"2024-09-21T07:12:14.686973+0000","last_undegraded":"2024-09-21T07:12:14.686973+0000","last_fullsized":"2024-09-21T07:12:14.686973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:54.263127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839267+0000","last_change":"2024-09-21T07:10:53.491873+0000","last_active":"2024-09-21T07:12:43.839267+0000","last_peered":"2024-09-21T07:12:43.839267+0000","last_clean":"2024-09-21T07:12:43.839267+0000","last_became_active":"2024-09-21T07:10:53.491424+0000","last_became_peered":"2024-09-21T07:10:53.491424+0000","last_unstale":"2024-09-21T07:12:43.839267+0000","last_undegraded":"2024-09-21T07:12:43.839267+0000","last_fullsized":"2024-09-21T07:12:43.839267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.145391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691247+0000","last_change":"2024-09-21T07:10:51.469395+0000","last_active":"2024-09-21T07:12:14.691247+0000","last_peered":"2024-09-21T07:12:14.691247+0000","last_clean":"2024-09-21T07:12:14.691247+0000","last_became_active":"2024-09-21T07:10:51.469015+0000","last_became_peered":"2024-09-21T07:10:51.469015+0000","last_unstale":"2024-09-21T07:12:14.691247+0000","last_undegraded":"2024-09-21T07:12:14.691247+0000","last_fullsized":"2024-09-21T07:12:14.691247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.274950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806037+0000","last_change":"2024-09-21T07:11:00.553164+0000","last_active":"2024-09-21T07:12:14.806037+0000","last_peered":"2024-09-21T07:12:14.806037+0000","last_clean":"2024-09-21T07:12:14.806037+0000","last_became_active":"2024-09-21T07:11:00.551969+0000","last_became_peered":"2024-09-21T07:11:00.551969+0000","last_unstale":"2024-09-21T07:12:14.806037+0000","last_undegraded":"2024-09-21T07:12:14.806037+0000","last_fullsized":"2024-09-21T07:12:14.806037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:53.042065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841473+0000","last_change":"2024-09-21T07:10:53.497110+0000","last_active":"2024-09-21T07:12:43.841473+0000","last_peered":"2024-09-21T07:12:43.841473+0000","last_clean":"2024-09-21T07:12:43.841473+0000","last_became_active":"2024-09-21T07:10:53.496751+0000","last_became_peered":"2024-09-21T07:10:53.496751+0000","last_unstale":"2024-09-21T07:12:43.841473+0000","last_undegraded":"2024-09-21T07:12:43.841473+0000","last_fullsized":"2024-09-21T07:12:43.841473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.531652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.812563+0000","last_change":"2024-09-21T07:12:14.811962+0000","last_active":"2024-09-21T07:12:14.812563+0000","last_peered":"2024-09-21T07:12:14.812563+0000","last_clean":"2024-09-21T07:12:14.812563+0000","last_became_active":"2024-09-21T07:12:14.807745+0000","last_became_peered":"2024-09-21T07:12:14.807745+0000","last_unstale":"2024-09-21T07:12:14.812563+0000","last_undegraded":"2024-09-21T07:12:14.812563+0000","last_fullsized":"2024-09-21T07:12:14.812563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:20.292633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691946+0000","last_change":"2024-09-21T07:11:14.655255+0000","last_active":"2024-09-21T07:12:14.691946+0000","last_peered":"2024-09-21T07:12:14.691946+0000","last_clean":"2024-09-21T07:12:14.691946+0000","last_became_active":"2024-09-21T07:11:14.654556+0000","last_became_peered":"2024-09-21T07:11:14.654556+0000","last_unstale":"2024-09-21T07:12:14.691946+0000","last_undegraded":"2024-09-21T07:12:14.691946+0000","last_fullsized":"2024-09-21T07:12:14.691946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:44.435834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843700+0000","last_change":"2024-09-21T07:10:53.484990+0000","last_active":"2024-09-21T07:12:43.843700+0000","last_peered":"2024-09-21T07:12:43.843700+0000","last_clean":"2024-09-21T07:12:43.843700+0000","last_became_active":"2024-09-21T07:10:53.484570+0000","last_became_peered":"2024-09-21T07:10:53.484570+0000","last_unstale":"2024-09-21T07:12:43.843700+0000","last_undegraded":"2024-09-21T07:12:43.843700+0000","last_fullsized":"2024-09-21T07:12:43.843700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:28.848203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":254,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.896951+0000","last_change":"2024-09-21T07:10:51.463378+0000","last_active":"2024-09-21T07:13:16.896951+0000","last_peered":"2024-09-21T07:13:16.896951+0000","last_clean":"2024-09-21T07:13:16.896951+0000","last_became_active":"2024-09-21T07:10:51.462961+0000","last_became_peered":"2024-09-21T07:10:51.462961+0000","last_unstale":"2024-09-21T07:13:16.896951+0000","last_undegraded":"2024-09-21T07:13:16.896951+0000","last_fullsized":"2024-09-21T07:13:16.896951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:22.637603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691338+0000","last_change":"2024-09-21T07:11:00.549758+0000","last_active":"2024-09-21T07:12:14.691338+0000","last_peered":"2024-09-21T07:12:14.691338+0000","last_clean":"2024-09-21T07:12:14.691338+0000","last_became_active":"2024-09-21T07:11:00.549141+0000","last_became_peered":"2024-09-21T07:11:00.549141+0000","last_unstale":"2024-09-21T07:12:14.691338+0000","last_undegraded":"2024-09-21T07:12:14.691338+0000","last_fullsized":"2024-09-21T07:12:14.691338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:27.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998447+0000","last_change":"2024-09-21T07:11:00.550407+0000","last_active":"2024-09-21T07:12:14.998447+0000","last_peered":"2024-09-21T07:12:14.998447+0000","last_clean":"2024-09-21T07:12:14.998447+0000","last_became_active":"2024-09-21T07:11:00.549930+0000","last_became_peered":"2024-09-21T07:11:00.549930+0000","last_unstale":"2024-09-21T07:12:14.998447+0000","last_undegraded":"2024-09-21T07:12:14.998447+0000","last_fullsized":"2024-09-21T07:12:14.998447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:25.924695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841002+0000","last_change":"2024-09-21T07:10:53.491452+0000","last_active":"2024-09-21T07:12:43.841002+0000","last_peered":"2024-09-21T07:12:43.841002+0000","last_clean":"2024-09-21T07:12:43.841002+0000","last_became_active":"2024-09-21T07:10:53.491106+0000","last_became_peered":"2024-09-21T07:10:53.491106+0000","last_unstale":"2024-09-21T07:12:43.841002+0000","last_undegraded":"2024-09-21T07:12:43.841002+0000","last_fullsized":"2024-09-21T07:12:43.841002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:58.270323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690834+0000","last_change":"2024-09-21T07:10:51.468433+0000","last_active":"2024-09-21T07:12:14.690834+0000","last_peered":"2024-09-21T07:12:14.690834+0000","last_clean":"2024-09-21T07:12:14.690834+0000","last_became_active":"2024-09-21T07:10:51.467810+0000","last_became_peered":"2024-09-21T07:10:51.467810+0000","last_unstale":"2024-09-21T07:12:14.690834+0000","last_undegraded":"2024-09-21T07:12:14.690834+0000","last_fullsized":"2024-09-21T07:12:14.690834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.787584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689774+0000","last_change":"2024-09-21T07:11:00.556866+0000","last_active":"2024-09-21T07:12:14.689774+0000","last_peered":"2024-09-21T07:12:14.689774+0000","last_clean":"2024-09-21T07:12:14.689774+0000","last_became_active":"2024-09-21T07:11:00.555350+0000","last_became_peered":"2024-09-21T07:11:00.555350+0000","last_unstale":"2024-09-21T07:12:14.689774+0000","last_undegraded":"2024-09-21T07:12:14.689774+0000","last_fullsized":"2024-09-21T07:12:14.689774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:46.296771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830507+0000","last_change":"2024-09-21T07:10:53.487210+0000","last_active":"2024-09-21T07:12:43.830507+0000","last_peered":"2024-09-21T07:12:43.830507+0000","last_clean":"2024-09-21T07:12:43.830507+0000","last_became_active":"2024-09-21T07:10:53.485975+0000","last_became_peered":"2024-09-21T07:10:53.485975+0000","last_unstale":"2024-09-21T07:12:43.830507+0000","last_undegraded":"2024-09-21T07:12:43.830507+0000","last_fullsized":"2024-09-21T07:12:43.830507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.685994+0000","last_change":"2024-09-21T07:10:51.456418+0000","last_active":"2024-09-21T07:12:14.685994+0000","last_peered":"2024-09-21T07:12:14.685994+0000","last_clean":"2024-09-21T07:12:14.685994+0000","last_became_active":"2024-09-21T07:10:51.455885+0000","last_became_peered":"2024-09-21T07:10:51.455885+0000","last_unstale":"2024-09-21T07:12:14.685994+0000","last_undegraded":"2024-09-21T07:12:14.685994+0000","last_fullsized":"2024-09-21T07:12:14.685994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:53.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687423+0000","last_change":"2024-09-21T07:10:51.462544+0000","last_active":"2024-09-21T07:12:14.687423+0000","last_peered":"2024-09-21T07:12:14.687423+0000","last_clean":"2024-09-21T07:12:14.687423+0000","last_became_active":"2024-09-21T07:10:51.462075+0000","last_became_peered":"2024-09-21T07:10:51.462075+0000","last_unstale":"2024-09-21T07:12:14.687423+0000","last_undegraded":"2024-09-21T07:12:14.687423+0000","last_fullsized":"2024-09-21T07:12:14.687423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:09.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.837792+0000","last_change":"2024-09-21T07:12:14.694814+0000","last_active":"2024-09-21T07:12:43.837792+0000","last_peered":"2024-09-21T07:12:43.837792+0000","last_clean":"2024-09-21T07:12:43.837792+0000","last_became_active":"2024-09-21T07:12:14.694334+0000","last_became_peered":"2024-09-21T07:12:14.694334+0000","last_unstale":"2024-09-21T07:12:43.837792+0000","last_undegraded":"2024-09-21T07:12:43.837792+0000","last_fullsized":"2024-09-21T07:12:43.837792+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:33.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687029+0000","last_change":"2024-09-21T07:11:00.552908+0000","last_active":"2024-09-21T07:12:14.687029+0000","last_peered":"2024-09-21T07:12:14.687029+0000","last_clean":"2024-09-21T07:12:14.687029+0000","last_became_active":"2024-09-21T07:11:00.552303+0000","last_became_peered":"2024-09-21T07:11:00.552303+0000","last_unstale":"2024-09-21T07:12:14.687029+0000","last_undegraded":"2024-09-21T07:12:14.687029+0000","last_fullsized":"2024-09-21T07:12:14.687029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'8","reported_seq":158,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:17.899377+0000","last_change":"2024-09-21T07:10:51.467072+0000","last_active":"2024-09-21T07:13:17.899377+0000","last_peered":"2024-09-21T07:13:17.899377+0000","last_clean":"2024-09-21T07:13:17.899377+0000","last_became_active":"2024-09-21T07:10:51.466671+0000","last_became_peered":"2024-09-21T07:10:51.466671+0000","last_unstale":"2024-09-21T07:13:17.899377+0000","last_undegraded":"2024-09-21T07:13:17.899377+0000","last_fullsized":"2024-09-21T07:13:17.899377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:24.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833720+0000","last_change":"2024-09-21T07:10:53.480057+0000","last_active":"2024-09-21T07:12:43.833720+0000","last_peered":"2024-09-21T07:12:43.833720+0000","last_clean":"2024-09-21T07:12:43.833720+0000","last_became_active":"2024-09-21T07:10:53.479644+0000","last_became_peered":"2024-09-21T07:10:53.479644+0000","last_unstale":"2024-09-21T07:12:43.833720+0000","last_undegraded":"2024-09-21T07:12:43.833720+0000","last_fullsized":"2024-09-21T07:12:43.833720+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:34.255547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687321+0000","last_change":"2024-09-21T07:11:00.550259+0000","last_active":"2024-09-21T07:12:14.687321+0000","last_peered":"2024-09-21T07:12:14.687321+0000","last_clean":"2024-09-21T07:12:14.687321+0000","last_became_active":"2024-09-21T07:11:00.549771+0000","last_became_peered":"2024-09-21T07:11:00.549771+0000","last_unstale":"2024-09-21T07:12:14.687321+0000","last_undegraded":"2024-09-21T07:12:14.687321+0000","last_fullsized":"2024-09-21T07:12:14.687321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839385+0000","last_change":"2024-09-21T07:10:53.488022+0000","last_active":"2024-09-21T07:12:43.839385+0000","last_peered":"2024-09-21T07:12:43.839385+0000","last_clean":"2024-09-21T07:12:43.839385+0000","last_became_active":"2024-09-21T07:10:53.487605+0000","last_became_peered":"2024-09-21T07:10:53.487605+0000","last_unstale":"2024-09-21T07:12:43.839385+0000","last_undegraded":"2024-09-21T07:12:43.839385+0000","last_fullsized":"2024-09-21T07:12:43.839385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:02.074960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833306+0000","last_change":"2024-09-21T07:10:53.484319+0000","last_active":"2024-09-21T07:12:43.833306+0000","last_peered":"2024-09-21T07:12:43.833306+0000","last_clean":"2024-09-21T07:12:43.833306+0000","last_became_active":"2024-09-21T07:10:53.483942+0000","last_became_peered":"2024-09-21T07:10:53.483942+0000","last_unstale":"2024-09-21T07:12:43.833306+0000","last_undegraded":"2024-09-21T07:12:43.833306+0000","last_fullsized":"2024-09-21T07:12:43.833306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:50.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840566+0000","last_change":"2024-09-21T07:10:53.494981+0000","last_active":"2024-09-21T07:12:43.840566+0000","last_peered":"2024-09-21T07:12:43.840566+0000","last_clean":"2024-09-21T07:12:43.840566+0000","last_became_active":"2024-09-21T07:10:53.494580+0000","last_became_peered":"2024-09-21T07:10:53.494580+0000","last_unstale":"2024-09-21T07:12:43.840566+0000","last_undegraded":"2024-09-21T07:12:43.840566+0000","last_fullsized":"2024-09-21T07:12:43.840566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:57.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842588+0000","last_change":"2024-09-21T07:10:53.492971+0000","last_active":"2024-09-21T07:12:43.842588+0000","last_peered":"2024-09-21T07:12:43.842588+0000","last_clean":"2024-09-21T07:12:43.842588+0000","last_became_active":"2024-09-21T07:10:53.492597+0000","last_became_peered":"2024-09-21T07:10:53.492597+0000","last_unstale":"2024-09-21T07:12:43.842588+0000","last_undegraded":"2024-09-21T07:12:43.842588+0000","last_fullsized":"2024-09-21T07:12:43.842588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.931998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836994+0000","last_change":"2024-09-21T07:10:53.485613+0000","last_active":"2024-09-21T07:12:43.836994+0000","last_peered":"2024-09-21T07:12:43.836994+0000","last_clean":"2024-09-21T07:12:43.836994+0000","last_became_active":"2024-09-21T07:10:53.485268+0000","last_became_peered":"2024-09-21T07:10:53.485268+0000","last_unstale":"2024-09-21T07:12:43.836994+0000","last_undegraded":"2024-09-21T07:12:43.836994+0000","last_fullsized":"2024-09-21T07:12:43.836994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:52.496426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831297+0000","last_change":"2024-09-21T07:10:53.489349+0000","last_active":"2024-09-21T07:12:43.831297+0000","last_peered":"2024-09-21T07:12:43.831297+0000","last_clean":"2024-09-21T07:12:43.831297+0000","last_became_active":"2024-09-21T07:10:53.488986+0000","last_became_peered":"2024-09-21T07:10:53.488986+0000","last_unstale":"2024-09-21T07:12:43.831297+0000","last_undegraded":"2024-09-21T07:12:43.831297+0000","last_fullsized":"2024-09-21T07:12:43.831297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:46.376689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.832429+0000","last_change":"2024-09-21T07:10:53.485740+0000","last_active":"2024-09-21T07:12:43.832429+0000","last_peered":"2024-09-21T07:12:43.832429+0000","last_clean":"2024-09-21T07:12:43.832429+0000","last_became_active":"2024-09-21T07:10:53.485375+0000","last_became_peered":"2024-09-21T07:10:53.485375+0000","last_unstale":"2024-09-21T07:12:43.832429+0000","last_undegraded":"2024-09-21T07:12:43.832429+0000","last_fullsized":"2024-09-21T07:12:43.832429+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:40.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838894+0000","last_change":"2024-09-21T07:10:53.490211+0000","last_active":"2024-09-21T07:12:43.838894+0000","last_peered":"2024-09-21T07:12:43.838894+0000","last_clean":"2024-09-21T07:12:43.838894+0000","last_became_active":"2024-09-21T07:10:53.489504+0000","last_became_peered":"2024-09-21T07:10:53.489504+0000","last_unstale":"2024-09-21T07:12:43.838894+0000","last_undegraded":"2024-09-21T07:12:43.838894+0000","last_fullsized":"2024-09-21T07:12:43.838894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:50.337307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.837945+0000","last_change":"2024-09-21T07:10:53.486064+0000","last_active":"2024-09-21T07:12:43.837945+0000","last_peered":"2024-09-21T07:12:43.837945+0000","last_clean":"2024-09-21T07:12:43.837945+0000","last_became_active":"2024-09-21T07:10:53.485674+0000","last_became_peered":"2024-09-21T07:10:53.485674+0000","last_unstale":"2024-09-21T07:12:43.837945+0000","last_undegraded":"2024-09-21T07:12:43.837945+0000","last_fullsized":"2024-09-21T07:12:43.837945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:55.232795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838941+0000","last_change":"2024-09-21T07:10:53.489008+0000","last_active":"2024-09-21T07:12:43.838941+0000","last_peered":"2024-09-21T07:12:43.838941+0000","last_clean":"2024-09-21T07:12:43.838941+0000","last_became_active":"2024-09-21T07:10:53.488655+0000","last_became_peered":"2024-09-21T07:10:53.488655+0000","last_unstale":"2024-09-21T07:12:43.838941+0000","last_undegraded":"2024-09-21T07:12:43.838941+0000","last_fullsized":"2024-09-21T07:12:43.838941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:42.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843962+0000","last_change":"2024-09-21T07:10:53.490147+0000","last_active":"2024-09-21T07:12:43.843962+0000","last_peered":"2024-09-21T07:12:43.843962+0000","last_clean":"2024-09-21T07:12:43.843962+0000","last_became_active":"2024-09-21T07:10:53.488389+0000","last_became_peered":"2024-09-21T07:10:53.488389+0000","last_unstale":"2024-09-21T07:12:43.843962+0000","last_undegraded":"2024-09-21T07:12:43.843962+0000","last_fullsized":"2024-09-21T07:12:43.843962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:17.729856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840459+0000","last_change":"2024-09-21T07:10:53.486557+0000","last_active":"2024-09-21T07:12:43.840459+0000","last_peered":"2024-09-21T07:12:43.840459+0000","last_clean":"2024-09-21T07:12:43.840459+0000","last_became_active":"2024-09-21T07:10:53.486248+0000","last_became_peered":"2024-09-21T07:10:53.486248+0000","last_unstale":"2024-09-21T07:12:43.840459+0000","last_undegraded":"2024-09-21T07:12:43.840459+0000","last_fullsized":"2024-09-21T07:12:43.840459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.675717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833816+0000","last_change":"2024-09-21T07:10:53.485281+0000","last_active":"2024-09-21T07:12:43.833816+0000","last_peered":"2024-09-21T07:12:43.833816+0000","last_clean":"2024-09-21T07:12:43.833816+0000","last_became_active":"2024-09-21T07:10:53.484732+0000","last_became_peered":"2024-09-21T07:10:53.484732+0000","last_unstale":"2024-09-21T07:12:43.833816+0000","last_undegraded":"2024-09-21T07:12:43.833816+0000","last_fullsized":"2024-09-21T07:12:43.833816+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:53.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836869+0000","last_change":"2024-09-21T07:10:53.483192+0000","last_active":"2024-09-21T07:12:43.836869+0000","last_peered":"2024-09-21T07:12:43.836869+0000","last_clean":"2024-09-21T07:12:43.836869+0000","last_became_active":"2024-09-21T07:10:53.482402+0000","last_became_peered":"2024-09-21T07:10:53.482402+0000","last_unstale":"2024-09-21T07:12:43.836869+0000","last_undegraded":"2024-09-21T07:12:43.836869+0000","last_fullsized":"2024-09-21T07:12:43.836869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.159873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843080+0000","last_change":"2024-09-21T07:10:53.481463+0000","last_active":"2024-09-21T07:12:43.843080+0000","last_peered":"2024-09-21T07:12:43.843080+0000","last_clean":"2024-09-21T07:12:43.843080+0000","last_became_active":"2024-09-21T07:10:53.481129+0000","last_became_peered":"2024-09-21T07:10:53.481129+0000","last_unstale":"2024-09-21T07:12:43.843080+0000","last_undegraded":"2024-09-21T07:12:43.843080+0000","last_fullsized":"2024-09-21T07:12:43.843080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:14.547936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840480+0000","last_change":"2024-09-21T07:10:53.493009+0000","last_active":"2024-09-21T07:12:43.840480+0000","last_peered":"2024-09-21T07:12:43.840480+0000","last_clean":"2024-09-21T07:12:43.840480+0000","last_became_active":"2024-09-21T07:10:53.492300+0000","last_became_peered":"2024-09-21T07:10:53.492300+0000","last_unstale":"2024-09-21T07:12:43.840480+0000","last_undegraded":"2024-09-21T07:12:43.840480+0000","last_fullsized":"2024-09-21T07:12:43.840480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:09.890248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843437+0000","last_change":"2024-09-21T07:10:53.491149+0000","last_active":"2024-09-21T07:12:43.843437+0000","last_peered":"2024-09-21T07:12:43.843437+0000","last_clean":"2024-09-21T07:12:43.843437+0000","last_became_active":"2024-09-21T07:10:53.490766+0000","last_became_peered":"2024-09-21T07:10:53.490766+0000","last_unstale":"2024-09-21T07:12:43.843437+0000","last_undegraded":"2024-09-21T07:12:43.843437+0000","last_fullsized":"2024-09-21T07:12:43.843437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:52.243083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840492+0000","last_change":"2024-09-21T07:11:14.672453+0000","last_active":"2024-09-21T07:12:43.840492+0000","last_peered":"2024-09-21T07:12:43.840492+0000","last_clean":"2024-09-21T07:12:43.840492+0000","last_became_active":"2024-09-21T07:11:14.671584+0000","last_became_peered":"2024-09-21T07:11:14.671584+0000","last_unstale":"2024-09-21T07:12:43.840492+0000","last_undegraded":"2024-09-21T07:12:43.840492+0000","last_fullsized":"2024-09-21T07:12:43.840492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:25.746195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839098+0000","last_change":"2024-09-21T07:10:53.496332+0000","last_active":"2024-09-21T07:12:43.839098+0000","last_peered":"2024-09-21T07:12:43.839098+0000","last_clean":"2024-09-21T07:12:43.839098+0000","last_became_active":"2024-09-21T07:10:53.495078+0000","last_became_peered":"2024-09-21T07:10:53.495078+0000","last_unstale":"2024-09-21T07:12:43.839098+0000","last_undegraded":"2024-09-21T07:12:43.839098+0000","last_fullsized":"2024-09-21T07:12:43.839098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:32.415350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838131+0000","last_change":"2024-09-21T07:10:53.478381+0000","last_active":"2024-09-21T07:12:43.838131+0000","last_peered":"2024-09-21T07:12:43.838131+0000","last_clean":"2024-09-21T07:12:43.838131+0000","last_became_active":"2024-09-21T07:10:53.478021+0000","last_became_peered":"2024-09-21T07:10:53.478021+0000","last_unstale":"2024-09-21T07:12:43.838131+0000","last_undegraded":"2024-09-21T07:12:43.838131+0000","last_fullsized":"2024-09-21T07:12:43.838131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:02.496263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.821141+0000","last_change":"2024-09-21T07:10:53.485103+0000","last_active":"2024-09-21T07:12:43.821141+0000","last_peered":"2024-09-21T07:12:43.821141+0000","last_clean":"2024-09-21T07:12:43.821141+0000","last_became_active":"2024-09-21T07:10:53.483835+0000","last_became_peered":"2024-09-21T07:10:53.483835+0000","last_unstale":"2024-09-21T07:12:43.821141+0000","last_undegraded":"2024-09-21T07:12:43.821141+0000","last_fullsized":"2024-09-21T07:12:43.821141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:47.775202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842539+0000","last_change":"2024-09-21T07:10:53.490497+0000","last_active":"2024-09-21T07:12:43.842539+0000","last_peered":"2024-09-21T07:12:43.842539+0000","last_clean":"2024-09-21T07:12:43.842539+0000","last_became_active":"2024-09-21T07:10:53.490137+0000","last_became_peered":"2024-09-21T07:10:53.490137+0000","last_unstale":"2024-09-21T07:12:43.842539+0000","last_undegraded":"2024-09-21T07:12:43.842539+0000","last_fullsized":"2024-09-21T07:12:43.842539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:12.090628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842305+0000","last_change":"2024-09-21T07:10:53.487118+0000","last_active":"2024-09-21T07:12:43.842305+0000","last_peered":"2024-09-21T07:12:43.842305+0000","last_clean":"2024-09-21T07:12:43.842305+0000","last_became_active":"2024-09-21T07:10:53.486582+0000","last_became_peered":"2024-09-21T07:10:53.486582+0000","last_unstale":"2024-09-21T07:12:43.842305+0000","last_undegraded":"2024-09-21T07:12:43.842305+0000","last_fullsized":"2024-09-21T07:12:43.842305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:00.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839468+0000","last_change":"2024-09-21T07:10:53.497390+0000","last_active":"2024-09-21T07:12:43.839468+0000","last_peered":"2024-09-21T07:12:43.839468+0000","last_clean":"2024-09-21T07:12:43.839468+0000","last_became_active":"2024-09-21T07:10:53.497043+0000","last_became_peered":"2024-09-21T07:10:53.497043+0000","last_unstale":"2024-09-21T07:12:43.839468+0000","last_undegraded":"2024-09-21T07:12:43.839468+0000","last_fullsized":"2024-09-21T07:12:43.839468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:36.912873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.829496+0000","last_change":"2024-09-21T07:10:53.484624+0000","last_active":"2024-09-21T07:12:43.829496+0000","last_peered":"2024-09-21T07:12:43.829496+0000","last_clean":"2024-09-21T07:12:43.829496+0000","last_became_active":"2024-09-21T07:10:53.484278+0000","last_became_peered":"2024-09-21T07:10:53.484278+0000","last_unstale":"2024-09-21T07:12:43.829496+0000","last_undegraded":"2024-09-21T07:12:43.829496+0000","last_fullsized":"2024-09-21T07:12:43.829496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:41.464442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836192+0000","last_change":"2024-09-21T07:10:53.478146+0000","last_active":"2024-09-21T07:12:43.836192+0000","last_peered":"2024-09-21T07:12:43.836192+0000","last_clean":"2024-09-21T07:12:43.836192+0000","last_became_active":"2024-09-21T07:10:53.477733+0000","last_became_peered":"2024-09-21T07:10:53.477733+0000","last_unstale":"2024-09-21T07:12:43.836192+0000","last_undegraded":"2024-09-21T07:12:43.836192+0000","last_fullsized":"2024-09-21T07:12:43.836192+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:09.159966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839738+0000","last_change":"2024-09-21T07:11:14.657274+0000","last_active":"2024-09-21T07:12:43.839738+0000","last_peered":"2024-09-21T07:12:43.839738+0000","last_clean":"2024-09-21T07:12:43.839738+0000","last_became_active":"2024-09-21T07:11:14.656826+0000","last_became_peered":"2024-09-21T07:11:14.656826+0000","last_unstale":"2024-09-21T07:12:43.839738+0000","last_undegraded":"2024-09-21T07:12:43.839738+0000","last_fullsized":"2024-09-21T07:12:43.839738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.688373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830031+0000","last_change":"2024-09-21T07:10:53.481411+0000","last_active":"2024-09-21T07:12:43.830031+0000","last_peered":"2024-09-21T07:12:43.830031+0000","last_clean":"2024-09-21T07:12:43.830031+0000","last_became_active":"2024-09-21T07:10:53.481005+0000","last_became_peered":"2024-09-21T07:10:53.481005+0000","last_unstale":"2024-09-21T07:12:43.830031+0000","last_undegraded":"2024-09-21T07:12:43.830031+0000","last_fullsized":"2024-09-21T07:12:43.830031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:41.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.823757+0000","last_change":"2024-09-21T07:10:53.487481+0000","last_active":"2024-09-21T07:12:43.823757+0000","last_peered":"2024-09-21T07:12:43.823757+0000","last_clean":"2024-09-21T07:12:43.823757+0000","last_became_active":"2024-09-21T07:10:53.486277+0000","last_became_peered":"2024-09-21T07:10:53.486277+0000","last_unstale":"2024-09-21T07:12:43.823757+0000","last_undegraded":"2024-09-21T07:12:43.823757+0000","last_fullsized":"2024-09-21T07:12:43.823757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:57.304382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840517+0000","last_change":"2024-09-21T07:10:53.495971+0000","last_active":"2024-09-21T07:12:43.840517+0000","last_peered":"2024-09-21T07:12:43.840517+0000","last_clean":"2024-09-21T07:12:43.840517+0000","last_became_active":"2024-09-21T07:10:53.495124+0000","last_became_peered":"2024-09-21T07:10:53.495124+0000","last_unstale":"2024-09-21T07:12:43.840517+0000","last_undegraded":"2024-09-21T07:12:43.840517+0000","last_fullsized":"2024-09-21T07:12:43.840517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839940+0000","last_change":"2024-09-21T07:10:53.497538+0000","last_active":"2024-09-21T07:12:43.839940+0000","last_peered":"2024-09-21T07:12:43.839940+0000","last_clean":"2024-09-21T07:12:43.839940+0000","last_became_active":"2024-09-21T07:10:53.496835+0000","last_became_peered":"2024-09-21T07:10:53.496835+0000","last_unstale":"2024-09-21T07:12:43.839940+0000","last_undegraded":"2024-09-21T07:12:43.839940+0000","last_fullsized":"2024-09-21T07:12:43.839940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:17.187282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840355+0000","last_change":"2024-09-21T07:10:53.492646+0000","last_active":"2024-09-21T07:12:43.840355+0000","last_peered":"2024-09-21T07:12:43.840355+0000","last_clean":"2024-09-21T07:12:43.840355+0000","last_became_active":"2024-09-21T07:10:53.491818+0000","last_became_peered":"2024-09-21T07:10:53.491818+0000","last_unstale":"2024-09-21T07:12:43.840355+0000","last_undegraded":"2024-09-21T07:12:43.840355+0000","last_fullsized":"2024-09-21T07:12:43.840355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:37.094158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76803,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1099,"num_read_kb":634,"num_write":274,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":68,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":237278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283164,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710762,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":506747,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906992,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712876,"statfs":{"total":95995035648,"available":95961985024,"internally_reserved":0,"allocated":1118208,"data_stored":1165077,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070517,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":506116,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266746,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":506494,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462975,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1105143,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626499,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":502113,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822729,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":1099207,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986255,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":506719,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":501328,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378712,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":571274,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542237,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":577357,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705763,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":983040,"data_stored":503569,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":70376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:13:22.980 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T07:13:22.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:13:23.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:22 smithi175 ceph-mon[34064]: pgmap v348: 129 pgs: 129 active+clean; 652 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T07:13:23.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.125+0000 7fd87664d640 1 -- 172.21.15.92:0/557564587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8701048d0 msgr2=0x7fd870104ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:23.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.125+0000 7fd87664d640 1 --2- 172.21.15.92:0/557564587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8701048d0 0x7fd870104ce0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd860009900 tx=0x7fd86002a410 comp rx=0 tx=0).stop 2024-09-21T07:13:23.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.125+0000 7fd87664d640 1 -- 172.21.15.92:0/557564587 shutdown_connections 2024-09-21T07:13:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.125+0000 7fd87664d640 1 --2- 172.21.15.92:0/557564587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87010dd30 0x7fd870110220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.125+0000 7fd87664d640 1 --2- 172.21.15.92:0/557564587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd870105220 0x7fd87010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.125+0000 7fd87664d640 1 --2- 172.21.15.92:0/557564587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8701048d0 0x7fd870104ce0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.125+0000 7fd87664d640 1 -- 172.21.15.92:0/557564587 >> 172.21.15.92:0/557564587 conn(0x7fd8700fe380 msgr2=0x7fd8701007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.125+0000 7fd87664d640 1 -- 172.21.15.92:0/557564587 shutdown_connections 2024-09-21T07:13:23.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.125+0000 7fd87664d640 1 -- 172.21.15.92:0/557564587 wait complete. 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd87664d640 1 Processor -- start 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd87664d640 1 -- start start 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd87664d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8701048d0 0x7fd87019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd87664d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870105220 0x7fd87019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd87664d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87010dd30 0x7fd87019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd87664d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701138b0 con 0x7fd870105220 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd87664d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd870113730 con 0x7fd87010dd30 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd87664d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd870113a30 con 0x7fd8701048d0 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd867fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870105220 0x7fd87019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd867fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870105220 0x7fd87019a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55548/0 (socket says 172.21.15.92:55548) 2024-09-21T07:13:23.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.126+0000 7fd867fff640 1 -- 172.21.15.92:0/3396903483 learned_addr learned my addr 172.21.15.92:0/3396903483 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd874bea640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87010dd30 0x7fd87019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd86ffff640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8701048d0 0x7fd87019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd867fff640 1 -- 172.21.15.92:0/3396903483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8701048d0 msgr2=0x7fd87019a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd867fff640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8701048d0 0x7fd87019a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd867fff640 1 -- 172.21.15.92:0/3396903483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87010dd30 msgr2=0x7fd87019fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd867fff640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87010dd30 0x7fd87019fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd867fff640 1 -- 172.21.15.92:0/3396903483 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8701a0240 con 0x7fd870105220 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd867fff640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870105220 0x7fd87019a8b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd85800e9c0 tx=0x7fd85800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd86dffb640 1 -- 172.21.15.92:0/3396903483 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85800ccc0 con 0x7fd870105220 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd86dffb640 1 -- 172.21.15.92:0/3396903483 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8580054b0 con 0x7fd870105220 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd87664d640 1 -- 172.21.15.92:0/3396903483 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8701a0530 con 0x7fd870105220 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd86dffb640 1 -- 172.21.15.92:0/3396903483 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858010430 con 0x7fd870105220 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.127+0000 7fd87664d640 1 -- 172.21.15.92:0/3396903483 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8701a6cc0 con 0x7fd870105220 2024-09-21T07:13:23.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.128+0000 7fd87664d640 1 -- 172.21.15.92:0/3396903483 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd870104ce0 con 0x7fd870105220 2024-09-21T07:13:23.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.130+0000 7fd86dffb640 1 -- 172.21.15.92:0/3396903483 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7fd858004f00 con 0x7fd870105220 2024-09-21T07:13:23.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.131+0000 7fd86dffb640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd85c0b65f0 0x7fd85c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:23.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.131+0000 7fd86ffff640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd85c0b65f0 0x7fd85c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:23.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.131+0000 7fd86dffb640 1 -- 172.21.15.92:0/3396903483 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd8580e80b0 con 0x7fd870105220 2024-09-21T07:13:23.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.131+0000 7fd86ffff640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd85c0b65f0 0x7fd85c0b8b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd860009230 tx=0x7fd860005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:23.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.134+0000 7fd86dffb640 1 -- 172.21.15.92:0/3396903483 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd858056710 con 0x7fd870105220 2024-09-21T07:13:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:22 smithi169 ceph-mon[33705]: pgmap v348: 129 pgs: 129 active+clean; 652 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T07:13:23.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.309+0000 7fd87664d640 1 -- 172.21.15.92:0/3396903483 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd870107f30 con 0x7fd85c0b65f0 2024-09-21T07:13:23.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.314+0000 7fd86dffb640 1 -- 172.21.15.92:0/3396903483 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340813 (secure 0 0 0) 0x7fd870107f30 con 0x7fd85c0b65f0 2024-09-21T07:13:23.320 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:23.321 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 -- 172.21.15.92:0/3396903483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd85c0b65f0 msgr2=0x7fd85c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd85c0b65f0 0x7fd85c0b8b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd860009230 tx=0x7fd860005fd0 comp rx=0 tx=0).stop 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 -- 172.21.15.92:0/3396903483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870105220 msgr2=0x7fd87019a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870105220 0x7fd87019a8b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd85800e9c0 tx=0x7fd85800ee80 comp rx=0 tx=0).stop 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 -- 172.21.15.92:0/3396903483 shutdown_connections 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd85c0b65f0 0x7fd85c0b8b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd87010dd30 0x7fd87019fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd870105220 0x7fd87019a8b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 --2- 172.21.15.92:0/3396903483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8701048d0 0x7fd87019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 -- 172.21.15.92:0/3396903483 >> 172.21.15.92:0/3396903483 conn(0x7fd8700fe380 msgr2=0x7fd870107820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:23.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 -- 172.21.15.92:0/3396903483 shutdown_connections 2024-09-21T07:13:23.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:23.318+0000 7fd87664d640 1 -- 172.21.15.92:0/3396903483 wait complete. 2024-09-21T07:13:23.331 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-21T07:13:21.624726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667405,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1180,"num_read_kb":703,"num_write":399,"num_write_kb":2318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2951908,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":829,"ondisk_log_size":829,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369364,"kb_used_data":11796,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572460,"statfs":{"total":1151940427776,"available":1151562199040,"internally_reserved":0,"allocated":12079104,"data_stored":8051144,"data_compressed":463053,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2856,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":17,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003657"},"pg_stats":[{"pgid":"2.1f","version":"86'14","reported_seq":159,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.161324+0000","last_change":"2024-09-21T07:10:51.463956+0000","last_active":"2024-09-21T07:13:16.161324+0000","last_peered":"2024-09-21T07:13:16.161324+0000","last_clean":"2024-09-21T07:13:16.161324+0000","last_became_active":"2024-09-21T07:10:51.463564+0000","last_became_peered":"2024-09-21T07:10:51.463564+0000","last_unstale":"2024-09-21T07:13:16.161324+0000","last_undegraded":"2024-09-21T07:13:16.161324+0000","last_fullsized":"2024-09-21T07:13:16.161324+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838602+0000","last_change":"2024-09-21T07:10:53.484379+0000","last_active":"2024-09-21T07:12:43.838602+0000","last_peered":"2024-09-21T07:12:43.838602+0000","last_clean":"2024-09-21T07:12:43.838602+0000","last_became_active":"2024-09-21T07:10:53.484005+0000","last_became_peered":"2024-09-21T07:10:53.484005+0000","last_unstale":"2024-09-21T07:12:43.838602+0000","last_undegraded":"2024-09-21T07:12:43.838602+0000","last_fullsized":"2024-09-21T07:12:43.838602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:27.665257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686808+0000","last_change":"2024-09-21T07:11:00.552729+0000","last_active":"2024-09-21T07:12:14.686808+0000","last_peered":"2024-09-21T07:12:14.686808+0000","last_clean":"2024-09-21T07:12:14.686808+0000","last_became_active":"2024-09-21T07:11:00.552196+0000","last_became_peered":"2024-09-21T07:11:00.552196+0000","last_unstale":"2024-09-21T07:12:14.686808+0000","last_undegraded":"2024-09-21T07:12:14.686808+0000","last_fullsized":"2024-09-21T07:12:14.686808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:35.942717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692173+0000","last_change":"2024-09-21T07:10:51.467798+0000","last_active":"2024-09-21T07:12:14.692173+0000","last_peered":"2024-09-21T07:12:14.692173+0000","last_clean":"2024-09-21T07:12:14.692173+0000","last_became_active":"2024-09-21T07:10:51.467314+0000","last_became_peered":"2024-09-21T07:10:51.467314+0000","last_unstale":"2024-09-21T07:12:14.692173+0000","last_undegraded":"2024-09-21T07:12:14.692173+0000","last_fullsized":"2024-09-21T07:12:14.692173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:21.944378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839226+0000","last_change":"2024-09-21T07:10:53.494849+0000","last_active":"2024-09-21T07:12:43.839226+0000","last_peered":"2024-09-21T07:12:43.839226+0000","last_clean":"2024-09-21T07:12:43.839226+0000","last_became_active":"2024-09-21T07:10:53.494478+0000","last_became_peered":"2024-09-21T07:10:53.494478+0000","last_unstale":"2024-09-21T07:12:43.839226+0000","last_undegraded":"2024-09-21T07:12:43.839226+0000","last_fullsized":"2024-09-21T07:12:43.839226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:38.383547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805630+0000","last_change":"2024-09-21T07:11:00.558306+0000","last_active":"2024-09-21T07:12:14.805630+0000","last_peered":"2024-09-21T07:12:14.805630+0000","last_clean":"2024-09-21T07:12:14.805630+0000","last_became_active":"2024-09-21T07:11:00.557814+0000","last_became_peered":"2024-09-21T07:11:00.557814+0000","last_unstale":"2024-09-21T07:12:14.805630+0000","last_undegraded":"2024-09-21T07:12:14.805630+0000","last_fullsized":"2024-09-21T07:12:14.805630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:31.401788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692968+0000","last_change":"2024-09-21T07:10:51.466831+0000","last_active":"2024-09-21T07:12:14.692968+0000","last_peered":"2024-09-21T07:12:14.692968+0000","last_clean":"2024-09-21T07:12:14.692968+0000","last_became_active":"2024-09-21T07:10:51.466381+0000","last_became_peered":"2024-09-21T07:10:51.466381+0000","last_unstale":"2024-09-21T07:12:14.692968+0000","last_undegraded":"2024-09-21T07:12:14.692968+0000","last_fullsized":"2024-09-21T07:12:14.692968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.559370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843453+0000","last_change":"2024-09-21T07:10:53.485920+0000","last_active":"2024-09-21T07:12:43.843453+0000","last_peered":"2024-09-21T07:12:43.843453+0000","last_clean":"2024-09-21T07:12:43.843453+0000","last_became_active":"2024-09-21T07:10:53.484689+0000","last_became_peered":"2024-09-21T07:10:53.484689+0000","last_unstale":"2024-09-21T07:12:43.843453+0000","last_undegraded":"2024-09-21T07:12:43.843453+0000","last_fullsized":"2024-09-21T07:12:43.843453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:59.951999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806409+0000","last_change":"2024-09-21T07:11:00.558298+0000","last_active":"2024-09-21T07:12:14.806409+0000","last_peered":"2024-09-21T07:12:14.806409+0000","last_clean":"2024-09-21T07:12:14.806409+0000","last_became_active":"2024-09-21T07:11:00.557738+0000","last_became_peered":"2024-09-21T07:11:00.557738+0000","last_unstale":"2024-09-21T07:12:14.806409+0000","last_undegraded":"2024-09-21T07:12:14.806409+0000","last_fullsized":"2024-09-21T07:12:14.806409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:03.037820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692968+0000","last_change":"2024-09-21T07:10:51.464283+0000","last_active":"2024-09-21T07:12:14.692968+0000","last_peered":"2024-09-21T07:12:14.692968+0000","last_clean":"2024-09-21T07:12:14.692968+0000","last_became_active":"2024-09-21T07:10:51.463783+0000","last_became_peered":"2024-09-21T07:10:51.463783+0000","last_unstale":"2024-09-21T07:12:14.692968+0000","last_undegraded":"2024-09-21T07:12:14.692968+0000","last_fullsized":"2024-09-21T07:12:14.692968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:45.298654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842942+0000","last_change":"2024-09-21T07:11:14.671020+0000","last_active":"2024-09-21T07:12:43.842942+0000","last_peered":"2024-09-21T07:12:43.842942+0000","last_clean":"2024-09-21T07:12:43.842942+0000","last_became_active":"2024-09-21T07:11:14.670573+0000","last_became_peered":"2024-09-21T07:11:14.670573+0000","last_unstale":"2024-09-21T07:12:43.842942+0000","last_undegraded":"2024-09-21T07:12:43.842942+0000","last_fullsized":"2024-09-21T07:12:43.842942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.926304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805803+0000","last_change":"2024-09-21T07:11:00.549015+0000","last_active":"2024-09-21T07:12:14.805803+0000","last_peered":"2024-09-21T07:12:14.805803+0000","last_clean":"2024-09-21T07:12:14.805803+0000","last_became_active":"2024-09-21T07:11:00.548561+0000","last_became_peered":"2024-09-21T07:11:00.548561+0000","last_unstale":"2024-09-21T07:12:14.805803+0000","last_undegraded":"2024-09-21T07:12:14.805803+0000","last_fullsized":"2024-09-21T07:12:14.805803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:08.386214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841440+0000","last_change":"2024-09-21T07:10:53.489382+0000","last_active":"2024-09-21T07:12:43.841440+0000","last_peered":"2024-09-21T07:12:43.841440+0000","last_clean":"2024-09-21T07:12:43.841440+0000","last_became_active":"2024-09-21T07:10:53.488987+0000","last_became_peered":"2024-09-21T07:10:53.488987+0000","last_unstale":"2024-09-21T07:12:43.841440+0000","last_undegraded":"2024-09-21T07:12:43.841440+0000","last_fullsized":"2024-09-21T07:12:43.841440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.334840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692508+0000","last_change":"2024-09-21T07:10:51.467203+0000","last_active":"2024-09-21T07:12:14.692508+0000","last_peered":"2024-09-21T07:12:14.692508+0000","last_clean":"2024-09-21T07:12:14.692508+0000","last_became_active":"2024-09-21T07:10:51.466737+0000","last_became_peered":"2024-09-21T07:10:51.466737+0000","last_unstale":"2024-09-21T07:12:14.692508+0000","last_undegraded":"2024-09-21T07:12:14.692508+0000","last_fullsized":"2024-09-21T07:12:14.692508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:26.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806191+0000","last_change":"2024-09-21T07:11:00.640801+0000","last_active":"2024-09-21T07:12:14.806191+0000","last_peered":"2024-09-21T07:12:14.806191+0000","last_clean":"2024-09-21T07:12:14.806191+0000","last_became_active":"2024-09-21T07:11:00.640213+0000","last_became_peered":"2024-09-21T07:11:00.640213+0000","last_unstale":"2024-09-21T07:12:14.806191+0000","last_undegraded":"2024-09-21T07:12:14.806191+0000","last_fullsized":"2024-09-21T07:12:14.806191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:55.801831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841160+0000","last_change":"2024-09-21T07:10:53.491166+0000","last_active":"2024-09-21T07:12:43.841160+0000","last_peered":"2024-09-21T07:12:43.841160+0000","last_clean":"2024-09-21T07:12:43.841160+0000","last_became_active":"2024-09-21T07:10:53.490823+0000","last_became_peered":"2024-09-21T07:10:53.490823+0000","last_unstale":"2024-09-21T07:12:43.841160+0000","last_undegraded":"2024-09-21T07:12:43.841160+0000","last_fullsized":"2024-09-21T07:12:43.841160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:48.661634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:02.728825+0000","last_change":"2024-09-21T07:10:51.461220+0000","last_active":"2024-09-21T07:13:02.728825+0000","last_peered":"2024-09-21T07:13:02.728825+0000","last_clean":"2024-09-21T07:13:02.728825+0000","last_became_active":"2024-09-21T07:10:51.460772+0000","last_became_peered":"2024-09-21T07:10:51.460772+0000","last_unstale":"2024-09-21T07:13:02.728825+0000","last_undegraded":"2024-09-21T07:13:02.728825+0000","last_fullsized":"2024-09-21T07:13:02.728825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:56.488273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806249+0000","last_change":"2024-09-21T07:11:00.558487+0000","last_active":"2024-09-21T07:12:14.806249+0000","last_peered":"2024-09-21T07:12:14.806249+0000","last_clean":"2024-09-21T07:12:14.806249+0000","last_became_active":"2024-09-21T07:11:00.557877+0000","last_became_peered":"2024-09-21T07:11:00.557877+0000","last_unstale":"2024-09-21T07:12:14.806249+0000","last_undegraded":"2024-09-21T07:12:14.806249+0000","last_fullsized":"2024-09-21T07:12:14.806249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:14.614603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840073+0000","last_change":"2024-09-21T07:10:53.489309+0000","last_active":"2024-09-21T07:12:43.840073+0000","last_peered":"2024-09-21T07:12:43.840073+0000","last_clean":"2024-09-21T07:12:43.840073+0000","last_became_active":"2024-09-21T07:10:53.488943+0000","last_became_peered":"2024-09-21T07:10:53.488943+0000","last_unstale":"2024-09-21T07:12:43.840073+0000","last_undegraded":"2024-09-21T07:12:43.840073+0000","last_fullsized":"2024-09-21T07:12:43.840073+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.797176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692071+0000","last_change":"2024-09-21T07:10:51.461078+0000","last_active":"2024-09-21T07:12:14.692071+0000","last_peered":"2024-09-21T07:12:14.692071+0000","last_clean":"2024-09-21T07:12:14.692071+0000","last_became_active":"2024-09-21T07:10:51.460759+0000","last_became_peered":"2024-09-21T07:10:51.460759+0000","last_unstale":"2024-09-21T07:12:14.692071+0000","last_undegraded":"2024-09-21T07:12:14.692071+0000","last_fullsized":"2024-09-21T07:12:14.692071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:37.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:11:00.554766+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:11:00.554374+0000","last_became_peered":"2024-09-21T07:11:00.554374+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:47.038411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825773+0000","last_change":"2024-09-21T07:10:53.487501+0000","last_active":"2024-09-21T07:12:43.825773+0000","last_peered":"2024-09-21T07:12:43.825773+0000","last_clean":"2024-09-21T07:12:43.825773+0000","last_became_active":"2024-09-21T07:10:53.487030+0000","last_became_peered":"2024-09-21T07:10:53.487030+0000","last_unstale":"2024-09-21T07:12:43.825773+0000","last_undegraded":"2024-09-21T07:12:43.825773+0000","last_fullsized":"2024-09-21T07:12:43.825773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692397+0000","last_change":"2024-09-21T07:10:51.468155+0000","last_active":"2024-09-21T07:12:14.692397+0000","last_peered":"2024-09-21T07:12:14.692397+0000","last_clean":"2024-09-21T07:12:14.692397+0000","last_became_active":"2024-09-21T07:10:51.467663+0000","last_became_peered":"2024-09-21T07:10:51.467663+0000","last_unstale":"2024-09-21T07:12:14.692397+0000","last_undegraded":"2024-09-21T07:12:14.692397+0000","last_fullsized":"2024-09-21T07:12:14.692397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:18.176519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806311+0000","last_change":"2024-09-21T07:11:00.641283+0000","last_active":"2024-09-21T07:12:14.806311+0000","last_peered":"2024-09-21T07:12:14.806311+0000","last_clean":"2024-09-21T07:12:14.806311+0000","last_became_active":"2024-09-21T07:11:00.640715+0000","last_became_peered":"2024-09-21T07:11:00.640715+0000","last_unstale":"2024-09-21T07:12:14.806311+0000","last_undegraded":"2024-09-21T07:12:14.806311+0000","last_fullsized":"2024-09-21T07:12:14.806311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:26.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842481+0000","last_change":"2024-09-21T07:11:14.656686+0000","last_active":"2024-09-21T07:12:43.842481+0000","last_peered":"2024-09-21T07:12:43.842481+0000","last_clean":"2024-09-21T07:12:43.842481+0000","last_became_active":"2024-09-21T07:11:14.656259+0000","last_became_peered":"2024-09-21T07:11:14.656259+0000","last_unstale":"2024-09-21T07:12:43.842481+0000","last_undegraded":"2024-09-21T07:12:43.842481+0000","last_fullsized":"2024-09-21T07:12:43.842481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:16.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806776+0000","last_change":"2024-09-21T07:10:52.123260+0000","last_active":"2024-09-21T07:12:14.806776+0000","last_peered":"2024-09-21T07:12:14.806776+0000","last_clean":"2024-09-21T07:12:14.806776+0000","last_became_active":"2024-09-21T07:10:52.122752+0000","last_became_peered":"2024-09-21T07:10:52.122752+0000","last_unstale":"2024-09-21T07:12:14.806776+0000","last_undegraded":"2024-09-21T07:12:14.806776+0000","last_fullsized":"2024-09-21T07:12:14.806776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.041434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686989+0000","last_change":"2024-09-21T07:11:00.549599+0000","last_active":"2024-09-21T07:12:14.686989+0000","last_peered":"2024-09-21T07:12:14.686989+0000","last_clean":"2024-09-21T07:12:14.686989+0000","last_became_active":"2024-09-21T07:11:00.549112+0000","last_became_peered":"2024-09-21T07:11:00.549112+0000","last_unstale":"2024-09-21T07:12:14.686989+0000","last_undegraded":"2024-09-21T07:12:14.686989+0000","last_fullsized":"2024-09-21T07:12:14.686989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:15.209889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.828092+0000","last_change":"2024-09-21T07:10:53.487792+0000","last_active":"2024-09-21T07:12:43.828092+0000","last_peered":"2024-09-21T07:12:43.828092+0000","last_clean":"2024-09-21T07:12:43.828092+0000","last_became_active":"2024-09-21T07:10:53.487460+0000","last_became_peered":"2024-09-21T07:10:53.487460+0000","last_unstale":"2024-09-21T07:12:43.828092+0000","last_undegraded":"2024-09-21T07:12:43.828092+0000","last_fullsized":"2024-09-21T07:12:43.828092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:26.329878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'17","reported_seq":74,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:02.651907+0000","last_change":"2024-09-21T07:12:14.699788+0000","last_active":"2024-09-21T07:13:02.651907+0000","last_peered":"2024-09-21T07:13:02.651907+0000","last_clean":"2024-09-21T07:13:02.651907+0000","last_became_active":"2024-09-21T07:12:14.693355+0000","last_became_peered":"2024-09-21T07:12:14.693355+0000","last_unstale":"2024-09-21T07:13:02.651907+0000","last_undegraded":"2024-09-21T07:13:02.651907+0000","last_fullsized":"2024-09-21T07:13:02.651907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:44.104210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691224+0000","last_change":"2024-09-21T07:11:00.640604+0000","last_active":"2024-09-21T07:12:14.691224+0000","last_peered":"2024-09-21T07:12:14.691224+0000","last_clean":"2024-09-21T07:12:14.691224+0000","last_became_active":"2024-09-21T07:11:00.640047+0000","last_became_peered":"2024-09-21T07:11:00.640047+0000","last_unstale":"2024-09-21T07:12:14.691224+0000","last_undegraded":"2024-09-21T07:12:14.691224+0000","last_fullsized":"2024-09-21T07:12:14.691224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:42.640908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834870+0000","last_change":"2024-09-21T07:10:53.473862+0000","last_active":"2024-09-21T07:12:43.834870+0000","last_peered":"2024-09-21T07:12:43.834870+0000","last_clean":"2024-09-21T07:12:43.834870+0000","last_became_active":"2024-09-21T07:10:53.473526+0000","last_became_peered":"2024-09-21T07:10:53.473526+0000","last_unstale":"2024-09-21T07:12:43.834870+0000","last_undegraded":"2024-09-21T07:12:43.834870+0000","last_fullsized":"2024-09-21T07:12:43.834870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.389566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693155+0000","last_change":"2024-09-21T07:10:51.468003+0000","last_active":"2024-09-21T07:12:14.693155+0000","last_peered":"2024-09-21T07:12:14.693155+0000","last_clean":"2024-09-21T07:12:14.693155+0000","last_became_active":"2024-09-21T07:10:51.467603+0000","last_became_peered":"2024-09-21T07:10:51.467603+0000","last_unstale":"2024-09-21T07:12:14.693155+0000","last_undegraded":"2024-09-21T07:12:14.693155+0000","last_fullsized":"2024-09-21T07:12:14.693155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:02.148721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690206+0000","last_change":"2024-09-21T07:11:00.550434+0000","last_active":"2024-09-21T07:12:14.690206+0000","last_peered":"2024-09-21T07:12:14.690206+0000","last_clean":"2024-09-21T07:12:14.690206+0000","last_became_active":"2024-09-21T07:11:00.549949+0000","last_became_peered":"2024-09-21T07:11:00.549949+0000","last_unstale":"2024-09-21T07:12:14.690206+0000","last_undegraded":"2024-09-21T07:12:14.690206+0000","last_fullsized":"2024-09-21T07:12:14.690206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:53.737978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839518+0000","last_change":"2024-09-21T07:12:14.690832+0000","last_active":"2024-09-21T07:12:43.839518+0000","last_peered":"2024-09-21T07:12:43.839518+0000","last_clean":"2024-09-21T07:12:43.839518+0000","last_became_active":"2024-09-21T07:12:14.690361+0000","last_became_peered":"2024-09-21T07:12:14.690361+0000","last_unstale":"2024-09-21T07:12:43.839518+0000","last_undegraded":"2024-09-21T07:12:43.839518+0000","last_fullsized":"2024-09-21T07:12:43.839518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:00.772213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:10:51.468201+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:10:51.467754+0000","last_became_peered":"2024-09-21T07:10:51.467754+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:52.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692198+0000","last_change":"2024-09-21T07:11:00.640653+0000","last_active":"2024-09-21T07:12:14.692198+0000","last_peered":"2024-09-21T07:12:14.692198+0000","last_clean":"2024-09-21T07:12:14.692198+0000","last_became_active":"2024-09-21T07:11:00.640080+0000","last_became_peered":"2024-09-21T07:11:00.640080+0000","last_unstale":"2024-09-21T07:12:14.692198+0000","last_undegraded":"2024-09-21T07:12:14.692198+0000","last_fullsized":"2024-09-21T07:12:14.692198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:24.124088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840328+0000","last_change":"2024-09-21T07:10:53.494222+0000","last_active":"2024-09-21T07:12:43.840328+0000","last_peered":"2024-09-21T07:12:43.840328+0000","last_clean":"2024-09-21T07:12:43.840328+0000","last_became_active":"2024-09-21T07:10:53.493703+0000","last_became_peered":"2024-09-21T07:10:53.493703+0000","last_unstale":"2024-09-21T07:12:43.840328+0000","last_undegraded":"2024-09-21T07:12:43.840328+0000","last_fullsized":"2024-09-21T07:12:43.840328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:21.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:17.897550+0000","last_change":"2024-09-21T07:10:51.461095+0000","last_active":"2024-09-21T07:13:17.897550+0000","last_peered":"2024-09-21T07:13:17.897550+0000","last_clean":"2024-09-21T07:13:17.897550+0000","last_became_active":"2024-09-21T07:10:51.460738+0000","last_became_peered":"2024-09-21T07:10:51.460738+0000","last_unstale":"2024-09-21T07:13:17.897550+0000","last_undegraded":"2024-09-21T07:13:17.897550+0000","last_fullsized":"2024-09-21T07:13:17.897550+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:55.593391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686398+0000","last_change":"2024-09-21T07:11:00.544788+0000","last_active":"2024-09-21T07:12:14.686398+0000","last_peered":"2024-09-21T07:12:14.686398+0000","last_clean":"2024-09-21T07:12:14.686398+0000","last_became_active":"2024-09-21T07:11:00.544370+0000","last_became_peered":"2024-09-21T07:11:00.544370+0000","last_unstale":"2024-09-21T07:12:14.686398+0000","last_undegraded":"2024-09-21T07:12:14.686398+0000","last_fullsized":"2024-09-21T07:12:14.686398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.154867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839305+0000","last_change":"2024-09-21T07:10:53.486715+0000","last_active":"2024-09-21T07:12:43.839305+0000","last_peered":"2024-09-21T07:12:43.839305+0000","last_clean":"2024-09-21T07:12:43.839305+0000","last_became_active":"2024-09-21T07:10:53.486315+0000","last_became_peered":"2024-09-21T07:10:53.486315+0000","last_unstale":"2024-09-21T07:12:43.839305+0000","last_undegraded":"2024-09-21T07:12:43.839305+0000","last_fullsized":"2024-09-21T07:12:43.839305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:00.124269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'7","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:19.899057+0000","last_change":"2024-09-21T07:10:51.467102+0000","last_active":"2024-09-21T07:13:19.899057+0000","last_peered":"2024-09-21T07:13:19.899057+0000","last_clean":"2024-09-21T07:13:19.899057+0000","last_became_active":"2024-09-21T07:10:51.466721+0000","last_became_peered":"2024-09-21T07:10:51.466721+0000","last_unstale":"2024-09-21T07:13:19.899057+0000","last_undegraded":"2024-09-21T07:13:19.899057+0000","last_fullsized":"2024-09-21T07:13:19.899057+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686198+0000","last_change":"2024-09-21T07:11:00.640622+0000","last_active":"2024-09-21T07:12:14.686198+0000","last_peered":"2024-09-21T07:12:14.686198+0000","last_clean":"2024-09-21T07:12:14.686198+0000","last_became_active":"2024-09-21T07:11:00.640104+0000","last_became_peered":"2024-09-21T07:11:00.640104+0000","last_unstale":"2024-09-21T07:12:14.686198+0000","last_undegraded":"2024-09-21T07:12:14.686198+0000","last_fullsized":"2024-09-21T07:12:14.686198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:12.023561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825104+0000","last_change":"2024-09-21T07:10:53.478175+0000","last_active":"2024-09-21T07:12:43.825104+0000","last_peered":"2024-09-21T07:12:43.825104+0000","last_clean":"2024-09-21T07:12:43.825104+0000","last_became_active":"2024-09-21T07:10:53.477831+0000","last_became_peered":"2024-09-21T07:10:53.477831+0000","last_unstale":"2024-09-21T07:12:43.825104+0000","last_undegraded":"2024-09-21T07:12:43.825104+0000","last_fullsized":"2024-09-21T07:12:43.825104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:27.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689665+0000","last_change":"2024-09-21T07:10:51.466318+0000","last_active":"2024-09-21T07:12:14.689665+0000","last_peered":"2024-09-21T07:12:14.689665+0000","last_clean":"2024-09-21T07:12:14.689665+0000","last_became_active":"2024-09-21T07:10:51.465983+0000","last_became_peered":"2024-09-21T07:10:51.465983+0000","last_unstale":"2024-09-21T07:12:14.689665+0000","last_undegraded":"2024-09-21T07:12:14.689665+0000","last_fullsized":"2024-09-21T07:12:14.689665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:08.432949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691834+0000","last_change":"2024-09-21T07:11:00.641364+0000","last_active":"2024-09-21T07:12:14.691834+0000","last_peered":"2024-09-21T07:12:14.691834+0000","last_clean":"2024-09-21T07:12:14.691834+0000","last_became_active":"2024-09-21T07:11:00.640879+0000","last_became_peered":"2024-09-21T07:11:00.640879+0000","last_unstale":"2024-09-21T07:12:14.691834+0000","last_undegraded":"2024-09-21T07:12:14.691834+0000","last_fullsized":"2024-09-21T07:12:14.691834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:16.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825148+0000","last_change":"2024-09-21T07:10:53.483709+0000","last_active":"2024-09-21T07:12:43.825148+0000","last_peered":"2024-09-21T07:12:43.825148+0000","last_clean":"2024-09-21T07:12:43.825148+0000","last_became_active":"2024-09-21T07:10:53.483355+0000","last_became_peered":"2024-09-21T07:10:53.483355+0000","last_unstale":"2024-09-21T07:12:43.825148+0000","last_undegraded":"2024-09-21T07:12:43.825148+0000","last_fullsized":"2024-09-21T07:12:43.825148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.702168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806593+0000","last_change":"2024-09-21T07:10:51.464239+0000","last_active":"2024-09-21T07:12:14.806593+0000","last_peered":"2024-09-21T07:12:14.806593+0000","last_clean":"2024-09-21T07:12:14.806593+0000","last_became_active":"2024-09-21T07:10:51.463828+0000","last_became_peered":"2024-09-21T07:10:51.463828+0000","last_unstale":"2024-09-21T07:12:14.806593+0000","last_undegraded":"2024-09-21T07:12:14.806593+0000","last_fullsized":"2024-09-21T07:12:14.806593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:09.580668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690229+0000","last_change":"2024-09-21T07:09:39.332523+0000","last_active":"2024-09-21T07:12:14.690229+0000","last_peered":"2024-09-21T07:12:14.690229+0000","last_clean":"2024-09-21T07:12:14.690229+0000","last_became_active":"2024-09-21T07:09:39.326582+0000","last_became_peered":"2024-09-21T07:09:39.326582+0000","last_unstale":"2024-09-21T07:12:14.690229+0000","last_undegraded":"2024-09-21T07:12:14.690229+0000","last_fullsized":"2024-09-21T07:12:14.690229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_clean_scrub_stamp":"2024-09-21T07:06:12.748818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690079+0000","last_change":"2024-09-21T07:11:14.672044+0000","last_active":"2024-09-21T07:12:14.690079+0000","last_peered":"2024-09-21T07:12:14.690079+0000","last_clean":"2024-09-21T07:12:14.690079+0000","last_became_active":"2024-09-21T07:11:14.671513+0000","last_became_peered":"2024-09-21T07:11:14.671513+0000","last_unstale":"2024-09-21T07:12:14.690079+0000","last_undegraded":"2024-09-21T07:12:14.690079+0000","last_fullsized":"2024-09-21T07:12:14.690079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:09.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842250+0000","last_change":"2024-09-21T07:10:53.488678+0000","last_active":"2024-09-21T07:12:43.842250+0000","last_peered":"2024-09-21T07:12:43.842250+0000","last_clean":"2024-09-21T07:12:43.842250+0000","last_became_active":"2024-09-21T07:10:53.488304+0000","last_became_peered":"2024-09-21T07:10:53.488304+0000","last_unstale":"2024-09-21T07:12:43.842250+0000","last_undegraded":"2024-09-21T07:12:43.842250+0000","last_fullsized":"2024-09-21T07:12:43.842250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:37.696269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.897310+0000","last_change":"2024-09-21T07:10:52.123086+0000","last_active":"2024-09-21T07:13:16.897310+0000","last_peered":"2024-09-21T07:13:16.897310+0000","last_clean":"2024-09-21T07:13:16.897310+0000","last_became_active":"2024-09-21T07:10:52.122584+0000","last_became_peered":"2024-09-21T07:10:52.122584+0000","last_unstale":"2024-09-21T07:13:16.897310+0000","last_undegraded":"2024-09-21T07:13:16.897310+0000","last_fullsized":"2024-09-21T07:13:16.897310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:28.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692332+0000","last_change":"2024-09-21T07:11:00.549595+0000","last_active":"2024-09-21T07:12:14.692332+0000","last_peered":"2024-09-21T07:12:14.692332+0000","last_clean":"2024-09-21T07:12:14.692332+0000","last_became_active":"2024-09-21T07:11:00.549009+0000","last_became_peered":"2024-09-21T07:11:00.549009+0000","last_unstale":"2024-09-21T07:12:14.692332+0000","last_undegraded":"2024-09-21T07:12:14.692332+0000","last_fullsized":"2024-09-21T07:12:14.692332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:59.825381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836215+0000","last_change":"2024-09-21T07:10:53.484336+0000","last_active":"2024-09-21T07:12:43.836215+0000","last_peered":"2024-09-21T07:12:43.836215+0000","last_clean":"2024-09-21T07:12:43.836215+0000","last_became_active":"2024-09-21T07:10:53.483825+0000","last_became_peered":"2024-09-21T07:10:53.483825+0000","last_unstale":"2024-09-21T07:12:43.836215+0000","last_undegraded":"2024-09-21T07:12:43.836215+0000","last_fullsized":"2024-09-21T07:12:43.836215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.545339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691375+0000","last_change":"2024-09-21T07:10:51.461297+0000","last_active":"2024-09-21T07:12:14.691375+0000","last_peered":"2024-09-21T07:12:14.691375+0000","last_clean":"2024-09-21T07:12:14.691375+0000","last_became_active":"2024-09-21T07:10:51.460600+0000","last_became_peered":"2024-09-21T07:10:51.460600+0000","last_unstale":"2024-09-21T07:12:14.691375+0000","last_undegraded":"2024-09-21T07:12:14.691375+0000","last_fullsized":"2024-09-21T07:12:14.691375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:34.955250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998589+0000","last_change":"2024-09-21T07:11:00.551652+0000","last_active":"2024-09-21T07:12:14.998589+0000","last_peered":"2024-09-21T07:12:14.998589+0000","last_clean":"2024-09-21T07:12:14.998589+0000","last_became_active":"2024-09-21T07:11:00.551236+0000","last_became_peered":"2024-09-21T07:11:00.551236+0000","last_unstale":"2024-09-21T07:12:14.998589+0000","last_undegraded":"2024-09-21T07:12:14.998589+0000","last_fullsized":"2024-09-21T07:12:14.998589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:28.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833526+0000","last_change":"2024-09-21T07:10:53.487605+0000","last_active":"2024-09-21T07:12:43.833526+0000","last_peered":"2024-09-21T07:12:43.833526+0000","last_clean":"2024-09-21T07:12:43.833526+0000","last_became_active":"2024-09-21T07:10:53.487245+0000","last_became_peered":"2024-09-21T07:10:53.487245+0000","last_unstale":"2024-09-21T07:12:43.833526+0000","last_undegraded":"2024-09-21T07:12:43.833526+0000","last_fullsized":"2024-09-21T07:12:43.833526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:24.490652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686405+0000","last_change":"2024-09-21T07:10:51.456920+0000","last_active":"2024-09-21T07:12:14.686405+0000","last_peered":"2024-09-21T07:12:14.686405+0000","last_clean":"2024-09-21T07:12:14.686405+0000","last_became_active":"2024-09-21T07:10:51.456500+0000","last_became_peered":"2024-09-21T07:10:51.456500+0000","last_unstale":"2024-09-21T07:12:14.686405+0000","last_undegraded":"2024-09-21T07:12:14.686405+0000","last_fullsized":"2024-09-21T07:12:14.686405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:07.663192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690452+0000","last_change":"2024-09-21T07:11:00.552115+0000","last_active":"2024-09-21T07:12:14.690452+0000","last_peered":"2024-09-21T07:12:14.690452+0000","last_clean":"2024-09-21T07:12:14.690452+0000","last_became_active":"2024-09-21T07:11:00.551647+0000","last_became_peered":"2024-09-21T07:11:00.551647+0000","last_unstale":"2024-09-21T07:12:14.690452+0000","last_undegraded":"2024-09-21T07:12:14.690452+0000","last_fullsized":"2024-09-21T07:12:14.690452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:13.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834739+0000","last_change":"2024-09-21T07:11:14.671714+0000","last_active":"2024-09-21T07:12:43.834739+0000","last_peered":"2024-09-21T07:12:43.834739+0000","last_clean":"2024-09-21T07:12:43.834739+0000","last_became_active":"2024-09-21T07:11:14.671248+0000","last_became_peered":"2024-09-21T07:11:14.671248+0000","last_unstale":"2024-09-21T07:12:43.834739+0000","last_undegraded":"2024-09-21T07:12:43.834739+0000","last_fullsized":"2024-09-21T07:12:43.834739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:36.599916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:06.740009+0000","last_change":"2024-09-21T07:10:51.464710+0000","last_active":"2024-09-21T07:13:06.740009+0000","last_peered":"2024-09-21T07:13:06.740009+0000","last_clean":"2024-09-21T07:13:06.740009+0000","last_became_active":"2024-09-21T07:10:51.464295+0000","last_became_peered":"2024-09-21T07:10:51.464295+0000","last_unstale":"2024-09-21T07:13:06.740009+0000","last_undegraded":"2024-09-21T07:13:06.740009+0000","last_fullsized":"2024-09-21T07:13:06.740009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:00.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691150+0000","last_change":"2024-09-21T07:11:00.548275+0000","last_active":"2024-09-21T07:12:14.691150+0000","last_peered":"2024-09-21T07:12:14.691150+0000","last_clean":"2024-09-21T07:12:14.691150+0000","last_became_active":"2024-09-21T07:11:00.547777+0000","last_became_peered":"2024-09-21T07:11:00.547777+0000","last_unstale":"2024-09-21T07:12:14.691150+0000","last_undegraded":"2024-09-21T07:12:14.691150+0000","last_fullsized":"2024-09-21T07:12:14.691150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:13.860131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840327+0000","last_change":"2024-09-21T07:10:53.494072+0000","last_active":"2024-09-21T07:12:43.840327+0000","last_peered":"2024-09-21T07:12:43.840327+0000","last_clean":"2024-09-21T07:12:43.840327+0000","last_became_active":"2024-09-21T07:10:53.493493+0000","last_became_peered":"2024-09-21T07:10:53.493493+0000","last_unstale":"2024-09-21T07:12:43.840327+0000","last_undegraded":"2024-09-21T07:12:43.840327+0000","last_fullsized":"2024-09-21T07:12:43.840327+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.846641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":58,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692149+0000","last_change":"2024-09-21T07:10:51.468145+0000","last_active":"2024-09-21T07:12:14.692149+0000","last_peered":"2024-09-21T07:12:14.692149+0000","last_clean":"2024-09-21T07:12:14.692149+0000","last_became_active":"2024-09-21T07:10:51.467757+0000","last_became_peered":"2024-09-21T07:10:51.467757+0000","last_unstale":"2024-09-21T07:12:14.692149+0000","last_undegraded":"2024-09-21T07:12:14.692149+0000","last_fullsized":"2024-09-21T07:12:14.692149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:39.150277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686223+0000","last_change":"2024-09-21T07:11:00.548394+0000","last_active":"2024-09-21T07:12:14.686223+0000","last_peered":"2024-09-21T07:12:14.686223+0000","last_clean":"2024-09-21T07:12:14.686223+0000","last_became_active":"2024-09-21T07:11:00.547972+0000","last_became_peered":"2024-09-21T07:11:00.547972+0000","last_unstale":"2024-09-21T07:12:14.686223+0000","last_undegraded":"2024-09-21T07:12:14.686223+0000","last_fullsized":"2024-09-21T07:12:14.686223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:35.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.819250+0000","last_change":"2024-09-21T07:11:14.659248+0000","last_active":"2024-09-21T07:12:43.819250+0000","last_peered":"2024-09-21T07:12:43.819250+0000","last_clean":"2024-09-21T07:12:43.819250+0000","last_became_active":"2024-09-21T07:11:14.658931+0000","last_became_peered":"2024-09-21T07:11:14.658931+0000","last_unstale":"2024-09-21T07:12:43.819250+0000","last_undegraded":"2024-09-21T07:12:43.819250+0000","last_fullsized":"2024-09-21T07:12:43.819250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:12.278964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'9","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:18.898289+0000","last_change":"2024-09-21T07:10:51.466302+0000","last_active":"2024-09-21T07:13:18.898289+0000","last_peered":"2024-09-21T07:13:18.898289+0000","last_clean":"2024-09-21T07:13:18.898289+0000","last_became_active":"2024-09-21T07:10:51.465906+0000","last_became_peered":"2024-09-21T07:10:51.465906+0000","last_unstale":"2024-09-21T07:13:18.898289+0000","last_undegraded":"2024-09-21T07:13:18.898289+0000","last_fullsized":"2024-09-21T07:13:18.898289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:39.616338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689493+0000","last_change":"2024-09-21T07:11:00.555600+0000","last_active":"2024-09-21T07:12:14.689493+0000","last_peered":"2024-09-21T07:12:14.689493+0000","last_clean":"2024-09-21T07:12:14.689493+0000","last_became_active":"2024-09-21T07:11:00.555203+0000","last_became_peered":"2024-09-21T07:11:00.555203+0000","last_unstale":"2024-09-21T07:12:14.689493+0000","last_undegraded":"2024-09-21T07:12:14.689493+0000","last_fullsized":"2024-09-21T07:12:14.689493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838290+0000","last_change":"2024-09-21T07:10:53.482493+0000","last_active":"2024-09-21T07:12:43.838290+0000","last_peered":"2024-09-21T07:12:43.838290+0000","last_clean":"2024-09-21T07:12:43.838290+0000","last_became_active":"2024-09-21T07:10:53.481310+0000","last_became_peered":"2024-09-21T07:10:53.481310+0000","last_unstale":"2024-09-21T07:12:43.838290+0000","last_undegraded":"2024-09-21T07:12:43.838290+0000","last_fullsized":"2024-09-21T07:12:43.838290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:41.288008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691304+0000","last_change":"2024-09-21T07:10:51.468189+0000","last_active":"2024-09-21T07:12:14.691304+0000","last_peered":"2024-09-21T07:12:14.691304+0000","last_clean":"2024-09-21T07:12:14.691304+0000","last_became_active":"2024-09-21T07:10:51.467770+0000","last_became_peered":"2024-09-21T07:10:51.467770+0000","last_unstale":"2024-09-21T07:12:14.691304+0000","last_undegraded":"2024-09-21T07:12:14.691304+0000","last_fullsized":"2024-09-21T07:12:14.691304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:53.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689286+0000","last_change":"2024-09-21T07:11:00.556306+0000","last_active":"2024-09-21T07:12:14.689286+0000","last_peered":"2024-09-21T07:12:14.689286+0000","last_clean":"2024-09-21T07:12:14.689286+0000","last_became_active":"2024-09-21T07:11:00.555770+0000","last_became_peered":"2024-09-21T07:11:00.555770+0000","last_unstale":"2024-09-21T07:12:14.689286+0000","last_undegraded":"2024-09-21T07:12:14.689286+0000","last_fullsized":"2024-09-21T07:12:14.689286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:19.438869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839202+0000","last_change":"2024-09-21T07:10:53.485039+0000","last_active":"2024-09-21T07:12:43.839202+0000","last_peered":"2024-09-21T07:12:43.839202+0000","last_clean":"2024-09-21T07:12:43.839202+0000","last_became_active":"2024-09-21T07:10:53.484672+0000","last_became_peered":"2024-09-21T07:10:53.484672+0000","last_unstale":"2024-09-21T07:12:43.839202+0000","last_undegraded":"2024-09-21T07:12:43.839202+0000","last_fullsized":"2024-09-21T07:12:43.839202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:28.291602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.709692+0000","last_change":"2024-09-21T07:12:14.709213+0000","last_active":"2024-09-21T07:12:14.709692+0000","last_peered":"2024-09-21T07:12:14.709692+0000","last_clean":"2024-09-21T07:12:14.709692+0000","last_became_active":"2024-09-21T07:12:14.693406+0000","last_became_peered":"2024-09-21T07:12:14.693406+0000","last_unstale":"2024-09-21T07:12:14.709692+0000","last_undegraded":"2024-09-21T07:12:14.709692+0000","last_fullsized":"2024-09-21T07:12:14.709692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:25.204575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687428+0000","last_change":"2024-09-21T07:11:14.672269+0000","last_active":"2024-09-21T07:12:14.687428+0000","last_peered":"2024-09-21T07:12:14.687428+0000","last_clean":"2024-09-21T07:12:14.687428+0000","last_became_active":"2024-09-21T07:11:14.671740+0000","last_became_peered":"2024-09-21T07:11:14.671740+0000","last_unstale":"2024-09-21T07:12:14.687428+0000","last_undegraded":"2024-09-21T07:12:14.687428+0000","last_fullsized":"2024-09-21T07:12:14.687428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.600585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831504+0000","last_change":"2024-09-21T07:10:53.487667+0000","last_active":"2024-09-21T07:12:43.831504+0000","last_peered":"2024-09-21T07:12:43.831504+0000","last_clean":"2024-09-21T07:12:43.831504+0000","last_became_active":"2024-09-21T07:10:53.487316+0000","last_became_peered":"2024-09-21T07:10:53.487316+0000","last_unstale":"2024-09-21T07:12:43.831504+0000","last_undegraded":"2024-09-21T07:12:43.831504+0000","last_fullsized":"2024-09-21T07:12:43.831504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:33.545631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'39","reported_seq":297,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.897154+0000","last_change":"2024-09-21T07:10:51.465172+0000","last_active":"2024-09-21T07:13:16.897154+0000","last_peered":"2024-09-21T07:13:16.897154+0000","last_clean":"2024-09-21T07:13:16.897154+0000","last_became_active":"2024-09-21T07:10:51.464655+0000","last_became_peered":"2024-09-21T07:10:51.464655+0000","last_unstale":"2024-09-21T07:13:16.897154+0000","last_undegraded":"2024-09-21T07:13:16.897154+0000","last_fullsized":"2024-09-21T07:13:16.897154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:02.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66954,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":176,"num_write":41,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686973+0000","last_change":"2024-09-21T07:11:14.671892+0000","last_active":"2024-09-21T07:12:14.686973+0000","last_peered":"2024-09-21T07:12:14.686973+0000","last_clean":"2024-09-21T07:12:14.686973+0000","last_became_active":"2024-09-21T07:11:14.671283+0000","last_became_peered":"2024-09-21T07:11:14.671283+0000","last_unstale":"2024-09-21T07:12:14.686973+0000","last_undegraded":"2024-09-21T07:12:14.686973+0000","last_fullsized":"2024-09-21T07:12:14.686973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:54.263127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839267+0000","last_change":"2024-09-21T07:10:53.491873+0000","last_active":"2024-09-21T07:12:43.839267+0000","last_peered":"2024-09-21T07:12:43.839267+0000","last_clean":"2024-09-21T07:12:43.839267+0000","last_became_active":"2024-09-21T07:10:53.491424+0000","last_became_peered":"2024-09-21T07:10:53.491424+0000","last_unstale":"2024-09-21T07:12:43.839267+0000","last_undegraded":"2024-09-21T07:12:43.839267+0000","last_fullsized":"2024-09-21T07:12:43.839267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.145391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691247+0000","last_change":"2024-09-21T07:10:51.469395+0000","last_active":"2024-09-21T07:12:14.691247+0000","last_peered":"2024-09-21T07:12:14.691247+0000","last_clean":"2024-09-21T07:12:14.691247+0000","last_became_active":"2024-09-21T07:10:51.469015+0000","last_became_peered":"2024-09-21T07:10:51.469015+0000","last_unstale":"2024-09-21T07:12:14.691247+0000","last_undegraded":"2024-09-21T07:12:14.691247+0000","last_fullsized":"2024-09-21T07:12:14.691247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.274950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806037+0000","last_change":"2024-09-21T07:11:00.553164+0000","last_active":"2024-09-21T07:12:14.806037+0000","last_peered":"2024-09-21T07:12:14.806037+0000","last_clean":"2024-09-21T07:12:14.806037+0000","last_became_active":"2024-09-21T07:11:00.551969+0000","last_became_peered":"2024-09-21T07:11:00.551969+0000","last_unstale":"2024-09-21T07:12:14.806037+0000","last_undegraded":"2024-09-21T07:12:14.806037+0000","last_fullsized":"2024-09-21T07:12:14.806037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:53.042065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841473+0000","last_change":"2024-09-21T07:10:53.497110+0000","last_active":"2024-09-21T07:12:43.841473+0000","last_peered":"2024-09-21T07:12:43.841473+0000","last_clean":"2024-09-21T07:12:43.841473+0000","last_became_active":"2024-09-21T07:10:53.496751+0000","last_became_peered":"2024-09-21T07:10:53.496751+0000","last_unstale":"2024-09-21T07:12:43.841473+0000","last_undegraded":"2024-09-21T07:12:43.841473+0000","last_fullsized":"2024-09-21T07:12:43.841473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.531652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.812563+0000","last_change":"2024-09-21T07:12:14.811962+0000","last_active":"2024-09-21T07:12:14.812563+0000","last_peered":"2024-09-21T07:12:14.812563+0000","last_clean":"2024-09-21T07:12:14.812563+0000","last_became_active":"2024-09-21T07:12:14.807745+0000","last_became_peered":"2024-09-21T07:12:14.807745+0000","last_unstale":"2024-09-21T07:12:14.812563+0000","last_undegraded":"2024-09-21T07:12:14.812563+0000","last_fullsized":"2024-09-21T07:12:14.812563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:20.292633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691946+0000","last_change":"2024-09-21T07:11:14.655255+0000","last_active":"2024-09-21T07:12:14.691946+0000","last_peered":"2024-09-21T07:12:14.691946+0000","last_clean":"2024-09-21T07:12:14.691946+0000","last_became_active":"2024-09-21T07:11:14.654556+0000","last_became_peered":"2024-09-21T07:11:14.654556+0000","last_unstale":"2024-09-21T07:12:14.691946+0000","last_undegraded":"2024-09-21T07:12:14.691946+0000","last_fullsized":"2024-09-21T07:12:14.691946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:44.435834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843700+0000","last_change":"2024-09-21T07:10:53.484990+0000","last_active":"2024-09-21T07:12:43.843700+0000","last_peered":"2024-09-21T07:12:43.843700+0000","last_clean":"2024-09-21T07:12:43.843700+0000","last_became_active":"2024-09-21T07:10:53.484570+0000","last_became_peered":"2024-09-21T07:10:53.484570+0000","last_unstale":"2024-09-21T07:12:43.843700+0000","last_undegraded":"2024-09-21T07:12:43.843700+0000","last_fullsized":"2024-09-21T07:12:43.843700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:28.848203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":254,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.896951+0000","last_change":"2024-09-21T07:10:51.463378+0000","last_active":"2024-09-21T07:13:16.896951+0000","last_peered":"2024-09-21T07:13:16.896951+0000","last_clean":"2024-09-21T07:13:16.896951+0000","last_became_active":"2024-09-21T07:10:51.462961+0000","last_became_peered":"2024-09-21T07:10:51.462961+0000","last_unstale":"2024-09-21T07:13:16.896951+0000","last_undegraded":"2024-09-21T07:13:16.896951+0000","last_fullsized":"2024-09-21T07:13:16.896951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:22.637603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691338+0000","last_change":"2024-09-21T07:11:00.549758+0000","last_active":"2024-09-21T07:12:14.691338+0000","last_peered":"2024-09-21T07:12:14.691338+0000","last_clean":"2024-09-21T07:12:14.691338+0000","last_became_active":"2024-09-21T07:11:00.549141+0000","last_became_peered":"2024-09-21T07:11:00.549141+0000","last_unstale":"2024-09-21T07:12:14.691338+0000","last_undegraded":"2024-09-21T07:12:14.691338+0000","last_fullsized":"2024-09-21T07:12:14.691338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:27.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998447+0000","last_change":"2024-09-21T07:11:00.550407+0000","last_active":"2024-09-21T07:12:14.998447+0000","last_peered":"2024-09-21T07:12:14.998447+0000","last_clean":"2024-09-21T07:12:14.998447+0000","last_became_active":"2024-09-21T07:11:00.549930+0000","last_became_peered":"2024-09-21T07:11:00.549930+0000","last_unstale":"2024-09-21T07:12:14.998447+0000","last_undegraded":"2024-09-21T07:12:14.998447+0000","last_fullsized":"2024-09-21T07:12:14.998447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:25.924695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841002+0000","last_change":"2024-09-21T07:10:53.491452+0000","last_active":"2024-09-21T07:12:43.841002+0000","last_peered":"2024-09-21T07:12:43.841002+0000","last_clean":"2024-09-21T07:12:43.841002+0000","last_became_active":"2024-09-21T07:10:53.491106+0000","last_became_peered":"2024-09-21T07:10:53.491106+0000","last_unstale":"2024-09-21T07:12:43.841002+0000","last_undegraded":"2024-09-21T07:12:43.841002+0000","last_fullsized":"2024-09-21T07:12:43.841002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:58.270323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690834+0000","last_change":"2024-09-21T07:10:51.468433+0000","last_active":"2024-09-21T07:12:14.690834+0000","last_peered":"2024-09-21T07:12:14.690834+0000","last_clean":"2024-09-21T07:12:14.690834+0000","last_became_active":"2024-09-21T07:10:51.467810+0000","last_became_peered":"2024-09-21T07:10:51.467810+0000","last_unstale":"2024-09-21T07:12:14.690834+0000","last_undegraded":"2024-09-21T07:12:14.690834+0000","last_fullsized":"2024-09-21T07:12:14.690834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.787584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689774+0000","last_change":"2024-09-21T07:11:00.556866+0000","last_active":"2024-09-21T07:12:14.689774+0000","last_peered":"2024-09-21T07:12:14.689774+0000","last_clean":"2024-09-21T07:12:14.689774+0000","last_became_active":"2024-09-21T07:11:00.555350+0000","last_became_peered":"2024-09-21T07:11:00.555350+0000","last_unstale":"2024-09-21T07:12:14.689774+0000","last_undegraded":"2024-09-21T07:12:14.689774+0000","last_fullsized":"2024-09-21T07:12:14.689774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:46.296771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830507+0000","last_change":"2024-09-21T07:10:53.487210+0000","last_active":"2024-09-21T07:12:43.830507+0000","last_peered":"2024-09-21T07:12:43.830507+0000","last_clean":"2024-09-21T07:12:43.830507+0000","last_became_active":"2024-09-21T07:10:53.485975+0000","last_became_peered":"2024-09-21T07:10:53.485975+0000","last_unstale":"2024-09-21T07:12:43.830507+0000","last_undegraded":"2024-09-21T07:12:43.830507+0000","last_fullsized":"2024-09-21T07:12:43.830507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.685994+0000","last_change":"2024-09-21T07:10:51.456418+0000","last_active":"2024-09-21T07:12:14.685994+0000","last_peered":"2024-09-21T07:12:14.685994+0000","last_clean":"2024-09-21T07:12:14.685994+0000","last_became_active":"2024-09-21T07:10:51.455885+0000","last_became_peered":"2024-09-21T07:10:51.455885+0000","last_unstale":"2024-09-21T07:12:14.685994+0000","last_undegraded":"2024-09-21T07:12:14.685994+0000","last_fullsized":"2024-09-21T07:12:14.685994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:53.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687423+0000","last_change":"2024-09-21T07:10:51.462544+0000","last_active":"2024-09-21T07:12:14.687423+0000","last_peered":"2024-09-21T07:12:14.687423+0000","last_clean":"2024-09-21T07:12:14.687423+0000","last_became_active":"2024-09-21T07:10:51.462075+0000","last_became_peered":"2024-09-21T07:10:51.462075+0000","last_unstale":"2024-09-21T07:12:14.687423+0000","last_undegraded":"2024-09-21T07:12:14.687423+0000","last_fullsized":"2024-09-21T07:12:14.687423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:09.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.837792+0000","last_change":"2024-09-21T07:12:14.694814+0000","last_active":"2024-09-21T07:12:43.837792+0000","last_peered":"2024-09-21T07:12:43.837792+0000","last_clean":"2024-09-21T07:12:43.837792+0000","last_became_active":"2024-09-21T07:12:14.694334+0000","last_became_peered":"2024-09-21T07:12:14.694334+0000","last_unstale":"2024-09-21T07:12:43.837792+0000","last_undegraded":"2024-09-21T07:12:43.837792+0000","last_fullsized":"2024-09-21T07:12:43.837792+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:33.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687029+0000","last_change":"2024-09-21T07:11:00.552908+0000","last_active":"2024-09-21T07:12:14.687029+0000","last_peered":"2024-09-21T07:12:14.687029+0000","last_clean":"2024-09-21T07:12:14.687029+0000","last_became_active":"2024-09-21T07:11:00.552303+0000","last_became_peered":"2024-09-21T07:11:00.552303+0000","last_unstale":"2024-09-21T07:12:14.687029+0000","last_undegraded":"2024-09-21T07:12:14.687029+0000","last_fullsized":"2024-09-21T07:12:14.687029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'8","reported_seq":158,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:17.899377+0000","last_change":"2024-09-21T07:10:51.467072+0000","last_active":"2024-09-21T07:13:17.899377+0000","last_peered":"2024-09-21T07:13:17.899377+0000","last_clean":"2024-09-21T07:13:17.899377+0000","last_became_active":"2024-09-21T07:10:51.466671+0000","last_became_peered":"2024-09-21T07:10:51.466671+0000","last_unstale":"2024-09-21T07:13:17.899377+0000","last_undegraded":"2024-09-21T07:13:17.899377+0000","last_fullsized":"2024-09-21T07:13:17.899377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:24.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833720+0000","last_change":"2024-09-21T07:10:53.480057+0000","last_active":"2024-09-21T07:12:43.833720+0000","last_peered":"2024-09-21T07:12:43.833720+0000","last_clean":"2024-09-21T07:12:43.833720+0000","last_became_active":"2024-09-21T07:10:53.479644+0000","last_became_peered":"2024-09-21T07:10:53.479644+0000","last_unstale":"2024-09-21T07:12:43.833720+0000","last_undegraded":"2024-09-21T07:12:43.833720+0000","last_fullsized":"2024-09-21T07:12:43.833720+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:34.255547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687321+0000","last_change":"2024-09-21T07:11:00.550259+0000","last_active":"2024-09-21T07:12:14.687321+0000","last_peered":"2024-09-21T07:12:14.687321+0000","last_clean":"2024-09-21T07:12:14.687321+0000","last_became_active":"2024-09-21T07:11:00.549771+0000","last_became_peered":"2024-09-21T07:11:00.549771+0000","last_unstale":"2024-09-21T07:12:14.687321+0000","last_undegraded":"2024-09-21T07:12:14.687321+0000","last_fullsized":"2024-09-21T07:12:14.687321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839385+0000","last_change":"2024-09-21T07:10:53.488022+0000","last_active":"2024-09-21T07:12:43.839385+0000","last_peered":"2024-09-21T07:12:43.839385+0000","last_clean":"2024-09-21T07:12:43.839385+0000","last_became_active":"2024-09-21T07:10:53.487605+0000","last_became_peered":"2024-09-21T07:10:53.487605+0000","last_unstale":"2024-09-21T07:12:43.839385+0000","last_undegraded":"2024-09-21T07:12:43.839385+0000","last_fullsized":"2024-09-21T07:12:43.839385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:02.074960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833306+0000","last_change":"2024-09-21T07:10:53.484319+0000","last_active":"2024-09-21T07:12:43.833306+0000","last_peered":"2024-09-21T07:12:43.833306+0000","last_clean":"2024-09-21T07:12:43.833306+0000","last_became_active":"2024-09-21T07:10:53.483942+0000","last_became_peered":"2024-09-21T07:10:53.483942+0000","last_unstale":"2024-09-21T07:12:43.833306+0000","last_undegraded":"2024-09-21T07:12:43.833306+0000","last_fullsized":"2024-09-21T07:12:43.833306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:50.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840566+0000","last_change":"2024-09-21T07:10:53.494981+0000","last_active":"2024-09-21T07:12:43.840566+0000","last_peered":"2024-09-21T07:12:43.840566+0000","last_clean":"2024-09-21T07:12:43.840566+0000","last_became_active":"2024-09-21T07:10:53.494580+0000","last_became_peered":"2024-09-21T07:10:53.494580+0000","last_unstale":"2024-09-21T07:12:43.840566+0000","last_undegraded":"2024-09-21T07:12:43.840566+0000","last_fullsized":"2024-09-21T07:12:43.840566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:57.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842588+0000","last_change":"2024-09-21T07:10:53.492971+0000","last_active":"2024-09-21T07:12:43.842588+0000","last_peered":"2024-09-21T07:12:43.842588+0000","last_clean":"2024-09-21T07:12:43.842588+0000","last_became_active":"2024-09-21T07:10:53.492597+0000","last_became_peered":"2024-09-21T07:10:53.492597+0000","last_unstale":"2024-09-21T07:12:43.842588+0000","last_undegraded":"2024-09-21T07:12:43.842588+0000","last_fullsized":"2024-09-21T07:12:43.842588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.931998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836994+0000","last_change":"2024-09-21T07:10:53.485613+0000","last_active":"2024-09-21T07:12:43.836994+0000","last_peered":"2024-09-21T07:12:43.836994+0000","last_clean":"2024-09-21T07:12:43.836994+0000","last_became_active":"2024-09-21T07:10:53.485268+0000","last_became_peered":"2024-09-21T07:10:53.485268+0000","last_unstale":"2024-09-21T07:12:43.836994+0000","last_undegraded":"2024-09-21T07:12:43.836994+0000","last_fullsized":"2024-09-21T07:12:43.836994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:52.496426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831297+0000","last_change":"2024-09-21T07:10:53.489349+0000","last_active":"2024-09-21T07:12:43.831297+0000","last_peered":"2024-09-21T07:12:43.831297+0000","last_clean":"2024-09-21T07:12:43.831297+0000","last_became_active":"2024-09-21T07:10:53.488986+0000","last_became_peered":"2024-09-21T07:10:53.488986+0000","last_unstale":"2024-09-21T07:12:43.831297+0000","last_undegraded":"2024-09-21T07:12:43.831297+0000","last_fullsized":"2024-09-21T07:12:43.831297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:46.376689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.832429+0000","last_change":"2024-09-21T07:10:53.485740+0000","last_active":"2024-09-21T07:12:43.832429+0000","last_peered":"2024-09-21T07:12:43.832429+0000","last_clean":"2024-09-21T07:12:43.832429+0000","last_became_active":"2024-09-21T07:10:53.485375+0000","last_became_peered":"2024-09-21T07:10:53.485375+0000","last_unstale":"2024-09-21T07:12:43.832429+0000","last_undegraded":"2024-09-21T07:12:43.832429+0000","last_fullsized":"2024-09-21T07:12:43.832429+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:40.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838894+0000","last_change":"2024-09-21T07:10:53.490211+0000","last_active":"2024-09-21T07:12:43.838894+0000","last_peered":"2024-09-21T07:12:43.838894+0000","last_clean":"2024-09-21T07:12:43.838894+0000","last_became_active":"2024-09-21T07:10:53.489504+0000","last_became_peered":"2024-09-21T07:10:53.489504+0000","last_unstale":"2024-09-21T07:12:43.838894+0000","last_undegraded":"2024-09-21T07:12:43.838894+0000","last_fullsized":"2024-09-21T07:12:43.838894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:50.337307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.837945+0000","last_change":"2024-09-21T07:10:53.486064+0000","last_active":"2024-09-21T07:12:43.837945+0000","last_peered":"2024-09-21T07:12:43.837945+0000","last_clean":"2024-09-21T07:12:43.837945+0000","last_became_active":"2024-09-21T07:10:53.485674+0000","last_became_peered":"2024-09-21T07:10:53.485674+0000","last_unstale":"2024-09-21T07:12:43.837945+0000","last_undegraded":"2024-09-21T07:12:43.837945+0000","last_fullsized":"2024-09-21T07:12:43.837945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:55.232795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838941+0000","last_change":"2024-09-21T07:10:53.489008+0000","last_active":"2024-09-21T07:12:43.838941+0000","last_peered":"2024-09-21T07:12:43.838941+0000","last_clean":"2024-09-21T07:12:43.838941+0000","last_became_active":"2024-09-21T07:10:53.488655+0000","last_became_peered":"2024-09-21T07:10:53.488655+0000","last_unstale":"2024-09-21T07:12:43.838941+0000","last_undegraded":"2024-09-21T07:12:43.838941+0000","last_fullsized":"2024-09-21T07:12:43.838941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:42.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843962+0000","last_change":"2024-09-21T07:10:53.490147+0000","last_active":"2024-09-21T07:12:43.843962+0000","last_peered":"2024-09-21T07:12:43.843962+0000","last_clean":"2024-09-21T07:12:43.843962+0000","last_became_active":"2024-09-21T07:10:53.488389+0000","last_became_peered":"2024-09-21T07:10:53.488389+0000","last_unstale":"2024-09-21T07:12:43.843962+0000","last_undegraded":"2024-09-21T07:12:43.843962+0000","last_fullsized":"2024-09-21T07:12:43.843962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:17.729856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840459+0000","last_change":"2024-09-21T07:10:53.486557+0000","last_active":"2024-09-21T07:12:43.840459+0000","last_peered":"2024-09-21T07:12:43.840459+0000","last_clean":"2024-09-21T07:12:43.840459+0000","last_became_active":"2024-09-21T07:10:53.486248+0000","last_became_peered":"2024-09-21T07:10:53.486248+0000","last_unstale":"2024-09-21T07:12:43.840459+0000","last_undegraded":"2024-09-21T07:12:43.840459+0000","last_fullsized":"2024-09-21T07:12:43.840459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.675717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833816+0000","last_change":"2024-09-21T07:10:53.485281+0000","last_active":"2024-09-21T07:12:43.833816+0000","last_peered":"2024-09-21T07:12:43.833816+0000","last_clean":"2024-09-21T07:12:43.833816+0000","last_became_active":"2024-09-21T07:10:53.484732+0000","last_became_peered":"2024-09-21T07:10:53.484732+0000","last_unstale":"2024-09-21T07:12:43.833816+0000","last_undegraded":"2024-09-21T07:12:43.833816+0000","last_fullsized":"2024-09-21T07:12:43.833816+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:53.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836869+0000","last_change":"2024-09-21T07:10:53.483192+0000","last_active":"2024-09-21T07:12:43.836869+0000","last_peered":"2024-09-21T07:12:43.836869+0000","last_clean":"2024-09-21T07:12:43.836869+0000","last_became_active":"2024-09-21T07:10:53.482402+0000","last_became_peered":"2024-09-21T07:10:53.482402+0000","last_unstale":"2024-09-21T07:12:43.836869+0000","last_undegraded":"2024-09-21T07:12:43.836869+0000","last_fullsized":"2024-09-21T07:12:43.836869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.159873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843080+0000","last_change":"2024-09-21T07:10:53.481463+0000","last_active":"2024-09-21T07:12:43.843080+0000","last_peered":"2024-09-21T07:12:43.843080+0000","last_clean":"2024-09-21T07:12:43.843080+0000","last_became_active":"2024-09-21T07:10:53.481129+0000","last_became_peered":"2024-09-21T07:10:53.481129+0000","last_unstale":"2024-09-21T07:12:43.843080+0000","last_undegraded":"2024-09-21T07:12:43.843080+0000","last_fullsized":"2024-09-21T07:12:43.843080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:14.547936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840480+0000","last_change":"2024-09-21T07:10:53.493009+0000","last_active":"2024-09-21T07:12:43.840480+0000","last_peered":"2024-09-21T07:12:43.840480+0000","last_clean":"2024-09-21T07:12:43.840480+0000","last_became_active":"2024-09-21T07:10:53.492300+0000","last_became_peered":"2024-09-21T07:10:53.492300+0000","last_unstale":"2024-09-21T07:12:43.840480+0000","last_undegraded":"2024-09-21T07:12:43.840480+0000","last_fullsized":"2024-09-21T07:12:43.840480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:09.890248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843437+0000","last_change":"2024-09-21T07:10:53.491149+0000","last_active":"2024-09-21T07:12:43.843437+0000","last_peered":"2024-09-21T07:12:43.843437+0000","last_clean":"2024-09-21T07:12:43.843437+0000","last_became_active":"2024-09-21T07:10:53.490766+0000","last_became_peered":"2024-09-21T07:10:53.490766+0000","last_unstale":"2024-09-21T07:12:43.843437+0000","last_undegraded":"2024-09-21T07:12:43.843437+0000","last_fullsized":"2024-09-21T07:12:43.843437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:52.243083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840492+0000","last_change":"2024-09-21T07:11:14.672453+0000","last_active":"2024-09-21T07:12:43.840492+0000","last_peered":"2024-09-21T07:12:43.840492+0000","last_clean":"2024-09-21T07:12:43.840492+0000","last_became_active":"2024-09-21T07:11:14.671584+0000","last_became_peered":"2024-09-21T07:11:14.671584+0000","last_unstale":"2024-09-21T07:12:43.840492+0000","last_undegraded":"2024-09-21T07:12:43.840492+0000","last_fullsized":"2024-09-21T07:12:43.840492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:25.746195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839098+0000","last_change":"2024-09-21T07:10:53.496332+0000","last_active":"2024-09-21T07:12:43.839098+0000","last_peered":"2024-09-21T07:12:43.839098+0000","last_clean":"2024-09-21T07:12:43.839098+0000","last_became_active":"2024-09-21T07:10:53.495078+0000","last_became_peered":"2024-09-21T07:10:53.495078+0000","last_unstale":"2024-09-21T07:12:43.839098+0000","last_undegraded":"2024-09-21T07:12:43.839098+0000","last_fullsized":"2024-09-21T07:12:43.839098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:32.415350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838131+0000","last_change":"2024-09-21T07:10:53.478381+0000","last_active":"2024-09-21T07:12:43.838131+0000","last_peered":"2024-09-21T07:12:43.838131+0000","last_clean":"2024-09-21T07:12:43.838131+0000","last_became_active":"2024-09-21T07:10:53.478021+0000","last_became_peered":"2024-09-21T07:10:53.478021+0000","last_unstale":"2024-09-21T07:12:43.838131+0000","last_undegraded":"2024-09-21T07:12:43.838131+0000","last_fullsized":"2024-09-21T07:12:43.838131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:02.496263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.821141+0000","last_change":"2024-09-21T07:10:53.485103+0000","last_active":"2024-09-21T07:12:43.821141+0000","last_peered":"2024-09-21T07:12:43.821141+0000","last_clean":"2024-09-21T07:12:43.821141+0000","last_became_active":"2024-09-21T07:10:53.483835+0000","last_became_peered":"2024-09-21T07:10:53.483835+0000","last_unstale":"2024-09-21T07:12:43.821141+0000","last_undegraded":"2024-09-21T07:12:43.821141+0000","last_fullsized":"2024-09-21T07:12:43.821141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:47.775202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842539+0000","last_change":"2024-09-21T07:10:53.490497+0000","last_active":"2024-09-21T07:12:43.842539+0000","last_peered":"2024-09-21T07:12:43.842539+0000","last_clean":"2024-09-21T07:12:43.842539+0000","last_became_active":"2024-09-21T07:10:53.490137+0000","last_became_peered":"2024-09-21T07:10:53.490137+0000","last_unstale":"2024-09-21T07:12:43.842539+0000","last_undegraded":"2024-09-21T07:12:43.842539+0000","last_fullsized":"2024-09-21T07:12:43.842539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:12.090628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842305+0000","last_change":"2024-09-21T07:10:53.487118+0000","last_active":"2024-09-21T07:12:43.842305+0000","last_peered":"2024-09-21T07:12:43.842305+0000","last_clean":"2024-09-21T07:12:43.842305+0000","last_became_active":"2024-09-21T07:10:53.486582+0000","last_became_peered":"2024-09-21T07:10:53.486582+0000","last_unstale":"2024-09-21T07:12:43.842305+0000","last_undegraded":"2024-09-21T07:12:43.842305+0000","last_fullsized":"2024-09-21T07:12:43.842305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:00.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839468+0000","last_change":"2024-09-21T07:10:53.497390+0000","last_active":"2024-09-21T07:12:43.839468+0000","last_peered":"2024-09-21T07:12:43.839468+0000","last_clean":"2024-09-21T07:12:43.839468+0000","last_became_active":"2024-09-21T07:10:53.497043+0000","last_became_peered":"2024-09-21T07:10:53.497043+0000","last_unstale":"2024-09-21T07:12:43.839468+0000","last_undegraded":"2024-09-21T07:12:43.839468+0000","last_fullsized":"2024-09-21T07:12:43.839468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:36.912873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.829496+0000","last_change":"2024-09-21T07:10:53.484624+0000","last_active":"2024-09-21T07:12:43.829496+0000","last_peered":"2024-09-21T07:12:43.829496+0000","last_clean":"2024-09-21T07:12:43.829496+0000","last_became_active":"2024-09-21T07:10:53.484278+0000","last_became_peered":"2024-09-21T07:10:53.484278+0000","last_unstale":"2024-09-21T07:12:43.829496+0000","last_undegraded":"2024-09-21T07:12:43.829496+0000","last_fullsized":"2024-09-21T07:12:43.829496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:41.464442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836192+0000","last_change":"2024-09-21T07:10:53.478146+0000","last_active":"2024-09-21T07:12:43.836192+0000","last_peered":"2024-09-21T07:12:43.836192+0000","last_clean":"2024-09-21T07:12:43.836192+0000","last_became_active":"2024-09-21T07:10:53.477733+0000","last_became_peered":"2024-09-21T07:10:53.477733+0000","last_unstale":"2024-09-21T07:12:43.836192+0000","last_undegraded":"2024-09-21T07:12:43.836192+0000","last_fullsized":"2024-09-21T07:12:43.836192+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:09.159966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839738+0000","last_change":"2024-09-21T07:11:14.657274+0000","last_active":"2024-09-21T07:12:43.839738+0000","last_peered":"2024-09-21T07:12:43.839738+0000","last_clean":"2024-09-21T07:12:43.839738+0000","last_became_active":"2024-09-21T07:11:14.656826+0000","last_became_peered":"2024-09-21T07:11:14.656826+0000","last_unstale":"2024-09-21T07:12:43.839738+0000","last_undegraded":"2024-09-21T07:12:43.839738+0000","last_fullsized":"2024-09-21T07:12:43.839738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.688373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830031+0000","last_change":"2024-09-21T07:10:53.481411+0000","last_active":"2024-09-21T07:12:43.830031+0000","last_peered":"2024-09-21T07:12:43.830031+0000","last_clean":"2024-09-21T07:12:43.830031+0000","last_became_active":"2024-09-21T07:10:53.481005+0000","last_became_peered":"2024-09-21T07:10:53.481005+0000","last_unstale":"2024-09-21T07:12:43.830031+0000","last_undegraded":"2024-09-21T07:12:43.830031+0000","last_fullsized":"2024-09-21T07:12:43.830031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:41.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.823757+0000","last_change":"2024-09-21T07:10:53.487481+0000","last_active":"2024-09-21T07:12:43.823757+0000","last_peered":"2024-09-21T07:12:43.823757+0000","last_clean":"2024-09-21T07:12:43.823757+0000","last_became_active":"2024-09-21T07:10:53.486277+0000","last_became_peered":"2024-09-21T07:10:53.486277+0000","last_unstale":"2024-09-21T07:12:43.823757+0000","last_undegraded":"2024-09-21T07:12:43.823757+0000","last_fullsized":"2024-09-21T07:12:43.823757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:57.304382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840517+0000","last_change":"2024-09-21T07:10:53.495971+0000","last_active":"2024-09-21T07:12:43.840517+0000","last_peered":"2024-09-21T07:12:43.840517+0000","last_clean":"2024-09-21T07:12:43.840517+0000","last_became_active":"2024-09-21T07:10:53.495124+0000","last_became_peered":"2024-09-21T07:10:53.495124+0000","last_unstale":"2024-09-21T07:12:43.840517+0000","last_undegraded":"2024-09-21T07:12:43.840517+0000","last_fullsized":"2024-09-21T07:12:43.840517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839940+0000","last_change":"2024-09-21T07:10:53.497538+0000","last_active":"2024-09-21T07:12:43.839940+0000","last_peered":"2024-09-21T07:12:43.839940+0000","last_clean":"2024-09-21T07:12:43.839940+0000","last_became_active":"2024-09-21T07:10:53.496835+0000","last_became_peered":"2024-09-21T07:10:53.496835+0000","last_unstale":"2024-09-21T07:12:43.839940+0000","last_undegraded":"2024-09-21T07:12:43.839940+0000","last_fullsized":"2024-09-21T07:12:43.839940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:17.187282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840355+0000","last_change":"2024-09-21T07:10:53.492646+0000","last_active":"2024-09-21T07:12:43.840355+0000","last_peered":"2024-09-21T07:12:43.840355+0000","last_clean":"2024-09-21T07:12:43.840355+0000","last_became_active":"2024-09-21T07:10:53.491818+0000","last_became_peered":"2024-09-21T07:10:53.491818+0000","last_unstale":"2024-09-21T07:12:43.840355+0000","last_undegraded":"2024-09-21T07:12:43.840355+0000","last_fullsized":"2024-09-21T07:12:43.840355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:37.094158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76803,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1099,"num_read_kb":634,"num_write":274,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":68,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":237278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283164,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710762,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":506747,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906992,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712876,"statfs":{"total":95995035648,"available":95961985024,"internally_reserved":0,"allocated":1118208,"data_stored":1165077,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070517,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":506116,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266746,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":506494,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462975,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1105143,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626499,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":502113,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822729,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":1099207,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986255,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":506719,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":501328,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378712,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":571274,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542237,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":577357,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705763,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":983040,"data_stored":503569,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":70376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:13:23.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:13:23.619 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:23.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:23 smithi092 ceph-mon[30987]: from='client.15633 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:23 smithi175 ceph-mon[34064]: from='client.15633 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:24.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.077+0000 7f12f29b1640 1 -- 172.21.15.92:0/3105999314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ec1094f0 msgr2=0x7f12ec109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:24.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.077+0000 7f12f29b1640 1 --2- 172.21.15.92:0/3105999314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ec1094f0 0x7f12ec109900 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009900 tx=0x7f12d402a410 comp rx=0 tx=0).stop 2024-09-21T07:13:24.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.077+0000 7f12f29b1640 1 -- 172.21.15.92:0/3105999314 shutdown_connections 2024-09-21T07:13:24.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.077+0000 7f12f29b1640 1 --2- 172.21.15.92:0/3105999314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ec109e40 0x7f12ec110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:24.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.077+0000 7f12f29b1640 1 --2- 172.21.15.92:0/3105999314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ec1094f0 0x7f12ec109900 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:24.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.078+0000 7f12f29b1640 1 --2- 172.21.15.92:0/3105999314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12ec103bb0 0x7f12ec103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:24.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.078+0000 7f12f29b1640 1 -- 172.21.15.92:0/3105999314 >> 172.21.15.92:0/3105999314 conn(0x7f12ec0ff600 msgr2=0x7f12ec101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:24.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.078+0000 7f12f29b1640 1 -- 172.21.15.92:0/3105999314 shutdown_connections 2024-09-21T07:13:24.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.078+0000 7f12f29b1640 1 -- 172.21.15.92:0/3105999314 wait complete. 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.078+0000 7f12f29b1640 1 Processor -- start 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.078+0000 7f12f29b1640 1 -- start start 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.078+0000 7f12f29b1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12ec103bb0 0x7f12ec19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f29b1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ec1094f0 0x7f12ec19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f29b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ec109e40 0x7f12ec19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f29b1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec1139b0 con 0x7f12ec109e40 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f29b1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec113830 con 0x7f12ec1094f0 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f29b1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec113b30 con 0x7f12ec103bb0 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f0f4e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ec109e40 0x7f12ec19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f0f4e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ec109e40 0x7f12ec19fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55570/0 (socket says 172.21.15.92:55570) 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f0f4e640 1 -- 172.21.15.92:0/1666679608 learned_addr learned my addr 172.21.15.92:0/1666679608 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12ebfff640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12ec103bb0 0x7f12ec19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12e3fff640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ec1094f0 0x7f12ec19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:24.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f0f4e640 1 -- 172.21.15.92:0/1666679608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12ec103bb0 msgr2=0x7f12ec19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:24.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f0f4e640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12ec103bb0 0x7f12ec19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:24.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f0f4e640 1 -- 172.21.15.92:0/1666679608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ec1094f0 msgr2=0x7f12ec19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:24.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f0f4e640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ec1094f0 0x7f12ec19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:24.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f0f4e640 1 -- 172.21.15.92:0/1666679608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ec1a02f0 con 0x7f12ec109e40 2024-09-21T07:13:24.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f0f4e640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ec109e40 0x7f12ec19fc80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f12e400cce0 tx=0x7f12e400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:24.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12e9ffb640 1 -- 172.21.15.92:0/1666679608 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e400f450 con 0x7f12ec109e40 2024-09-21T07:13:24.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12e9ffb640 1 -- 172.21.15.92:0/1666679608 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12e400fa80 con 0x7f12ec109e40 2024-09-21T07:13:24.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12e9ffb640 1 -- 172.21.15.92:0/1666679608 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4018ad0 con 0x7f12ec109e40 2024-09-21T07:13:24.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f29b1640 1 -- 172.21.15.92:0/1666679608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ec1a05e0 con 0x7f12ec109e40 2024-09-21T07:13:24.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.079+0000 7f12f29b1640 1 -- 172.21.15.92:0/1666679608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ec1a6e00 con 0x7f12ec109e40 2024-09-21T07:13:24.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.081+0000 7f12f29b1640 1 -- 172.21.15.92:0/1666679608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ec103fc0 con 0x7f12ec109e40 2024-09-21T07:13:24.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.082+0000 7f12e9ffb640 1 -- 172.21.15.92:0/1666679608 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7f12e400f5f0 con 0x7f12ec109e40 2024-09-21T07:13:24.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.083+0000 7f12e9ffb640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12d80b66a0 0x7f12d80b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:24.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.083+0000 7f12ebfff640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12d80b66a0 0x7f12d80b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:24.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.083+0000 7f12e9ffb640 1 -- 172.21.15.92:0/1666679608 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f12e40e8110 con 0x7f12ec109e40 2024-09-21T07:13:24.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.083+0000 7f12ebfff640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12d80b66a0 0x7f12d80b8bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12dc005fd0 tx=0x7f12dc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:24.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.087+0000 7f12e9ffb640 1 -- 172.21.15.92:0/1666679608 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12e4014030 con 0x7f12ec109e40 2024-09-21T07:13:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:23 smithi169 ceph-mon[33705]: from='client.15633 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:24.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.302+0000 7f12f29b1640 1 -- 172.21.15.92:0/1666679608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12ec10bc70 con 0x7f12ec109e40 2024-09-21T07:13:24.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.303+0000 7f12e9ffb640 1 -- 172.21.15.92:0/1666679608 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f12e40ae380 con 0x7f12ec109e40 2024-09-21T07:13:24.305 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:24.305 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:13:24.306 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:13:24.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 -- 172.21.15.92:0/1666679608 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12d80b66a0 msgr2=0x7f12d80b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12d80b66a0 0x7f12d80b8bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12dc005fd0 tx=0x7f12dc00b390 comp rx=0 tx=0).stop 2024-09-21T07:13:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 -- 172.21.15.92:0/1666679608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ec109e40 msgr2=0x7f12ec19fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ec109e40 0x7f12ec19fc80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f12e400cce0 tx=0x7f12e400a620 comp rx=0 tx=0).stop 2024-09-21T07:13:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 -- 172.21.15.92:0/1666679608 shutdown_connections 2024-09-21T07:13:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12d80b66a0 0x7f12d80b8bb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:24.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ec109e40 0x7f12ec19fc80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:24.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12ec1094f0 0x7f12ec19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:24.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 --2- 172.21.15.92:0/1666679608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12ec103bb0 0x7f12ec19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:24.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 -- 172.21.15.92:0/1666679608 >> 172.21.15.92:0/1666679608 conn(0x7f12ec0ff600 msgr2=0x7f12ec101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:24.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 -- 172.21.15.92:0/1666679608 shutdown_connections 2024-09-21T07:13:24.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:24.305+0000 7f12f29b1640 1 -- 172.21.15.92:0/1666679608 wait complete. 2024-09-21T07:13:24.939 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:13:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:24 smithi175 ceph-mon[34064]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:24 smithi175 ceph-mon[34064]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:24 smithi175 ceph-mon[34064]: pgmap v349: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-21T07:13:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:24 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1666679608' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:24 smithi092 ceph-mon[30987]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:24 smithi092 ceph-mon[30987]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:24 smithi092 ceph-mon[30987]: pgmap v349: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-21T07:13:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:24 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1666679608' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:24 smithi169 ceph-mon[33705]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:24 smithi169 ceph-mon[33705]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:24 smithi169 ceph-mon[33705]: pgmap v349: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-21T07:13:25.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:24 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1666679608' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:25.184 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:25.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1669150926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6ac103b60 msgr2=0x7ff6ac103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:25.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 --2- 172.21.15.92:0/1669150926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6ac103b60 0x7ff6ac103f70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009900 tx=0x7ff6a802a410 comp rx=0 tx=0).stop 2024-09-21T07:13:25.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1669150926 shutdown_connections 2024-09-21T07:13:25.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 --2- 172.21.15.92:0/1669150926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac109df0 0x7ff6ac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:25.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 --2- 172.21.15.92:0/1669150926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ac1094a0 0x7ff6ac1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:25.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 --2- 172.21.15.92:0/1669150926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6ac103b60 0x7ff6ac103f70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:25.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1669150926 >> 172.21.15.92:0/1669150926 conn(0x7ff6ac07b850 msgr2=0x7ff6ac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:25.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1669150926 shutdown_connections 2024-09-21T07:13:25.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1669150926 wait complete. 2024-09-21T07:13:25.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 Processor -- start 2024-09-21T07:13:25.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.662+0000 7ff6b2be7640 1 -- start start 2024-09-21T07:13:25.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6b2be7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac103b60 0x7ff6ac19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:25.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6b2be7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6ac1094a0 0x7ff6ac19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:25.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6b2be7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ac109df0 0x7ff6ac19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6b2be7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac113960 con 0x7ff6ac1094a0 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6b2be7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1137e0 con 0x7ff6ac103b60 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6b2be7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac113ae0 con 0x7ff6ac109df0 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6ac1094a0 0x7ff6ac19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6ac1094a0 0x7ff6ac19a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55586/0 (socket says 172.21.15.92:55586) 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6a3fff640 1 -- 172.21.15.92:0/1404225726 learned_addr learned my addr 172.21.15.92:0/1404225726 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6b0983640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac103b60 0x7ff6ac19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6b1184640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ac109df0 0x7ff6ac19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6a3fff640 1 -- 172.21.15.92:0/1404225726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ac109df0 msgr2=0x7ff6ac19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6a3fff640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ac109df0 0x7ff6ac19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6a3fff640 1 -- 172.21.15.92:0/1404225726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac103b60 msgr2=0x7ff6ac19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:25.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6a3fff640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac103b60 0x7ff6ac19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6a3fff640 1 -- 172.21.15.92:0/1404225726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac1a03c0 con 0x7ff6ac1094a0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.663+0000 7ff6a3fff640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6ac1094a0 0x7ff6ac19a9f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00c970 tx=0x7ff69c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.664+0000 7ff6a1ffb640 1 -- 172.21.15.92:0/1404225726 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c007bb0 con 0x7ff6ac1094a0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.664+0000 7ff6a1ffb640 1 -- 172.21.15.92:0/1404225726 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff69c007d50 con 0x7ff6ac1094a0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.664+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1404225726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac1a06b0 con 0x7ff6ac1094a0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.664+0000 7ff6a1ffb640 1 -- 172.21.15.92:0/1404225726 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c004da0 con 0x7ff6ac1094a0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.664+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1404225726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac1a6e10 con 0x7ff6ac1094a0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.665+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1404225726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ac103f70 con 0x7ff6ac1094a0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.666+0000 7ff6a1ffb640 1 -- 172.21.15.92:0/1404225726 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7ff69c004f80 con 0x7ff6ac1094a0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.667+0000 7ff6a1ffb640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6940b65f0 0x7ff6940b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.667+0000 7ff6b0983640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6940b65f0 0x7ff6940b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.667+0000 7ff6a1ffb640 1 -- 172.21.15.92:0/1404225726 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff69c0e7720 con 0x7ff6ac1094a0 2024-09-21T07:13:25.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.668+0000 7ff6b0983640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6940b65f0 0x7ff6940b8b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80057c0 tx=0x7ff6a80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:25.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.672+0000 7ff6a1ffb640 1 -- 172.21.15.92:0/1404225726 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff69c014030 con 0x7ff6ac1094a0 2024-09-21T07:13:25.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.856+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1404225726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6ac02e640 con 0x7ff6ac1094a0 2024-09-21T07:13:25.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.857+0000 7ff6a1ffb640 1 -- 172.21.15.92:0/1404225726 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+25265 (secure 0 0 0) 0x7ff69c0ad990 con 0x7ff6ac1094a0 2024-09-21T07:13:25.860 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:25.860 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":86,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:12:14.675473+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:13:25.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.859+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1404225726 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6940b65f0 msgr2=0x7ff6940b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:25.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.859+0000 7ff6b2be7640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6940b65f0 0x7ff6940b8b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80057c0 tx=0x7ff6a80058d0 comp rx=0 tx=0).stop 2024-09-21T07:13:25.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.859+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1404225726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6ac1094a0 msgr2=0x7ff6ac19a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:25.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.859+0000 7ff6b2be7640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6ac1094a0 0x7ff6ac19a9f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00c970 tx=0x7ff69c00ce30 comp rx=0 tx=0).stop 2024-09-21T07:13:25.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.860+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1404225726 shutdown_connections 2024-09-21T07:13:25.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.860+0000 7ff6b2be7640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6940b65f0 0x7ff6940b8b00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:25.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.860+0000 7ff6b2be7640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ac109df0 0x7ff6ac19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:25.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.860+0000 7ff6b2be7640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6ac1094a0 0x7ff6ac19a9f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:25.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.860+0000 7ff6b2be7640 1 --2- 172.21.15.92:0/1404225726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac103b60 0x7ff6ac19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:25.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.860+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1404225726 >> 172.21.15.92:0/1404225726 conn(0x7ff6ac07b850 msgr2=0x7ff6ac107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:25.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.860+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1404225726 shutdown_connections 2024-09-21T07:13:25.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:25.860+0000 7ff6b2be7640 1 -- 172.21.15.92:0/1404225726 wait complete. 2024-09-21T07:13:26.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:25 smithi175 ceph-mon[34064]: pgmap v350: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-21T07:13:26.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:25 smithi092 ceph-mon[30987]: pgmap v350: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-21T07:13:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:25 smithi169 ceph-mon[33705]: pgmap v350: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-21T07:13:26.579 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T07:13:26.579 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T07:13:26.588 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T07:13:26.588 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T07:13:26.588 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T07:13:26.588 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T07:13:26.588 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:13:26.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:13:26.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.705+0000 7f9516638640 1 -- 172.21.15.92:0/2620577197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510108c30 msgr2=0x7f951010f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:26.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.705+0000 7f9516638640 1 --2- 172.21.15.92:0/2620577197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510108c30 0x7f951010f460 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9508009ca0 tx=0x7f950802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:26.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.705+0000 7f9516638640 1 -- 172.21.15.92:0/2620577197 shutdown_connections 2024-09-21T07:13:26.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.705+0000 7f9516638640 1 --2- 172.21.15.92:0/2620577197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510108c30 0x7f951010f460 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:26.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.705+0000 7f9516638640 1 --2- 172.21.15.92:0/2620577197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95101082e0 0x7f95101086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:26.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.705+0000 7f9516638640 1 --2- 172.21.15.92:0/2620577197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95101029b0 0x7f9510102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:26.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.705+0000 7f9516638640 1 -- 172.21.15.92:0/2620577197 >> 172.21.15.92:0/2620577197 conn(0x7f951007a740 msgr2=0x7f951007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:26.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.705+0000 7f9516638640 1 -- 172.21.15.92:0/2620577197 shutdown_connections 2024-09-21T07:13:26.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.705+0000 7f9516638640 1 -- 172.21.15.92:0/2620577197 wait complete. 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.706+0000 7f9516638640 1 Processor -- start 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.706+0000 7f9516638640 1 -- start start 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f9516638640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95101029b0 0x7f95101991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f9516638640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95101082e0 0x7f9510199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f9516638640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510108c30 0x7f951019ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f9516638640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95101127f0 con 0x7f95101029b0 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f9516638640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9510112670 con 0x7f9510108c30 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f9516638640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9510112970 con 0x7f95101082e0 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95101029b0 0x7f95101991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95101029b0 0x7f95101991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55600/0 (socket says 172.21.15.92:55600) 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950ffff640 1 -- 172.21.15.92:0/4169651519 learned_addr learned my addr 172.21.15.92:0/4169651519 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:26.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f9514bd5640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510108c30 0x7f951019ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f9507fff640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95101082e0 0x7f9510199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950ffff640 1 -- 172.21.15.92:0/4169651519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95101082e0 msgr2=0x7f9510199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950ffff640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95101082e0 0x7f9510199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950ffff640 1 -- 172.21.15.92:0/4169651519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510108c30 msgr2=0x7f951019ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950ffff640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510108c30 0x7f951019ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950ffff640 1 -- 172.21.15.92:0/4169651519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951019f100 con 0x7f95101029b0 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950ffff640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95101029b0 0x7f95101991d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f950000d950 tx=0x7f950000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950dffb640 1 -- 172.21.15.92:0/4169651519 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500017070 con 0x7f95101029b0 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f9516638640 1 -- 172.21.15.92:0/4169651519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951019f3f0 con 0x7f95101029b0 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950dffb640 1 -- 172.21.15.92:0/4169651519 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9500009c30 con 0x7f95101029b0 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f950dffb640 1 -- 172.21.15.92:0/4169651519 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950000f620 con 0x7f95101029b0 2024-09-21T07:13:26.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.707+0000 7f9516638640 1 -- 172.21.15.92:0/4169651519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95101a5b80 con 0x7f95101029b0 2024-09-21T07:13:26.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.708+0000 7f9516638640 1 -- 172.21.15.92:0/4169651519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9510102dc0 con 0x7f95101029b0 2024-09-21T07:13:26.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.710+0000 7f950dffb640 1 -- 172.21.15.92:0/4169651519 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7f9500010460 con 0x7f95101029b0 2024-09-21T07:13:26.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.711+0000 7f950dffb640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94fc0b65f0 0x7f94fc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:26.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.711+0000 7f9507fff640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94fc0b65f0 0x7f94fc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:26.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.711+0000 7f950dffb640 1 -- 172.21.15.92:0/4169651519 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f95000e75e0 con 0x7f95101029b0 2024-09-21T07:13:26.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.712+0000 7f9507fff640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94fc0b65f0 0x7f94fc0b8b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9510107af0 tx=0x7f94f800b590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:26.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.715+0000 7f950dffb640 1 -- 172.21.15.92:0/4169651519 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f95000ad850 con 0x7f95101029b0 2024-09-21T07:13:26.853 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:26.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:26 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1404225726' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:26.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:26.931+0000 7f9516638640 1 -- 172.21.15.92:0/4169651519 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9510063800 con 0x7f94fc0b65f0 2024-09-21T07:13:27.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:26 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1404225726' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:27.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.101+0000 7f950dffb640 1 -- 172.21.15.92:0/4169651519 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9510063800 con 0x7f94fc0b65f0 2024-09-21T07:13:27.103 INFO:teuthology.orchestra.run.smithi092.stdout:Schedule set for path / 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 -- 172.21.15.92:0/4169651519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94fc0b65f0 msgr2=0x7f94fc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94fc0b65f0 0x7f94fc0b8b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9510107af0 tx=0x7f94f800b590 comp rx=0 tx=0).stop 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 -- 172.21.15.92:0/4169651519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95101029b0 msgr2=0x7f95101991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95101029b0 0x7f95101991d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f950000d950 tx=0x7f950000de10 comp rx=0 tx=0).stop 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 -- 172.21.15.92:0/4169651519 shutdown_connections 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94fc0b65f0 0x7f94fc0b8b00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510108c30 0x7f951019ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95101082e0 0x7f9510199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 --2- 172.21.15.92:0/4169651519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95101029b0 0x7f95101991d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 -- 172.21.15.92:0/4169651519 >> 172.21.15.92:0/4169651519 conn(0x7f951007a740 msgr2=0x7f95101042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 -- 172.21.15.92:0/4169651519 shutdown_connections 2024-09-21T07:13:27.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.104+0000 7f9516638640 1 -- 172.21.15.92:0/4169651519 wait complete. 2024-09-21T07:13:27.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T07:13:27.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:26 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1404225726' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.232+0000 7ff9afe84640 1 -- 172.21.15.92:0/3585056114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9a8108310 msgr2=0x7ff9a8108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.232+0000 7ff9afe84640 1 --2- 172.21.15.92:0/3585056114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9a8108310 0x7ff9a8108720 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009900 tx=0x7ff99c02a410 comp rx=0 tx=0).stop 2024-09-21T07:13:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.232+0000 7ff9afe84640 1 -- 172.21.15.92:0/3585056114 shutdown_connections 2024-09-21T07:13:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.232+0000 7ff9afe84640 1 --2- 172.21.15.92:0/3585056114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a8108c60 0x7ff9a810f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.232+0000 7ff9afe84640 1 --2- 172.21.15.92:0/3585056114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9a8108310 0x7ff9a8108720 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.232+0000 7ff9afe84640 1 --2- 172.21.15.92:0/3585056114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9a81029e0 0x7ff9a8102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.232+0000 7ff9afe84640 1 -- 172.21.15.92:0/3585056114 >> 172.21.15.92:0/3585056114 conn(0x7ff9a80fe3e0 msgr2=0x7ff9a8100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.232+0000 7ff9afe84640 1 -- 172.21.15.92:0/3585056114 shutdown_connections 2024-09-21T07:13:27.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.232+0000 7ff9afe84640 1 -- 172.21.15.92:0/3585056114 wait complete. 2024-09-21T07:13:27.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9afe84640 1 Processor -- start 2024-09-21T07:13:27.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9afe84640 1 -- start start 2024-09-21T07:13:27.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9afe84640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9a81029e0 0x7ff9a819b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9afe84640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9a8108310 0x7ff9a819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9afe84640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a8108c60 0x7ff9a819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9afe84640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81127d0 con 0x7ff9a8108310 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9afe84640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8112650 con 0x7ff9a81029e0 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9afe84640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8112950 con 0x7ff9a8108c60 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9ad41f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9a8108310 0x7ff9a819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9ad41f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9a8108310 0x7ff9a819b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55612/0 (socket says 172.21.15.92:55612) 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9ad41f640 1 -- 172.21.15.92:0/3805693085 learned_addr learned my addr 172.21.15.92:0/3805693085 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9ae421640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a8108c60 0x7ff9a819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9adc20640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9a81029e0 0x7ff9a819b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9ad41f640 1 -- 172.21.15.92:0/3805693085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a8108c60 msgr2=0x7ff9a819bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9ad41f640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a8108c60 0x7ff9a819bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9ad41f640 1 -- 172.21.15.92:0/3805693085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9a81029e0 msgr2=0x7ff9a819b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9ad41f640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9a81029e0 0x7ff9a819b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9ad41f640 1 -- 172.21.15.92:0/3805693085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a81a6410 con 0x7ff9a8108310 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.233+0000 7ff9ad41f640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9a8108310 0x7ff9a819b6c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff99c005940 tx=0x7ff99c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.234+0000 7ff9a6ffd640 1 -- 172.21.15.92:0/3805693085 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c03f030 con 0x7ff9a8108310 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.234+0000 7ff9afe84640 1 -- 172.21.15.92:0/3805693085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a81a66a0 con 0x7ff9a8108310 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.234+0000 7ff9a6ffd640 1 -- 172.21.15.92:0/3805693085 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff99c003a80 con 0x7ff9a8108310 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.234+0000 7ff9a6ffd640 1 -- 172.21.15.92:0/3805693085 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c035070 con 0x7ff9a8108310 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.234+0000 7ff9afe84640 1 -- 172.21.15.92:0/3805693085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a81a6be0 con 0x7ff9a8108310 2024-09-21T07:13:27.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.235+0000 7ff9afe84640 1 -- 172.21.15.92:0/3805693085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a8102df0 con 0x7ff9a8108310 2024-09-21T07:13:27.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.237+0000 7ff9a6ffd640 1 -- 172.21.15.92:0/3805693085 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7ff99c042030 con 0x7ff9a8108310 2024-09-21T07:13:27.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.238+0000 7ff9a6ffd640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff9900b65f0 0x7ff9900b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.238+0000 7ff9adc20640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff9900b65f0 0x7ff9900b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.238+0000 7ff9a6ffd640 1 -- 172.21.15.92:0/3805693085 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff99c108230 con 0x7ff9a8108310 2024-09-21T07:13:27.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.238+0000 7ff9adc20640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff9900b65f0 0x7ff9900b8b00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff998005c40 tx=0x7ff99800a590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:27.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.241+0000 7ff9a6ffd640 1 -- 172.21.15.92:0/3805693085 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff99c0d2880 con 0x7ff9a8108310 2024-09-21T07:13:27.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.343+0000 7f0a44027640 1 -- 172.21.15.92:0/480536139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a3c10de50 msgr2=0x7f0a3c110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.343+0000 7f0a44027640 1 --2- 172.21.15.92:0/480536139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a3c10de50 0x7f0a3c110330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009ca0 tx=0x7f0a3402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.343+0000 7f0a44027640 1 -- 172.21.15.92:0/480536139 shutdown_connections 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.343+0000 7f0a44027640 1 --2- 172.21.15.92:0/480536139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a3c10de50 0x7f0a3c110330 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.343+0000 7f0a44027640 1 --2- 172.21.15.92:0/480536139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c1052d0 0x7f0a3c10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.343+0000 7f0a44027640 1 --2- 172.21.15.92:0/480536139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a3c1048a0 0x7f0a3c104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.343+0000 7f0a44027640 1 -- 172.21.15.92:0/480536139 >> 172.21.15.92:0/480536139 conn(0x7f0a3c0797e0 msgr2=0x7f0a3c079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.344+0000 7f0a44027640 1 -- 172.21.15.92:0/480536139 shutdown_connections 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.344+0000 7f0a44027640 1 -- 172.21.15.92:0/480536139 wait complete. 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.344+0000 7f0a44027640 1 Processor -- start 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.344+0000 7f0a44027640 1 -- start start 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.344+0000 7f0a44027640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a3c1048a0 0x7f0a3c19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.344+0000 7f0a44027640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a3c1052d0 0x7f0a3c19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.344+0000 7f0a44027640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c10de50 0x7f0a3c19fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.344+0000 7f0a44027640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c1139c0 con 0x7f0a3c1052d0 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.344+0000 7f0a44027640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c113840 con 0x7f0a3c10de50 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.344+0000 7f0a44027640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c113b40 con 0x7f0a3c1048a0 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a415c2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a3c1052d0 0x7f0a3c19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a41dc3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a3c1048a0 0x7f0a3c19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a415c2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a3c1052d0 0x7f0a3c19a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55634/0 (socket says 172.21.15.92:55634) 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a415c2640 1 -- 172.21.15.92:0/3439882990 learned_addr learned my addr 172.21.15.92:0/3439882990 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a425c4640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c10de50 0x7f0a3c19fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a41dc3640 1 -- 172.21.15.92:0/3439882990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c10de50 msgr2=0x7f0a3c19fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a41dc3640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c10de50 0x7f0a3c19fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a41dc3640 1 -- 172.21.15.92:0/3439882990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a3c1052d0 msgr2=0x7f0a3c19a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a41dc3640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a3c1052d0 0x7f0a3c19a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a41dc3640 1 -- 172.21.15.92:0/3439882990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c1a0300 con 0x7f0a3c1048a0 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a415c2640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a3c1052d0 0x7f0a3c19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.345+0000 7f0a41dc3640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a3c1048a0 0x7f0a3c19a390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800e9f0 tx=0x7f0a3800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.346+0000 7f0a32ffd640 1 -- 172.21.15.92:0/3439882990 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800ccc0 con 0x7f0a3c1048a0 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.346+0000 7f0a44027640 1 -- 172.21.15.92:0/3439882990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3c1a05f0 con 0x7f0a3c1048a0 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.346+0000 7f0a32ffd640 1 -- 172.21.15.92:0/3439882990 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a38005020 con 0x7f0a3c1048a0 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.346+0000 7f0a32ffd640 1 -- 172.21.15.92:0/3439882990 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800ce60 con 0x7f0a3c1048a0 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.346+0000 7f0a44027640 1 -- 172.21.15.92:0/3439882990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3c1a6d50 con 0x7f0a3c1048a0 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.348+0000 7f0a4a59b740 1 Processor -- start 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a4a59b740 1 -- start start 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818c4350 0x561c81c6b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c8189b490 0x561c81c6b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c818a3670 0x561c81c6beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561c81be1e60 con 0x561c8189b490 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561c81bd1290 con 0x561c818a3670 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561c81bd50a0 con 0x561c818c4350 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a425c4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818c4350 0x561c81c6b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a425c4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818c4350 0x561c81c6b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:60772/0 (socket says 172.21.15.92:60772) 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a425c4640 1 -- 172.21.15.92:0/3389907469 learned_addr learned my addr 172.21.15.92:0/3389907469 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a415c2640 1 --2- 172.21.15.92:0/3389907469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c818a3670 0x561c81c6beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a425c4640 1 -- 172.21.15.92:0/3389907469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c818a3670 msgr2=0x561c81c6beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a425c4640 1 --2- 172.21.15.92:0/3389907469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c818a3670 0x561c81c6beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a425c4640 1 -- 172.21.15.92:0/3389907469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c8189b490 msgr2=0x561c81c6b970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a425c4640 1 --2- 172.21.15.92:0/3389907469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c8189b490 0x561c81c6b970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.349+0000 7f0a425c4640 1 -- 172.21.15.92:0/3389907469 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c8192f930 con 0x561c818c4350 2024-09-21T07:13:27.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.350+0000 7f0a425c4640 1 --2- 172.21.15.92:0/3389907469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818c4350 0x561c81c6b430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009ca0 tx=0x7f0a34009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3041c9039d0a607 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:27.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.350+0000 7f0a32ffd640 1 -- 172.21.15.92:0/3439882990 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7f0a38004a40 con 0x7f0a3c1048a0 2024-09-21T07:13:27.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.350+0000 7f0a27fff640 1 -- 172.21.15.92:0/3389907469 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34031980 con 0x561c818c4350 2024-09-21T07:13:27.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.350+0000 7f0a27fff640 1 -- 172.21.15.92:0/3389907469 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a34036030 con 0x561c818c4350 2024-09-21T07:13:27.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.350+0000 7f0a27fff640 1 -- 172.21.15.92:0/3389907469 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34004460 con 0x561c818c4350 2024-09-21T07:13:27.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.350+0000 7f0a32ffd640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0a280b65f0 0x7f0a280b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a41dc3640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0a280b65f0 0x7f0a280b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a4a59b740 1 -- 172.21.15.92:0/3389907469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818c4350 msgr2=0x561c81c6b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/3389907469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818c4350 0x561c81c6b430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009ca0 tx=0x7f0a34009a20 comp rx=0 tx=0).stop 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a32ffd640 1 -- 172.21.15.92:0/3439882990 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0a380e7940 con 0x7f0a3c1048a0 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a4a59b740 1 -- 172.21.15.92:0/3389907469 shutdown_connections 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/3389907469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c818a3670 0x561c81c6beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/3389907469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c8189b490 0x561c81c6b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/3389907469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818c4350 0x561c81c6b430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a4a59b740 1 -- 172.21.15.92:0/3389907469 >> 172.21.15.92:0/3389907469 conn(0x561c818b8740 msgr2=0x561c81c69320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a4a59b740 1 -- 172.21.15.92:0/3389907469 shutdown_connections 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a4a59b740 1 -- 172.21.15.92:0/3389907469 wait complete. 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a41dc3640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0a280b65f0 0x7f0a280b8b00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x561c81c6a0b0 tx=0x7f0a380a1d10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.351+0000 7f0a4a59b740 1 -- start start 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a4a59b740 1 Processor -- start 2024-09-21T07:13:27.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c8189b490 0x561c81c7b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818a3670 0x561c81c7b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c818c4350 0x561c81c87090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561c81a32890 con 0x561c8189b490 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561c81b6bd40 con 0x561c818c4350 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561c81c7dd60 con 0x561c818a3670 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a4a59b740 10 client.0 _ll_register_callbacks cb 0x561c81bcfc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a425c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c8189b490 0x561c81c7b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a415c2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818a3670 0x561c81c7b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a425c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c8189b490 0x561c81c7b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55646/0 (socket says 172.21.15.92:55646) 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a425c4640 1 -- 172.21.15.92:0/2749320318 learned_addr learned my addr 172.21.15.92:0/2749320318 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.352+0000 7f0a425c4640 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c818c4350 0x561c81c87090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a415c2640 1 -- 172.21.15.92:0/2749320318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c818c4350 msgr2=0x561c81c87090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:27.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a415c2640 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c818c4350 0x561c81c87090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a415c2640 1 -- 172.21.15.92:0/2749320318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c8189b490 msgr2=0x561c81c7b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a415c2640 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c8189b490 0x561c81c7b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a415c2640 1 -- 172.21.15.92:0/2749320318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c81c87680 con 0x561c818a3670 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a415c2640 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818a3670 0x561c81c7b940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c005d00 tx=0x7f0a2c0039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e04ec9fca82650b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a257fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a257fa640 1 -- 172.21.15.92:0/2749320318 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c011850 con 0x561c818a3670 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a4a59b740 1 -- 172.21.15.92:0/2749320318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a34036030 con 0x561c818a3670 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a257fa640 1 -- 172.21.15.92:0/2749320318 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0a2c0119f0 con 0x561c818a3670 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a257fa640 1 -- 172.21.15.92:0/2749320318 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0a2c024050 con 0x561c818a3670 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a4a59b740 10 client.25222 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a4a59b740 1 -- 172.21.15.92:0/2749320318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561c81c8a040 con 0x561c818a3670 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.353+0000 7f0a257fa640 1 -- 172.21.15.92:0/2749320318 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a34036030 con 0x561c818a3670 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.354+0000 7f0a257fa640 1 -- 172.21.15.92:0/2749320318 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0a2c019020 con 0x561c818a3670 2024-09-21T07:13:27.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.354+0000 7f0a4a59b740 10 client.25222 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.354+0000 7f0a4a59b740 10 client.25222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.354+0000 7f0a4a59b740 20 client.25222 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.354+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561c81882cd0 0x561c81c8d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.354+0000 7f0a4a59b740 4 client.25222 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.354+0000 7f0a4a59b740 1 -- 172.21.15.92:0/2749320318 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c81be3db0 con 0x561c81882cd0 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.354+0000 7f0a425c4640 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561c81882cd0 0x561c81c8d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.354+0000 7f0a257fa640 10 client.25222 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.354+0000 7f0a425c4640 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561c81882cd0 0x561c81c8d5a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b28b1fe9cd8ebbf9 server_cookie=745c842bfa627852 in_seq=0 out_seq=0 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a257fa640 1 -- 172.21.15.92:0/2749320318 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c81be3db0 con 0x561c81882cd0 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a257fa640 10 client.25222 handle_command_reply: tid=0 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a4a59b740 1 client.25222 shutdown 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a4a59b740 1 -- 172.21.15.92:0/2749320318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818a3670 msgr2=0x561c81c7b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818a3670 0x561c81c7b940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c005d00 tx=0x7f0a2c0039c0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a4a59b740 1 -- 172.21.15.92:0/2749320318 shutdown_connections 2024-09-21T07:13:27.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561c81882cd0 0x561c81c8d5a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c818c4350 0x561c81c87090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c818a3670 0x561c81c7b940 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/2749320318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c8189b490 0x561c81c7b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a257fa640 0 client.25222 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:27.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.355+0000 7f0a4a59b740 1 -- 172.21.15.92:0/2749320318 >> 172.21.15.92:0/2749320318 conn(0x561c818b8740 msgr2=0x561c81c67850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.356+0000 7f0a4a59b740 1 -- 172.21.15.92:0/2749320318 shutdown_connections 2024-09-21T07:13:27.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.356+0000 7f0a4a59b740 1 -- 172.21.15.92:0/2749320318 wait complete. 2024-09-21T07:13:27.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.356+0000 7f0a4a59b740 20 client.25222 trim_cache size 0 max 16384 2024-09-21T07:13:27.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.373+0000 7f0a4a59b740 1 Processor -- start 2024-09-21T07:13:27.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.373+0000 7f0a4a59b740 1 -- start start 2024-09-21T07:13:27.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.373+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c81882cd0 0x561c81c79a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.373+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c8189b490 0x561c81c79fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.373+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c68c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.373+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c1aeb40 con 0x561c818a3670 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c1b0680 con 0x561c8189b490 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c1af210 con 0x561c81882cd0 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a425c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c68c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a425c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c68c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55656/0 (socket says 172.21.15.92:55656) 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a425c4640 1 -- 172.21.15.92:0/833401190 learned_addr learned my addr 172.21.15.92:0/833401190 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a425c4640 1 --2- 172.21.15.92:0/833401190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c81882cd0 0x561c81c79a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a415c2640 1 --2- 172.21.15.92:0/833401190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c8189b490 0x561c81c79fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a425c4640 1 -- 172.21.15.92:0/833401190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c81882cd0 msgr2=0x561c81c79a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a425c4640 1 --2- 172.21.15.92:0/833401190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c81882cd0 0x561c81c79a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a425c4640 1 -- 172.21.15.92:0/833401190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c8189b490 msgr2=0x561c81c79fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a425c4640 1 --2- 172.21.15.92:0/833401190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c8189b490 0x561c81c79fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a425c4640 1 -- 172.21.15.92:0/833401190 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c81c6e240 con 0x561c818a3670 2024-09-21T07:13:27.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a425c4640 1 --2- 172.21.15.92:0/833401190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c68c80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0a340040b0 tx=0x7f0a34005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178bcc9b581f1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:27.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a277fe640 1 -- 172.21.15.92:0/833401190 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3404a040 con 0x561c818a3670 2024-09-21T07:13:27.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a277fe640 1 -- 172.21.15.92:0/833401190 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a34036070 con 0x561c818a3670 2024-09-21T07:13:27.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.374+0000 7f0a277fe640 1 -- 172.21.15.92:0/833401190 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a340305c0 con 0x561c818a3670 2024-09-21T07:13:27.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 -- 172.21.15.92:0/833401190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 msgr2=0x561c81c68c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/833401190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c68c80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0a340040b0 tx=0x7f0a34005fd0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 -- 172.21.15.92:0/833401190 shutdown_connections 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/833401190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c68c80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/833401190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c8189b490 0x561c81c79fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/833401190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c81882cd0 0x561c81c79a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 -- 172.21.15.92:0/833401190 >> 172.21.15.92:0/833401190 conn(0x561c818b8740 msgr2=0x561c81c76370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 -- 172.21.15.92:0/833401190 shutdown_connections 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 -- 172.21.15.92:0/833401190 wait complete. 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 -- start start 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.376+0000 7f0a4a59b740 1 Processor -- start 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c81882cd0 0x561c81c835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c8189b490 0x561c81c7dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a4a59b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c7e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c1affb0 con 0x561c818a3670 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c1af8e0 con 0x561c81882cd0 2024-09-21T07:13:27.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a4a59b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c1acb20 con 0x561c8189b490 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a4a59b740 10 client.0 _ll_register_callbacks cb 0x7f0a2c00bca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a425c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c7e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a425c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c7e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55658/0 (socket says 172.21.15.92:55658) 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a425c4640 1 -- 172.21.15.92:0/807487270 learned_addr learned my addr 172.21.15.92:0/807487270 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a425c4640 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c81882cd0 0x561c81c835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.377+0000 7f0a415c2640 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c8189b490 0x561c81c7dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a425c4640 1 -- 172.21.15.92:0/807487270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c8189b490 msgr2=0x561c81c7dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a425c4640 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c8189b490 0x561c81c7dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a425c4640 1 -- 172.21.15.92:0/807487270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c81882cd0 msgr2=0x561c81c835e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a425c4640 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c81882cd0 0x561c81c835e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a425c4640 1 -- 172.21.15.92:0/807487270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c81c7dca0 con 0x561c818a3670 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a425c4640 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c7e4f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0a34004840 tx=0x7f0a3403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0069706216803a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a257fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:27.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a257fa640 1 -- 172.21.15.92:0/807487270 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3405d040 con 0x561c818a3670 2024-09-21T07:13:27.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a257fa640 1 -- 172.21.15.92:0/807487270 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0a340042e0 con 0x561c818a3670 2024-09-21T07:13:27.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a4a59b740 1 -- 172.21.15.92:0/807487270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a34036070 con 0x561c818a3670 2024-09-21T07:13:27.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a257fa640 1 -- 172.21.15.92:0/807487270 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0a3404a040 con 0x561c818a3670 2024-09-21T07:13:27.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a4a59b740 10 client.15690 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:27.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.378+0000 7f0a4a59b740 1 -- 172.21.15.92:0/807487270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561c81cf8b60 con 0x561c818a3670 2024-09-21T07:13:27.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a257fa640 1 -- 172.21.15.92:0/807487270 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a34036070 con 0x561c818a3670 2024-09-21T07:13:27.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a257fa640 1 -- 172.21.15.92:0/807487270 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0a34050040 con 0x561c818a3670 2024-09-21T07:13:27.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a4a59b740 10 client.15690 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:27.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a4a59b740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:13:27.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a4a59b740 20 client.15690 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:27.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561c818c4350 0x561c81cfaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a4a59b740 4 client.15690 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a4a59b740 1 -- 172.21.15.92:0/807487270 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561c81bdf860 con 0x561c818c4350 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a415c2640 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561c818c4350 0x561c81cfaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a415c2640 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561c818c4350 0x561c81cfaf20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=babcc4d1934ae5cb server_cookie=9e5d358e795bd4ad in_seq=0 out_seq=0 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.379+0000 7f0a257fa640 10 client.15690 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a257fa640 1 -- 172.21.15.92:0/807487270 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561c81bdf860 con 0x561c818c4350 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a257fa640 10 client.15690 handle_command_reply: tid=0 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a4a59b740 1 client.15690 shutdown 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a4a59b740 1 -- 172.21.15.92:0/807487270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 msgr2=0x561c81c7e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c7e4f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0a34004840 tx=0x7f0a3403e040 comp rx=0 tx=0).stop 2024-09-21T07:13:27.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a4a59b740 1 -- 172.21.15.92:0/807487270 shutdown_connections 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561c818c4350 0x561c81cfaf20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c818a3670 0x561c81c7e4f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561c8189b490 0x561c81c7dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a4a59b740 1 --2- 172.21.15.92:0/807487270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c81882cd0 0x561c81c835e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a4a59b740 1 -- 172.21.15.92:0/807487270 >> 172.21.15.92:0/807487270 conn(0x561c818b8740 msgr2=0x561c81c7b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.381+0000 7f0a257fa640 0 client.15690 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a4a59b740 1 -- 172.21.15.92:0/807487270 shutdown_connections 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a4a59b740 1 -- 172.21.15.92:0/807487270 wait complete. 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a4a59b740 20 client.15690 trim_cache size 0 max 16384 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:27.386 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:13:27.387 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "d407b537-389e-488f-bc01-d777c1d3796e", 2024-09-21T07:13:27.387 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:13:27.387 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:27.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a44027640 1 -- 172.21.15.92:0/3439882990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0a280b65f0 msgr2=0x7f0a280b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a44027640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0a280b65f0 0x7f0a280b8b00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x561c81c6a0b0 tx=0x7f0a380a1d10 comp rx=0 tx=0).stop 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a44027640 1 -- 172.21.15.92:0/3439882990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a3c1048a0 msgr2=0x7f0a3c19a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a44027640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a3c1048a0 0x7f0a3c19a390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800e9f0 tx=0x7f0a3800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a44027640 1 -- 172.21.15.92:0/3439882990 shutdown_connections 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a44027640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0a280b65f0 0x7f0a280b8b00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a44027640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c10de50 0x7f0a3c19fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a44027640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a3c1052d0 0x7f0a3c19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a44027640 1 --2- 172.21.15.92:0/3439882990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a3c1048a0 0x7f0a3c19a390 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800e9f0 tx=0x7f0a3800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.382+0000 7f0a44027640 1 -- 172.21.15.92:0/3439882990 >> 172.21.15.92:0/3439882990 conn(0x7f0a3c0797e0 msgr2=0x7f0a3c1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.383+0000 7f0a44027640 1 -- 172.21.15.92:0/3439882990 shutdown_connections 2024-09-21T07:13:27.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.383+0000 7f0a44027640 1 -- 172.21.15.92:0/3439882990 wait complete. 2024-09-21T07:13:27.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.458+0000 7ff9afe84640 1 -- 172.21.15.92:0/3805693085 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7ff9a8063800 con 0x7ff9900b65f0 2024-09-21T07:13:27.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.519+0000 7ff9a6ffd640 1 -- 172.21.15.92:0/3805693085 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7ff9a8063800 con 0x7ff9900b65f0 2024-09-21T07:13:27.521 INFO:teuthology.orchestra.run.smithi092.stdout:Retention added to path / 2024-09-21T07:13:27.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 -- 172.21.15.92:0/3805693085 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff9900b65f0 msgr2=0x7ff9900b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff9900b65f0 0x7ff9900b8b00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff998005c40 tx=0x7ff99800a590 comp rx=0 tx=0).stop 2024-09-21T07:13:27.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 -- 172.21.15.92:0/3805693085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9a8108310 msgr2=0x7ff9a819b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9a8108310 0x7ff9a819b6c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff99c005940 tx=0x7ff99c0040e0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 -- 172.21.15.92:0/3805693085 shutdown_connections 2024-09-21T07:13:27.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff9900b65f0 0x7ff9900b8b00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a8108c60 0x7ff9a819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9a8108310 0x7ff9a819b6c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 --2- 172.21.15.92:0/3805693085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9a81029e0 0x7ff9a819b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 -- 172.21.15.92:0/3805693085 >> 172.21.15.92:0/3805693085 conn(0x7ff9a80fe3e0 msgr2=0x7ff9a8100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 -- 172.21.15.92:0/3805693085 shutdown_connections 2024-09-21T07:13:27.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.521+0000 7ff9afe84640 1 -- 172.21.15.92:0/3805693085 wait complete. 2024-09-21T07:13:27.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T07:13:27.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.644+0000 7f69ad884640 1 -- 172.21.15.92:0/4257600214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69a8107ab0 msgr2=0x7f69a8107ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.644+0000 7f69ad884640 1 --2- 172.21.15.92:0/4257600214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69a8107ab0 0x7f69a8107ec0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f699c009900 tx=0x7f699c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.644+0000 7f69ad884640 1 -- 172.21.15.92:0/4257600214 shutdown_connections 2024-09-21T07:13:27.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.644+0000 7f69ad884640 1 --2- 172.21.15.92:0/4257600214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a8108400 0x7f69a810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.644+0000 7f69ad884640 1 --2- 172.21.15.92:0/4257600214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69a8107ab0 0x7f69a8107ec0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.644+0000 7f69ad884640 1 --2- 172.21.15.92:0/4257600214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69a8102180 0x7f69a8102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.644+0000 7f69ad884640 1 -- 172.21.15.92:0/4257600214 >> 172.21.15.92:0/4257600214 conn(0x7f69a8077ad0 msgr2=0x7f69a8077f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.644+0000 7f69ad884640 1 -- 172.21.15.92:0/4257600214 shutdown_connections 2024-09-21T07:13:27.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.644+0000 7f69ad884640 1 -- 172.21.15.92:0/4257600214 wait complete. 2024-09-21T07:13:27.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69ad884640 1 Processor -- start 2024-09-21T07:13:27.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69ad884640 1 -- start start 2024-09-21T07:13:27.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69ad884640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69a8102180 0x7f69a819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69ad884640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a8107ab0 0x7f69a819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69ad884640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69a8108400 0x7f69a819fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69ad884640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81138e0 con 0x7f69a8108400 2024-09-21T07:13:27.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69ad884640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69a8113760 con 0x7f69a8107ab0 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69ad884640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69a8113a60 con 0x7f69a8102180 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69a77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69a8108400 0x7f69a819fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69a77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69a8108400 0x7f69a819fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55682/0 (socket says 172.21.15.92:55682) 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69a77fe640 1 -- 172.21.15.92:0/2550942493 learned_addr learned my addr 172.21.15.92:0/2550942493 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69a67fc640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a8107ab0 0x7f69a819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.645+0000 7f69a6ffd640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69a8102180 0x7f69a819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69a77fe640 1 -- 172.21.15.92:0/2550942493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69a8102180 msgr2=0x7f69a819a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69a77fe640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69a8102180 0x7f69a819a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69a77fe640 1 -- 172.21.15.92:0/2550942493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a8107ab0 msgr2=0x7f69a819a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69a77fe640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a8107ab0 0x7f69a819a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69a77fe640 1 -- 172.21.15.92:0/2550942493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a81a01a0 con 0x7f69a8108400 2024-09-21T07:13:27.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69a77fe640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69a8108400 0x7f69a819fb30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f69a000cce0 tx=0x7f69a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:27.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69ac882640 1 -- 172.21.15.92:0/2550942493 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a000f450 con 0x7f69a8108400 2024-09-21T07:13:27.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69ad884640 1 -- 172.21.15.92:0/2550942493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a81a0490 con 0x7f69a8108400 2024-09-21T07:13:27.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69ac882640 1 -- 172.21.15.92:0/2550942493 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69a000fa80 con 0x7f69a8108400 2024-09-21T07:13:27.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69ac882640 1 -- 172.21.15.92:0/2550942493 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0018ad0 con 0x7f69a8108400 2024-09-21T07:13:27.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.646+0000 7f69ad884640 1 -- 172.21.15.92:0/2550942493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a81a6cb0 con 0x7f69a8108400 2024-09-21T07:13:27.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.647+0000 7f69ad884640 1 -- 172.21.15.92:0/2550942493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a8102590 con 0x7f69a8108400 2024-09-21T07:13:27.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.649+0000 7f69ac882640 1 -- 172.21.15.92:0/2550942493 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 154580+0+0 (secure 0 0 0) 0x7f69a000f5f0 con 0x7f69a8108400 2024-09-21T07:13:27.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.649+0000 7f69ac882640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69900b65f0 0x7f69900b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:27.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.649+0000 7f69a6ffd640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69900b65f0 0x7f69900b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:27.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.649+0000 7f69ac882640 1 -- 172.21.15.92:0/2550942493 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f69a00e8260 con 0x7f69a8108400 2024-09-21T07:13:27.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.650+0000 7f69a6ffd640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69900b65f0 0x7f69900b8b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6998005e10 tx=0x7f6998005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:27.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.652+0000 7f69ac882640 1 -- 172.21.15.92:0/2550942493 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69a0014030 con 0x7f69a8108400 2024-09-21T07:13:27.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.770+0000 7f69ac882640 1 -- 172.21.15.92:0/2550942493 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f69a00aa0d0 con 0x7f69a8108400 2024-09-21T07:13:27.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:27 smithi092 ceph-mon[30987]: from='client.15663 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:27.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:27 smithi092 ceph-mon[30987]: from='client.15675 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:27.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:27 smithi092 ceph-mon[30987]: pgmap v351: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-21T07:13:27.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.866+0000 7f69ad884640 1 -- 172.21.15.92:0/2550942493 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f69a810a200 con 0x7f69900b65f0 2024-09-21T07:13:27.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.873+0000 7f69ac882640 1 -- 172.21.15.92:0/2550942493 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f69a810a200 con 0x7f69900b65f0 2024-09-21T07:13:27.875 INFO:teuthology.orchestra.run.smithi092.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T07:13:26", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T07:13:27.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 -- 172.21.15.92:0/2550942493 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69900b65f0 msgr2=0x7f69900b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69900b65f0 0x7f69900b8b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6998005e10 tx=0x7f6998005da0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 -- 172.21.15.92:0/2550942493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69a8108400 msgr2=0x7f69a819fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:27.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69a8108400 0x7f69a819fb30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f69a000cce0 tx=0x7f69a000a620 comp rx=0 tx=0).stop 2024-09-21T07:13:27.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 -- 172.21.15.92:0/2550942493 shutdown_connections 2024-09-21T07:13:27.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69900b65f0 0x7f69900b8b00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69a8108400 0x7f69a819fb30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69a8107ab0 0x7f69a819a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 --2- 172.21.15.92:0/2550942493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69a8102180 0x7f69a819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:27.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 -- 172.21.15.92:0/2550942493 >> 172.21.15.92:0/2550942493 conn(0x7f69a8077ad0 msgr2=0x7f69a8103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:27.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 -- 172.21.15.92:0/2550942493 shutdown_connections 2024-09-21T07:13:27.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.875+0000 7f69ad884640 1 -- 172.21.15.92:0/2550942493 wait complete. 2024-09-21T07:13:27.888 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T07:13:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.997+0000 7fc1fce30640 1 -- 172.21.15.92:0/1510592815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f81029e0 msgr2=0x7fc1f8102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.997+0000 7fc1fce30640 1 --2- 172.21.15.92:0/1510592815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f81029e0 0x7fc1f8102df0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009900 tx=0x7fc1e002a410 comp rx=0 tx=0).stop 2024-09-21T07:13:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.997+0000 7fc1fce30640 1 -- 172.21.15.92:0/1510592815 shutdown_connections 2024-09-21T07:13:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.997+0000 7fc1fce30640 1 --2- 172.21.15.92:0/1510592815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1f8108c60 0x7fc1f810f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.997+0000 7fc1fce30640 1 --2- 172.21.15.92:0/1510592815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f8108310 0x7fc1f8108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.997+0000 7fc1fce30640 1 --2- 172.21.15.92:0/1510592815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f81029e0 0x7fc1f8102df0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.997+0000 7fc1fce30640 1 -- 172.21.15.92:0/1510592815 >> 172.21.15.92:0/1510592815 conn(0x7fc1f80fe3c0 msgr2=0x7fc1f8100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.997+0000 7fc1fce30640 1 -- 172.21.15.92:0/1510592815 shutdown_connections 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.997+0000 7fc1fce30640 1 -- 172.21.15.92:0/1510592815 wait complete. 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1fce30640 1 Processor -- start 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1fce30640 1 -- start start 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1fce30640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1f81029e0 0x7fc1f819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1fce30640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f8108310 0x7fc1f819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1fce30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f8108c60 0x7fc1f819fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1fce30640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f81127d0 con 0x7fc1f8108c60 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1fce30640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f8112650 con 0x7fc1f81029e0 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1fce30640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f8112950 con 0x7fc1f8108310 2024-09-21T07:13:28.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1f6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f8108c60 0x7fc1f819fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1f6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f8108c60 0x7fc1f819fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55702/0 (socket says 172.21.15.92:55702) 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.998+0000 7fc1f6d9d640 1 -- 172.21.15.92:0/273855718 learned_addr learned my addr 172.21.15.92:0/273855718 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1f5d9b640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f8108310 0x7fc1f819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1f659c640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1f81029e0 0x7fc1f819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1f6d9d640 1 -- 172.21.15.92:0/273855718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f8108310 msgr2=0x7fc1f819a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1f6d9d640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f8108310 0x7fc1f819a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1f6d9d640 1 -- 172.21.15.92:0/273855718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1f81029e0 msgr2=0x7fc1f819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1f6d9d640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1f81029e0 0x7fc1f819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1f6d9d640 1 -- 172.21.15.92:0/273855718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f81a0200 con 0x7fc1f8108c60 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1f659c640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1f81029e0 0x7fc1f819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1f6d9d640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f8108c60 0x7fc1f819fb90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000eaa0 tx=0x7fc1f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1ef7fe640 1 -- 172.21.15.92:0/273855718 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f000cdb0 con 0x7fc1f8108c60 2024-09-21T07:13:28.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1ef7fe640 1 -- 172.21.15.92:0/273855718 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1f0005020 con 0x7fc1f8108c60 2024-09-21T07:13:28.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1fce30640 1 -- 172.21.15.92:0/273855718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f81a04f0 con 0x7fc1f8108c60 2024-09-21T07:13:28.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1ef7fe640 1 -- 172.21.15.92:0/273855718 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00116d0 con 0x7fc1f8108c60 2024-09-21T07:13:28.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:27.999+0000 7fc1fce30640 1 -- 172.21.15.92:0/273855718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f81a6d10 con 0x7fc1f8108c60 2024-09-21T07:13:28.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.000+0000 7fc1fce30640 1 -- 172.21.15.92:0/273855718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f8102df0 con 0x7fc1f8108c60 2024-09-21T07:13:28.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.001+0000 7fc1ef7fe640 1 -- 172.21.15.92:0/273855718 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7fc1f00051d0 con 0x7fc1f8108c60 2024-09-21T07:13:28.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.002+0000 7fc1ef7fe640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc1e40b6680 0x7fc1e40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.002+0000 7fc1f659c640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc1e40b6680 0x7fc1e40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.002+0000 7fc1ef7fe640 1 -- 172.21.15.92:0/273855718 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc1f00e8150 con 0x7fc1f8108c60 2024-09-21T07:13:28.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.003+0000 7fc1f659c640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc1e40b6680 0x7fc1e40b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0006010 tx=0x7fc1e0000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:28.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.005+0000 7fc1ef7fe640 1 -- 172.21.15.92:0/273855718 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1f0016030 con 0x7fc1f8108c60 2024-09-21T07:13:28.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:27 smithi175 ceph-mon[34064]: from='client.15663 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:28.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:27 smithi175 ceph-mon[34064]: from='client.15675 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:28.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:27 smithi175 ceph-mon[34064]: pgmap v351: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-21T07:13:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:27 smithi169 ceph-mon[33705]: from='client.15663 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:28.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:27 smithi169 ceph-mon[33705]: from='client.15675 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:28.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:27 smithi169 ceph-mon[33705]: pgmap v351: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-21T07:13:28.174 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:13:28.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.211+0000 7fc1fce30640 1 -- 172.21.15.92:0/273855718 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fc1f8106ae0 con 0x7fc1e40b6680 2024-09-21T07:13:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.219+0000 7fc1ef7fe640 1 -- 172.21.15.92:0/273855718 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fc1f8106ae0 con 0x7fc1e40b6680 2024-09-21T07:13:28.221 INFO:teuthology.orchestra.run.smithi092.stdout:/ 1m 6m3h 2024-09-21T07:13:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 -- 172.21.15.92:0/273855718 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc1e40b6680 msgr2=0x7fc1e40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc1e40b6680 0x7fc1e40b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0006010 tx=0x7fc1e0000bc0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 -- 172.21.15.92:0/273855718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f8108c60 msgr2=0x7fc1f819fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f8108c60 0x7fc1f819fb90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000eaa0 tx=0x7fc1f000ef60 comp rx=0 tx=0).stop 2024-09-21T07:13:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 -- 172.21.15.92:0/273855718 shutdown_connections 2024-09-21T07:13:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc1e40b6680 0x7fc1e40b8b90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f8108c60 0x7fc1f819fb90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f8108310 0x7fc1f819a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 --2- 172.21.15.92:0/273855718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1f81029e0 0x7fc1f819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 -- 172.21.15.92:0/273855718 >> 172.21.15.92:0/273855718 conn(0x7fc1f80fe3c0 msgr2=0x7fc1f81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 -- 172.21.15.92:0/273855718 shutdown_connections 2024-09-21T07:13:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.221+0000 7fc1fce30640 1 -- 172.21.15.92:0/273855718 wait complete. 2024-09-21T07:13:28.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T07:13:28.301 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T07:13:28.315 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T07:13:28.339 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T07:13:28.340 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T07:13:28.343 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T07:13:28.358 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:13:28.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:13:28.429 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:28.852 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:28 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:13:28.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:28 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:13:28.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:28 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:13:28.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:28 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:13:28.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:28 smithi092 ceph-mon[30987]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-09-21T07:13:28.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:28 smithi092 ceph-mon[30987]: from='client.15696 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:28.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:28 smithi092 ceph-mon[30987]: from='client.15702 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:28.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.943+0000 7f8028aac640 1 -- 172.21.15.92:0/3586217311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8024102a80 msgr2=0x7f8024102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.943+0000 7f8028aac640 1 --2- 172.21.15.92:0/3586217311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8024102a80 0x7f8024102e90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8014009900 tx=0x7f801402a410 comp rx=0 tx=0).stop 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.943+0000 7f8028aac640 1 -- 172.21.15.92:0/3586217311 shutdown_connections 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.943+0000 7f8028aac640 1 --2- 172.21.15.92:0/3586217311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8024108d10 0x7f802410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.943+0000 7f8028aac640 1 --2- 172.21.15.92:0/3586217311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80241083c0 0x7f80241087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.943+0000 7f8028aac640 1 --2- 172.21.15.92:0/3586217311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8024102a80 0x7f8024102e90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.943+0000 7f8028aac640 1 -- 172.21.15.92:0/3586217311 >> 172.21.15.92:0/3586217311 conn(0x7f8024079740 msgr2=0x7f8024079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.943+0000 7f8028aac640 1 -- 172.21.15.92:0/3586217311 shutdown_connections 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.943+0000 7f8028aac640 1 -- 172.21.15.92:0/3586217311 wait complete. 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8028aac640 1 Processor -- start 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8028aac640 1 -- start start 2024-09-21T07:13:28.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8028aac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8024102a80 0x7f802419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8028aac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80241083c0 0x7f802419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8028aac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8024108d10 0x7f802419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8028aac640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8024113990 con 0x7f80241083c0 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8028aac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8024113810 con 0x7f8024108d10 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8028aac640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8024113b10 con 0x7f8024102a80 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8019d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80241083c0 0x7f802419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8019d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80241083c0 0x7f802419a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55714/0 (socket says 172.21.15.92:55714) 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.944+0000 7f8019d9b640 1 -- 172.21.15.92:0/2589712268 learned_addr learned my addr 172.21.15.92:0/2589712268 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f802259c640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8024102a80 0x7f802419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f8022d9d640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8024108d10 0x7f802419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f8019d9b640 1 -- 172.21.15.92:0/2589712268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8024102a80 msgr2=0x7f802419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f8019d9b640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8024102a80 0x7f802419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f8019d9b640 1 -- 172.21.15.92:0/2589712268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8024108d10 msgr2=0x7f802419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f8019d9b640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8024108d10 0x7f802419fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f8019d9b640 1 -- 172.21.15.92:0/2589712268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80241a03b0 con 0x7f80241083c0 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f802259c640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8024102a80 0x7f802419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f8019d9b640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80241083c0 0x7f802419a9e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f800c00d770 tx=0x7f800c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f801bfff640 1 -- 172.21.15.92:0/2589712268 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c017070 con 0x7f80241083c0 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f801bfff640 1 -- 172.21.15.92:0/2589712268 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f800c009c30 con 0x7f80241083c0 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f8028aac640 1 -- 172.21.15.92:0/2589712268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80241a06a0 con 0x7f80241083c0 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f801bfff640 1 -- 172.21.15.92:0/2589712268 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c00f620 con 0x7f80241083c0 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.945+0000 7f8028aac640 1 -- 172.21.15.92:0/2589712268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80241a6e00 con 0x7f80241083c0 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f802f020740 1 Processor -- start 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f802f020740 1 -- start start 2024-09-21T07:13:28.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f801bfff640 1 -- 172.21.15.92:0/2589712268 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f800c01a070 con 0x7f80241083c0 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f802f020740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ef7070 0x55f63229e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f802f020740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ece1b0 0x55f63229eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f802f020740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f63229f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f802f020740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f632214e50 con 0x55f631ed6390 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f802f020740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f632204280 con 0x55f631ef7070 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f802f020740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f632208090 con 0x55f631ece1b0 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f8019d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f63229f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f8019d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f63229f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55724/0 (socket says 172.21.15.92:55724) 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.948+0000 7f8019d9b640 1 -- 172.21.15.92:0/734685351 learned_addr learned my addr 172.21.15.92:0/734685351 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8022d9d640 1 --2- 172.21.15.92:0/734685351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ef7070 0x55f63229e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f802259c640 1 --2- 172.21.15.92:0/734685351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ece1b0 0x55f63229eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8019d9b640 1 -- 172.21.15.92:0/734685351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ece1b0 msgr2=0x55f63229eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8019d9b640 1 --2- 172.21.15.92:0/734685351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ece1b0 0x55f63229eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8019d9b640 1 -- 172.21.15.92:0/734685351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ef7070 msgr2=0x55f63229e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8019d9b640 1 --2- 172.21.15.92:0/734685351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ef7070 0x55f63229e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8019d9b640 1 -- 172.21.15.92:0/734685351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f631f62650 con 0x55f631ed6390 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f801bfff640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80100b6680 0x7f80100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8019d9b640 1 --2- 172.21.15.92:0/734685351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f63229f0d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f800c0e4970 tx=0x7f800c0ef690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130ba95c790b296 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8022d9d640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80100b6680 0x7f80100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f801bfff640 1 -- 172.21.15.92:0/2589712268 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f800c0e7650 con 0x7f80241083c0 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8018d99640 1 -- 172.21.15.92:0/734685351 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c0a9750 con 0x55f631ed6390 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8018d99640 1 -- 172.21.15.92:0/734685351 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f800c010e40 con 0x55f631ed6390 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.949+0000 7f8018d99640 1 -- 172.21.15.92:0/734685351 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c0ac870 con 0x55f631ed6390 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.950+0000 7f802f020740 1 -- 172.21.15.92:0/734685351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 msgr2=0x55f63229f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.950+0000 7f8022d9d640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80100b6680 0x7f80100b8b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f801c007d80 tx=0x7f801c007430 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.950+0000 7f802f020740 1 --2- 172.21.15.92:0/734685351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f63229f0d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f800c0e4970 tx=0x7f800c0ef690 comp rx=0 tx=0).stop 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.950+0000 7f802f020740 1 -- 172.21.15.92:0/734685351 shutdown_connections 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.950+0000 7f802f020740 1 --2- 172.21.15.92:0/734685351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f63229f0d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.950+0000 7f802f020740 1 --2- 172.21.15.92:0/734685351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ece1b0 0x55f63229eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.950+0000 7f802f020740 1 --2- 172.21.15.92:0/734685351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ef7070 0x55f63229e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.950+0000 7f802f020740 1 -- 172.21.15.92:0/734685351 >> 172.21.15.92:0/734685351 conn(0x55f631eeb460 msgr2=0x55f63229c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.950+0000 7f802f020740 1 -- 172.21.15.92:0/734685351 shutdown_connections 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.950+0000 7f802f020740 1 -- 172.21.15.92:0/734685351 wait complete. 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f802f020740 1 -- start start 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f802f020740 1 Processor -- start 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f802f020740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 0x55f6322a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f802f020740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ed6390 0x55f6322aa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f802f020740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ef7070 0x55f6322aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f802f020740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f632065700 con 0x55f631ef7070 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f802f020740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f63219f110 con 0x55f631ece1b0 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f802f020740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f6322ace30 con 0x55f631ed6390 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f802f020740 10 client.0 _ll_register_callbacks cb 0x55f6321b8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f8022d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ef7070 0x55f6322aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f8022d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ef7070 0x55f6322aa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55728/0 (socket says 172.21.15.92:55728) 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.951+0000 7f8022d9d640 1 -- 172.21.15.92:0/3861761565 learned_addr learned my addr 172.21.15.92:0/3861761565 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f802259c640 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 0x55f6322a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8019d9b640 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ed6390 0x55f6322aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8022d9d640 1 -- 172.21.15.92:0/3861761565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ed6390 msgr2=0x55f6322aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8022d9d640 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ed6390 0x55f6322aa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8022d9d640 1 -- 172.21.15.92:0/3861761565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 msgr2=0x55f6322a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8022d9d640 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 0x55f6322a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8022d9d640 1 -- 172.21.15.92:0/3861761565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6321ccc40 con 0x55f631ef7070 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8022d9d640 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ef7070 0x55f6322aa6c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f801c014a70 tx=0x7f801c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d666e1df1f55d3df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8009ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8009ffb640 1 -- 172.21.15.92:0/3861761565 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c01a050 con 0x55f631ef7070 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8009ffb640 1 -- 172.21.15.92:0/3861761565 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f801c012a00 con 0x55f631ef7070 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f802f020740 1 -- 172.21.15.92:0/3861761565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f632216da0 con 0x55f631ef7070 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8009ffb640 1 -- 172.21.15.92:0/3861761565 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f801c012c00 con 0x55f631ef7070 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f802f020740 10 client.15714 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f802f020740 1 -- 172.21.15.92:0/3861761565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f6322b8ae0 con 0x55f631ef7070 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.952+0000 7f8009ffb640 1 -- 172.21.15.92:0/3861761565 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f632216da0 con 0x55f631ef7070 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.953+0000 7f8009ffb640 1 -- 172.21.15.92:0/3861761565 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f801c011070 con 0x55f631ef7070 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.953+0000 7f802f020740 10 client.15714 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:28.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.953+0000 7f802f020740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:13:28.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.953+0000 7f802f020740 20 client.15714 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:28.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.953+0000 7f802f020740 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f631eb59f0 0x55f6322bc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.953+0000 7f802f020740 4 client.15714 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:28.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.953+0000 7f802f020740 1 -- 172.21.15.92:0/3861761565 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f632212850 con 0x55f631eb59f0 2024-09-21T07:13:28.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.953+0000 7f802259c640 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f631eb59f0 0x55f6322bc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.953+0000 7f802259c640 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f631eb59f0 0x55f6322bc030 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1986a2c54636796d server_cookie=e007a805ad351a06 in_seq=0 out_seq=0 2024-09-21T07:13:28.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.953+0000 7f8009ffb640 10 client.15714 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:28.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.954+0000 7f8009ffb640 1 -- 172.21.15.92:0/3861761565 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f632212850 con 0x55f631eb59f0 2024-09-21T07:13:28.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.954+0000 7f8009ffb640 10 client.15714 handle_command_reply: tid=0 2024-09-21T07:13:28.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.954+0000 7f802f020740 1 client.15714 shutdown 2024-09-21T07:13:28.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.954+0000 7f802f020740 1 -- 172.21.15.92:0/3861761565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ef7070 msgr2=0x55f6322aa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.954+0000 7f802f020740 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ef7070 0x55f6322aa6c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f801c014a70 tx=0x7f801c004a40 comp rx=0 tx=0).stop 2024-09-21T07:13:28.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.955+0000 7f802f020740 1 -- 172.21.15.92:0/3861761565 shutdown_connections 2024-09-21T07:13:28.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.955+0000 7f802f020740 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f631eb59f0 0x55f6322bc030 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.955+0000 7f802f020740 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ef7070 0x55f6322aa6c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.955+0000 7f802f020740 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ed6390 0x55f6322aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.955+0000 7f802f020740 1 --2- 172.21.15.92:0/3861761565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 0x55f6322a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.955+0000 7f8009ffb640 0 client.15714 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:28.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.955+0000 7f802f020740 1 -- 172.21.15.92:0/3861761565 >> 172.21.15.92:0/3861761565 conn(0x55f631eeb460 msgr2=0x55f6322a1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:28.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.955+0000 7f802f020740 1 -- 172.21.15.92:0/3861761565 shutdown_connections 2024-09-21T07:13:28.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.955+0000 7f802f020740 1 -- 172.21.15.92:0/3861761565 wait complete. 2024-09-21T07:13:28.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.955+0000 7f802f020740 20 client.15714 trim_cache size 0 max 16384 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f802f020740 1 Processor -- start 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f802f020740 1 -- start start 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f802f020740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 0x55f6322a0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f802f020740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f6322ab870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f802f020740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 0x55f63229bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f802f020740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80241b0f10 con 0x55f631ed6390 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f802f020740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80241b2a50 con 0x55f631ece1b0 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f802f020740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80241b15e0 con 0x55f631ef7070 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f8019d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f6322ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f8019d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f6322ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55744/0 (socket says 172.21.15.92:55744) 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f8019d9b640 1 -- 172.21.15.92:0/3162246114 learned_addr learned my addr 172.21.15.92:0/3162246114 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:28.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f802259c640 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 0x55f6322a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f8019d9b640 1 -- 172.21.15.92:0/3162246114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 msgr2=0x55f63229bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f8022d9d640 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 0x55f63229bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f8019d9b640 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 0x55f63229bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f8019d9b640 1 -- 172.21.15.92:0/3162246114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 msgr2=0x55f6322a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f8019d9b640 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 0x55f6322a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f8019d9b640 1 -- 172.21.15.92:0/3162246114 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6322a8140 con 0x55f631ed6390 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f8022d9d640 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 0x55f63229bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.972+0000 7f802259c640 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 0x55f6322a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.973+0000 7f8019d9b640 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f6322ab870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f800c0a96d0 tx=0x7f800c00de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e5456ebed1a959 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.973+0000 7f800bfff640 1 -- 172.21.15.92:0/3162246114 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c021070 con 0x55f631ed6390 2024-09-21T07:13:28.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.973+0000 7f800bfff640 1 -- 172.21.15.92:0/3162246114 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f800c0efe90 con 0x55f631ed6390 2024-09-21T07:13:28.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.973+0000 7f800bfff640 1 -- 172.21.15.92:0/3162246114 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c0aca50 con 0x55f631ed6390 2024-09-21T07:13:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 -- 172.21.15.92:0/3162246114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 msgr2=0x55f6322ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f6322ab870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f800c0a96d0 tx=0x7f800c00de80 comp rx=0 tx=0).stop 2024-09-21T07:13:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 -- 172.21.15.92:0/3162246114 shutdown_connections 2024-09-21T07:13:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 0x55f63229bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ed6390 0x55f6322ab870 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 --2- 172.21.15.92:0/3162246114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ece1b0 0x55f6322a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 -- 172.21.15.92:0/3162246114 >> 172.21.15.92:0/3162246114 conn(0x55f631eeb460 msgr2=0x55f6322ab160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 -- 172.21.15.92:0/3162246114 shutdown_connections 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 -- 172.21.15.92:0/3162246114 wait complete. 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 -- start start 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 Processor -- start 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.974+0000 7f802f020740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ece1b0 0x55f6322ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802f020740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ed6390 0x55f6322ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802f020740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 0x55f6322aed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802f020740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80241b2380 con 0x55f631ece1b0 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802f020740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80241b1cb0 con 0x55f631ed6390 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ece1b0 0x55f6322ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802f020740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80241aeef0 con 0x55f631ef7070 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ece1b0 0x55f6322ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55760/0 (socket says 172.21.15.92:55760) 2024-09-21T07:13:28.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802259c640 1 -- 172.21.15.92:0/3354682585 learned_addr learned my addr 172.21.15.92:0/3354682585 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802f020740 10 client.0 _ll_register_callbacks cb 0x7f801c008040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f8019d9b640 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ed6390 0x55f6322ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f8022d9d640 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 0x55f6322aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802259c640 1 -- 172.21.15.92:0/3354682585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 msgr2=0x55f6322aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802259c640 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 0x55f6322aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802259c640 1 -- 172.21.15.92:0/3354682585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ed6390 msgr2=0x55f6322ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802259c640 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ed6390 0x55f6322ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802259c640 1 -- 172.21.15.92:0/3354682585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f632325bf0 con 0x55f631ece1b0 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802259c640 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ece1b0 0x55f6322ae290 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8014000c00 tx=0x7f8014004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3904a6205c5b64ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f8009ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f8009ffb640 1 -- 172.21.15.92:0/3354682585 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014035070 con 0x55f631ece1b0 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f8009ffb640 1 -- 172.21.15.92:0/3354682585 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f8014005450 con 0x55f631ece1b0 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.975+0000 7f802f020740 1 -- 172.21.15.92:0/3354682585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f800c0efe90 con 0x55f631ece1b0 2024-09-21T07:13:28.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f8009ffb640 1 -- 172.21.15.92:0/3354682585 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8014052050 con 0x55f631ece1b0 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f802f020740 10 client.15720 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f802f020740 1 -- 172.21.15.92:0/3354682585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f632326e60 con 0x55f631ece1b0 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f8009ffb640 1 -- 172.21.15.92:0/3354682585 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f800c0efe90 con 0x55f631ece1b0 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f8009ffb640 1 -- 172.21.15.92:0/3354682585 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f801c00ed20 con 0x55f631ece1b0 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f802f020740 10 client.15720 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f802f020740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f802f020740 20 client.15720 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f802f020740 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f631e8ada0 0x55f6323296a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f802f020740 4 client.15720 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f802f020740 1 -- 172.21.15.92:0/3354682585 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f63220fc80 con 0x55f631e8ada0 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.976+0000 7f8019d9b640 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f631e8ada0 0x55f6323296a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f8009ffb640 10 client.15720 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f8019d9b640 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f631e8ada0 0x55f6323296a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f95963cb51ebcd3b server_cookie=f4890ccd512ea8df in_seq=0 out_seq=0 2024-09-21T07:13:28.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f8009ffb640 1 -- 172.21.15.92:0/3354682585 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55f63220fc80 con 0x55f631e8ada0 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f8009ffb640 10 client.15720 handle_command_reply: tid=0 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 client.15720 shutdown 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 -- 172.21.15.92:0/3354682585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ece1b0 msgr2=0x55f6322ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ece1b0 0x55f6322ae290 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8014000c00 tx=0x7f8014004610 comp rx=0 tx=0).stop 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 -- 172.21.15.92:0/3354682585 shutdown_connections 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f631e8ada0 0x55f6323296a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f631ef7070 0x55f6322aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f8009ffb640 0 client.15720 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f631ed6390 0x55f6322ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 --2- 172.21.15.92:0/3354682585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f631ece1b0 0x55f6322ae290 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 -- 172.21.15.92:0/3354682585 >> 172.21.15.92:0/3354682585 conn(0x55f631eeb460 msgr2=0x55f63229fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 -- 172.21.15.92:0/3354682585 shutdown_connections 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.977+0000 7f802f020740 1 -- 172.21.15.92:0/3354682585 wait complete. 2024-09-21T07:13:28.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f802f020740 20 client.15720 trim_cache size 0 max 16384 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "d407b537-389e-488f-bc01-d777c1d3796e", 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:13:28.985 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:13:28.986 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:13:28.986 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:13:28.986 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:13:28.986 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:13:28.986 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:13:28.986 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:13:28.986 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:13:28.986 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 -- 172.21.15.92:0/2589712268 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80100b6680 msgr2=0x7f80100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80100b6680 0x7f80100b8b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f801c007d80 tx=0x7f801c007430 comp rx=0 tx=0).stop 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 -- 172.21.15.92:0/2589712268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80241083c0 msgr2=0x7f802419a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80241083c0 0x7f802419a9e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f800c00d770 tx=0x7f800c00dc30 comp rx=0 tx=0).stop 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 -- 172.21.15.92:0/2589712268 shutdown_connections 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80100b6680 0x7f80100b8b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8024108d10 0x7f802419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80241083c0 0x7f802419a9e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 --2- 172.21.15.92:0/2589712268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8024102a80 0x7f802419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 -- 172.21.15.92:0/2589712268 >> 172.21.15.92:0/2589712268 conn(0x7f8024079740 msgr2=0x7f80241014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:28.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 -- 172.21.15.92:0/2589712268 shutdown_connections 2024-09-21T07:13:28.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:28.978+0000 7f8028aac640 1 -- 172.21.15.92:0/2589712268 wait complete. 2024-09-21T07:13:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:28 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:13:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:28 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:13:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:28 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:13:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:28 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:13:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:28 smithi175 ceph-mon[34064]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-09-21T07:13:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:28 smithi175 ceph-mon[34064]: from='client.15696 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:28 smithi175 ceph-mon[34064]: from='client.15702 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:29.045 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:28 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:13:29.045 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:28 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:13:29.045 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:28 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:13:29.045 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:28 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:13:29.045 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:28 smithi169 ceph-mon[33705]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-09-21T07:13:29.045 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:28 smithi169 ceph-mon[33705]: from='client.15696 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:29.045 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:28 smithi169 ceph-mon[33705]: from='client.15702 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:13:29.694 INFO:tasks.cephfs.filesystem:scrub status for tag:d407b537-389e-488f-bc01-d777c1d3796e - {'path': '/', 'tag': 'd407b537-389e-488f-bc01-d777c1d3796e', 'options': 'recursive,force'} 2024-09-21T07:13:29.737 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:29.857 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:29 smithi092 ceph-mon[30987]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 176 KiB/s wr, 58 op/s 2024-09-21T07:13:30.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:29 smithi169 ceph-mon[33705]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 176 KiB/s wr, 58 op/s 2024-09-21T07:13:30.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.225+0000 7fbf71e65640 1 -- 172.21.15.92:0/849987446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf6c109560 msgr2=0x7fbf6c109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:30.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.225+0000 7fbf71e65640 1 --2- 172.21.15.92:0/849987446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf6c109560 0x7fbf6c109970 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009900 tx=0x7fbf6002a410 comp rx=0 tx=0).stop 2024-09-21T07:13:30.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.225+0000 7fbf71e65640 1 -- 172.21.15.92:0/849987446 shutdown_connections 2024-09-21T07:13:30.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.225+0000 7fbf71e65640 1 --2- 172.21.15.92:0/849987446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf6c109eb0 0x7fbf6c1106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:30.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.225+0000 7fbf71e65640 1 --2- 172.21.15.92:0/849987446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf6c109560 0x7fbf6c109970 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:30.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.225+0000 7fbf71e65640 1 --2- 172.21.15.92:0/849987446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf6c102080 0x7fbf6c102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:30.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.225+0000 7fbf71e65640 1 -- 172.21.15.92:0/849987446 >> 172.21.15.92:0/849987446 conn(0x7fbf6c079ec0 msgr2=0x7fbf6c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.225+0000 7fbf71e65640 1 -- 172.21.15.92:0/849987446 shutdown_connections 2024-09-21T07:13:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.225+0000 7fbf71e65640 1 -- 172.21.15.92:0/849987446 wait complete. 2024-09-21T07:13:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.226+0000 7fbf71e65640 1 Processor -- start 2024-09-21T07:13:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.226+0000 7fbf71e65640 1 -- start start 2024-09-21T07:13:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf71e65640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf6c102080 0x7fbf6c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf71e65640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf6c109560 0x7fbf6c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf71e65640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf6c109eb0 0x7fbf6c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf71e65640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c113a60 con 0x7fbf6c102080 2024-09-21T07:13:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf71e65640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c1138e0 con 0x7fbf6c109560 2024-09-21T07:13:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf71e65640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c113be0 con 0x7fbf6c109eb0 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf6c102080 0x7fbf6c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf6c102080 0x7fbf6c19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50932/0 (socket says 172.21.15.92:50932) 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6b7fe640 1 -- 172.21.15.92:0/3045322721 learned_addr learned my addr 172.21.15.92:0/3045322721 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6affd640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf6c109560 0x7fbf6c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6bfff640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf6c109eb0 0x7fbf6c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6b7fe640 1 -- 172.21.15.92:0/3045322721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf6c109eb0 msgr2=0x7fbf6c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6b7fe640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf6c109eb0 0x7fbf6c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6b7fe640 1 -- 172.21.15.92:0/3045322721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf6c109560 msgr2=0x7fbf6c19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6b7fe640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf6c109560 0x7fbf6c19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6b7fe640 1 -- 172.21.15.92:0/3045322721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c1a0460 con 0x7fbf6c102080 2024-09-21T07:13:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6bfff640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf6c109eb0 0x7fbf6c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf6b7fe640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf6c102080 0x7fbf6c19a4f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00d770 tx=0x7fbf5c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf68ff9640 1 -- 172.21.15.92:0/3045322721 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c017070 con 0x7fbf6c102080 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf68ff9640 1 -- 172.21.15.92:0/3045322721 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf5c0054b0 con 0x7fbf6c102080 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf71e65640 1 -- 172.21.15.92:0/3045322721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6c1a0750 con 0x7fbf6c102080 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.227+0000 7fbf68ff9640 1 -- 172.21.15.92:0/3045322721 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c004c60 con 0x7fbf6c102080 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.228+0000 7fbf71e65640 1 -- 172.21.15.92:0/3045322721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6c1a6eb0 con 0x7fbf6c102080 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.229+0000 7fbf71e65640 1 -- 172.21.15.92:0/3045322721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf6c06b8f0 con 0x7fbf6c102080 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.230+0000 7fbf68ff9640 1 -- 172.21.15.92:0/3045322721 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7fbf5c004e00 con 0x7fbf6c102080 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.230+0000 7fbf68ff9640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf540b6680 0x7fbf540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.231+0000 7fbf6affd640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf540b6680 0x7fbf540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.231+0000 7fbf68ff9640 1 -- 172.21.15.92:0/3045322721 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fbf5c0e7480 con 0x7fbf6c102080 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.231+0000 7fbf6affd640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf540b6680 0x7fbf540b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbf60005940 tx=0x7fbf600058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:30.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.235+0000 7fbf68ff9640 1 -- 172.21.15.92:0/3045322721 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf5c0ad6d0 con 0x7fbf6c102080 2024-09-21T07:13:30.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:29 smithi175 ceph-mon[34064]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 176 KiB/s wr, 58 op/s 2024-09-21T07:13:30.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.411+0000 7fbf71e65640 1 -- 172.21.15.92:0/3045322721 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf6c063800 con 0x7fbf540b6680 2024-09-21T07:13:30.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.417+0000 7fbf68ff9640 1 -- 172.21.15.92:0/3045322721 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340957 (secure 0 0 0) 0x7fbf6c063800 con 0x7fbf540b6680 2024-09-21T07:13:30.425 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:30.426 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-21T07:13:30.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.420+0000 7fbf71e65640 1 -- 172.21.15.92:0/3045322721 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf540b6680 msgr2=0x7fbf540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:30.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.420+0000 7fbf71e65640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf540b6680 0x7fbf540b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbf60005940 tx=0x7fbf600058d0 comp rx=0 tx=0).stop 2024-09-21T07:13:30.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.421+0000 7fbf71e65640 1 -- 172.21.15.92:0/3045322721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf6c102080 msgr2=0x7fbf6c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:30.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.421+0000 7fbf71e65640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf6c102080 0x7fbf6c19a4f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00d770 tx=0x7fbf5c00dc30 comp rx=0 tx=0).stop 2024-09-21T07:13:30.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.421+0000 7fbf71e65640 1 -- 172.21.15.92:0/3045322721 shutdown_connections 2024-09-21T07:13:30.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.421+0000 7fbf71e65640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf540b6680 0x7fbf540b8b90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:30.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.421+0000 7fbf71e65640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf6c109eb0 0x7fbf6c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:30.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.421+0000 7fbf71e65640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf6c109560 0x7fbf6c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:30.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.421+0000 7fbf71e65640 1 --2- 172.21.15.92:0/3045322721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf6c102080 0x7fbf6c19a4f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:30.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.421+0000 7fbf71e65640 1 -- 172.21.15.92:0/3045322721 >> 172.21.15.92:0/3045322721 conn(0x7fbf6c079ec0 msgr2=0x7fbf6c107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:30.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.421+0000 7fbf71e65640 1 -- 172.21.15.92:0/3045322721 shutdown_connections 2024-09-21T07:13:30.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:30.421+0000 7fbf71e65640 1 -- 172.21.15.92:0/3045322721 wait complete. 2024-09-21T07:13:31.060 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:30 smithi092 ceph-mon[30987]: from='client.15726 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:31.087 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2024-09-21T07:13:29.626949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1461657,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1588,"num_read_kb":1040,"num_write":621,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2951908,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":972,"ondisk_log_size":972,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369604,"kb_used_data":12032,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572220,"statfs":{"total":1151940427776,"available":1151561953280,"internally_reserved":0,"allocated":12320768,"data_stored":10427813,"data_compressed":574435,"data_compressed_allocated":774144,"data_compressed_original":5038080,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":797108,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":367,"num_write":236,"num_write_kb":2110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003537"},"pg_stats":[{"pgid":"2.1f","version":"86'14","reported_seq":170,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:26.911615+0000","last_change":"2024-09-21T07:10:51.463956+0000","last_active":"2024-09-21T07:13:26.911615+0000","last_peered":"2024-09-21T07:13:26.911615+0000","last_clean":"2024-09-21T07:13:26.911615+0000","last_became_active":"2024-09-21T07:10:51.463564+0000","last_became_peered":"2024-09-21T07:10:51.463564+0000","last_unstale":"2024-09-21T07:13:26.911615+0000","last_undegraded":"2024-09-21T07:13:26.911615+0000","last_fullsized":"2024-09-21T07:13:26.911615+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838602+0000","last_change":"2024-09-21T07:10:53.484379+0000","last_active":"2024-09-21T07:12:43.838602+0000","last_peered":"2024-09-21T07:12:43.838602+0000","last_clean":"2024-09-21T07:12:43.838602+0000","last_became_active":"2024-09-21T07:10:53.484005+0000","last_became_peered":"2024-09-21T07:10:53.484005+0000","last_unstale":"2024-09-21T07:12:43.838602+0000","last_undegraded":"2024-09-21T07:12:43.838602+0000","last_fullsized":"2024-09-21T07:12:43.838602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:27.665257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687327+0000","last_change":"2024-09-21T07:11:00.552729+0000","last_active":"2024-09-21T07:12:14.687327+0000","last_peered":"2024-09-21T07:12:14.687327+0000","last_clean":"2024-09-21T07:12:14.687327+0000","last_became_active":"2024-09-21T07:11:00.552196+0000","last_became_peered":"2024-09-21T07:11:00.552196+0000","last_unstale":"2024-09-21T07:12:14.687327+0000","last_undegraded":"2024-09-21T07:12:14.687327+0000","last_fullsized":"2024-09-21T07:12:14.687327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:35.942717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692173+0000","last_change":"2024-09-21T07:10:51.467798+0000","last_active":"2024-09-21T07:12:14.692173+0000","last_peered":"2024-09-21T07:12:14.692173+0000","last_clean":"2024-09-21T07:12:14.692173+0000","last_became_active":"2024-09-21T07:10:51.467314+0000","last_became_peered":"2024-09-21T07:10:51.467314+0000","last_unstale":"2024-09-21T07:12:14.692173+0000","last_undegraded":"2024-09-21T07:12:14.692173+0000","last_fullsized":"2024-09-21T07:12:14.692173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:21.944378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839226+0000","last_change":"2024-09-21T07:10:53.494849+0000","last_active":"2024-09-21T07:12:43.839226+0000","last_peered":"2024-09-21T07:12:43.839226+0000","last_clean":"2024-09-21T07:12:43.839226+0000","last_became_active":"2024-09-21T07:10:53.494478+0000","last_became_peered":"2024-09-21T07:10:53.494478+0000","last_unstale":"2024-09-21T07:12:43.839226+0000","last_undegraded":"2024-09-21T07:12:43.839226+0000","last_fullsized":"2024-09-21T07:12:43.839226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:38.383547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805693+0000","last_change":"2024-09-21T07:11:00.558306+0000","last_active":"2024-09-21T07:12:14.805693+0000","last_peered":"2024-09-21T07:12:14.805693+0000","last_clean":"2024-09-21T07:12:14.805693+0000","last_became_active":"2024-09-21T07:11:00.557814+0000","last_became_peered":"2024-09-21T07:11:00.557814+0000","last_unstale":"2024-09-21T07:12:14.805693+0000","last_undegraded":"2024-09-21T07:12:14.805693+0000","last_fullsized":"2024-09-21T07:12:14.805693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:31.401788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":53,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693033+0000","last_change":"2024-09-21T07:10:51.466831+0000","last_active":"2024-09-21T07:12:14.693033+0000","last_peered":"2024-09-21T07:12:14.693033+0000","last_clean":"2024-09-21T07:12:14.693033+0000","last_became_active":"2024-09-21T07:10:51.466381+0000","last_became_peered":"2024-09-21T07:10:51.466381+0000","last_unstale":"2024-09-21T07:12:14.693033+0000","last_undegraded":"2024-09-21T07:12:14.693033+0000","last_fullsized":"2024-09-21T07:12:14.693033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.559370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843617+0000","last_change":"2024-09-21T07:10:53.485920+0000","last_active":"2024-09-21T07:12:43.843617+0000","last_peered":"2024-09-21T07:12:43.843617+0000","last_clean":"2024-09-21T07:12:43.843617+0000","last_became_active":"2024-09-21T07:10:53.484689+0000","last_became_peered":"2024-09-21T07:10:53.484689+0000","last_unstale":"2024-09-21T07:12:43.843617+0000","last_undegraded":"2024-09-21T07:12:43.843617+0000","last_fullsized":"2024-09-21T07:12:43.843617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:59.951999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806409+0000","last_change":"2024-09-21T07:11:00.558298+0000","last_active":"2024-09-21T07:12:14.806409+0000","last_peered":"2024-09-21T07:12:14.806409+0000","last_clean":"2024-09-21T07:12:14.806409+0000","last_became_active":"2024-09-21T07:11:00.557738+0000","last_became_peered":"2024-09-21T07:11:00.557738+0000","last_unstale":"2024-09-21T07:12:14.806409+0000","last_undegraded":"2024-09-21T07:12:14.806409+0000","last_fullsized":"2024-09-21T07:12:14.806409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:03.037820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693169+0000","last_change":"2024-09-21T07:10:51.464283+0000","last_active":"2024-09-21T07:12:14.693169+0000","last_peered":"2024-09-21T07:12:14.693169+0000","last_clean":"2024-09-21T07:12:14.693169+0000","last_became_active":"2024-09-21T07:10:51.463783+0000","last_became_peered":"2024-09-21T07:10:51.463783+0000","last_unstale":"2024-09-21T07:12:14.693169+0000","last_undegraded":"2024-09-21T07:12:14.693169+0000","last_fullsized":"2024-09-21T07:12:14.693169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:45.298654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842942+0000","last_change":"2024-09-21T07:11:14.671020+0000","last_active":"2024-09-21T07:12:43.842942+0000","last_peered":"2024-09-21T07:12:43.842942+0000","last_clean":"2024-09-21T07:12:43.842942+0000","last_became_active":"2024-09-21T07:11:14.670573+0000","last_became_peered":"2024-09-21T07:11:14.670573+0000","last_unstale":"2024-09-21T07:12:43.842942+0000","last_undegraded":"2024-09-21T07:12:43.842942+0000","last_fullsized":"2024-09-21T07:12:43.842942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.926304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805803+0000","last_change":"2024-09-21T07:11:00.549015+0000","last_active":"2024-09-21T07:12:14.805803+0000","last_peered":"2024-09-21T07:12:14.805803+0000","last_clean":"2024-09-21T07:12:14.805803+0000","last_became_active":"2024-09-21T07:11:00.548561+0000","last_became_peered":"2024-09-21T07:11:00.548561+0000","last_unstale":"2024-09-21T07:12:14.805803+0000","last_undegraded":"2024-09-21T07:12:14.805803+0000","last_fullsized":"2024-09-21T07:12:14.805803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:08.386214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841440+0000","last_change":"2024-09-21T07:10:53.489382+0000","last_active":"2024-09-21T07:12:43.841440+0000","last_peered":"2024-09-21T07:12:43.841440+0000","last_clean":"2024-09-21T07:12:43.841440+0000","last_became_active":"2024-09-21T07:10:53.488987+0000","last_became_peered":"2024-09-21T07:10:53.488987+0000","last_unstale":"2024-09-21T07:12:43.841440+0000","last_undegraded":"2024-09-21T07:12:43.841440+0000","last_fullsized":"2024-09-21T07:12:43.841440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.334840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692508+0000","last_change":"2024-09-21T07:10:51.467203+0000","last_active":"2024-09-21T07:12:14.692508+0000","last_peered":"2024-09-21T07:12:14.692508+0000","last_clean":"2024-09-21T07:12:14.692508+0000","last_became_active":"2024-09-21T07:10:51.466737+0000","last_became_peered":"2024-09-21T07:10:51.466737+0000","last_unstale":"2024-09-21T07:12:14.692508+0000","last_undegraded":"2024-09-21T07:12:14.692508+0000","last_fullsized":"2024-09-21T07:12:14.692508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:26.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806191+0000","last_change":"2024-09-21T07:11:00.640801+0000","last_active":"2024-09-21T07:12:14.806191+0000","last_peered":"2024-09-21T07:12:14.806191+0000","last_clean":"2024-09-21T07:12:14.806191+0000","last_became_active":"2024-09-21T07:11:00.640213+0000","last_became_peered":"2024-09-21T07:11:00.640213+0000","last_unstale":"2024-09-21T07:12:14.806191+0000","last_undegraded":"2024-09-21T07:12:14.806191+0000","last_fullsized":"2024-09-21T07:12:14.806191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:55.801831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841160+0000","last_change":"2024-09-21T07:10:53.491166+0000","last_active":"2024-09-21T07:12:43.841160+0000","last_peered":"2024-09-21T07:12:43.841160+0000","last_clean":"2024-09-21T07:12:43.841160+0000","last_became_active":"2024-09-21T07:10:53.490823+0000","last_became_peered":"2024-09-21T07:10:53.490823+0000","last_unstale":"2024-09-21T07:12:43.841160+0000","last_undegraded":"2024-09-21T07:12:43.841160+0000","last_fullsized":"2024-09-21T07:12:43.841160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:48.661634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:02.728825+0000","last_change":"2024-09-21T07:10:51.461220+0000","last_active":"2024-09-21T07:13:02.728825+0000","last_peered":"2024-09-21T07:13:02.728825+0000","last_clean":"2024-09-21T07:13:02.728825+0000","last_became_active":"2024-09-21T07:10:51.460772+0000","last_became_peered":"2024-09-21T07:10:51.460772+0000","last_unstale":"2024-09-21T07:13:02.728825+0000","last_undegraded":"2024-09-21T07:13:02.728825+0000","last_fullsized":"2024-09-21T07:13:02.728825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:56.488273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806249+0000","last_change":"2024-09-21T07:11:00.558487+0000","last_active":"2024-09-21T07:12:14.806249+0000","last_peered":"2024-09-21T07:12:14.806249+0000","last_clean":"2024-09-21T07:12:14.806249+0000","last_became_active":"2024-09-21T07:11:00.557877+0000","last_became_peered":"2024-09-21T07:11:00.557877+0000","last_unstale":"2024-09-21T07:12:14.806249+0000","last_undegraded":"2024-09-21T07:12:14.806249+0000","last_fullsized":"2024-09-21T07:12:14.806249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:14.614603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840073+0000","last_change":"2024-09-21T07:10:53.489309+0000","last_active":"2024-09-21T07:12:43.840073+0000","last_peered":"2024-09-21T07:12:43.840073+0000","last_clean":"2024-09-21T07:12:43.840073+0000","last_became_active":"2024-09-21T07:10:53.488943+0000","last_became_peered":"2024-09-21T07:10:53.488943+0000","last_unstale":"2024-09-21T07:12:43.840073+0000","last_undegraded":"2024-09-21T07:12:43.840073+0000","last_fullsized":"2024-09-21T07:12:43.840073+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.797176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692071+0000","last_change":"2024-09-21T07:10:51.461078+0000","last_active":"2024-09-21T07:12:14.692071+0000","last_peered":"2024-09-21T07:12:14.692071+0000","last_clean":"2024-09-21T07:12:14.692071+0000","last_became_active":"2024-09-21T07:10:51.460759+0000","last_became_peered":"2024-09-21T07:10:51.460759+0000","last_unstale":"2024-09-21T07:12:14.692071+0000","last_undegraded":"2024-09-21T07:12:14.692071+0000","last_fullsized":"2024-09-21T07:12:14.692071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:37.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:11:00.554766+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:11:00.554374+0000","last_became_peered":"2024-09-21T07:11:00.554374+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:47.038411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825773+0000","last_change":"2024-09-21T07:10:53.487501+0000","last_active":"2024-09-21T07:12:43.825773+0000","last_peered":"2024-09-21T07:12:43.825773+0000","last_clean":"2024-09-21T07:12:43.825773+0000","last_became_active":"2024-09-21T07:10:53.487030+0000","last_became_peered":"2024-09-21T07:10:53.487030+0000","last_unstale":"2024-09-21T07:12:43.825773+0000","last_undegraded":"2024-09-21T07:12:43.825773+0000","last_fullsized":"2024-09-21T07:12:43.825773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692397+0000","last_change":"2024-09-21T07:10:51.468155+0000","last_active":"2024-09-21T07:12:14.692397+0000","last_peered":"2024-09-21T07:12:14.692397+0000","last_clean":"2024-09-21T07:12:14.692397+0000","last_became_active":"2024-09-21T07:10:51.467663+0000","last_became_peered":"2024-09-21T07:10:51.467663+0000","last_unstale":"2024-09-21T07:12:14.692397+0000","last_undegraded":"2024-09-21T07:12:14.692397+0000","last_fullsized":"2024-09-21T07:12:14.692397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:18.176519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806311+0000","last_change":"2024-09-21T07:11:00.641283+0000","last_active":"2024-09-21T07:12:14.806311+0000","last_peered":"2024-09-21T07:12:14.806311+0000","last_clean":"2024-09-21T07:12:14.806311+0000","last_became_active":"2024-09-21T07:11:00.640715+0000","last_became_peered":"2024-09-21T07:11:00.640715+0000","last_unstale":"2024-09-21T07:12:14.806311+0000","last_undegraded":"2024-09-21T07:12:14.806311+0000","last_fullsized":"2024-09-21T07:12:14.806311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:26.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842481+0000","last_change":"2024-09-21T07:11:14.656686+0000","last_active":"2024-09-21T07:12:43.842481+0000","last_peered":"2024-09-21T07:12:43.842481+0000","last_clean":"2024-09-21T07:12:43.842481+0000","last_became_active":"2024-09-21T07:11:14.656259+0000","last_became_peered":"2024-09-21T07:11:14.656259+0000","last_unstale":"2024-09-21T07:12:43.842481+0000","last_undegraded":"2024-09-21T07:12:43.842481+0000","last_fullsized":"2024-09-21T07:12:43.842481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:16.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806776+0000","last_change":"2024-09-21T07:10:52.123260+0000","last_active":"2024-09-21T07:12:14.806776+0000","last_peered":"2024-09-21T07:12:14.806776+0000","last_clean":"2024-09-21T07:12:14.806776+0000","last_became_active":"2024-09-21T07:10:52.122752+0000","last_became_peered":"2024-09-21T07:10:52.122752+0000","last_unstale":"2024-09-21T07:12:14.806776+0000","last_undegraded":"2024-09-21T07:12:14.806776+0000","last_fullsized":"2024-09-21T07:12:14.806776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.041434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686989+0000","last_change":"2024-09-21T07:11:00.549599+0000","last_active":"2024-09-21T07:12:14.686989+0000","last_peered":"2024-09-21T07:12:14.686989+0000","last_clean":"2024-09-21T07:12:14.686989+0000","last_became_active":"2024-09-21T07:11:00.549112+0000","last_became_peered":"2024-09-21T07:11:00.549112+0000","last_unstale":"2024-09-21T07:12:14.686989+0000","last_undegraded":"2024-09-21T07:12:14.686989+0000","last_fullsized":"2024-09-21T07:12:14.686989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:15.209889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.828092+0000","last_change":"2024-09-21T07:10:53.487792+0000","last_active":"2024-09-21T07:12:43.828092+0000","last_peered":"2024-09-21T07:12:43.828092+0000","last_clean":"2024-09-21T07:12:43.828092+0000","last_became_active":"2024-09-21T07:10:53.487460+0000","last_became_peered":"2024-09-21T07:10:53.487460+0000","last_unstale":"2024-09-21T07:12:43.828092+0000","last_undegraded":"2024-09-21T07:12:43.828092+0000","last_fullsized":"2024-09-21T07:12:43.828092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:26.329878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'98","reported_seq":238,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.517935+0000","last_change":"2024-09-21T07:12:14.699788+0000","last_active":"2024-09-21T07:13:27.517935+0000","last_peered":"2024-09-21T07:13:27.517935+0000","last_clean":"2024-09-21T07:13:27.517935+0000","last_became_active":"2024-09-21T07:12:14.693355+0000","last_became_peered":"2024-09-21T07:12:14.693355+0000","last_unstale":"2024-09-21T07:13:27.517935+0000","last_undegraded":"2024-09-21T07:13:27.517935+0000","last_fullsized":"2024-09-21T07:13:27.517935+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:44.104210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":282,"num_read_kb":250,"num_write":179,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691224+0000","last_change":"2024-09-21T07:11:00.640604+0000","last_active":"2024-09-21T07:12:14.691224+0000","last_peered":"2024-09-21T07:12:14.691224+0000","last_clean":"2024-09-21T07:12:14.691224+0000","last_became_active":"2024-09-21T07:11:00.640047+0000","last_became_peered":"2024-09-21T07:11:00.640047+0000","last_unstale":"2024-09-21T07:12:14.691224+0000","last_undegraded":"2024-09-21T07:12:14.691224+0000","last_fullsized":"2024-09-21T07:12:14.691224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:42.640908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834870+0000","last_change":"2024-09-21T07:10:53.473862+0000","last_active":"2024-09-21T07:12:43.834870+0000","last_peered":"2024-09-21T07:12:43.834870+0000","last_clean":"2024-09-21T07:12:43.834870+0000","last_became_active":"2024-09-21T07:10:53.473526+0000","last_became_peered":"2024-09-21T07:10:53.473526+0000","last_unstale":"2024-09-21T07:12:43.834870+0000","last_undegraded":"2024-09-21T07:12:43.834870+0000","last_fullsized":"2024-09-21T07:12:43.834870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.389566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693155+0000","last_change":"2024-09-21T07:10:51.468003+0000","last_active":"2024-09-21T07:12:14.693155+0000","last_peered":"2024-09-21T07:12:14.693155+0000","last_clean":"2024-09-21T07:12:14.693155+0000","last_became_active":"2024-09-21T07:10:51.467603+0000","last_became_peered":"2024-09-21T07:10:51.467603+0000","last_unstale":"2024-09-21T07:12:14.693155+0000","last_undegraded":"2024-09-21T07:12:14.693155+0000","last_fullsized":"2024-09-21T07:12:14.693155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:02.148721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690206+0000","last_change":"2024-09-21T07:11:00.550434+0000","last_active":"2024-09-21T07:12:14.690206+0000","last_peered":"2024-09-21T07:12:14.690206+0000","last_clean":"2024-09-21T07:12:14.690206+0000","last_became_active":"2024-09-21T07:11:00.549949+0000","last_became_peered":"2024-09-21T07:11:00.549949+0000","last_unstale":"2024-09-21T07:12:14.690206+0000","last_undegraded":"2024-09-21T07:12:14.690206+0000","last_fullsized":"2024-09-21T07:12:14.690206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:53.737978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839518+0000","last_change":"2024-09-21T07:12:14.690832+0000","last_active":"2024-09-21T07:12:43.839518+0000","last_peered":"2024-09-21T07:12:43.839518+0000","last_clean":"2024-09-21T07:12:43.839518+0000","last_became_active":"2024-09-21T07:12:14.690361+0000","last_became_peered":"2024-09-21T07:12:14.690361+0000","last_unstale":"2024-09-21T07:12:43.839518+0000","last_undegraded":"2024-09-21T07:12:43.839518+0000","last_fullsized":"2024-09-21T07:12:43.839518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:00.772213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:10:51.468201+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:10:51.467754+0000","last_became_peered":"2024-09-21T07:10:51.467754+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:52.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692198+0000","last_change":"2024-09-21T07:11:00.640653+0000","last_active":"2024-09-21T07:12:14.692198+0000","last_peered":"2024-09-21T07:12:14.692198+0000","last_clean":"2024-09-21T07:12:14.692198+0000","last_became_active":"2024-09-21T07:11:00.640080+0000","last_became_peered":"2024-09-21T07:11:00.640080+0000","last_unstale":"2024-09-21T07:12:14.692198+0000","last_undegraded":"2024-09-21T07:12:14.692198+0000","last_fullsized":"2024-09-21T07:12:14.692198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:24.124088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840328+0000","last_change":"2024-09-21T07:10:53.494222+0000","last_active":"2024-09-21T07:12:43.840328+0000","last_peered":"2024-09-21T07:12:43.840328+0000","last_clean":"2024-09-21T07:12:43.840328+0000","last_became_active":"2024-09-21T07:10:53.493703+0000","last_became_peered":"2024-09-21T07:10:53.493703+0000","last_unstale":"2024-09-21T07:12:43.840328+0000","last_undegraded":"2024-09-21T07:12:43.840328+0000","last_fullsized":"2024-09-21T07:12:43.840328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:21.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":158,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:22.905151+0000","last_change":"2024-09-21T07:10:51.461095+0000","last_active":"2024-09-21T07:13:22.905151+0000","last_peered":"2024-09-21T07:13:22.905151+0000","last_clean":"2024-09-21T07:13:22.905151+0000","last_became_active":"2024-09-21T07:10:51.460738+0000","last_became_peered":"2024-09-21T07:10:51.460738+0000","last_unstale":"2024-09-21T07:13:22.905151+0000","last_undegraded":"2024-09-21T07:13:22.905151+0000","last_fullsized":"2024-09-21T07:13:22.905151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:55.593391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686398+0000","last_change":"2024-09-21T07:11:00.544788+0000","last_active":"2024-09-21T07:12:14.686398+0000","last_peered":"2024-09-21T07:12:14.686398+0000","last_clean":"2024-09-21T07:12:14.686398+0000","last_became_active":"2024-09-21T07:11:00.544370+0000","last_became_peered":"2024-09-21T07:11:00.544370+0000","last_unstale":"2024-09-21T07:12:14.686398+0000","last_undegraded":"2024-09-21T07:12:14.686398+0000","last_fullsized":"2024-09-21T07:12:14.686398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.154867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839305+0000","last_change":"2024-09-21T07:10:53.486715+0000","last_active":"2024-09-21T07:12:43.839305+0000","last_peered":"2024-09-21T07:12:43.839305+0000","last_clean":"2024-09-21T07:12:43.839305+0000","last_became_active":"2024-09-21T07:10:53.486315+0000","last_became_peered":"2024-09-21T07:10:53.486315+0000","last_unstale":"2024-09-21T07:12:43.839305+0000","last_undegraded":"2024-09-21T07:12:43.839305+0000","last_fullsized":"2024-09-21T07:12:43.839305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:00.124269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'7","reported_seq":161,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:24.924938+0000","last_change":"2024-09-21T07:10:51.467102+0000","last_active":"2024-09-21T07:13:24.924938+0000","last_peered":"2024-09-21T07:13:24.924938+0000","last_clean":"2024-09-21T07:13:24.924938+0000","last_became_active":"2024-09-21T07:10:51.466721+0000","last_became_peered":"2024-09-21T07:10:51.466721+0000","last_unstale":"2024-09-21T07:13:24.924938+0000","last_undegraded":"2024-09-21T07:13:24.924938+0000","last_fullsized":"2024-09-21T07:13:24.924938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686198+0000","last_change":"2024-09-21T07:11:00.640622+0000","last_active":"2024-09-21T07:12:14.686198+0000","last_peered":"2024-09-21T07:12:14.686198+0000","last_clean":"2024-09-21T07:12:14.686198+0000","last_became_active":"2024-09-21T07:11:00.640104+0000","last_became_peered":"2024-09-21T07:11:00.640104+0000","last_unstale":"2024-09-21T07:12:14.686198+0000","last_undegraded":"2024-09-21T07:12:14.686198+0000","last_fullsized":"2024-09-21T07:12:14.686198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:12.023561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825104+0000","last_change":"2024-09-21T07:10:53.478175+0000","last_active":"2024-09-21T07:12:43.825104+0000","last_peered":"2024-09-21T07:12:43.825104+0000","last_clean":"2024-09-21T07:12:43.825104+0000","last_became_active":"2024-09-21T07:10:53.477831+0000","last_became_peered":"2024-09-21T07:10:53.477831+0000","last_unstale":"2024-09-21T07:12:43.825104+0000","last_undegraded":"2024-09-21T07:12:43.825104+0000","last_fullsized":"2024-09-21T07:12:43.825104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:27.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689665+0000","last_change":"2024-09-21T07:10:51.466318+0000","last_active":"2024-09-21T07:12:14.689665+0000","last_peered":"2024-09-21T07:12:14.689665+0000","last_clean":"2024-09-21T07:12:14.689665+0000","last_became_active":"2024-09-21T07:10:51.465983+0000","last_became_peered":"2024-09-21T07:10:51.465983+0000","last_unstale":"2024-09-21T07:12:14.689665+0000","last_undegraded":"2024-09-21T07:12:14.689665+0000","last_fullsized":"2024-09-21T07:12:14.689665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:08.432949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691834+0000","last_change":"2024-09-21T07:11:00.641364+0000","last_active":"2024-09-21T07:12:14.691834+0000","last_peered":"2024-09-21T07:12:14.691834+0000","last_clean":"2024-09-21T07:12:14.691834+0000","last_became_active":"2024-09-21T07:11:00.640879+0000","last_became_peered":"2024-09-21T07:11:00.640879+0000","last_unstale":"2024-09-21T07:12:14.691834+0000","last_undegraded":"2024-09-21T07:12:14.691834+0000","last_fullsized":"2024-09-21T07:12:14.691834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:16.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825148+0000","last_change":"2024-09-21T07:10:53.483709+0000","last_active":"2024-09-21T07:12:43.825148+0000","last_peered":"2024-09-21T07:12:43.825148+0000","last_clean":"2024-09-21T07:12:43.825148+0000","last_became_active":"2024-09-21T07:10:53.483355+0000","last_became_peered":"2024-09-21T07:10:53.483355+0000","last_unstale":"2024-09-21T07:12:43.825148+0000","last_undegraded":"2024-09-21T07:12:43.825148+0000","last_fullsized":"2024-09-21T07:12:43.825148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.702168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806593+0000","last_change":"2024-09-21T07:10:51.464239+0000","last_active":"2024-09-21T07:12:14.806593+0000","last_peered":"2024-09-21T07:12:14.806593+0000","last_clean":"2024-09-21T07:12:14.806593+0000","last_became_active":"2024-09-21T07:10:51.463828+0000","last_became_peered":"2024-09-21T07:10:51.463828+0000","last_unstale":"2024-09-21T07:12:14.806593+0000","last_undegraded":"2024-09-21T07:12:14.806593+0000","last_fullsized":"2024-09-21T07:12:14.806593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:09.580668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690229+0000","last_change":"2024-09-21T07:09:39.332523+0000","last_active":"2024-09-21T07:12:14.690229+0000","last_peered":"2024-09-21T07:12:14.690229+0000","last_clean":"2024-09-21T07:12:14.690229+0000","last_became_active":"2024-09-21T07:09:39.326582+0000","last_became_peered":"2024-09-21T07:09:39.326582+0000","last_unstale":"2024-09-21T07:12:14.690229+0000","last_undegraded":"2024-09-21T07:12:14.690229+0000","last_fullsized":"2024-09-21T07:12:14.690229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_clean_scrub_stamp":"2024-09-21T07:06:12.748818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690079+0000","last_change":"2024-09-21T07:11:14.672044+0000","last_active":"2024-09-21T07:12:14.690079+0000","last_peered":"2024-09-21T07:12:14.690079+0000","last_clean":"2024-09-21T07:12:14.690079+0000","last_became_active":"2024-09-21T07:11:14.671513+0000","last_became_peered":"2024-09-21T07:11:14.671513+0000","last_unstale":"2024-09-21T07:12:14.690079+0000","last_undegraded":"2024-09-21T07:12:14.690079+0000","last_fullsized":"2024-09-21T07:12:14.690079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:09.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842250+0000","last_change":"2024-09-21T07:10:53.488678+0000","last_active":"2024-09-21T07:12:43.842250+0000","last_peered":"2024-09-21T07:12:43.842250+0000","last_clean":"2024-09-21T07:12:43.842250+0000","last_became_active":"2024-09-21T07:10:53.488304+0000","last_became_peered":"2024-09-21T07:10:53.488304+0000","last_unstale":"2024-09-21T07:12:43.842250+0000","last_undegraded":"2024-09-21T07:12:43.842250+0000","last_fullsized":"2024-09-21T07:12:43.842250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:37.696269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:25.927387+0000","last_change":"2024-09-21T07:10:52.123086+0000","last_active":"2024-09-21T07:13:25.927387+0000","last_peered":"2024-09-21T07:13:25.927387+0000","last_clean":"2024-09-21T07:13:25.927387+0000","last_became_active":"2024-09-21T07:10:52.122584+0000","last_became_peered":"2024-09-21T07:10:52.122584+0000","last_unstale":"2024-09-21T07:13:25.927387+0000","last_undegraded":"2024-09-21T07:13:25.927387+0000","last_fullsized":"2024-09-21T07:13:25.927387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:28.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692332+0000","last_change":"2024-09-21T07:11:00.549595+0000","last_active":"2024-09-21T07:12:14.692332+0000","last_peered":"2024-09-21T07:12:14.692332+0000","last_clean":"2024-09-21T07:12:14.692332+0000","last_became_active":"2024-09-21T07:11:00.549009+0000","last_became_peered":"2024-09-21T07:11:00.549009+0000","last_unstale":"2024-09-21T07:12:14.692332+0000","last_undegraded":"2024-09-21T07:12:14.692332+0000","last_fullsized":"2024-09-21T07:12:14.692332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:59.825381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836215+0000","last_change":"2024-09-21T07:10:53.484336+0000","last_active":"2024-09-21T07:12:43.836215+0000","last_peered":"2024-09-21T07:12:43.836215+0000","last_clean":"2024-09-21T07:12:43.836215+0000","last_became_active":"2024-09-21T07:10:53.483825+0000","last_became_peered":"2024-09-21T07:10:53.483825+0000","last_unstale":"2024-09-21T07:12:43.836215+0000","last_undegraded":"2024-09-21T07:12:43.836215+0000","last_fullsized":"2024-09-21T07:12:43.836215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.545339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'62","reported_seq":132,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.871180+0000","last_change":"2024-09-21T07:10:51.461297+0000","last_active":"2024-09-21T07:13:27.871180+0000","last_peered":"2024-09-21T07:13:27.871180+0000","last_clean":"2024-09-21T07:13:27.871180+0000","last_became_active":"2024-09-21T07:10:51.460600+0000","last_became_peered":"2024-09-21T07:10:51.460600+0000","last_unstale":"2024-09-21T07:13:27.871180+0000","last_undegraded":"2024-09-21T07:13:27.871180+0000","last_fullsized":"2024-09-21T07:13:27.871180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:34.955250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998589+0000","last_change":"2024-09-21T07:11:00.551652+0000","last_active":"2024-09-21T07:12:14.998589+0000","last_peered":"2024-09-21T07:12:14.998589+0000","last_clean":"2024-09-21T07:12:14.998589+0000","last_became_active":"2024-09-21T07:11:00.551236+0000","last_became_peered":"2024-09-21T07:11:00.551236+0000","last_unstale":"2024-09-21T07:12:14.998589+0000","last_undegraded":"2024-09-21T07:12:14.998589+0000","last_fullsized":"2024-09-21T07:12:14.998589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:28.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833526+0000","last_change":"2024-09-21T07:10:53.487605+0000","last_active":"2024-09-21T07:12:43.833526+0000","last_peered":"2024-09-21T07:12:43.833526+0000","last_clean":"2024-09-21T07:12:43.833526+0000","last_became_active":"2024-09-21T07:10:53.487245+0000","last_became_peered":"2024-09-21T07:10:53.487245+0000","last_unstale":"2024-09-21T07:12:43.833526+0000","last_undegraded":"2024-09-21T07:12:43.833526+0000","last_fullsized":"2024-09-21T07:12:43.833526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:24.490652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686405+0000","last_change":"2024-09-21T07:10:51.456920+0000","last_active":"2024-09-21T07:12:14.686405+0000","last_peered":"2024-09-21T07:12:14.686405+0000","last_clean":"2024-09-21T07:12:14.686405+0000","last_became_active":"2024-09-21T07:10:51.456500+0000","last_became_peered":"2024-09-21T07:10:51.456500+0000","last_unstale":"2024-09-21T07:12:14.686405+0000","last_undegraded":"2024-09-21T07:12:14.686405+0000","last_fullsized":"2024-09-21T07:12:14.686405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:07.663192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690452+0000","last_change":"2024-09-21T07:11:00.552115+0000","last_active":"2024-09-21T07:12:14.690452+0000","last_peered":"2024-09-21T07:12:14.690452+0000","last_clean":"2024-09-21T07:12:14.690452+0000","last_became_active":"2024-09-21T07:11:00.551647+0000","last_became_peered":"2024-09-21T07:11:00.551647+0000","last_unstale":"2024-09-21T07:12:14.690452+0000","last_undegraded":"2024-09-21T07:12:14.690452+0000","last_fullsized":"2024-09-21T07:12:14.690452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:13.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834739+0000","last_change":"2024-09-21T07:11:14.671714+0000","last_active":"2024-09-21T07:12:43.834739+0000","last_peered":"2024-09-21T07:12:43.834739+0000","last_clean":"2024-09-21T07:12:43.834739+0000","last_became_active":"2024-09-21T07:11:14.671248+0000","last_became_peered":"2024-09-21T07:11:14.671248+0000","last_unstale":"2024-09-21T07:12:43.834739+0000","last_undegraded":"2024-09-21T07:12:43.834739+0000","last_fullsized":"2024-09-21T07:12:43.834739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:36.599916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.725429+0000","last_change":"2024-09-21T07:10:51.464710+0000","last_active":"2024-09-21T07:13:16.725429+0000","last_peered":"2024-09-21T07:13:16.725429+0000","last_clean":"2024-09-21T07:13:16.725429+0000","last_became_active":"2024-09-21T07:10:51.464295+0000","last_became_peered":"2024-09-21T07:10:51.464295+0000","last_unstale":"2024-09-21T07:13:16.725429+0000","last_undegraded":"2024-09-21T07:13:16.725429+0000","last_fullsized":"2024-09-21T07:13:16.725429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:00.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691150+0000","last_change":"2024-09-21T07:11:00.548275+0000","last_active":"2024-09-21T07:12:14.691150+0000","last_peered":"2024-09-21T07:12:14.691150+0000","last_clean":"2024-09-21T07:12:14.691150+0000","last_became_active":"2024-09-21T07:11:00.547777+0000","last_became_peered":"2024-09-21T07:11:00.547777+0000","last_unstale":"2024-09-21T07:12:14.691150+0000","last_undegraded":"2024-09-21T07:12:14.691150+0000","last_fullsized":"2024-09-21T07:12:14.691150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:13.860131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840327+0000","last_change":"2024-09-21T07:10:53.494072+0000","last_active":"2024-09-21T07:12:43.840327+0000","last_peered":"2024-09-21T07:12:43.840327+0000","last_clean":"2024-09-21T07:12:43.840327+0000","last_became_active":"2024-09-21T07:10:53.493493+0000","last_became_peered":"2024-09-21T07:10:53.493493+0000","last_unstale":"2024-09-21T07:12:43.840327+0000","last_undegraded":"2024-09-21T07:12:43.840327+0000","last_fullsized":"2024-09-21T07:12:43.840327+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.846641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":58,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692149+0000","last_change":"2024-09-21T07:10:51.468145+0000","last_active":"2024-09-21T07:12:14.692149+0000","last_peered":"2024-09-21T07:12:14.692149+0000","last_clean":"2024-09-21T07:12:14.692149+0000","last_became_active":"2024-09-21T07:10:51.467757+0000","last_became_peered":"2024-09-21T07:10:51.467757+0000","last_unstale":"2024-09-21T07:12:14.692149+0000","last_undegraded":"2024-09-21T07:12:14.692149+0000","last_fullsized":"2024-09-21T07:12:14.692149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:39.150277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686272+0000","last_change":"2024-09-21T07:11:00.548394+0000","last_active":"2024-09-21T07:12:14.686272+0000","last_peered":"2024-09-21T07:12:14.686272+0000","last_clean":"2024-09-21T07:12:14.686272+0000","last_became_active":"2024-09-21T07:11:00.547972+0000","last_became_peered":"2024-09-21T07:11:00.547972+0000","last_unstale":"2024-09-21T07:12:14.686272+0000","last_undegraded":"2024-09-21T07:12:14.686272+0000","last_fullsized":"2024-09-21T07:12:14.686272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:35.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.819250+0000","last_change":"2024-09-21T07:11:14.659248+0000","last_active":"2024-09-21T07:12:43.819250+0000","last_peered":"2024-09-21T07:12:43.819250+0000","last_clean":"2024-09-21T07:12:43.819250+0000","last_became_active":"2024-09-21T07:11:14.658931+0000","last_became_peered":"2024-09-21T07:11:14.658931+0000","last_unstale":"2024-09-21T07:12:43.819250+0000","last_undegraded":"2024-09-21T07:12:43.819250+0000","last_fullsized":"2024-09-21T07:12:43.819250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:12.278964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'9","reported_seq":171,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.929539+0000","last_change":"2024-09-21T07:10:51.466302+0000","last_active":"2024-09-21T07:13:27.929539+0000","last_peered":"2024-09-21T07:13:27.929539+0000","last_clean":"2024-09-21T07:13:27.929539+0000","last_became_active":"2024-09-21T07:10:51.465906+0000","last_became_peered":"2024-09-21T07:10:51.465906+0000","last_unstale":"2024-09-21T07:13:27.929539+0000","last_undegraded":"2024-09-21T07:13:27.929539+0000","last_fullsized":"2024-09-21T07:13:27.929539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:39.616338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":7,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689541+0000","last_change":"2024-09-21T07:11:00.555600+0000","last_active":"2024-09-21T07:12:14.689541+0000","last_peered":"2024-09-21T07:12:14.689541+0000","last_clean":"2024-09-21T07:12:14.689541+0000","last_became_active":"2024-09-21T07:11:00.555203+0000","last_became_peered":"2024-09-21T07:11:00.555203+0000","last_unstale":"2024-09-21T07:12:14.689541+0000","last_undegraded":"2024-09-21T07:12:14.689541+0000","last_fullsized":"2024-09-21T07:12:14.689541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838290+0000","last_change":"2024-09-21T07:10:53.482493+0000","last_active":"2024-09-21T07:12:43.838290+0000","last_peered":"2024-09-21T07:12:43.838290+0000","last_clean":"2024-09-21T07:12:43.838290+0000","last_became_active":"2024-09-21T07:10:53.481310+0000","last_became_peered":"2024-09-21T07:10:53.481310+0000","last_unstale":"2024-09-21T07:12:43.838290+0000","last_undegraded":"2024-09-21T07:12:43.838290+0000","last_fullsized":"2024-09-21T07:12:43.838290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:41.288008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691304+0000","last_change":"2024-09-21T07:10:51.468189+0000","last_active":"2024-09-21T07:12:14.691304+0000","last_peered":"2024-09-21T07:12:14.691304+0000","last_clean":"2024-09-21T07:12:14.691304+0000","last_became_active":"2024-09-21T07:10:51.467770+0000","last_became_peered":"2024-09-21T07:10:51.467770+0000","last_unstale":"2024-09-21T07:12:14.691304+0000","last_undegraded":"2024-09-21T07:12:14.691304+0000","last_fullsized":"2024-09-21T07:12:14.691304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:53.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689382+0000","last_change":"2024-09-21T07:11:00.556306+0000","last_active":"2024-09-21T07:12:14.689382+0000","last_peered":"2024-09-21T07:12:14.689382+0000","last_clean":"2024-09-21T07:12:14.689382+0000","last_became_active":"2024-09-21T07:11:00.555770+0000","last_became_peered":"2024-09-21T07:11:00.555770+0000","last_unstale":"2024-09-21T07:12:14.689382+0000","last_undegraded":"2024-09-21T07:12:14.689382+0000","last_fullsized":"2024-09-21T07:12:14.689382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:19.438869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839202+0000","last_change":"2024-09-21T07:10:53.485039+0000","last_active":"2024-09-21T07:12:43.839202+0000","last_peered":"2024-09-21T07:12:43.839202+0000","last_clean":"2024-09-21T07:12:43.839202+0000","last_became_active":"2024-09-21T07:10:53.484672+0000","last_became_peered":"2024-09-21T07:10:53.484672+0000","last_unstale":"2024-09-21T07:12:43.839202+0000","last_undegraded":"2024-09-21T07:12:43.839202+0000","last_fullsized":"2024-09-21T07:12:43.839202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:28.291602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.709692+0000","last_change":"2024-09-21T07:12:14.709213+0000","last_active":"2024-09-21T07:12:14.709692+0000","last_peered":"2024-09-21T07:12:14.709692+0000","last_clean":"2024-09-21T07:12:14.709692+0000","last_became_active":"2024-09-21T07:12:14.693406+0000","last_became_peered":"2024-09-21T07:12:14.693406+0000","last_unstale":"2024-09-21T07:12:14.709692+0000","last_undegraded":"2024-09-21T07:12:14.709692+0000","last_fullsized":"2024-09-21T07:12:14.709692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:25.204575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687428+0000","last_change":"2024-09-21T07:11:14.672269+0000","last_active":"2024-09-21T07:12:14.687428+0000","last_peered":"2024-09-21T07:12:14.687428+0000","last_clean":"2024-09-21T07:12:14.687428+0000","last_became_active":"2024-09-21T07:11:14.671740+0000","last_became_peered":"2024-09-21T07:11:14.671740+0000","last_unstale":"2024-09-21T07:12:14.687428+0000","last_undegraded":"2024-09-21T07:12:14.687428+0000","last_fullsized":"2024-09-21T07:12:14.687428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.600585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831681+0000","last_change":"2024-09-21T07:10:53.487667+0000","last_active":"2024-09-21T07:12:43.831681+0000","last_peered":"2024-09-21T07:12:43.831681+0000","last_clean":"2024-09-21T07:12:43.831681+0000","last_became_active":"2024-09-21T07:10:53.487316+0000","last_became_peered":"2024-09-21T07:10:53.487316+0000","last_unstale":"2024-09-21T07:12:43.831681+0000","last_undegraded":"2024-09-21T07:12:43.831681+0000","last_fullsized":"2024-09-21T07:12:43.831681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:33.545631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'41","reported_seq":321,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:26.912188+0000","last_change":"2024-09-21T07:10:51.465172+0000","last_active":"2024-09-21T07:13:26.912188+0000","last_peered":"2024-09-21T07:13:26.912188+0000","last_clean":"2024-09-21T07:13:26.912188+0000","last_became_active":"2024-09-21T07:10:51.464655+0000","last_became_peered":"2024-09-21T07:10:51.464655+0000","last_unstale":"2024-09-21T07:13:26.912188+0000","last_undegraded":"2024-09-21T07:13:26.912188+0000","last_fullsized":"2024-09-21T07:13:26.912188+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:02.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74214,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":241,"num_read_kb":195,"num_write":43,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686973+0000","last_change":"2024-09-21T07:11:14.671892+0000","last_active":"2024-09-21T07:12:14.686973+0000","last_peered":"2024-09-21T07:12:14.686973+0000","last_clean":"2024-09-21T07:12:14.686973+0000","last_became_active":"2024-09-21T07:11:14.671283+0000","last_became_peered":"2024-09-21T07:11:14.671283+0000","last_unstale":"2024-09-21T07:12:14.686973+0000","last_undegraded":"2024-09-21T07:12:14.686973+0000","last_fullsized":"2024-09-21T07:12:14.686973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:54.263127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839267+0000","last_change":"2024-09-21T07:10:53.491873+0000","last_active":"2024-09-21T07:12:43.839267+0000","last_peered":"2024-09-21T07:12:43.839267+0000","last_clean":"2024-09-21T07:12:43.839267+0000","last_became_active":"2024-09-21T07:10:53.491424+0000","last_became_peered":"2024-09-21T07:10:53.491424+0000","last_unstale":"2024-09-21T07:12:43.839267+0000","last_undegraded":"2024-09-21T07:12:43.839267+0000","last_fullsized":"2024-09-21T07:12:43.839267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.145391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691247+0000","last_change":"2024-09-21T07:10:51.469395+0000","last_active":"2024-09-21T07:12:14.691247+0000","last_peered":"2024-09-21T07:12:14.691247+0000","last_clean":"2024-09-21T07:12:14.691247+0000","last_became_active":"2024-09-21T07:10:51.469015+0000","last_became_peered":"2024-09-21T07:10:51.469015+0000","last_unstale":"2024-09-21T07:12:14.691247+0000","last_undegraded":"2024-09-21T07:12:14.691247+0000","last_fullsized":"2024-09-21T07:12:14.691247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.274950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806089+0000","last_change":"2024-09-21T07:11:00.553164+0000","last_active":"2024-09-21T07:12:14.806089+0000","last_peered":"2024-09-21T07:12:14.806089+0000","last_clean":"2024-09-21T07:12:14.806089+0000","last_became_active":"2024-09-21T07:11:00.551969+0000","last_became_peered":"2024-09-21T07:11:00.551969+0000","last_unstale":"2024-09-21T07:12:14.806089+0000","last_undegraded":"2024-09-21T07:12:14.806089+0000","last_fullsized":"2024-09-21T07:12:14.806089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:53.042065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842195+0000","last_change":"2024-09-21T07:10:53.497110+0000","last_active":"2024-09-21T07:12:43.842195+0000","last_peered":"2024-09-21T07:12:43.842195+0000","last_clean":"2024-09-21T07:12:43.842195+0000","last_became_active":"2024-09-21T07:10:53.496751+0000","last_became_peered":"2024-09-21T07:10:53.496751+0000","last_unstale":"2024-09-21T07:12:43.842195+0000","last_undegraded":"2024-09-21T07:12:43.842195+0000","last_fullsized":"2024-09-21T07:12:43.842195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.531652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.812563+0000","last_change":"2024-09-21T07:12:14.811962+0000","last_active":"2024-09-21T07:12:14.812563+0000","last_peered":"2024-09-21T07:12:14.812563+0000","last_clean":"2024-09-21T07:12:14.812563+0000","last_became_active":"2024-09-21T07:12:14.807745+0000","last_became_peered":"2024-09-21T07:12:14.807745+0000","last_unstale":"2024-09-21T07:12:14.812563+0000","last_undegraded":"2024-09-21T07:12:14.812563+0000","last_fullsized":"2024-09-21T07:12:14.812563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:20.292633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691946+0000","last_change":"2024-09-21T07:11:14.655255+0000","last_active":"2024-09-21T07:12:14.691946+0000","last_peered":"2024-09-21T07:12:14.691946+0000","last_clean":"2024-09-21T07:12:14.691946+0000","last_became_active":"2024-09-21T07:11:14.654556+0000","last_became_peered":"2024-09-21T07:11:14.654556+0000","last_unstale":"2024-09-21T07:12:14.691946+0000","last_undegraded":"2024-09-21T07:12:14.691946+0000","last_fullsized":"2024-09-21T07:12:14.691946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:44.435834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843700+0000","last_change":"2024-09-21T07:10:53.484990+0000","last_active":"2024-09-21T07:12:43.843700+0000","last_peered":"2024-09-21T07:12:43.843700+0000","last_clean":"2024-09-21T07:12:43.843700+0000","last_became_active":"2024-09-21T07:10:53.484570+0000","last_became_peered":"2024-09-21T07:10:53.484570+0000","last_unstale":"2024-09-21T07:12:43.843700+0000","last_undegraded":"2024-09-21T07:12:43.843700+0000","last_fullsized":"2024-09-21T07:12:43.843700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:28.848203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":274,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:26.911651+0000","last_change":"2024-09-21T07:10:51.463378+0000","last_active":"2024-09-21T07:13:26.911651+0000","last_peered":"2024-09-21T07:13:26.911651+0000","last_clean":"2024-09-21T07:13:26.911651+0000","last_became_active":"2024-09-21T07:10:51.462961+0000","last_became_peered":"2024-09-21T07:10:51.462961+0000","last_unstale":"2024-09-21T07:13:26.911651+0000","last_undegraded":"2024-09-21T07:13:26.911651+0000","last_fullsized":"2024-09-21T07:13:26.911651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:22.637603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691393+0000","last_change":"2024-09-21T07:11:00.549758+0000","last_active":"2024-09-21T07:12:14.691393+0000","last_peered":"2024-09-21T07:12:14.691393+0000","last_clean":"2024-09-21T07:12:14.691393+0000","last_became_active":"2024-09-21T07:11:00.549141+0000","last_became_peered":"2024-09-21T07:11:00.549141+0000","last_unstale":"2024-09-21T07:12:14.691393+0000","last_undegraded":"2024-09-21T07:12:14.691393+0000","last_fullsized":"2024-09-21T07:12:14.691393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:27.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998447+0000","last_change":"2024-09-21T07:11:00.550407+0000","last_active":"2024-09-21T07:12:14.998447+0000","last_peered":"2024-09-21T07:12:14.998447+0000","last_clean":"2024-09-21T07:12:14.998447+0000","last_became_active":"2024-09-21T07:11:00.549930+0000","last_became_peered":"2024-09-21T07:11:00.549930+0000","last_unstale":"2024-09-21T07:12:14.998447+0000","last_undegraded":"2024-09-21T07:12:14.998447+0000","last_fullsized":"2024-09-21T07:12:14.998447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:25.924695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841002+0000","last_change":"2024-09-21T07:10:53.491452+0000","last_active":"2024-09-21T07:12:43.841002+0000","last_peered":"2024-09-21T07:12:43.841002+0000","last_clean":"2024-09-21T07:12:43.841002+0000","last_became_active":"2024-09-21T07:10:53.491106+0000","last_became_peered":"2024-09-21T07:10:53.491106+0000","last_unstale":"2024-09-21T07:12:43.841002+0000","last_undegraded":"2024-09-21T07:12:43.841002+0000","last_fullsized":"2024-09-21T07:12:43.841002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:58.270323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690834+0000","last_change":"2024-09-21T07:10:51.468433+0000","last_active":"2024-09-21T07:12:14.690834+0000","last_peered":"2024-09-21T07:12:14.690834+0000","last_clean":"2024-09-21T07:12:14.690834+0000","last_became_active":"2024-09-21T07:10:51.467810+0000","last_became_peered":"2024-09-21T07:10:51.467810+0000","last_unstale":"2024-09-21T07:12:14.690834+0000","last_undegraded":"2024-09-21T07:12:14.690834+0000","last_fullsized":"2024-09-21T07:12:14.690834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.787584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689774+0000","last_change":"2024-09-21T07:11:00.556866+0000","last_active":"2024-09-21T07:12:14.689774+0000","last_peered":"2024-09-21T07:12:14.689774+0000","last_clean":"2024-09-21T07:12:14.689774+0000","last_became_active":"2024-09-21T07:11:00.555350+0000","last_became_peered":"2024-09-21T07:11:00.555350+0000","last_unstale":"2024-09-21T07:12:14.689774+0000","last_undegraded":"2024-09-21T07:12:14.689774+0000","last_fullsized":"2024-09-21T07:12:14.689774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:46.296771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830636+0000","last_change":"2024-09-21T07:10:53.487210+0000","last_active":"2024-09-21T07:12:43.830636+0000","last_peered":"2024-09-21T07:12:43.830636+0000","last_clean":"2024-09-21T07:12:43.830636+0000","last_became_active":"2024-09-21T07:10:53.485975+0000","last_became_peered":"2024-09-21T07:10:53.485975+0000","last_unstale":"2024-09-21T07:12:43.830636+0000","last_undegraded":"2024-09-21T07:12:43.830636+0000","last_fullsized":"2024-09-21T07:12:43.830636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.685994+0000","last_change":"2024-09-21T07:10:51.456418+0000","last_active":"2024-09-21T07:12:14.685994+0000","last_peered":"2024-09-21T07:12:14.685994+0000","last_clean":"2024-09-21T07:12:14.685994+0000","last_became_active":"2024-09-21T07:10:51.455885+0000","last_became_peered":"2024-09-21T07:10:51.455885+0000","last_unstale":"2024-09-21T07:12:14.685994+0000","last_undegraded":"2024-09-21T07:12:14.685994+0000","last_fullsized":"2024-09-21T07:12:14.685994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:53.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687514+0000","last_change":"2024-09-21T07:10:51.462544+0000","last_active":"2024-09-21T07:12:14.687514+0000","last_peered":"2024-09-21T07:12:14.687514+0000","last_clean":"2024-09-21T07:12:14.687514+0000","last_became_active":"2024-09-21T07:10:51.462075+0000","last_became_peered":"2024-09-21T07:10:51.462075+0000","last_unstale":"2024-09-21T07:12:14.687514+0000","last_undegraded":"2024-09-21T07:12:14.687514+0000","last_fullsized":"2024-09-21T07:12:14.687514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:09.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839085+0000","last_change":"2024-09-21T07:12:14.694814+0000","last_active":"2024-09-21T07:12:43.839085+0000","last_peered":"2024-09-21T07:12:43.839085+0000","last_clean":"2024-09-21T07:12:43.839085+0000","last_became_active":"2024-09-21T07:12:14.694334+0000","last_became_peered":"2024-09-21T07:12:14.694334+0000","last_unstale":"2024-09-21T07:12:43.839085+0000","last_undegraded":"2024-09-21T07:12:43.839085+0000","last_fullsized":"2024-09-21T07:12:43.839085+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:33.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687029+0000","last_change":"2024-09-21T07:11:00.552908+0000","last_active":"2024-09-21T07:12:14.687029+0000","last_peered":"2024-09-21T07:12:14.687029+0000","last_clean":"2024-09-21T07:12:14.687029+0000","last_became_active":"2024-09-21T07:11:00.552303+0000","last_became_peered":"2024-09-21T07:11:00.552303+0000","last_unstale":"2024-09-21T07:12:14.687029+0000","last_undegraded":"2024-09-21T07:12:14.687029+0000","last_fullsized":"2024-09-21T07:12:14.687029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'8","reported_seq":169,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.914322+0000","last_change":"2024-09-21T07:10:51.467072+0000","last_active":"2024-09-21T07:13:27.914322+0000","last_peered":"2024-09-21T07:13:27.914322+0000","last_clean":"2024-09-21T07:13:27.914322+0000","last_became_active":"2024-09-21T07:10:51.466671+0000","last_became_peered":"2024-09-21T07:10:51.466671+0000","last_unstale":"2024-09-21T07:13:27.914322+0000","last_undegraded":"2024-09-21T07:13:27.914322+0000","last_fullsized":"2024-09-21T07:13:27.914322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:24.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833933+0000","last_change":"2024-09-21T07:10:53.480057+0000","last_active":"2024-09-21T07:12:43.833933+0000","last_peered":"2024-09-21T07:12:43.833933+0000","last_clean":"2024-09-21T07:12:43.833933+0000","last_became_active":"2024-09-21T07:10:53.479644+0000","last_became_peered":"2024-09-21T07:10:53.479644+0000","last_unstale":"2024-09-21T07:12:43.833933+0000","last_undegraded":"2024-09-21T07:12:43.833933+0000","last_fullsized":"2024-09-21T07:12:43.833933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:34.255547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687321+0000","last_change":"2024-09-21T07:11:00.550259+0000","last_active":"2024-09-21T07:12:14.687321+0000","last_peered":"2024-09-21T07:12:14.687321+0000","last_clean":"2024-09-21T07:12:14.687321+0000","last_became_active":"2024-09-21T07:11:00.549771+0000","last_became_peered":"2024-09-21T07:11:00.549771+0000","last_unstale":"2024-09-21T07:12:14.687321+0000","last_undegraded":"2024-09-21T07:12:14.687321+0000","last_fullsized":"2024-09-21T07:12:14.687321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839385+0000","last_change":"2024-09-21T07:10:53.488022+0000","last_active":"2024-09-21T07:12:43.839385+0000","last_peered":"2024-09-21T07:12:43.839385+0000","last_clean":"2024-09-21T07:12:43.839385+0000","last_became_active":"2024-09-21T07:10:53.487605+0000","last_became_peered":"2024-09-21T07:10:53.487605+0000","last_unstale":"2024-09-21T07:12:43.839385+0000","last_undegraded":"2024-09-21T07:12:43.839385+0000","last_fullsized":"2024-09-21T07:12:43.839385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:02.074960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833306+0000","last_change":"2024-09-21T07:10:53.484319+0000","last_active":"2024-09-21T07:12:43.833306+0000","last_peered":"2024-09-21T07:12:43.833306+0000","last_clean":"2024-09-21T07:12:43.833306+0000","last_became_active":"2024-09-21T07:10:53.483942+0000","last_became_peered":"2024-09-21T07:10:53.483942+0000","last_unstale":"2024-09-21T07:12:43.833306+0000","last_undegraded":"2024-09-21T07:12:43.833306+0000","last_fullsized":"2024-09-21T07:12:43.833306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:50.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840566+0000","last_change":"2024-09-21T07:10:53.494981+0000","last_active":"2024-09-21T07:12:43.840566+0000","last_peered":"2024-09-21T07:12:43.840566+0000","last_clean":"2024-09-21T07:12:43.840566+0000","last_became_active":"2024-09-21T07:10:53.494580+0000","last_became_peered":"2024-09-21T07:10:53.494580+0000","last_unstale":"2024-09-21T07:12:43.840566+0000","last_undegraded":"2024-09-21T07:12:43.840566+0000","last_fullsized":"2024-09-21T07:12:43.840566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:57.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842588+0000","last_change":"2024-09-21T07:10:53.492971+0000","last_active":"2024-09-21T07:12:43.842588+0000","last_peered":"2024-09-21T07:12:43.842588+0000","last_clean":"2024-09-21T07:12:43.842588+0000","last_became_active":"2024-09-21T07:10:53.492597+0000","last_became_peered":"2024-09-21T07:10:53.492597+0000","last_unstale":"2024-09-21T07:12:43.842588+0000","last_undegraded":"2024-09-21T07:12:43.842588+0000","last_fullsized":"2024-09-21T07:12:43.842588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.931998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836994+0000","last_change":"2024-09-21T07:10:53.485613+0000","last_active":"2024-09-21T07:12:43.836994+0000","last_peered":"2024-09-21T07:12:43.836994+0000","last_clean":"2024-09-21T07:12:43.836994+0000","last_became_active":"2024-09-21T07:10:53.485268+0000","last_became_peered":"2024-09-21T07:10:53.485268+0000","last_unstale":"2024-09-21T07:12:43.836994+0000","last_undegraded":"2024-09-21T07:12:43.836994+0000","last_fullsized":"2024-09-21T07:12:43.836994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:52.496426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831297+0000","last_change":"2024-09-21T07:10:53.489349+0000","last_active":"2024-09-21T07:12:43.831297+0000","last_peered":"2024-09-21T07:12:43.831297+0000","last_clean":"2024-09-21T07:12:43.831297+0000","last_became_active":"2024-09-21T07:10:53.488986+0000","last_became_peered":"2024-09-21T07:10:53.488986+0000","last_unstale":"2024-09-21T07:12:43.831297+0000","last_undegraded":"2024-09-21T07:12:43.831297+0000","last_fullsized":"2024-09-21T07:12:43.831297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:46.376689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.832429+0000","last_change":"2024-09-21T07:10:53.485740+0000","last_active":"2024-09-21T07:12:43.832429+0000","last_peered":"2024-09-21T07:12:43.832429+0000","last_clean":"2024-09-21T07:12:43.832429+0000","last_became_active":"2024-09-21T07:10:53.485375+0000","last_became_peered":"2024-09-21T07:10:53.485375+0000","last_unstale":"2024-09-21T07:12:43.832429+0000","last_undegraded":"2024-09-21T07:12:43.832429+0000","last_fullsized":"2024-09-21T07:12:43.832429+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:40.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838894+0000","last_change":"2024-09-21T07:10:53.490211+0000","last_active":"2024-09-21T07:12:43.838894+0000","last_peered":"2024-09-21T07:12:43.838894+0000","last_clean":"2024-09-21T07:12:43.838894+0000","last_became_active":"2024-09-21T07:10:53.489504+0000","last_became_peered":"2024-09-21T07:10:53.489504+0000","last_unstale":"2024-09-21T07:12:43.838894+0000","last_undegraded":"2024-09-21T07:12:43.838894+0000","last_fullsized":"2024-09-21T07:12:43.838894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:50.337307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.837945+0000","last_change":"2024-09-21T07:10:53.486064+0000","last_active":"2024-09-21T07:12:43.837945+0000","last_peered":"2024-09-21T07:12:43.837945+0000","last_clean":"2024-09-21T07:12:43.837945+0000","last_became_active":"2024-09-21T07:10:53.485674+0000","last_became_peered":"2024-09-21T07:10:53.485674+0000","last_unstale":"2024-09-21T07:12:43.837945+0000","last_undegraded":"2024-09-21T07:12:43.837945+0000","last_fullsized":"2024-09-21T07:12:43.837945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:55.232795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838941+0000","last_change":"2024-09-21T07:10:53.489008+0000","last_active":"2024-09-21T07:12:43.838941+0000","last_peered":"2024-09-21T07:12:43.838941+0000","last_clean":"2024-09-21T07:12:43.838941+0000","last_became_active":"2024-09-21T07:10:53.488655+0000","last_became_peered":"2024-09-21T07:10:53.488655+0000","last_unstale":"2024-09-21T07:12:43.838941+0000","last_undegraded":"2024-09-21T07:12:43.838941+0000","last_fullsized":"2024-09-21T07:12:43.838941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:42.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843962+0000","last_change":"2024-09-21T07:10:53.490147+0000","last_active":"2024-09-21T07:12:43.843962+0000","last_peered":"2024-09-21T07:12:43.843962+0000","last_clean":"2024-09-21T07:12:43.843962+0000","last_became_active":"2024-09-21T07:10:53.488389+0000","last_became_peered":"2024-09-21T07:10:53.488389+0000","last_unstale":"2024-09-21T07:12:43.843962+0000","last_undegraded":"2024-09-21T07:12:43.843962+0000","last_fullsized":"2024-09-21T07:12:43.843962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:17.729856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840459+0000","last_change":"2024-09-21T07:10:53.486557+0000","last_active":"2024-09-21T07:12:43.840459+0000","last_peered":"2024-09-21T07:12:43.840459+0000","last_clean":"2024-09-21T07:12:43.840459+0000","last_became_active":"2024-09-21T07:10:53.486248+0000","last_became_peered":"2024-09-21T07:10:53.486248+0000","last_unstale":"2024-09-21T07:12:43.840459+0000","last_undegraded":"2024-09-21T07:12:43.840459+0000","last_fullsized":"2024-09-21T07:12:43.840459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.675717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833816+0000","last_change":"2024-09-21T07:10:53.485281+0000","last_active":"2024-09-21T07:12:43.833816+0000","last_peered":"2024-09-21T07:12:43.833816+0000","last_clean":"2024-09-21T07:12:43.833816+0000","last_became_active":"2024-09-21T07:10:53.484732+0000","last_became_peered":"2024-09-21T07:10:53.484732+0000","last_unstale":"2024-09-21T07:12:43.833816+0000","last_undegraded":"2024-09-21T07:12:43.833816+0000","last_fullsized":"2024-09-21T07:12:43.833816+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:53.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836869+0000","last_change":"2024-09-21T07:10:53.483192+0000","last_active":"2024-09-21T07:12:43.836869+0000","last_peered":"2024-09-21T07:12:43.836869+0000","last_clean":"2024-09-21T07:12:43.836869+0000","last_became_active":"2024-09-21T07:10:53.482402+0000","last_became_peered":"2024-09-21T07:10:53.482402+0000","last_unstale":"2024-09-21T07:12:43.836869+0000","last_undegraded":"2024-09-21T07:12:43.836869+0000","last_fullsized":"2024-09-21T07:12:43.836869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.159873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843080+0000","last_change":"2024-09-21T07:10:53.481463+0000","last_active":"2024-09-21T07:12:43.843080+0000","last_peered":"2024-09-21T07:12:43.843080+0000","last_clean":"2024-09-21T07:12:43.843080+0000","last_became_active":"2024-09-21T07:10:53.481129+0000","last_became_peered":"2024-09-21T07:10:53.481129+0000","last_unstale":"2024-09-21T07:12:43.843080+0000","last_undegraded":"2024-09-21T07:12:43.843080+0000","last_fullsized":"2024-09-21T07:12:43.843080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:14.547936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840480+0000","last_change":"2024-09-21T07:10:53.493009+0000","last_active":"2024-09-21T07:12:43.840480+0000","last_peered":"2024-09-21T07:12:43.840480+0000","last_clean":"2024-09-21T07:12:43.840480+0000","last_became_active":"2024-09-21T07:10:53.492300+0000","last_became_peered":"2024-09-21T07:10:53.492300+0000","last_unstale":"2024-09-21T07:12:43.840480+0000","last_undegraded":"2024-09-21T07:12:43.840480+0000","last_fullsized":"2024-09-21T07:12:43.840480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:09.890248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843437+0000","last_change":"2024-09-21T07:10:53.491149+0000","last_active":"2024-09-21T07:12:43.843437+0000","last_peered":"2024-09-21T07:12:43.843437+0000","last_clean":"2024-09-21T07:12:43.843437+0000","last_became_active":"2024-09-21T07:10:53.490766+0000","last_became_peered":"2024-09-21T07:10:53.490766+0000","last_unstale":"2024-09-21T07:12:43.843437+0000","last_undegraded":"2024-09-21T07:12:43.843437+0000","last_fullsized":"2024-09-21T07:12:43.843437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:52.243083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840492+0000","last_change":"2024-09-21T07:11:14.672453+0000","last_active":"2024-09-21T07:12:43.840492+0000","last_peered":"2024-09-21T07:12:43.840492+0000","last_clean":"2024-09-21T07:12:43.840492+0000","last_became_active":"2024-09-21T07:11:14.671584+0000","last_became_peered":"2024-09-21T07:11:14.671584+0000","last_unstale":"2024-09-21T07:12:43.840492+0000","last_undegraded":"2024-09-21T07:12:43.840492+0000","last_fullsized":"2024-09-21T07:12:43.840492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:25.746195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839098+0000","last_change":"2024-09-21T07:10:53.496332+0000","last_active":"2024-09-21T07:12:43.839098+0000","last_peered":"2024-09-21T07:12:43.839098+0000","last_clean":"2024-09-21T07:12:43.839098+0000","last_became_active":"2024-09-21T07:10:53.495078+0000","last_became_peered":"2024-09-21T07:10:53.495078+0000","last_unstale":"2024-09-21T07:12:43.839098+0000","last_undegraded":"2024-09-21T07:12:43.839098+0000","last_fullsized":"2024-09-21T07:12:43.839098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:32.415350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838131+0000","last_change":"2024-09-21T07:10:53.478381+0000","last_active":"2024-09-21T07:12:43.838131+0000","last_peered":"2024-09-21T07:12:43.838131+0000","last_clean":"2024-09-21T07:12:43.838131+0000","last_became_active":"2024-09-21T07:10:53.478021+0000","last_became_peered":"2024-09-21T07:10:53.478021+0000","last_unstale":"2024-09-21T07:12:43.838131+0000","last_undegraded":"2024-09-21T07:12:43.838131+0000","last_fullsized":"2024-09-21T07:12:43.838131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:02.496263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.821141+0000","last_change":"2024-09-21T07:10:53.485103+0000","last_active":"2024-09-21T07:12:43.821141+0000","last_peered":"2024-09-21T07:12:43.821141+0000","last_clean":"2024-09-21T07:12:43.821141+0000","last_became_active":"2024-09-21T07:10:53.483835+0000","last_became_peered":"2024-09-21T07:10:53.483835+0000","last_unstale":"2024-09-21T07:12:43.821141+0000","last_undegraded":"2024-09-21T07:12:43.821141+0000","last_fullsized":"2024-09-21T07:12:43.821141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:47.775202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842539+0000","last_change":"2024-09-21T07:10:53.490497+0000","last_active":"2024-09-21T07:12:43.842539+0000","last_peered":"2024-09-21T07:12:43.842539+0000","last_clean":"2024-09-21T07:12:43.842539+0000","last_became_active":"2024-09-21T07:10:53.490137+0000","last_became_peered":"2024-09-21T07:10:53.490137+0000","last_unstale":"2024-09-21T07:12:43.842539+0000","last_undegraded":"2024-09-21T07:12:43.842539+0000","last_fullsized":"2024-09-21T07:12:43.842539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:12.090628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842305+0000","last_change":"2024-09-21T07:10:53.487118+0000","last_active":"2024-09-21T07:12:43.842305+0000","last_peered":"2024-09-21T07:12:43.842305+0000","last_clean":"2024-09-21T07:12:43.842305+0000","last_became_active":"2024-09-21T07:10:53.486582+0000","last_became_peered":"2024-09-21T07:10:53.486582+0000","last_unstale":"2024-09-21T07:12:43.842305+0000","last_undegraded":"2024-09-21T07:12:43.842305+0000","last_fullsized":"2024-09-21T07:12:43.842305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:00.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839468+0000","last_change":"2024-09-21T07:10:53.497390+0000","last_active":"2024-09-21T07:12:43.839468+0000","last_peered":"2024-09-21T07:12:43.839468+0000","last_clean":"2024-09-21T07:12:43.839468+0000","last_became_active":"2024-09-21T07:10:53.497043+0000","last_became_peered":"2024-09-21T07:10:53.497043+0000","last_unstale":"2024-09-21T07:12:43.839468+0000","last_undegraded":"2024-09-21T07:12:43.839468+0000","last_fullsized":"2024-09-21T07:12:43.839468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:36.912873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.829609+0000","last_change":"2024-09-21T07:10:53.484624+0000","last_active":"2024-09-21T07:12:43.829609+0000","last_peered":"2024-09-21T07:12:43.829609+0000","last_clean":"2024-09-21T07:12:43.829609+0000","last_became_active":"2024-09-21T07:10:53.484278+0000","last_became_peered":"2024-09-21T07:10:53.484278+0000","last_unstale":"2024-09-21T07:12:43.829609+0000","last_undegraded":"2024-09-21T07:12:43.829609+0000","last_fullsized":"2024-09-21T07:12:43.829609+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:41.464442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836326+0000","last_change":"2024-09-21T07:10:53.478146+0000","last_active":"2024-09-21T07:12:43.836326+0000","last_peered":"2024-09-21T07:12:43.836326+0000","last_clean":"2024-09-21T07:12:43.836326+0000","last_became_active":"2024-09-21T07:10:53.477733+0000","last_became_peered":"2024-09-21T07:10:53.477733+0000","last_unstale":"2024-09-21T07:12:43.836326+0000","last_undegraded":"2024-09-21T07:12:43.836326+0000","last_fullsized":"2024-09-21T07:12:43.836326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:09.159966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839904+0000","last_change":"2024-09-21T07:11:14.657274+0000","last_active":"2024-09-21T07:12:43.839904+0000","last_peered":"2024-09-21T07:12:43.839904+0000","last_clean":"2024-09-21T07:12:43.839904+0000","last_became_active":"2024-09-21T07:11:14.656826+0000","last_became_peered":"2024-09-21T07:11:14.656826+0000","last_unstale":"2024-09-21T07:12:43.839904+0000","last_undegraded":"2024-09-21T07:12:43.839904+0000","last_fullsized":"2024-09-21T07:12:43.839904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.688373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830242+0000","last_change":"2024-09-21T07:10:53.481411+0000","last_active":"2024-09-21T07:12:43.830242+0000","last_peered":"2024-09-21T07:12:43.830242+0000","last_clean":"2024-09-21T07:12:43.830242+0000","last_became_active":"2024-09-21T07:10:53.481005+0000","last_became_peered":"2024-09-21T07:10:53.481005+0000","last_unstale":"2024-09-21T07:12:43.830242+0000","last_undegraded":"2024-09-21T07:12:43.830242+0000","last_fullsized":"2024-09-21T07:12:43.830242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:41.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.823757+0000","last_change":"2024-09-21T07:10:53.487481+0000","last_active":"2024-09-21T07:12:43.823757+0000","last_peered":"2024-09-21T07:12:43.823757+0000","last_clean":"2024-09-21T07:12:43.823757+0000","last_became_active":"2024-09-21T07:10:53.486277+0000","last_became_peered":"2024-09-21T07:10:53.486277+0000","last_unstale":"2024-09-21T07:12:43.823757+0000","last_undegraded":"2024-09-21T07:12:43.823757+0000","last_fullsized":"2024-09-21T07:12:43.823757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:57.304382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840517+0000","last_change":"2024-09-21T07:10:53.495971+0000","last_active":"2024-09-21T07:12:43.840517+0000","last_peered":"2024-09-21T07:12:43.840517+0000","last_clean":"2024-09-21T07:12:43.840517+0000","last_became_active":"2024-09-21T07:10:53.495124+0000","last_became_peered":"2024-09-21T07:10:53.495124+0000","last_unstale":"2024-09-21T07:12:43.840517+0000","last_undegraded":"2024-09-21T07:12:43.840517+0000","last_fullsized":"2024-09-21T07:12:43.840517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839940+0000","last_change":"2024-09-21T07:10:53.497538+0000","last_active":"2024-09-21T07:12:43.839940+0000","last_peered":"2024-09-21T07:12:43.839940+0000","last_clean":"2024-09-21T07:12:43.839940+0000","last_became_active":"2024-09-21T07:10:53.496835+0000","last_became_peered":"2024-09-21T07:10:53.496835+0000","last_unstale":"2024-09-21T07:12:43.839940+0000","last_undegraded":"2024-09-21T07:12:43.839940+0000","last_fullsized":"2024-09-21T07:12:43.839940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:17.187282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840355+0000","last_change":"2024-09-21T07:10:53.492646+0000","last_active":"2024-09-21T07:12:43.840355+0000","last_peered":"2024-09-21T07:12:43.840355+0000","last_clean":"2024-09-21T07:12:43.840355+0000","last_became_active":"2024-09-21T07:10:53.491818+0000","last_became_peered":"2024-09-21T07:10:53.491818+0000","last_unstale":"2024-09-21T07:12:43.840355+0000","last_undegraded":"2024-09-21T07:12:43.840355+0000","last_fullsized":"2024-09-21T07:12:43.840355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:37.094158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":871055,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1507,"num_read_kb":971,"num_write":496,"num_write_kb":2264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":68,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":835584,"data_stored":2613165,"data_compressed":111761,"data_compressed_allocated":147456,"data_compressed_original":2285568,"omap_allocated":0,"internal_metadata":0},"log_size":378,"ondisk_log_size":378,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283164,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710764,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":899963,"data_compressed":48859,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906994,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32332,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712820,"statfs":{"total":95995035648,"available":95961927680,"internally_reserved":0,"allocated":1175552,"data_stored":1566504,"data_compressed":83319,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070519,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":899332,"data_compressed":48876,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266748,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":506494,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462976,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1105534,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626500,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":502113,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822731,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36416,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708736,"statfs":{"total":95995035648,"available":95957745664,"internally_reserved":0,"allocated":1093632,"data_stored":1492983,"data_compressed":83681,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986257,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":507110,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182485,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1288320,"data_compressed":66588,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378714,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":578534,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542238,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":577357,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705765,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":983040,"data_stored":503569,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":77636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":787422,"data_compressed":37001,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":397621,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":471142,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394969,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:13:31.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:13:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:30 smithi169 ceph-mon[33705]: from='client.15726 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:31.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:30 smithi175 ceph-mon[34064]: from='client.15726 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:31.375 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:31.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.853+0000 7f1251014640 1 -- 172.21.15.92:0/299374363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f124c108450 msgr2=0x7f124c108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.853+0000 7f1251014640 1 --2- 172.21.15.92:0/299374363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f124c108450 0x7f124c108860 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1234009900 tx=0x7f123402a410 comp rx=0 tx=0).stop 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.853+0000 7f1251014640 1 -- 172.21.15.92:0/299374363 shutdown_connections 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.853+0000 7f1251014640 1 --2- 172.21.15.92:0/299374363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f124c108da0 0x7f124c10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.853+0000 7f1251014640 1 --2- 172.21.15.92:0/299374363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f124c108450 0x7f124c108860 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.853+0000 7f1251014640 1 --2- 172.21.15.92:0/299374363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f124c102b10 0x7f124c102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.853+0000 7f1251014640 1 -- 172.21.15.92:0/299374363 >> 172.21.15.92:0/299374363 conn(0x7f124c0796d0 msgr2=0x7f124c079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.853+0000 7f1251014640 1 -- 172.21.15.92:0/299374363 shutdown_connections 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.854+0000 7f1251014640 1 -- 172.21.15.92:0/299374363 wait complete. 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.854+0000 7f1251014640 1 Processor -- start 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.854+0000 7f1251014640 1 -- start start 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1251014640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f124c102b10 0x7f124c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1251014640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f124c108450 0x7f124c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:31.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1251014640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f124c108da0 0x7f124c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1251014640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f124c112910 con 0x7f124c108450 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1251014640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f124c112790 con 0x7f124c102b10 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1251014640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f124c112a90 con 0x7f124c108da0 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1243fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f124c108450 0x7f124c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1243fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f124c108450 0x7f124c19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50952/0 (socket says 172.21.15.92:50952) 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1243fff640 1 -- 172.21.15.92:0/549632366 learned_addr learned my addr 172.21.15.92:0/549632366 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f124ad9d640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f124c102b10 0x7f124c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f124b59e640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f124c108da0 0x7f124c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1243fff640 1 -- 172.21.15.92:0/549632366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f124c108da0 msgr2=0x7f124c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1243fff640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f124c108da0 0x7f124c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1243fff640 1 -- 172.21.15.92:0/549632366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f124c102b10 msgr2=0x7f124c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1243fff640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f124c102b10 0x7f124c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1243fff640 1 -- 172.21.15.92:0/549632366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124c1a0440 con 0x7f124c108450 2024-09-21T07:13:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1243fff640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f124c108450 0x7f124c19aa70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1234005940 tx=0x7f12340040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.855+0000 7f1248d99640 1 -- 172.21.15.92:0/549632366 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123403f030 con 0x7f124c108450 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.856+0000 7f1251014640 1 -- 172.21.15.92:0/549632366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124c1a06d0 con 0x7f124c108450 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.856+0000 7f1248d99640 1 -- 172.21.15.92:0/549632366 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1234003a80 con 0x7f124c108450 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.856+0000 7f1248d99640 1 -- 172.21.15.92:0/549632366 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234035070 con 0x7f124c108450 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.856+0000 7f1251014640 1 -- 172.21.15.92:0/549632366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f124c1a6e90 con 0x7f124c108450 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.857+0000 7f1251014640 1 -- 172.21.15.92:0/549632366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f124c102f20 con 0x7f124c108450 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.858+0000 7f1248d99640 1 -- 172.21.15.92:0/549632366 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f1234042030 con 0x7f124c108450 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.859+0000 7f1248d99640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12380b6680 0x7f12380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.859+0000 7f124ad9d640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12380b6680 0x7f12380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.859+0000 7f1248d99640 1 -- 172.21.15.92:0/549632366 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f12341083e0 con 0x7f124c108450 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.860+0000 7f124ad9d640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12380b6680 0x7f12380b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f123c005d00 tx=0x7f123c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:31.862+0000 7f1248d99640 1 -- 172.21.15.92:0/549632366 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12340d2910 con 0x7f124c108450 2024-09-21T07:13:32.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.042+0000 7f1251014640 1 -- 172.21.15.92:0/549632366 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f124c063800 con 0x7f12380b6680 2024-09-21T07:13:32.044 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:31 smithi092 ceph-mon[30987]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T07:13:32.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.048+0000 7f1248d99640 1 -- 172.21.15.92:0/549632366 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340957 (secure 0 0 0) 0x7f124c063800 con 0x7f12380b6680 2024-09-21T07:13:32.053 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:32.054 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-21T07:13:32.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 -- 172.21.15.92:0/549632366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12380b6680 msgr2=0x7f12380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12380b6680 0x7f12380b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f123c005d00 tx=0x7f123c00b410 comp rx=0 tx=0).stop 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 -- 172.21.15.92:0/549632366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f124c108450 msgr2=0x7f124c19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f124c108450 0x7f124c19aa70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1234005940 tx=0x7f12340040e0 comp rx=0 tx=0).stop 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 -- 172.21.15.92:0/549632366 shutdown_connections 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f12380b6680 0x7f12380b8b90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f124c108da0 0x7f124c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f124c108450 0x7f124c19aa70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 --2- 172.21.15.92:0/549632366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f124c102b10 0x7f124c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 -- 172.21.15.92:0/549632366 >> 172.21.15.92:0/549632366 conn(0x7f124c0796d0 msgr2=0x7f124c101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 -- 172.21.15.92:0/549632366 shutdown_connections 2024-09-21T07:13:32.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:32.052+0000 7f1251014640 1 -- 172.21.15.92:0/549632366 wait complete. 2024-09-21T07:13:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:31 smithi169 ceph-mon[33705]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T07:13:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:31 smithi175 ceph-mon[34064]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T07:13:32.691 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2024-09-21T07:13:31.627533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1461657,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1598,"num_read_kb":1045,"num_write":621,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2951908,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":972,"ondisk_log_size":972,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369604,"kb_used_data":12032,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572220,"statfs":{"total":1151940427776,"available":1151561953280,"internally_reserved":0,"allocated":12320768,"data_stored":10427813,"data_compressed":574435,"data_compressed_allocated":774144,"data_compressed_original":5038080,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":794745,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":429,"num_read_kb":348,"num_write":223,"num_write_kb":2099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003411"},"pg_stats":[{"pgid":"2.1f","version":"86'14","reported_seq":170,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:26.911615+0000","last_change":"2024-09-21T07:10:51.463956+0000","last_active":"2024-09-21T07:13:26.911615+0000","last_peered":"2024-09-21T07:13:26.911615+0000","last_clean":"2024-09-21T07:13:26.911615+0000","last_became_active":"2024-09-21T07:10:51.463564+0000","last_became_peered":"2024-09-21T07:10:51.463564+0000","last_unstale":"2024-09-21T07:13:26.911615+0000","last_undegraded":"2024-09-21T07:13:26.911615+0000","last_fullsized":"2024-09-21T07:13:26.911615+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838602+0000","last_change":"2024-09-21T07:10:53.484379+0000","last_active":"2024-09-21T07:12:43.838602+0000","last_peered":"2024-09-21T07:12:43.838602+0000","last_clean":"2024-09-21T07:12:43.838602+0000","last_became_active":"2024-09-21T07:10:53.484005+0000","last_became_peered":"2024-09-21T07:10:53.484005+0000","last_unstale":"2024-09-21T07:12:43.838602+0000","last_undegraded":"2024-09-21T07:12:43.838602+0000","last_fullsized":"2024-09-21T07:12:43.838602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:27.665257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687327+0000","last_change":"2024-09-21T07:11:00.552729+0000","last_active":"2024-09-21T07:12:14.687327+0000","last_peered":"2024-09-21T07:12:14.687327+0000","last_clean":"2024-09-21T07:12:14.687327+0000","last_became_active":"2024-09-21T07:11:00.552196+0000","last_became_peered":"2024-09-21T07:11:00.552196+0000","last_unstale":"2024-09-21T07:12:14.687327+0000","last_undegraded":"2024-09-21T07:12:14.687327+0000","last_fullsized":"2024-09-21T07:12:14.687327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:35.942717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692173+0000","last_change":"2024-09-21T07:10:51.467798+0000","last_active":"2024-09-21T07:12:14.692173+0000","last_peered":"2024-09-21T07:12:14.692173+0000","last_clean":"2024-09-21T07:12:14.692173+0000","last_became_active":"2024-09-21T07:10:51.467314+0000","last_became_peered":"2024-09-21T07:10:51.467314+0000","last_unstale":"2024-09-21T07:12:14.692173+0000","last_undegraded":"2024-09-21T07:12:14.692173+0000","last_fullsized":"2024-09-21T07:12:14.692173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:21.944378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839226+0000","last_change":"2024-09-21T07:10:53.494849+0000","last_active":"2024-09-21T07:12:43.839226+0000","last_peered":"2024-09-21T07:12:43.839226+0000","last_clean":"2024-09-21T07:12:43.839226+0000","last_became_active":"2024-09-21T07:10:53.494478+0000","last_became_peered":"2024-09-21T07:10:53.494478+0000","last_unstale":"2024-09-21T07:12:43.839226+0000","last_undegraded":"2024-09-21T07:12:43.839226+0000","last_fullsized":"2024-09-21T07:12:43.839226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:38.383547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805693+0000","last_change":"2024-09-21T07:11:00.558306+0000","last_active":"2024-09-21T07:12:14.805693+0000","last_peered":"2024-09-21T07:12:14.805693+0000","last_clean":"2024-09-21T07:12:14.805693+0000","last_became_active":"2024-09-21T07:11:00.557814+0000","last_became_peered":"2024-09-21T07:11:00.557814+0000","last_unstale":"2024-09-21T07:12:14.805693+0000","last_undegraded":"2024-09-21T07:12:14.805693+0000","last_fullsized":"2024-09-21T07:12:14.805693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:31.401788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":53,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693033+0000","last_change":"2024-09-21T07:10:51.466831+0000","last_active":"2024-09-21T07:12:14.693033+0000","last_peered":"2024-09-21T07:12:14.693033+0000","last_clean":"2024-09-21T07:12:14.693033+0000","last_became_active":"2024-09-21T07:10:51.466381+0000","last_became_peered":"2024-09-21T07:10:51.466381+0000","last_unstale":"2024-09-21T07:12:14.693033+0000","last_undegraded":"2024-09-21T07:12:14.693033+0000","last_fullsized":"2024-09-21T07:12:14.693033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.559370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843617+0000","last_change":"2024-09-21T07:10:53.485920+0000","last_active":"2024-09-21T07:12:43.843617+0000","last_peered":"2024-09-21T07:12:43.843617+0000","last_clean":"2024-09-21T07:12:43.843617+0000","last_became_active":"2024-09-21T07:10:53.484689+0000","last_became_peered":"2024-09-21T07:10:53.484689+0000","last_unstale":"2024-09-21T07:12:43.843617+0000","last_undegraded":"2024-09-21T07:12:43.843617+0000","last_fullsized":"2024-09-21T07:12:43.843617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:59.951999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806409+0000","last_change":"2024-09-21T07:11:00.558298+0000","last_active":"2024-09-21T07:12:14.806409+0000","last_peered":"2024-09-21T07:12:14.806409+0000","last_clean":"2024-09-21T07:12:14.806409+0000","last_became_active":"2024-09-21T07:11:00.557738+0000","last_became_peered":"2024-09-21T07:11:00.557738+0000","last_unstale":"2024-09-21T07:12:14.806409+0000","last_undegraded":"2024-09-21T07:12:14.806409+0000","last_fullsized":"2024-09-21T07:12:14.806409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:03.037820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693169+0000","last_change":"2024-09-21T07:10:51.464283+0000","last_active":"2024-09-21T07:12:14.693169+0000","last_peered":"2024-09-21T07:12:14.693169+0000","last_clean":"2024-09-21T07:12:14.693169+0000","last_became_active":"2024-09-21T07:10:51.463783+0000","last_became_peered":"2024-09-21T07:10:51.463783+0000","last_unstale":"2024-09-21T07:12:14.693169+0000","last_undegraded":"2024-09-21T07:12:14.693169+0000","last_fullsized":"2024-09-21T07:12:14.693169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:45.298654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842942+0000","last_change":"2024-09-21T07:11:14.671020+0000","last_active":"2024-09-21T07:12:43.842942+0000","last_peered":"2024-09-21T07:12:43.842942+0000","last_clean":"2024-09-21T07:12:43.842942+0000","last_became_active":"2024-09-21T07:11:14.670573+0000","last_became_peered":"2024-09-21T07:11:14.670573+0000","last_unstale":"2024-09-21T07:12:43.842942+0000","last_undegraded":"2024-09-21T07:12:43.842942+0000","last_fullsized":"2024-09-21T07:12:43.842942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.926304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805803+0000","last_change":"2024-09-21T07:11:00.549015+0000","last_active":"2024-09-21T07:12:14.805803+0000","last_peered":"2024-09-21T07:12:14.805803+0000","last_clean":"2024-09-21T07:12:14.805803+0000","last_became_active":"2024-09-21T07:11:00.548561+0000","last_became_peered":"2024-09-21T07:11:00.548561+0000","last_unstale":"2024-09-21T07:12:14.805803+0000","last_undegraded":"2024-09-21T07:12:14.805803+0000","last_fullsized":"2024-09-21T07:12:14.805803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:08.386214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841440+0000","last_change":"2024-09-21T07:10:53.489382+0000","last_active":"2024-09-21T07:12:43.841440+0000","last_peered":"2024-09-21T07:12:43.841440+0000","last_clean":"2024-09-21T07:12:43.841440+0000","last_became_active":"2024-09-21T07:10:53.488987+0000","last_became_peered":"2024-09-21T07:10:53.488987+0000","last_unstale":"2024-09-21T07:12:43.841440+0000","last_undegraded":"2024-09-21T07:12:43.841440+0000","last_fullsized":"2024-09-21T07:12:43.841440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.334840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692508+0000","last_change":"2024-09-21T07:10:51.467203+0000","last_active":"2024-09-21T07:12:14.692508+0000","last_peered":"2024-09-21T07:12:14.692508+0000","last_clean":"2024-09-21T07:12:14.692508+0000","last_became_active":"2024-09-21T07:10:51.466737+0000","last_became_peered":"2024-09-21T07:10:51.466737+0000","last_unstale":"2024-09-21T07:12:14.692508+0000","last_undegraded":"2024-09-21T07:12:14.692508+0000","last_fullsized":"2024-09-21T07:12:14.692508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:26.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806191+0000","last_change":"2024-09-21T07:11:00.640801+0000","last_active":"2024-09-21T07:12:14.806191+0000","last_peered":"2024-09-21T07:12:14.806191+0000","last_clean":"2024-09-21T07:12:14.806191+0000","last_became_active":"2024-09-21T07:11:00.640213+0000","last_became_peered":"2024-09-21T07:11:00.640213+0000","last_unstale":"2024-09-21T07:12:14.806191+0000","last_undegraded":"2024-09-21T07:12:14.806191+0000","last_fullsized":"2024-09-21T07:12:14.806191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:55.801831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841160+0000","last_change":"2024-09-21T07:10:53.491166+0000","last_active":"2024-09-21T07:12:43.841160+0000","last_peered":"2024-09-21T07:12:43.841160+0000","last_clean":"2024-09-21T07:12:43.841160+0000","last_became_active":"2024-09-21T07:10:53.490823+0000","last_became_peered":"2024-09-21T07:10:53.490823+0000","last_unstale":"2024-09-21T07:12:43.841160+0000","last_undegraded":"2024-09-21T07:12:43.841160+0000","last_fullsized":"2024-09-21T07:12:43.841160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:48.661634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:02.728825+0000","last_change":"2024-09-21T07:10:51.461220+0000","last_active":"2024-09-21T07:13:02.728825+0000","last_peered":"2024-09-21T07:13:02.728825+0000","last_clean":"2024-09-21T07:13:02.728825+0000","last_became_active":"2024-09-21T07:10:51.460772+0000","last_became_peered":"2024-09-21T07:10:51.460772+0000","last_unstale":"2024-09-21T07:13:02.728825+0000","last_undegraded":"2024-09-21T07:13:02.728825+0000","last_fullsized":"2024-09-21T07:13:02.728825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:56.488273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806249+0000","last_change":"2024-09-21T07:11:00.558487+0000","last_active":"2024-09-21T07:12:14.806249+0000","last_peered":"2024-09-21T07:12:14.806249+0000","last_clean":"2024-09-21T07:12:14.806249+0000","last_became_active":"2024-09-21T07:11:00.557877+0000","last_became_peered":"2024-09-21T07:11:00.557877+0000","last_unstale":"2024-09-21T07:12:14.806249+0000","last_undegraded":"2024-09-21T07:12:14.806249+0000","last_fullsized":"2024-09-21T07:12:14.806249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:14.614603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840073+0000","last_change":"2024-09-21T07:10:53.489309+0000","last_active":"2024-09-21T07:12:43.840073+0000","last_peered":"2024-09-21T07:12:43.840073+0000","last_clean":"2024-09-21T07:12:43.840073+0000","last_became_active":"2024-09-21T07:10:53.488943+0000","last_became_peered":"2024-09-21T07:10:53.488943+0000","last_unstale":"2024-09-21T07:12:43.840073+0000","last_undegraded":"2024-09-21T07:12:43.840073+0000","last_fullsized":"2024-09-21T07:12:43.840073+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.797176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692071+0000","last_change":"2024-09-21T07:10:51.461078+0000","last_active":"2024-09-21T07:12:14.692071+0000","last_peered":"2024-09-21T07:12:14.692071+0000","last_clean":"2024-09-21T07:12:14.692071+0000","last_became_active":"2024-09-21T07:10:51.460759+0000","last_became_peered":"2024-09-21T07:10:51.460759+0000","last_unstale":"2024-09-21T07:12:14.692071+0000","last_undegraded":"2024-09-21T07:12:14.692071+0000","last_fullsized":"2024-09-21T07:12:14.692071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:37.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:11:00.554766+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:11:00.554374+0000","last_became_peered":"2024-09-21T07:11:00.554374+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:47.038411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825773+0000","last_change":"2024-09-21T07:10:53.487501+0000","last_active":"2024-09-21T07:12:43.825773+0000","last_peered":"2024-09-21T07:12:43.825773+0000","last_clean":"2024-09-21T07:12:43.825773+0000","last_became_active":"2024-09-21T07:10:53.487030+0000","last_became_peered":"2024-09-21T07:10:53.487030+0000","last_unstale":"2024-09-21T07:12:43.825773+0000","last_undegraded":"2024-09-21T07:12:43.825773+0000","last_fullsized":"2024-09-21T07:12:43.825773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692397+0000","last_change":"2024-09-21T07:10:51.468155+0000","last_active":"2024-09-21T07:12:14.692397+0000","last_peered":"2024-09-21T07:12:14.692397+0000","last_clean":"2024-09-21T07:12:14.692397+0000","last_became_active":"2024-09-21T07:10:51.467663+0000","last_became_peered":"2024-09-21T07:10:51.467663+0000","last_unstale":"2024-09-21T07:12:14.692397+0000","last_undegraded":"2024-09-21T07:12:14.692397+0000","last_fullsized":"2024-09-21T07:12:14.692397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:18.176519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806311+0000","last_change":"2024-09-21T07:11:00.641283+0000","last_active":"2024-09-21T07:12:14.806311+0000","last_peered":"2024-09-21T07:12:14.806311+0000","last_clean":"2024-09-21T07:12:14.806311+0000","last_became_active":"2024-09-21T07:11:00.640715+0000","last_became_peered":"2024-09-21T07:11:00.640715+0000","last_unstale":"2024-09-21T07:12:14.806311+0000","last_undegraded":"2024-09-21T07:12:14.806311+0000","last_fullsized":"2024-09-21T07:12:14.806311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:26.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842481+0000","last_change":"2024-09-21T07:11:14.656686+0000","last_active":"2024-09-21T07:12:43.842481+0000","last_peered":"2024-09-21T07:12:43.842481+0000","last_clean":"2024-09-21T07:12:43.842481+0000","last_became_active":"2024-09-21T07:11:14.656259+0000","last_became_peered":"2024-09-21T07:11:14.656259+0000","last_unstale":"2024-09-21T07:12:43.842481+0000","last_undegraded":"2024-09-21T07:12:43.842481+0000","last_fullsized":"2024-09-21T07:12:43.842481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:16.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806776+0000","last_change":"2024-09-21T07:10:52.123260+0000","last_active":"2024-09-21T07:12:14.806776+0000","last_peered":"2024-09-21T07:12:14.806776+0000","last_clean":"2024-09-21T07:12:14.806776+0000","last_became_active":"2024-09-21T07:10:52.122752+0000","last_became_peered":"2024-09-21T07:10:52.122752+0000","last_unstale":"2024-09-21T07:12:14.806776+0000","last_undegraded":"2024-09-21T07:12:14.806776+0000","last_fullsized":"2024-09-21T07:12:14.806776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.041434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686989+0000","last_change":"2024-09-21T07:11:00.549599+0000","last_active":"2024-09-21T07:12:14.686989+0000","last_peered":"2024-09-21T07:12:14.686989+0000","last_clean":"2024-09-21T07:12:14.686989+0000","last_became_active":"2024-09-21T07:11:00.549112+0000","last_became_peered":"2024-09-21T07:11:00.549112+0000","last_unstale":"2024-09-21T07:12:14.686989+0000","last_undegraded":"2024-09-21T07:12:14.686989+0000","last_fullsized":"2024-09-21T07:12:14.686989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:15.209889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.828092+0000","last_change":"2024-09-21T07:10:53.487792+0000","last_active":"2024-09-21T07:12:43.828092+0000","last_peered":"2024-09-21T07:12:43.828092+0000","last_clean":"2024-09-21T07:12:43.828092+0000","last_became_active":"2024-09-21T07:10:53.487460+0000","last_became_peered":"2024-09-21T07:10:53.487460+0000","last_unstale":"2024-09-21T07:12:43.828092+0000","last_undegraded":"2024-09-21T07:12:43.828092+0000","last_fullsized":"2024-09-21T07:12:43.828092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:26.329878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'98","reported_seq":238,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.517935+0000","last_change":"2024-09-21T07:12:14.699788+0000","last_active":"2024-09-21T07:13:27.517935+0000","last_peered":"2024-09-21T07:13:27.517935+0000","last_clean":"2024-09-21T07:13:27.517935+0000","last_became_active":"2024-09-21T07:12:14.693355+0000","last_became_peered":"2024-09-21T07:12:14.693355+0000","last_unstale":"2024-09-21T07:13:27.517935+0000","last_undegraded":"2024-09-21T07:13:27.517935+0000","last_fullsized":"2024-09-21T07:13:27.517935+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:44.104210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":282,"num_read_kb":250,"num_write":179,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691224+0000","last_change":"2024-09-21T07:11:00.640604+0000","last_active":"2024-09-21T07:12:14.691224+0000","last_peered":"2024-09-21T07:12:14.691224+0000","last_clean":"2024-09-21T07:12:14.691224+0000","last_became_active":"2024-09-21T07:11:00.640047+0000","last_became_peered":"2024-09-21T07:11:00.640047+0000","last_unstale":"2024-09-21T07:12:14.691224+0000","last_undegraded":"2024-09-21T07:12:14.691224+0000","last_fullsized":"2024-09-21T07:12:14.691224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:42.640908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834870+0000","last_change":"2024-09-21T07:10:53.473862+0000","last_active":"2024-09-21T07:12:43.834870+0000","last_peered":"2024-09-21T07:12:43.834870+0000","last_clean":"2024-09-21T07:12:43.834870+0000","last_became_active":"2024-09-21T07:10:53.473526+0000","last_became_peered":"2024-09-21T07:10:53.473526+0000","last_unstale":"2024-09-21T07:12:43.834870+0000","last_undegraded":"2024-09-21T07:12:43.834870+0000","last_fullsized":"2024-09-21T07:12:43.834870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.389566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693155+0000","last_change":"2024-09-21T07:10:51.468003+0000","last_active":"2024-09-21T07:12:14.693155+0000","last_peered":"2024-09-21T07:12:14.693155+0000","last_clean":"2024-09-21T07:12:14.693155+0000","last_became_active":"2024-09-21T07:10:51.467603+0000","last_became_peered":"2024-09-21T07:10:51.467603+0000","last_unstale":"2024-09-21T07:12:14.693155+0000","last_undegraded":"2024-09-21T07:12:14.693155+0000","last_fullsized":"2024-09-21T07:12:14.693155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:02.148721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690206+0000","last_change":"2024-09-21T07:11:00.550434+0000","last_active":"2024-09-21T07:12:14.690206+0000","last_peered":"2024-09-21T07:12:14.690206+0000","last_clean":"2024-09-21T07:12:14.690206+0000","last_became_active":"2024-09-21T07:11:00.549949+0000","last_became_peered":"2024-09-21T07:11:00.549949+0000","last_unstale":"2024-09-21T07:12:14.690206+0000","last_undegraded":"2024-09-21T07:12:14.690206+0000","last_fullsized":"2024-09-21T07:12:14.690206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:53.737978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839518+0000","last_change":"2024-09-21T07:12:14.690832+0000","last_active":"2024-09-21T07:12:43.839518+0000","last_peered":"2024-09-21T07:12:43.839518+0000","last_clean":"2024-09-21T07:12:43.839518+0000","last_became_active":"2024-09-21T07:12:14.690361+0000","last_became_peered":"2024-09-21T07:12:14.690361+0000","last_unstale":"2024-09-21T07:12:43.839518+0000","last_undegraded":"2024-09-21T07:12:43.839518+0000","last_fullsized":"2024-09-21T07:12:43.839518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:00.772213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:10:51.468201+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:10:51.467754+0000","last_became_peered":"2024-09-21T07:10:51.467754+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:52.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692198+0000","last_change":"2024-09-21T07:11:00.640653+0000","last_active":"2024-09-21T07:12:14.692198+0000","last_peered":"2024-09-21T07:12:14.692198+0000","last_clean":"2024-09-21T07:12:14.692198+0000","last_became_active":"2024-09-21T07:11:00.640080+0000","last_became_peered":"2024-09-21T07:11:00.640080+0000","last_unstale":"2024-09-21T07:12:14.692198+0000","last_undegraded":"2024-09-21T07:12:14.692198+0000","last_fullsized":"2024-09-21T07:12:14.692198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:24.124088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840328+0000","last_change":"2024-09-21T07:10:53.494222+0000","last_active":"2024-09-21T07:12:43.840328+0000","last_peered":"2024-09-21T07:12:43.840328+0000","last_clean":"2024-09-21T07:12:43.840328+0000","last_became_active":"2024-09-21T07:10:53.493703+0000","last_became_peered":"2024-09-21T07:10:53.493703+0000","last_unstale":"2024-09-21T07:12:43.840328+0000","last_undegraded":"2024-09-21T07:12:43.840328+0000","last_fullsized":"2024-09-21T07:12:43.840328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:21.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.914037+0000","last_change":"2024-09-21T07:10:51.461095+0000","last_active":"2024-09-21T07:13:27.914037+0000","last_peered":"2024-09-21T07:13:27.914037+0000","last_clean":"2024-09-21T07:13:27.914037+0000","last_became_active":"2024-09-21T07:10:51.460738+0000","last_became_peered":"2024-09-21T07:10:51.460738+0000","last_unstale":"2024-09-21T07:13:27.914037+0000","last_undegraded":"2024-09-21T07:13:27.914037+0000","last_fullsized":"2024-09-21T07:13:27.914037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:55.593391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686398+0000","last_change":"2024-09-21T07:11:00.544788+0000","last_active":"2024-09-21T07:12:14.686398+0000","last_peered":"2024-09-21T07:12:14.686398+0000","last_clean":"2024-09-21T07:12:14.686398+0000","last_became_active":"2024-09-21T07:11:00.544370+0000","last_became_peered":"2024-09-21T07:11:00.544370+0000","last_unstale":"2024-09-21T07:12:14.686398+0000","last_undegraded":"2024-09-21T07:12:14.686398+0000","last_fullsized":"2024-09-21T07:12:14.686398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.154867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839305+0000","last_change":"2024-09-21T07:10:53.486715+0000","last_active":"2024-09-21T07:12:43.839305+0000","last_peered":"2024-09-21T07:12:43.839305+0000","last_clean":"2024-09-21T07:12:43.839305+0000","last_became_active":"2024-09-21T07:10:53.486315+0000","last_became_peered":"2024-09-21T07:10:53.486315+0000","last_unstale":"2024-09-21T07:12:43.839305+0000","last_undegraded":"2024-09-21T07:12:43.839305+0000","last_fullsized":"2024-09-21T07:12:43.839305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:00.124269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'7","reported_seq":166,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:29.931449+0000","last_change":"2024-09-21T07:10:51.467102+0000","last_active":"2024-09-21T07:13:29.931449+0000","last_peered":"2024-09-21T07:13:29.931449+0000","last_clean":"2024-09-21T07:13:29.931449+0000","last_became_active":"2024-09-21T07:10:51.466721+0000","last_became_peered":"2024-09-21T07:10:51.466721+0000","last_unstale":"2024-09-21T07:13:29.931449+0000","last_undegraded":"2024-09-21T07:13:29.931449+0000","last_fullsized":"2024-09-21T07:13:29.931449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686198+0000","last_change":"2024-09-21T07:11:00.640622+0000","last_active":"2024-09-21T07:12:14.686198+0000","last_peered":"2024-09-21T07:12:14.686198+0000","last_clean":"2024-09-21T07:12:14.686198+0000","last_became_active":"2024-09-21T07:11:00.640104+0000","last_became_peered":"2024-09-21T07:11:00.640104+0000","last_unstale":"2024-09-21T07:12:14.686198+0000","last_undegraded":"2024-09-21T07:12:14.686198+0000","last_fullsized":"2024-09-21T07:12:14.686198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:12.023561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825104+0000","last_change":"2024-09-21T07:10:53.478175+0000","last_active":"2024-09-21T07:12:43.825104+0000","last_peered":"2024-09-21T07:12:43.825104+0000","last_clean":"2024-09-21T07:12:43.825104+0000","last_became_active":"2024-09-21T07:10:53.477831+0000","last_became_peered":"2024-09-21T07:10:53.477831+0000","last_unstale":"2024-09-21T07:12:43.825104+0000","last_undegraded":"2024-09-21T07:12:43.825104+0000","last_fullsized":"2024-09-21T07:12:43.825104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:27.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689665+0000","last_change":"2024-09-21T07:10:51.466318+0000","last_active":"2024-09-21T07:12:14.689665+0000","last_peered":"2024-09-21T07:12:14.689665+0000","last_clean":"2024-09-21T07:12:14.689665+0000","last_became_active":"2024-09-21T07:10:51.465983+0000","last_became_peered":"2024-09-21T07:10:51.465983+0000","last_unstale":"2024-09-21T07:12:14.689665+0000","last_undegraded":"2024-09-21T07:12:14.689665+0000","last_fullsized":"2024-09-21T07:12:14.689665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:08.432949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691834+0000","last_change":"2024-09-21T07:11:00.641364+0000","last_active":"2024-09-21T07:12:14.691834+0000","last_peered":"2024-09-21T07:12:14.691834+0000","last_clean":"2024-09-21T07:12:14.691834+0000","last_became_active":"2024-09-21T07:11:00.640879+0000","last_became_peered":"2024-09-21T07:11:00.640879+0000","last_unstale":"2024-09-21T07:12:14.691834+0000","last_undegraded":"2024-09-21T07:12:14.691834+0000","last_fullsized":"2024-09-21T07:12:14.691834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:16.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825148+0000","last_change":"2024-09-21T07:10:53.483709+0000","last_active":"2024-09-21T07:12:43.825148+0000","last_peered":"2024-09-21T07:12:43.825148+0000","last_clean":"2024-09-21T07:12:43.825148+0000","last_became_active":"2024-09-21T07:10:53.483355+0000","last_became_peered":"2024-09-21T07:10:53.483355+0000","last_unstale":"2024-09-21T07:12:43.825148+0000","last_undegraded":"2024-09-21T07:12:43.825148+0000","last_fullsized":"2024-09-21T07:12:43.825148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.702168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806593+0000","last_change":"2024-09-21T07:10:51.464239+0000","last_active":"2024-09-21T07:12:14.806593+0000","last_peered":"2024-09-21T07:12:14.806593+0000","last_clean":"2024-09-21T07:12:14.806593+0000","last_became_active":"2024-09-21T07:10:51.463828+0000","last_became_peered":"2024-09-21T07:10:51.463828+0000","last_unstale":"2024-09-21T07:12:14.806593+0000","last_undegraded":"2024-09-21T07:12:14.806593+0000","last_fullsized":"2024-09-21T07:12:14.806593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:09.580668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690229+0000","last_change":"2024-09-21T07:09:39.332523+0000","last_active":"2024-09-21T07:12:14.690229+0000","last_peered":"2024-09-21T07:12:14.690229+0000","last_clean":"2024-09-21T07:12:14.690229+0000","last_became_active":"2024-09-21T07:09:39.326582+0000","last_became_peered":"2024-09-21T07:09:39.326582+0000","last_unstale":"2024-09-21T07:12:14.690229+0000","last_undegraded":"2024-09-21T07:12:14.690229+0000","last_fullsized":"2024-09-21T07:12:14.690229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_clean_scrub_stamp":"2024-09-21T07:06:12.748818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690079+0000","last_change":"2024-09-21T07:11:14.672044+0000","last_active":"2024-09-21T07:12:14.690079+0000","last_peered":"2024-09-21T07:12:14.690079+0000","last_clean":"2024-09-21T07:12:14.690079+0000","last_became_active":"2024-09-21T07:11:14.671513+0000","last_became_peered":"2024-09-21T07:11:14.671513+0000","last_unstale":"2024-09-21T07:12:14.690079+0000","last_undegraded":"2024-09-21T07:12:14.690079+0000","last_fullsized":"2024-09-21T07:12:14.690079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:09.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842250+0000","last_change":"2024-09-21T07:10:53.488678+0000","last_active":"2024-09-21T07:12:43.842250+0000","last_peered":"2024-09-21T07:12:43.842250+0000","last_clean":"2024-09-21T07:12:43.842250+0000","last_became_active":"2024-09-21T07:10:53.488304+0000","last_became_peered":"2024-09-21T07:10:53.488304+0000","last_unstale":"2024-09-21T07:12:43.842250+0000","last_undegraded":"2024-09-21T07:12:43.842250+0000","last_fullsized":"2024-09-21T07:12:43.842250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:37.696269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:25.927387+0000","last_change":"2024-09-21T07:10:52.123086+0000","last_active":"2024-09-21T07:13:25.927387+0000","last_peered":"2024-09-21T07:13:25.927387+0000","last_clean":"2024-09-21T07:13:25.927387+0000","last_became_active":"2024-09-21T07:10:52.122584+0000","last_became_peered":"2024-09-21T07:10:52.122584+0000","last_unstale":"2024-09-21T07:13:25.927387+0000","last_undegraded":"2024-09-21T07:13:25.927387+0000","last_fullsized":"2024-09-21T07:13:25.927387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:28.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692332+0000","last_change":"2024-09-21T07:11:00.549595+0000","last_active":"2024-09-21T07:12:14.692332+0000","last_peered":"2024-09-21T07:12:14.692332+0000","last_clean":"2024-09-21T07:12:14.692332+0000","last_became_active":"2024-09-21T07:11:00.549009+0000","last_became_peered":"2024-09-21T07:11:00.549009+0000","last_unstale":"2024-09-21T07:12:14.692332+0000","last_undegraded":"2024-09-21T07:12:14.692332+0000","last_fullsized":"2024-09-21T07:12:14.692332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:59.825381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836215+0000","last_change":"2024-09-21T07:10:53.484336+0000","last_active":"2024-09-21T07:12:43.836215+0000","last_peered":"2024-09-21T07:12:43.836215+0000","last_clean":"2024-09-21T07:12:43.836215+0000","last_became_active":"2024-09-21T07:10:53.483825+0000","last_became_peered":"2024-09-21T07:10:53.483825+0000","last_unstale":"2024-09-21T07:12:43.836215+0000","last_undegraded":"2024-09-21T07:12:43.836215+0000","last_fullsized":"2024-09-21T07:12:43.836215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.545339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'62","reported_seq":132,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.871180+0000","last_change":"2024-09-21T07:10:51.461297+0000","last_active":"2024-09-21T07:13:27.871180+0000","last_peered":"2024-09-21T07:13:27.871180+0000","last_clean":"2024-09-21T07:13:27.871180+0000","last_became_active":"2024-09-21T07:10:51.460600+0000","last_became_peered":"2024-09-21T07:10:51.460600+0000","last_unstale":"2024-09-21T07:13:27.871180+0000","last_undegraded":"2024-09-21T07:13:27.871180+0000","last_fullsized":"2024-09-21T07:13:27.871180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:34.955250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998589+0000","last_change":"2024-09-21T07:11:00.551652+0000","last_active":"2024-09-21T07:12:14.998589+0000","last_peered":"2024-09-21T07:12:14.998589+0000","last_clean":"2024-09-21T07:12:14.998589+0000","last_became_active":"2024-09-21T07:11:00.551236+0000","last_became_peered":"2024-09-21T07:11:00.551236+0000","last_unstale":"2024-09-21T07:12:14.998589+0000","last_undegraded":"2024-09-21T07:12:14.998589+0000","last_fullsized":"2024-09-21T07:12:14.998589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:28.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833526+0000","last_change":"2024-09-21T07:10:53.487605+0000","last_active":"2024-09-21T07:12:43.833526+0000","last_peered":"2024-09-21T07:12:43.833526+0000","last_clean":"2024-09-21T07:12:43.833526+0000","last_became_active":"2024-09-21T07:10:53.487245+0000","last_became_peered":"2024-09-21T07:10:53.487245+0000","last_unstale":"2024-09-21T07:12:43.833526+0000","last_undegraded":"2024-09-21T07:12:43.833526+0000","last_fullsized":"2024-09-21T07:12:43.833526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:24.490652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686405+0000","last_change":"2024-09-21T07:10:51.456920+0000","last_active":"2024-09-21T07:12:14.686405+0000","last_peered":"2024-09-21T07:12:14.686405+0000","last_clean":"2024-09-21T07:12:14.686405+0000","last_became_active":"2024-09-21T07:10:51.456500+0000","last_became_peered":"2024-09-21T07:10:51.456500+0000","last_unstale":"2024-09-21T07:12:14.686405+0000","last_undegraded":"2024-09-21T07:12:14.686405+0000","last_fullsized":"2024-09-21T07:12:14.686405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:07.663192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690452+0000","last_change":"2024-09-21T07:11:00.552115+0000","last_active":"2024-09-21T07:12:14.690452+0000","last_peered":"2024-09-21T07:12:14.690452+0000","last_clean":"2024-09-21T07:12:14.690452+0000","last_became_active":"2024-09-21T07:11:00.551647+0000","last_became_peered":"2024-09-21T07:11:00.551647+0000","last_unstale":"2024-09-21T07:12:14.690452+0000","last_undegraded":"2024-09-21T07:12:14.690452+0000","last_fullsized":"2024-09-21T07:12:14.690452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:13.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834739+0000","last_change":"2024-09-21T07:11:14.671714+0000","last_active":"2024-09-21T07:12:43.834739+0000","last_peered":"2024-09-21T07:12:43.834739+0000","last_clean":"2024-09-21T07:12:43.834739+0000","last_became_active":"2024-09-21T07:11:14.671248+0000","last_became_peered":"2024-09-21T07:11:14.671248+0000","last_unstale":"2024-09-21T07:12:43.834739+0000","last_undegraded":"2024-09-21T07:12:43.834739+0000","last_fullsized":"2024-09-21T07:12:43.834739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:36.599916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.725429+0000","last_change":"2024-09-21T07:10:51.464710+0000","last_active":"2024-09-21T07:13:16.725429+0000","last_peered":"2024-09-21T07:13:16.725429+0000","last_clean":"2024-09-21T07:13:16.725429+0000","last_became_active":"2024-09-21T07:10:51.464295+0000","last_became_peered":"2024-09-21T07:10:51.464295+0000","last_unstale":"2024-09-21T07:13:16.725429+0000","last_undegraded":"2024-09-21T07:13:16.725429+0000","last_fullsized":"2024-09-21T07:13:16.725429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:00.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691150+0000","last_change":"2024-09-21T07:11:00.548275+0000","last_active":"2024-09-21T07:12:14.691150+0000","last_peered":"2024-09-21T07:12:14.691150+0000","last_clean":"2024-09-21T07:12:14.691150+0000","last_became_active":"2024-09-21T07:11:00.547777+0000","last_became_peered":"2024-09-21T07:11:00.547777+0000","last_unstale":"2024-09-21T07:12:14.691150+0000","last_undegraded":"2024-09-21T07:12:14.691150+0000","last_fullsized":"2024-09-21T07:12:14.691150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:13.860131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840327+0000","last_change":"2024-09-21T07:10:53.494072+0000","last_active":"2024-09-21T07:12:43.840327+0000","last_peered":"2024-09-21T07:12:43.840327+0000","last_clean":"2024-09-21T07:12:43.840327+0000","last_became_active":"2024-09-21T07:10:53.493493+0000","last_became_peered":"2024-09-21T07:10:53.493493+0000","last_unstale":"2024-09-21T07:12:43.840327+0000","last_undegraded":"2024-09-21T07:12:43.840327+0000","last_fullsized":"2024-09-21T07:12:43.840327+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.846641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":58,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692149+0000","last_change":"2024-09-21T07:10:51.468145+0000","last_active":"2024-09-21T07:12:14.692149+0000","last_peered":"2024-09-21T07:12:14.692149+0000","last_clean":"2024-09-21T07:12:14.692149+0000","last_became_active":"2024-09-21T07:10:51.467757+0000","last_became_peered":"2024-09-21T07:10:51.467757+0000","last_unstale":"2024-09-21T07:12:14.692149+0000","last_undegraded":"2024-09-21T07:12:14.692149+0000","last_fullsized":"2024-09-21T07:12:14.692149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:39.150277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686272+0000","last_change":"2024-09-21T07:11:00.548394+0000","last_active":"2024-09-21T07:12:14.686272+0000","last_peered":"2024-09-21T07:12:14.686272+0000","last_clean":"2024-09-21T07:12:14.686272+0000","last_became_active":"2024-09-21T07:11:00.547972+0000","last_became_peered":"2024-09-21T07:11:00.547972+0000","last_unstale":"2024-09-21T07:12:14.686272+0000","last_undegraded":"2024-09-21T07:12:14.686272+0000","last_fullsized":"2024-09-21T07:12:14.686272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:35.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.819250+0000","last_change":"2024-09-21T07:11:14.659248+0000","last_active":"2024-09-21T07:12:43.819250+0000","last_peered":"2024-09-21T07:12:43.819250+0000","last_clean":"2024-09-21T07:12:43.819250+0000","last_became_active":"2024-09-21T07:11:14.658931+0000","last_became_peered":"2024-09-21T07:11:14.658931+0000","last_unstale":"2024-09-21T07:12:43.819250+0000","last_undegraded":"2024-09-21T07:12:43.819250+0000","last_fullsized":"2024-09-21T07:12:43.819250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:12.278964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'9","reported_seq":171,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.929539+0000","last_change":"2024-09-21T07:10:51.466302+0000","last_active":"2024-09-21T07:13:27.929539+0000","last_peered":"2024-09-21T07:13:27.929539+0000","last_clean":"2024-09-21T07:13:27.929539+0000","last_became_active":"2024-09-21T07:10:51.465906+0000","last_became_peered":"2024-09-21T07:10:51.465906+0000","last_unstale":"2024-09-21T07:13:27.929539+0000","last_undegraded":"2024-09-21T07:13:27.929539+0000","last_fullsized":"2024-09-21T07:13:27.929539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:39.616338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":7,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689541+0000","last_change":"2024-09-21T07:11:00.555600+0000","last_active":"2024-09-21T07:12:14.689541+0000","last_peered":"2024-09-21T07:12:14.689541+0000","last_clean":"2024-09-21T07:12:14.689541+0000","last_became_active":"2024-09-21T07:11:00.555203+0000","last_became_peered":"2024-09-21T07:11:00.555203+0000","last_unstale":"2024-09-21T07:12:14.689541+0000","last_undegraded":"2024-09-21T07:12:14.689541+0000","last_fullsized":"2024-09-21T07:12:14.689541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838290+0000","last_change":"2024-09-21T07:10:53.482493+0000","last_active":"2024-09-21T07:12:43.838290+0000","last_peered":"2024-09-21T07:12:43.838290+0000","last_clean":"2024-09-21T07:12:43.838290+0000","last_became_active":"2024-09-21T07:10:53.481310+0000","last_became_peered":"2024-09-21T07:10:53.481310+0000","last_unstale":"2024-09-21T07:12:43.838290+0000","last_undegraded":"2024-09-21T07:12:43.838290+0000","last_fullsized":"2024-09-21T07:12:43.838290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:41.288008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691304+0000","last_change":"2024-09-21T07:10:51.468189+0000","last_active":"2024-09-21T07:12:14.691304+0000","last_peered":"2024-09-21T07:12:14.691304+0000","last_clean":"2024-09-21T07:12:14.691304+0000","last_became_active":"2024-09-21T07:10:51.467770+0000","last_became_peered":"2024-09-21T07:10:51.467770+0000","last_unstale":"2024-09-21T07:12:14.691304+0000","last_undegraded":"2024-09-21T07:12:14.691304+0000","last_fullsized":"2024-09-21T07:12:14.691304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:53.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689382+0000","last_change":"2024-09-21T07:11:00.556306+0000","last_active":"2024-09-21T07:12:14.689382+0000","last_peered":"2024-09-21T07:12:14.689382+0000","last_clean":"2024-09-21T07:12:14.689382+0000","last_became_active":"2024-09-21T07:11:00.555770+0000","last_became_peered":"2024-09-21T07:11:00.555770+0000","last_unstale":"2024-09-21T07:12:14.689382+0000","last_undegraded":"2024-09-21T07:12:14.689382+0000","last_fullsized":"2024-09-21T07:12:14.689382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:19.438869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839202+0000","last_change":"2024-09-21T07:10:53.485039+0000","last_active":"2024-09-21T07:12:43.839202+0000","last_peered":"2024-09-21T07:12:43.839202+0000","last_clean":"2024-09-21T07:12:43.839202+0000","last_became_active":"2024-09-21T07:10:53.484672+0000","last_became_peered":"2024-09-21T07:10:53.484672+0000","last_unstale":"2024-09-21T07:12:43.839202+0000","last_undegraded":"2024-09-21T07:12:43.839202+0000","last_fullsized":"2024-09-21T07:12:43.839202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:28.291602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.709692+0000","last_change":"2024-09-21T07:12:14.709213+0000","last_active":"2024-09-21T07:12:14.709692+0000","last_peered":"2024-09-21T07:12:14.709692+0000","last_clean":"2024-09-21T07:12:14.709692+0000","last_became_active":"2024-09-21T07:12:14.693406+0000","last_became_peered":"2024-09-21T07:12:14.693406+0000","last_unstale":"2024-09-21T07:12:14.709692+0000","last_undegraded":"2024-09-21T07:12:14.709692+0000","last_fullsized":"2024-09-21T07:12:14.709692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:25.204575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687428+0000","last_change":"2024-09-21T07:11:14.672269+0000","last_active":"2024-09-21T07:12:14.687428+0000","last_peered":"2024-09-21T07:12:14.687428+0000","last_clean":"2024-09-21T07:12:14.687428+0000","last_became_active":"2024-09-21T07:11:14.671740+0000","last_became_peered":"2024-09-21T07:11:14.671740+0000","last_unstale":"2024-09-21T07:12:14.687428+0000","last_undegraded":"2024-09-21T07:12:14.687428+0000","last_fullsized":"2024-09-21T07:12:14.687428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.600585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831681+0000","last_change":"2024-09-21T07:10:53.487667+0000","last_active":"2024-09-21T07:12:43.831681+0000","last_peered":"2024-09-21T07:12:43.831681+0000","last_clean":"2024-09-21T07:12:43.831681+0000","last_became_active":"2024-09-21T07:10:53.487316+0000","last_became_peered":"2024-09-21T07:10:53.487316+0000","last_unstale":"2024-09-21T07:12:43.831681+0000","last_undegraded":"2024-09-21T07:12:43.831681+0000","last_fullsized":"2024-09-21T07:12:43.831681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:33.545631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'41","reported_seq":321,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:26.912188+0000","last_change":"2024-09-21T07:10:51.465172+0000","last_active":"2024-09-21T07:13:26.912188+0000","last_peered":"2024-09-21T07:13:26.912188+0000","last_clean":"2024-09-21T07:13:26.912188+0000","last_became_active":"2024-09-21T07:10:51.464655+0000","last_became_peered":"2024-09-21T07:10:51.464655+0000","last_unstale":"2024-09-21T07:13:26.912188+0000","last_undegraded":"2024-09-21T07:13:26.912188+0000","last_fullsized":"2024-09-21T07:13:26.912188+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:02.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74214,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":241,"num_read_kb":195,"num_write":43,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686973+0000","last_change":"2024-09-21T07:11:14.671892+0000","last_active":"2024-09-21T07:12:14.686973+0000","last_peered":"2024-09-21T07:12:14.686973+0000","last_clean":"2024-09-21T07:12:14.686973+0000","last_became_active":"2024-09-21T07:11:14.671283+0000","last_became_peered":"2024-09-21T07:11:14.671283+0000","last_unstale":"2024-09-21T07:12:14.686973+0000","last_undegraded":"2024-09-21T07:12:14.686973+0000","last_fullsized":"2024-09-21T07:12:14.686973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:54.263127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839267+0000","last_change":"2024-09-21T07:10:53.491873+0000","last_active":"2024-09-21T07:12:43.839267+0000","last_peered":"2024-09-21T07:12:43.839267+0000","last_clean":"2024-09-21T07:12:43.839267+0000","last_became_active":"2024-09-21T07:10:53.491424+0000","last_became_peered":"2024-09-21T07:10:53.491424+0000","last_unstale":"2024-09-21T07:12:43.839267+0000","last_undegraded":"2024-09-21T07:12:43.839267+0000","last_fullsized":"2024-09-21T07:12:43.839267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.145391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691247+0000","last_change":"2024-09-21T07:10:51.469395+0000","last_active":"2024-09-21T07:12:14.691247+0000","last_peered":"2024-09-21T07:12:14.691247+0000","last_clean":"2024-09-21T07:12:14.691247+0000","last_became_active":"2024-09-21T07:10:51.469015+0000","last_became_peered":"2024-09-21T07:10:51.469015+0000","last_unstale":"2024-09-21T07:12:14.691247+0000","last_undegraded":"2024-09-21T07:12:14.691247+0000","last_fullsized":"2024-09-21T07:12:14.691247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.274950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806089+0000","last_change":"2024-09-21T07:11:00.553164+0000","last_active":"2024-09-21T07:12:14.806089+0000","last_peered":"2024-09-21T07:12:14.806089+0000","last_clean":"2024-09-21T07:12:14.806089+0000","last_became_active":"2024-09-21T07:11:00.551969+0000","last_became_peered":"2024-09-21T07:11:00.551969+0000","last_unstale":"2024-09-21T07:12:14.806089+0000","last_undegraded":"2024-09-21T07:12:14.806089+0000","last_fullsized":"2024-09-21T07:12:14.806089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:53.042065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842195+0000","last_change":"2024-09-21T07:10:53.497110+0000","last_active":"2024-09-21T07:12:43.842195+0000","last_peered":"2024-09-21T07:12:43.842195+0000","last_clean":"2024-09-21T07:12:43.842195+0000","last_became_active":"2024-09-21T07:10:53.496751+0000","last_became_peered":"2024-09-21T07:10:53.496751+0000","last_unstale":"2024-09-21T07:12:43.842195+0000","last_undegraded":"2024-09-21T07:12:43.842195+0000","last_fullsized":"2024-09-21T07:12:43.842195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.531652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.812563+0000","last_change":"2024-09-21T07:12:14.811962+0000","last_active":"2024-09-21T07:12:14.812563+0000","last_peered":"2024-09-21T07:12:14.812563+0000","last_clean":"2024-09-21T07:12:14.812563+0000","last_became_active":"2024-09-21T07:12:14.807745+0000","last_became_peered":"2024-09-21T07:12:14.807745+0000","last_unstale":"2024-09-21T07:12:14.812563+0000","last_undegraded":"2024-09-21T07:12:14.812563+0000","last_fullsized":"2024-09-21T07:12:14.812563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:20.292633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691946+0000","last_change":"2024-09-21T07:11:14.655255+0000","last_active":"2024-09-21T07:12:14.691946+0000","last_peered":"2024-09-21T07:12:14.691946+0000","last_clean":"2024-09-21T07:12:14.691946+0000","last_became_active":"2024-09-21T07:11:14.654556+0000","last_became_peered":"2024-09-21T07:11:14.654556+0000","last_unstale":"2024-09-21T07:12:14.691946+0000","last_undegraded":"2024-09-21T07:12:14.691946+0000","last_fullsized":"2024-09-21T07:12:14.691946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:44.435834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843700+0000","last_change":"2024-09-21T07:10:53.484990+0000","last_active":"2024-09-21T07:12:43.843700+0000","last_peered":"2024-09-21T07:12:43.843700+0000","last_clean":"2024-09-21T07:12:43.843700+0000","last_became_active":"2024-09-21T07:10:53.484570+0000","last_became_peered":"2024-09-21T07:10:53.484570+0000","last_unstale":"2024-09-21T07:12:43.843700+0000","last_undegraded":"2024-09-21T07:12:43.843700+0000","last_fullsized":"2024-09-21T07:12:43.843700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:28.848203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":274,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:26.911651+0000","last_change":"2024-09-21T07:10:51.463378+0000","last_active":"2024-09-21T07:13:26.911651+0000","last_peered":"2024-09-21T07:13:26.911651+0000","last_clean":"2024-09-21T07:13:26.911651+0000","last_became_active":"2024-09-21T07:10:51.462961+0000","last_became_peered":"2024-09-21T07:10:51.462961+0000","last_unstale":"2024-09-21T07:13:26.911651+0000","last_undegraded":"2024-09-21T07:13:26.911651+0000","last_fullsized":"2024-09-21T07:13:26.911651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:22.637603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691393+0000","last_change":"2024-09-21T07:11:00.549758+0000","last_active":"2024-09-21T07:12:14.691393+0000","last_peered":"2024-09-21T07:12:14.691393+0000","last_clean":"2024-09-21T07:12:14.691393+0000","last_became_active":"2024-09-21T07:11:00.549141+0000","last_became_peered":"2024-09-21T07:11:00.549141+0000","last_unstale":"2024-09-21T07:12:14.691393+0000","last_undegraded":"2024-09-21T07:12:14.691393+0000","last_fullsized":"2024-09-21T07:12:14.691393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:27.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998447+0000","last_change":"2024-09-21T07:11:00.550407+0000","last_active":"2024-09-21T07:12:14.998447+0000","last_peered":"2024-09-21T07:12:14.998447+0000","last_clean":"2024-09-21T07:12:14.998447+0000","last_became_active":"2024-09-21T07:11:00.549930+0000","last_became_peered":"2024-09-21T07:11:00.549930+0000","last_unstale":"2024-09-21T07:12:14.998447+0000","last_undegraded":"2024-09-21T07:12:14.998447+0000","last_fullsized":"2024-09-21T07:12:14.998447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:25.924695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841002+0000","last_change":"2024-09-21T07:10:53.491452+0000","last_active":"2024-09-21T07:12:43.841002+0000","last_peered":"2024-09-21T07:12:43.841002+0000","last_clean":"2024-09-21T07:12:43.841002+0000","last_became_active":"2024-09-21T07:10:53.491106+0000","last_became_peered":"2024-09-21T07:10:53.491106+0000","last_unstale":"2024-09-21T07:12:43.841002+0000","last_undegraded":"2024-09-21T07:12:43.841002+0000","last_fullsized":"2024-09-21T07:12:43.841002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:58.270323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690834+0000","last_change":"2024-09-21T07:10:51.468433+0000","last_active":"2024-09-21T07:12:14.690834+0000","last_peered":"2024-09-21T07:12:14.690834+0000","last_clean":"2024-09-21T07:12:14.690834+0000","last_became_active":"2024-09-21T07:10:51.467810+0000","last_became_peered":"2024-09-21T07:10:51.467810+0000","last_unstale":"2024-09-21T07:12:14.690834+0000","last_undegraded":"2024-09-21T07:12:14.690834+0000","last_fullsized":"2024-09-21T07:12:14.690834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.787584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689774+0000","last_change":"2024-09-21T07:11:00.556866+0000","last_active":"2024-09-21T07:12:14.689774+0000","last_peered":"2024-09-21T07:12:14.689774+0000","last_clean":"2024-09-21T07:12:14.689774+0000","last_became_active":"2024-09-21T07:11:00.555350+0000","last_became_peered":"2024-09-21T07:11:00.555350+0000","last_unstale":"2024-09-21T07:12:14.689774+0000","last_undegraded":"2024-09-21T07:12:14.689774+0000","last_fullsized":"2024-09-21T07:12:14.689774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:46.296771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830636+0000","last_change":"2024-09-21T07:10:53.487210+0000","last_active":"2024-09-21T07:12:43.830636+0000","last_peered":"2024-09-21T07:12:43.830636+0000","last_clean":"2024-09-21T07:12:43.830636+0000","last_became_active":"2024-09-21T07:10:53.485975+0000","last_became_peered":"2024-09-21T07:10:53.485975+0000","last_unstale":"2024-09-21T07:12:43.830636+0000","last_undegraded":"2024-09-21T07:12:43.830636+0000","last_fullsized":"2024-09-21T07:12:43.830636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.685994+0000","last_change":"2024-09-21T07:10:51.456418+0000","last_active":"2024-09-21T07:12:14.685994+0000","last_peered":"2024-09-21T07:12:14.685994+0000","last_clean":"2024-09-21T07:12:14.685994+0000","last_became_active":"2024-09-21T07:10:51.455885+0000","last_became_peered":"2024-09-21T07:10:51.455885+0000","last_unstale":"2024-09-21T07:12:14.685994+0000","last_undegraded":"2024-09-21T07:12:14.685994+0000","last_fullsized":"2024-09-21T07:12:14.685994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:53.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687514+0000","last_change":"2024-09-21T07:10:51.462544+0000","last_active":"2024-09-21T07:12:14.687514+0000","last_peered":"2024-09-21T07:12:14.687514+0000","last_clean":"2024-09-21T07:12:14.687514+0000","last_became_active":"2024-09-21T07:10:51.462075+0000","last_became_peered":"2024-09-21T07:10:51.462075+0000","last_unstale":"2024-09-21T07:12:14.687514+0000","last_undegraded":"2024-09-21T07:12:14.687514+0000","last_fullsized":"2024-09-21T07:12:14.687514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:09.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839085+0000","last_change":"2024-09-21T07:12:14.694814+0000","last_active":"2024-09-21T07:12:43.839085+0000","last_peered":"2024-09-21T07:12:43.839085+0000","last_clean":"2024-09-21T07:12:43.839085+0000","last_became_active":"2024-09-21T07:12:14.694334+0000","last_became_peered":"2024-09-21T07:12:14.694334+0000","last_unstale":"2024-09-21T07:12:43.839085+0000","last_undegraded":"2024-09-21T07:12:43.839085+0000","last_fullsized":"2024-09-21T07:12:43.839085+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:33.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687029+0000","last_change":"2024-09-21T07:11:00.552908+0000","last_active":"2024-09-21T07:12:14.687029+0000","last_peered":"2024-09-21T07:12:14.687029+0000","last_clean":"2024-09-21T07:12:14.687029+0000","last_became_active":"2024-09-21T07:11:00.552303+0000","last_became_peered":"2024-09-21T07:11:00.552303+0000","last_unstale":"2024-09-21T07:12:14.687029+0000","last_undegraded":"2024-09-21T07:12:14.687029+0000","last_fullsized":"2024-09-21T07:12:14.687029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'8","reported_seq":169,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.914322+0000","last_change":"2024-09-21T07:10:51.467072+0000","last_active":"2024-09-21T07:13:27.914322+0000","last_peered":"2024-09-21T07:13:27.914322+0000","last_clean":"2024-09-21T07:13:27.914322+0000","last_became_active":"2024-09-21T07:10:51.466671+0000","last_became_peered":"2024-09-21T07:10:51.466671+0000","last_unstale":"2024-09-21T07:13:27.914322+0000","last_undegraded":"2024-09-21T07:13:27.914322+0000","last_fullsized":"2024-09-21T07:13:27.914322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:24.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833933+0000","last_change":"2024-09-21T07:10:53.480057+0000","last_active":"2024-09-21T07:12:43.833933+0000","last_peered":"2024-09-21T07:12:43.833933+0000","last_clean":"2024-09-21T07:12:43.833933+0000","last_became_active":"2024-09-21T07:10:53.479644+0000","last_became_peered":"2024-09-21T07:10:53.479644+0000","last_unstale":"2024-09-21T07:12:43.833933+0000","last_undegraded":"2024-09-21T07:12:43.833933+0000","last_fullsized":"2024-09-21T07:12:43.833933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:34.255547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687321+0000","last_change":"2024-09-21T07:11:00.550259+0000","last_active":"2024-09-21T07:12:14.687321+0000","last_peered":"2024-09-21T07:12:14.687321+0000","last_clean":"2024-09-21T07:12:14.687321+0000","last_became_active":"2024-09-21T07:11:00.549771+0000","last_became_peered":"2024-09-21T07:11:00.549771+0000","last_unstale":"2024-09-21T07:12:14.687321+0000","last_undegraded":"2024-09-21T07:12:14.687321+0000","last_fullsized":"2024-09-21T07:12:14.687321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839385+0000","last_change":"2024-09-21T07:10:53.488022+0000","last_active":"2024-09-21T07:12:43.839385+0000","last_peered":"2024-09-21T07:12:43.839385+0000","last_clean":"2024-09-21T07:12:43.839385+0000","last_became_active":"2024-09-21T07:10:53.487605+0000","last_became_peered":"2024-09-21T07:10:53.487605+0000","last_unstale":"2024-09-21T07:12:43.839385+0000","last_undegraded":"2024-09-21T07:12:43.839385+0000","last_fullsized":"2024-09-21T07:12:43.839385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:02.074960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833306+0000","last_change":"2024-09-21T07:10:53.484319+0000","last_active":"2024-09-21T07:12:43.833306+0000","last_peered":"2024-09-21T07:12:43.833306+0000","last_clean":"2024-09-21T07:12:43.833306+0000","last_became_active":"2024-09-21T07:10:53.483942+0000","last_became_peered":"2024-09-21T07:10:53.483942+0000","last_unstale":"2024-09-21T07:12:43.833306+0000","last_undegraded":"2024-09-21T07:12:43.833306+0000","last_fullsized":"2024-09-21T07:12:43.833306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:50.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840566+0000","last_change":"2024-09-21T07:10:53.494981+0000","last_active":"2024-09-21T07:12:43.840566+0000","last_peered":"2024-09-21T07:12:43.840566+0000","last_clean":"2024-09-21T07:12:43.840566+0000","last_became_active":"2024-09-21T07:10:53.494580+0000","last_became_peered":"2024-09-21T07:10:53.494580+0000","last_unstale":"2024-09-21T07:12:43.840566+0000","last_undegraded":"2024-09-21T07:12:43.840566+0000","last_fullsized":"2024-09-21T07:12:43.840566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:57.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842588+0000","last_change":"2024-09-21T07:10:53.492971+0000","last_active":"2024-09-21T07:12:43.842588+0000","last_peered":"2024-09-21T07:12:43.842588+0000","last_clean":"2024-09-21T07:12:43.842588+0000","last_became_active":"2024-09-21T07:10:53.492597+0000","last_became_peered":"2024-09-21T07:10:53.492597+0000","last_unstale":"2024-09-21T07:12:43.842588+0000","last_undegraded":"2024-09-21T07:12:43.842588+0000","last_fullsized":"2024-09-21T07:12:43.842588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.931998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836994+0000","last_change":"2024-09-21T07:10:53.485613+0000","last_active":"2024-09-21T07:12:43.836994+0000","last_peered":"2024-09-21T07:12:43.836994+0000","last_clean":"2024-09-21T07:12:43.836994+0000","last_became_active":"2024-09-21T07:10:53.485268+0000","last_became_peered":"2024-09-21T07:10:53.485268+0000","last_unstale":"2024-09-21T07:12:43.836994+0000","last_undegraded":"2024-09-21T07:12:43.836994+0000","last_fullsized":"2024-09-21T07:12:43.836994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:52.496426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831297+0000","last_change":"2024-09-21T07:10:53.489349+0000","last_active":"2024-09-21T07:12:43.831297+0000","last_peered":"2024-09-21T07:12:43.831297+0000","last_clean":"2024-09-21T07:12:43.831297+0000","last_became_active":"2024-09-21T07:10:53.488986+0000","last_became_peered":"2024-09-21T07:10:53.488986+0000","last_unstale":"2024-09-21T07:12:43.831297+0000","last_undegraded":"2024-09-21T07:12:43.831297+0000","last_fullsized":"2024-09-21T07:12:43.831297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:46.376689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.832429+0000","last_change":"2024-09-21T07:10:53.485740+0000","last_active":"2024-09-21T07:12:43.832429+0000","last_peered":"2024-09-21T07:12:43.832429+0000","last_clean":"2024-09-21T07:12:43.832429+0000","last_became_active":"2024-09-21T07:10:53.485375+0000","last_became_peered":"2024-09-21T07:10:53.485375+0000","last_unstale":"2024-09-21T07:12:43.832429+0000","last_undegraded":"2024-09-21T07:12:43.832429+0000","last_fullsized":"2024-09-21T07:12:43.832429+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:40.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838894+0000","last_change":"2024-09-21T07:10:53.490211+0000","last_active":"2024-09-21T07:12:43.838894+0000","last_peered":"2024-09-21T07:12:43.838894+0000","last_clean":"2024-09-21T07:12:43.838894+0000","last_became_active":"2024-09-21T07:10:53.489504+0000","last_became_peered":"2024-09-21T07:10:53.489504+0000","last_unstale":"2024-09-21T07:12:43.838894+0000","last_undegraded":"2024-09-21T07:12:43.838894+0000","last_fullsized":"2024-09-21T07:12:43.838894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:50.337307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.837945+0000","last_change":"2024-09-21T07:10:53.486064+0000","last_active":"2024-09-21T07:12:43.837945+0000","last_peered":"2024-09-21T07:12:43.837945+0000","last_clean":"2024-09-21T07:12:43.837945+0000","last_became_active":"2024-09-21T07:10:53.485674+0000","last_became_peered":"2024-09-21T07:10:53.485674+0000","last_unstale":"2024-09-21T07:12:43.837945+0000","last_undegraded":"2024-09-21T07:12:43.837945+0000","last_fullsized":"2024-09-21T07:12:43.837945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:55.232795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838941+0000","last_change":"2024-09-21T07:10:53.489008+0000","last_active":"2024-09-21T07:12:43.838941+0000","last_peered":"2024-09-21T07:12:43.838941+0000","last_clean":"2024-09-21T07:12:43.838941+0000","last_became_active":"2024-09-21T07:10:53.488655+0000","last_became_peered":"2024-09-21T07:10:53.488655+0000","last_unstale":"2024-09-21T07:12:43.838941+0000","last_undegraded":"2024-09-21T07:12:43.838941+0000","last_fullsized":"2024-09-21T07:12:43.838941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:42.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843962+0000","last_change":"2024-09-21T07:10:53.490147+0000","last_active":"2024-09-21T07:12:43.843962+0000","last_peered":"2024-09-21T07:12:43.843962+0000","last_clean":"2024-09-21T07:12:43.843962+0000","last_became_active":"2024-09-21T07:10:53.488389+0000","last_became_peered":"2024-09-21T07:10:53.488389+0000","last_unstale":"2024-09-21T07:12:43.843962+0000","last_undegraded":"2024-09-21T07:12:43.843962+0000","last_fullsized":"2024-09-21T07:12:43.843962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:17.729856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840459+0000","last_change":"2024-09-21T07:10:53.486557+0000","last_active":"2024-09-21T07:12:43.840459+0000","last_peered":"2024-09-21T07:12:43.840459+0000","last_clean":"2024-09-21T07:12:43.840459+0000","last_became_active":"2024-09-21T07:10:53.486248+0000","last_became_peered":"2024-09-21T07:10:53.486248+0000","last_unstale":"2024-09-21T07:12:43.840459+0000","last_undegraded":"2024-09-21T07:12:43.840459+0000","last_fullsized":"2024-09-21T07:12:43.840459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.675717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833816+0000","last_change":"2024-09-21T07:10:53.485281+0000","last_active":"2024-09-21T07:12:43.833816+0000","last_peered":"2024-09-21T07:12:43.833816+0000","last_clean":"2024-09-21T07:12:43.833816+0000","last_became_active":"2024-09-21T07:10:53.484732+0000","last_became_peered":"2024-09-21T07:10:53.484732+0000","last_unstale":"2024-09-21T07:12:43.833816+0000","last_undegraded":"2024-09-21T07:12:43.833816+0000","last_fullsized":"2024-09-21T07:12:43.833816+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:53.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836869+0000","last_change":"2024-09-21T07:10:53.483192+0000","last_active":"2024-09-21T07:12:43.836869+0000","last_peered":"2024-09-21T07:12:43.836869+0000","last_clean":"2024-09-21T07:12:43.836869+0000","last_became_active":"2024-09-21T07:10:53.482402+0000","last_became_peered":"2024-09-21T07:10:53.482402+0000","last_unstale":"2024-09-21T07:12:43.836869+0000","last_undegraded":"2024-09-21T07:12:43.836869+0000","last_fullsized":"2024-09-21T07:12:43.836869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.159873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843080+0000","last_change":"2024-09-21T07:10:53.481463+0000","last_active":"2024-09-21T07:12:43.843080+0000","last_peered":"2024-09-21T07:12:43.843080+0000","last_clean":"2024-09-21T07:12:43.843080+0000","last_became_active":"2024-09-21T07:10:53.481129+0000","last_became_peered":"2024-09-21T07:10:53.481129+0000","last_unstale":"2024-09-21T07:12:43.843080+0000","last_undegraded":"2024-09-21T07:12:43.843080+0000","last_fullsized":"2024-09-21T07:12:43.843080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:14.547936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840480+0000","last_change":"2024-09-21T07:10:53.493009+0000","last_active":"2024-09-21T07:12:43.840480+0000","last_peered":"2024-09-21T07:12:43.840480+0000","last_clean":"2024-09-21T07:12:43.840480+0000","last_became_active":"2024-09-21T07:10:53.492300+0000","last_became_peered":"2024-09-21T07:10:53.492300+0000","last_unstale":"2024-09-21T07:12:43.840480+0000","last_undegraded":"2024-09-21T07:12:43.840480+0000","last_fullsized":"2024-09-21T07:12:43.840480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:09.890248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843437+0000","last_change":"2024-09-21T07:10:53.491149+0000","last_active":"2024-09-21T07:12:43.843437+0000","last_peered":"2024-09-21T07:12:43.843437+0000","last_clean":"2024-09-21T07:12:43.843437+0000","last_became_active":"2024-09-21T07:10:53.490766+0000","last_became_peered":"2024-09-21T07:10:53.490766+0000","last_unstale":"2024-09-21T07:12:43.843437+0000","last_undegraded":"2024-09-21T07:12:43.843437+0000","last_fullsized":"2024-09-21T07:12:43.843437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:52.243083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840492+0000","last_change":"2024-09-21T07:11:14.672453+0000","last_active":"2024-09-21T07:12:43.840492+0000","last_peered":"2024-09-21T07:12:43.840492+0000","last_clean":"2024-09-21T07:12:43.840492+0000","last_became_active":"2024-09-21T07:11:14.671584+0000","last_became_peered":"2024-09-21T07:11:14.671584+0000","last_unstale":"2024-09-21T07:12:43.840492+0000","last_undegraded":"2024-09-21T07:12:43.840492+0000","last_fullsized":"2024-09-21T07:12:43.840492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:25.746195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839098+0000","last_change":"2024-09-21T07:10:53.496332+0000","last_active":"2024-09-21T07:12:43.839098+0000","last_peered":"2024-09-21T07:12:43.839098+0000","last_clean":"2024-09-21T07:12:43.839098+0000","last_became_active":"2024-09-21T07:10:53.495078+0000","last_became_peered":"2024-09-21T07:10:53.495078+0000","last_unstale":"2024-09-21T07:12:43.839098+0000","last_undegraded":"2024-09-21T07:12:43.839098+0000","last_fullsized":"2024-09-21T07:12:43.839098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:32.415350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838131+0000","last_change":"2024-09-21T07:10:53.478381+0000","last_active":"2024-09-21T07:12:43.838131+0000","last_peered":"2024-09-21T07:12:43.838131+0000","last_clean":"2024-09-21T07:12:43.838131+0000","last_became_active":"2024-09-21T07:10:53.478021+0000","last_became_peered":"2024-09-21T07:10:53.478021+0000","last_unstale":"2024-09-21T07:12:43.838131+0000","last_undegraded":"2024-09-21T07:12:43.838131+0000","last_fullsized":"2024-09-21T07:12:43.838131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:02.496263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.821141+0000","last_change":"2024-09-21T07:10:53.485103+0000","last_active":"2024-09-21T07:12:43.821141+0000","last_peered":"2024-09-21T07:12:43.821141+0000","last_clean":"2024-09-21T07:12:43.821141+0000","last_became_active":"2024-09-21T07:10:53.483835+0000","last_became_peered":"2024-09-21T07:10:53.483835+0000","last_unstale":"2024-09-21T07:12:43.821141+0000","last_undegraded":"2024-09-21T07:12:43.821141+0000","last_fullsized":"2024-09-21T07:12:43.821141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:47.775202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842539+0000","last_change":"2024-09-21T07:10:53.490497+0000","last_active":"2024-09-21T07:12:43.842539+0000","last_peered":"2024-09-21T07:12:43.842539+0000","last_clean":"2024-09-21T07:12:43.842539+0000","last_became_active":"2024-09-21T07:10:53.490137+0000","last_became_peered":"2024-09-21T07:10:53.490137+0000","last_unstale":"2024-09-21T07:12:43.842539+0000","last_undegraded":"2024-09-21T07:12:43.842539+0000","last_fullsized":"2024-09-21T07:12:43.842539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:12.090628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842305+0000","last_change":"2024-09-21T07:10:53.487118+0000","last_active":"2024-09-21T07:12:43.842305+0000","last_peered":"2024-09-21T07:12:43.842305+0000","last_clean":"2024-09-21T07:12:43.842305+0000","last_became_active":"2024-09-21T07:10:53.486582+0000","last_became_peered":"2024-09-21T07:10:53.486582+0000","last_unstale":"2024-09-21T07:12:43.842305+0000","last_undegraded":"2024-09-21T07:12:43.842305+0000","last_fullsized":"2024-09-21T07:12:43.842305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:00.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839468+0000","last_change":"2024-09-21T07:10:53.497390+0000","last_active":"2024-09-21T07:12:43.839468+0000","last_peered":"2024-09-21T07:12:43.839468+0000","last_clean":"2024-09-21T07:12:43.839468+0000","last_became_active":"2024-09-21T07:10:53.497043+0000","last_became_peered":"2024-09-21T07:10:53.497043+0000","last_unstale":"2024-09-21T07:12:43.839468+0000","last_undegraded":"2024-09-21T07:12:43.839468+0000","last_fullsized":"2024-09-21T07:12:43.839468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:36.912873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.829609+0000","last_change":"2024-09-21T07:10:53.484624+0000","last_active":"2024-09-21T07:12:43.829609+0000","last_peered":"2024-09-21T07:12:43.829609+0000","last_clean":"2024-09-21T07:12:43.829609+0000","last_became_active":"2024-09-21T07:10:53.484278+0000","last_became_peered":"2024-09-21T07:10:53.484278+0000","last_unstale":"2024-09-21T07:12:43.829609+0000","last_undegraded":"2024-09-21T07:12:43.829609+0000","last_fullsized":"2024-09-21T07:12:43.829609+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:41.464442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836326+0000","last_change":"2024-09-21T07:10:53.478146+0000","last_active":"2024-09-21T07:12:43.836326+0000","last_peered":"2024-09-21T07:12:43.836326+0000","last_clean":"2024-09-21T07:12:43.836326+0000","last_became_active":"2024-09-21T07:10:53.477733+0000","last_became_peered":"2024-09-21T07:10:53.477733+0000","last_unstale":"2024-09-21T07:12:43.836326+0000","last_undegraded":"2024-09-21T07:12:43.836326+0000","last_fullsized":"2024-09-21T07:12:43.836326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:09.159966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839904+0000","last_change":"2024-09-21T07:11:14.657274+0000","last_active":"2024-09-21T07:12:43.839904+0000","last_peered":"2024-09-21T07:12:43.839904+0000","last_clean":"2024-09-21T07:12:43.839904+0000","last_became_active":"2024-09-21T07:11:14.656826+0000","last_became_peered":"2024-09-21T07:11:14.656826+0000","last_unstale":"2024-09-21T07:12:43.839904+0000","last_undegraded":"2024-09-21T07:12:43.839904+0000","last_fullsized":"2024-09-21T07:12:43.839904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.688373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830242+0000","last_change":"2024-09-21T07:10:53.481411+0000","last_active":"2024-09-21T07:12:43.830242+0000","last_peered":"2024-09-21T07:12:43.830242+0000","last_clean":"2024-09-21T07:12:43.830242+0000","last_became_active":"2024-09-21T07:10:53.481005+0000","last_became_peered":"2024-09-21T07:10:53.481005+0000","last_unstale":"2024-09-21T07:12:43.830242+0000","last_undegraded":"2024-09-21T07:12:43.830242+0000","last_fullsized":"2024-09-21T07:12:43.830242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:41.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.823757+0000","last_change":"2024-09-21T07:10:53.487481+0000","last_active":"2024-09-21T07:12:43.823757+0000","last_peered":"2024-09-21T07:12:43.823757+0000","last_clean":"2024-09-21T07:12:43.823757+0000","last_became_active":"2024-09-21T07:10:53.486277+0000","last_became_peered":"2024-09-21T07:10:53.486277+0000","last_unstale":"2024-09-21T07:12:43.823757+0000","last_undegraded":"2024-09-21T07:12:43.823757+0000","last_fullsized":"2024-09-21T07:12:43.823757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:57.304382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840517+0000","last_change":"2024-09-21T07:10:53.495971+0000","last_active":"2024-09-21T07:12:43.840517+0000","last_peered":"2024-09-21T07:12:43.840517+0000","last_clean":"2024-09-21T07:12:43.840517+0000","last_became_active":"2024-09-21T07:10:53.495124+0000","last_became_peered":"2024-09-21T07:10:53.495124+0000","last_unstale":"2024-09-21T07:12:43.840517+0000","last_undegraded":"2024-09-21T07:12:43.840517+0000","last_fullsized":"2024-09-21T07:12:43.840517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839940+0000","last_change":"2024-09-21T07:10:53.497538+0000","last_active":"2024-09-21T07:12:43.839940+0000","last_peered":"2024-09-21T07:12:43.839940+0000","last_clean":"2024-09-21T07:12:43.839940+0000","last_became_active":"2024-09-21T07:10:53.496835+0000","last_became_peered":"2024-09-21T07:10:53.496835+0000","last_unstale":"2024-09-21T07:12:43.839940+0000","last_undegraded":"2024-09-21T07:12:43.839940+0000","last_fullsized":"2024-09-21T07:12:43.839940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:17.187282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840355+0000","last_change":"2024-09-21T07:10:53.492646+0000","last_active":"2024-09-21T07:12:43.840355+0000","last_peered":"2024-09-21T07:12:43.840355+0000","last_clean":"2024-09-21T07:12:43.840355+0000","last_became_active":"2024-09-21T07:10:53.491818+0000","last_became_peered":"2024-09-21T07:10:53.491818+0000","last_unstale":"2024-09-21T07:12:43.840355+0000","last_undegraded":"2024-09-21T07:12:43.840355+0000","last_fullsized":"2024-09-21T07:12:43.840355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:37.094158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":871055,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1517,"num_read_kb":976,"num_write":496,"num_write_kb":2264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":68,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":835584,"data_stored":2613165,"data_compressed":111761,"data_compressed_allocated":147456,"data_compressed_original":2285568,"omap_allocated":0,"internal_metadata":0},"log_size":378,"ondisk_log_size":378,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283164,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710764,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":899963,"data_compressed":48859,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906994,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32332,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712820,"statfs":{"total":95995035648,"available":95961927680,"internally_reserved":0,"allocated":1175552,"data_stored":1566504,"data_compressed":83319,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070519,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":899332,"data_compressed":48876,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266748,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":506494,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462977,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1105534,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626501,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":502113,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822731,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36416,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708736,"statfs":{"total":95995035648,"available":95957745664,"internally_reserved":0,"allocated":1093632,"data_stored":1492983,"data_compressed":83681,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986257,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":507110,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182485,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1288320,"data_compressed":66588,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378714,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":578534,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":577357,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705765,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":983040,"data_stored":503569,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":77636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":787422,"data_compressed":37001,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":397621,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":471142,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394969,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:13:32.696 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:13:32.696 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:13:32.944 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:33.065 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:32 smithi092 ceph-mon[30987]: from='client.15732 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:32 smithi169 ceph-mon[33705]: from='client.15732 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:33.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:32 smithi175 ceph-mon[34064]: from='client.15732 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:33.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.445+0000 7f80f0dd8640 1 -- 172.21.15.92:0/3839843258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80ec103b60 msgr2=0x7f80ec103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:33.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.445+0000 7f80f0dd8640 1 --2- 172.21.15.92:0/3839843258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80ec103b60 0x7f80ec103f70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009ca0 tx=0x7f80e002a8e0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.445+0000 7f80f0dd8640 1 -- 172.21.15.92:0/3839843258 shutdown_connections 2024-09-21T07:13:33.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.445+0000 7f80f0dd8640 1 --2- 172.21.15.92:0/3839843258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80ec109df0 0x7f80ec110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.445+0000 7f80f0dd8640 1 --2- 172.21.15.92:0/3839843258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80ec1094a0 0x7f80ec1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.445+0000 7f80f0dd8640 1 --2- 172.21.15.92:0/3839843258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80ec103b60 0x7f80ec103f70 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.445+0000 7f80f0dd8640 1 -- 172.21.15.92:0/3839843258 >> 172.21.15.92:0/3839843258 conn(0x7f80ec07b850 msgr2=0x7f80ec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:33.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.445+0000 7f80f0dd8640 1 -- 172.21.15.92:0/3839843258 shutdown_connections 2024-09-21T07:13:33.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.445+0000 7f80f0dd8640 1 -- 172.21.15.92:0/3839843258 wait complete. 2024-09-21T07:13:33.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80f0dd8640 1 Processor -- start 2024-09-21T07:13:33.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80f0dd8640 1 -- start start 2024-09-21T07:13:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80f0dd8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80ec103b60 0x7f80ec19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80f0dd8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80ec1094a0 0x7f80ec19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80f0dd8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80ec109df0 0x7f80ec19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80f0dd8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec1139c0 con 0x7f80ec1094a0 2024-09-21T07:13:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80f0dd8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec113840 con 0x7f80ec103b60 2024-09-21T07:13:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80f0dd8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec113b40 con 0x7f80ec109df0 2024-09-21T07:13:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80e9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80ec1094a0 0x7f80ec19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80e9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80ec1094a0 0x7f80ec19a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50978/0 (socket says 172.21.15.92:50978) 2024-09-21T07:13:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80e9d9b640 1 -- 172.21.15.92:0/1874109265 learned_addr learned my addr 172.21.15.92:0/1874109265 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80ead9d640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80ec109df0 0x7f80ec19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.446+0000 7f80ea59c640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80ec103b60 0x7f80ec19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80e9d9b640 1 -- 172.21.15.92:0/1874109265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80ec109df0 msgr2=0x7f80ec19fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80e9d9b640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80ec109df0 0x7f80ec19fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80e9d9b640 1 -- 172.21.15.92:0/1874109265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80ec103b60 msgr2=0x7f80ec19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80e9d9b640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80ec103b60 0x7f80ec19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80e9d9b640 1 -- 172.21.15.92:0/1874109265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec1a0360 con 0x7f80ec1094a0 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80ea59c640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80ec103b60 0x7f80ec19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80e9d9b640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80ec1094a0 0x7f80ec19a990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f80dc006fd0 tx=0x7f80dc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80db7fe640 1 -- 172.21.15.92:0/1874109265 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc011830 con 0x7f80ec1094a0 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80db7fe640 1 -- 172.21.15.92:0/1874109265 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80dc016070 con 0x7f80ec1094a0 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80f0dd8640 1 -- 172.21.15.92:0/1874109265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ec1a0650 con 0x7f80ec1094a0 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80db7fe640 1 -- 172.21.15.92:0/1874109265 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc010d30 con 0x7f80ec1094a0 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.447+0000 7f80f0dd8640 1 -- 172.21.15.92:0/1874109265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ec1a6e30 con 0x7f80ec1094a0 2024-09-21T07:13:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.448+0000 7f80f0dd8640 1 -- 172.21.15.92:0/1874109265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80ec103f70 con 0x7f80ec1094a0 2024-09-21T07:13:33.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.449+0000 7f80db7fe640 1 -- 172.21.15.92:0/1874109265 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f80dc0119d0 con 0x7f80ec1094a0 2024-09-21T07:13:33.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.451+0000 7f80db7fe640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80d40b6700 0x7f80d40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:33.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.451+0000 7f80ea59c640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80d40b6700 0x7f80d40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:33.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.451+0000 7f80db7fe640 1 -- 172.21.15.92:0/1874109265 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f80dc0e76a0 con 0x7f80ec1094a0 2024-09-21T07:13:33.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.451+0000 7f80ea59c640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80d40b6700 0x7f80d40b8c10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f80e0006010 tx=0x7f80e0000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:33.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.454+0000 7f80db7fe640 1 -- 172.21.15.92:0/1874109265 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80dc0ad850 con 0x7f80ec1094a0 2024-09-21T07:13:33.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.635+0000 7f80f0dd8640 1 -- 172.21.15.92:0/1874109265 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80ec063800 con 0x7f80d40b6700 2024-09-21T07:13:33.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.641+0000 7f80db7fe640 1 -- 172.21.15.92:0/1874109265 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340961 (secure 0 0 0) 0x7f80ec063800 con 0x7f80d40b6700 2024-09-21T07:13:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:33.647 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 -- 172.21.15.92:0/1874109265 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80d40b6700 msgr2=0x7f80d40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80d40b6700 0x7f80d40b8c10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f80e0006010 tx=0x7f80e0000f40 comp rx=0 tx=0).stop 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 -- 172.21.15.92:0/1874109265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80ec1094a0 msgr2=0x7f80ec19a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80ec1094a0 0x7f80ec19a990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f80dc006fd0 tx=0x7f80dc00b8e0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 -- 172.21.15.92:0/1874109265 shutdown_connections 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80d40b6700 0x7f80d40b8c10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80ec109df0 0x7f80ec19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80ec1094a0 0x7f80ec19a990 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 --2- 172.21.15.92:0/1874109265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80ec103b60 0x7f80ec19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 -- 172.21.15.92:0/1874109265 >> 172.21.15.92:0/1874109265 conn(0x7f80ec07b850 msgr2=0x7f80ec107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.644+0000 7f80f0dd8640 1 -- 172.21.15.92:0/1874109265 shutdown_connections 2024-09-21T07:13:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:33.645+0000 7f80f0dd8640 1 -- 172.21.15.92:0/1874109265 wait complete. 2024-09-21T07:13:34.108 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:33 smithi092 ceph-mon[30987]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-09-21T07:13:34.108 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:33 smithi092 ceph-mon[30987]: from='client.15738 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:33 smithi169 ceph-mon[33705]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-09-21T07:13:34.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:33 smithi169 ceph-mon[33705]: from='client.15738 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:34.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:33 smithi175 ceph-mon[34064]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-09-21T07:13:34.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:33 smithi175 ceph-mon[34064]: from='client.15738 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:13:34.357 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-09-21T07:13:33.628043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1461657,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1648,"num_read_kb":1083,"num_write":629,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2951908,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":976,"ondisk_log_size":976,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369612,"kb_used_data":12032,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572212,"statfs":{"total":1151940427776,"available":1151561945088,"internally_reserved":0,"allocated":12320768,"data_stored":10427813,"data_compressed":575193,"data_compressed_allocated":774144,"data_compressed_original":5038080,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":794252,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":380,"num_write":230,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003316"},"pg_stats":[{"pgid":"2.1f","version":"86'14","reported_seq":175,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:30.918477+0000","last_change":"2024-09-21T07:10:51.463956+0000","last_active":"2024-09-21T07:13:30.918477+0000","last_peered":"2024-09-21T07:13:30.918477+0000","last_clean":"2024-09-21T07:13:30.918477+0000","last_became_active":"2024-09-21T07:10:51.463564+0000","last_became_peered":"2024-09-21T07:10:51.463564+0000","last_unstale":"2024-09-21T07:13:30.918477+0000","last_undegraded":"2024-09-21T07:13:30.918477+0000","last_fullsized":"2024-09-21T07:13:30.918477+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:47.612313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838602+0000","last_change":"2024-09-21T07:10:53.484379+0000","last_active":"2024-09-21T07:12:43.838602+0000","last_peered":"2024-09-21T07:12:43.838602+0000","last_clean":"2024-09-21T07:12:43.838602+0000","last_became_active":"2024-09-21T07:10:53.484005+0000","last_became_peered":"2024-09-21T07:10:53.484005+0000","last_unstale":"2024-09-21T07:12:43.838602+0000","last_undegraded":"2024-09-21T07:12:43.838602+0000","last_fullsized":"2024-09-21T07:12:43.838602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:27.665257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687327+0000","last_change":"2024-09-21T07:11:00.552729+0000","last_active":"2024-09-21T07:12:14.687327+0000","last_peered":"2024-09-21T07:12:14.687327+0000","last_clean":"2024-09-21T07:12:14.687327+0000","last_became_active":"2024-09-21T07:11:00.552196+0000","last_became_peered":"2024-09-21T07:11:00.552196+0000","last_unstale":"2024-09-21T07:12:14.687327+0000","last_undegraded":"2024-09-21T07:12:14.687327+0000","last_fullsized":"2024-09-21T07:12:14.687327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:35.942717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692173+0000","last_change":"2024-09-21T07:10:51.467798+0000","last_active":"2024-09-21T07:12:14.692173+0000","last_peered":"2024-09-21T07:12:14.692173+0000","last_clean":"2024-09-21T07:12:14.692173+0000","last_became_active":"2024-09-21T07:10:51.467314+0000","last_became_peered":"2024-09-21T07:10:51.467314+0000","last_unstale":"2024-09-21T07:12:14.692173+0000","last_undegraded":"2024-09-21T07:12:14.692173+0000","last_fullsized":"2024-09-21T07:12:14.692173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:21.944378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839226+0000","last_change":"2024-09-21T07:10:53.494849+0000","last_active":"2024-09-21T07:12:43.839226+0000","last_peered":"2024-09-21T07:12:43.839226+0000","last_clean":"2024-09-21T07:12:43.839226+0000","last_became_active":"2024-09-21T07:10:53.494478+0000","last_became_peered":"2024-09-21T07:10:53.494478+0000","last_unstale":"2024-09-21T07:12:43.839226+0000","last_undegraded":"2024-09-21T07:12:43.839226+0000","last_fullsized":"2024-09-21T07:12:43.839226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:38.383547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805693+0000","last_change":"2024-09-21T07:11:00.558306+0000","last_active":"2024-09-21T07:12:14.805693+0000","last_peered":"2024-09-21T07:12:14.805693+0000","last_clean":"2024-09-21T07:12:14.805693+0000","last_became_active":"2024-09-21T07:11:00.557814+0000","last_became_peered":"2024-09-21T07:11:00.557814+0000","last_unstale":"2024-09-21T07:12:14.805693+0000","last_undegraded":"2024-09-21T07:12:14.805693+0000","last_fullsized":"2024-09-21T07:12:14.805693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:31.401788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":53,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693033+0000","last_change":"2024-09-21T07:10:51.466831+0000","last_active":"2024-09-21T07:12:14.693033+0000","last_peered":"2024-09-21T07:12:14.693033+0000","last_clean":"2024-09-21T07:12:14.693033+0000","last_became_active":"2024-09-21T07:10:51.466381+0000","last_became_peered":"2024-09-21T07:10:51.466381+0000","last_unstale":"2024-09-21T07:12:14.693033+0000","last_undegraded":"2024-09-21T07:12:14.693033+0000","last_fullsized":"2024-09-21T07:12:14.693033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:01.559370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843617+0000","last_change":"2024-09-21T07:10:53.485920+0000","last_active":"2024-09-21T07:12:43.843617+0000","last_peered":"2024-09-21T07:12:43.843617+0000","last_clean":"2024-09-21T07:12:43.843617+0000","last_became_active":"2024-09-21T07:10:53.484689+0000","last_became_peered":"2024-09-21T07:10:53.484689+0000","last_unstale":"2024-09-21T07:12:43.843617+0000","last_undegraded":"2024-09-21T07:12:43.843617+0000","last_fullsized":"2024-09-21T07:12:43.843617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:59.951999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806409+0000","last_change":"2024-09-21T07:11:00.558298+0000","last_active":"2024-09-21T07:12:14.806409+0000","last_peered":"2024-09-21T07:12:14.806409+0000","last_clean":"2024-09-21T07:12:14.806409+0000","last_became_active":"2024-09-21T07:11:00.557738+0000","last_became_peered":"2024-09-21T07:11:00.557738+0000","last_unstale":"2024-09-21T07:12:14.806409+0000","last_undegraded":"2024-09-21T07:12:14.806409+0000","last_fullsized":"2024-09-21T07:12:14.806409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:03.037820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693169+0000","last_change":"2024-09-21T07:10:51.464283+0000","last_active":"2024-09-21T07:12:14.693169+0000","last_peered":"2024-09-21T07:12:14.693169+0000","last_clean":"2024-09-21T07:12:14.693169+0000","last_became_active":"2024-09-21T07:10:51.463783+0000","last_became_peered":"2024-09-21T07:10:51.463783+0000","last_unstale":"2024-09-21T07:12:14.693169+0000","last_undegraded":"2024-09-21T07:12:14.693169+0000","last_fullsized":"2024-09-21T07:12:14.693169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:45.298654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842942+0000","last_change":"2024-09-21T07:11:14.671020+0000","last_active":"2024-09-21T07:12:43.842942+0000","last_peered":"2024-09-21T07:12:43.842942+0000","last_clean":"2024-09-21T07:12:43.842942+0000","last_became_active":"2024-09-21T07:11:14.670573+0000","last_became_peered":"2024-09-21T07:11:14.670573+0000","last_unstale":"2024-09-21T07:12:43.842942+0000","last_undegraded":"2024-09-21T07:12:43.842942+0000","last_fullsized":"2024-09-21T07:12:43.842942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.926304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.805803+0000","last_change":"2024-09-21T07:11:00.549015+0000","last_active":"2024-09-21T07:12:14.805803+0000","last_peered":"2024-09-21T07:12:14.805803+0000","last_clean":"2024-09-21T07:12:14.805803+0000","last_became_active":"2024-09-21T07:11:00.548561+0000","last_became_peered":"2024-09-21T07:11:00.548561+0000","last_unstale":"2024-09-21T07:12:14.805803+0000","last_undegraded":"2024-09-21T07:12:14.805803+0000","last_fullsized":"2024-09-21T07:12:14.805803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:08.386214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841440+0000","last_change":"2024-09-21T07:10:53.489382+0000","last_active":"2024-09-21T07:12:43.841440+0000","last_peered":"2024-09-21T07:12:43.841440+0000","last_clean":"2024-09-21T07:12:43.841440+0000","last_became_active":"2024-09-21T07:10:53.488987+0000","last_became_peered":"2024-09-21T07:10:53.488987+0000","last_unstale":"2024-09-21T07:12:43.841440+0000","last_undegraded":"2024-09-21T07:12:43.841440+0000","last_fullsized":"2024-09-21T07:12:43.841440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.334840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692508+0000","last_change":"2024-09-21T07:10:51.467203+0000","last_active":"2024-09-21T07:12:14.692508+0000","last_peered":"2024-09-21T07:12:14.692508+0000","last_clean":"2024-09-21T07:12:14.692508+0000","last_became_active":"2024-09-21T07:10:51.466737+0000","last_became_peered":"2024-09-21T07:10:51.466737+0000","last_unstale":"2024-09-21T07:12:14.692508+0000","last_undegraded":"2024-09-21T07:12:14.692508+0000","last_fullsized":"2024-09-21T07:12:14.692508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:26.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806191+0000","last_change":"2024-09-21T07:11:00.640801+0000","last_active":"2024-09-21T07:12:14.806191+0000","last_peered":"2024-09-21T07:12:14.806191+0000","last_clean":"2024-09-21T07:12:14.806191+0000","last_became_active":"2024-09-21T07:11:00.640213+0000","last_became_peered":"2024-09-21T07:11:00.640213+0000","last_unstale":"2024-09-21T07:12:14.806191+0000","last_undegraded":"2024-09-21T07:12:14.806191+0000","last_fullsized":"2024-09-21T07:12:14.806191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:55.801831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841160+0000","last_change":"2024-09-21T07:10:53.491166+0000","last_active":"2024-09-21T07:12:43.841160+0000","last_peered":"2024-09-21T07:12:43.841160+0000","last_clean":"2024-09-21T07:12:43.841160+0000","last_became_active":"2024-09-21T07:10:53.490823+0000","last_became_peered":"2024-09-21T07:10:53.490823+0000","last_unstale":"2024-09-21T07:12:43.841160+0000","last_undegraded":"2024-09-21T07:12:43.841160+0000","last_fullsized":"2024-09-21T07:12:43.841160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:48.661634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:02.728825+0000","last_change":"2024-09-21T07:10:51.461220+0000","last_active":"2024-09-21T07:13:02.728825+0000","last_peered":"2024-09-21T07:13:02.728825+0000","last_clean":"2024-09-21T07:13:02.728825+0000","last_became_active":"2024-09-21T07:10:51.460772+0000","last_became_peered":"2024-09-21T07:10:51.460772+0000","last_unstale":"2024-09-21T07:13:02.728825+0000","last_undegraded":"2024-09-21T07:13:02.728825+0000","last_fullsized":"2024-09-21T07:13:02.728825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:56.488273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806249+0000","last_change":"2024-09-21T07:11:00.558487+0000","last_active":"2024-09-21T07:12:14.806249+0000","last_peered":"2024-09-21T07:12:14.806249+0000","last_clean":"2024-09-21T07:12:14.806249+0000","last_became_active":"2024-09-21T07:11:00.557877+0000","last_became_peered":"2024-09-21T07:11:00.557877+0000","last_unstale":"2024-09-21T07:12:14.806249+0000","last_undegraded":"2024-09-21T07:12:14.806249+0000","last_fullsized":"2024-09-21T07:12:14.806249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:14.614603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840073+0000","last_change":"2024-09-21T07:10:53.489309+0000","last_active":"2024-09-21T07:12:43.840073+0000","last_peered":"2024-09-21T07:12:43.840073+0000","last_clean":"2024-09-21T07:12:43.840073+0000","last_became_active":"2024-09-21T07:10:53.488943+0000","last_became_peered":"2024-09-21T07:10:53.488943+0000","last_unstale":"2024-09-21T07:12:43.840073+0000","last_undegraded":"2024-09-21T07:12:43.840073+0000","last_fullsized":"2024-09-21T07:12:43.840073+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.797176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692071+0000","last_change":"2024-09-21T07:10:51.461078+0000","last_active":"2024-09-21T07:12:14.692071+0000","last_peered":"2024-09-21T07:12:14.692071+0000","last_clean":"2024-09-21T07:12:14.692071+0000","last_became_active":"2024-09-21T07:10:51.460759+0000","last_became_peered":"2024-09-21T07:10:51.460759+0000","last_unstale":"2024-09-21T07:12:14.692071+0000","last_undegraded":"2024-09-21T07:12:14.692071+0000","last_fullsized":"2024-09-21T07:12:14.692071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:37.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:11:00.554766+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:11:00.554374+0000","last_became_peered":"2024-09-21T07:11:00.554374+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:47.038411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825773+0000","last_change":"2024-09-21T07:10:53.487501+0000","last_active":"2024-09-21T07:12:43.825773+0000","last_peered":"2024-09-21T07:12:43.825773+0000","last_clean":"2024-09-21T07:12:43.825773+0000","last_became_active":"2024-09-21T07:10:53.487030+0000","last_became_peered":"2024-09-21T07:10:53.487030+0000","last_unstale":"2024-09-21T07:12:43.825773+0000","last_undegraded":"2024-09-21T07:12:43.825773+0000","last_fullsized":"2024-09-21T07:12:43.825773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692397+0000","last_change":"2024-09-21T07:10:51.468155+0000","last_active":"2024-09-21T07:12:14.692397+0000","last_peered":"2024-09-21T07:12:14.692397+0000","last_clean":"2024-09-21T07:12:14.692397+0000","last_became_active":"2024-09-21T07:10:51.467663+0000","last_became_peered":"2024-09-21T07:10:51.467663+0000","last_unstale":"2024-09-21T07:12:14.692397+0000","last_undegraded":"2024-09-21T07:12:14.692397+0000","last_fullsized":"2024-09-21T07:12:14.692397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:18.176519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806311+0000","last_change":"2024-09-21T07:11:00.641283+0000","last_active":"2024-09-21T07:12:14.806311+0000","last_peered":"2024-09-21T07:12:14.806311+0000","last_clean":"2024-09-21T07:12:14.806311+0000","last_became_active":"2024-09-21T07:11:00.640715+0000","last_became_peered":"2024-09-21T07:11:00.640715+0000","last_unstale":"2024-09-21T07:12:14.806311+0000","last_undegraded":"2024-09-21T07:12:14.806311+0000","last_fullsized":"2024-09-21T07:12:14.806311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:26.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842481+0000","last_change":"2024-09-21T07:11:14.656686+0000","last_active":"2024-09-21T07:12:43.842481+0000","last_peered":"2024-09-21T07:12:43.842481+0000","last_clean":"2024-09-21T07:12:43.842481+0000","last_became_active":"2024-09-21T07:11:14.656259+0000","last_became_peered":"2024-09-21T07:11:14.656259+0000","last_unstale":"2024-09-21T07:12:43.842481+0000","last_undegraded":"2024-09-21T07:12:43.842481+0000","last_fullsized":"2024-09-21T07:12:43.842481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:16.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806776+0000","last_change":"2024-09-21T07:10:52.123260+0000","last_active":"2024-09-21T07:12:14.806776+0000","last_peered":"2024-09-21T07:12:14.806776+0000","last_clean":"2024-09-21T07:12:14.806776+0000","last_became_active":"2024-09-21T07:10:52.122752+0000","last_became_peered":"2024-09-21T07:10:52.122752+0000","last_unstale":"2024-09-21T07:12:14.806776+0000","last_undegraded":"2024-09-21T07:12:14.806776+0000","last_fullsized":"2024-09-21T07:12:14.806776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.041434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686989+0000","last_change":"2024-09-21T07:11:00.549599+0000","last_active":"2024-09-21T07:12:14.686989+0000","last_peered":"2024-09-21T07:12:14.686989+0000","last_clean":"2024-09-21T07:12:14.686989+0000","last_became_active":"2024-09-21T07:11:00.549112+0000","last_became_peered":"2024-09-21T07:11:00.549112+0000","last_unstale":"2024-09-21T07:12:14.686989+0000","last_undegraded":"2024-09-21T07:12:14.686989+0000","last_fullsized":"2024-09-21T07:12:14.686989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:15.209889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.828092+0000","last_change":"2024-09-21T07:10:53.487792+0000","last_active":"2024-09-21T07:12:43.828092+0000","last_peered":"2024-09-21T07:12:43.828092+0000","last_clean":"2024-09-21T07:12:43.828092+0000","last_became_active":"2024-09-21T07:10:53.487460+0000","last_became_peered":"2024-09-21T07:10:53.487460+0000","last_unstale":"2024-09-21T07:12:43.828092+0000","last_undegraded":"2024-09-21T07:12:43.828092+0000","last_fullsized":"2024-09-21T07:12:43.828092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:26.329878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'102","reported_seq":248,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:28.217493+0000","last_change":"2024-09-21T07:12:14.699788+0000","last_active":"2024-09-21T07:13:28.217493+0000","last_peered":"2024-09-21T07:13:28.217493+0000","last_clean":"2024-09-21T07:13:28.217493+0000","last_became_active":"2024-09-21T07:12:14.693355+0000","last_became_peered":"2024-09-21T07:12:14.693355+0000","last_unstale":"2024-09-21T07:13:28.217493+0000","last_undegraded":"2024-09-21T07:13:28.217493+0000","last_fullsized":"2024-09-21T07:13:28.217493+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:44.104210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":187,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691224+0000","last_change":"2024-09-21T07:11:00.640604+0000","last_active":"2024-09-21T07:12:14.691224+0000","last_peered":"2024-09-21T07:12:14.691224+0000","last_clean":"2024-09-21T07:12:14.691224+0000","last_became_active":"2024-09-21T07:11:00.640047+0000","last_became_peered":"2024-09-21T07:11:00.640047+0000","last_unstale":"2024-09-21T07:12:14.691224+0000","last_undegraded":"2024-09-21T07:12:14.691224+0000","last_fullsized":"2024-09-21T07:12:14.691224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:42.640908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834870+0000","last_change":"2024-09-21T07:10:53.473862+0000","last_active":"2024-09-21T07:12:43.834870+0000","last_peered":"2024-09-21T07:12:43.834870+0000","last_clean":"2024-09-21T07:12:43.834870+0000","last_became_active":"2024-09-21T07:10:53.473526+0000","last_became_peered":"2024-09-21T07:10:53.473526+0000","last_unstale":"2024-09-21T07:12:43.834870+0000","last_undegraded":"2024-09-21T07:12:43.834870+0000","last_fullsized":"2024-09-21T07:12:43.834870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.389566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.693155+0000","last_change":"2024-09-21T07:10:51.468003+0000","last_active":"2024-09-21T07:12:14.693155+0000","last_peered":"2024-09-21T07:12:14.693155+0000","last_clean":"2024-09-21T07:12:14.693155+0000","last_became_active":"2024-09-21T07:10:51.467603+0000","last_became_peered":"2024-09-21T07:10:51.467603+0000","last_unstale":"2024-09-21T07:12:14.693155+0000","last_undegraded":"2024-09-21T07:12:14.693155+0000","last_fullsized":"2024-09-21T07:12:14.693155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:02.148721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690206+0000","last_change":"2024-09-21T07:11:00.550434+0000","last_active":"2024-09-21T07:12:14.690206+0000","last_peered":"2024-09-21T07:12:14.690206+0000","last_clean":"2024-09-21T07:12:14.690206+0000","last_became_active":"2024-09-21T07:11:00.549949+0000","last_became_peered":"2024-09-21T07:11:00.549949+0000","last_unstale":"2024-09-21T07:12:14.690206+0000","last_undegraded":"2024-09-21T07:12:14.690206+0000","last_fullsized":"2024-09-21T07:12:14.690206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:53.737978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839518+0000","last_change":"2024-09-21T07:12:14.690832+0000","last_active":"2024-09-21T07:12:43.839518+0000","last_peered":"2024-09-21T07:12:43.839518+0000","last_clean":"2024-09-21T07:12:43.839518+0000","last_became_active":"2024-09-21T07:12:14.690361+0000","last_became_peered":"2024-09-21T07:12:14.690361+0000","last_unstale":"2024-09-21T07:12:43.839518+0000","last_undegraded":"2024-09-21T07:12:43.839518+0000","last_fullsized":"2024-09-21T07:12:43.839518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:00.772213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689540+0000","last_change":"2024-09-21T07:10:51.468201+0000","last_active":"2024-09-21T07:12:14.689540+0000","last_peered":"2024-09-21T07:12:14.689540+0000","last_clean":"2024-09-21T07:12:14.689540+0000","last_became_active":"2024-09-21T07:10:51.467754+0000","last_became_peered":"2024-09-21T07:10:51.467754+0000","last_unstale":"2024-09-21T07:12:14.689540+0000","last_undegraded":"2024-09-21T07:12:14.689540+0000","last_fullsized":"2024-09-21T07:12:14.689540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:52.196495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692198+0000","last_change":"2024-09-21T07:11:00.640653+0000","last_active":"2024-09-21T07:12:14.692198+0000","last_peered":"2024-09-21T07:12:14.692198+0000","last_clean":"2024-09-21T07:12:14.692198+0000","last_became_active":"2024-09-21T07:11:00.640080+0000","last_became_peered":"2024-09-21T07:11:00.640080+0000","last_unstale":"2024-09-21T07:12:14.692198+0000","last_undegraded":"2024-09-21T07:12:14.692198+0000","last_fullsized":"2024-09-21T07:12:14.692198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:24.124088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840328+0000","last_change":"2024-09-21T07:10:53.494222+0000","last_active":"2024-09-21T07:12:43.840328+0000","last_peered":"2024-09-21T07:12:43.840328+0000","last_clean":"2024-09-21T07:12:43.840328+0000","last_became_active":"2024-09-21T07:10:53.493703+0000","last_became_peered":"2024-09-21T07:10:53.493703+0000","last_unstale":"2024-09-21T07:12:43.840328+0000","last_undegraded":"2024-09-21T07:12:43.840328+0000","last_fullsized":"2024-09-21T07:12:43.840328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:21.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.914037+0000","last_change":"2024-09-21T07:10:51.461095+0000","last_active":"2024-09-21T07:13:27.914037+0000","last_peered":"2024-09-21T07:13:27.914037+0000","last_clean":"2024-09-21T07:13:27.914037+0000","last_became_active":"2024-09-21T07:10:51.460738+0000","last_became_peered":"2024-09-21T07:10:51.460738+0000","last_unstale":"2024-09-21T07:13:27.914037+0000","last_undegraded":"2024-09-21T07:13:27.914037+0000","last_fullsized":"2024-09-21T07:13:27.914037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:55.593391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686398+0000","last_change":"2024-09-21T07:11:00.544788+0000","last_active":"2024-09-21T07:12:14.686398+0000","last_peered":"2024-09-21T07:12:14.686398+0000","last_clean":"2024-09-21T07:12:14.686398+0000","last_became_active":"2024-09-21T07:11:00.544370+0000","last_became_peered":"2024-09-21T07:11:00.544370+0000","last_unstale":"2024-09-21T07:12:14.686398+0000","last_undegraded":"2024-09-21T07:12:14.686398+0000","last_fullsized":"2024-09-21T07:12:14.686398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:07.154867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839305+0000","last_change":"2024-09-21T07:10:53.486715+0000","last_active":"2024-09-21T07:12:43.839305+0000","last_peered":"2024-09-21T07:12:43.839305+0000","last_clean":"2024-09-21T07:12:43.839305+0000","last_became_active":"2024-09-21T07:10:53.486315+0000","last_became_peered":"2024-09-21T07:10:53.486315+0000","last_unstale":"2024-09-21T07:12:43.839305+0000","last_undegraded":"2024-09-21T07:12:43.839305+0000","last_fullsized":"2024-09-21T07:12:43.839305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:00.124269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'7","reported_seq":166,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:29.931449+0000","last_change":"2024-09-21T07:10:51.467102+0000","last_active":"2024-09-21T07:13:29.931449+0000","last_peered":"2024-09-21T07:13:29.931449+0000","last_clean":"2024-09-21T07:13:29.931449+0000","last_became_active":"2024-09-21T07:10:51.466721+0000","last_became_peered":"2024-09-21T07:10:51.466721+0000","last_unstale":"2024-09-21T07:13:29.931449+0000","last_undegraded":"2024-09-21T07:13:29.931449+0000","last_fullsized":"2024-09-21T07:13:29.931449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686198+0000","last_change":"2024-09-21T07:11:00.640622+0000","last_active":"2024-09-21T07:12:14.686198+0000","last_peered":"2024-09-21T07:12:14.686198+0000","last_clean":"2024-09-21T07:12:14.686198+0000","last_became_active":"2024-09-21T07:11:00.640104+0000","last_became_peered":"2024-09-21T07:11:00.640104+0000","last_unstale":"2024-09-21T07:12:14.686198+0000","last_undegraded":"2024-09-21T07:12:14.686198+0000","last_fullsized":"2024-09-21T07:12:14.686198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:12.023561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825104+0000","last_change":"2024-09-21T07:10:53.478175+0000","last_active":"2024-09-21T07:12:43.825104+0000","last_peered":"2024-09-21T07:12:43.825104+0000","last_clean":"2024-09-21T07:12:43.825104+0000","last_became_active":"2024-09-21T07:10:53.477831+0000","last_became_peered":"2024-09-21T07:10:53.477831+0000","last_unstale":"2024-09-21T07:12:43.825104+0000","last_undegraded":"2024-09-21T07:12:43.825104+0000","last_fullsized":"2024-09-21T07:12:43.825104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:27.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689665+0000","last_change":"2024-09-21T07:10:51.466318+0000","last_active":"2024-09-21T07:12:14.689665+0000","last_peered":"2024-09-21T07:12:14.689665+0000","last_clean":"2024-09-21T07:12:14.689665+0000","last_became_active":"2024-09-21T07:10:51.465983+0000","last_became_peered":"2024-09-21T07:10:51.465983+0000","last_unstale":"2024-09-21T07:12:14.689665+0000","last_undegraded":"2024-09-21T07:12:14.689665+0000","last_fullsized":"2024-09-21T07:12:14.689665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:08.432949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691834+0000","last_change":"2024-09-21T07:11:00.641364+0000","last_active":"2024-09-21T07:12:14.691834+0000","last_peered":"2024-09-21T07:12:14.691834+0000","last_clean":"2024-09-21T07:12:14.691834+0000","last_became_active":"2024-09-21T07:11:00.640879+0000","last_became_peered":"2024-09-21T07:11:00.640879+0000","last_unstale":"2024-09-21T07:12:14.691834+0000","last_undegraded":"2024-09-21T07:12:14.691834+0000","last_fullsized":"2024-09-21T07:12:14.691834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:16.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.825148+0000","last_change":"2024-09-21T07:10:53.483709+0000","last_active":"2024-09-21T07:12:43.825148+0000","last_peered":"2024-09-21T07:12:43.825148+0000","last_clean":"2024-09-21T07:12:43.825148+0000","last_became_active":"2024-09-21T07:10:53.483355+0000","last_became_peered":"2024-09-21T07:10:53.483355+0000","last_unstale":"2024-09-21T07:12:43.825148+0000","last_undegraded":"2024-09-21T07:12:43.825148+0000","last_fullsized":"2024-09-21T07:12:43.825148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:32.702168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806593+0000","last_change":"2024-09-21T07:10:51.464239+0000","last_active":"2024-09-21T07:12:14.806593+0000","last_peered":"2024-09-21T07:12:14.806593+0000","last_clean":"2024-09-21T07:12:14.806593+0000","last_became_active":"2024-09-21T07:10:51.463828+0000","last_became_peered":"2024-09-21T07:10:51.463828+0000","last_unstale":"2024-09-21T07:12:14.806593+0000","last_undegraded":"2024-09-21T07:12:14.806593+0000","last_fullsized":"2024-09-21T07:12:14.806593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:09.580668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690229+0000","last_change":"2024-09-21T07:09:39.332523+0000","last_active":"2024-09-21T07:12:14.690229+0000","last_peered":"2024-09-21T07:12:14.690229+0000","last_clean":"2024-09-21T07:12:14.690229+0000","last_became_active":"2024-09-21T07:09:39.326582+0000","last_became_peered":"2024-09-21T07:09:39.326582+0000","last_unstale":"2024-09-21T07:12:14.690229+0000","last_undegraded":"2024-09-21T07:12:14.690229+0000","last_fullsized":"2024-09-21T07:12:14.690229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:06:12.748818+0000","last_clean_scrub_stamp":"2024-09-21T07:06:12.748818+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:53.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690079+0000","last_change":"2024-09-21T07:11:14.672044+0000","last_active":"2024-09-21T07:12:14.690079+0000","last_peered":"2024-09-21T07:12:14.690079+0000","last_clean":"2024-09-21T07:12:14.690079+0000","last_became_active":"2024-09-21T07:11:14.671513+0000","last_became_peered":"2024-09-21T07:11:14.671513+0000","last_unstale":"2024-09-21T07:12:14.690079+0000","last_undegraded":"2024-09-21T07:12:14.690079+0000","last_fullsized":"2024-09-21T07:12:14.690079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:09.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842250+0000","last_change":"2024-09-21T07:10:53.488678+0000","last_active":"2024-09-21T07:12:43.842250+0000","last_peered":"2024-09-21T07:12:43.842250+0000","last_clean":"2024-09-21T07:12:43.842250+0000","last_became_active":"2024-09-21T07:10:53.488304+0000","last_became_peered":"2024-09-21T07:10:53.488304+0000","last_unstale":"2024-09-21T07:12:43.842250+0000","last_undegraded":"2024-09-21T07:12:43.842250+0000","last_fullsized":"2024-09-21T07:12:43.842250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:37.696269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":168,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:30.934369+0000","last_change":"2024-09-21T07:10:52.123086+0000","last_active":"2024-09-21T07:13:30.934369+0000","last_peered":"2024-09-21T07:13:30.934369+0000","last_clean":"2024-09-21T07:13:30.934369+0000","last_became_active":"2024-09-21T07:10:52.122584+0000","last_became_peered":"2024-09-21T07:10:52.122584+0000","last_unstale":"2024-09-21T07:13:30.934369+0000","last_undegraded":"2024-09-21T07:13:30.934369+0000","last_fullsized":"2024-09-21T07:13:30.934369+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:28.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692332+0000","last_change":"2024-09-21T07:11:00.549595+0000","last_active":"2024-09-21T07:12:14.692332+0000","last_peered":"2024-09-21T07:12:14.692332+0000","last_clean":"2024-09-21T07:12:14.692332+0000","last_became_active":"2024-09-21T07:11:00.549009+0000","last_became_peered":"2024-09-21T07:11:00.549009+0000","last_unstale":"2024-09-21T07:12:14.692332+0000","last_undegraded":"2024-09-21T07:12:14.692332+0000","last_fullsized":"2024-09-21T07:12:14.692332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:59.825381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836215+0000","last_change":"2024-09-21T07:10:53.484336+0000","last_active":"2024-09-21T07:12:43.836215+0000","last_peered":"2024-09-21T07:12:43.836215+0000","last_clean":"2024-09-21T07:12:43.836215+0000","last_became_active":"2024-09-21T07:10:53.483825+0000","last_became_peered":"2024-09-21T07:10:53.483825+0000","last_unstale":"2024-09-21T07:12:43.836215+0000","last_undegraded":"2024-09-21T07:12:43.836215+0000","last_fullsized":"2024-09-21T07:12:43.836215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:51:20.545339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'62","reported_seq":132,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.871180+0000","last_change":"2024-09-21T07:10:51.461297+0000","last_active":"2024-09-21T07:13:27.871180+0000","last_peered":"2024-09-21T07:13:27.871180+0000","last_clean":"2024-09-21T07:13:27.871180+0000","last_became_active":"2024-09-21T07:10:51.460600+0000","last_became_peered":"2024-09-21T07:10:51.460600+0000","last_unstale":"2024-09-21T07:13:27.871180+0000","last_undegraded":"2024-09-21T07:13:27.871180+0000","last_fullsized":"2024-09-21T07:13:27.871180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:34.955250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998589+0000","last_change":"2024-09-21T07:11:00.551652+0000","last_active":"2024-09-21T07:12:14.998589+0000","last_peered":"2024-09-21T07:12:14.998589+0000","last_clean":"2024-09-21T07:12:14.998589+0000","last_became_active":"2024-09-21T07:11:00.551236+0000","last_became_peered":"2024-09-21T07:11:00.551236+0000","last_unstale":"2024-09-21T07:12:14.998589+0000","last_undegraded":"2024-09-21T07:12:14.998589+0000","last_fullsized":"2024-09-21T07:12:14.998589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:28.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833526+0000","last_change":"2024-09-21T07:10:53.487605+0000","last_active":"2024-09-21T07:12:43.833526+0000","last_peered":"2024-09-21T07:12:43.833526+0000","last_clean":"2024-09-21T07:12:43.833526+0000","last_became_active":"2024-09-21T07:10:53.487245+0000","last_became_peered":"2024-09-21T07:10:53.487245+0000","last_unstale":"2024-09-21T07:12:43.833526+0000","last_undegraded":"2024-09-21T07:12:43.833526+0000","last_fullsized":"2024-09-21T07:12:43.833526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:24.490652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686405+0000","last_change":"2024-09-21T07:10:51.456920+0000","last_active":"2024-09-21T07:12:14.686405+0000","last_peered":"2024-09-21T07:12:14.686405+0000","last_clean":"2024-09-21T07:12:14.686405+0000","last_became_active":"2024-09-21T07:10:51.456500+0000","last_became_peered":"2024-09-21T07:10:51.456500+0000","last_unstale":"2024-09-21T07:12:14.686405+0000","last_undegraded":"2024-09-21T07:12:14.686405+0000","last_fullsized":"2024-09-21T07:12:14.686405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:07.663192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690452+0000","last_change":"2024-09-21T07:11:00.552115+0000","last_active":"2024-09-21T07:12:14.690452+0000","last_peered":"2024-09-21T07:12:14.690452+0000","last_clean":"2024-09-21T07:12:14.690452+0000","last_became_active":"2024-09-21T07:11:00.551647+0000","last_became_peered":"2024-09-21T07:11:00.551647+0000","last_unstale":"2024-09-21T07:12:14.690452+0000","last_undegraded":"2024-09-21T07:12:14.690452+0000","last_fullsized":"2024-09-21T07:12:14.690452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:13.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.834739+0000","last_change":"2024-09-21T07:11:14.671714+0000","last_active":"2024-09-21T07:12:43.834739+0000","last_peered":"2024-09-21T07:12:43.834739+0000","last_clean":"2024-09-21T07:12:43.834739+0000","last_became_active":"2024-09-21T07:11:14.671248+0000","last_became_peered":"2024-09-21T07:11:14.671248+0000","last_unstale":"2024-09-21T07:12:43.834739+0000","last_undegraded":"2024-09-21T07:12:43.834739+0000","last_fullsized":"2024-09-21T07:12:43.834739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:36.599916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:16.725429+0000","last_change":"2024-09-21T07:10:51.464710+0000","last_active":"2024-09-21T07:13:16.725429+0000","last_peered":"2024-09-21T07:13:16.725429+0000","last_clean":"2024-09-21T07:13:16.725429+0000","last_became_active":"2024-09-21T07:10:51.464295+0000","last_became_peered":"2024-09-21T07:10:51.464295+0000","last_unstale":"2024-09-21T07:13:16.725429+0000","last_undegraded":"2024-09-21T07:13:16.725429+0000","last_fullsized":"2024-09-21T07:13:16.725429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:00.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691150+0000","last_change":"2024-09-21T07:11:00.548275+0000","last_active":"2024-09-21T07:12:14.691150+0000","last_peered":"2024-09-21T07:12:14.691150+0000","last_clean":"2024-09-21T07:12:14.691150+0000","last_became_active":"2024-09-21T07:11:00.547777+0000","last_became_peered":"2024-09-21T07:11:00.547777+0000","last_unstale":"2024-09-21T07:12:14.691150+0000","last_undegraded":"2024-09-21T07:12:14.691150+0000","last_fullsized":"2024-09-21T07:12:14.691150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:13.860131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840327+0000","last_change":"2024-09-21T07:10:53.494072+0000","last_active":"2024-09-21T07:12:43.840327+0000","last_peered":"2024-09-21T07:12:43.840327+0000","last_clean":"2024-09-21T07:12:43.840327+0000","last_became_active":"2024-09-21T07:10:53.493493+0000","last_became_peered":"2024-09-21T07:10:53.493493+0000","last_unstale":"2024-09-21T07:12:43.840327+0000","last_undegraded":"2024-09-21T07:12:43.840327+0000","last_fullsized":"2024-09-21T07:12:43.840327+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.846641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":58,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.692149+0000","last_change":"2024-09-21T07:10:51.468145+0000","last_active":"2024-09-21T07:12:14.692149+0000","last_peered":"2024-09-21T07:12:14.692149+0000","last_clean":"2024-09-21T07:12:14.692149+0000","last_became_active":"2024-09-21T07:10:51.467757+0000","last_became_peered":"2024-09-21T07:10:51.467757+0000","last_unstale":"2024-09-21T07:12:14.692149+0000","last_undegraded":"2024-09-21T07:12:14.692149+0000","last_fullsized":"2024-09-21T07:12:14.692149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:39.150277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686272+0000","last_change":"2024-09-21T07:11:00.548394+0000","last_active":"2024-09-21T07:12:14.686272+0000","last_peered":"2024-09-21T07:12:14.686272+0000","last_clean":"2024-09-21T07:12:14.686272+0000","last_became_active":"2024-09-21T07:11:00.547972+0000","last_became_peered":"2024-09-21T07:11:00.547972+0000","last_unstale":"2024-09-21T07:12:14.686272+0000","last_undegraded":"2024-09-21T07:12:14.686272+0000","last_fullsized":"2024-09-21T07:12:14.686272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:35.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.819250+0000","last_change":"2024-09-21T07:11:14.659248+0000","last_active":"2024-09-21T07:12:43.819250+0000","last_peered":"2024-09-21T07:12:43.819250+0000","last_clean":"2024-09-21T07:12:43.819250+0000","last_became_active":"2024-09-21T07:11:14.658931+0000","last_became_peered":"2024-09-21T07:11:14.658931+0000","last_unstale":"2024-09-21T07:12:43.819250+0000","last_undegraded":"2024-09-21T07:12:43.819250+0000","last_fullsized":"2024-09-21T07:12:43.819250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:12.278964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'9","reported_seq":171,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.929539+0000","last_change":"2024-09-21T07:10:51.466302+0000","last_active":"2024-09-21T07:13:27.929539+0000","last_peered":"2024-09-21T07:13:27.929539+0000","last_clean":"2024-09-21T07:13:27.929539+0000","last_became_active":"2024-09-21T07:10:51.465906+0000","last_became_peered":"2024-09-21T07:10:51.465906+0000","last_unstale":"2024-09-21T07:13:27.929539+0000","last_undegraded":"2024-09-21T07:13:27.929539+0000","last_fullsized":"2024-09-21T07:13:27.929539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:39.616338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":7,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689541+0000","last_change":"2024-09-21T07:11:00.555600+0000","last_active":"2024-09-21T07:12:14.689541+0000","last_peered":"2024-09-21T07:12:14.689541+0000","last_clean":"2024-09-21T07:12:14.689541+0000","last_became_active":"2024-09-21T07:11:00.555203+0000","last_became_peered":"2024-09-21T07:11:00.555203+0000","last_unstale":"2024-09-21T07:12:14.689541+0000","last_undegraded":"2024-09-21T07:12:14.689541+0000","last_fullsized":"2024-09-21T07:12:14.689541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.321019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838290+0000","last_change":"2024-09-21T07:10:53.482493+0000","last_active":"2024-09-21T07:12:43.838290+0000","last_peered":"2024-09-21T07:12:43.838290+0000","last_clean":"2024-09-21T07:12:43.838290+0000","last_became_active":"2024-09-21T07:10:53.481310+0000","last_became_peered":"2024-09-21T07:10:53.481310+0000","last_unstale":"2024-09-21T07:12:43.838290+0000","last_undegraded":"2024-09-21T07:12:43.838290+0000","last_fullsized":"2024-09-21T07:12:43.838290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:41.288008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691304+0000","last_change":"2024-09-21T07:10:51.468189+0000","last_active":"2024-09-21T07:12:14.691304+0000","last_peered":"2024-09-21T07:12:14.691304+0000","last_clean":"2024-09-21T07:12:14.691304+0000","last_became_active":"2024-09-21T07:10:51.467770+0000","last_became_peered":"2024-09-21T07:10:51.467770+0000","last_unstale":"2024-09-21T07:12:14.691304+0000","last_undegraded":"2024-09-21T07:12:14.691304+0000","last_fullsized":"2024-09-21T07:12:14.691304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:53.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689382+0000","last_change":"2024-09-21T07:11:00.556306+0000","last_active":"2024-09-21T07:12:14.689382+0000","last_peered":"2024-09-21T07:12:14.689382+0000","last_clean":"2024-09-21T07:12:14.689382+0000","last_became_active":"2024-09-21T07:11:00.555770+0000","last_became_peered":"2024-09-21T07:11:00.555770+0000","last_unstale":"2024-09-21T07:12:14.689382+0000","last_undegraded":"2024-09-21T07:12:14.689382+0000","last_fullsized":"2024-09-21T07:12:14.689382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:38:19.438869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839202+0000","last_change":"2024-09-21T07:10:53.485039+0000","last_active":"2024-09-21T07:12:43.839202+0000","last_peered":"2024-09-21T07:12:43.839202+0000","last_clean":"2024-09-21T07:12:43.839202+0000","last_became_active":"2024-09-21T07:10:53.484672+0000","last_became_peered":"2024-09-21T07:10:53.484672+0000","last_unstale":"2024-09-21T07:12:43.839202+0000","last_undegraded":"2024-09-21T07:12:43.839202+0000","last_fullsized":"2024-09-21T07:12:43.839202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:28.291602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.709692+0000","last_change":"2024-09-21T07:12:14.709213+0000","last_active":"2024-09-21T07:12:14.709692+0000","last_peered":"2024-09-21T07:12:14.709692+0000","last_clean":"2024-09-21T07:12:14.709692+0000","last_became_active":"2024-09-21T07:12:14.693406+0000","last_became_peered":"2024-09-21T07:12:14.693406+0000","last_unstale":"2024-09-21T07:12:14.709692+0000","last_undegraded":"2024-09-21T07:12:14.709692+0000","last_fullsized":"2024-09-21T07:12:14.709692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:25.204575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687428+0000","last_change":"2024-09-21T07:11:14.672269+0000","last_active":"2024-09-21T07:12:14.687428+0000","last_peered":"2024-09-21T07:12:14.687428+0000","last_clean":"2024-09-21T07:12:14.687428+0000","last_became_active":"2024-09-21T07:11:14.671740+0000","last_became_peered":"2024-09-21T07:11:14.671740+0000","last_unstale":"2024-09-21T07:12:14.687428+0000","last_undegraded":"2024-09-21T07:12:14.687428+0000","last_fullsized":"2024-09-21T07:12:14.687428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.600585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831681+0000","last_change":"2024-09-21T07:10:53.487667+0000","last_active":"2024-09-21T07:12:43.831681+0000","last_peered":"2024-09-21T07:12:43.831681+0000","last_clean":"2024-09-21T07:12:43.831681+0000","last_became_active":"2024-09-21T07:10:53.487316+0000","last_became_peered":"2024-09-21T07:10:53.487316+0000","last_unstale":"2024-09-21T07:12:43.831681+0000","last_undegraded":"2024-09-21T07:12:43.831681+0000","last_fullsized":"2024-09-21T07:12:43.831681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:33.545631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'41","reported_seq":331,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:31.920163+0000","last_change":"2024-09-21T07:10:51.465172+0000","last_active":"2024-09-21T07:13:31.920163+0000","last_peered":"2024-09-21T07:13:31.920163+0000","last_clean":"2024-09-21T07:13:31.920163+0000","last_became_active":"2024-09-21T07:10:51.464655+0000","last_became_peered":"2024-09-21T07:10:51.464655+0000","last_unstale":"2024-09-21T07:13:31.920163+0000","last_undegraded":"2024-09-21T07:13:31.920163+0000","last_fullsized":"2024-09-21T07:13:31.920163+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:02.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74214,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":200,"num_write":43,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.686973+0000","last_change":"2024-09-21T07:11:14.671892+0000","last_active":"2024-09-21T07:12:14.686973+0000","last_peered":"2024-09-21T07:12:14.686973+0000","last_clean":"2024-09-21T07:12:14.686973+0000","last_became_active":"2024-09-21T07:11:14.671283+0000","last_became_peered":"2024-09-21T07:11:14.671283+0000","last_unstale":"2024-09-21T07:12:14.686973+0000","last_undegraded":"2024-09-21T07:12:14.686973+0000","last_fullsized":"2024-09-21T07:12:14.686973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:54.263127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839267+0000","last_change":"2024-09-21T07:10:53.491873+0000","last_active":"2024-09-21T07:12:43.839267+0000","last_peered":"2024-09-21T07:12:43.839267+0000","last_clean":"2024-09-21T07:12:43.839267+0000","last_became_active":"2024-09-21T07:10:53.491424+0000","last_became_peered":"2024-09-21T07:10:53.491424+0000","last_unstale":"2024-09-21T07:12:43.839267+0000","last_undegraded":"2024-09-21T07:12:43.839267+0000","last_fullsized":"2024-09-21T07:12:43.839267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.145391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691247+0000","last_change":"2024-09-21T07:10:51.469395+0000","last_active":"2024-09-21T07:12:14.691247+0000","last_peered":"2024-09-21T07:12:14.691247+0000","last_clean":"2024-09-21T07:12:14.691247+0000","last_became_active":"2024-09-21T07:10:51.469015+0000","last_became_peered":"2024-09-21T07:10:51.469015+0000","last_unstale":"2024-09-21T07:12:14.691247+0000","last_undegraded":"2024-09-21T07:12:14.691247+0000","last_fullsized":"2024-09-21T07:12:14.691247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:11.274950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.806089+0000","last_change":"2024-09-21T07:11:00.553164+0000","last_active":"2024-09-21T07:12:14.806089+0000","last_peered":"2024-09-21T07:12:14.806089+0000","last_clean":"2024-09-21T07:12:14.806089+0000","last_became_active":"2024-09-21T07:11:00.551969+0000","last_became_peered":"2024-09-21T07:11:00.551969+0000","last_unstale":"2024-09-21T07:12:14.806089+0000","last_undegraded":"2024-09-21T07:12:14.806089+0000","last_fullsized":"2024-09-21T07:12:14.806089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:53.042065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842195+0000","last_change":"2024-09-21T07:10:53.497110+0000","last_active":"2024-09-21T07:12:43.842195+0000","last_peered":"2024-09-21T07:12:43.842195+0000","last_clean":"2024-09-21T07:12:43.842195+0000","last_became_active":"2024-09-21T07:10:53.496751+0000","last_became_peered":"2024-09-21T07:10:53.496751+0000","last_unstale":"2024-09-21T07:12:43.842195+0000","last_undegraded":"2024-09-21T07:12:43.842195+0000","last_fullsized":"2024-09-21T07:12:43.842195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:02.531652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.812563+0000","last_change":"2024-09-21T07:12:14.811962+0000","last_active":"2024-09-21T07:12:14.812563+0000","last_peered":"2024-09-21T07:12:14.812563+0000","last_clean":"2024-09-21T07:12:14.812563+0000","last_became_active":"2024-09-21T07:12:14.807745+0000","last_became_peered":"2024-09-21T07:12:14.807745+0000","last_unstale":"2024-09-21T07:12:14.812563+0000","last_undegraded":"2024-09-21T07:12:14.812563+0000","last_fullsized":"2024-09-21T07:12:14.812563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:20.292633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691946+0000","last_change":"2024-09-21T07:11:14.655255+0000","last_active":"2024-09-21T07:12:14.691946+0000","last_peered":"2024-09-21T07:12:14.691946+0000","last_clean":"2024-09-21T07:12:14.691946+0000","last_became_active":"2024-09-21T07:11:14.654556+0000","last_became_peered":"2024-09-21T07:11:14.654556+0000","last_unstale":"2024-09-21T07:12:14.691946+0000","last_undegraded":"2024-09-21T07:12:14.691946+0000","last_fullsized":"2024-09-21T07:12:14.691946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:44.435834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843700+0000","last_change":"2024-09-21T07:10:53.484990+0000","last_active":"2024-09-21T07:12:43.843700+0000","last_peered":"2024-09-21T07:12:43.843700+0000","last_clean":"2024-09-21T07:12:43.843700+0000","last_became_active":"2024-09-21T07:10:53.484570+0000","last_became_peered":"2024-09-21T07:10:53.484570+0000","last_unstale":"2024-09-21T07:12:43.843700+0000","last_undegraded":"2024-09-21T07:12:43.843700+0000","last_fullsized":"2024-09-21T07:12:43.843700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:28.848203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":284,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:31.920163+0000","last_change":"2024-09-21T07:10:51.463378+0000","last_active":"2024-09-21T07:13:31.920163+0000","last_peered":"2024-09-21T07:13:31.920163+0000","last_clean":"2024-09-21T07:13:31.920163+0000","last_became_active":"2024-09-21T07:10:51.462961+0000","last_became_peered":"2024-09-21T07:10:51.462961+0000","last_unstale":"2024-09-21T07:13:31.920163+0000","last_undegraded":"2024-09-21T07:13:31.920163+0000","last_fullsized":"2024-09-21T07:13:31.920163+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:22.637603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":238,"num_read_kb":238,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.691393+0000","last_change":"2024-09-21T07:11:00.549758+0000","last_active":"2024-09-21T07:12:14.691393+0000","last_peered":"2024-09-21T07:12:14.691393+0000","last_clean":"2024-09-21T07:12:14.691393+0000","last_became_active":"2024-09-21T07:11:00.549141+0000","last_became_peered":"2024-09-21T07:11:00.549141+0000","last_unstale":"2024-09-21T07:12:14.691393+0000","last_undegraded":"2024-09-21T07:12:14.691393+0000","last_fullsized":"2024-09-21T07:12:14.691393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:27.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.998447+0000","last_change":"2024-09-21T07:11:00.550407+0000","last_active":"2024-09-21T07:12:14.998447+0000","last_peered":"2024-09-21T07:12:14.998447+0000","last_clean":"2024-09-21T07:12:14.998447+0000","last_became_active":"2024-09-21T07:11:00.549930+0000","last_became_peered":"2024-09-21T07:11:00.549930+0000","last_unstale":"2024-09-21T07:12:14.998447+0000","last_undegraded":"2024-09-21T07:12:14.998447+0000","last_fullsized":"2024-09-21T07:12:14.998447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:25.924695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.841002+0000","last_change":"2024-09-21T07:10:53.491452+0000","last_active":"2024-09-21T07:12:43.841002+0000","last_peered":"2024-09-21T07:12:43.841002+0000","last_clean":"2024-09-21T07:12:43.841002+0000","last_became_active":"2024-09-21T07:10:53.491106+0000","last_became_peered":"2024-09-21T07:10:53.491106+0000","last_unstale":"2024-09-21T07:12:43.841002+0000","last_undegraded":"2024-09-21T07:12:43.841002+0000","last_fullsized":"2024-09-21T07:12:43.841002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:58.270323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.690834+0000","last_change":"2024-09-21T07:10:51.468433+0000","last_active":"2024-09-21T07:12:14.690834+0000","last_peered":"2024-09-21T07:12:14.690834+0000","last_clean":"2024-09-21T07:12:14.690834+0000","last_became_active":"2024-09-21T07:10:51.467810+0000","last_became_peered":"2024-09-21T07:10:51.467810+0000","last_unstale":"2024-09-21T07:12:14.690834+0000","last_undegraded":"2024-09-21T07:12:14.690834+0000","last_fullsized":"2024-09-21T07:12:14.690834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.787584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.689774+0000","last_change":"2024-09-21T07:11:00.556866+0000","last_active":"2024-09-21T07:12:14.689774+0000","last_peered":"2024-09-21T07:12:14.689774+0000","last_clean":"2024-09-21T07:12:14.689774+0000","last_became_active":"2024-09-21T07:11:00.555350+0000","last_became_peered":"2024-09-21T07:11:00.555350+0000","last_unstale":"2024-09-21T07:12:14.689774+0000","last_undegraded":"2024-09-21T07:12:14.689774+0000","last_fullsized":"2024-09-21T07:12:14.689774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:46.296771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830636+0000","last_change":"2024-09-21T07:10:53.487210+0000","last_active":"2024-09-21T07:12:43.830636+0000","last_peered":"2024-09-21T07:12:43.830636+0000","last_clean":"2024-09-21T07:12:43.830636+0000","last_became_active":"2024-09-21T07:10:53.485975+0000","last_became_peered":"2024-09-21T07:10:53.485975+0000","last_unstale":"2024-09-21T07:12:43.830636+0000","last_undegraded":"2024-09-21T07:12:43.830636+0000","last_fullsized":"2024-09-21T07:12:43.830636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:46.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.685994+0000","last_change":"2024-09-21T07:10:51.456418+0000","last_active":"2024-09-21T07:12:14.685994+0000","last_peered":"2024-09-21T07:12:14.685994+0000","last_clean":"2024-09-21T07:12:14.685994+0000","last_became_active":"2024-09-21T07:10:51.455885+0000","last_became_peered":"2024-09-21T07:10:51.455885+0000","last_unstale":"2024-09-21T07:12:14.685994+0000","last_undegraded":"2024-09-21T07:12:14.685994+0000","last_fullsized":"2024-09-21T07:12:14.685994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:53.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687514+0000","last_change":"2024-09-21T07:10:51.462544+0000","last_active":"2024-09-21T07:12:14.687514+0000","last_peered":"2024-09-21T07:12:14.687514+0000","last_clean":"2024-09-21T07:12:14.687514+0000","last_became_active":"2024-09-21T07:10:51.462075+0000","last_became_peered":"2024-09-21T07:10:51.462075+0000","last_unstale":"2024-09-21T07:12:14.687514+0000","last_undegraded":"2024-09-21T07:12:14.687514+0000","last_fullsized":"2024-09-21T07:12:14.687514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:09.121402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839085+0000","last_change":"2024-09-21T07:12:14.694814+0000","last_active":"2024-09-21T07:12:43.839085+0000","last_peered":"2024-09-21T07:12:43.839085+0000","last_clean":"2024-09-21T07:12:43.839085+0000","last_became_active":"2024-09-21T07:12:14.694334+0000","last_became_peered":"2024-09-21T07:12:14.694334+0000","last_unstale":"2024-09-21T07:12:43.839085+0000","last_undegraded":"2024-09-21T07:12:43.839085+0000","last_fullsized":"2024-09-21T07:12:43.839085+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:33.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687113+0000","last_change":"2024-09-21T07:11:00.552908+0000","last_active":"2024-09-21T07:12:14.687113+0000","last_peered":"2024-09-21T07:12:14.687113+0000","last_clean":"2024-09-21T07:12:14.687113+0000","last_became_active":"2024-09-21T07:11:00.552303+0000","last_became_peered":"2024-09-21T07:11:00.552303+0000","last_unstale":"2024-09-21T07:12:14.687113+0000","last_undegraded":"2024-09-21T07:12:14.687113+0000","last_fullsized":"2024-09-21T07:12:14.687113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'8","reported_seq":169,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:13:27.914322+0000","last_change":"2024-09-21T07:10:51.467072+0000","last_active":"2024-09-21T07:13:27.914322+0000","last_peered":"2024-09-21T07:13:27.914322+0000","last_clean":"2024-09-21T07:13:27.914322+0000","last_became_active":"2024-09-21T07:10:51.466671+0000","last_became_peered":"2024-09-21T07:10:51.466671+0000","last_unstale":"2024-09-21T07:13:27.914322+0000","last_undegraded":"2024-09-21T07:13:27.914322+0000","last_fullsized":"2024-09-21T07:13:27.914322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:50.439475+0000","last_clean_scrub_stamp":"2024-09-21T07:10:50.439475+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:24.519035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833933+0000","last_change":"2024-09-21T07:10:53.480057+0000","last_active":"2024-09-21T07:12:43.833933+0000","last_peered":"2024-09-21T07:12:43.833933+0000","last_clean":"2024-09-21T07:12:43.833933+0000","last_became_active":"2024-09-21T07:10:53.479644+0000","last_became_peered":"2024-09-21T07:10:53.479644+0000","last_unstale":"2024-09-21T07:12:43.833933+0000","last_undegraded":"2024-09-21T07:12:43.833933+0000","last_fullsized":"2024-09-21T07:12:43.833933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:34.255547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:14.687396+0000","last_change":"2024-09-21T07:11:00.550259+0000","last_active":"2024-09-21T07:12:14.687396+0000","last_peered":"2024-09-21T07:12:14.687396+0000","last_clean":"2024-09-21T07:12:14.687396+0000","last_became_active":"2024-09-21T07:11:00.549771+0000","last_became_peered":"2024-09-21T07:11:00.549771+0000","last_unstale":"2024-09-21T07:12:14.687396+0000","last_undegraded":"2024-09-21T07:12:14.687396+0000","last_fullsized":"2024-09-21T07:12:14.687396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:59.512978+0000","last_clean_scrub_stamp":"2024-09-21T07:10:59.512978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.038085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839385+0000","last_change":"2024-09-21T07:10:53.488022+0000","last_active":"2024-09-21T07:12:43.839385+0000","last_peered":"2024-09-21T07:12:43.839385+0000","last_clean":"2024-09-21T07:12:43.839385+0000","last_became_active":"2024-09-21T07:10:53.487605+0000","last_became_peered":"2024-09-21T07:10:53.487605+0000","last_unstale":"2024-09-21T07:12:43.839385+0000","last_undegraded":"2024-09-21T07:12:43.839385+0000","last_fullsized":"2024-09-21T07:12:43.839385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:02.074960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833306+0000","last_change":"2024-09-21T07:10:53.484319+0000","last_active":"2024-09-21T07:12:43.833306+0000","last_peered":"2024-09-21T07:12:43.833306+0000","last_clean":"2024-09-21T07:12:43.833306+0000","last_became_active":"2024-09-21T07:10:53.483942+0000","last_became_peered":"2024-09-21T07:10:53.483942+0000","last_unstale":"2024-09-21T07:12:43.833306+0000","last_undegraded":"2024-09-21T07:12:43.833306+0000","last_fullsized":"2024-09-21T07:12:43.833306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:50.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840566+0000","last_change":"2024-09-21T07:10:53.494981+0000","last_active":"2024-09-21T07:12:43.840566+0000","last_peered":"2024-09-21T07:12:43.840566+0000","last_clean":"2024-09-21T07:12:43.840566+0000","last_became_active":"2024-09-21T07:10:53.494580+0000","last_became_peered":"2024-09-21T07:10:53.494580+0000","last_unstale":"2024-09-21T07:12:43.840566+0000","last_undegraded":"2024-09-21T07:12:43.840566+0000","last_fullsized":"2024-09-21T07:12:43.840566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:57.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842588+0000","last_change":"2024-09-21T07:10:53.492971+0000","last_active":"2024-09-21T07:12:43.842588+0000","last_peered":"2024-09-21T07:12:43.842588+0000","last_clean":"2024-09-21T07:12:43.842588+0000","last_became_active":"2024-09-21T07:10:53.492597+0000","last_became_peered":"2024-09-21T07:10:53.492597+0000","last_unstale":"2024-09-21T07:12:43.842588+0000","last_undegraded":"2024-09-21T07:12:43.842588+0000","last_fullsized":"2024-09-21T07:12:43.842588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.931998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836994+0000","last_change":"2024-09-21T07:10:53.485613+0000","last_active":"2024-09-21T07:12:43.836994+0000","last_peered":"2024-09-21T07:12:43.836994+0000","last_clean":"2024-09-21T07:12:43.836994+0000","last_became_active":"2024-09-21T07:10:53.485268+0000","last_became_peered":"2024-09-21T07:10:53.485268+0000","last_unstale":"2024-09-21T07:12:43.836994+0000","last_undegraded":"2024-09-21T07:12:43.836994+0000","last_fullsized":"2024-09-21T07:12:43.836994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:52.496426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.831297+0000","last_change":"2024-09-21T07:10:53.489349+0000","last_active":"2024-09-21T07:12:43.831297+0000","last_peered":"2024-09-21T07:12:43.831297+0000","last_clean":"2024-09-21T07:12:43.831297+0000","last_became_active":"2024-09-21T07:10:53.488986+0000","last_became_peered":"2024-09-21T07:10:53.488986+0000","last_unstale":"2024-09-21T07:12:43.831297+0000","last_undegraded":"2024-09-21T07:12:43.831297+0000","last_fullsized":"2024-09-21T07:12:43.831297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:46.376689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.832429+0000","last_change":"2024-09-21T07:10:53.485740+0000","last_active":"2024-09-21T07:12:43.832429+0000","last_peered":"2024-09-21T07:12:43.832429+0000","last_clean":"2024-09-21T07:12:43.832429+0000","last_became_active":"2024-09-21T07:10:53.485375+0000","last_became_peered":"2024-09-21T07:10:53.485375+0000","last_unstale":"2024-09-21T07:12:43.832429+0000","last_undegraded":"2024-09-21T07:12:43.832429+0000","last_fullsized":"2024-09-21T07:12:43.832429+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:40.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838894+0000","last_change":"2024-09-21T07:10:53.490211+0000","last_active":"2024-09-21T07:12:43.838894+0000","last_peered":"2024-09-21T07:12:43.838894+0000","last_clean":"2024-09-21T07:12:43.838894+0000","last_became_active":"2024-09-21T07:10:53.489504+0000","last_became_peered":"2024-09-21T07:10:53.489504+0000","last_unstale":"2024-09-21T07:12:43.838894+0000","last_undegraded":"2024-09-21T07:12:43.838894+0000","last_fullsized":"2024-09-21T07:12:43.838894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:50.337307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.837945+0000","last_change":"2024-09-21T07:10:53.486064+0000","last_active":"2024-09-21T07:12:43.837945+0000","last_peered":"2024-09-21T07:12:43.837945+0000","last_clean":"2024-09-21T07:12:43.837945+0000","last_became_active":"2024-09-21T07:10:53.485674+0000","last_became_peered":"2024-09-21T07:10:53.485674+0000","last_unstale":"2024-09-21T07:12:43.837945+0000","last_undegraded":"2024-09-21T07:12:43.837945+0000","last_fullsized":"2024-09-21T07:12:43.837945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:55.232795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838941+0000","last_change":"2024-09-21T07:10:53.489008+0000","last_active":"2024-09-21T07:12:43.838941+0000","last_peered":"2024-09-21T07:12:43.838941+0000","last_clean":"2024-09-21T07:12:43.838941+0000","last_became_active":"2024-09-21T07:10:53.488655+0000","last_became_peered":"2024-09-21T07:10:53.488655+0000","last_unstale":"2024-09-21T07:12:43.838941+0000","last_undegraded":"2024-09-21T07:12:43.838941+0000","last_fullsized":"2024-09-21T07:12:43.838941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:42.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843962+0000","last_change":"2024-09-21T07:10:53.490147+0000","last_active":"2024-09-21T07:12:43.843962+0000","last_peered":"2024-09-21T07:12:43.843962+0000","last_clean":"2024-09-21T07:12:43.843962+0000","last_became_active":"2024-09-21T07:10:53.488389+0000","last_became_peered":"2024-09-21T07:10:53.488389+0000","last_unstale":"2024-09-21T07:12:43.843962+0000","last_undegraded":"2024-09-21T07:12:43.843962+0000","last_fullsized":"2024-09-21T07:12:43.843962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:17.729856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840459+0000","last_change":"2024-09-21T07:10:53.486557+0000","last_active":"2024-09-21T07:12:43.840459+0000","last_peered":"2024-09-21T07:12:43.840459+0000","last_clean":"2024-09-21T07:12:43.840459+0000","last_became_active":"2024-09-21T07:10:53.486248+0000","last_became_peered":"2024-09-21T07:10:53.486248+0000","last_unstale":"2024-09-21T07:12:43.840459+0000","last_undegraded":"2024-09-21T07:12:43.840459+0000","last_fullsized":"2024-09-21T07:12:43.840459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.675717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.833816+0000","last_change":"2024-09-21T07:10:53.485281+0000","last_active":"2024-09-21T07:12:43.833816+0000","last_peered":"2024-09-21T07:12:43.833816+0000","last_clean":"2024-09-21T07:12:43.833816+0000","last_became_active":"2024-09-21T07:10:53.484732+0000","last_became_peered":"2024-09-21T07:10:53.484732+0000","last_unstale":"2024-09-21T07:12:43.833816+0000","last_undegraded":"2024-09-21T07:12:43.833816+0000","last_fullsized":"2024-09-21T07:12:43.833816+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:53.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836869+0000","last_change":"2024-09-21T07:10:53.483192+0000","last_active":"2024-09-21T07:12:43.836869+0000","last_peered":"2024-09-21T07:12:43.836869+0000","last_clean":"2024-09-21T07:12:43.836869+0000","last_became_active":"2024-09-21T07:10:53.482402+0000","last_became_peered":"2024-09-21T07:10:53.482402+0000","last_unstale":"2024-09-21T07:12:43.836869+0000","last_undegraded":"2024-09-21T07:12:43.836869+0000","last_fullsized":"2024-09-21T07:12:43.836869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.159873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843080+0000","last_change":"2024-09-21T07:10:53.481463+0000","last_active":"2024-09-21T07:12:43.843080+0000","last_peered":"2024-09-21T07:12:43.843080+0000","last_clean":"2024-09-21T07:12:43.843080+0000","last_became_active":"2024-09-21T07:10:53.481129+0000","last_became_peered":"2024-09-21T07:10:53.481129+0000","last_unstale":"2024-09-21T07:12:43.843080+0000","last_undegraded":"2024-09-21T07:12:43.843080+0000","last_fullsized":"2024-09-21T07:12:43.843080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:14.547936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840480+0000","last_change":"2024-09-21T07:10:53.493009+0000","last_active":"2024-09-21T07:12:43.840480+0000","last_peered":"2024-09-21T07:12:43.840480+0000","last_clean":"2024-09-21T07:12:43.840480+0000","last_became_active":"2024-09-21T07:10:53.492300+0000","last_became_peered":"2024-09-21T07:10:53.492300+0000","last_unstale":"2024-09-21T07:12:43.840480+0000","last_undegraded":"2024-09-21T07:12:43.840480+0000","last_fullsized":"2024-09-21T07:12:43.840480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:09.890248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.843437+0000","last_change":"2024-09-21T07:10:53.491149+0000","last_active":"2024-09-21T07:12:43.843437+0000","last_peered":"2024-09-21T07:12:43.843437+0000","last_clean":"2024-09-21T07:12:43.843437+0000","last_became_active":"2024-09-21T07:10:53.490766+0000","last_became_peered":"2024-09-21T07:10:53.490766+0000","last_unstale":"2024-09-21T07:12:43.843437+0000","last_undegraded":"2024-09-21T07:12:43.843437+0000","last_fullsized":"2024-09-21T07:12:43.843437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:52.243083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840492+0000","last_change":"2024-09-21T07:11:14.672453+0000","last_active":"2024-09-21T07:12:43.840492+0000","last_peered":"2024-09-21T07:12:43.840492+0000","last_clean":"2024-09-21T07:12:43.840492+0000","last_became_active":"2024-09-21T07:11:14.671584+0000","last_became_peered":"2024-09-21T07:11:14.671584+0000","last_unstale":"2024-09-21T07:12:43.840492+0000","last_undegraded":"2024-09-21T07:12:43.840492+0000","last_fullsized":"2024-09-21T07:12:43.840492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:25.746195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839098+0000","last_change":"2024-09-21T07:10:53.496332+0000","last_active":"2024-09-21T07:12:43.839098+0000","last_peered":"2024-09-21T07:12:43.839098+0000","last_clean":"2024-09-21T07:12:43.839098+0000","last_became_active":"2024-09-21T07:10:53.495078+0000","last_became_peered":"2024-09-21T07:10:53.495078+0000","last_unstale":"2024-09-21T07:12:43.839098+0000","last_undegraded":"2024-09-21T07:12:43.839098+0000","last_fullsized":"2024-09-21T07:12:43.839098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:32.415350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.838131+0000","last_change":"2024-09-21T07:10:53.478381+0000","last_active":"2024-09-21T07:12:43.838131+0000","last_peered":"2024-09-21T07:12:43.838131+0000","last_clean":"2024-09-21T07:12:43.838131+0000","last_became_active":"2024-09-21T07:10:53.478021+0000","last_became_peered":"2024-09-21T07:10:53.478021+0000","last_unstale":"2024-09-21T07:12:43.838131+0000","last_undegraded":"2024-09-21T07:12:43.838131+0000","last_fullsized":"2024-09-21T07:12:43.838131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:02.496263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.821141+0000","last_change":"2024-09-21T07:10:53.485103+0000","last_active":"2024-09-21T07:12:43.821141+0000","last_peered":"2024-09-21T07:12:43.821141+0000","last_clean":"2024-09-21T07:12:43.821141+0000","last_became_active":"2024-09-21T07:10:53.483835+0000","last_became_peered":"2024-09-21T07:10:53.483835+0000","last_unstale":"2024-09-21T07:12:43.821141+0000","last_undegraded":"2024-09-21T07:12:43.821141+0000","last_fullsized":"2024-09-21T07:12:43.821141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:47.775202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842539+0000","last_change":"2024-09-21T07:10:53.490497+0000","last_active":"2024-09-21T07:12:43.842539+0000","last_peered":"2024-09-21T07:12:43.842539+0000","last_clean":"2024-09-21T07:12:43.842539+0000","last_became_active":"2024-09-21T07:10:53.490137+0000","last_became_peered":"2024-09-21T07:10:53.490137+0000","last_unstale":"2024-09-21T07:12:43.842539+0000","last_undegraded":"2024-09-21T07:12:43.842539+0000","last_fullsized":"2024-09-21T07:12:43.842539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:12.090628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.842305+0000","last_change":"2024-09-21T07:10:53.487118+0000","last_active":"2024-09-21T07:12:43.842305+0000","last_peered":"2024-09-21T07:12:43.842305+0000","last_clean":"2024-09-21T07:12:43.842305+0000","last_became_active":"2024-09-21T07:10:53.486582+0000","last_became_peered":"2024-09-21T07:10:53.486582+0000","last_unstale":"2024-09-21T07:12:43.842305+0000","last_undegraded":"2024-09-21T07:12:43.842305+0000","last_fullsized":"2024-09-21T07:12:43.842305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:00.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839468+0000","last_change":"2024-09-21T07:10:53.497390+0000","last_active":"2024-09-21T07:12:43.839468+0000","last_peered":"2024-09-21T07:12:43.839468+0000","last_clean":"2024-09-21T07:12:43.839468+0000","last_became_active":"2024-09-21T07:10:53.497043+0000","last_became_peered":"2024-09-21T07:10:53.497043+0000","last_unstale":"2024-09-21T07:12:43.839468+0000","last_undegraded":"2024-09-21T07:12:43.839468+0000","last_fullsized":"2024-09-21T07:12:43.839468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:36.912873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.829609+0000","last_change":"2024-09-21T07:10:53.484624+0000","last_active":"2024-09-21T07:12:43.829609+0000","last_peered":"2024-09-21T07:12:43.829609+0000","last_clean":"2024-09-21T07:12:43.829609+0000","last_became_active":"2024-09-21T07:10:53.484278+0000","last_became_peered":"2024-09-21T07:10:53.484278+0000","last_unstale":"2024-09-21T07:12:43.829609+0000","last_undegraded":"2024-09-21T07:12:43.829609+0000","last_fullsized":"2024-09-21T07:12:43.829609+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:41.464442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.836326+0000","last_change":"2024-09-21T07:10:53.478146+0000","last_active":"2024-09-21T07:12:43.836326+0000","last_peered":"2024-09-21T07:12:43.836326+0000","last_clean":"2024-09-21T07:12:43.836326+0000","last_became_active":"2024-09-21T07:10:53.477733+0000","last_became_peered":"2024-09-21T07:10:53.477733+0000","last_unstale":"2024-09-21T07:12:43.836326+0000","last_undegraded":"2024-09-21T07:12:43.836326+0000","last_fullsized":"2024-09-21T07:12:43.836326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:09.159966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839904+0000","last_change":"2024-09-21T07:11:14.657274+0000","last_active":"2024-09-21T07:12:43.839904+0000","last_peered":"2024-09-21T07:12:43.839904+0000","last_clean":"2024-09-21T07:12:43.839904+0000","last_became_active":"2024-09-21T07:11:14.656826+0000","last_became_peered":"2024-09-21T07:11:14.656826+0000","last_unstale":"2024-09-21T07:12:43.839904+0000","last_undegraded":"2024-09-21T07:12:43.839904+0000","last_fullsized":"2024-09-21T07:12:43.839904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.688373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.830242+0000","last_change":"2024-09-21T07:10:53.481411+0000","last_active":"2024-09-21T07:12:43.830242+0000","last_peered":"2024-09-21T07:12:43.830242+0000","last_clean":"2024-09-21T07:12:43.830242+0000","last_became_active":"2024-09-21T07:10:53.481005+0000","last_became_peered":"2024-09-21T07:10:53.481005+0000","last_unstale":"2024-09-21T07:12:43.830242+0000","last_undegraded":"2024-09-21T07:12:43.830242+0000","last_fullsized":"2024-09-21T07:12:43.830242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:41.751107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.823757+0000","last_change":"2024-09-21T07:10:53.487481+0000","last_active":"2024-09-21T07:12:43.823757+0000","last_peered":"2024-09-21T07:12:43.823757+0000","last_clean":"2024-09-21T07:12:43.823757+0000","last_became_active":"2024-09-21T07:10:53.486277+0000","last_became_peered":"2024-09-21T07:10:53.486277+0000","last_unstale":"2024-09-21T07:12:43.823757+0000","last_undegraded":"2024-09-21T07:12:43.823757+0000","last_fullsized":"2024-09-21T07:12:43.823757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:57.304382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840517+0000","last_change":"2024-09-21T07:10:53.495971+0000","last_active":"2024-09-21T07:12:43.840517+0000","last_peered":"2024-09-21T07:12:43.840517+0000","last_clean":"2024-09-21T07:12:43.840517+0000","last_became_active":"2024-09-21T07:10:53.495124+0000","last_became_peered":"2024-09-21T07:10:53.495124+0000","last_unstale":"2024-09-21T07:12:43.840517+0000","last_undegraded":"2024-09-21T07:12:43.840517+0000","last_fullsized":"2024-09-21T07:12:43.840517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.839940+0000","last_change":"2024-09-21T07:10:53.497538+0000","last_active":"2024-09-21T07:12:43.839940+0000","last_peered":"2024-09-21T07:12:43.839940+0000","last_clean":"2024-09-21T07:12:43.839940+0000","last_became_active":"2024-09-21T07:10:53.496835+0000","last_became_peered":"2024-09-21T07:10:53.496835+0000","last_unstale":"2024-09-21T07:12:43.839940+0000","last_undegraded":"2024-09-21T07:12:43.839940+0000","last_fullsized":"2024-09-21T07:12:43.839940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:17.187282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:12:43.840355+0000","last_change":"2024-09-21T07:10:53.492646+0000","last_active":"2024-09-21T07:12:43.840355+0000","last_peered":"2024-09-21T07:12:43.840355+0000","last_clean":"2024-09-21T07:12:43.840355+0000","last_became_active":"2024-09-21T07:10:53.491818+0000","last_became_peered":"2024-09-21T07:10:53.491818+0000","last_unstale":"2024-09-21T07:12:43.840355+0000","last_undegraded":"2024-09-21T07:12:43.840355+0000","last_fullsized":"2024-09-21T07:12:43.840355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:52.456263+0000","last_clean_scrub_stamp":"2024-09-21T07:10:52.456263+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:37.094158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":871055,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1567,"num_read_kb":1014,"num_write":504,"num_write_kb":2264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":68,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":835584,"data_stored":2613165,"data_compressed":112140,"data_compressed_allocated":147456,"data_compressed_original":2285568,"omap_allocated":0,"internal_metadata":0},"log_size":382,"ondisk_log_size":382,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283164,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710765,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":899963,"data_compressed":48876,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906995,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32336,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712816,"statfs":{"total":95995035648,"available":95961923584,"internally_reserved":0,"allocated":1175552,"data_stored":1566504,"data_compressed":83681,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070520,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":899332,"data_compressed":48876,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266749,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":506494,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462977,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1105534,"data_compressed":65590,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626501,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":502113,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822731,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36416,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708736,"statfs":{"total":95995035648,"available":95957745664,"internally_reserved":0,"allocated":1093632,"data_stored":1492983,"data_compressed":83681,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986257,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":507110,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182486,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1048576,"data_stored":1288320,"data_compressed":66967,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378715,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":578534,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":577357,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705766,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":983040,"data_stored":503569,"data_compressed":29587,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34383,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36003,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":76459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":77636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":787422,"data_compressed":37380,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":397621,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":471142,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394969,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:13:34.363 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:13:34.627 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:35.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.092+0000 7eff3afe6640 1 -- 172.21.15.92:0/2081158431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff34102a60 msgr2=0x7eff34102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:35.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.092+0000 7eff3afe6640 1 --2- 172.21.15.92:0/2081158431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff34102a60 0x7eff34102e70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7eff28009900 tx=0x7eff2802a410 comp rx=0 tx=0).stop 2024-09-21T07:13:35.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.092+0000 7eff3afe6640 1 -- 172.21.15.92:0/2081158431 shutdown_connections 2024-09-21T07:13:35.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.092+0000 7eff3afe6640 1 --2- 172.21.15.92:0/2081158431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff34108cf0 0x7eff3410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:35.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.092+0000 7eff3afe6640 1 --2- 172.21.15.92:0/2081158431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff341083a0 0x7eff341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:35.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.092+0000 7eff3afe6640 1 --2- 172.21.15.92:0/2081158431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff34102a60 0x7eff34102e70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:35.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.092+0000 7eff3afe6640 1 -- 172.21.15.92:0/2081158431 >> 172.21.15.92:0/2081158431 conn(0x7eff34079730 msgr2=0x7eff34079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:35.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.092+0000 7eff3afe6640 1 -- 172.21.15.92:0/2081158431 shutdown_connections 2024-09-21T07:13:35.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.092+0000 7eff3afe6640 1 -- 172.21.15.92:0/2081158431 wait complete. 2024-09-21T07:13:35.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff3afe6640 1 Processor -- start 2024-09-21T07:13:35.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff3afe6640 1 -- start start 2024-09-21T07:13:35.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff3afe6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff34102a60 0x7eff34199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:35.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff3afe6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff341083a0 0x7eff341998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:35.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff3afe6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34108cf0 0x7eff3419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:35.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff3afe6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7eff34112810 con 0x7eff341083a0 2024-09-21T07:13:35.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff3afe6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7eff34112690 con 0x7eff34102a60 2024-09-21T07:13:35.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff3afe6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff34112990 con 0x7eff34108cf0 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff341083a0 0x7eff341998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff341083a0 0x7eff341998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51002/0 (socket says 172.21.15.92:51002) 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff33fff640 1 -- 172.21.15.92:0/3659980380 learned_addr learned my addr 172.21.15.92:0/3659980380 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.093+0000 7eff38d82640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff34102a60 0x7eff34199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff39583640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34108cf0 0x7eff3419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff33fff640 1 -- 172.21.15.92:0/3659980380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34108cf0 msgr2=0x7eff3419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff33fff640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34108cf0 0x7eff3419eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff33fff640 1 -- 172.21.15.92:0/3659980380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff34102a60 msgr2=0x7eff34199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff33fff640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff34102a60 0x7eff34199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff33fff640 1 -- 172.21.15.92:0/3659980380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3419f270 con 0x7eff341083a0 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff33fff640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff341083a0 0x7eff341998a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7eff20007920 tx=0x7eff20007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff31ffb640 1 -- 172.21.15.92:0/3659980380 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2000e690 con 0x7eff341083a0 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff31ffb640 1 -- 172.21.15.92:0/3659980380 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff2000ecc0 con 0x7eff341083a0 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff3afe6640 1 -- 172.21.15.92:0/3659980380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3419f560 con 0x7eff341083a0 2024-09-21T07:13:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff31ffb640 1 -- 172.21.15.92:0/3659980380 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2000ab30 con 0x7eff341083a0 2024-09-21T07:13:35.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.094+0000 7eff3afe6640 1 -- 172.21.15.92:0/3659980380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3406ae60 con 0x7eff341083a0 2024-09-21T07:13:35.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.095+0000 7eff3afe6640 1 -- 172.21.15.92:0/3659980380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff34103ce0 con 0x7eff341083a0 2024-09-21T07:13:35.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.097+0000 7eff31ffb640 1 -- 172.21.15.92:0/3659980380 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7eff2000e830 con 0x7eff341083a0 2024-09-21T07:13:35.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.098+0000 7eff31ffb640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff240b6680 0x7eff240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:35.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.098+0000 7eff38d82640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff240b6680 0x7eff240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:35.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.098+0000 7eff31ffb640 1 -- 172.21.15.92:0/3659980380 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7eff200e9b20 con 0x7eff341083a0 2024-09-21T07:13:35.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.098+0000 7eff38d82640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff240b6680 0x7eff240b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff28000c00 tx=0x7eff28009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:35.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.101+0000 7eff31ffb640 1 -- 172.21.15.92:0/3659980380 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff200afc70 con 0x7eff341083a0 2024-09-21T07:13:35.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.323+0000 7eff3afe6640 1 -- 172.21.15.92:0/3659980380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff34102e70 con 0x7eff341083a0 2024-09-21T07:13:35.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.324+0000 7eff31ffb640 1 -- 172.21.15.92:0/3659980380 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7eff34102e70 con 0x7eff341083a0 2024-09-21T07:13:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:35.326 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:13:35.326 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:13:35.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 -- 172.21.15.92:0/3659980380 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff240b6680 msgr2=0x7eff240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:35.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff240b6680 0x7eff240b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff28000c00 tx=0x7eff28009680 comp rx=0 tx=0).stop 2024-09-21T07:13:35.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 -- 172.21.15.92:0/3659980380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff341083a0 msgr2=0x7eff341998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:35.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff341083a0 0x7eff341998a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7eff20007920 tx=0x7eff20007de0 comp rx=0 tx=0).stop 2024-09-21T07:13:35.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 -- 172.21.15.92:0/3659980380 shutdown_connections 2024-09-21T07:13:35.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff240b6680 0x7eff240b8b90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:35.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff34108cf0 0x7eff3419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:35.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff341083a0 0x7eff341998a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:35.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 --2- 172.21.15.92:0/3659980380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff34102a60 0x7eff34199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:35.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 -- 172.21.15.92:0/3659980380 >> 172.21.15.92:0/3659980380 conn(0x7eff34079730 msgr2=0x7eff34101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:35.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.326+0000 7eff3afe6640 1 -- 172.21.15.92:0/3659980380 shutdown_connections 2024-09-21T07:13:35.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:35.327+0000 7eff3afe6640 1 -- 172.21.15.92:0/3659980380 wait complete. 2024-09-21T07:13:35.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:35 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3659980380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:35.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:35 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3659980380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:35.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:35 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3659980380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:35.984 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:13:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:36.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:36 smithi092 ceph-mon[30987]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-09-21T07:13:36.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:36 smithi169 ceph-mon[33705]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-09-21T07:13:36.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.716+0000 7f7488cbc640 1 -- 172.21.15.92:0/3884373442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74841083a0 msgr2=0x7f74841087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:36.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.716+0000 7f7488cbc640 1 --2- 172.21.15.92:0/3884373442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74841083a0 0x7f74841087b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7478009900 tx=0x7f747802a410 comp rx=0 tx=0).stop 2024-09-21T07:13:36.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.716+0000 7f7488cbc640 1 -- 172.21.15.92:0/3884373442 shutdown_connections 2024-09-21T07:13:36.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.716+0000 7f7488cbc640 1 --2- 172.21.15.92:0/3884373442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7484108cf0 0x7f748410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:36.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.716+0000 7f7488cbc640 1 --2- 172.21.15.92:0/3884373442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74841083a0 0x7f74841087b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:36.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.716+0000 7f7488cbc640 1 --2- 172.21.15.92:0/3884373442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7484102a60 0x7f7484102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:36.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.716+0000 7f7488cbc640 1 -- 172.21.15.92:0/3884373442 >> 172.21.15.92:0/3884373442 conn(0x7f7484079730 msgr2=0x7f7484079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:36.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.716+0000 7f7488cbc640 1 -- 172.21.15.92:0/3884373442 shutdown_connections 2024-09-21T07:13:36.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.716+0000 7f7488cbc640 1 -- 172.21.15.92:0/3884373442 wait complete. 2024-09-21T07:13:36.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7488cbc640 1 Processor -- start 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7488cbc640 1 -- start start 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7488cbc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7484102a60 0x7f748419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7488cbc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841083a0 0x7f748419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7488cbc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484108cf0 0x7f748419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7488cbc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7484112810 con 0x7f7484108cf0 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7488cbc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7484112690 con 0x7f74841083a0 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7488cbc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7484112990 con 0x7f7484102a60 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7482d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484108cf0 0x7f748419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7482d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484108cf0 0x7f748419fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51018/0 (socket says 172.21.15.92:51018) 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.717+0000 7f7482d9d640 1 -- 172.21.15.92:0/2460627415 learned_addr learned my addr 172.21.15.92:0/2460627415 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f7481d9b640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841083a0 0x7f748419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f748259c640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7484102a60 0x7f748419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:36.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f7482d9d640 1 -- 172.21.15.92:0/2460627415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7484102a60 msgr2=0x7f748419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f7482d9d640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7484102a60 0x7f748419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f7482d9d640 1 -- 172.21.15.92:0/2460627415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841083a0 msgr2=0x7f748419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f7482d9d640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841083a0 0x7f748419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f7482d9d640 1 -- 172.21.15.92:0/2460627415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74841a0340 con 0x7f7484108cf0 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f7481d9b640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841083a0 0x7f748419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f7482d9d640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484108cf0 0x7f748419fc10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f747c00d950 tx=0x7f747c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f74737fe640 1 -- 172.21.15.92:0/2460627415 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c017030 con 0x7f7484108cf0 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f74737fe640 1 -- 172.21.15.92:0/2460627415 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f747c004020 con 0x7f7484108cf0 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f7488cbc640 1 -- 172.21.15.92:0/2460627415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74841a0630 con 0x7f7484108cf0 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f74737fe640 1 -- 172.21.15.92:0/2460627415 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c003ab0 con 0x7f7484108cf0 2024-09-21T07:13:36.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.718+0000 7f7488cbc640 1 -- 172.21.15.92:0/2460627415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74841a6d90 con 0x7f7484108cf0 2024-09-21T07:13:36.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.719+0000 7f7488cbc640 1 -- 172.21.15.92:0/2460627415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7484102e70 con 0x7f7484108cf0 2024-09-21T07:13:36.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.721+0000 7f74737fe640 1 -- 172.21.15.92:0/2460627415 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f747c01a070 con 0x7f7484108cf0 2024-09-21T07:13:36.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.722+0000 7f74737fe640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f746c0b6680 0x7f746c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:36.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.722+0000 7f748259c640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f746c0b6680 0x7f746c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:36.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.722+0000 7f74737fe640 1 -- 172.21.15.92:0/2460627415 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f747c0e7680 con 0x7f7484108cf0 2024-09-21T07:13:36.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.722+0000 7f748259c640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f746c0b6680 0x7f746c0b8b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7474005fd0 tx=0x7f7474009870 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:36.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.725+0000 7f74737fe640 1 -- 172.21.15.92:0/2460627415 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f747c021070 con 0x7f7484108cf0 2024-09-21T07:13:36.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:36 smithi175 ceph-mon[34064]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-09-21T07:13:36.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.940+0000 7f7488cbc640 1 -- 172.21.15.92:0/2460627415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f748419b500 con 0x7f7484108cf0 2024-09-21T07:13:36.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.941+0000 7f74737fe640 1 -- 172.21.15.92:0/2460627415 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f748419b500 con 0x7f7484108cf0 2024-09-21T07:13:36.943 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:36.943 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:13:36.944 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:13:36.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 -- 172.21.15.92:0/2460627415 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f746c0b6680 msgr2=0x7f746c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:36.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f746c0b6680 0x7f746c0b8b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7474005fd0 tx=0x7f7474009870 comp rx=0 tx=0).stop 2024-09-21T07:13:36.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 -- 172.21.15.92:0/2460627415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484108cf0 msgr2=0x7f748419fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:36.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484108cf0 0x7f748419fc10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f747c00d950 tx=0x7f747c00de10 comp rx=0 tx=0).stop 2024-09-21T07:13:36.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 -- 172.21.15.92:0/2460627415 shutdown_connections 2024-09-21T07:13:36.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f746c0b6680 0x7f746c0b8b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484108cf0 0x7f748419fc10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841083a0 0x7f748419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 --2- 172.21.15.92:0/2460627415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7484102a60 0x7f748419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 -- 172.21.15.92:0/2460627415 >> 172.21.15.92:0/2460627415 conn(0x7f7484079730 msgr2=0x7f748406b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 -- 172.21.15.92:0/2460627415 shutdown_connections 2024-09-21T07:13:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:36.943+0000 7f7488cbc640 1 -- 172.21.15.92:0/2460627415 wait complete. 2024-09-21T07:13:37.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:37 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2460627415' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:37.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:37 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2460627415' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:37.646 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:13:37.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:37 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2460627415' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:37.896 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.489+0000 7f9e5be44640 1 -- 172.21.15.92:0/4233627870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e54109df0 msgr2=0x7f9e54110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.489+0000 7f9e5be44640 1 --2- 172.21.15.92:0/4233627870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e54109df0 0x7f9e54110620 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009ca0 tx=0x7f9e4c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.489+0000 7f9e5be44640 1 -- 172.21.15.92:0/4233627870 shutdown_connections 2024-09-21T07:13:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.489+0000 7f9e5be44640 1 --2- 172.21.15.92:0/4233627870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e54109df0 0x7f9e54110620 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.489+0000 7f9e5be44640 1 --2- 172.21.15.92:0/4233627870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e541094a0 0x7f9e541098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.489+0000 7f9e5be44640 1 --2- 172.21.15.92:0/4233627870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e54103b60 0x7f9e54103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.489+0000 7f9e5be44640 1 -- 172.21.15.92:0/4233627870 >> 172.21.15.92:0/4233627870 conn(0x7f9e5407b850 msgr2=0x7f9e5407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.489+0000 7f9e5be44640 1 -- 172.21.15.92:0/4233627870 shutdown_connections 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.489+0000 7f9e5be44640 1 -- 172.21.15.92:0/4233627870 wait complete. 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.489+0000 7f9e5be44640 1 Processor -- start 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e5be44640 1 -- start start 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e5be44640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e54103b60 0x7f9e5419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e5be44640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541094a0 0x7f9e5419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e5be44640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e54109df0 0x7f9e541a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e5be44640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e54076240 con 0x7f9e541094a0 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e5be44640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e540760c0 con 0x7f9e54109df0 2024-09-21T07:13:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e5be44640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e540763c0 con 0x7f9e54103b60 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e593df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541094a0 0x7f9e5419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e593df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541094a0 0x7f9e5419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51038/0 (socket says 172.21.15.92:51038) 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e593df640 1 -- 172.21.15.92:0/1764397444 learned_addr learned my addr 172.21.15.92:0/1764397444 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e5a3e1640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e54109df0 0x7f9e541a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e59be0640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e54103b60 0x7f9e5419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e593df640 1 -- 172.21.15.92:0/1764397444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e54103b60 msgr2=0x7f9e5419c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e593df640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e54103b60 0x7f9e5419c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e593df640 1 -- 172.21.15.92:0/1764397444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e54109df0 msgr2=0x7f9e541a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e593df640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e54109df0 0x7f9e541a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.490+0000 7f9e593df640 1 -- 172.21.15.92:0/1764397444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e541a2550 con 0x7f9e541094a0 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.491+0000 7f9e593df640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541094a0 0x7f9e5419cb80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400d750 tx=0x7f9e4400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.491+0000 7f9e4affd640 1 -- 172.21.15.92:0/1764397444 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44017070 con 0x7f9e541094a0 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.491+0000 7f9e5be44640 1 -- 172.21.15.92:0/1764397444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e541a2840 con 0x7f9e541094a0 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.491+0000 7f9e4affd640 1 -- 172.21.15.92:0/1764397444 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e440054b0 con 0x7f9e541094a0 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.491+0000 7f9e4affd640 1 -- 172.21.15.92:0/1764397444 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44004bc0 con 0x7f9e541094a0 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.491+0000 7f9e5be44640 1 -- 172.21.15.92:0/1764397444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e541a8fa0 con 0x7f9e541094a0 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.492+0000 7f9e5be44640 1 -- 172.21.15.92:0/1764397444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e54103f70 con 0x7f9e541094a0 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.493+0000 7f9e4affd640 1 -- 172.21.15.92:0/1764397444 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f9e44009c30 con 0x7f9e541094a0 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.494+0000 7f9e4affd640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e400b6680 0x7f9e400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.494+0000 7f9e59be0640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e400b6680 0x7f9e400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.494+0000 7f9e4affd640 1 -- 172.21.15.92:0/1764397444 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9e440e77a0 con 0x7f9e541094a0 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.494+0000 7f9e59be0640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e400b6680 0x7f9e400b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e500058c0 tx=0x7f9e5000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.497+0000 7f9e4affd640 1 -- 172.21.15.92:0/1764397444 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e440b1d30 con 0x7f9e541094a0 2024-09-21T07:13:38.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:38 smithi092 ceph-mon[30987]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-09-21T07:13:38.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.678+0000 7f9e5be44640 1 -- 172.21.15.92:0/1764397444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e541a9240 con 0x7f9e541094a0 2024-09-21T07:13:38.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.680+0000 7f9e4affd640 1 -- 172.21.15.92:0/1764397444 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+25265 (secure 0 0 0) 0x7f9e440b6c70 con 0x7f9e541094a0 2024-09-21T07:13:38.683 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:38.683 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":86,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:12:14.675473+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:13:38.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 -- 172.21.15.92:0/1764397444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e400b6680 msgr2=0x7f9e400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:38.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e400b6680 0x7f9e400b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e500058c0 tx=0x7f9e5000a2d0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 -- 172.21.15.92:0/1764397444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541094a0 msgr2=0x7f9e5419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:38.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541094a0 0x7f9e5419cb80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400d750 tx=0x7f9e4400dc10 comp rx=0 tx=0).stop 2024-09-21T07:13:38.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 -- 172.21.15.92:0/1764397444 shutdown_connections 2024-09-21T07:13:38.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e400b6680 0x7f9e400b8b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e54109df0 0x7f9e541a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541094a0 0x7f9e5419cb80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 --2- 172.21.15.92:0/1764397444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e54103b60 0x7f9e5419c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:38.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 -- 172.21.15.92:0/1764397444 >> 172.21.15.92:0/1764397444 conn(0x7f9e5407b850 msgr2=0x7f9e54102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:38.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 -- 172.21.15.92:0/1764397444 shutdown_connections 2024-09-21T07:13:38.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:38.682+0000 7f9e5be44640 1 -- 172.21.15.92:0/1764397444 wait complete. 2024-09-21T07:13:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:38 smithi175 ceph-mon[34064]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-09-21T07:13:38.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:38 smithi169 ceph-mon[33705]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-09-21T07:13:39.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T07:13:39.592 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:39.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:39 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1764397444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:39.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:39 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1764397444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:39.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:39 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1764397444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:13:40.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:40 smithi092 ceph-mon[30987]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 58 op/s 2024-09-21T07:13:40.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:40 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:13:40.752 INFO:teuthology.orchestra.run.smithi092.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T07:13:40.753 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T07:13:40.753 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T07:13:40.753 DEBUG:tasks.quiescer:Yielding 2024-09-21T07:13:40.753 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T07:13:40.769 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:13:40.769 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T07:13:40.769 INFO:tasks.workunit:timeout=3h 2024-09-21T07:13:40.769 INFO:tasks.workunit:cleanup=True 2024-09-21T07:13:40.770 DEBUG:teuthology.orchestra.run.smithi092:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:40.770 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:13:40.771 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:40 smithi175 ceph-mon[34064]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 58 op/s 2024-09-21T07:13:40.771 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:40 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:13:40.786 INFO:teuthology.orchestra.run.smithi092.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:40.786 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T07:13:40.786 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-21T07:13:40.786 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:13:40.786 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T07:13:40.786 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-21 07:11:37.447459972 +0000 2024-09-21T07:13:40.787 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-21 07:11:37.447459972 +0000 2024-09-21T07:13:40.787 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-21 07:13:17.769220600 +0000 2024-09-21T07:13:40.787 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2024-09-21T07:13:40.787 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T07:13:40.787 DEBUG:teuthology.orchestra.run.smithi092:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T07:13:40.858 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:13:40.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:40 smithi169 ceph-mon[33705]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 58 op/s 2024-09-21T07:13:40.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:40 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:13:40.914 INFO:tasks.workunit.client.0.smithi092.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T07:13:41.030 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.484+0000 7fdf92f72640 1 -- 172.21.15.92:0/2638974838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf8c1082e0 msgr2=0x7fdf8c1086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.484+0000 7fdf92f72640 1 --2- 172.21.15.92:0/2638974838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf8c1082e0 0x7fdf8c1086f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009900 tx=0x7fdf7802a410 comp rx=0 tx=0).stop 2024-09-21T07:13:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.485+0000 7fdf92f72640 1 -- 172.21.15.92:0/2638974838 shutdown_connections 2024-09-21T07:13:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.485+0000 7fdf92f72640 1 --2- 172.21.15.92:0/2638974838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c108c30 0x7fdf8c10f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.485+0000 7fdf92f72640 1 --2- 172.21.15.92:0/2638974838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf8c1082e0 0x7fdf8c1086f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.485+0000 7fdf92f72640 1 --2- 172.21.15.92:0/2638974838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf8c1029b0 0x7fdf8c102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.485+0000 7fdf92f72640 1 -- 172.21.15.92:0/2638974838 >> 172.21.15.92:0/2638974838 conn(0x7fdf8c07a740 msgr2=0x7fdf8c07ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.485+0000 7fdf92f72640 1 -- 172.21.15.92:0/2638974838 shutdown_connections 2024-09-21T07:13:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.485+0000 7fdf92f72640 1 -- 172.21.15.92:0/2638974838 wait complete. 2024-09-21T07:13:41.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.485+0000 7f251ee8e640 1 -- 172.21.15.92:0/3131780905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25181083a0 msgr2=0x7f25181087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.485+0000 7f251ee8e640 1 --2- 172.21.15.92:0/3131780905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25181083a0 0x7f25181087b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2504009900 tx=0x7f250402a410 comp rx=0 tx=0).stop 2024-09-21T07:13:41.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.486+0000 7f251ee8e640 1 -- 172.21.15.92:0/3131780905 shutdown_connections 2024-09-21T07:13:41.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.486+0000 7f251ee8e640 1 --2- 172.21.15.92:0/3131780905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518108cf0 0x7f251810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.486+0000 7f251ee8e640 1 --2- 172.21.15.92:0/3131780905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25181083a0 0x7f25181087b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.486+0000 7f251ee8e640 1 --2- 172.21.15.92:0/3131780905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2518102a60 0x7f2518102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.486+0000 7f251ee8e640 1 -- 172.21.15.92:0/3131780905 >> 172.21.15.92:0/3131780905 conn(0x7f2518079730 msgr2=0x7f2518079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.486+0000 7fdf92f72640 1 Processor -- start 2024-09-21T07:13:41.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.486+0000 7f251ee8e640 1 -- 172.21.15.92:0/3131780905 shutdown_connections 2024-09-21T07:13:41.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.486+0000 7f251ee8e640 1 -- 172.21.15.92:0/3131780905 wait complete. 2024-09-21T07:13:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.486+0000 7fdf92f72640 1 -- start start 2024-09-21T07:13:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.486+0000 7fdf92f72640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c1029b0 0x7fdf8c19af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.486+0000 7fdf92f72640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf8c1082e0 0x7fdf8c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.486+0000 7fdf92f72640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf8c108c30 0x7fdf8c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.486+0000 7fdf92f72640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c1127f0 con 0x7fdf8c1082e0 2024-09-21T07:13:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.486+0000 7fdf92f72640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c112670 con 0x7fdf8c108c30 2024-09-21T07:13:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.486+0000 7fdf92f72640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c112970 con 0x7fdf8c1029b0 2024-09-21T07:13:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.486+0000 7fdf8bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf8c1082e0 0x7fdf8c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.486+0000 7fdf8bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf8c1082e0 0x7fdf8c19b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40716/0 (socket says 172.21.15.92:40716) 2024-09-21T07:13:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.487+0000 7fdf8bfff640 1 -- 172.21.15.92:0/2254811126 learned_addr learned my addr 172.21.15.92:0/2254811126 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.487+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c1029b0 0x7fdf8c19af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.487+0000 7fdf9150f640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf8c108c30 0x7fdf8c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251ee8e640 1 Processor -- start 2024-09-21T07:13:41.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251ee8e640 1 -- start start 2024-09-21T07:13:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.487+0000 7fdf9150f640 1 -- 172.21.15.92:0/2254811126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c1029b0 msgr2=0x7fdf8c19af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.487+0000 7fdf9150f640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c1029b0 0x7fdf8c19af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.487+0000 7fdf9150f640 1 -- 172.21.15.92:0/2254811126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf8c1082e0 msgr2=0x7fdf8c19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.487+0000 7fdf9150f640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf8c1082e0 0x7fdf8c19b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.487+0000 7fdf9150f640 1 -- 172.21.15.92:0/2254811126 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8c1a6210 con 0x7fdf8c108c30 2024-09-21T07:13:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.487+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c1029b0 0x7fdf8c19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:13:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.487+0000 7fdf9150f640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf8c108c30 0x7fdf8c19ba00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009fd0 tx=0x7fdf8400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:41.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251ee8e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2518102a60 0x7f251819c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251ee8e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25181083a0 0x7f251819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251ee8e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518108cf0 0x7f25181a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251ee8e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2518112860 con 0x7f2518102a60 2024-09-21T07:13:41.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251ee8e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f25181126e0 con 0x7f25181083a0 2024-09-21T07:13:41.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251ee8e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25181129e0 con 0x7f2518108cf0 2024-09-21T07:13:41.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251cc2a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2518102a60 0x7f251819c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251cc2a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2518102a60 0x7f251819c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40720/0 (socket says 172.21.15.92:40720) 2024-09-21T07:13:41.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.487+0000 7f251cc2a640 1 -- 172.21.15.92:0/886389739 learned_addr learned my addr 172.21.15.92:0/886389739 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.488+0000 7fdf89ffb640 1 -- 172.21.15.92:0/2254811126 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400ce20 con 0x7fdf8c108c30 2024-09-21T07:13:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.488+0000 7fdf92f72640 1 -- 172.21.15.92:0/2254811126 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf8c1a6500 con 0x7fdf8c108c30 2024-09-21T07:13:41.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.488+0000 7f2517fff640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25181083a0 0x7f251819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.488+0000 7f251d42b640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518108cf0 0x7f25181a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.488+0000 7fdf92f72640 1 -- 172.21.15.92:0/2254811126 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf8c1a6aa0 con 0x7fdf8c108c30 2024-09-21T07:13:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.488+0000 7fdf89ffb640 1 -- 172.21.15.92:0/2254811126 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf84005020 con 0x7fdf8c108c30 2024-09-21T07:13:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.488+0000 7fdf89ffb640 1 -- 172.21.15.92:0/2254811126 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400ce20 con 0x7fdf8c108c30 2024-09-21T07:13:41.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.488+0000 7f251cc2a640 1 -- 172.21.15.92:0/886389739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518108cf0 msgr2=0x7f25181a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.488+0000 7f251cc2a640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518108cf0 0x7f25181a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.488+0000 7f251cc2a640 1 -- 172.21.15.92:0/886389739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25181083a0 msgr2=0x7f251819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.488+0000 7f251cc2a640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25181083a0 0x7f251819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.488+0000 7f251cc2a640 1 -- 172.21.15.92:0/886389739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25181a2510 con 0x7f2518102a60 2024-09-21T07:13:41.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.488+0000 7f251cc2a640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2518102a60 0x7f251819c5a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f250c00e9f0 tx=0x7f250c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:41.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.488+0000 7f2515ffb640 1 -- 172.21.15.92:0/886389739 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c00cd80 con 0x7f2518102a60 2024-09-21T07:13:41.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.489+0000 7f2515ffb640 1 -- 172.21.15.92:0/886389739 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f250c0108c0 con 0x7f2518102a60 2024-09-21T07:13:41.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.489+0000 7f251ee8e640 1 -- 172.21.15.92:0/886389739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25181a2800 con 0x7f2518102a60 2024-09-21T07:13:41.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.490+0000 7f2515ffb640 1 -- 172.21.15.92:0/886389739 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c0187c0 con 0x7f2518102a60 2024-09-21T07:13:41.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.490+0000 7f251ee8e640 1 -- 172.21.15.92:0/886389739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25181a8f60 con 0x7f2518102a60 2024-09-21T07:13:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.491+0000 7fdf99fc0740 1 Processor -- start 2024-09-21T07:13:41.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.492+0000 7f251ee8e640 1 -- 172.21.15.92:0/886389739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2518103ce0 con 0x7f2518102a60 2024-09-21T07:13:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.492+0000 7fdf89ffb640 1 -- 172.21.15.92:0/2254811126 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7fdf84004a40 con 0x7fdf8c108c30 2024-09-21T07:13:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf99fc0740 1 -- start start 2024-09-21T07:13:41.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.493+0000 7f2515ffb640 1 -- 172.21.15.92:0/886389739 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f250c010430 con 0x7f2518102a60 2024-09-21T07:13:41.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d99a021b0 0x557d99dabdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99dac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999e14d0 0x557d99dac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557d99d1c6f0 con 0x557d999d92f0 2024-09-21T07:13:41.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557d99d0bb20 con 0x557d999e14d0 2024-09-21T07:13:41.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d99d0f930 con 0x557d99a021b0 2024-09-21T07:13:41.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf90d0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99dac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf90d0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99dac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40728/0 (socket says 172.21.15.92:40728) 2024-09-21T07:13:41.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf90d0e640 1 -- 172.21.15.92:0/2027678282 learned_addr learned my addr 172.21.15.92:0/2027678282 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:41.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf8bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999e14d0 0x557d99dac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/2027678282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d99a021b0 0x557d99dabdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf90d0e640 1 -- 172.21.15.92:0/2027678282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d99a021b0 msgr2=0x557d99dabdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/2027678282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d99a021b0 0x557d99dabdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf90d0e640 1 -- 172.21.15.92:0/2027678282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999e14d0 msgr2=0x557d99dac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/2027678282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999e14d0 0x557d99dac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.493+0000 7fdf90d0e640 1 -- 172.21.15.92:0/2027678282 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d99cd1530 con 0x557d999d92f0 2024-09-21T07:13:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.494+0000 7fdf89ffb640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdf7c0b6a80 0x7fdf7c0b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.494+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/2027678282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99dac300 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdf80022500 tx=0x7fdf800229c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823027aac63a07de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.494+0000 7fdf89ffb640 1 -- 172.21.15.92:0/2254811126 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdf8400cc20 con 0x7fdf8c108c30 2024-09-21T07:13:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.494+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdf7c0b6a80 0x7fdf7c0b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.494+0000 7f2515ffb640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25080b6560 0x7f25080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.494+0000 7f2517fff640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25080b6560 0x7f25080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.494+0000 7f2515ffb640 1 -- 172.21.15.92:0/886389739 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f250c0e7f70 con 0x7f2518102a60 2024-09-21T07:13:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.494+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdf7c0b6a80 0x7fdf7c0b8f90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c06aaf0 tx=0x7fdf78009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:41.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.495+0000 7f2517fff640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25080b6560 0x7f25080b8a70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f25040057c0 tx=0x7f2504000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.499+0000 7fdf76ffd640 1 -- 172.21.15.92:0/2027678282 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8002f070 con 0x557d999d92f0 2024-09-21T07:13:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.499+0000 7fdf76ffd640 1 -- 172.21.15.92:0/2027678282 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf800044c0 con 0x557d999d92f0 2024-09-21T07:13:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.499+0000 7fdf76ffd640 1 -- 172.21.15.92:0/2027678282 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf80003e60 con 0x557d999d92f0 2024-09-21T07:13:41.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.499+0000 7f2515ffb640 1 -- 172.21.15.92:0/886389739 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f250c056710 con 0x7f2518102a60 2024-09-21T07:13:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.500+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2027678282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 msgr2=0x557d99dac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.500+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/2027678282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99dac300 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdf80022500 tx=0x7fdf800229c0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.500+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2027678282 shutdown_connections 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.500+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/2027678282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999e14d0 0x557d99dac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.500+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/2027678282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99dac300 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.500+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/2027678282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d99a021b0 0x557d99dabdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.500+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2027678282 >> 172.21.15.92:0/2027678282 conn(0x557d999f6300 msgr2=0x557d99da9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.500+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2027678282 shutdown_connections 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.500+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2027678282 wait complete. 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.501+0000 7fdf99fc0740 1 -- start start 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.501+0000 7fdf99fc0740 1 Processor -- start 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.501+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99db35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.501+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 0x557d99db3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.501+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d99a021b0 0x557d99db8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.501+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557d99c43ab0 con 0x557d999d92f0 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.501+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557d99cb1730 con 0x557d99a021b0 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.501+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d99da5350 con 0x557d999e14d0 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.501+0000 7fdf99fc0740 10 client.0 _ll_register_callbacks cb 0x557d99d056b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.501+0000 7fdf90d0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99db35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf90d0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99db35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40738/0 (socket says 172.21.15.92:40738) 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf90d0e640 1 -- 172.21.15.92:0/2283831034 learned_addr learned my addr 172.21.15.92:0/2283831034 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf9150f640 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d99a021b0 0x557d99db8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 0x557d99db3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf90d0e640 1 -- 172.21.15.92:0/2283831034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 msgr2=0x557d99db3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 0x557d99db3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf90d0e640 1 -- 172.21.15.92:0/2283831034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d99a021b0 msgr2=0x557d99db8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d99a021b0 0x557d99db8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf90d0e640 1 -- 172.21.15.92:0/2283831034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d99a6d790 con 0x557d999d92f0 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf9150f640 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d99a021b0 0x557d99db8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99db35d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdf800040b0 tx=0x7fdf800040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fead6136591a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf6bfff640 1 -- 172.21.15.92:0/2283831034 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8003a060 con 0x557d999d92f0 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf6bfff640 1 -- 172.21.15.92:0/2283831034 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdf80005040 con 0x557d999d92f0 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2283831034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d99d1e640 con 0x557d999d92f0 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.502+0000 7fdf6bfff640 1 -- 172.21.15.92:0/2283831034 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdf80041050 con 0x557d999d92f0 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf99fc0740 10 client.15774 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2283831034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d99ae6620 con 0x557d999d92f0 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf6bfff640 1 -- 172.21.15.92:0/2283831034 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557d99d1e640 con 0x557d999d92f0 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf6bfff640 1 -- 172.21.15.92:0/2283831034 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdf80004880 con 0x557d999d92f0 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf99fc0740 10 client.15774 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf99fc0740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:13:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf99fc0740 20 client.15774 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d999c0d80 0x557d99dc51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf99fc0740 4 client.15774 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2283831034 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d99d1a0f0 con 0x557d999c0d80 2024-09-21T07:13:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.503+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d999c0d80 0x557d99dc51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.504+0000 7fdf6bfff640 10 client.15774 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.504+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d999c0d80 0x557d99dc51c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d36965c60ba3273 server_cookie=206452a0b348a86b in_seq=0 out_seq=0 2024-09-21T07:13:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.504+0000 7fdf6bfff640 1 -- 172.21.15.92:0/2283831034 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d99d1a0f0 con 0x557d999c0d80 2024-09-21T07:13:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.504+0000 7fdf6bfff640 10 client.15774 handle_command_reply: tid=0 2024-09-21T07:13:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 client.15774 shutdown 2024-09-21T07:13:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2283831034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 msgr2=0x557d99db35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99db35d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdf800040b0 tx=0x7fdf800040e0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2283831034 shutdown_connections 2024-09-21T07:13:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d999c0d80 0x557d99dc51c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d99a021b0 0x557d99db8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 0x557d99db3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/2283831034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999d92f0 0x557d99db35d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2283831034 >> 172.21.15.92:0/2283831034 conn(0x557d999f6300 msgr2=0x557d99dacdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf6bfff640 0 client.15774 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2283831034 shutdown_connections 2024-09-21T07:13:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 1 -- 172.21.15.92:0/2283831034 wait complete. 2024-09-21T07:13:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.505+0000 7fdf99fc0740 20 client.15774 trim_cache size 0 max 16384 2024-09-21T07:13:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.520+0000 7fdf99fc0740 1 Processor -- start 2024-09-21T07:13:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.520+0000 7fdf99fc0740 1 -- start start 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.520+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 0x557d99da05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.520+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999e14d0 0x557d99da6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.520+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d99a021b0 0x557d99da6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.520+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7000ff90 con 0x557d999e14d0 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.520+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdf70011ad0 con 0x557d999d92f0 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.520+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf70010660 con 0x557d99a021b0 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf8bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999e14d0 0x557d99da6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf90d0e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 0x557d99da05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf8bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999e14d0 0x557d99da6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40742/0 (socket says 172.21.15.92:40742) 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf8bfff640 1 -- 172.21.15.92:0/3808294340 learned_addr learned my addr 172.21.15.92:0/3808294340 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf9150f640 1 --2- 172.21.15.92:0/3808294340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d99a021b0 0x557d99da6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf8bfff640 1 -- 172.21.15.92:0/3808294340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d99a021b0 msgr2=0x557d99da6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/3808294340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d99a021b0 0x557d99da6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf8bfff640 1 -- 172.21.15.92:0/3808294340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 msgr2=0x557d99da05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/3808294340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 0x557d99da05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf8bfff640 1 -- 172.21.15.92:0/3808294340 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d99dacba0 con 0x557d999e14d0 2024-09-21T07:13:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/3808294340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 0x557d99da05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:13:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/3808294340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999e14d0 0x557d99da6600 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009850 tx=0x7fdf7802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff51e192b41d4586 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf767fc640 1 -- 172.21.15.92:0/3808294340 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf78035040 con 0x557d999e14d0 2024-09-21T07:13:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf767fc640 1 -- 172.21.15.92:0/3808294340 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf78031c10 con 0x557d999e14d0 2024-09-21T07:13:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.521+0000 7fdf767fc640 1 -- 172.21.15.92:0/3808294340 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf78003bc0 con 0x557d999e14d0 2024-09-21T07:13:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.522+0000 7fdf99fc0740 1 -- 172.21.15.92:0/3808294340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999e14d0 msgr2=0x557d99da6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.522+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/3808294340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999e14d0 0x557d99da6600 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009850 tx=0x7fdf7802a410 comp rx=0 tx=0).stop 2024-09-21T07:13:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.522+0000 7fdf99fc0740 1 -- 172.21.15.92:0/3808294340 shutdown_connections 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.522+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/3808294340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d99a021b0 0x557d99da6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.522+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/3808294340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d999e14d0 0x557d99da6600 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.522+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/3808294340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 0x557d99da05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.522+0000 7fdf99fc0740 1 -- 172.21.15.92:0/3808294340 >> 172.21.15.92:0/3808294340 conn(0x557d999f6300 msgr2=0x557d99db1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.522+0000 7fdf99fc0740 1 -- 172.21.15.92:0/3808294340 shutdown_connections 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.522+0000 7fdf99fc0740 1 -- 172.21.15.92:0/3808294340 wait complete. 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf99fc0740 1 -- start start 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf99fc0740 1 Processor -- start 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 0x557d99dbc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 0x557d99dbca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf99fc0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d99a021b0 0x557d99dbcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf70011400 con 0x557d99a021b0 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdf70010d30 con 0x557d999d92f0 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf99fc0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7000df70 con 0x557d999e14d0 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf99fc0740 10 client.0 _ll_register_callbacks cb 0x7fdf8002d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf9150f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d99a021b0 0x557d99dbcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf9150f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d99a021b0 0x557d99dbcf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40746/0 (socket says 172.21.15.92:40746) 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf9150f640 1 -- 172.21.15.92:0/1025558466 learned_addr learned my addr 172.21.15.92:0/1025558466 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.523+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 0x557d99dbca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 0x557d99dbc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf9150f640 1 -- 172.21.15.92:0/1025558466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 msgr2=0x557d99dbca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf9150f640 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 0x557d99dbca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf9150f640 1 -- 172.21.15.92:0/1025558466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 msgr2=0x557d99dbc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf9150f640 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 0x557d99dbc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf9150f640 1 -- 172.21.15.92:0/1025558466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d99e2db80 con 0x557d99a021b0 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 0x557d99dbc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf8bfff640 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 0x557d99dbca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf9150f640 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d99a021b0 0x557d99dbcf80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdf840e4cb0 tx=0x7fdf840b6c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5574c02372145b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf6bfff640 1 -- 172.21.15.92:0/1025558466 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840ace60 con 0x557d99a021b0 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf6bfff640 1 -- 172.21.15.92:0/1025558466 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdf840ac020 con 0x557d99a021b0 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf99fc0740 1 -- 172.21.15.92:0/1025558466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf78031c10 con 0x557d99a021b0 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf6bfff640 1 -- 172.21.15.92:0/1025558466 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdf840ada50 con 0x557d99a021b0 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf99fc0740 10 client.15780 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf99fc0740 1 -- 172.21.15.92:0/1025558466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d99e2ee70 con 0x557d99a021b0 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf6bfff640 1 -- 172.21.15.92:0/1025558466 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf78031c10 con 0x557d99a021b0 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.524+0000 7fdf6bfff640 1 -- 172.21.15.92:0/1025558466 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdf840b2fc0 con 0x557d99a021b0 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.525+0000 7fdf99fc0740 10 client.15780 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.525+0000 7fdf99fc0740 10 client.15780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:13:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.525+0000 7fdf99fc0740 20 client.15780 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.525+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d999961c0 0x557d99e31630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.525+0000 7fdf99fc0740 4 client.15780 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:13:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.525+0000 7fdf99fc0740 1 -- 172.21.15.92:0/1025558466 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557d99d17520 con 0x557d999961c0 2024-09-21T07:13:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.525+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d999961c0 0x557d99e31630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.525+0000 7fdf6bfff640 10 client.15780 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.525+0000 7fdf90d0e640 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d999961c0 0x557d99e31630 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b31253d02445ec5 server_cookie=d67ac603d2d4b5a6 in_seq=0 out_seq=0 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.538+0000 7fdf6bfff640 1 -- 172.21.15.92:0/1025558466 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557d99d17520 con 0x557d999961c0 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.538+0000 7fdf6bfff640 10 client.15780 handle_command_reply: tid=0 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.538+0000 7fdf99fc0740 1 client.15780 shutdown 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 1 -- 172.21.15.92:0/1025558466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d99a021b0 msgr2=0x557d99dbcf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d99a021b0 0x557d99dbcf80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdf840e4cb0 tx=0x7fdf840b6c20 comp rx=0 tx=0).stop 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 1 -- 172.21.15.92:0/1025558466 shutdown_connections 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d999961c0 0x557d99e31630 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d99a021b0 0x557d99dbcf80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d999e14d0 0x557d99dbca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 1 --2- 172.21.15.92:0/1025558466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d999d92f0 0x557d99dbc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf6bfff640 0 client.15780 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 1 -- 172.21.15.92:0/1025558466 >> 172.21.15.92:0/1025558466 conn(0x557d999f6300 msgr2=0x557d99da9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 1 -- 172.21.15.92:0/1025558466 shutdown_connections 2024-09-21T07:13:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 1 -- 172.21.15.92:0/1025558466 wait complete. 2024-09-21T07:13:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.539+0000 7fdf99fc0740 20 client.15780 trim_cache size 0 max 16384 2024-09-21T07:13:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:13:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:13:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:13:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:13:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 -- 172.21.15.92:0/2254811126 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdf7c0b6a80 msgr2=0x7fdf7c0b8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdf7c0b6a80 0x7fdf7c0b8f90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c06aaf0 tx=0x7fdf78009560 comp rx=0 tx=0).stop 2024-09-21T07:13:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 -- 172.21.15.92:0/2254811126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf8c108c30 msgr2=0x7fdf8c19ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf8c108c30 0x7fdf8c19ba00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009fd0 tx=0x7fdf8400ef10 comp rx=0 tx=0).stop 2024-09-21T07:13:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 -- 172.21.15.92:0/2254811126 shutdown_connections 2024-09-21T07:13:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdf7c0b6a80 0x7fdf7c0b8f90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf8c108c30 0x7fdf8c19ba00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf8c1082e0 0x7fdf8c19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 --2- 172.21.15.92:0/2254811126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf8c1029b0 0x7fdf8c19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 -- 172.21.15.92:0/2254811126 >> 172.21.15.92:0/2254811126 conn(0x7fdf8c07a740 msgr2=0x7fdf8c1061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 -- 172.21.15.92:0/2254811126 shutdown_connections 2024-09-21T07:13:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:41.540+0000 7fdf92f72640 1 -- 172.21.15.92:0/2254811126 wait complete. 2024-09-21T07:13:41.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.726+0000 7f251ee8e640 1 -- 172.21.15.92:0/886389739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f251819d700 con 0x7f2518102a60 2024-09-21T07:13:41.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.726+0000 7f2515ffb640 1 -- 172.21.15.92:0/886389739 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f251819d700 con 0x7f2518102a60 2024-09-21T07:13:41.728 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:13:41.728 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:13:41.729 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:13:41.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 -- 172.21.15.92:0/886389739 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25080b6560 msgr2=0x7f25080b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25080b6560 0x7f25080b8a70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f25040057c0 tx=0x7f2504000bc0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 -- 172.21.15.92:0/886389739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2518102a60 msgr2=0x7f251819c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:41.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2518102a60 0x7f251819c5a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f250c00e9f0 tx=0x7f250c00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 -- 172.21.15.92:0/886389739 shutdown_connections 2024-09-21T07:13:41.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f25080b6560 0x7f25080b8a70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518108cf0 0x7f25181a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25181083a0 0x7f251819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 --2- 172.21.15.92:0/886389739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2518102a60 0x7f251819c5a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 -- 172.21.15.92:0/886389739 >> 172.21.15.92:0/886389739 conn(0x7f2518079730 msgr2=0x7f251806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 -- 172.21.15.92:0/886389739 shutdown_connections 2024-09-21T07:13:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:41.729+0000 7f251ee8e640 1 -- 172.21.15.92:0/886389739 wait complete. 2024-09-21T07:13:42.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:10:54.236729+0000', 'modified': '2024-09-21T07:13:18.148048+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24649, 'mds_1': 24625, 'mds_2': 24608, 'mds_3': 24583, 'mds_4': 24566}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14841': {'gid': 14841, 'name': 'h', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6837/2116680832', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 2116680832}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 2116680832}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14859': {'gid': 14859, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6839/1835760933', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 1835760933}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 1835760933}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14871': {'gid': 14871, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6841/752270354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6840', 'nonce': 752270354}, {'type': 'v1', 'addr': '172.21.15.92:6841', 'nonce': 752270354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6833/3784592006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6832', 'nonce': 3784592006}, {'type': 'v1', 'addr': '172.21.15.169:6833', 'nonce': 3784592006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24548': {'gid': 24548, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/1770920559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 1770920559}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 1770920559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24566': {'gid': 24566, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.175:6837/1654191634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1654191634}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1654191634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24583': {'gid': 24583, 'name': 'l', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.175:6833/2860278829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 2860278829}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 2860278829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'b', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.169:6839/44894739', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 44894739}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 44894739}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'f', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.175:6835/2445062283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 2445062283}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 2445062283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.175:6839/3839014225', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3839014225}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3839014225}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24649, 'qdb_cluster': [24566, 24583, 24608, 24625, 24649]} 2024-09-21T07:13:42.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T07:13:42.507 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T07:13:42.795 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:42 smithi092 ceph-mon[30987]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T07:13:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:42 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/886389739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:43.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:42 smithi175 ceph-mon[34064]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T07:13:43.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:42 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/886389739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:42 smithi169 ceph-mon[33705]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T07:13:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:42 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/886389739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:13:43.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.278+0000 7f261c7c5640 1 -- 172.21.15.92:0/893191964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26141083a0 msgr2=0x7f26141087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:43.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.278+0000 7f261c7c5640 1 --2- 172.21.15.92:0/893191964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26141083a0 0x7f26141087b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2608009900 tx=0x7f260802a410 comp rx=0 tx=0).stop 2024-09-21T07:13:43.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.278+0000 7f261c7c5640 1 -- 172.21.15.92:0/893191964 shutdown_connections 2024-09-21T07:13:43.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.278+0000 7f261c7c5640 1 --2- 172.21.15.92:0/893191964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2614108cf0 0x7f261410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.278+0000 7f261c7c5640 1 --2- 172.21.15.92:0/893191964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26141083a0 0x7f26141087b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.278+0000 7f261c7c5640 1 --2- 172.21.15.92:0/893191964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2614102a60 0x7f2614102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.278+0000 7f261c7c5640 1 -- 172.21.15.92:0/893191964 >> 172.21.15.92:0/893191964 conn(0x7f2614079760 msgr2=0x7f2614079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:43.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.278+0000 7f261c7c5640 1 -- 172.21.15.92:0/893191964 shutdown_connections 2024-09-21T07:13:43.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.278+0000 7f261c7c5640 1 -- 172.21.15.92:0/893191964 wait complete. 2024-09-21T07:13:43.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261c7c5640 1 Processor -- start 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261c7c5640 1 -- start start 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261c7c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2614102a60 0x7f261419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261c7c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26141083a0 0x7f261419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261c7c5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2614108cf0 0x7f261419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261c7c5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2614113980 con 0x7f2614102a60 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261c7c5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2614113800 con 0x7f2614108cf0 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261c7c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2614113b00 con 0x7f26141083a0 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261a561640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2614102a60 0x7f261419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261a561640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2614102a60 0x7f261419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40770/0 (socket says 172.21.15.92:40770) 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261a561640 1 -- 172.21.15.92:0/2066325754 learned_addr learned my addr 172.21.15.92:0/2066325754 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261a561640 1 -- 172.21.15.92:0/2066325754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26141083a0 msgr2=0x7f261419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f2619d60640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26141083a0 0x7f261419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261a561640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26141083a0 0x7f261419aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261ad62640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2614108cf0 0x7f261419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261a561640 1 -- 172.21.15.92:0/2066325754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2614108cf0 msgr2=0x7f261419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261a561640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2614108cf0 0x7f261419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261a561640 1 -- 172.21.15.92:0/2066325754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26141a0420 con 0x7f2614102a60 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261ad62640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2614108cf0 0x7f261419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.279+0000 7f261a561640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2614102a60 0x7f261419a4b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f261000d950 tx=0x7f261000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.280+0000 7f26077fe640 1 -- 172.21.15.92:0/2066325754 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610017070 con 0x7f2614102a60 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.280+0000 7f26077fe640 1 -- 172.21.15.92:0/2066325754 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2610009c30 con 0x7f2614102a60 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.280+0000 7f261c7c5640 1 -- 172.21.15.92:0/2066325754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26141a0710 con 0x7f2614102a60 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.280+0000 7f26077fe640 1 -- 172.21.15.92:0/2066325754 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261000f620 con 0x7f2614102a60 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.280+0000 7f261c7c5640 1 -- 172.21.15.92:0/2066325754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26141a6e70 con 0x7f2614102a60 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.282+0000 7f2622d39740 1 Processor -- start 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f2622d39740 1 -- start start 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f26077fe640 1 -- 172.21.15.92:0/2066325754 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f2610010460 con 0x7f2614102a60 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f2622d39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c2402ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f2622d39740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c600a0 0x564c2402f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f2622d39740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c68280 0x564c2402f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f2622d39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c23fa6c10 con 0x564c23c88f60 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f2622d39740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564c23f96040 con 0x564c23c68280 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f2622d39740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564c23f99e50 con 0x564c23c600a0 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f261ad62640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c2402ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f261ad62640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c2402ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40774/0 (socket says 172.21.15.92:40774) 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f261ad62640 1 -- 172.21.15.92:0/2358817183 learned_addr learned my addr 172.21.15.92:0/2358817183 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f2619d60640 1 --2- 172.21.15.92:0/2358817183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c68280 0x564c2402f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f261a561640 1 --2- 172.21.15.92:0/2358817183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c600a0 0x564c2402f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f261ad62640 1 -- 172.21.15.92:0/2358817183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c600a0 msgr2=0x564c2402f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f261ad62640 1 --2- 172.21.15.92:0/2358817183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c600a0 0x564c2402f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f261ad62640 1 -- 172.21.15.92:0/2358817183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c68280 msgr2=0x564c2402f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f261ad62640 1 --2- 172.21.15.92:0/2358817183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c68280 0x564c2402f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.283+0000 7f261ad62640 1 -- 172.21.15.92:0/2358817183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c23cf4540 con 0x564c23c88f60 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.284+0000 7f26077fe640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26000b6700 0x7f26000b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.284+0000 7f261ad62640 1 --2- 172.21.15.92:0/2358817183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c2402ef00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f260c009e40 tx=0x7f260c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb2006c97ac4492 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.284+0000 7f261a561640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26000b6700 0x7f26000b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.284+0000 7f2604ff9640 1 -- 172.21.15.92:0/2358817183 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c004d20 con 0x564c23c88f60 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.284+0000 7f2604ff9640 1 -- 172.21.15.92:0/2358817183 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f260c0054b0 con 0x564c23c88f60 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.284+0000 7f26077fe640 1 -- 172.21.15.92:0/2066325754 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f26100e7700 con 0x7f2614102a60 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.284+0000 7f2604ff9640 1 -- 172.21.15.92:0/2358817183 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c011680 con 0x564c23c88f60 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 -- 172.21.15.92:0/2358817183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 msgr2=0x564c2402ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f261a561640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26000b6700 0x7f26000b8c10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f26100e4b60 tx=0x7f26100a9930 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 --2- 172.21.15.92:0/2358817183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c2402ef00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f260c009e40 tx=0x7f260c00f730 comp rx=0 tx=0).stop 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 -- 172.21.15.92:0/2358817183 shutdown_connections 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 --2- 172.21.15.92:0/2358817183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c68280 0x564c2402f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 --2- 172.21.15.92:0/2358817183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c600a0 0x564c2402f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 --2- 172.21.15.92:0/2358817183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c2402ef00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 -- 172.21.15.92:0/2358817183 >> 172.21.15.92:0/2358817183 conn(0x564c23c7d350 msgr2=0x564c2402cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 -- 172.21.15.92:0/2358817183 shutdown_connections 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 -- 172.21.15.92:0/2358817183 wait complete. 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 -- start start 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.285+0000 7f2622d39740 1 Processor -- start 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f2622d39740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c600a0 0x564c2403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f2622d39740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c68280 0x564c2403af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f2622d39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c240469d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f2622d39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c23df75f0 con 0x564c23c88f60 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f2622d39740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564c23f31010 con 0x564c23c68280 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f2622d39740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564c2403d6e0 con 0x564c23c600a0 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f2622d39740 10 client.0 _ll_register_callbacks cb 0x564c23f90340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f261ad62640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c240469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f261ad62640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c240469d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40782/0 (socket says 172.21.15.92:40782) 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f261ad62640 1 -- 172.21.15.92:0/581234490 learned_addr learned my addr 172.21.15.92:0/581234490 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:43.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f2619d60640 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c68280 0x564c2403af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f261ad62640 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c600a0 0x564c2403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f261ad62640 1 -- 172.21.15.92:0/581234490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c600a0 msgr2=0x564c2403aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f261ad62640 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c600a0 0x564c2403aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f261ad62640 1 -- 172.21.15.92:0/581234490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c68280 msgr2=0x564c2403af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f261ad62640 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c68280 0x564c2403af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f261ad62640 1 -- 172.21.15.92:0/581234490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c23f5ea00 con 0x564c23c88f60 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f261ad62640 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c240469d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x564c2403d080 tx=0x7f260c00ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0f0050f5804944 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.286+0000 7f25fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f25fdffb640 1 -- 172.21.15.92:0/581234490 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c01d030 con 0x564c23c88f60 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f25fdffb640 1 -- 172.21.15.92:0/581234490 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f260c022070 con 0x564c23c88f60 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f2622d39740 1 -- 172.21.15.92:0/581234490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f260c0054b0 con 0x564c23c88f60 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f25fdffb640 1 -- 172.21.15.92:0/581234490 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f260c004bf0 con 0x564c23c88f60 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f2622d39740 10 client.15792 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f2622d39740 1 -- 172.21.15.92:0/581234490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564c24049670 con 0x564c23c88f60 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f25fdffb640 1 -- 172.21.15.92:0/581234490 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f260c0054b0 con 0x564c23c88f60 2024-09-21T07:13:43.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f25fdffb640 1 -- 172.21.15.92:0/581234490 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f260c02a4d0 con 0x564c23c88f60 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f2622d39740 10 client.15792 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f2622d39740 10 client.15792 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f2622d39740 20 client.15792 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f2622d39740 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x564c23c478e0 0x564c2404ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f2622d39740 4 client.15792 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.287+0000 7f2622d39740 1 -- 172.21.15.92:0/581234490 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c23fa8b60 con 0x564c23c478e0 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.288+0000 7f2619d60640 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x564c23c478e0 0x564c2404ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.288+0000 7f2619d60640 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x564c23c478e0 0x564c2404ceb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2a7b217449b6b667 server_cookie=8205a42af8a5c658 in_seq=0 out_seq=0 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.288+0000 7f25fdffb640 10 client.15792 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f25fdffb640 1 -- 172.21.15.92:0/581234490 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c23fa8b60 con 0x564c23c478e0 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f25fdffb640 10 client.15792 handle_command_reply: tid=0 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 client.15792 shutdown 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 -- 172.21.15.92:0/581234490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 msgr2=0x564c240469d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c240469d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x564c2403d080 tx=0x7f260c00ffa0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 -- 172.21.15.92:0/581234490 shutdown_connections 2024-09-21T07:13:43.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x564c23c478e0 0x564c2404ceb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c88f60 0x564c240469d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f25fdffb640 0 client.15792 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:13:43.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c68280 0x564c2403af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 --2- 172.21.15.92:0/581234490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c600a0 0x564c2403aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 -- 172.21.15.92:0/581234490 >> 172.21.15.92:0/581234490 conn(0x564c23c7d350 msgr2=0x564c240320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:43.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 -- 172.21.15.92:0/581234490 shutdown_connections 2024-09-21T07:13:43.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 1 -- 172.21.15.92:0/581234490 wait complete. 2024-09-21T07:13:43.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.289+0000 7f2622d39740 20 client.15792 trim_cache size 0 max 16384 2024-09-21T07:13:43.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2622d39740 1 Processor -- start 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2622d39740 1 -- start start 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2622d39740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 0x564c2403aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2622d39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2403af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2622d39740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c68280 0x564c240359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2622d39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c2404b1f0 con 0x564c23c600a0 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2622d39740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564c2404b8c0 con 0x564c23c478e0 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2622d39740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564c2404bf90 con 0x564c23c68280 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2619d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2403af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2619d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2403af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40788/0 (socket says 172.21.15.92:40788) 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.307+0000 7f2619d60640 1 -- 172.21.15.92:0/1189027091 learned_addr learned my addr 172.21.15.92:0/1189027091 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f261ad62640 1 --2- 172.21.15.92:0/1189027091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c68280 0x564c240359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f261ad62640 1 --2- 172.21.15.92:0/1189027091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 0x564c2403aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f2619d60640 1 -- 172.21.15.92:0/1189027091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c68280 msgr2=0x564c240359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f2619d60640 1 --2- 172.21.15.92:0/1189027091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c68280 0x564c240359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f2619d60640 1 -- 172.21.15.92:0/1189027091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 msgr2=0x564c2403aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f2619d60640 1 --2- 172.21.15.92:0/1189027091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 0x564c2403aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f2619d60640 1 -- 172.21.15.92:0/1189027091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c240311f0 con 0x564c23c600a0 2024-09-21T07:13:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f261ad62640 1 --2- 172.21.15.92:0/1189027091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 0x564c2403aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f2619d60640 1 --2- 172.21.15.92:0/1189027091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2403af50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2608009850 tx=0x7f26080058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bafb13f48b90a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f25fffff640 1 -- 172.21.15.92:0/1189027091 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608035040 con 0x564c23c600a0 2024-09-21T07:13:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f25fffff640 1 -- 172.21.15.92:0/1189027091 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26080044d0 con 0x564c23c600a0 2024-09-21T07:13:43.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.308+0000 7f25fffff640 1 -- 172.21.15.92:0/1189027091 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608032050 con 0x564c23c600a0 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 -- 172.21.15.92:0/1189027091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 msgr2=0x564c2403af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 --2- 172.21.15.92:0/1189027091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2403af50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2608009850 tx=0x7f26080058d0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 -- 172.21.15.92:0/1189027091 shutdown_connections 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 --2- 172.21.15.92:0/1189027091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c68280 0x564c240359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 --2- 172.21.15.92:0/1189027091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2403af50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 --2- 172.21.15.92:0/1189027091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 0x564c2403aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 -- 172.21.15.92:0/1189027091 >> 172.21.15.92:0/1189027091 conn(0x564c23c7d350 msgr2=0x564c24046b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 -- 172.21.15.92:0/1189027091 shutdown_connections 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 -- 172.21.15.92:0/1189027091 wait complete. 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 -- start start 2024-09-21T07:13:43.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 Processor -- start 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 0x564c2404f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.309+0000 7f2622d39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2404fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2622d39740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c68280 0x564c240545f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2622d39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c2404cd30 con 0x564c23c600a0 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2622d39740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564c2404c660 con 0x564c23c478e0 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2622d39740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564c2404d400 con 0x564c23c68280 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2622d39740 10 client.0 _ll_register_callbacks cb 0x7f2608009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2619d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2404fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2619d60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2404fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40796/0 (socket says 172.21.15.92:40796) 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2619d60640 1 -- 172.21.15.92:0/1465587687 learned_addr learned my addr 172.21.15.92:0/1465587687 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f261ad62640 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c68280 0x564c240545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f261ad62640 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 0x564c2404f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2619d60640 1 -- 172.21.15.92:0/1465587687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c68280 msgr2=0x564c240545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2619d60640 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c68280 0x564c240545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2619d60640 1 -- 172.21.15.92:0/1465587687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 msgr2=0x564c2404f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2619d60640 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 0x564c2404f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2619d60640 1 -- 172.21.15.92:0/1465587687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c24050360 con 0x564c23c600a0 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2619d60640 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2404fae0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f26080322c0 tx=0x7f26080322f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7640609323c10e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f25fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f25fdffb640 1 -- 172.21.15.92:0/1465587687 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608051020 con 0x564c23c600a0 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f25fdffb640 1 -- 172.21.15.92:0/1465587687 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f26080327e0 con 0x564c23c600a0 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.310+0000 7f2622d39740 1 -- 172.21.15.92:0/1465587687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26080044d0 con 0x564c23c600a0 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f25fdffb640 1 -- 172.21.15.92:0/1465587687 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f260805c050 con 0x564c23c600a0 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f2622d39740 10 client.15798 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f2622d39740 1 -- 172.21.15.92:0/1465587687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564c24055ae0 con 0x564c23c600a0 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f25fdffb640 1 -- 172.21.15.92:0/1465587687 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26080044d0 con 0x564c23c600a0 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f25fdffb640 1 -- 172.21.15.92:0/1465587687 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f260803d4e0 con 0x564c23c600a0 2024-09-21T07:13:43.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f2622d39740 10 client.15798 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f2622d39740 10 client.15798 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f2622d39740 20 client.15798 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f2622d39740 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x564c23c88f60 0x564c240bb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f2622d39740 4 client.15798 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f2622d39740 1 -- 172.21.15.92:0/1465587687 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "status"}) -- 0x564c23fa4610 con 0x564c23c88f60 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.311+0000 7f261ad62640 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x564c23c88f60 0x564c240bb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f25fdffb640 10 client.15798 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f261ad62640 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x564c23c88f60 0x564c240bb1e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f4ee6942cccb83be server_cookie=f093b82ba1f547fb in_seq=0 out_seq=0 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f25fdffb640 1 -- 172.21.15.92:0/1465587687 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564c23fa4610 con 0x564c23c88f60 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f25fdffb640 10 client.15798 handle_command_reply: tid=0 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 client.15798 shutdown 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 -- 172.21.15.92:0/1465587687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 msgr2=0x564c2404fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2404fae0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f26080322c0 tx=0x7f26080322f0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 -- 172.21.15.92:0/1465587687 shutdown_connections 2024-09-21T07:13:43.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x564c23c88f60 0x564c240bb1e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c23c68280 0x564c240545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c23c600a0 0x564c2404fae0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 --2- 172.21.15.92:0/1465587687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c23c478e0 0x564c2404f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f25fdffb640 0 client.15798 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 -- 172.21.15.92:0/1465587687 >> 172.21.15.92:0/1465587687 conn(0x564c23c7d350 msgr2=0x564c2403aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 -- 172.21.15.92:0/1465587687 shutdown_connections 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 1 -- 172.21.15.92:0/1465587687 wait complete. 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.312+0000 7f2622d39740 20 client.15798 trim_cache size 0 max 16384 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:13:43.319 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 4, 2024-09-21T07:13:43.320 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24566, 2024-09-21T07:13:43.320 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:13:43.320 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:13:43.320 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:13:43.320 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 130.587643781, 2024-09-21T07:13:43.320 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 29, 2024-09-21T07:13:43.320 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:13:43.320 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:13:43.320 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 193.69239320400001 2024-09-21T07:13:43.320 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 -- 172.21.15.92:0/2066325754 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26000b6700 msgr2=0x7f26000b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26000b6700 0x7f26000b8c10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f26100e4b60 tx=0x7f26100a9930 comp rx=0 tx=0).stop 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 -- 172.21.15.92:0/2066325754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2614102a60 msgr2=0x7f261419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2614102a60 0x7f261419a4b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f261000d950 tx=0x7f261000de10 comp rx=0 tx=0).stop 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 -- 172.21.15.92:0/2066325754 shutdown_connections 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26000b6700 0x7f26000b8c10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2614108cf0 0x7f261419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26141083a0 0x7f261419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 --2- 172.21.15.92:0/2066325754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2614102a60 0x7f261419a4b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 -- 172.21.15.92:0/2066325754 >> 172.21.15.92:0/2066325754 conn(0x7f2614079760 msgr2=0x7f26141044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 -- 172.21.15.92:0/2066325754 shutdown_connections 2024-09-21T07:13:43.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:43.313+0000 7f261c7c5640 1 -- 172.21.15.92:0/2066325754 wait complete. 2024-09-21T07:13:44.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.l status 2024-09-21T07:13:44.293 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.821+0000 7f6620b34640 1 -- 172.21.15.92:0/1676584865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f661c102ae0 msgr2=0x7f661c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.821+0000 7f6620b34640 1 --2- 172.21.15.92:0/1676584865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f661c102ae0 0x7f661c102ef0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f660c009900 tx=0x7f660c02a410 comp rx=0 tx=0).stop 2024-09-21T07:13:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.821+0000 7f6620b34640 1 -- 172.21.15.92:0/1676584865 shutdown_connections 2024-09-21T07:13:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.821+0000 7f6620b34640 1 --2- 172.21.15.92:0/1676584865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c108d20 0x7f661c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.821+0000 7f6620b34640 1 --2- 172.21.15.92:0/1676584865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f661c1083d0 0x7f661c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.821+0000 7f6620b34640 1 --2- 172.21.15.92:0/1676584865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f661c102ae0 0x7f661c102ef0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.821+0000 7f6620b34640 1 -- 172.21.15.92:0/1676584865 >> 172.21.15.92:0/1676584865 conn(0x7f661c0797b0 msgr2=0x7f661c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.821+0000 7f6620b34640 1 -- 172.21.15.92:0/1676584865 shutdown_connections 2024-09-21T07:13:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.821+0000 7f6620b34640 1 -- 172.21.15.92:0/1676584865 wait complete. 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f6620b34640 1 Processor -- start 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f6620b34640 1 -- start start 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f6620b34640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c102ae0 0x7f661c110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f6620b34640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f661c1083d0 0x7f661c110570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f6620b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f661c108d20 0x7f661c110ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f6620b34640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f661c1139b0 con 0x7f661c108d20 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f6620b34640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f661c113830 con 0x7f661c1083d0 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f6620b34640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f661c113b30 con 0x7f661c102ae0 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f661ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f661c108d20 0x7f661c110ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f661ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f661c108d20 0x7f661c110ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40810/0 (socket says 172.21.15.92:40810) 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.822+0000 7f661ad9d640 1 -- 172.21.15.92:0/3327715040 learned_addr learned my addr 172.21.15.92:0/3327715040 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f6619d9b640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f661c1083d0 0x7f661c110570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f661ad9d640 1 -- 172.21.15.92:0/3327715040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c102ae0 msgr2=0x7f661c110030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f661ad9d640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c102ae0 0x7f661c110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f661ad9d640 1 -- 172.21.15.92:0/3327715040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f661c1083d0 msgr2=0x7f661c110570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f661ad9d640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f661c1083d0 0x7f661c110570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f661ad9d640 1 -- 172.21.15.92:0/3327715040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661c1a8660 con 0x7f661c108d20 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f6619d9b640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f661c1083d0 0x7f661c110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f661ad9d640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f661c108d20 0x7f661c110ab0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f661400eaa0 tx=0x7f661400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f66137fe640 1 -- 172.21.15.92:0/3327715040 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661400cdb0 con 0x7f661c108d20 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f6620b34640 1 -- 172.21.15.92:0/3327715040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f661c1a8950 con 0x7f661c108d20 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f66137fe640 1 -- 172.21.15.92:0/3327715040 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6614005020 con 0x7f661c108d20 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f66137fe640 1 -- 172.21.15.92:0/3327715040 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66140116d0 con 0x7f661c108d20 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.823+0000 7f6620b34640 1 -- 172.21.15.92:0/3327715040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f661c1a8ee0 con 0x7f661c108d20 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.826+0000 7f66270a8740 1 Processor -- start 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.826+0000 7f66137fe640 1 -- 172.21.15.92:0/3327715040 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f6614004a40 con 0x7f661c108d20 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f66270a8740 1 -- start start 2024-09-21T07:13:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f66270a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79e5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f66270a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed76170a0 0x563ed79e6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f66270a8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed761f280 0x563ed79e6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f66270a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ed795dc10 con 0x563ed763ff60 2024-09-21T07:13:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f66270a8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563ed794d040 con 0x563ed761f280 2024-09-21T07:13:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f66270a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563ed7950e50 con 0x563ed76170a0 2024-09-21T07:13:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f6619d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79e5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f6619d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79e5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40816/0 (socket says 172.21.15.92:40816) 2024-09-21T07:13:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f6619d9b640 1 -- 172.21.15.92:0/1878201200 learned_addr learned my addr 172.21.15.92:0/1878201200 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f661a59c640 1 --2- 172.21.15.92:0/1878201200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed76170a0 0x563ed79e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f6619d9b640 1 -- 172.21.15.92:0/1878201200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed76170a0 msgr2=0x563ed79e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f6619d9b640 1 --2- 172.21.15.92:0/1878201200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed76170a0 0x563ed79e6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f6619d9b640 1 -- 172.21.15.92:0/1878201200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed761f280 msgr2=0x563ed79e6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f6619d9b640 1 --2- 172.21.15.92:0/1878201200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed761f280 0x563ed79e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f6619d9b640 1 -- 172.21.15.92:0/1878201200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed76ab540 con 0x563ed763ff60 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.827+0000 7f66137fe640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f66080b6680 0x7f66080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.828+0000 7f661a59c640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f66080b6680 0x7f66080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.828+0000 7f6619d9b640 1 --2- 172.21.15.92:0/1878201200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79e5f00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f660400bb80 tx=0x7f660400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18578532d275f45d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.828+0000 7f66137fe640 1 -- 172.21.15.92:0/3327715040 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f66140e7cf0 con 0x7f661c108d20 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.828+0000 7f6610ff9640 1 -- 172.21.15.92:0/1878201200 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604011670 con 0x563ed763ff60 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.828+0000 7f6610ff9640 1 -- 172.21.15.92:0/1878201200 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6604011ca0 con 0x563ed763ff60 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.828+0000 7f6610ff9640 1 -- 172.21.15.92:0/1878201200 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604019ae0 con 0x563ed763ff60 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 -- 172.21.15.92:0/1878201200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 msgr2=0x563ed79e5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 --2- 172.21.15.92:0/1878201200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79e5f00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f660400bb80 tx=0x7f660400f730 comp rx=0 tx=0).stop 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f661a59c640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f66080b6680 0x7f66080b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f660c005f70 tx=0x7f660c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 -- 172.21.15.92:0/1878201200 shutdown_connections 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 --2- 172.21.15.92:0/1878201200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed761f280 0x563ed79e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 --2- 172.21.15.92:0/1878201200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed76170a0 0x563ed79e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 --2- 172.21.15.92:0/1878201200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79e5f00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 -- 172.21.15.92:0/1878201200 >> 172.21.15.92:0/1878201200 conn(0x563ed7634350 msgr2=0x563ed79e3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 -- 172.21.15.92:0/1878201200 shutdown_connections 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 -- 172.21.15.92:0/1878201200 wait complete. 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 -- start start 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.829+0000 7f66270a8740 1 Processor -- start 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f66270a8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 0x563ed79f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f66270a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 0x563ed79f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f66270a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79fd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f66270a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ed77ae5f0 con 0x563ed763ff60 2024-09-21T07:13:44.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f66270a8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563ed78e8010 con 0x563ed76170a0 2024-09-21T07:13:44.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f66270a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563ed79f46e0 con 0x563ed761f280 2024-09-21T07:13:44.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f66270a8740 10 client.0 _ll_register_callbacks cb 0x563ed7947340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:44.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79fd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79fd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40818/0 (socket says 172.21.15.92:40818) 2024-09-21T07:13:44.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661ad9d640 1 -- 172.21.15.92:0/1253831500 learned_addr learned my addr 172.21.15.92:0/1253831500 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:44.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f6619d9b640 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 0x563ed79f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661a59c640 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 0x563ed79f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661ad9d640 1 -- 172.21.15.92:0/1253831500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 msgr2=0x563ed79f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661ad9d640 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 0x563ed79f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661ad9d640 1 -- 172.21.15.92:0/1253831500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 msgr2=0x563ed79f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661ad9d640 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 0x563ed79f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661ad9d640 1 -- 172.21.15.92:0/1253831500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ed7915a00 con 0x563ed763ff60 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f6619d9b640 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 0x563ed79f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661a59c640 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 0x563ed79f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f661ad9d640 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79fd9d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f66140a9d70 tx=0x7f66140ad000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1469717a5b8cd380 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f6601ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.830+0000 7f6601ffb640 1 -- 172.21.15.92:0/1253831500 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661401f070 con 0x563ed763ff60 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f6601ffb640 1 -- 172.21.15.92:0/1253831500 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f66140a90f0 con 0x563ed763ff60 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f66270a8740 1 -- 172.21.15.92:0/1253831500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6604011ca0 con 0x563ed763ff60 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f6601ffb640 1 -- 172.21.15.92:0/1253831500 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f66140b71c0 con 0x563ed763ff60 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f66270a8740 10 client.15810 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f66270a8740 1 -- 172.21.15.92:0/1253831500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ed7a00770 con 0x563ed763ff60 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f6601ffb640 1 -- 172.21.15.92:0/1253831500 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6604011ca0 con 0x563ed763ff60 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f6601ffb640 1 -- 172.21.15.92:0/1253831500 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f661400f040 con 0x563ed763ff60 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f66270a8740 10 client.15810 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f66270a8740 10 client.15810 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f66270a8740 20 client.15810 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f66270a8740 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x563ed75fe8e0 0x563ed7a041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f66270a8740 4 client.15810 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f66270a8740 1 -- 172.21.15.92:0/1253831500 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ed795fb60 con 0x563ed75fe8e0 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.831+0000 7f661a59c640 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x563ed75fe8e0 0x563ed7a041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.832+0000 7f6601ffb640 10 client.15810 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:13:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.832+0000 7f661a59c640 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x563ed75fe8e0 0x563ed7a041d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fdd90dfcf2ea58a7 server_cookie=e844a87fc615b3bd in_seq=0 out_seq=0 2024-09-21T07:13:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f6601ffb640 1 -- 172.21.15.92:0/1253831500 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ed795fb60 con 0x563ed75fe8e0 2024-09-21T07:13:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f6601ffb640 10 client.15810 handle_command_reply: tid=0 2024-09-21T07:13:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 client.15810 shutdown 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 -- 172.21.15.92:0/1253831500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 msgr2=0x563ed79fd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79fd9d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f66140a9d70 tx=0x7f66140ad000 comp rx=0 tx=0).stop 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 -- 172.21.15.92:0/1253831500 shutdown_connections 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x563ed75fe8e0 0x563ed7a041d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed763ff60 0x563ed79fd9d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 0x563ed79f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 --2- 172.21.15.92:0/1253831500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 0x563ed79f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f6601ffb640 0 client.15810 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 -- 172.21.15.92:0/1253831500 >> 172.21.15.92:0/1253831500 conn(0x563ed7634350 msgr2=0x563ed79e90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 -- 172.21.15.92:0/1253831500 shutdown_connections 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 1 -- 172.21.15.92:0/1253831500 wait complete. 2024-09-21T07:13:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.833+0000 7f66270a8740 20 client.15810 trim_cache size 0 max 16384 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f66270a8740 1 Processor -- start 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f66270a8740 1 -- start start 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f66270a8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 0x563ed79e3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f66270a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed761f280 0x563ed79e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f66270a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed763ff60 0x563ed79eca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f66270a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ed7a02510 con 0x563ed761f280 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f66270a8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563ed7a02be0 con 0x563ed76170a0 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f66270a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563ed7a032b0 con 0x563ed763ff60 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f6619d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed761f280 0x563ed79e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f6619d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed761f280 0x563ed79e3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40832/0 (socket says 172.21.15.92:40832) 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.851+0000 7f6619d9b640 1 -- 172.21.15.92:0/2378733029 learned_addr learned my addr 172.21.15.92:0/2378733029 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:44.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f661ad9d640 1 --2- 172.21.15.92:0/2378733029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed763ff60 0x563ed79eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f661a59c640 1 --2- 172.21.15.92:0/2378733029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 0x563ed79e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f6619d9b640 1 -- 172.21.15.92:0/2378733029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed763ff60 msgr2=0x563ed79eca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f6619d9b640 1 --2- 172.21.15.92:0/2378733029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed763ff60 0x563ed79eca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f6619d9b640 1 -- 172.21.15.92:0/2378733029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 msgr2=0x563ed79e3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f6619d9b640 1 --2- 172.21.15.92:0/2378733029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 0x563ed79e3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f6619d9b640 1 -- 172.21.15.92:0/2378733029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed79f2900 con 0x563ed761f280 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f661ad9d640 1 --2- 172.21.15.92:0/2378733029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed763ff60 0x563ed79eca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f6619d9b640 1 --2- 172.21.15.92:0/2378733029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed761f280 0x563ed79e3c70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6604018000 tx=0x7f660400b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2575e0e0265c24b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f6603fff640 1 -- 172.21.15.92:0/2378733029 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604029070 con 0x563ed761f280 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f6603fff640 1 -- 172.21.15.92:0/2378733029 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6604011cc0 con 0x563ed761f280 2024-09-21T07:13:44.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.852+0000 7f6603fff640 1 -- 172.21.15.92:0/2378733029 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604024da0 con 0x563ed761f280 2024-09-21T07:13:44.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 -- 172.21.15.92:0/2378733029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed761f280 msgr2=0x563ed79e3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:44.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 --2- 172.21.15.92:0/2378733029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed761f280 0x563ed79e3c70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6604018000 tx=0x7f660400b980 comp rx=0 tx=0).stop 2024-09-21T07:13:44.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 -- 172.21.15.92:0/2378733029 shutdown_connections 2024-09-21T07:13:44.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 --2- 172.21.15.92:0/2378733029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed763ff60 0x563ed79eca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 --2- 172.21.15.92:0/2378733029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed761f280 0x563ed79e3c70 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 --2- 172.21.15.92:0/2378733029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed76170a0 0x563ed79e3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 -- 172.21.15.92:0/2378733029 >> 172.21.15.92:0/2378733029 conn(0x563ed7634350 msgr2=0x563ed79dead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:44.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 -- 172.21.15.92:0/2378733029 shutdown_connections 2024-09-21T07:13:44.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 -- 172.21.15.92:0/2378733029 wait complete. 2024-09-21T07:13:44.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 -- start start 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.853+0000 7f66270a8740 1 Processor -- start 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f66270a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed76170a0 0x563ed7a0cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f66270a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 0x563ed7a06290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f66270a8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed763ff60 0x563ed7a06930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f66270a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ed7a04050 con 0x563ed76170a0 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f66270a8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563ed7a03980 con 0x563ed763ff60 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f66270a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563ed7a04720 con 0x563ed761f280 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f66270a8740 10 client.0 _ll_register_callbacks cb 0x7f66140a9df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f661a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed76170a0 0x563ed7a0cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f661a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed76170a0 0x563ed7a0cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40834/0 (socket says 172.21.15.92:40834) 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f661a59c640 1 -- 172.21.15.92:0/986623757 learned_addr learned my addr 172.21.15.92:0/986623757 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f661ad9d640 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed763ff60 0x563ed7a06930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f6619d9b640 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 0x563ed7a06290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f661a59c640 1 -- 172.21.15.92:0/986623757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 msgr2=0x563ed7a06290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:44.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f661a59c640 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 0x563ed7a06290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f661a59c640 1 -- 172.21.15.92:0/986623757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed763ff60 msgr2=0x563ed7a06930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f661a59c640 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed763ff60 0x563ed7a06930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f661a59c640 1 -- 172.21.15.92:0/986623757 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ed79e8d60 con 0x563ed76170a0 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f6619d9b640 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 0x563ed7a06290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f661a59c640 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed76170a0 0x563ed7a0cd90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f661c111a80 tx=0x7f660c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f925260c873936cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.854+0000 7f6601ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f6601ffb640 1 -- 172.21.15.92:0/986623757 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c053060 con 0x563ed76170a0 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f6601ffb640 1 -- 172.21.15.92:0/986623757 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f660c004450 con 0x563ed76170a0 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f66270a8740 1 -- 172.21.15.92:0/986623757 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6604011cc0 con 0x563ed76170a0 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f6601ffb640 1 -- 172.21.15.92:0/986623757 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f660c05a050 con 0x563ed76170a0 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f66270a8740 10 client.15816 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f66270a8740 1 -- 172.21.15.92:0/986623757 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ed79de080 con 0x563ed76170a0 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f6601ffb640 1 -- 172.21.15.92:0/986623757 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6604011cc0 con 0x563ed76170a0 2024-09-21T07:13:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f6601ffb640 1 -- 172.21.15.92:0/986623757 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f660c046040 con 0x563ed76170a0 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f66270a8740 10 client.15816 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f66270a8740 10 client.15816 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f66270a8740 20 client.15816 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f66270a8740 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x563ed75d3c90 0x563ed7a72c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f66270a8740 4 client.15816 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.855+0000 7f66270a8740 1 -- 172.21.15.92:0/986623757 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "status"}) -- 0x563ed795b610 con 0x563ed75d3c90 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.856+0000 7f6619d9b640 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x563ed75d3c90 0x563ed7a72c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.856+0000 7f6601ffb640 10 client.15816 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.856+0000 7f6619d9b640 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x563ed75d3c90 0x563ed7a72c50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=25077a1587a3b90 server_cookie=9fffef063750eee in_seq=0 out_seq=0 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.856+0000 7f6601ffb640 1 -- 172.21.15.92:0/986623757 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563ed795b610 con 0x563ed75d3c90 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.856+0000 7f6601ffb640 10 client.15816 handle_command_reply: tid=0 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 client.15816 shutdown 2024-09-21T07:13:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 -- 172.21.15.92:0/986623757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed76170a0 msgr2=0x563ed7a0cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed76170a0 0x563ed7a0cd90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f661c111a80 tx=0x7f660c005fd0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 -- 172.21.15.92:0/986623757 shutdown_connections 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ed763ff60 0x563ed7a06930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ed761f280 0x563ed7a06290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x563ed75d3c90 0x563ed7a72c50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 --2- 172.21.15.92:0/986623757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ed76170a0 0x563ed7a0cd90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f6601ffb640 0 client.15816 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 -- 172.21.15.92:0/986623757 >> 172.21.15.92:0/986623757 conn(0x563ed7634350 msgr2=0x563ed79e35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 -- 172.21.15.92:0/986623757 shutdown_connections 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 1 -- 172.21.15.92:0/986623757 wait complete. 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f66270a8740 20 client.15816 trim_cache size 0 max 16384 2024-09-21T07:13:44.863 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 3, 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24583, 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 133.14247080300001, 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 29, 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 212.92687683400001 2024-09-21T07:13:44.864 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:44.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f6620b34640 1 -- 172.21.15.92:0/3327715040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f66080b6680 msgr2=0x7f66080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:44.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f6620b34640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f66080b6680 0x7f66080b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f660c005f70 tx=0x7f660c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f6620b34640 1 -- 172.21.15.92:0/3327715040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f661c108d20 msgr2=0x7f661c110ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:44.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.857+0000 7f6620b34640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f661c108d20 0x7f661c110ab0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f661400eaa0 tx=0x7f661400ef60 comp rx=0 tx=0).stop 2024-09-21T07:13:44.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.858+0000 7f6620b34640 1 -- 172.21.15.92:0/3327715040 shutdown_connections 2024-09-21T07:13:44.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.858+0000 7f6620b34640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f66080b6680 0x7f66080b8b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.858+0000 7f6620b34640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f661c108d20 0x7f661c110ab0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.858+0000 7f6620b34640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f661c1083d0 0x7f661c110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.858+0000 7f6620b34640 1 --2- 172.21.15.92:0/3327715040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f661c102ae0 0x7f661c110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.858+0000 7f6620b34640 1 -- 172.21.15.92:0/3327715040 >> 172.21.15.92:0/3327715040 conn(0x7f661c0797b0 msgr2=0x7f661c106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.858+0000 7f6620b34640 1 -- 172.21.15.92:0/3327715040 shutdown_connections 2024-09-21T07:13:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:44.858+0000 7f6620b34640 1 -- 172.21.15.92:0/3327715040 wait complete. 2024-09-21T07:13:45.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:44 smithi175 ceph-mon[34064]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.1 KiB/s wr, 16 op/s 2024-09-21T07:13:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:44 smithi092 ceph-mon[30987]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.1 KiB/s wr, 16 op/s 2024-09-21T07:13:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:44 smithi169 ceph-mon[33705]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.1 KiB/s wr, 16 op/s 2024-09-21T07:13:45.626 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:13:45.875 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:46.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.371+0000 7fc9e105f640 1 -- 172.21.15.92:0/1072662697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9dc103b60 msgr2=0x7fc9dc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:46.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.371+0000 7fc9e105f640 1 --2- 172.21.15.92:0/1072662697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9dc103b60 0x7fc9dc103f70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009900 tx=0x7fc9cc02a410 comp rx=0 tx=0).stop 2024-09-21T07:13:46.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.371+0000 7fc9e105f640 1 -- 172.21.15.92:0/1072662697 shutdown_connections 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.371+0000 7fc9e105f640 1 --2- 172.21.15.92:0/1072662697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9dc109df0 0x7fc9dc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.371+0000 7fc9e105f640 1 --2- 172.21.15.92:0/1072662697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9dc1094a0 0x7fc9dc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.371+0000 7fc9e105f640 1 --2- 172.21.15.92:0/1072662697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9dc103b60 0x7fc9dc103f70 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.371+0000 7fc9e105f640 1 -- 172.21.15.92:0/1072662697 >> 172.21.15.92:0/1072662697 conn(0x7fc9dc07b850 msgr2=0x7fc9dc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.371+0000 7fc9e105f640 1 -- 172.21.15.92:0/1072662697 shutdown_connections 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.371+0000 7fc9e105f640 1 -- 172.21.15.92:0/1072662697 wait complete. 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9e105f640 1 Processor -- start 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9e105f640 1 -- start start 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9e105f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9dc103b60 0x7fc9dc19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9e105f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9dc1094a0 0x7fc9dc19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9e105f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9dc109df0 0x7fc9dc19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9e105f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc113960 con 0x7fc9dc103b60 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9e105f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc1137e0 con 0x7fc9dc1094a0 2024-09-21T07:13:46.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9e105f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc113ae0 con 0x7fc9dc109df0 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9dad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9dc103b60 0x7fc9dc19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9dad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9dc103b60 0x7fc9dc19a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40848/0 (socket says 172.21.15.92:40848) 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9dad9d640 1 -- 172.21.15.92:0/56706620 learned_addr learned my addr 172.21.15.92:0/56706620 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9da59c640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9dc1094a0 0x7fc9dc19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9dad9d640 1 -- 172.21.15.92:0/56706620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9dc109df0 msgr2=0x7fc9dc19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9dc109df0 0x7fc9dc19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9dad9d640 1 -- 172.21.15.92:0/56706620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9dc1094a0 msgr2=0x7fc9dc19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.372+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9dc1094a0 0x7fc9dc19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.373+0000 7fc9dad9d640 1 -- 172.21.15.92:0/56706620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc1a0340 con 0x7fc9dc103b60 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.373+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9dc103b60 0x7fc9dc19a3d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009230 tx=0x7fc9cc0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.373+0000 7fc9c3fff640 1 -- 172.21.15.92:0/56706620 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc03f030 con 0x7fc9dc103b60 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.373+0000 7fc9e105f640 1 -- 172.21.15.92:0/56706620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc1a05d0 con 0x7fc9dc103b60 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.373+0000 7fc9c3fff640 1 -- 172.21.15.92:0/56706620 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9cc0043d0 con 0x7fc9dc103b60 2024-09-21T07:13:46.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.373+0000 7fc9c3fff640 1 -- 172.21.15.92:0/56706620 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc035070 con 0x7fc9dc103b60 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.373+0000 7fc9e105f640 1 -- 172.21.15.92:0/56706620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc1a6d90 con 0x7fc9dc103b60 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.375+0000 7fc9e75d3740 1 Processor -- start 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.375+0000 7fc9e75d3740 1 -- start start 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.375+0000 7fc9c3fff640 1 -- 172.21.15.92:0/56706620 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7fc9cc042030 con 0x7fc9dc103b60 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfcadf60 0x55e8c0053f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c0054440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0054980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e8bffcbc10 con 0x55e8bfc850a0 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e8bffbb040 con 0x55e8bfc8d280 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e8bffbee50 con 0x55e8bfcadf60 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9dad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c0054440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9dad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c0054440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40864/0 (socket says 172.21.15.92:40864) 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9dad9d640 1 -- 172.21.15.92:0/3630819450 learned_addr learned my addr 172.21.15.92:0/3630819450 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9db59e640 1 --2- 172.21.15.92:0/3630819450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfcadf60 0x55e8c0053f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9da59c640 1 --2- 172.21.15.92:0/3630819450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0054980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9dad9d640 1 -- 172.21.15.92:0/3630819450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfcadf60 msgr2=0x55e8c0053f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/3630819450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfcadf60 0x55e8c0053f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9dad9d640 1 -- 172.21.15.92:0/3630819450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 msgr2=0x55e8c0054980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/3630819450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0054980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9dad9d640 1 -- 172.21.15.92:0/3630819450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8bfd19540 con 0x55e8bfc850a0 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/3630819450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c0054440 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc105230 tx=0x7fc9cc110270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22565eeb9f8a9918 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.376+0000 7fc9c3fff640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9c40b6680 0x7fc9c40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.377+0000 7fc9db59e640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9c40b6680 0x7fc9c40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.377+0000 7fc9c17fa640 1 -- 172.21.15.92:0/3630819450 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0ca010 con 0x55e8bfc850a0 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.377+0000 7fc9c17fa640 1 -- 172.21.15.92:0/3630819450 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9cc115070 con 0x55e8bfc850a0 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.377+0000 7fc9c17fa640 1 -- 172.21.15.92:0/3630819450 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0cd130 con 0x55e8bfc850a0 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.377+0000 7fc9c3fff640 1 -- 172.21.15.92:0/56706620 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc9cc107f10 con 0x7fc9dc103b60 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 -- 172.21.15.92:0/3630819450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 msgr2=0x55e8c0054440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:46.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9db59e640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9c40b6680 0x7fc9c40b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009270 tx=0x7fc9d4009200 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/3630819450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c0054440 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc105230 tx=0x7fc9cc110270 comp rx=0 tx=0).stop 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 -- 172.21.15.92:0/3630819450 shutdown_connections 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/3630819450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0054980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/3630819450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c0054440 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/3630819450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfcadf60 0x55e8c0053f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 -- 172.21.15.92:0/3630819450 >> 172.21.15.92:0/3630819450 conn(0x55e8bfca2350 msgr2=0x55e8c0051df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 -- 172.21.15.92:0/3630819450 shutdown_connections 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 -- 172.21.15.92:0/3630819450 wait complete. 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 -- start start 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 Processor -- start 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 0x55e8c0063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.378+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0064330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e8bfe1c5f0 con 0x55e8bfcadf60 2024-09-21T07:13:46.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e8bff56010 con 0x55e8bfc8d280 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e8c0066800 con 0x55e8bfc850a0 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9e75d3740 10 client.0 _ll_register_callbacks cb 0x55e8bffb5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9db59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9dad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 0x55e8c0063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9db59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40870/0 (socket says 172.21.15.92:40870) 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9db59e640 1 -- 172.21.15.92:0/32563377 learned_addr learned my addr 172.21.15.92:0/32563377 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 0x55e8c0063df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:55922/0 (socket says 172.21.15.92:55922) 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9da59c640 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0064330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9db59e640 1 -- 172.21.15.92:0/32563377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 msgr2=0x55e8c0063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9db59e640 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 0x55e8c0063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9db59e640 1 -- 172.21.15.92:0/32563377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 msgr2=0x55e8c0064330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9db59e640 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0064330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9db59e640 1 -- 172.21.15.92:0/32563377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8bff83a00 con 0x55e8bfcadf60 2024-09-21T07:13:46.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9db59e640 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fab0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4004090 tx=0x7fc9d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1e4019658bf364 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9beff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9beff5640 1 -- 172.21.15.92:0/32563377 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4004d20 con 0x55e8bfcadf60 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9e75d3740 1 -- 172.21.15.92:0/32563377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9cc115070 con 0x55e8bfcadf60 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9beff5640 1 -- 172.21.15.92:0/32563377 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc9d400f850 con 0x55e8bfcadf60 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.379+0000 7fc9beff5640 1 -- 172.21.15.92:0/32563377 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc9d402e050 con 0x55e8bfcadf60 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9e75d3740 10 client.15828 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9e75d3740 1 -- 172.21.15.92:0/32563377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e8c0072770 con 0x55e8bfcadf60 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9beff5640 1 -- 172.21.15.92:0/32563377 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9cc115070 con 0x55e8bfcadf60 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9beff5640 1 -- 172.21.15.92:0/32563377 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc9d4005640 con 0x55e8bfcadf60 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9e75d3740 10 client.15828 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9e75d3740 10 client.15828 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9e75d3740 20 client.15828 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e8bfc6c8e0 0x55e8c0076250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9e75d3740 4 client.15828 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:46.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9e75d3740 1 -- 172.21.15.92:0/32563377 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8bffcdb60 con 0x55e8bfc6c8e0 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.380+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e8bfc6c8e0 0x55e8c0076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.381+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e8bfc6c8e0 0x55e8c0076250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee67821be182f1e server_cookie=3f26a69d886fc7c0 in_seq=0 out_seq=0 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.381+0000 7fc9beff5640 10 client.15828 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9beff5640 1 -- 172.21.15.92:0/32563377 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8bffcdb60 con 0x55e8bfc6c8e0 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9beff5640 10 client.15828 handle_command_reply: tid=0 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9e75d3740 1 client.15828 shutdown 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9e75d3740 1 -- 172.21.15.92:0/32563377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 msgr2=0x55e8c006fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fab0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4004090 tx=0x7fc9d4004a40 comp rx=0 tx=0).stop 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9e75d3740 1 -- 172.21.15.92:0/32563377 shutdown_connections 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e8bfc6c8e0 0x55e8c0076250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fab0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0064330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/32563377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 0x55e8c0063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.382+0000 7fc9e75d3740 1 -- 172.21.15.92:0/32563377 >> 172.21.15.92:0/32563377 conn(0x55e8bfca2350 msgr2=0x55e8c00503b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.383+0000 7fc9beff5640 0 client.15828 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:13:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.383+0000 7fc9e75d3740 1 -- 172.21.15.92:0/32563377 shutdown_connections 2024-09-21T07:13:46.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.383+0000 7fc9e75d3740 1 -- 172.21.15.92:0/32563377 wait complete. 2024-09-21T07:13:46.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.383+0000 7fc9e75d3740 20 client.15828 trim_cache size 0 max 16384 2024-09-21T07:13:46.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.400+0000 7fc9e75d3740 1 Processor -- start 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.400+0000 7fc9e75d3740 1 -- start start 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 0x55e8c0063dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0064310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e8c0074590 con 0x55e8bfcadf60 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e8c0074c60 con 0x55e8bfc8d280 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e8c0075330 con 0x55e8bfc850a0 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9db59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9db59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40876/0 (socket says 172.21.15.92:40876) 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9db59e640 1 -- 172.21.15.92:0/411923283 learned_addr learned my addr 172.21.15.92:0/411923283 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/411923283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 0x55e8c0063dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9da59c640 1 --2- 172.21.15.92:0/411923283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0064310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9db59e640 1 -- 172.21.15.92:0/411923283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 msgr2=0x55e8c0063dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:46.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9db59e640 1 --2- 172.21.15.92:0/411923283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 0x55e8c0063dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9db59e640 1 -- 172.21.15.92:0/411923283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 msgr2=0x55e8c0064310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:46.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9db59e640 1 --2- 172.21.15.92:0/411923283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0064310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9db59e640 1 -- 172.21.15.92:0/411923283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c0056d30 con 0x55e8bfcadf60 2024-09-21T07:13:46.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/411923283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 0x55e8c0063dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:46.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.401+0000 7fc9db59e640 1 --2- 172.21.15.92:0/411923283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fa60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4006010 tx=0x7fc9d400f480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf91f231af3f333 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:46.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.402+0000 7fc9c0ff9640 1 -- 172.21.15.92:0/411923283 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400f850 con 0x55e8bfcadf60 2024-09-21T07:13:46.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.402+0000 7fc9c0ff9640 1 -- 172.21.15.92:0/411923283 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9d4037030 con 0x55e8bfcadf60 2024-09-21T07:13:46.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.402+0000 7fc9c0ff9640 1 -- 172.21.15.92:0/411923283 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4026bc0 con 0x55e8bfcadf60 2024-09-21T07:13:46.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.402+0000 7fc9e75d3740 1 -- 172.21.15.92:0/411923283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 msgr2=0x55e8c006fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:46.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.402+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/411923283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fa60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4006010 tx=0x7fc9d400f480 comp rx=0 tx=0).stop 2024-09-21T07:13:46.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 -- 172.21.15.92:0/411923283 shutdown_connections 2024-09-21T07:13:46.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/411923283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfcadf60 0x55e8c006fa60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/411923283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfc8d280 0x55e8c0064310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/411923283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc850a0 0x55e8c0063dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 -- 172.21.15.92:0/411923283 >> 172.21.15.92:0/411923283 conn(0x55e8bfca2350 msgr2=0x55e8c0051750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:46.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 -- 172.21.15.92:0/411923283 shutdown_connections 2024-09-21T07:13:46.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 -- 172.21.15.92:0/411923283 wait complete. 2024-09-21T07:13:46.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 -- start start 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 Processor -- start 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c007e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc8d280 0x55e8c007edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfcadf60 0x55e8c0077d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e8c00760d0 con 0x55e8bfc850a0 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e8c0075a00 con 0x55e8bfcadf60 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e8c00767a0 con 0x55e8bfc8d280 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9e75d3740 10 client.0 _ll_register_callbacks cb 0x7fc9d4009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9dad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c007e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9dad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c007e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40880/0 (socket says 172.21.15.92:40880) 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.403+0000 7fc9dad9d640 1 -- 172.21.15.92:0/672286402 learned_addr learned my addr 172.21.15.92:0/672286402 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9db59e640 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfcadf60 0x55e8c0077d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9da59c640 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc8d280 0x55e8c007edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9dad9d640 1 -- 172.21.15.92:0/672286402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc8d280 msgr2=0x55e8c007edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc8d280 0x55e8c007edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9dad9d640 1 -- 172.21.15.92:0/672286402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfcadf60 msgr2=0x55e8c0077d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfcadf60 0x55e8c0077d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9dad9d640 1 -- 172.21.15.92:0/672286402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c00784e0 con 0x55e8bfc850a0 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9db59e640 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfcadf60 0x55e8c0077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9dad9d640 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c007e7f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0cd6c0 tx=0x7fc9cc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26a05175343437e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9beff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9beff5640 1 -- 172.21.15.92:0/672286402 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc049040 con 0x55e8bfc850a0 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9beff5640 1 -- 172.21.15.92:0/672286402 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc9cc105540 con 0x55e8bfc850a0 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9e75d3740 1 -- 172.21.15.92:0/672286402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d4037030 con 0x55e8bfc850a0 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9beff5640 1 -- 172.21.15.92:0/672286402 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc9cc0cd310 con 0x55e8bfc850a0 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9e75d3740 10 client.15834 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.404+0000 7fc9e75d3740 1 -- 172.21.15.92:0/672286402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e8c007de90 con 0x55e8bfc850a0 2024-09-21T07:13:46.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.405+0000 7fc9beff5640 1 -- 172.21.15.92:0/672286402 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9d4037030 con 0x55e8bfc850a0 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.405+0000 7fc9beff5640 1 -- 172.21.15.92:0/672286402 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc9cc0c9c30 con 0x55e8bfc850a0 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.405+0000 7fc9e75d3740 10 client.15834 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.405+0000 7fc9e75d3740 10 client.15834 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.405+0000 7fc9e75d3740 20 client.15834 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.405+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e8bfc41c90 0x55e8c00e4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.405+0000 7fc9e75d3740 4 client.15834 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.405+0000 7fc9e75d3740 1 -- 172.21.15.92:0/672286402 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "status"}) -- 0x55e8bffc9610 con 0x55e8bfc41c90 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.405+0000 7fc9da59c640 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e8bfc41c90 0x55e8c00e4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9beff5640 10 client.15834 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9da59c640 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e8bfc41c90 0x55e8c00e4840 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c286710306b48be4 server_cookie=b4d0559260057a82 in_seq=0 out_seq=0 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9beff5640 1 -- 172.21.15.92:0/672286402 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55e8bffc9610 con 0x55e8bfc41c90 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9beff5640 10 client.15834 handle_command_reply: tid=0 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 client.15834 shutdown 2024-09-21T07:13:46.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 -- 172.21.15.92:0/672286402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 msgr2=0x55e8c007e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c007e7f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0cd6c0 tx=0x7fc9cc009260 comp rx=0 tx=0).stop 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 -- 172.21.15.92:0/672286402 shutdown_connections 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e8bfc41c90 0x55e8c00e4840 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8bfcadf60 0x55e8c0077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8bfc8d280 0x55e8c007edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 --2- 172.21.15.92:0/672286402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8bfc850a0 0x55e8c007e7f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 -- 172.21.15.92:0/672286402 >> 172.21.15.92:0/672286402 conn(0x55e8bfca2350 msgr2=0x55e8c0063dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9beff5640 0 client.15834 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 -- 172.21.15.92:0/672286402 shutdown_connections 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 1 -- 172.21.15.92:0/672286402 wait complete. 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.406+0000 7fc9e75d3740 20 client.15834 trim_cache size 0 max 16384 2024-09-21T07:13:46.413 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 2, 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24608, 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 135.70229392300001, 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 29, 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 182.55009052 2024-09-21T07:13:46.414 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:46.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 -- 172.21.15.92:0/56706620 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9c40b6680 msgr2=0x7fc9c40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:46.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9c40b6680 0x7fc9c40b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009270 tx=0x7fc9d4009200 comp rx=0 tx=0).stop 2024-09-21T07:13:46.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 -- 172.21.15.92:0/56706620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9dc103b60 msgr2=0x7fc9dc19a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:46.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9dc103b60 0x7fc9dc19a3d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009230 tx=0x7fc9cc0319a0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 -- 172.21.15.92:0/56706620 shutdown_connections 2024-09-21T07:13:46.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc9c40b6680 0x7fc9c40b8b90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9dc109df0 0x7fc9dc19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9dc1094a0 0x7fc9dc19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 --2- 172.21.15.92:0/56706620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9dc103b60 0x7fc9dc19a3d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:46.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 -- 172.21.15.92:0/56706620 >> 172.21.15.92:0/56706620 conn(0x7fc9dc07b850 msgr2=0x7fc9dc1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:46.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 -- 172.21.15.92:0/56706620 shutdown_connections 2024-09-21T07:13:46.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:46.407+0000 7fc9e105f640 1 -- 172.21.15.92:0/56706620 wait complete. 2024-09-21T07:13:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:46 smithi175 ceph-mon[34064]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-09-21T07:13:47.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:46 smithi092 ceph-mon[30987]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-09-21T07:13:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:46 smithi169 ceph-mon[33705]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-09-21T07:13:47.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T07:13:47.414 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.899+0000 7f891932e640 1 -- 172.21.15.92:0/1059418357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914103b90 msgr2=0x7f8914103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.899+0000 7f891932e640 1 --2- 172.21.15.92:0/1059418357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914103b90 0x7f8914103fa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8904009900 tx=0x7f890402a410 comp rx=0 tx=0).stop 2024-09-21T07:13:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.899+0000 7f891932e640 1 -- 172.21.15.92:0/1059418357 shutdown_connections 2024-09-21T07:13:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.899+0000 7f891932e640 1 --2- 172.21.15.92:0/1059418357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8914109e20 0x7f8914110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.899+0000 7f891932e640 1 --2- 172.21.15.92:0/1059418357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89141094d0 0x7f89141098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.899+0000 7f891932e640 1 --2- 172.21.15.92:0/1059418357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914103b90 0x7f8914103fa0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.899+0000 7f891932e640 1 -- 172.21.15.92:0/1059418357 >> 172.21.15.92:0/1059418357 conn(0x7f89140ff620 msgr2=0x7f8914101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.899+0000 7f891932e640 1 -- 172.21.15.92:0/1059418357 shutdown_connections 2024-09-21T07:13:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.899+0000 7f891932e640 1 -- 172.21.15.92:0/1059418357 wait complete. 2024-09-21T07:13:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.899+0000 7f891932e640 1 Processor -- start 2024-09-21T07:13:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f891932e640 1 -- start start 2024-09-21T07:13:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f891932e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8914103b90 0x7f891419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f891932e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89141094d0 0x7f891419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f891932e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914109e20 0x7f89141a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f891932e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8914113990 con 0x7f8914109e20 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f891932e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8914113810 con 0x7f89141094d0 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f891932e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8914113b10 con 0x7f8914103b90 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f89137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914109e20 0x7f89141a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f89137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914109e20 0x7f89141a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40894/0 (socket says 172.21.15.92:40894) 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f89137fe640 1 -- 172.21.15.92:0/911101118 learned_addr learned my addr 172.21.15.92:0/911101118 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f890a7fc640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89141094d0 0x7f891419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f8912ffd640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8914103b90 0x7f891419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f89137fe640 1 -- 172.21.15.92:0/911101118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8914103b90 msgr2=0x7f891419c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f89137fe640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8914103b90 0x7f891419c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f89137fe640 1 -- 172.21.15.92:0/911101118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89141094d0 msgr2=0x7f891419cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:47.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f89137fe640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89141094d0 0x7f891419cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f89137fe640 1 -- 172.21.15.92:0/911101118 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89141a2530 con 0x7f8914109e20 2024-09-21T07:13:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f890a7fc640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89141094d0 0x7f891419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.900+0000 7f8912ffd640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8914103b90 0x7f891419c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.901+0000 7f89137fe640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914109e20 0x7f89141a1e00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f890c00eaa0 tx=0x7f890c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.901+0000 7f8910ff9640 1 -- 172.21.15.92:0/911101118 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c00cdb0 con 0x7f8914109e20 2024-09-21T07:13:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.901+0000 7f8910ff9640 1 -- 172.21.15.92:0/911101118 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f890c005020 con 0x7f8914109e20 2024-09-21T07:13:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.901+0000 7f891932e640 1 -- 172.21.15.92:0/911101118 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89141a2820 con 0x7f8914109e20 2024-09-21T07:13:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.901+0000 7f8910ff9640 1 -- 172.21.15.92:0/911101118 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c0116d0 con 0x7f8914109e20 2024-09-21T07:13:47.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.901+0000 7f891932e640 1 -- 172.21.15.92:0/911101118 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89141a8f80 con 0x7f8914109e20 2024-09-21T07:13:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.903+0000 7f891f8a2740 1 Processor -- start 2024-09-21T07:13:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f8910ff9640 1 -- 172.21.15.92:0/911101118 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f890c0051d0 con 0x7f8914109e20 2024-09-21T07:13:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f891f8a2740 1 -- start start 2024-09-21T07:13:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572535aaf60 0x557253950f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x557253951440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55725358a280 0x557253951980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f891f8a2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5572538c8c10 con 0x55725358a280 2024-09-21T07:13:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f891f8a2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5572538b8040 con 0x5572535820a0 2024-09-21T07:13:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f891f8a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5572538bbe50 con 0x5572535aaf60 2024-09-21T07:13:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f890a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55725358a280 0x557253951980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f890a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55725358a280 0x557253951980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40904/0 (socket says 172.21.15.92:40904) 2024-09-21T07:13:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f890a7fc640 1 -- 172.21.15.92:0/41382051 learned_addr learned my addr 172.21.15.92:0/41382051 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.904+0000 7f890a7fc640 1 --2- 172.21.15.92:0/41382051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572535aaf60 0x557253950f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f8912ffd640 1 --2- 172.21.15.92:0/41382051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x557253951440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f890a7fc640 1 -- 172.21.15.92:0/41382051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572535aaf60 msgr2=0x557253950f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f890a7fc640 1 --2- 172.21.15.92:0/41382051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572535aaf60 0x557253950f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f890a7fc640 1 -- 172.21.15.92:0/41382051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 msgr2=0x557253951440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f890a7fc640 1 --2- 172.21.15.92:0/41382051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x557253951440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f890a7fc640 1 -- 172.21.15.92:0/41382051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557253616540 con 0x55725358a280 2024-09-21T07:13:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f890a7fc640 1 --2- 172.21.15.92:0/41382051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55725358a280 0x557253951980 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0149f0 tx=0x7f88fc00c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81afa6b35f16194f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f8910ff9640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89000b6680 0x7f89000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f8912ffd640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89000b6680 0x7f89000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f89097fa640 1 -- 172.21.15.92:0/41382051 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc0142d0 con 0x55725358a280 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f89097fa640 1 -- 172.21.15.92:0/41382051 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88fc00f760 con 0x55725358a280 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f89097fa640 1 -- 172.21.15.92:0/41382051 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc0044c0 con 0x55725358a280 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.905+0000 7f8910ff9640 1 -- 172.21.15.92:0/911101118 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f890c0e7d40 con 0x7f8914109e20 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.906+0000 7f891f8a2740 1 -- 172.21.15.92:0/41382051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55725358a280 msgr2=0x557253951980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.906+0000 7f8912ffd640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89000b6680 0x7f89000b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8904000c00 tx=0x7f8904005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.906+0000 7f891f8a2740 1 --2- 172.21.15.92:0/41382051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55725358a280 0x557253951980 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0149f0 tx=0x7f88fc00c510 comp rx=0 tx=0).stop 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.906+0000 7f891f8a2740 1 -- 172.21.15.92:0/41382051 shutdown_connections 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.906+0000 7f891f8a2740 1 --2- 172.21.15.92:0/41382051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55725358a280 0x557253951980 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.906+0000 7f891f8a2740 1 --2- 172.21.15.92:0/41382051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x557253951440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.906+0000 7f891f8a2740 1 --2- 172.21.15.92:0/41382051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572535aaf60 0x557253950f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.906+0000 7f891f8a2740 1 -- 172.21.15.92:0/41382051 >> 172.21.15.92:0/41382051 conn(0x55725359f350 msgr2=0x55725394edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.906+0000 7f891f8a2740 1 -- 172.21.15.92:0/41382051 shutdown_connections 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.906+0000 7f891f8a2740 1 -- 172.21.15.92:0/41382051 wait complete. 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f891f8a2740 1 -- start start 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f891f8a2740 1 Processor -- start 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x55725395caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 0x55725395cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x557253968970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f891f8a2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5572537195f0 con 0x5572535aaf60 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f891f8a2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557253853010 con 0x5572535820a0 2024-09-21T07:13:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f891f8a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55725395f680 con 0x55725358a280 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f891f8a2740 10 client.0 _ll_register_callbacks cb 0x5572538b2340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f89137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x557253968970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f89137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x557253968970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40916/0 (socket says 172.21.15.92:40916) 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f89137fe640 1 -- 172.21.15.92:0/3007490273 learned_addr learned my addr 172.21.15.92:0/3007490273 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f890a7fc640 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 0x55725395cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.907+0000 7f8912ffd640 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x55725395caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f89137fe640 1 -- 172.21.15.92:0/3007490273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 msgr2=0x55725395cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f89137fe640 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 0x55725395cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f89137fe640 1 -- 172.21.15.92:0/3007490273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 msgr2=0x55725395caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f89137fe640 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x55725395caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f89137fe640 1 -- 172.21.15.92:0/3007490273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557253880a00 con 0x5572535aaf60 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f890a7fc640 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 0x55725395cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f89137fe640 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x557253968970 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f890c009270 tx=0x7f890c0ad030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15838ae008171c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f88fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f88fa7fc640 1 -- 172.21.15.92:0/3007490273 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c01f070 con 0x5572535aaf60 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f88fa7fc640 1 -- 172.21.15.92:0/3007490273 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f890c0aeb20 con 0x5572535aaf60 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f891f8a2740 1 -- 172.21.15.92:0/3007490273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88fc00f760 con 0x5572535aaf60 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f88fa7fc640 1 -- 172.21.15.92:0/3007490273 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f890c0d2030 con 0x5572535aaf60 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f891f8a2740 10 client.15846 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f891f8a2740 1 -- 172.21.15.92:0/3007490273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55725396b6e0 con 0x5572535aaf60 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f88fa7fc640 1 -- 172.21.15.92:0/3007490273 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88fc00f760 con 0x5572535aaf60 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.908+0000 7f88fa7fc640 1 -- 172.21.15.92:0/3007490273 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f890c00f040 con 0x5572535aaf60 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.909+0000 7f891f8a2740 10 client.15846 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.909+0000 7f891f8a2740 10 client.15846 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.909+0000 7f891f8a2740 20 client.15846 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.909+0000 7f891f8a2740 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5572535698e0 0x55725396f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.909+0000 7f891f8a2740 4 client.15846 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.909+0000 7f891f8a2740 1 -- 172.21.15.92:0/3007490273 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572538cab60 con 0x5572535698e0 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.909+0000 7f8912ffd640 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5572535698e0 0x55725396f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.909+0000 7f88fa7fc640 10 client.15846 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.909+0000 7f8912ffd640 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5572535698e0 0x55725396f110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92511347484f8acc server_cookie=38be2b64b72df7b3 in_seq=0 out_seq=0 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.910+0000 7f88fa7fc640 1 -- 172.21.15.92:0/3007490273 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572538cab60 con 0x5572535698e0 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.910+0000 7f88fa7fc640 10 client.15846 handle_command_reply: tid=0 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.910+0000 7f891f8a2740 1 client.15846 shutdown 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.910+0000 7f891f8a2740 1 -- 172.21.15.92:0/3007490273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 msgr2=0x557253968970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.910+0000 7f891f8a2740 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x557253968970 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f890c009270 tx=0x7f890c0ad030 comp rx=0 tx=0).stop 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.911+0000 7f891f8a2740 1 -- 172.21.15.92:0/3007490273 shutdown_connections 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.911+0000 7f891f8a2740 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5572535698e0 0x55725396f110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.911+0000 7f891f8a2740 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x557253968970 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.911+0000 7f891f8a2740 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 0x55725395cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.911+0000 7f891f8a2740 1 --2- 172.21.15.92:0/3007490273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x55725395caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.911+0000 7f88fa7fc640 0 client.15846 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:13:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.911+0000 7f891f8a2740 1 -- 172.21.15.92:0/3007490273 >> 172.21.15.92:0/3007490273 conn(0x55725359f350 msgr2=0x557253954090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.911+0000 7f891f8a2740 1 -- 172.21.15.92:0/3007490273 shutdown_connections 2024-09-21T07:13:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.911+0000 7f891f8a2740 1 -- 172.21.15.92:0/3007490273 wait complete. 2024-09-21T07:13:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.911+0000 7f891f8a2740 20 client.15846 trim_cache size 0 max 16384 2024-09-21T07:13:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.928+0000 7f891f8a2740 1 Processor -- start 2024-09-21T07:13:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.928+0000 7f891f8a2740 1 -- start start 2024-09-21T07:13:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572535820a0 0x5572539579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725358a280 0x557253957f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x55725395b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f891f8a2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55725396d450 con 0x5572535aaf60 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f891f8a2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55725396db20 con 0x55725358a280 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f891f8a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55725396e1f0 con 0x5572535820a0 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f89137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x55725395b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f89137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x55725395b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40920/0 (socket says 172.21.15.92:40920) 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f89137fe640 1 -- 172.21.15.92:0/3932985957 learned_addr learned my addr 172.21.15.92:0/3932985957 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f8912ffd640 1 --2- 172.21.15.92:0/3932985957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572535820a0 0x5572539579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f890a7fc640 1 --2- 172.21.15.92:0/3932985957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725358a280 0x557253957f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f89137fe640 1 -- 172.21.15.92:0/3932985957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572535820a0 msgr2=0x5572539579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f89137fe640 1 --2- 172.21.15.92:0/3932985957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572535820a0 0x5572539579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f89137fe640 1 -- 172.21.15.92:0/3932985957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725358a280 msgr2=0x557253957f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f89137fe640 1 --2- 172.21.15.92:0/3932985957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725358a280 0x557253957f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f89137fe640 1 -- 172.21.15.92:0/3932985957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557253949080 con 0x5572535aaf60 2024-09-21T07:13:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f890a7fc640 1 --2- 172.21.15.92:0/3932985957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725358a280 0x557253957f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.929+0000 7f89137fe640 1 --2- 172.21.15.92:0/3932985957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x55725395b120 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f890c0a9fb0 tx=0x7f890c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd30f8ef5fa6435 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f8908ff9640 1 -- 172.21.15.92:0/3932985957 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c01f040 con 0x5572535aaf60 2024-09-21T07:13:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f8908ff9640 1 -- 172.21.15.92:0/3932985957 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f890c0b7210 con 0x5572535aaf60 2024-09-21T07:13:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f8908ff9640 1 -- 172.21.15.92:0/3932985957 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c0aeb20 con 0x5572535aaf60 2024-09-21T07:13:47.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f891f8a2740 1 -- 172.21.15.92:0/3932985957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 msgr2=0x55725395b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:47.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f891f8a2740 1 --2- 172.21.15.92:0/3932985957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x55725395b120 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f890c0a9fb0 tx=0x7f890c005720 comp rx=0 tx=0).stop 2024-09-21T07:13:47.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f891f8a2740 1 -- 172.21.15.92:0/3932985957 shutdown_connections 2024-09-21T07:13:47.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f891f8a2740 1 --2- 172.21.15.92:0/3932985957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x55725395b120 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f891f8a2740 1 --2- 172.21.15.92:0/3932985957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725358a280 0x557253957f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f891f8a2740 1 --2- 172.21.15.92:0/3932985957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572535820a0 0x5572539579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f891f8a2740 1 -- 172.21.15.92:0/3932985957 >> 172.21.15.92:0/3932985957 conn(0x55725359f350 msgr2=0x557253949ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.930+0000 7f891f8a2740 1 -- 172.21.15.92:0/3932985957 shutdown_connections 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f891f8a2740 1 -- 172.21.15.92:0/3932985957 wait complete. 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f891f8a2740 1 -- start start 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f891f8a2740 1 Processor -- start 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x557253977900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 0x557253970db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f891f8a2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x5572539712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f891f8a2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55725396ef90 con 0x5572535aaf60 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f891f8a2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55725396e8c0 con 0x5572535820a0 2024-09-21T07:13:47.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f891f8a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55725396f660 con 0x55725358a280 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f891f8a2740 10 client.0 _ll_register_callbacks cb 0x7f890c0a9ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f89137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x5572539712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f89137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x5572539712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40932/0 (socket says 172.21.15.92:40932) 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.931+0000 7f89137fe640 1 -- 172.21.15.92:0/2491644178 learned_addr learned my addr 172.21.15.92:0/2491644178 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f890a7fc640 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 0x557253970db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f8912ffd640 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x557253977900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f89137fe640 1 -- 172.21.15.92:0/2491644178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 msgr2=0x557253970db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f89137fe640 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 0x557253970db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f89137fe640 1 -- 172.21.15.92:0/2491644178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 msgr2=0x557253977900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f89137fe640 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x557253977900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f89137fe640 1 -- 172.21.15.92:0/2491644178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557253971830 con 0x5572535aaf60 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f89137fe640 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x5572539712f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f890c0ad4f0 tx=0x7f890c0aedd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfd9866664d502d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:47.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f88fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f88fa7fc640 1 -- 172.21.15.92:0/2491644178 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c070060 con 0x5572535aaf60 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f88fa7fc640 1 -- 172.21.15.92:0/2491644178 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f890c0ac6d0 con 0x5572535aaf60 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f891f8a2740 1 -- 172.21.15.92:0/2491644178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f890c0b7210 con 0x5572535aaf60 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f88fa7fc640 1 -- 172.21.15.92:0/2491644178 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f890c01f070 con 0x5572535aaf60 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f891f8a2740 10 client.15852 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f891f8a2740 1 -- 172.21.15.92:0/2491644178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5572539771a0 con 0x5572535aaf60 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.932+0000 7f88fa7fc640 1 -- 172.21.15.92:0/2491644178 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f890c0b7210 con 0x5572535aaf60 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.933+0000 7f88fa7fc640 1 -- 172.21.15.92:0/2491644178 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f890c004bb0 con 0x5572535aaf60 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.933+0000 7f891f8a2740 10 client.15852 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.933+0000 7f891f8a2740 10 client.15852 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.933+0000 7f891f8a2740 20 client.15852 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.933+0000 7f891f8a2740 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55725353ec90 0x5572539dd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.933+0000 7f891f8a2740 4 client.15852 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:13:47.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.933+0000 7f891f8a2740 1 -- 172.21.15.92:0/2491644178 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "status"}) -- 0x5572538c6610 con 0x55725353ec90 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.933+0000 7f8912ffd640 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55725353ec90 0x5572539dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.933+0000 7f8912ffd640 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55725353ec90 0x5572539dd570 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18db828a0340b50a server_cookie=cf255e7e002b2f64 in_seq=0 out_seq=0 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.933+0000 7f88fa7fc640 10 client.15852 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f88fa7fc640 1 -- 172.21.15.92:0/2491644178 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5572538c6610 con 0x55725353ec90 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f88fa7fc640 10 client.15852 handle_command_reply: tid=0 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 client.15852 shutdown 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 -- 172.21.15.92:0/2491644178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 msgr2=0x5572539712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x5572539712f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f890c0ad4f0 tx=0x7f890c0aedd0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 -- 172.21.15.92:0/2491644178 shutdown_connections 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55725353ec90 0x5572539dd570 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572535aaf60 0x5572539712f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55725358a280 0x557253970db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 --2- 172.21.15.92:0/2491644178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572535820a0 0x557253977900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 -- 172.21.15.92:0/2491644178 >> 172.21.15.92:0/2491644178 conn(0x55725359f350 msgr2=0x5572539579e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:47.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f88fa7fc640 0 client.15852 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:13:47.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 -- 172.21.15.92:0/2491644178 shutdown_connections 2024-09-21T07:13:47.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 1 -- 172.21.15.92:0/2491644178 wait complete. 2024-09-21T07:13:47.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.934+0000 7f891f8a2740 20 client.15852 trim_cache size 0 max 16384 2024-09-21T07:13:47.941 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:47.941 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:13:47.941 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 1, 2024-09-21T07:13:47.941 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24625, 2024-09-21T07:13:47.941 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:13:47.942 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:13:47.942 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:13:47.942 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 138.23404922200001, 2024-09-21T07:13:47.942 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 29, 2024-09-21T07:13:47.942 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:13:47.942 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:13:47.942 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 200.93553592000001 2024-09-21T07:13:47.942 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 -- 172.21.15.92:0/911101118 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89000b6680 msgr2=0x7f89000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89000b6680 0x7f89000b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8904000c00 tx=0x7f8904005a20 comp rx=0 tx=0).stop 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 -- 172.21.15.92:0/911101118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914109e20 msgr2=0x7f89141a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914109e20 0x7f89141a1e00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f890c00eaa0 tx=0x7f890c00ef60 comp rx=0 tx=0).stop 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 -- 172.21.15.92:0/911101118 shutdown_connections 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f89000b6680 0x7f89000b8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914109e20 0x7f89141a1e00 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89141094d0 0x7f891419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 --2- 172.21.15.92:0/911101118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8914103b90 0x7f891419c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 -- 172.21.15.92:0/911101118 >> 172.21.15.92:0/911101118 conn(0x7f89140ff620 msgr2=0x7f8914108bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 -- 172.21.15.92:0/911101118 shutdown_connections 2024-09-21T07:13:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:47.935+0000 7f891932e640 1 -- 172.21.15.92:0/911101118 wait complete. 2024-09-21T07:13:48.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:13:48.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:48 smithi092 ceph-mon[30987]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-21T07:13:48.882 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:13:49.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:48 smithi175 ceph-mon[34064]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-21T07:13:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:48 smithi169 ceph-mon[33705]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-21T07:13:49.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.365+0000 7f47969b3640 1 -- 172.21.15.92:0/3083926168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4790109df0 msgr2=0x7f4790110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:49.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.365+0000 7f47969b3640 1 --2- 172.21.15.92:0/3083926168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4790109df0 0x7f4790110620 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4788009ca0 tx=0x7f478802a8e0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.365+0000 7f47969b3640 1 -- 172.21.15.92:0/3083926168 shutdown_connections 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.365+0000 7f47969b3640 1 --2- 172.21.15.92:0/3083926168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4790109df0 0x7f4790110620 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.365+0000 7f47969b3640 1 --2- 172.21.15.92:0/3083926168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47901094a0 0x7f47901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.365+0000 7f47969b3640 1 --2- 172.21.15.92:0/3083926168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4790103b60 0x7f4790103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.365+0000 7f47969b3640 1 -- 172.21.15.92:0/3083926168 >> 172.21.15.92:0/3083926168 conn(0x7f479007b850 msgr2=0x7f479007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.365+0000 7f47969b3640 1 -- 172.21.15.92:0/3083926168 shutdown_connections 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.365+0000 7f47969b3640 1 -- 172.21.15.92:0/3083926168 wait complete. 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f47969b3640 1 Processor -- start 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f47969b3640 1 -- start start 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f47969b3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4790103b60 0x7f479019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f47969b3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47901094a0 0x7f479019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f47969b3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4790109df0 0x7f479019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f47969b3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47901139c0 con 0x7f4790109df0 2024-09-21T07:13:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f47969b3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4790113840 con 0x7f4790103b60 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f47969b3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4790113b40 con 0x7f47901094a0 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f4794f50640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4790109df0 0x7f479019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f4794f50640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4790109df0 0x7f479019fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40956/0 (socket says 172.21.15.92:40956) 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.366+0000 7f4794f50640 1 -- 172.21.15.92:0/1664112753 learned_addr learned my addr 172.21.15.92:0/1664112753 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f478f7fe640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47901094a0 0x7f479019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f478ffff640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4790103b60 0x7f479019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f4794f50640 1 -- 172.21.15.92:0/1664112753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47901094a0 msgr2=0x7f479019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f4794f50640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47901094a0 0x7f479019a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f4794f50640 1 -- 172.21.15.92:0/1664112753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4790103b60 msgr2=0x7f479019a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f4794f50640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4790103b60 0x7f479019a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f4794f50640 1 -- 172.21.15.92:0/1664112753 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47901a0340 con 0x7f4790109df0 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f478f7fe640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47901094a0 0x7f479019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f4794f50640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4790109df0 0x7f479019fc10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4788006010 tx=0x7f4788003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:49.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f478d7fa640 1 -- 172.21.15.92:0/1664112753 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788004240 con 0x7f4790109df0 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f478d7fa640 1 -- 172.21.15.92:0/1664112753 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4788003e10 con 0x7f4790109df0 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f47969b3640 1 -- 172.21.15.92:0/1664112753 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47901a05d0 con 0x7f4790109df0 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f478d7fa640 1 -- 172.21.15.92:0/1664112753 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788030d70 con 0x7f4790109df0 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.367+0000 7f47969b3640 1 -- 172.21.15.92:0/1664112753 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47901a6d90 con 0x7f4790109df0 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.370+0000 7f478d7fa640 1 -- 172.21.15.92:0/1664112753 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f47880043e0 con 0x7f4790109df0 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.370+0000 7f479cf27740 1 Processor -- start 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.370+0000 7f479cf27740 1 -- start start 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.370+0000 7f479cf27740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b5af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.370+0000 7f479cf27740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b5b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.370+0000 7f479cf27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562639794280 0x562639b5b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.370+0000 7f479cf27740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562639ad2c10 con 0x5626397b4f60 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.370+0000 7f479cf27740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562639ac2040 con 0x56263978c0a0 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.370+0000 7f479cf27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562639ac5e50 con 0x562639794280 2024-09-21T07:13:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.370+0000 7f478f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b5af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b5af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40962/0 (socket says 172.21.15.92:40962) 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478f7fe640 1 -- 172.21.15.92:0/208894461 learned_addr learned my addr 172.21.15.92:0/208894461 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478ffff640 1 --2- 172.21.15.92:0/208894461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b5b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478d7fa640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47780b6700 0x7f47780b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478f7fe640 1 --2- 172.21.15.92:0/208894461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562639794280 0x562639b5b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f4794f50640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47780b6700 0x7f47780b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478f7fe640 1 -- 172.21.15.92:0/208894461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562639794280 msgr2=0x562639b5b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478f7fe640 1 --2- 172.21.15.92:0/208894461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562639794280 0x562639b5b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478f7fe640 1 -- 172.21.15.92:0/208894461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 msgr2=0x562639b5b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478d7fa640 1 -- 172.21.15.92:0/1664112753 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4788108de0 con 0x7f4790109df0 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478f7fe640 1 --2- 172.21.15.92:0/208894461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b5b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478f7fe640 1 -- 172.21.15.92:0/208894461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562639820540 con 0x5626397b4f60 2024-09-21T07:13:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f478f7fe640 1 --2- 172.21.15.92:0/208894461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b5af00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4784016580 tx=0x7f47840073c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a214510940acbf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f4794f50640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47780b6700 0x7f47780b8c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4788106240 tx=0x7f478809b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f47767fc640 1 -- 172.21.15.92:0/208894461 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784011670 con 0x5626397b4f60 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f47767fc640 1 -- 172.21.15.92:0/208894461 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4784010040 con 0x5626397b4f60 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.371+0000 7f47767fc640 1 -- 172.21.15.92:0/208894461 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47840188a0 con 0x5626397b4f60 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.372+0000 7f479cf27740 1 -- 172.21.15.92:0/208894461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 msgr2=0x562639b5af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.372+0000 7f479cf27740 1 --2- 172.21.15.92:0/208894461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b5af00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4784016580 tx=0x7f47840073c0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.372+0000 7f479cf27740 1 -- 172.21.15.92:0/208894461 shutdown_connections 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.372+0000 7f479cf27740 1 --2- 172.21.15.92:0/208894461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562639794280 0x562639b5b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.372+0000 7f479cf27740 1 --2- 172.21.15.92:0/208894461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b5b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.372+0000 7f479cf27740 1 --2- 172.21.15.92:0/208894461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b5af00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.372+0000 7f479cf27740 1 -- 172.21.15.92:0/208894461 >> 172.21.15.92:0/208894461 conn(0x5626397a9350 msgr2=0x562639b58df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.372+0000 7f479cf27740 1 -- 172.21.15.92:0/208894461 shutdown_connections 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.372+0000 7f479cf27740 1 -- 172.21.15.92:0/208894461 wait complete. 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f479cf27740 1 -- start start 2024-09-21T07:13:49.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f479cf27740 1 Processor -- start 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f479cf27740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b669c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f479cf27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562639794280 0x562639b66f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f479cf27740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f479cf27740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5626399235f0 con 0x5626397b4f60 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f479cf27740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562639a5d010 con 0x56263978c0a0 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f479cf27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562639b69680 con 0x562639794280 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f479cf27740 10 client.0 _ll_register_callbacks cb 0x562639abc340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f478f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f478f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40966/0 (socket says 172.21.15.92:40966) 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.373+0000 7f478f7fe640 1 -- 172.21.15.92:0/2045713504 learned_addr learned my addr 172.21.15.92:0/2045713504 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f478ffff640 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562639794280 0x562639b66f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f478f7fe640 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f478f7fe640 1 -- 172.21.15.92:0/2045713504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562639794280 msgr2=0x562639b66f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:49.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f478f7fe640 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562639794280 0x562639b66f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f478f7fe640 1 -- 172.21.15.92:0/2045713504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 msgr2=0x562639b669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f478f7fe640 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b669c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f478f7fe640 1 -- 172.21.15.92:0/2045713504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562639a8aa00 con 0x5626397b4f60 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f478f7fe640 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b729a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4784007890 tx=0x7f4784018580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc0626397f91f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f476f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f476f7fe640 1 -- 172.21.15.92:0/2045713504 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478401e040 con 0x5626397b4f60 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f476f7fe640 1 -- 172.21.15.92:0/2045713504 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4784005bc0 con 0x5626397b4f60 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f479cf27740 1 -- 172.21.15.92:0/2045713504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4784010040 con 0x5626397b4f60 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f476f7fe640 1 -- 172.21.15.92:0/2045713504 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f478402a650 con 0x5626397b4f60 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f479cf27740 10 client.15864 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f479cf27740 1 -- 172.21.15.92:0/2045713504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562639b755a0 con 0x5626397b4f60 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.374+0000 7f476f7fe640 1 -- 172.21.15.92:0/2045713504 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4784010040 con 0x5626397b4f60 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.375+0000 7f476f7fe640 1 -- 172.21.15.92:0/2045713504 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4784011a50 con 0x5626397b4f60 2024-09-21T07:13:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.375+0000 7f479cf27740 10 client.15864 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.375+0000 7f479cf27740 10 client.15864 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.375+0000 7f479cf27740 20 client.15864 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.375+0000 7f479cf27740 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626397738e0 0x562639b78d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.375+0000 7f479cf27740 4 client.15864 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.375+0000 7f479cf27740 1 -- 172.21.15.92:0/2045713504 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562639ad4b60 con 0x5626397738e0 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.375+0000 7f478ffff640 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626397738e0 0x562639b78d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.375+0000 7f476f7fe640 10 client.15864 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.375+0000 7f478ffff640 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626397738e0 0x562639b78d20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e274ca31393d3f96 server_cookie=dd9ec349cdd6c535 in_seq=0 out_seq=0 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.376+0000 7f476f7fe640 1 -- 172.21.15.92:0/2045713504 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562639ad4b60 con 0x5626397738e0 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.376+0000 7f476f7fe640 10 client.15864 handle_command_reply: tid=0 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.376+0000 7f479cf27740 1 client.15864 shutdown 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 1 -- 172.21.15.92:0/2045713504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 msgr2=0x562639b729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b729a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4784007890 tx=0x7f4784018580 comp rx=0 tx=0).stop 2024-09-21T07:13:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 1 -- 172.21.15.92:0/2045713504 shutdown_connections 2024-09-21T07:13:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626397738e0 0x562639b78d20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f476f7fe640 0 client.15864 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626397b4f60 0x562639b729a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562639794280 0x562639b66f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 1 --2- 172.21.15.92:0/2045713504 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 1 -- 172.21.15.92:0/2045713504 >> 172.21.15.92:0/2045713504 conn(0x5626397a9350 msgr2=0x562639b5e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 1 -- 172.21.15.92:0/2045713504 shutdown_connections 2024-09-21T07:13:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 1 -- 172.21.15.92:0/2045713504 wait complete. 2024-09-21T07:13:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.377+0000 7f479cf27740 20 client.15864 trim_cache size 0 max 16384 2024-09-21T07:13:49.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f479cf27740 1 Processor -- start 2024-09-21T07:13:49.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f479cf27740 1 -- start start 2024-09-21T07:13:49.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f479cf27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626397738e0 0x562639b61020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f479cf27740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b72910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f479cf27740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b72e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f479cf27740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562639b77060 con 0x562639794280 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f479cf27740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562639b77730 con 0x56263978c0a0 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f479cf27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562639b77e00 con 0x5626397738e0 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b72e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b72e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40974/0 (socket says 172.21.15.92:40974) 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478f7fe640 1 -- 172.21.15.92:0/2189173053 learned_addr learned my addr 172.21.15.92:0/2189173053 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478ffff640 1 --2- 172.21.15.92:0/2189173053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b72910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478f7fe640 1 --2- 172.21.15.92:0/2189173053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626397738e0 0x562639b61020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478f7fe640 1 -- 172.21.15.92:0/2189173053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626397738e0 msgr2=0x562639b61020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478f7fe640 1 --2- 172.21.15.92:0/2189173053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626397738e0 0x562639b61020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478f7fe640 1 -- 172.21.15.92:0/2189173053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 msgr2=0x562639b72910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:49.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478f7fe640 1 --2- 172.21.15.92:0/2189173053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b72910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478f7fe640 1 -- 172.21.15.92:0/2189173053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562639b676f0 con 0x562639794280 2024-09-21T07:13:49.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.395+0000 7f478ffff640 1 --2- 172.21.15.92:0/2189173053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b72910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:49.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.396+0000 7f478f7fe640 1 --2- 172.21.15.92:0/2189173053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b72e50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4784018550 tx=0x7f4784016430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61062f7b36175652 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:49.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.396+0000 7f4775ffb640 1 -- 172.21.15.92:0/2189173053 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47840078c0 con 0x562639794280 2024-09-21T07:13:49.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.396+0000 7f4775ffb640 1 -- 172.21.15.92:0/2189173053 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4784007b00 con 0x562639794280 2024-09-21T07:13:49.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.396+0000 7f4775ffb640 1 -- 172.21.15.92:0/2189173053 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784005db0 con 0x562639794280 2024-09-21T07:13:49.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.396+0000 7f479cf27740 1 -- 172.21.15.92:0/2189173053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 msgr2=0x562639b72e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.396+0000 7f479cf27740 1 --2- 172.21.15.92:0/2189173053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b72e50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4784018550 tx=0x7f4784016430 comp rx=0 tx=0).stop 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 -- 172.21.15.92:0/2189173053 shutdown_connections 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 --2- 172.21.15.92:0/2189173053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b72e50 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 --2- 172.21.15.92:0/2189173053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56263978c0a0 0x562639b72910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 --2- 172.21.15.92:0/2189173053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626397738e0 0x562639b61020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 -- 172.21.15.92:0/2189173053 >> 172.21.15.92:0/2189173053 conn(0x5626397a9350 msgr2=0x562639b619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 -- 172.21.15.92:0/2189173053 shutdown_connections 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 -- 172.21.15.92:0/2189173053 wait complete. 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 -- start start 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 Processor -- start 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626397738e0 0x562639b813b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.397+0000 7f479cf27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56263978c0a0 0x562639b81990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f479cf27740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b7a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f479cf27740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562639b78ba0 con 0x562639794280 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f479cf27740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562639b784d0 con 0x5626397738e0 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f479cf27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562639b79270 con 0x56263978c0a0 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f479cf27740 10 client.0 _ll_register_callbacks cb 0x7f47800092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b7a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b7a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40982/0 (socket says 172.21.15.92:40982) 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478f7fe640 1 -- 172.21.15.92:0/3787113821 learned_addr learned my addr 172.21.15.92:0/3787113821 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478f7fe640 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626397738e0 0x562639b813b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478ffff640 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56263978c0a0 0x562639b81990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478f7fe640 1 -- 172.21.15.92:0/3787113821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56263978c0a0 msgr2=0x562639b81990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478f7fe640 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56263978c0a0 0x562639b81990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478f7fe640 1 -- 172.21.15.92:0/3787113821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626397738e0 msgr2=0x562639b813b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478f7fe640 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626397738e0 0x562639b813b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478f7fe640 1 -- 172.21.15.92:0/3787113821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562639b7b130 con 0x562639794280 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f478f7fe640 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b7a9a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4784007d10 tx=0x7f47840183d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865f75ce30e2ccec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f476f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f476f7fe640 1 -- 172.21.15.92:0/3787113821 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784007320 con 0x562639794280 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f476f7fe640 1 -- 172.21.15.92:0/3787113821 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4784005b30 con 0x562639794280 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.398+0000 7f479cf27740 1 -- 172.21.15.92:0/3787113821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4784007b00 con 0x562639794280 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f476f7fe640 1 -- 172.21.15.92:0/3787113821 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f47840074c0 con 0x562639794280 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f479cf27740 10 client.15870 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f479cf27740 1 -- 172.21.15.92:0/3787113821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562639b80b30 con 0x562639794280 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f476f7fe640 1 -- 172.21.15.92:0/3787113821 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4784007b00 con 0x562639794280 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f476f7fe640 1 -- 172.21.15.92:0/3787113821 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4784010070 con 0x562639794280 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f479cf27740 10 client.15870 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f479cf27740 10 client.15870 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f479cf27740 20 client.15870 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:49.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f479cf27740 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626397b4f60 0x562639be7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f479cf27740 4 client.15870 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f479cf27740 1 -- 172.21.15.92:0/3787113821 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "status"}) -- 0x562639ad0610 con 0x5626397b4f60 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.399+0000 7f478ffff640 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626397b4f60 0x562639be7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f476f7fe640 10 client.15870 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f478ffff640 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626397b4f60 0x562639be7190 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2f025f3fcd988db server_cookie=ebbab8acb07d6b4c in_seq=0 out_seq=0 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f476f7fe640 1 -- 172.21.15.92:0/3787113821 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562639ad0610 con 0x5626397b4f60 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f476f7fe640 10 client.15870 handle_command_reply: tid=0 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 client.15870 shutdown 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 -- 172.21.15.92:0/3787113821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 msgr2=0x562639b7a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b7a9a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4784007d10 tx=0x7f47840183d0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 -- 172.21.15.92:0/3787113821 shutdown_connections 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626397b4f60 0x562639be7190 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f476f7fe640 0 client.15870 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:49.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562639794280 0x562639b7a9a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56263978c0a0 0x562639b81990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 --2- 172.21.15.92:0/3787113821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626397738e0 0x562639b813b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 -- 172.21.15.92:0/3787113821 >> 172.21.15.92:0/3787113821 conn(0x5626397a9350 msgr2=0x562639b58600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 -- 172.21.15.92:0/3787113821 shutdown_connections 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.400+0000 7f479cf27740 1 -- 172.21.15.92:0/3787113821 wait complete. 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f479cf27740 20 client.15870 trim_cache size 0 max 16384 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "4e9565c0-77e7-11ef-baf5-efdc52797490", 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24649, 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-21T07:13:49.407 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-21T07:13:49.408 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-21T07:13:49.408 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 174.91365242500001, 2024-09-21T07:13:49.408 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 29, 2024-09-21T07:13:49.408 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 86, 2024-09-21T07:13:49.408 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:13:49.408 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 194.56706170699999 2024-09-21T07:13:49.408 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:13:49.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 -- 172.21.15.92:0/1664112753 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47780b6700 msgr2=0x7f47780b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47780b6700 0x7f47780b8c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4788106240 tx=0x7f478809b540 comp rx=0 tx=0).stop 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 -- 172.21.15.92:0/1664112753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4790109df0 msgr2=0x7f479019fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4790109df0 0x7f479019fc10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4788006010 tx=0x7f4788003c20 comp rx=0 tx=0).stop 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 -- 172.21.15.92:0/1664112753 shutdown_connections 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47780b6700 0x7f47780b8c10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4790109df0 0x7f479019fc10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47901094a0 0x7f479019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 --2- 172.21.15.92:0/1664112753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4790103b60 0x7f479019a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 -- 172.21.15.92:0/1664112753 >> 172.21.15.92:0/1664112753 conn(0x7f479007b850 msgr2=0x7f47901054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 -- 172.21.15.92:0/1664112753 shutdown_connections 2024-09-21T07:13:49.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:13:49.401+0000 7f47969b3640 1 -- 172.21.15.92:0/1664112753 wait complete. 2024-09-21T07:13:50.104 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T07:13:51.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:50 smithi175 ceph-mon[34064]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.6 KiB/s wr, 16 op/s 2024-09-21T07:13:51.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:50 smithi092 ceph-mon[30987]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.6 KiB/s wr, 16 op/s 2024-09-21T07:13:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:50 smithi169 ceph-mon[33705]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.6 KiB/s wr, 16 op/s 2024-09-21T07:13:53.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:52 smithi175 ceph-mon[34064]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 14 op/s 2024-09-21T07:13:53.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:52 smithi092 ceph-mon[30987]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 14 op/s 2024-09-21T07:13:53.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:52 smithi169 ceph-mon[33705]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 14 op/s 2024-09-21T07:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.650+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/2216553890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6f41029b0 msgr2=0x7ff6f4102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.650+0000 7ff6fa1ba640 1 --2- 172.21.15.92:0/2216553890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6f41029b0 0x7ff6f4102dc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009ca0 tx=0x7ff6e402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.650+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/2216553890 shutdown_connections 2024-09-21T07:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.650+0000 7ff6fa1ba640 1 --2- 172.21.15.92:0/2216553890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f4108c30 0x7ff6f410f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.650+0000 7ff6fa1ba640 1 --2- 172.21.15.92:0/2216553890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6f41082e0 0x7ff6f41086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.650+0000 7ff6fa1ba640 1 --2- 172.21.15.92:0/2216553890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6f41029b0 0x7ff6f4102dc0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.650+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/2216553890 >> 172.21.15.92:0/2216553890 conn(0x7ff6f407a740 msgr2=0x7ff6f407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.650+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/2216553890 shutdown_connections 2024-09-21T07:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.650+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/2216553890 wait complete. 2024-09-21T07:13:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.651+0000 7ff6fa1ba640 1 Processor -- start 2024-09-21T07:13:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.651+0000 7ff6fa1ba640 1 -- start start 2024-09-21T07:13:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6fa1ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6f41029b0 0x7ff6f4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6fa1ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f41082e0 0x7ff6f4199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6fa1ba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6f4108c30 0x7ff6f419eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6fa1ba640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41127f0 con 0x7ff6f41029b0 2024-09-21T07:13:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6fa1ba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4112670 con 0x7ff6f4108c30 2024-09-21T07:13:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6fa1ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4112970 con 0x7ff6f41082e0 2024-09-21T07:13:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6f41029b0 0x7ff6f4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6f41029b0 0x7ff6f4199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55492/0 (socket says 172.21.15.92:55492) 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f37fe640 1 -- 172.21.15.92:0/3613081765 learned_addr learned my addr 172.21.15.92:0/3613081765 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f2ffd640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f41082e0 0x7ff6f4199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6f4108c30 0x7ff6f419eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f37fe640 1 -- 172.21.15.92:0/3613081765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f41082e0 msgr2=0x7ff6f4199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f41082e0 0x7ff6f4199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f37fe640 1 -- 172.21.15.92:0/3613081765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6f4108c30 msgr2=0x7ff6f419eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6f4108c30 0x7ff6f419eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f37fe640 1 -- 172.21.15.92:0/3613081765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f419f1a0 con 0x7ff6f41029b0 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f2ffd640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f41082e0 0x7ff6f4199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.652+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6f41029b0 0x7ff6f4199270 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009dc0 tx=0x7ff6e4032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.653+0000 7ff6f0ff9640 1 -- 172.21.15.92:0/3613081765 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4004040 con 0x7ff6f41029b0 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.653+0000 7ff6f0ff9640 1 -- 172.21.15.92:0/3613081765 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6e4004670 con 0x7ff6f41029b0 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.653+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/3613081765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f419f430 con 0x7ff6f41029b0 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.653+0000 7ff6f0ff9640 1 -- 172.21.15.92:0/3613081765 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4030c80 con 0x7ff6f41029b0 2024-09-21T07:13:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.653+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/3613081765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f41a5c20 con 0x7ff6f41029b0 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.655+0000 7ff6f0ff9640 1 -- 172.21.15.92:0/3613081765 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7ff6e40041e0 con 0x7ff6f41029b0 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff701203740 1 Processor -- start 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff701203740 1 -- start start 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff701203740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd159b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff701203740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 0x56123fd15ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff701203740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f94f4d0 0x56123fd16430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff701203740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56123fc8a6f0 con 0x56123f9701b0 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff701203740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56123fc79b20 con 0x56123f9472f0 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff701203740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56123fc7d930 con 0x56123f94f4d0 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f0ff9640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6e00b6680 0x7ff6e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd159b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd159b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55508/0 (socket says 172.21.15.92:55508) 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f3fff640 1 -- 172.21.15.92:0/4225280019 learned_addr learned my addr 172.21.15.92:0/4225280019 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6e00b6680 0x7ff6e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f2ffd640 1 --2- 172.21.15.92:0/4225280019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f94f4d0 0x56123fd16430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f0ff9640 1 -- 172.21.15.92:0/3613081765 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff6e4108eb0 con 0x7ff6f41029b0 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/4225280019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 0x56123fd15ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f3fff640 1 -- 172.21.15.92:0/4225280019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f94f4d0 msgr2=0x56123fd16430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/4225280019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f94f4d0 0x56123fd16430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f3fff640 1 -- 172.21.15.92:0/4225280019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 msgr2=0x56123fd15ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.656+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/4225280019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 0x56123fd15ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.657+0000 7ff6f3fff640 1 -- 172.21.15.92:0/4225280019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56123fc3f530 con 0x56123f9701b0 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.657+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/4225280019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd159b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec014c50 tx=0x7ff6ec0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a886e67dbef6e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.657+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6e00b6680 0x7ff6e00b8b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec011cb0 tx=0x7ff6ec016000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.657+0000 7ff6e9ffb640 1 -- 172.21.15.92:0/4225280019 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec014620 con 0x56123f9701b0 2024-09-21T07:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.657+0000 7ff6e9ffb640 1 -- 172.21.15.92:0/4225280019 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6ec00c9c0 con 0x56123f9701b0 2024-09-21T07:13:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.657+0000 7ff6e9ffb640 1 -- 172.21.15.92:0/4225280019 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec005340 con 0x56123f9701b0 2024-09-21T07:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.658+0000 7ff701203740 1 -- 172.21.15.92:0/4225280019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 msgr2=0x56123fd159b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.658+0000 7ff701203740 1 --2- 172.21.15.92:0/4225280019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd159b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec014c50 tx=0x7ff6ec0117b0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.658+0000 7ff701203740 1 -- 172.21.15.92:0/4225280019 shutdown_connections 2024-09-21T07:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.658+0000 7ff701203740 1 --2- 172.21.15.92:0/4225280019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f94f4d0 0x56123fd16430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.658+0000 7ff701203740 1 --2- 172.21.15.92:0/4225280019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 0x56123fd15ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.658+0000 7ff701203740 1 --2- 172.21.15.92:0/4225280019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd159b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.658+0000 7ff701203740 1 -- 172.21.15.92:0/4225280019 >> 172.21.15.92:0/4225280019 conn(0x56123f964300 msgr2=0x56123fd138a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.658+0000 7ff701203740 1 -- 172.21.15.92:0/4225280019 shutdown_connections 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.658+0000 7ff701203740 1 -- 172.21.15.92:0/4225280019 wait complete. 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.658+0000 7ff701203740 1 -- start start 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff701203740 1 Processor -- start 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff701203740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f9472f0 0x56123fd23320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff701203740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f94f4d0 0x56123fd23860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff701203740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd2f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff701203740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56123fbb1ab0 con 0x56123f9701b0 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff701203740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56123fc1f730 con 0x56123f94f4d0 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff701203740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56123fd26290 con 0x56123f9472f0 2024-09-21T07:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff701203740 10 client.0 _ll_register_callbacks cb 0x56123fc736b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff6f3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd2f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff6f3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd2f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55518/0 (socket says 172.21.15.92:55518) 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff6f3fff640 1 -- 172.21.15.92:0/1689320768 learned_addr learned my addr 172.21.15.92:0/1689320768 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff6f2ffd640 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f94f4d0 0x56123fd23860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f9472f0 0x56123fd23320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff6f3fff640 1 -- 172.21.15.92:0/1689320768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f9472f0 msgr2=0x56123fd23320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f9472f0 0x56123fd23320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff6f3fff640 1 -- 172.21.15.92:0/1689320768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f94f4d0 msgr2=0x56123fd23860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f94f4d0 0x56123fd23860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.659+0000 7ff6f3fff640 1 -- 172.21.15.92:0/1689320768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56123f9db790 con 0x56123f9701b0 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.660+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd2f5c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec005fb0 tx=0x7ff6ec00cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5ca72f9a56561c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.660+0000 7ff6d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.660+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/1689320768 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec014620 con 0x56123f9701b0 2024-09-21T07:13:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.660+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/1689320768 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff6ec005330 con 0x56123f9701b0 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.660+0000 7ff701203740 1 -- 172.21.15.92:0/1689320768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6ec00c9c0 con 0x56123f9701b0 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.660+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/1689320768 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff6ec005530 con 0x56123f9701b0 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.660+0000 7ff701203740 10 client.15882 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.660+0000 7ff701203740 1 -- 172.21.15.92:0/1689320768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56123fa54620 con 0x56123f9701b0 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.660+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/1689320768 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6ec00c9c0 con 0x56123f9701b0 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.660+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/1689320768 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff6ec02f070 con 0x56123f9701b0 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.661+0000 7ff701203740 10 client.15882 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.661+0000 7ff701203740 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.661+0000 7ff701203740 20 client.15882 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.661+0000 7ff701203740 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56123f92ed80 0x56123fd35310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.661+0000 7ff701203740 4 client.15882 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.661+0000 7ff701203740 1 -- 172.21.15.92:0/1689320768 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56123fc8c640 con 0x56123f92ed80 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.661+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56123f92ed80 0x56123fd35310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.661+0000 7ff6d2ffd640 10 client.15882 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.661+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56123f92ed80 0x56123fd35310 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f70427a4078030eb server_cookie=beba74a98b9b87f9 in_seq=0 out_seq=0 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/1689320768 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56123fc8c640 con 0x56123f92ed80 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff6d2ffd640 10 client.15882 handle_command_reply: tid=0 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 client.15882 shutdown 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 -- 172.21.15.92:0/1689320768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 msgr2=0x56123fd2f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd2f5c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec005fb0 tx=0x7ff6ec00cfd0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 -- 172.21.15.92:0/1689320768 shutdown_connections 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56123f92ed80 0x56123fd35310 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd2f5c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff6d2ffd640 0 client.15882 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f94f4d0 0x56123fd23860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 --2- 172.21.15.92:0/1689320768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f9472f0 0x56123fd23320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 -- 172.21.15.92:0/1689320768 >> 172.21.15.92:0/1689320768 conn(0x56123f964300 msgr2=0x56123fd11ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 -- 172.21.15.92:0/1689320768 shutdown_connections 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.662+0000 7ff701203740 1 -- 172.21.15.92:0/1689320768 wait complete. 2024-09-21T07:13:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.663+0000 7ff701203740 20 client.15882 trim_cache size 0 max 16384 2024-09-21T07:13:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.677+0000 7ff701203740 1 Processor -- start 2024-09-21T07:13:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.677+0000 7ff701203740 1 -- start start 2024-09-21T07:13:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.677+0000 7ff701203740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f9472f0 0x56123fd221f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.677+0000 7ff701203740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f94f4d0 0x56123fd1b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.677+0000 7ff701203740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9701b0 0x56123fd23800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.677+0000 7ff701203740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41aec10 con 0x56123f94f4d0 2024-09-21T07:13:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.677+0000 7ff701203740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41b0750 con 0x56123f9701b0 2024-09-21T07:13:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.677+0000 7ff701203740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41af2e0 con 0x56123f9472f0 2024-09-21T07:13:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f94f4d0 0x56123fd1b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f94f4d0 0x56123fd1b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55522/0 (socket says 172.21.15.92:55522) 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f2ffd640 1 -- 172.21.15.92:0/3616771208 learned_addr learned my addr 172.21.15.92:0/3616771208 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/3616771208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f9472f0 0x56123fd221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/3616771208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9701b0 0x56123fd23800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f2ffd640 1 -- 172.21.15.92:0/3616771208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f9472f0 msgr2=0x56123fd221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f2ffd640 1 --2- 172.21.15.92:0/3616771208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f9472f0 0x56123fd221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f2ffd640 1 -- 172.21.15.92:0/3616771208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9701b0 msgr2=0x56123fd23800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f2ffd640 1 --2- 172.21.15.92:0/3616771208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9701b0 0x56123fd23800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f2ffd640 1 -- 172.21.15.92:0/3616771208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56123fd14230 con 0x56123f94f4d0 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/3616771208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9701b0 0x56123fd23800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6f2ffd640 1 --2- 172.21.15.92:0/3616771208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f94f4d0 0x56123fd1b0b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00bea0 tx=0x7ff6dc012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbdffc4e8d019db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6e97fa640 1 -- 172.21.15.92:0/3616771208 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc020070 con 0x56123f94f4d0 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6e97fa640 1 -- 172.21.15.92:0/3616771208 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6dc010920 con 0x56123f94f4d0 2024-09-21T07:13:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.678+0000 7ff6e97fa640 1 -- 172.21.15.92:0/3616771208 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc01b900 con 0x56123f94f4d0 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.679+0000 7ff701203740 1 -- 172.21.15.92:0/3616771208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f94f4d0 msgr2=0x56123fd1b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.679+0000 7ff701203740 1 --2- 172.21.15.92:0/3616771208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f94f4d0 0x56123fd1b0b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00bea0 tx=0x7ff6dc012820 comp rx=0 tx=0).stop 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.679+0000 7ff701203740 1 -- 172.21.15.92:0/3616771208 shutdown_connections 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.679+0000 7ff701203740 1 --2- 172.21.15.92:0/3616771208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9701b0 0x56123fd23800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.679+0000 7ff701203740 1 --2- 172.21.15.92:0/3616771208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f94f4d0 0x56123fd1b0b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.679+0000 7ff701203740 1 --2- 172.21.15.92:0/3616771208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f9472f0 0x56123fd221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.679+0000 7ff701203740 1 -- 172.21.15.92:0/3616771208 >> 172.21.15.92:0/3616771208 conn(0x56123f964300 msgr2=0x56123fd24840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.679+0000 7ff701203740 1 -- 172.21.15.92:0/3616771208 shutdown_connections 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.679+0000 7ff701203740 1 -- 172.21.15.92:0/3616771208 wait complete. 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.679+0000 7ff701203740 1 -- start start 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff701203740 1 Processor -- start 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff701203740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 0x56123fd26d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff701203740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f94f4d0 0x56123fd27260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff701203740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd9db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff701203740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41b0080 con 0x56123f9701b0 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff701203740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41af9b0 con 0x56123f9472f0 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff701203740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41acbf0 con 0x56123f94f4d0 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff701203740 10 client.0 _ll_register_callbacks cb 0x7ff6dc00b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff6f3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd9db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff6f3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd9db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55530/0 (socket says 172.21.15.92:55530) 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff6f3fff640 1 -- 172.21.15.92:0/795656262 learned_addr learned my addr 172.21.15.92:0/795656262 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 0x56123fd26d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff6f3fff640 1 -- 172.21.15.92:0/795656262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f94f4d0 msgr2=0x56123fd27260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.680+0000 7ff6f2ffd640 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f94f4d0 0x56123fd27260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f94f4d0 0x56123fd27260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6f3fff640 1 -- 172.21.15.92:0/795656262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 msgr2=0x56123fd26d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:13:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 0x56123fd26d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6f3fff640 1 -- 172.21.15.92:0/795656262 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56123fd9e100 con 0x56123f9701b0 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 0x56123fd26d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6f3fff640 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd9db90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00ce70 tx=0x7ff6ec0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a43b8c0df1ed971 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/795656262 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec005850 con 0x56123f9701b0 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/795656262 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff6ec005330 con 0x56123f9701b0 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff701203740 1 -- 172.21.15.92:0/795656262 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6dc010920 con 0x56123f9701b0 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/795656262 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff6ec0136a0 con 0x56123f9701b0 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff701203740 10 client.15888 fetch_fsmap learned FSMap version 29 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff701203740 1 -- 172.21.15.92:0/795656262 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56123fd9f3f0 con 0x56123f9701b0 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/795656262 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6dc010920 con 0x56123f9701b0 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/795656262 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff6ec02f040 con 0x56123f9701b0 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff701203740 10 client.15888 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff701203740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:13:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.681+0000 7ff701203740 20 client.15888 populate_metadata read hostname 'smithi092' 2024-09-21T07:13:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.682+0000 7ff701203740 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56123f9041c0 0x56123fda1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:13:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.682+0000 7ff701203740 4 client.15888 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:13:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.682+0000 7ff701203740 1 -- 172.21.15.92:0/795656262 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56123fc880f0 con 0x56123f9041c0 2024-09-21T07:13:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.682+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56123f9041c0 0x56123fda1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:13:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.682+0000 7ff6d2ffd640 10 client.15888 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.682+0000 7ff6f37fe640 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56123f9041c0 0x56123fda1b10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3314767ebc8df568 server_cookie=6af1571ee959c1e7 in_seq=0 out_seq=0 2024-09-21T07:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.690+0000 7ff6d2ffd640 1 -- 172.21.15.92:0/795656262 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56123fc880f0 con 0x56123f9041c0 2024-09-21T07:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.690+0000 7ff6d2ffd640 10 client.15888 handle_command_reply: tid=0 2024-09-21T07:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.690+0000 7ff701203740 1 client.15888 shutdown 2024-09-21T07:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 1 -- 172.21.15.92:0/795656262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 msgr2=0x56123fd9db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd9db90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00ce70 tx=0x7ff6ec0056d0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 1 -- 172.21.15.92:0/795656262 shutdown_connections 2024-09-21T07:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56123f9041c0 0x56123fda1b10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56123f9701b0 0x56123fd9db90 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff6d2ffd640 0 client.15888 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56123f94f4d0 0x56123fd27260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 1 --2- 172.21.15.92:0/795656262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56123f9472f0 0x56123fd26d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 1 -- 172.21.15.92:0/795656262 >> 172.21.15.92:0/795656262 conn(0x56123f964300 msgr2=0x56123fd1def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 1 -- 172.21.15.92:0/795656262 shutdown_connections 2024-09-21T07:13:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 1 -- 172.21.15.92:0/795656262 wait complete. 2024-09-21T07:13:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff701203740 20 client.15888 trim_cache size 0 max 16384 2024-09-21T07:13:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:13:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:13:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:13:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/3613081765 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6e00b6680 msgr2=0x7ff6e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff6fa1ba640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6e00b6680 0x7ff6e00b8b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec011cb0 tx=0x7ff6ec016000 comp rx=0 tx=0).stop 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/3613081765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6f41029b0 msgr2=0x7ff6f4199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.691+0000 7ff6fa1ba640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6f41029b0 0x7ff6f4199270 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009dc0 tx=0x7ff6e4032bc0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.692+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/3613081765 shutdown_connections 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.692+0000 7ff6fa1ba640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff6e00b6680 0x7ff6e00b8b90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.692+0000 7ff6fa1ba640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6f4108c30 0x7ff6f419eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.692+0000 7ff6fa1ba640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f41082e0 0x7ff6f4199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.692+0000 7ff6fa1ba640 1 --2- 172.21.15.92:0/3613081765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6f41029b0 0x7ff6f4199270 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.692+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/3613081765 >> 172.21.15.92:0/3613081765 conn(0x7ff6f407a740 msgr2=0x7ff6f41063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.692+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/3613081765 shutdown_connections 2024-09-21T07:13:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:13:54.692+0000 7ff6fa1ba640 1 -- 172.21.15.92:0/3613081765 wait complete. 2024-09-21T07:13:55.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:54 smithi175 ceph-mon[34064]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.2 KiB/s wr, 16 op/s 2024-09-21T07:13:55.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:54 smithi092 ceph-mon[30987]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.2 KiB/s wr, 16 op/s 2024-09-21T07:13:55.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:54 smithi169 ceph-mon[33705]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.2 KiB/s wr, 16 op/s 2024-09-21T07:13:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:56 smithi175 ceph-mon[34064]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T07:13:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:13:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:56 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:56 smithi092 ceph-mon[30987]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T07:13:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:13:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:56 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:56 smithi169 ceph-mon[33705]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T07:13:57.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:13:57.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:57.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:56 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:58.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:57 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:13:58.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:57 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:13:58.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:57 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:58.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:57 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:13:58.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:57 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:13:58.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:57 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:58.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:57 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:13:58.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:57 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:13:58.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:57 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:13:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:13:58 smithi175 ceph-mon[34064]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T07:13:59.044 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:13:58 smithi169 ceph-mon[33705]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T07:13:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:13:58 smithi092 ceph-mon[30987]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T07:13:59.695 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:13:59.946 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.463+0000 7f67f2107640 1 -- 172.21.15.92:0/3866519612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ec1094d0 msgr2=0x7f67ec1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.463+0000 7f67f2107640 1 --2- 172.21.15.92:0/3866519612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ec1094d0 0x7f67ec1098e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009900 tx=0x7f67e002a410 comp rx=0 tx=0).stop 2024-09-21T07:14:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.463+0000 7f67f2107640 1 -- 172.21.15.92:0/3866519612 shutdown_connections 2024-09-21T07:14:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.463+0000 7f67f2107640 1 --2- 172.21.15.92:0/3866519612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec109e20 0x7f67ec110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.463+0000 7f67f2107640 1 --2- 172.21.15.92:0/3866519612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ec1094d0 0x7f67ec1098e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.463+0000 7f67f2107640 1 --2- 172.21.15.92:0/3866519612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec103b90 0x7f67ec103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.463+0000 7f67f2107640 1 -- 172.21.15.92:0/3866519612 >> 172.21.15.92:0/3866519612 conn(0x7f67ec0ff5e0 msgr2=0x7f67ec101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.463+0000 7f67f2107640 1 -- 172.21.15.92:0/3866519612 shutdown_connections 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.463+0000 7f67f2107640 1 -- 172.21.15.92:0/3866519612 wait complete. 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.464+0000 7f67f2107640 1 Processor -- start 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.464+0000 7f67f2107640 1 -- start start 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67f2107640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec103b90 0x7f67ec19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67f2107640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec1094d0 0x7f67ec19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67f2107640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ec109e20 0x7f67ec19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67f2107640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec113990 con 0x7f67ec109e20 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67f2107640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec113810 con 0x7f67ec1094d0 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67f2107640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec113b10 con 0x7f67ec103b90 2024-09-21T07:14:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ec109e20 0x7f67ec19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ec109e20 0x7f67ec19fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57786/0 (socket says 172.21.15.92:57786) 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67ebfff640 1 -- 172.21.15.92:0/2525985323 learned_addr learned my addr 172.21.15.92:0/2525985323 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec103b90 0x7f67ec19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67eaffd640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec1094d0 0x7f67ec19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67ebfff640 1 -- 172.21.15.92:0/2525985323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec103b90 msgr2=0x7f67ec19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67ebfff640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec103b90 0x7f67ec19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67ebfff640 1 -- 172.21.15.92:0/2525985323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec1094d0 msgr2=0x7f67ec19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67ebfff640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec1094d0 0x7f67ec19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67ebfff640 1 -- 172.21.15.92:0/2525985323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec1a0350 con 0x7f67ec109e20 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67ebfff640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ec109e20 0x7f67ec19fc20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f67e400eb10 tx=0x7f67e400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.465+0000 7f67e8ff9640 1 -- 172.21.15.92:0/2525985323 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4004b20 con 0x7f67ec109e20 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.466+0000 7f67f2107640 1 -- 172.21.15.92:0/2525985323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ec1a0640 con 0x7f67ec109e20 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.466+0000 7f67f2107640 1 -- 172.21.15.92:0/2525985323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ec1a6da0 con 0x7f67ec109e20 2024-09-21T07:14:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.466+0000 7f67e8ff9640 1 -- 172.21.15.92:0/2525985323 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67e4004cc0 con 0x7f67ec109e20 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.466+0000 7f67e8ff9640 1 -- 172.21.15.92:0/2525985323 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4010690 con 0x7f67ec109e20 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.468+0000 7f67f867b740 1 Processor -- start 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.468+0000 7f67e8ff9640 1 -- 172.21.15.92:0/2525985323 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 154637+0+0 (secure 0 0 0) 0x7f67e4010830 con 0x7f67ec109e20 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.468+0000 7f67f867b740 1 -- start start 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67f867b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6c1070 0x56018ea68650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67f867b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6981b0 0x56018ea68b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67f867b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 0x56018ea690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67f867b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56018e9dee50 con 0x56018e6c1070 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67f867b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56018e9ce280 con 0x56018e6a0390 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67f867b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56018e9d2090 con 0x56018e6981b0 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67eaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6c1070 0x56018ea68650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67eaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6c1070 0x56018ea68650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57796/0 (socket says 172.21.15.92:57796) 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67eaffd640 1 -- 172.21.15.92:0/2928816900 learned_addr learned my addr 172.21.15.92:0/2928816900 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:00.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67eaffd640 1 --2- 172.21.15.92:0/2928816900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 0x56018ea690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/2928816900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6981b0 0x56018ea68b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67eaffd640 1 -- 172.21.15.92:0/2928816900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6981b0 msgr2=0x56018ea68b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67eaffd640 1 --2- 172.21.15.92:0/2928816900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6981b0 0x56018ea68b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67eaffd640 1 -- 172.21.15.92:0/2928816900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 msgr2=0x56018ea690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67eaffd640 1 --2- 172.21.15.92:0/2928816900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 0x56018ea690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67eaffd640 1 -- 172.21.15.92:0/2928816900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56018e72c650 con 0x56018e6c1070 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.469+0000 7f67e8ff9640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f67d40b6680 0x7f67d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.470+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f67d40b6680 0x7f67d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.470+0000 7f67eaffd640 1 --2- 172.21.15.92:0/2928816900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6c1070 0x56018ea68650 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f67e0000c00 tx=0x7f67e0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ace718823c7712c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.470+0000 7f67e8ff9640 1 -- 172.21.15.92:0/2525985323 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f67e40e8010 con 0x7f67ec109e20 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.470+0000 7f67d1ffb640 1 -- 172.21.15.92:0/2928816900 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0044020 con 0x56018e6c1070 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.470+0000 7f67d1ffb640 1 -- 172.21.15.92:0/2928816900 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67e00044c0 con 0x56018e6c1070 2024-09-21T07:14:00.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.470+0000 7f67d1ffb640 1 -- 172.21.15.92:0/2928816900 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0035040 con 0x56018e6c1070 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67f867b740 1 -- 172.21.15.92:0/2928816900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6c1070 msgr2=0x56018ea68650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f67d40b6680 0x7f67d40b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x56018ea672d0 tx=0x7f67dc00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67f867b740 1 --2- 172.21.15.92:0/2928816900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6c1070 0x56018ea68650 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f67e0000c00 tx=0x7f67e0005fd0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67f867b740 1 -- 172.21.15.92:0/2928816900 shutdown_connections 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67f867b740 1 --2- 172.21.15.92:0/2928816900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 0x56018ea690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67f867b740 1 --2- 172.21.15.92:0/2928816900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6981b0 0x56018ea68b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67f867b740 1 --2- 172.21.15.92:0/2928816900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6c1070 0x56018ea68650 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67f867b740 1 -- 172.21.15.92:0/2928816900 >> 172.21.15.92:0/2928816900 conn(0x56018e6b5460 msgr2=0x56018ea66540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67f867b740 1 -- 172.21.15.92:0/2928816900 shutdown_connections 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67f867b740 1 -- 172.21.15.92:0/2928816900 wait complete. 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.471+0000 7f67f867b740 1 -- start start 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67f867b740 1 Processor -- start 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67f867b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6981b0 0x56018ea73d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67f867b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6a0390 0x56018ea74280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67f867b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6c1070 0x56018ea800f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67f867b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56018e82f700 con 0x56018e6a0390 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67f867b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56018e969110 con 0x56018e6c1070 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67f867b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56018ea76dd0 con 0x56018e6981b0 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67f867b740 10 client.0 _ll_register_callbacks cb 0x56018e982990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67eaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6a0390 0x56018ea74280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67eaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6a0390 0x56018ea74280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57806/0 (socket says 172.21.15.92:57806) 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67eaffd640 1 -- 172.21.15.92:0/2234840232 learned_addr learned my addr 172.21.15.92:0/2234840232 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67ebfff640 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6c1070 0x56018ea800f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6981b0 0x56018ea73d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67eaffd640 1 -- 172.21.15.92:0/2234840232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6981b0 msgr2=0x56018ea73d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67eaffd640 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6981b0 0x56018ea73d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67eaffd640 1 -- 172.21.15.92:0/2234840232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6c1070 msgr2=0x56018ea800f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:00.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67eaffd640 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6c1070 0x56018ea800f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.472+0000 7f67eaffd640 1 -- 172.21.15.92:0/2234840232 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56018e996c40 con 0x56018e6a0390 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.473+0000 7f67eaffd640 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6a0390 0x56018ea74280 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f67e0031c80 tx=0x7f67e0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761eceffe8d69768 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.473+0000 7f67caffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.473+0000 7f67caffd640 1 -- 172.21.15.92:0/2234840232 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0050060 con 0x56018e6a0390 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.473+0000 7f67caffd640 1 -- 172.21.15.92:0/2234840232 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f67e004b660 con 0x56018e6a0390 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.473+0000 7f67f867b740 1 -- 172.21.15.92:0/2234840232 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56018e9e0da0 con 0x56018e6a0390 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.473+0000 7f67caffd640 1 -- 172.21.15.92:0/2234840232 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f67e0057050 con 0x56018e6a0390 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.473+0000 7f67f867b740 10 client.15900 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.473+0000 7f67f867b740 1 -- 172.21.15.92:0/2234840232 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56018ea82ae0 con 0x56018e6a0390 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.473+0000 7f67caffd640 1 -- 172.21.15.92:0/2234840232 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56018e9e0da0 con 0x56018e6a0390 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.474+0000 7f67caffd640 1 -- 172.21.15.92:0/2234840232 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f67e0003960 con 0x56018e6a0390 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.474+0000 7f67f867b740 10 client.15900 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:00.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.474+0000 7f67f867b740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.474+0000 7f67f867b740 20 client.15900 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.474+0000 7f67f867b740 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56018e67f9f0 0x56018ea85e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.474+0000 7f67f867b740 4 client.15900 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.474+0000 7f67f867b740 1 -- 172.21.15.92:0/2234840232 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56018e9dc850 con 0x56018e67f9f0 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.474+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56018e67f9f0 0x56018ea85e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.474+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56018e67f9f0 0x56018ea85e40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feed817eb9ef4357 server_cookie=76de5430215aa80c in_seq=0 out_seq=0 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.474+0000 7f67caffd640 10 client.15900 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67caffd640 1 -- 172.21.15.92:0/2234840232 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56018e9dc850 con 0x56018e67f9f0 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67caffd640 10 client.15900 handle_command_reply: tid=0 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 client.15900 shutdown 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 -- 172.21.15.92:0/2234840232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6a0390 msgr2=0x56018ea74280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6a0390 0x56018ea74280 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f67e0031c80 tx=0x7f67e0031400 comp rx=0 tx=0).stop 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 -- 172.21.15.92:0/2234840232 shutdown_connections 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56018e67f9f0 0x56018ea85e40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6c1070 0x56018ea800f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67caffd640 0 client.15900 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:00.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6a0390 0x56018ea74280 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 --2- 172.21.15.92:0/2234840232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6981b0 0x56018ea73d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 -- 172.21.15.92:0/2234840232 >> 172.21.15.92:0/2234840232 conn(0x56018e6b5460 msgr2=0x56018ea6b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:00.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 -- 172.21.15.92:0/2234840232 shutdown_connections 2024-09-21T07:14:00.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.475+0000 7f67f867b740 1 -- 172.21.15.92:0/2234840232 wait complete. 2024-09-21T07:14:00.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.476+0000 7f67f867b740 20 client.15900 trim_cache size 0 max 16384 2024-09-21T07:14:00.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67f867b740 1 Processor -- start 2024-09-21T07:14:00.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67f867b740 1 -- start start 2024-09-21T07:14:00.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67f867b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea72c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67f867b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6a0390 0x56018ea75970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67f867b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6c1070 0x56018ea80060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67f867b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec1b0d60 con 0x56018e6981b0 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67f867b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec1b28a0 con 0x56018e6c1070 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67f867b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec1b1430 con 0x56018e6a0390 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67eb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea72c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67eb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea72c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57808/0 (socket says 172.21.15.92:57808) 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.493+0000 7f67eb7fe640 1 -- 172.21.15.92:0/93570511 learned_addr learned my addr 172.21.15.92:0/93570511 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67ebfff640 1 --2- 172.21.15.92:0/93570511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6c1070 0x56018ea80060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67eaffd640 1 --2- 172.21.15.92:0/93570511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6a0390 0x56018ea75970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67eb7fe640 1 -- 172.21.15.92:0/93570511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6a0390 msgr2=0x56018ea75970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/93570511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6a0390 0x56018ea75970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67eb7fe640 1 -- 172.21.15.92:0/93570511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6c1070 msgr2=0x56018ea80060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:00.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/93570511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6c1070 0x56018ea80060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67eb7fe640 1 -- 172.21.15.92:0/93570511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56018ea6a940 con 0x56018e6981b0 2024-09-21T07:14:00.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/93570511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea72c30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f67dc010570 tx=0x7f67dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ca65cd1499ab3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:00.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67d17fa640 1 -- 172.21.15.92:0/93570511 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc004220 con 0x56018e6981b0 2024-09-21T07:14:00.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67d17fa640 1 -- 172.21.15.92:0/93570511 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67dc0043c0 con 0x56018e6981b0 2024-09-21T07:14:00.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.494+0000 7f67d17fa640 1 -- 172.21.15.92:0/93570511 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc0298c0 con 0x56018e6981b0 2024-09-21T07:14:00.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.495+0000 7f67f867b740 1 -- 172.21.15.92:0/93570511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 msgr2=0x56018ea72c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:00.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.495+0000 7f67f867b740 1 --2- 172.21.15.92:0/93570511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea72c30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f67dc010570 tx=0x7f67dc015000 comp rx=0 tx=0).stop 2024-09-21T07:14:00.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.495+0000 7f67f867b740 1 -- 172.21.15.92:0/93570511 shutdown_connections 2024-09-21T07:14:00.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.495+0000 7f67f867b740 1 --2- 172.21.15.92:0/93570511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6c1070 0x56018ea80060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.495+0000 7f67f867b740 1 --2- 172.21.15.92:0/93570511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6a0390 0x56018ea75970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.495+0000 7f67f867b740 1 --2- 172.21.15.92:0/93570511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea72c30 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.495+0000 7f67f867b740 1 -- 172.21.15.92:0/93570511 >> 172.21.15.92:0/93570511 conn(0x56018e6b5460 msgr2=0x56018ea75260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.495+0000 7f67f867b740 1 -- 172.21.15.92:0/93570511 shutdown_connections 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.495+0000 7f67f867b740 1 -- 172.21.15.92:0/93570511 wait complete. 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.496+0000 7f67f867b740 1 -- start start 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.496+0000 7f67f867b740 1 Processor -- start 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.496+0000 7f67f867b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea86f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.496+0000 7f67f867b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 0x56018ea87490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.496+0000 7f67f867b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6c1070 0x56018ea879d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.496+0000 7f67f867b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec1b21d0 con 0x56018e6981b0 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.496+0000 7f67f867b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec1b1b00 con 0x56018e6a0390 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.496+0000 7f67f867b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec1aed40 con 0x56018e6c1070 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.496+0000 7f67f867b740 10 client.0 _ll_register_callbacks cb 0x7f67e0031d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:00.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.496+0000 7f67eb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea86f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67eb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea86f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57810/0 (socket says 172.21.15.92:57810) 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67eb7fe640 1 -- 172.21.15.92:0/717436261 learned_addr learned my addr 172.21.15.92:0/717436261 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67eaffd640 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 0x56018ea87490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67ebfff640 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6c1070 0x56018ea879d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67eb7fe640 1 -- 172.21.15.92:0/717436261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6c1070 msgr2=0x56018ea879d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6c1070 0x56018ea879d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67eb7fe640 1 -- 172.21.15.92:0/717436261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 msgr2=0x56018ea87490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 0x56018ea87490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67eb7fe640 1 -- 172.21.15.92:0/717436261 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56018eaf3a80 con 0x56018e6981b0 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67eaffd640 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 0x56018ea87490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67eb7fe640 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea86f50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f67dc029510 tx=0x7f67dc029540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2eead153bbe13a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67caffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67caffd640 1 -- 172.21.15.92:0/717436261 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc029c00 con 0x56018e6981b0 2024-09-21T07:14:00.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67caffd640 1 -- 172.21.15.92:0/717436261 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f67dc020400 con 0x56018e6981b0 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.497+0000 7f67f867b740 1 -- 172.21.15.92:0/717436261 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67dc0043c0 con 0x56018e6981b0 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67caffd640 1 -- 172.21.15.92:0/717436261 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f67dc046050 con 0x56018e6981b0 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67f867b740 10 client.15906 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67f867b740 1 -- 172.21.15.92:0/717436261 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56018eaf4d20 con 0x56018e6981b0 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67caffd640 1 -- 172.21.15.92:0/717436261 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67dc0043c0 con 0x56018e6981b0 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67caffd640 1 -- 172.21.15.92:0/717436261 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f67dc02f030 con 0x56018e6981b0 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67f867b740 10 client.15906 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67f867b740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67f867b740 20 client.15906 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67f867b740 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56018e654da0 0x56018eaf74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67f867b740 4 client.15906 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67f867b740 1 -- 172.21.15.92:0/717436261 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56018ea6f8f0 con 0x56018e654da0 2024-09-21T07:14:00.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.498+0000 7f67eaffd640 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56018e654da0 0x56018eaf74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:00.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67caffd640 10 client.15906 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:00.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67eaffd640 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56018e654da0 0x56018eaf74b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8ae40528d4b99f9 server_cookie=9cf21e50c382a2f2 in_seq=0 out_seq=0 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67caffd640 1 -- 172.21.15.92:0/717436261 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x56018ea6f8f0 con 0x56018e654da0 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67caffd640 10 client.15906 handle_command_reply: tid=0 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 client.15906 shutdown 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 -- 172.21.15.92:0/717436261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 msgr2=0x56018ea86f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea86f50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f67dc029510 tx=0x7f67dc029540 comp rx=0 tx=0).stop 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 -- 172.21.15.92:0/717436261 shutdown_connections 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56018e654da0 0x56018eaf74b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56018e6c1070 0x56018ea879d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67caffd640 0 client.15906 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56018e6a0390 0x56018ea87490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 --2- 172.21.15.92:0/717436261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56018e6981b0 0x56018ea86f50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 -- 172.21.15.92:0/717436261 >> 172.21.15.92:0/717436261 conn(0x56018e6b5460 msgr2=0x56018ea75b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 -- 172.21.15.92:0/717436261 shutdown_connections 2024-09-21T07:14:00.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.499+0000 7f67f867b740 1 -- 172.21.15.92:0/717436261 wait complete. 2024-09-21T07:14:00.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f867b740 20 client.15906 trim_cache size 0 max 16384 2024-09-21T07:14:00.506 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:14:00.506 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:14:00.506 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:14:00.506 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:14:00.506 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:14:00.506 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:14:00.506 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:14:00.506 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:14:00.507 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:14:00.507 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:14:00.507 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:14:00.507 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:00.507 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:00.507 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:14:00.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 -- 172.21.15.92:0/2525985323 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f67d40b6680 msgr2=0x7f67d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:00.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f67d40b6680 0x7f67d40b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x56018ea672d0 tx=0x7f67dc00b410 comp rx=0 tx=0).stop 2024-09-21T07:14:00.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 -- 172.21.15.92:0/2525985323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ec109e20 msgr2=0x7f67ec19fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:00.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ec109e20 0x7f67ec19fc20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f67e400eb10 tx=0x7f67e400c2d0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 -- 172.21.15.92:0/2525985323 shutdown_connections 2024-09-21T07:14:00.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f67d40b6680 0x7f67d40b8b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ec109e20 0x7f67ec19fc20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec1094d0 0x7f67ec19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 --2- 172.21.15.92:0/2525985323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67ec103b90 0x7f67ec19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:00.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 -- 172.21.15.92:0/2525985323 >> 172.21.15.92:0/2525985323 conn(0x7f67ec0ff5e0 msgr2=0x7f67ec101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:00.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 -- 172.21.15.92:0/2525985323 shutdown_connections 2024-09-21T07:14:00.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:00.500+0000 7f67f2107640 1 -- 172.21.15.92:0/2525985323 wait complete. 2024-09-21T07:14:00.711 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:14:00 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:14:00.531+0000 7fc737dde640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:14:00.711 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:14:00 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:14:00.531+0000 7fc737dde640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:14:00.711 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:14:00 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:14:00.531+0000 7fc737dde640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:14:00.711 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:14:00 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:14:00.531+0000 7fc737dde640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:14:00.711 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:14:00 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:14:00.531+0000 7fc737dde640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:14:01.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:00 smithi175 ceph-mon[34064]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-21T07:14:01.103 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:00 smithi092 ceph-mon[30987]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-21T07:14:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:00 smithi169 ceph-mon[33705]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-21T07:14:01.278 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:14:01.279 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:14:01.533 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.038+0000 7f997b58b640 1 -- 172.21.15.92:0/4235850751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99741083a0 msgr2=0x7f99741087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.038+0000 7f997b58b640 1 --2- 172.21.15.92:0/4235850751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99741083a0 0x7f99741087b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9964009900 tx=0x7f996402a410 comp rx=0 tx=0).stop 2024-09-21T07:14:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.038+0000 7f997b58b640 1 -- 172.21.15.92:0/4235850751 shutdown_connections 2024-09-21T07:14:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.038+0000 7f997b58b640 1 --2- 172.21.15.92:0/4235850751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974108cf0 0x7f997410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.038+0000 7f997b58b640 1 --2- 172.21.15.92:0/4235850751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99741083a0 0x7f99741087b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.038+0000 7f997b58b640 1 --2- 172.21.15.92:0/4235850751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9974102a60 0x7f9974102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.038+0000 7f997b58b640 1 -- 172.21.15.92:0/4235850751 >> 172.21.15.92:0/4235850751 conn(0x7f9974079730 msgr2=0x7f9974079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.038+0000 7f997b58b640 1 -- 172.21.15.92:0/4235850751 shutdown_connections 2024-09-21T07:14:02.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.038+0000 7f997b58b640 1 -- 172.21.15.92:0/4235850751 wait complete. 2024-09-21T07:14:02.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f997b58b640 1 Processor -- start 2024-09-21T07:14:02.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f997b58b640 1 -- start start 2024-09-21T07:14:02.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f997b58b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974102a60 0x7f997419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:02.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f997b58b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99741083a0 0x7f997419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:02.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f997b58b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9974108cf0 0x7f997419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:02.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f997b58b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9974112810 con 0x7f99741083a0 2024-09-21T07:14:02.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f997b58b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9974112690 con 0x7f9974108cf0 2024-09-21T07:14:02.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f997b58b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9974112990 con 0x7f9974102a60 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f9978b26640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99741083a0 0x7f997419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f9979327640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974102a60 0x7f997419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f9979327640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974102a60 0x7f997419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:41418/0 (socket says 172.21.15.92:41418) 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f9979327640 1 -- 172.21.15.92:0/312133809 learned_addr learned my addr 172.21.15.92:0/312133809 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f9978b26640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99741083a0 0x7f997419a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57858/0 (socket says 172.21.15.92:57858) 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.039+0000 7f9979b28640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9974108cf0 0x7f997419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f9978b26640 1 -- 172.21.15.92:0/312133809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974102a60 msgr2=0x7f997419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f9978b26640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974102a60 0x7f997419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f9978b26640 1 -- 172.21.15.92:0/312133809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9974108cf0 msgr2=0x7f997419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f9978b26640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9974108cf0 0x7f997419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f9978b26640 1 -- 172.21.15.92:0/312133809 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99741a0340 con 0x7f99741083a0 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f9978b26640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99741083a0 0x7f997419a970 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9964009230 tx=0x7f99640040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f996a7fc640 1 -- 172.21.15.92:0/312133809 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996403f070 con 0x7f99741083a0 2024-09-21T07:14:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f996a7fc640 1 -- 172.21.15.92:0/312133809 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9964003c80 con 0x7f99741083a0 2024-09-21T07:14:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f996a7fc640 1 -- 172.21.15.92:0/312133809 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964035070 con 0x7f99741083a0 2024-09-21T07:14:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f997b58b640 1 -- 172.21.15.92:0/312133809 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99741a05d0 con 0x7f99741083a0 2024-09-21T07:14:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.040+0000 7f997b58b640 1 -- 172.21.15.92:0/312133809 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99741a0a30 con 0x7f99741083a0 2024-09-21T07:14:02.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.042+0000 7f997b58b640 1 -- 172.21.15.92:0/312133809 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9974102e70 con 0x7f99741083a0 2024-09-21T07:14:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.044+0000 7f996a7fc640 1 -- 172.21.15.92:0/312133809 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7f99640037f0 con 0x7f99741083a0 2024-09-21T07:14:02.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.045+0000 7f996a7fc640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f99600b6710 0x7f99600b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:02.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.045+0000 7f9979327640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f99600b6710 0x7f99600b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:02.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.045+0000 7f996a7fc640 1 -- 172.21.15.92:0/312133809 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9964108ae0 con 0x7f99741083a0 2024-09-21T07:14:02.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.045+0000 7f9979327640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f99600b6710 0x7f99600b8c20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9970005fd0 tx=0x7f997000b480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:02.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.048+0000 7f996a7fc640 1 -- 172.21.15.92:0/312133809 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99640d2f00 con 0x7f99741083a0 2024-09-21T07:14:02.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.286+0000 7f997b58b640 1 -- 172.21.15.92:0/312133809 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f997419b500 con 0x7f99741083a0 2024-09-21T07:14:02.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.287+0000 7f996a7fc640 1 -- 172.21.15.92:0/312133809 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f99640d7e40 con 0x7f99741083a0 2024-09-21T07:14:02.289 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:14:02.289 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:14:02.289 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:14:02.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 -- 172.21.15.92:0/312133809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f99600b6710 msgr2=0x7f99600b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:02.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f99600b6710 0x7f99600b8c20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9970005fd0 tx=0x7f997000b480 comp rx=0 tx=0).stop 2024-09-21T07:14:02.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 -- 172.21.15.92:0/312133809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99741083a0 msgr2=0x7f997419a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:02.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99741083a0 0x7f997419a970 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9964009230 tx=0x7f99640040e0 comp rx=0 tx=0).stop 2024-09-21T07:14:02.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 -- 172.21.15.92:0/312133809 shutdown_connections 2024-09-21T07:14:02.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f99600b6710 0x7f99600b8c20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:02.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9974108cf0 0x7f997419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:02.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99741083a0 0x7f997419a970 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:02.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 --2- 172.21.15.92:0/312133809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974102a60 0x7f997419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:02.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 -- 172.21.15.92:0/312133809 >> 172.21.15.92:0/312133809 conn(0x7f9974079730 msgr2=0x7f997406b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:02.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 -- 172.21.15.92:0/312133809 shutdown_connections 2024-09-21T07:14:02.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:02.289+0000 7f997b58b640 1 -- 172.21.15.92:0/312133809 wait complete. 2024-09-21T07:14:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:02 smithi175 ceph-mon[34064]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T07:14:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:02 smithi175 ceph-mon[34064]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-21T07:14:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:02 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/312133809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:03.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:02 smithi092 ceph-mon[30987]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T07:14:03.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:02 smithi092 ceph-mon[30987]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-21T07:14:03.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:02 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/312133809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:03.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:14:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:02 smithi169 ceph-mon[33705]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T07:14:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:02 smithi169 ceph-mon[33705]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-21T07:14:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:02 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/312133809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:03.334 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:05.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:04 smithi175 ceph-mon[34064]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 26 op/s 2024-09-21T07:14:05.105 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T07:14:05.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:14:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:04 smithi092 ceph-mon[30987]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 26 op/s 2024-09-21T07:14:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:04 smithi169 ceph-mon[33705]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 26 op/s 2024-09-21T07:14:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.713+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3050102792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da4106bd0 msgr2=0x7f4da4110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.713+0000 7f4dab3c8640 1 --2- 172.21.15.92:0/3050102792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da4106bd0 0x7f4da4110660 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009ca0 tx=0x7f4d9c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.713+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3050102792 shutdown_connections 2024-09-21T07:14:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.713+0000 7f4dab3c8640 1 --2- 172.21.15.92:0/3050102792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da4106bd0 0x7f4da4110660 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.713+0000 7f4dab3c8640 1 --2- 172.21.15.92:0/3050102792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da4106280 0x7f4da4106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.713+0000 7f4dab3c8640 1 --2- 172.21.15.92:0/3050102792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4da4102090 0x7f4da41024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.713+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3050102792 >> 172.21.15.92:0/3050102792 conn(0x7f4da4077c60 msgr2=0x7f4da40780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.713+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3050102792 shutdown_connections 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.713+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3050102792 wait complete. 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4dab3c8640 1 Processor -- start 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4dab3c8640 1 -- start start 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4dab3c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da4102090 0x7f4da419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4dab3c8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4da4106280 0x7f4da419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4dab3c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da4106bd0 0x7f4da419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4dab3c8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4da4113970 con 0x7f4da4106bd0 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4dab3c8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41137f0 con 0x7f4da4106280 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4dab3c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4da4113af0 con 0x7f4da4102090 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4da9965640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da4106bd0 0x7f4da419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4da9965640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da4106bd0 0x7f4da419fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57884/0 (socket says 172.21.15.92:57884) 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4da9965640 1 -- 172.21.15.92:0/3458123950 learned_addr learned my addr 172.21.15.92:0/3458123950 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4da9164640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da4102090 0x7f4da419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.714+0000 7f4da8963640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4da4106280 0x7f4da419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4da9965640 1 -- 172.21.15.92:0/3458123950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da4102090 msgr2=0x7f4da419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4da9965640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da4102090 0x7f4da419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4da9965640 1 -- 172.21.15.92:0/3458123950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4da4106280 msgr2=0x7f4da419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4da9965640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4da4106280 0x7f4da419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4da9965640 1 -- 172.21.15.92:0/3458123950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da41a0350 con 0x7f4da4106bd0 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4da8963640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4da4106280 0x7f4da419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4da9965640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da4106bd0 0x7f4da419fc20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c031ef0 tx=0x7f4d9c031f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4d9a7fc640 1 -- 172.21.15.92:0/3458123950 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c003c30 con 0x7f4da4106bd0 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3458123950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da41a05e0 con 0x7f4da4106bd0 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3458123950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da41a6da0 con 0x7f4da4106bd0 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4d9a7fc640 1 -- 172.21.15.92:0/3458123950 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d9c003dd0 con 0x7f4da4106bd0 2024-09-21T07:14:05.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.715+0000 7f4d9a7fc640 1 -- 172.21.15.92:0/3458123950 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0046c0 con 0x7f4da4106bd0 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.718+0000 7f4db193c740 1 Processor -- start 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.718+0000 7f4d9a7fc640 1 -- 172.21.15.92:0/3458123950 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7f4d9c030640 con 0x7f4da4106bd0 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4db193c740 1 -- start start 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4db193c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b4106a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4db193c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 0x56209b410be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4db193c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b411120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4db193c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56209b386ea0 con 0x56209b069070 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4db193c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56209b3762d0 con 0x56209b0401b0 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4db193c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56209b37a0e0 con 0x56209b048390 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4da8963640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b411120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4da9164640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 0x56209b410be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4da9164640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 0x56209b410be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:47194/0 (socket says 172.21.15.92:47194) 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4da8963640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b411120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:41444/0 (socket says 172.21.15.92:41444) 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.719+0000 7f4da9164640 1 -- 172.21.15.92:0/3080314642 learned_addr learned my addr 172.21.15.92:0/3080314642 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:05.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.720+0000 7f4da8963640 1 --2- 172.21.15.92:0/3080314642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b4106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.720+0000 7f4d9a7fc640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4d900b6790 0x7f4d900b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.720+0000 7f4da8963640 1 -- 172.21.15.92:0/3080314642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 msgr2=0x56209b411120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.720+0000 7f4da8963640 1 --2- 172.21.15.92:0/3080314642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b411120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.720+0000 7f4da8963640 1 -- 172.21.15.92:0/3080314642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 msgr2=0x56209b410be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.720+0000 7f4d9a7fc640 1 -- 172.21.15.92:0/3458123950 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4d9c108a70 con 0x7f4da4106bd0 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.720+0000 7f4da8963640 1 --2- 172.21.15.92:0/3080314642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 0x56209b410be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.720+0000 7f4da8963640 1 -- 172.21.15.92:0/3080314642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209b0d4650 con 0x56209b069070 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.720+0000 7f4da9965640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4d900b6790 0x7f4d900b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.720+0000 7f4da8963640 1 --2- 172.21.15.92:0/3080314642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b4106a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4da4075820 tx=0x7f4d94005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fa3686123af9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.721+0000 7f4da9965640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4d900b6790 0x7f4d900b8ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c105dc0 tx=0x7f4d9c108d70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.724+0000 7f4d8f7fe640 1 -- 172.21.15.92:0/3080314642 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9400e670 con 0x56209b069070 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.724+0000 7f4d8f7fe640 1 -- 172.21.15.92:0/3080314642 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d9400eca0 con 0x56209b069070 2024-09-21T07:14:05.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.725+0000 7f4d8f7fe640 1 -- 172.21.15.92:0/3080314642 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9401cb10 con 0x56209b069070 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.725+0000 7f4db193c740 1 -- 172.21.15.92:0/3080314642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 msgr2=0x56209b4106a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.725+0000 7f4db193c740 1 --2- 172.21.15.92:0/3080314642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b4106a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4da4075820 tx=0x7f4d94005f90 comp rx=0 tx=0).stop 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.725+0000 7f4db193c740 1 -- 172.21.15.92:0/3080314642 shutdown_connections 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.726+0000 7f4db193c740 1 --2- 172.21.15.92:0/3080314642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b411120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.726+0000 7f4db193c740 1 --2- 172.21.15.92:0/3080314642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 0x56209b410be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.726+0000 7f4db193c740 1 --2- 172.21.15.92:0/3080314642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b4106a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.726+0000 7f4db193c740 1 -- 172.21.15.92:0/3080314642 >> 172.21.15.92:0/3080314642 conn(0x56209b05d460 msgr2=0x56209b40e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.726+0000 7f4db193c740 1 -- 172.21.15.92:0/3080314642 shutdown_connections 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.726+0000 7f4db193c740 1 -- 172.21.15.92:0/3080314642 wait complete. 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.726+0000 7f4db193c740 1 -- start start 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.726+0000 7f4db193c740 1 Processor -- start 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4db193c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b0401b0 0x56209b41c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4db193c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b048390 0x56209b41c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4db193c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b421a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4db193c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56209b1d7700 con 0x56209b069070 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4db193c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56209b311160 con 0x56209b048390 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4db193c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56209b416c50 con 0x56209b0401b0 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4db193c740 10 client.0 _ll_register_callbacks cb 0x56209b32a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da8963640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b421a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da8963640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b0401b0 0x56209b41c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da9164640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b048390 0x56209b41c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da9164640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b048390 0x56209b41c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:47208/0 (socket says 172.21.15.92:47208) 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da9164640 1 -- 172.21.15.92:0/3238549531 learned_addr learned my addr 172.21.15.92:0/3238549531 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da9164640 1 -- 172.21.15.92:0/3238549531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b0401b0 msgr2=0x56209b41c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da9164640 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b0401b0 0x56209b41c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da9164640 1 -- 172.21.15.92:0/3238549531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 msgr2=0x56209b421a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da9164640 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b421a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da9164640 1 -- 172.21.15.92:0/3238549531 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56209b33ec90 con 0x56209b048390 2024-09-21T07:14:05.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.727+0000 7f4da8963640 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b421a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.728+0000 7f4da9164640 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b048390 0x56209b41c8b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4da0012770 tx=0x7f4da0012c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cf20dbd3b00509f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.728+0000 7f4d8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.728+0000 7f4d8cff9640 1 -- 172.21.15.92:0/3238549531 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da0004050 con 0x56209b048390 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.728+0000 7f4db193c740 1 -- 172.21.15.92:0/3238549531 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d9400eca0 con 0x56209b048390 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.728+0000 7f4d8cff9640 1 -- 172.21.15.92:0/3238549531 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4da00041f0 con 0x56209b048390 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.728+0000 7f4d8cff9640 1 -- 172.21.15.92:0/3238549531 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4da00043f0 con 0x56209b048390 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.728+0000 7f4db193c740 10 client.25286 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.728+0000 7f4db193c740 1 -- 172.21.15.92:0/3238549531 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56209b42ac00 con 0x56209b048390 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.729+0000 7f4d8cff9640 1 -- 172.21.15.92:0/3238549531 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d9400eca0 con 0x56209b048390 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.729+0000 7f4d8cff9640 1 -- 172.21.15.92:0/3238549531 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4da0003af0 con 0x56209b048390 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.729+0000 7f4db193c740 10 client.25286 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.729+0000 7f4db193c740 10 client.25286 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.729+0000 7f4db193c740 20 client.25286 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:05.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.729+0000 7f4db193c740 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56209b0279f0 0x56209b42e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.729+0000 7f4db193c740 4 client.25286 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.729+0000 7f4db193c740 1 -- 172.21.15.92:0/3238549531 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56209b388df0 con 0x56209b0279f0 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.729+0000 7f4da8963640 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56209b0279f0 0x56209b42e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.730+0000 7f4da8963640 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56209b0279f0 0x56209b42e270 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=426e7961bc0f945 server_cookie=42ec3989b9bb497d in_seq=0 out_seq=0 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.730+0000 7f4d8cff9640 10 client.25286 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4d8cff9640 1 -- 172.21.15.92:0/3238549531 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56209b388df0 con 0x56209b0279f0 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4d8cff9640 10 client.25286 handle_command_reply: tid=0 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 client.25286 shutdown 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 -- 172.21.15.92:0/3238549531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b048390 msgr2=0x56209b41c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b048390 0x56209b41c8b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4da0012770 tx=0x7f4da0012c30 comp rx=0 tx=0).stop 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 -- 172.21.15.92:0/3238549531 shutdown_connections 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56209b0279f0 0x56209b42e270 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b421a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b048390 0x56209b41c8b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 --2- 172.21.15.92:0/3238549531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b0401b0 0x56209b41c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4d8cff9640 0 client.25286 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 -- 172.21.15.92:0/3238549531 >> 172.21.15.92:0/3238549531 conn(0x56209b05d460 msgr2=0x56209b412090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 -- 172.21.15.92:0/3238549531 shutdown_connections 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 1 -- 172.21.15.92:0/3238549531 wait complete. 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.731+0000 7f4db193c740 20 client.25286 trim_cache size 0 max 16384 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4db193c740 1 Processor -- start 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4db193c740 1 -- start start 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4db193c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b0401b0 0x56209b40e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4db193c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b41c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4db193c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b069070 0x56209b41c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4db193c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41aec80 con 0x56209b0401b0 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4db193c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41b07c0 con 0x56209b069070 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4db193c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41af350 con 0x56209b048390 2024-09-21T07:14:05.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4da8963640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b0401b0 0x56209b40e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4da8963640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b0401b0 0x56209b40e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57928/0 (socket says 172.21.15.92:57928) 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4da8963640 1 -- 172.21.15.92:0/1655680196 learned_addr learned my addr 172.21.15.92:0/1655680196 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.745+0000 7f4da9164640 1 --2- 172.21.15.92:0/1655680196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b41c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.746+0000 7f4da8963640 1 -- 172.21.15.92:0/1655680196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 msgr2=0x56209b41c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.746+0000 7f4da8963640 1 --2- 172.21.15.92:0/1655680196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b41c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.746+0000 7f4da8963640 1 -- 172.21.15.92:0/1655680196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b069070 msgr2=0x56209b41c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.746+0000 7f4da8963640 1 --2- 172.21.15.92:0/1655680196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b069070 0x56209b41c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.746+0000 7f4da8963640 1 -- 172.21.15.92:0/1655680196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209b412df0 con 0x56209b0401b0 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.746+0000 7f4da8963640 1 --2- 172.21.15.92:0/1655680196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b0401b0 0x56209b40e5c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009690 tx=0x7f4d940095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8302353e000fc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.746+0000 7f4d8effd640 1 -- 172.21.15.92:0/1655680196 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94005040 con 0x56209b0401b0 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.746+0000 7f4d8effd640 1 -- 172.21.15.92:0/1655680196 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d9402a070 con 0x56209b0401b0 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.746+0000 7f4d8effd640 1 -- 172.21.15.92:0/1655680196 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94004660 con 0x56209b0401b0 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.747+0000 7f4db193c740 1 -- 172.21.15.92:0/1655680196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b0401b0 msgr2=0x56209b40e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.747+0000 7f4db193c740 1 --2- 172.21.15.92:0/1655680196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b0401b0 0x56209b40e5c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009690 tx=0x7f4d940095d0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.747+0000 7f4db193c740 1 -- 172.21.15.92:0/1655680196 shutdown_connections 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.747+0000 7f4db193c740 1 --2- 172.21.15.92:0/1655680196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b069070 0x56209b41c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.747+0000 7f4db193c740 1 --2- 172.21.15.92:0/1655680196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b41c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.747+0000 7f4db193c740 1 --2- 172.21.15.92:0/1655680196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b0401b0 0x56209b40e5c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.747+0000 7f4db193c740 1 -- 172.21.15.92:0/1655680196 >> 172.21.15.92:0/1655680196 conn(0x56209b05d460 msgr2=0x56209b40deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.747+0000 7f4db193c740 1 -- 172.21.15.92:0/1655680196 shutdown_connections 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.747+0000 7f4db193c740 1 -- 172.21.15.92:0/1655680196 wait complete. 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.748+0000 7f4db193c740 1 -- start start 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.748+0000 7f4db193c740 1 Processor -- start 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.748+0000 7f4db193c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 0x56209b4249b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.748+0000 7f4db193c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b424f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4db193c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b491c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4db193c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41b00f0 con 0x56209b069070 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4db193c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41afa20 con 0x56209b0401b0 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4db193c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41acc60 con 0x56209b048390 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4db193c740 10 client.0 _ll_register_callbacks cb 0x7f4da0009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da8963640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b491c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da8963640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b491c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57936/0 (socket says 172.21.15.92:57936) 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da8963640 1 -- 172.21.15.92:0/943400562 learned_addr learned my addr 172.21.15.92:0/943400562 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da9164640 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b424f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da8963640 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 0x56209b4249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da9164640 1 -- 172.21.15.92:0/943400562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 msgr2=0x56209b4249b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da9164640 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 0x56209b4249b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da9164640 1 -- 172.21.15.92:0/943400562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 msgr2=0x56209b491c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da9164640 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b491c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da9164640 1 -- 172.21.15.92:0/943400562 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56209b4922b0 con 0x56209b048390 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da8963640 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b491c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4da9164640 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b424f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4da0012740 tx=0x7f4da000fb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed41bd07b8bf402b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.749+0000 7f4d8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4d8cff9640 1 -- 172.21.15.92:0/943400562 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da002d070 con 0x56209b048390 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4d8cff9640 1 -- 172.21.15.92:0/943400562 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4da00035f0 con 0x56209b048390 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4db193c740 1 -- 172.21.15.92:0/943400562 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d9402a070 con 0x56209b048390 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4d8cff9640 1 -- 172.21.15.92:0/943400562 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4da00037f0 con 0x56209b048390 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4db193c740 10 client.25423 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4db193c740 1 -- 172.21.15.92:0/943400562 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56209b4995d0 con 0x56209b048390 2024-09-21T07:14:05.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4d8cff9640 1 -- 172.21.15.92:0/943400562 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d9402a070 con 0x56209b048390 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4d8cff9640 1 -- 172.21.15.92:0/943400562 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4da00105a0 con 0x56209b048390 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4db193c740 10 client.25423 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4db193c740 10 client.25423 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4db193c740 20 client.25423 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4db193c740 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56209affcda0 0x56209b49bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4db193c740 4 client.25423 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.750+0000 7f4db193c740 1 -- 172.21.15.92:0/943400562 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56209b3848a0 con 0x56209affcda0 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.751+0000 7f4da8963640 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56209affcda0 0x56209b49bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.751+0000 7f4d8cff9640 10 client.25423 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.751+0000 7f4da8963640 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56209affcda0 0x56209b49bd30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=99c42d9d560f314c server_cookie=9630347d14cd88bb in_seq=0 out_seq=0 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.751+0000 7f4d8cff9640 1 -- 172.21.15.92:0/943400562 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56209b3848a0 con 0x56209affcda0 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.751+0000 7f4d8cff9640 10 client.25423 handle_command_reply: tid=0 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.751+0000 7f4db193c740 1 client.25423 shutdown 2024-09-21T07:14:05.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 1 -- 172.21.15.92:0/943400562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 msgr2=0x56209b424f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b424f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4da0012740 tx=0x7f4da000fb50 comp rx=0 tx=0).stop 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 1 -- 172.21.15.92:0/943400562 shutdown_connections 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56209affcda0 0x56209b49bd30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56209b069070 0x56209b491c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56209b048390 0x56209b424f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4d8cff9640 0 client.25423 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 1 --2- 172.21.15.92:0/943400562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56209b0401b0 0x56209b4249b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 1 -- 172.21.15.92:0/943400562 >> 172.21.15.92:0/943400562 conn(0x56209b05d460 msgr2=0x56209b41c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 1 -- 172.21.15.92:0/943400562 shutdown_connections 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 1 -- 172.21.15.92:0/943400562 wait complete. 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.752+0000 7f4db193c740 20 client.25423 trim_cache size 0 max 16384 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3458123950 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4d900b6790 msgr2=0x7f4d900b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:05.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4d900b6790 0x7f4d900b8ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c105dc0 tx=0x7f4d9c108d70 comp rx=0 tx=0).stop 2024-09-21T07:14:05.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3458123950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da4106bd0 msgr2=0x7f4da419fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:05.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da4106bd0 0x7f4da419fc20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c031ef0 tx=0x7f4d9c031f20 comp rx=0 tx=0).stop 2024-09-21T07:14:05.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3458123950 shutdown_connections 2024-09-21T07:14:05.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4d900b6790 0x7f4d900b8ca0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4da4106bd0 0x7f4da419fc20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4da4106280 0x7f4da419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 --2- 172.21.15.92:0/3458123950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da4102090 0x7f4da419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:05.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3458123950 >> 172.21.15.92:0/3458123950 conn(0x7f4da4077c60 msgr2=0x7f4da4107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:05.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3458123950 shutdown_connections 2024-09-21T07:14:05.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:04.753+0000 7f4dab3c8640 1 -- 172.21.15.92:0/3458123950 wait complete. 2024-09-21T07:14:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:07.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:06 smithi175 ceph-mon[34064]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-21T07:14:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:06 smithi092 ceph-mon[30987]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-21T07:14:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:06 smithi169 ceph-mon[33705]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-21T07:14:07.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.797+0000 7f95062a9640 1 -- 172.21.15.92:0/2681097469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95001029b0 msgr2=0x7f9500102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.797+0000 7f95062a9640 1 --2- 172.21.15.92:0/2681097469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95001029b0 0x7f9500102dc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009900 tx=0x7f94f002a410 comp rx=0 tx=0).stop 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.797+0000 7f95062a9640 1 -- 172.21.15.92:0/2681097469 shutdown_connections 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.797+0000 7f95062a9640 1 --2- 172.21.15.92:0/2681097469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9500108c30 0x7f950010f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.797+0000 7f95062a9640 1 --2- 172.21.15.92:0/2681097469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95001082e0 0x7f95001086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.797+0000 7f95062a9640 1 --2- 172.21.15.92:0/2681097469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95001029b0 0x7f9500102dc0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.797+0000 7f95062a9640 1 -- 172.21.15.92:0/2681097469 >> 172.21.15.92:0/2681097469 conn(0x7f950007a740 msgr2=0x7f950007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.798+0000 7f95062a9640 1 -- 172.21.15.92:0/2681097469 shutdown_connections 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.798+0000 7f95062a9640 1 -- 172.21.15.92:0/2681097469 wait complete. 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.798+0000 7f95062a9640 1 Processor -- start 2024-09-21T07:14:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.798+0000 7f95062a9640 1 -- start start 2024-09-21T07:14:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.798+0000 7f95062a9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95001029b0 0x7f950019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.798+0000 7f95062a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95001082e0 0x7f950019b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f95062a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9500108c30 0x7f950019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f95062a9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95001127a0 con 0x7f9500108c30 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f95062a9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9500112620 con 0x7f95001029b0 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f95062a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9500112920 con 0x7f95001082e0 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f9504846640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9500108c30 0x7f950019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f9504846640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9500108c30 0x7f950019bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57942/0 (socket says 172.21.15.92:57942) 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f9504846640 1 -- 172.21.15.92:0/3425849708 learned_addr learned my addr 172.21.15.92:0/3425849708 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f94fffff640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95001029b0 0x7f950019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f94f7fff640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95001082e0 0x7f950019b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f9504846640 1 -- 172.21.15.92:0/3425849708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95001082e0 msgr2=0x7f950019b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f9504846640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95001082e0 0x7f950019b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f9504846640 1 -- 172.21.15.92:0/3425849708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95001029b0 msgr2=0x7f950019b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f9504846640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95001029b0 0x7f950019b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f9504846640 1 -- 172.21.15.92:0/3425849708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95001a63d0 con 0x7f9500108c30 2024-09-21T07:14:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f9504846640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9500108c30 0x7f950019bc50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f94f800eaa0 tx=0x7f94f800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f94fdffb640 1 -- 172.21.15.92:0/3425849708 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f800cdb0 con 0x7f9500108c30 2024-09-21T07:14:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f95062a9640 1 -- 172.21.15.92:0/3425849708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95001a66c0 con 0x7f9500108c30 2024-09-21T07:14:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f94fdffb640 1 -- 172.21.15.92:0/3425849708 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94f8005020 con 0x7f9500108c30 2024-09-21T07:14:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.799+0000 7f94fdffb640 1 -- 172.21.15.92:0/3425849708 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f80116d0 con 0x7f9500108c30 2024-09-21T07:14:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.800+0000 7f95062a9640 1 -- 172.21.15.92:0/3425849708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95001a6c10 con 0x7f9500108c30 2024-09-21T07:14:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.802+0000 7f950d21c740 1 Processor -- start 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.802+0000 7f94fdffb640 1 -- 172.21.15.92:0/3425849708 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7f94f80051d0 con 0x7f9500108c30 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.802+0000 7f950d21c740 1 -- start start 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f950d21c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e361b0 0x55cd091db9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f950d21c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091dbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f950d21c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e154d0 0x55cd091dc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f950d21c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cd091506f0 con 0x55cd08e0d2f0 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f950d21c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cd0913fb20 con 0x55cd08e154d0 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f950d21c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cd09143930 con 0x55cd08e361b0 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091dbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091dbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57958/0 (socket says 172.21.15.92:57958) 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94fffff640 1 -- 172.21.15.92:0/2894229607 learned_addr learned my addr 172.21.15.92:0/2894229607 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94f7fff640 1 --2- 172.21.15.92:0/2894229607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e361b0 0x55cd091db9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94f7fff640 1 --2- 172.21.15.92:0/2894229607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e154d0 0x55cd091dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94fffff640 1 -- 172.21.15.92:0/2894229607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e361b0 msgr2=0x55cd091db9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94fffff640 1 --2- 172.21.15.92:0/2894229607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e361b0 0x55cd091db9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94fffff640 1 -- 172.21.15.92:0/2894229607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e154d0 msgr2=0x55cd091dc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94fffff640 1 --2- 172.21.15.92:0/2894229607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e154d0 0x55cd091dc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94fffff640 1 -- 172.21.15.92:0/2894229607 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd09105530 con 0x55cd08e0d2f0 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94fdffb640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94ec0b6710 0x7f94ec0b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94fffff640 1 --2- 172.21.15.92:0/2894229607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091dbef0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f94f0000c00 tx=0x7f94f0031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bea0eef3758f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.803+0000 7f94f7fff640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94ec0b6710 0x7f94ec0b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.804+0000 7f94f67fc640 1 -- 172.21.15.92:0/2894229607 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0035030 con 0x55cd08e0d2f0 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.804+0000 7f94fdffb640 1 -- 172.21.15.92:0/3425849708 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f94f80e7dd0 con 0x7f9500108c30 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.804+0000 7f94f67fc640 1 -- 172.21.15.92:0/2894229607 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94f0040070 con 0x55cd08e0d2f0 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.804+0000 7f94f67fc640 1 -- 172.21.15.92:0/2894229607 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f00039e0 con 0x55cd08e0d2f0 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 -- 172.21.15.92:0/2894229607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 msgr2=0x55cd091dbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f94f7fff640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94ec0b6710 0x7f94ec0b8c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f950007b1a0 tx=0x7f94e80046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 --2- 172.21.15.92:0/2894229607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091dbef0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f94f0000c00 tx=0x7f94f0031dc0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 -- 172.21.15.92:0/2894229607 shutdown_connections 2024-09-21T07:14:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 --2- 172.21.15.92:0/2894229607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e154d0 0x55cd091dc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 --2- 172.21.15.92:0/2894229607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091dbef0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 --2- 172.21.15.92:0/2894229607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e361b0 0x55cd091db9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 -- 172.21.15.92:0/2894229607 >> 172.21.15.92:0/2894229607 conn(0x55cd08e2a300 msgr2=0x55cd091d98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 -- 172.21.15.92:0/2894229607 shutdown_connections 2024-09-21T07:14:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 -- 172.21.15.92:0/2894229607 wait complete. 2024-09-21T07:14:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 -- start start 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.805+0000 7f950d21c740 1 Processor -- start 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f950d21c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f950d21c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e154d0 0x55cd091ec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f950d21c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e361b0 0x55cd091f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f950d21c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cd09077ab0 con 0x55cd08e0d2f0 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f950d21c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cd090e5730 con 0x55cd08e361b0 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f950d21c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cd091ea0d0 con 0x55cd08e154d0 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f950d21c740 10 client.0 _ll_register_callbacks cb 0x55cd091396b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091ebce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57962/0 (socket says 172.21.15.92:57962) 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94fffff640 1 -- 172.21.15.92:0/841772476 learned_addr learned my addr 172.21.15.92:0/841772476 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94f7fff640 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e154d0 0x55cd091ec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f9504846640 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e361b0 0x55cd091f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94fffff640 1 -- 172.21.15.92:0/841772476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e154d0 msgr2=0x55cd091ec2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94fffff640 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e154d0 0x55cd091ec2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94fffff640 1 -- 172.21.15.92:0/841772476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e361b0 msgr2=0x55cd091f12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94fffff640 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e361b0 0x55cd091f12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94fffff640 1 -- 172.21.15.92:0/841772476 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd08ea1790 con 0x55cd08e0d2f0 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94fffff640 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091ebce0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f94f0006010 tx=0x7f94f00316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c06d89fdad53f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.806+0000 7f94df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f94df7fe640 1 -- 172.21.15.92:0/841772476 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f004c070 con 0x55cd08e0d2f0 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f94df7fe640 1 -- 172.21.15.92:0/841772476 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f94f003c850 con 0x55cd08e0d2f0 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f950d21c740 1 -- 172.21.15.92:0/841772476 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94f0040070 con 0x55cd08e0d2f0 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f94df7fe640 1 -- 172.21.15.92:0/841772476 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f94f0058050 con 0x55cd08e0d2f0 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f950d21c740 10 client.15945 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f950d21c740 1 -- 172.21.15.92:0/841772476 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cd08f1a620 con 0x55cd08e0d2f0 2024-09-21T07:14:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f94df7fe640 1 -- 172.21.15.92:0/841772476 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94f0040070 con 0x55cd08e0d2f0 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f94df7fe640 1 -- 172.21.15.92:0/841772476 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f94f00448b0 con 0x55cd08e0d2f0 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f950d21c740 10 client.15945 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f950d21c740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f950d21c740 20 client.15945 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f950d21c740 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55cd08df4d80 0x55cd091fd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f950d21c740 4 client.15945 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.807+0000 7f950d21c740 1 -- 172.21.15.92:0/841772476 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd09152640 con 0x55cd08df4d80 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.808+0000 7f94f7fff640 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55cd08df4d80 0x55cd091fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.808+0000 7f94df7fe640 10 client.15945 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.808+0000 7f94f7fff640 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55cd08df4d80 0x55cd091fd3b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ba1688fd52bb0af server_cookie=c9c96e43e7aa0b21 in_seq=0 out_seq=0 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f94df7fe640 1 -- 172.21.15.92:0/841772476 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd09152640 con 0x55cd08df4d80 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f94df7fe640 10 client.15945 handle_command_reply: tid=0 2024-09-21T07:14:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 client.15945 shutdown 2024-09-21T07:14:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 -- 172.21.15.92:0/841772476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 msgr2=0x55cd091ebce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091ebce0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f94f0006010 tx=0x7f94f00316b0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 -- 172.21.15.92:0/841772476 shutdown_connections 2024-09-21T07:14:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55cd08df4d80 0x55cd091fd3b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f94df7fe640 0 client.15945 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e361b0 0x55cd091f12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e154d0 0x55cd091ec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 --2- 172.21.15.92:0/841772476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e0d2f0 0x55cd091ebce0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 -- 172.21.15.92:0/841772476 >> 172.21.15.92:0/841772476 conn(0x55cd08e2a300 msgr2=0x55cd091dc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 -- 172.21.15.92:0/841772476 shutdown_connections 2024-09-21T07:14:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 1 -- 172.21.15.92:0/841772476 wait complete. 2024-09-21T07:14:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.809+0000 7f950d21c740 20 client.15945 trim_cache size 0 max 16384 2024-09-21T07:14:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f950d21c740 1 Processor -- start 2024-09-21T07:14:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f950d21c740 1 -- start start 2024-09-21T07:14:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f950d21c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08df4d80 0x55cd091d98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f950d21c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 0x55cd091e8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f950d21c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e154d0 0x55cd091e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f950d21c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95001aeba0 con 0x55cd08df4d80 2024-09-21T07:14:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f950d21c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f95001b06e0 con 0x55cd08e0d2f0 2024-09-21T07:14:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f950d21c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f95001af270 con 0x55cd08e154d0 2024-09-21T07:14:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f94fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08df4d80 0x55cd091d98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f94fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08df4d80 0x55cd091d98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57968/0 (socket says 172.21.15.92:57968) 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.825+0000 7f94fffff640 1 -- 172.21.15.92:0/2978211188 learned_addr learned my addr 172.21.15.92:0/2978211188 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.826+0000 7f94fffff640 1 -- 172.21.15.92:0/2978211188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e154d0 msgr2=0x55cd091e8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.826+0000 7f94fffff640 1 --2- 172.21.15.92:0/2978211188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e154d0 0x55cd091e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.826+0000 7f94f7fff640 1 --2- 172.21.15.92:0/2978211188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 0x55cd091e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.826+0000 7f94fffff640 1 -- 172.21.15.92:0/2978211188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 msgr2=0x55cd091e8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.826+0000 7f94fffff640 1 --2- 172.21.15.92:0/2978211188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 0x55cd091e8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.826+0000 7f94fffff640 1 -- 172.21.15.92:0/2978211188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd091de7c0 con 0x55cd08df4d80 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.826+0000 7f94fffff640 1 --2- 172.21.15.92:0/2978211188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08df4d80 0x55cd091d98d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f94f002a930 tx=0x7f94f0009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb0f49976530c18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.826+0000 7f94f5ffb640 1 -- 172.21.15.92:0/2978211188 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f004c030 con 0x55cd08df4d80 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.826+0000 7f94f5ffb640 1 -- 172.21.15.92:0/2978211188 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94f0040040 con 0x55cd08df4d80 2024-09-21T07:14:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.826+0000 7f94f5ffb640 1 -- 172.21.15.92:0/2978211188 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0035050 con 0x55cd08df4d80 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.827+0000 7f950d21c740 1 -- 172.21.15.92:0/2978211188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08df4d80 msgr2=0x55cd091d98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.827+0000 7f950d21c740 1 --2- 172.21.15.92:0/2978211188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08df4d80 0x55cd091d98d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f94f002a930 tx=0x7f94f0009620 comp rx=0 tx=0).stop 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.827+0000 7f950d21c740 1 -- 172.21.15.92:0/2978211188 shutdown_connections 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.827+0000 7f950d21c740 1 --2- 172.21.15.92:0/2978211188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08e154d0 0x55cd091e8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.827+0000 7f950d21c740 1 --2- 172.21.15.92:0/2978211188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 0x55cd091e8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.827+0000 7f950d21c740 1 --2- 172.21.15.92:0/2978211188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08df4d80 0x55cd091d98d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.827+0000 7f950d21c740 1 -- 172.21.15.92:0/2978211188 >> 172.21.15.92:0/2978211188 conn(0x55cd08e2a300 msgr2=0x55cd091d91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.827+0000 7f950d21c740 1 -- 172.21.15.92:0/2978211188 shutdown_connections 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.827+0000 7f950d21c740 1 -- 172.21.15.92:0/2978211188 wait complete. 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.827+0000 7f950d21c740 1 -- start start 2024-09-21T07:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f950d21c740 1 Processor -- start 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f950d21c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08df4d80 0x55cd091f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f950d21c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 0x55cd091f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f950d21c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e154d0 0x55cd0925eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f950d21c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95001b0010 con 0x55cd08e154d0 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f950d21c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f95001af940 con 0x55cd08e0d2f0 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f950d21c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f95001acb80 con 0x55cd08df4d80 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f950d21c740 10 client.0 _ll_register_callbacks cb 0x7f94e800e4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f9504846640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e154d0 0x55cd0925eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f9504846640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e154d0 0x55cd0925eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57974/0 (socket says 172.21.15.92:57974) 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f9504846640 1 -- 172.21.15.92:0/491237108 learned_addr learned my addr 172.21.15.92:0/491237108 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f94fffff640 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08df4d80 0x55cd091f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f94f7fff640 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 0x55cd091f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f9504846640 1 -- 172.21.15.92:0/491237108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08df4d80 msgr2=0x55cd091f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f9504846640 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08df4d80 0x55cd091f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f9504846640 1 -- 172.21.15.92:0/491237108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 msgr2=0x55cd091f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f9504846640 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 0x55cd091f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f9504846640 1 -- 172.21.15.92:0/491237108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0925f180 con 0x55cd08e154d0 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.828+0000 7f94fffff640 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08df4d80 0x55cd091f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f94f7fff640 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 0x55cd091f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f9504846640 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e154d0 0x55cd0925eae0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f94f80e5150 tx=0x7f94f80ad060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1998558dd9d0c0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f94df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f94df7fe640 1 -- 172.21.15.92:0/491237108 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f801f040 con 0x55cd08e154d0 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f94df7fe640 1 -- 172.21.15.92:0/491237108 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f94f80ac3e0 con 0x55cd08e154d0 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f950d21c740 1 -- 172.21.15.92:0/491237108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94f0040040 con 0x55cd08e154d0 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f94df7fe640 1 -- 172.21.15.92:0/491237108 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f94f80ad220 con 0x55cd08e154d0 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f950d21c740 10 client.15951 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f950d21c740 1 -- 172.21.15.92:0/491237108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cd092676a0 con 0x55cd08e154d0 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f94df7fe640 1 -- 172.21.15.92:0/491237108 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94f80d4070 con 0x55cd08e154d0 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f94df7fe640 1 -- 172.21.15.92:0/491237108 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f94f800f040 con 0x55cd08e154d0 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f950d21c740 10 client.15951 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f950d21c740 10 client.15951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f950d21c740 20 client.15951 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.829+0000 7f950d21c740 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55cd08e361b0 0x55cd09269e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.830+0000 7f950d21c740 4 client.15951 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.830+0000 7f950d21c740 1 -- 172.21.15.92:0/491237108 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd0914e0f0 con 0x55cd08e361b0 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.830+0000 7f94fffff640 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55cd08e361b0 0x55cd09269e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.830+0000 7f94df7fe640 10 client.15951 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.830+0000 7f94fffff640 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55cd08e361b0 0x55cd09269e40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d581b1a91580d27 server_cookie=e19a9309cff016cb in_seq=0 out_seq=0 2024-09-21T07:14:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f94df7fe640 1 -- 172.21.15.92:0/491237108 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cd0914e0f0 con 0x55cd08e361b0 2024-09-21T07:14:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f94df7fe640 10 client.15951 handle_command_reply: tid=0 2024-09-21T07:14:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 client.15951 shutdown 2024-09-21T07:14:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 -- 172.21.15.92:0/491237108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e154d0 msgr2=0x55cd0925eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e154d0 0x55cd0925eae0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f94f80e5150 tx=0x7f94f80ad060 comp rx=0 tx=0).stop 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 -- 172.21.15.92:0/491237108 shutdown_connections 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55cd08e361b0 0x55cd09269e40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd08e154d0 0x55cd0925eae0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd08e0d2f0 0x55cd091f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f94df7fe640 0 client.15951 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 --2- 172.21.15.92:0/491237108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd08df4d80 0x55cd091f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 -- 172.21.15.92:0/491237108 >> 172.21.15.92:0/491237108 conn(0x55cd08e2a300 msgr2=0x55cd091e8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 -- 172.21.15.92:0/491237108 shutdown_connections 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 1 -- 172.21.15.92:0/491237108 wait complete. 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.837+0000 7f950d21c740 20 client.15951 trim_cache size 0 max 16384 2024-09-21T07:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:14:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:14:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:14:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:14:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 -- 172.21.15.92:0/3425849708 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94ec0b6710 msgr2=0x7f94ec0b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94ec0b6710 0x7f94ec0b8c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f950007b1a0 tx=0x7f94e80046c0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 -- 172.21.15.92:0/3425849708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9500108c30 msgr2=0x7f950019bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9500108c30 0x7f950019bc50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f94f800eaa0 tx=0x7f94f800ef60 comp rx=0 tx=0).stop 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 -- 172.21.15.92:0/3425849708 shutdown_connections 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f94ec0b6710 0x7f94ec0b8c20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9500108c30 0x7f950019bc50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95001082e0 0x7f950019b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 --2- 172.21.15.92:0/3425849708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95001029b0 0x7f950019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 -- 172.21.15.92:0/3425849708 >> 172.21.15.92:0/3425849708 conn(0x7f950007a740 msgr2=0x7f9500106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 -- 172.21.15.92:0/3425849708 shutdown_connections 2024-09-21T07:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:07.838+0000 7f95062a9640 1 -- 172.21.15.92:0/3425849708 wait complete. 2024-09-21T07:14:07.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.937+0000 7f97942d3640 1 -- 172.21.15.92:0/337341759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f978c106bd0 msgr2=0x7f978c110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.937+0000 7f97942d3640 1 --2- 172.21.15.92:0/337341759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f978c106bd0 0x7f978c110660 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9784009ca0 tx=0x7f978402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.937+0000 7f97942d3640 1 -- 172.21.15.92:0/337341759 shutdown_connections 2024-09-21T07:14:07.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.937+0000 7f97942d3640 1 --2- 172.21.15.92:0/337341759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f978c106bd0 0x7f978c110660 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.937+0000 7f97942d3640 1 --2- 172.21.15.92:0/337341759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f978c106280 0x7f978c106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.937+0000 7f97942d3640 1 --2- 172.21.15.92:0/337341759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f978c102090 0x7f978c1024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.937+0000 7f97942d3640 1 -- 172.21.15.92:0/337341759 >> 172.21.15.92:0/337341759 conn(0x7f978c077c60 msgr2=0x7f978c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:07.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.937+0000 7f97942d3640 1 -- 172.21.15.92:0/337341759 shutdown_connections 2024-09-21T07:14:07.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.937+0000 7f97942d3640 1 -- 172.21.15.92:0/337341759 wait complete. 2024-09-21T07:14:07.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.938+0000 7f97942d3640 1 Processor -- start 2024-09-21T07:14:07.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.938+0000 7f97942d3640 1 -- start start 2024-09-21T07:14:07.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f97942d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f978c102090 0x7f978c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f97942d3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f978c106280 0x7f978c1a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f97942d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f978c106bd0 0x7f978c1ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f97942d3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f978c113950 con 0x7f978c102090 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f97942d3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f978c1137d0 con 0x7f978c106280 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f97942d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f978c113ad0 con 0x7f978c106bd0 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f979206f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f978c102090 0x7f978c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f979206f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f978c102090 0x7f978c1a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57990/0 (socket says 172.21.15.92:57990) 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f979206f640 1 -- 172.21.15.92:0/3695835776 learned_addr learned my addr 172.21.15.92:0/3695835776 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f979186e640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f978c106280 0x7f978c1a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f9792870640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f978c106bd0 0x7f978c1ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f979206f640 1 -- 172.21.15.92:0/3695835776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f978c106bd0 msgr2=0x7f978c1ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f979206f640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f978c106bd0 0x7f978c1ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f979206f640 1 -- 172.21.15.92:0/3695835776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f978c106280 msgr2=0x7f978c1a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f979206f640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f978c106280 0x7f978c1a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:07.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.939+0000 7f979206f640 1 -- 172.21.15.92:0/3695835776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978c1acbf0 con 0x7f978c102090 2024-09-21T07:14:07.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.940+0000 7f979186e640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f978c106280 0x7f978c1a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:07.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.940+0000 7f979206f640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f978c102090 0x7f978c1a1630 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f978800c970 tx=0x7f978800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:07.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.940+0000 7f97837fe640 1 -- 172.21.15.92:0/3695835776 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788004220 con 0x7f978c102090 2024-09-21T07:14:07.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.940+0000 7f97942d3640 1 -- 172.21.15.92:0/3695835776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978c1acdc0 con 0x7f978c102090 2024-09-21T07:14:07.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.940+0000 7f97942d3640 1 -- 172.21.15.92:0/3695835776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f978c1ad270 con 0x7f978c102090 2024-09-21T07:14:07.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.940+0000 7f97837fe640 1 -- 172.21.15.92:0/3695835776 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9788007e40 con 0x7f978c102090 2024-09-21T07:14:07.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.940+0000 7f97837fe640 1 -- 172.21.15.92:0/3695835776 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978801d060 con 0x7f978c102090 2024-09-21T07:14:07.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.941+0000 7f97942d3640 1 -- 172.21.15.92:0/3695835776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9770005290 con 0x7f978c102090 2024-09-21T07:14:07.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.943+0000 7f97837fe640 1 -- 172.21.15.92:0/3695835776 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7f97880079b0 con 0x7f978c102090 2024-09-21T07:14:07.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.944+0000 7f97837fe640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97780b6790 0x7f97780b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:07.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.944+0000 7f979186e640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97780b6790 0x7f97780b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:07.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.944+0000 7f97837fe640 1 -- 172.21.15.92:0/3695835776 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f97880e7b50 con 0x7f978c102090 2024-09-21T07:14:07.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.945+0000 7f979186e640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97780b6790 0x7f97780b8ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f978c10a490 tx=0x7f977c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:07.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:07.948+0000 7f97837fe640 1 -- 172.21.15.92:0/3695835776 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9788014030 con 0x7f978c102090 2024-09-21T07:14:07.980 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:08.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.191+0000 7f97942d3640 1 -- 172.21.15.92:0/3695835776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9770005580 con 0x7f978c102090 2024-09-21T07:14:08.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.192+0000 7f97837fe640 1 -- 172.21.15.92:0/3695835776 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f97880adc10 con 0x7f978c102090 2024-09-21T07:14:08.194 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:14:08.194 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:14:08.194 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:14:08.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 -- 172.21.15.92:0/3695835776 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97780b6790 msgr2=0x7f97780b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:08.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97780b6790 0x7f97780b8ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f978c10a490 tx=0x7f977c00b410 comp rx=0 tx=0).stop 2024-09-21T07:14:08.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 -- 172.21.15.92:0/3695835776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f978c102090 msgr2=0x7f978c1a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:08.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f978c102090 0x7f978c1a1630 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f978800c970 tx=0x7f978800ce30 comp rx=0 tx=0).stop 2024-09-21T07:14:08.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 -- 172.21.15.92:0/3695835776 shutdown_connections 2024-09-21T07:14:08.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f97780b6790 0x7f97780b8ca0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:08.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f978c106bd0 0x7f978c1ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:08.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f978c106280 0x7f978c1a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:08.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 --2- 172.21.15.92:0/3695835776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f978c102090 0x7f978c1a1630 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:08.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 -- 172.21.15.92:0/3695835776 >> 172.21.15.92:0/3695835776 conn(0x7f978c077c60 msgr2=0x7f978c1073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:08.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 -- 172.21.15.92:0/3695835776 shutdown_connections 2024-09-21T07:14:08.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:08.194+0000 7f97942d3640 1 -- 172.21.15.92:0/3695835776 wait complete. 2024-09-21T07:14:08.895 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24649 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T07:14:08.896 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24649 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T07:14:09.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:08 smithi175 ceph-mon[34064]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-21T07:14:09.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:08 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3695835776' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:09.039 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:08 smithi092 ceph-mon[30987]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-21T07:14:09.039 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:08 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3695835776' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:09.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:08 smithi169 ceph-mon[33705]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-21T07:14:09.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:08 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3695835776' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:09.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.159+0000 7fc61b208640 1 -- 172.21.15.92:0/308458094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc614107be0 msgr2=0x7fc6141080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:09.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.159+0000 7fc61b208640 1 --2- 172.21.15.92:0/308458094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc614107be0 0x7fc6141080c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009c10 tx=0x7fc60c02a6e0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.160+0000 7fc61b208640 1 -- 172.21.15.92:0/308458094 shutdown_connections 2024-09-21T07:14:09.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.160+0000 7fc61b208640 1 --2- 172.21.15.92:0/308458094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc614107be0 0x7fc6141080c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.160+0000 7fc61b208640 1 --2- 172.21.15.92:0/308458094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6141030f0 0x7fc614107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.160+0000 7fc61b208640 1 --2- 172.21.15.92:0/308458094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6141027a0 0x7fc614102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.160+0000 7fc61b208640 1 -- 172.21.15.92:0/308458094 >> 172.21.15.92:0/308458094 conn(0x7fc614079730 msgr2=0x7fc614079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.160+0000 7fc61b208640 1 -- 172.21.15.92:0/308458094 shutdown_connections 2024-09-21T07:14:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.160+0000 7fc61b208640 1 -- 172.21.15.92:0/308458094 wait complete. 2024-09-21T07:14:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.161+0000 7fc61b208640 1 Processor -- start 2024-09-21T07:14:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.161+0000 7fc61b208640 1 -- start start 2024-09-21T07:14:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.162+0000 7fc61b208640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6141027a0 0x7fc6141a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.162+0000 7fc61b208640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6141030f0 0x7fc6141a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.162+0000 7fc613fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6141030f0 0x7fc6141a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.162+0000 7fc613fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6141030f0 0x7fc6141a0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58004/0 (socket says 172.21.15.92:58004) 2024-09-21T07:14:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.162+0000 7fc618fa4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6141027a0 0x7fc6141a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.162+0000 7fc613fff640 1 -- 172.21.15.92:0/1551576779 learned_addr learned my addr 172.21.15.92:0/1551576779 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.162+0000 7fc61b208640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc614107be0 0x7fc6141a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.162+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc614119f50 con 0x7fc6141030f0 2024-09-21T07:14:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.162+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc614119dd0 con 0x7fc6141027a0 2024-09-21T07:14:09.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.162+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc61411a0d0 con 0x7fc614107be0 2024-09-21T07:14:09.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.163+0000 7fc6197a5640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc614107be0 0x7fc6141a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.163+0000 7fc613fff640 1 -- 172.21.15.92:0/1551576779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc614107be0 msgr2=0x7fc6141a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:09.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.163+0000 7fc613fff640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc614107be0 0x7fc6141a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.163+0000 7fc613fff640 1 -- 172.21.15.92:0/1551576779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6141027a0 msgr2=0x7fc6141a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.163+0000 7fc613fff640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6141027a0 0x7fc6141a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.163+0000 7fc613fff640 1 -- 172.21.15.92:0/1551576779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6141a6930 con 0x7fc6141030f0 2024-09-21T07:14:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.163+0000 7fc613fff640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6141030f0 0x7fc6141a0f60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc6000058c0 tx=0x7fc60000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.163+0000 7fc611ffb640 1 -- 172.21.15.92:0/1551576779 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60000cd30 con 0x7fc6141030f0 2024-09-21T07:14:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.163+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6141a6c20 con 0x7fc6141030f0 2024-09-21T07:14:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.164+0000 7fc611ffb640 1 -- 172.21.15.92:0/1551576779 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6000044c0 con 0x7fc6141030f0 2024-09-21T07:14:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.165+0000 7fc611ffb640 1 -- 172.21.15.92:0/1551576779 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600010430 con 0x7fc6141030f0 2024-09-21T07:14:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.165+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6141ad380 con 0x7fc6141030f0 2024-09-21T07:14:09.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.168+0000 7fc611ffb640 1 -- 172.21.15.92:0/1551576779 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7fc600003710 con 0x7fc6141030f0 2024-09-21T07:14:09.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.168+0000 7fc62177c740 1 Processor -- start 2024-09-21T07:14:09.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.169+0000 7fc62177c740 1 -- start start 2024-09-21T07:14:09.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.169+0000 7fc62177c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34a9070 0x55bdd38502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.169+0000 7fc62177c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd3850800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.169+0000 7fc62177c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 0x55bdd3850d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.169+0000 7fc62177c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bdd37c6ea0 con 0x55bdd34801b0 2024-09-21T07:14:09.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.169+0000 7fc62177c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bdd37b62d0 con 0x55bdd34a9070 2024-09-21T07:14:09.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.169+0000 7fc62177c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bdd37ba0e0 con 0x55bdd3488390 2024-09-21T07:14:09.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc6197a5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34a9070 0x55bdd38502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc6197a5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34a9070 0x55bdd38502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:47342/0 (socket says 172.21.15.92:47342) 2024-09-21T07:14:09.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc6197a5640 1 -- 172.21.15.92:0/2618965799 learned_addr learned my addr 172.21.15.92:0/2618965799 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:09.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc6197a5640 1 -- 172.21.15.92:0/2618965799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 msgr2=0x55bdd3850d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:14:09.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc6197a5640 1 --2- 172.21.15.92:0/2618965799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 0x55bdd3850d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc6197a5640 1 -- 172.21.15.92:0/2618965799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 msgr2=0x55bdd3850800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:14:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc611ffb640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6040b6790 0x7fc6040b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc618fa4640 1 --2- 172.21.15.92:0/2618965799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd3850800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc6197a5640 1 --2- 172.21.15.92:0/2618965799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd3850800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc6197a5640 1 -- 172.21.15.92:0/2618965799 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd3514650 con 0x55bdd34a9070 2024-09-21T07:14:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc618fa4640 1 --2- 172.21.15.92:0/2618965799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd3850800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:14:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.170+0000 7fc611ffb640 1 -- 172.21.15.92:0/1551576779 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc6000e7f00 con 0x7fc6141030f0 2024-09-21T07:14:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.171+0000 7fc6197a5640 1 --2- 172.21.15.92:0/2618965799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34a9070 0x55bdd38502c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009be0 tx=0x7fc60c030430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d3e826270f9a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.171+0000 7fc5feffd640 1 -- 172.21.15.92:0/2618965799 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c040030 con 0x55bdd34a9070 2024-09-21T07:14:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.171+0000 7fc613fff640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6040b6790 0x7fc6040b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.171+0000 7fc5feffd640 1 -- 172.21.15.92:0/2618965799 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc60c037040 con 0x55bdd34a9070 2024-09-21T07:14:09.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.171+0000 7fc5feffd640 1 -- 172.21.15.92:0/2618965799 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c036070 con 0x55bdd34a9070 2024-09-21T07:14:09.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.172+0000 7fc62177c740 1 -- 172.21.15.92:0/2618965799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34a9070 msgr2=0x55bdd38502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:09.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.172+0000 7fc613fff640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6040b6790 0x7fc6040b8ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc6000e51f0 tx=0x7fc6000a9e30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:09.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.172+0000 7fc62177c740 1 --2- 172.21.15.92:0/2618965799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34a9070 0x55bdd38502c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009be0 tx=0x7fc60c030430 comp rx=0 tx=0).stop 2024-09-21T07:14:09.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.172+0000 7fc62177c740 1 -- 172.21.15.92:0/2618965799 shutdown_connections 2024-09-21T07:14:09.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.172+0000 7fc62177c740 1 --2- 172.21.15.92:0/2618965799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 0x55bdd3850d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.172+0000 7fc62177c740 1 --2- 172.21.15.92:0/2618965799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd3850800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.172+0000 7fc62177c740 1 --2- 172.21.15.92:0/2618965799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34a9070 0x55bdd38502c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.172+0000 7fc62177c740 1 -- 172.21.15.92:0/2618965799 >> 172.21.15.92:0/2618965799 conn(0x55bdd349d460 msgr2=0x55bdd384e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:09.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.173+0000 7fc62177c740 1 -- 172.21.15.92:0/2618965799 shutdown_connections 2024-09-21T07:14:09.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.173+0000 7fc62177c740 1 -- 172.21.15.92:0/2618965799 wait complete. 2024-09-21T07:14:09.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.173+0000 7fc62177c740 1 -- start start 2024-09-21T07:14:09.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.173+0000 7fc62177c740 1 Processor -- start 2024-09-21T07:14:09.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.174+0000 7fc62177c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34801b0 0x55bdd385b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.174+0000 7fc62177c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 0x55bdd385bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.174+0000 7fc62177c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34a9070 0x55bdd3867d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.174+0000 7fc62177c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bdd3617700 con 0x55bdd34a9070 2024-09-21T07:14:09.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.174+0000 7fc62177c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bdd3751160 con 0x55bdd34801b0 2024-09-21T07:14:09.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc62177c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bdd385ea40 con 0x55bdd3488390 2024-09-21T07:14:09.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc62177c740 10 client.0 _ll_register_callbacks cb 0x55bdd376a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:09.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc618fa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 0x55bdd385bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc618fa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 0x55bdd385bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:41628/0 (socket says 172.21.15.92:41628) 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc618fa4640 1 -- 172.21.15.92:0/2323427789 learned_addr learned my addr 172.21.15.92:0/2323427789 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc6197a5640 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34a9070 0x55bdd3867d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc618fa4640 1 -- 172.21.15.92:0/2323427789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34801b0 msgr2=0x55bdd385b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc618fa4640 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34801b0 0x55bdd385b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc618fa4640 1 -- 172.21.15.92:0/2323427789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34a9070 msgr2=0x55bdd3867d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc618fa4640 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34a9070 0x55bdd3867d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc618fa4640 1 -- 172.21.15.92:0/2323427789 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd377ec90 con 0x55bdd3488390 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc6197a5640 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34a9070 0x55bdd3867d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc618fa4640 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 0x55bdd385bf10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc608011690 tx=0x7fc608011b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a86655a70b6bf133 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.175+0000 7fc5f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:14:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.176+0000 7fc5f3fff640 1 -- 172.21.15.92:0/2323427789 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60800fae0 con 0x55bdd3488390 2024-09-21T07:14:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.176+0000 7fc62177c740 1 -- 172.21.15.92:0/2323427789 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc60c037040 con 0x55bdd3488390 2024-09-21T07:14:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.176+0000 7fc5f3fff640 1 -- 172.21.15.92:0/2323427789 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc60800fc80 con 0x55bdd3488390 2024-09-21T07:14:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.176+0000 7fc5f3fff640 1 -- 172.21.15.92:0/2323427789 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc608025050 con 0x55bdd3488390 2024-09-21T07:14:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.176+0000 7fc62177c740 10 client.25444 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.176+0000 7fc62177c740 1 -- 172.21.15.92:0/2323427789 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bdd386a7a0 con 0x55bdd3488390 2024-09-21T07:14:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.177+0000 7fc5f3fff640 1 -- 172.21.15.92:0/2323427789 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc60c037040 con 0x55bdd3488390 2024-09-21T07:14:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.178+0000 7fc5f3fff640 1 -- 172.21.15.92:0/2323427789 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc608004aa0 con 0x55bdd3488390 2024-09-21T07:14:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.178+0000 7fc62177c740 10 client.25444 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.178+0000 7fc62177c740 10 client.25444 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:14:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.178+0000 7fc62177c740 20 client.25444 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.178+0000 7fc62177c740 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55bdd34679f0 0x55bdd386e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.178+0000 7fc62177c740 4 client.25444 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.178+0000 7fc62177c740 1 -- 172.21.15.92:0/2323427789 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdd37c8df0 con 0x55bdd34679f0 2024-09-21T07:14:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.178+0000 7fc6197a5640 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55bdd34679f0 0x55bdd386e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.178+0000 7fc6197a5640 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55bdd34679f0 0x55bdd386e110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1767700c323d22c6 server_cookie=814f7ab98cc8b64e in_seq=0 out_seq=0 2024-09-21T07:14:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.178+0000 7fc5f3fff640 10 client.25444 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:14:09.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc5f3fff640 1 -- 172.21.15.92:0/2323427789 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bdd37c8df0 con 0x55bdd34679f0 2024-09-21T07:14:09.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc5f3fff640 10 client.25444 handle_command_reply: tid=0 2024-09-21T07:14:09.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc62177c740 1 client.25444 shutdown 2024-09-21T07:14:09.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc62177c740 1 -- 172.21.15.92:0/2323427789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 msgr2=0x55bdd385bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc62177c740 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 0x55bdd385bf10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc608011690 tx=0x7fc608011b50 comp rx=0 tx=0).stop 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc62177c740 1 -- 172.21.15.92:0/2323427789 shutdown_connections 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc62177c740 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55bdd34679f0 0x55bdd386e110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc62177c740 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34a9070 0x55bdd3867d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc62177c740 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd3488390 0x55bdd385bf10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc62177c740 1 --2- 172.21.15.92:0/2323427789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd34801b0 0x55bdd385b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.179+0000 7fc62177c740 1 -- 172.21.15.92:0/2323427789 >> 172.21.15.92:0/2323427789 conn(0x55bdd349d460 msgr2=0x55bdd3853450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.180+0000 7fc5f3fff640 0 client.25444 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.180+0000 7fc62177c740 1 -- 172.21.15.92:0/2323427789 shutdown_connections 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.180+0000 7fc62177c740 1 -- 172.21.15.92:0/2323427789 wait complete. 2024-09-21T07:14:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.180+0000 7fc62177c740 20 client.25444 trim_cache size 0 max 16384 2024-09-21T07:14:09.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc62177c740 1 Processor -- start 2024-09-21T07:14:09.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc62177c740 1 -- start start 2024-09-21T07:14:09.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc62177c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd385be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc62177c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 0x55bdd3867c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc62177c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd34a9070 0x55bdd38533c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc62177c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6141b7360 con 0x55bdd34801b0 2024-09-21T07:14:09.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc62177c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc6141b8ea0 con 0x55bdd3488390 2024-09-21T07:14:09.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc62177c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6141b7a30 con 0x55bdd34a9070 2024-09-21T07:14:09.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc6197a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd385be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc6197a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd385be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58044/0 (socket says 172.21.15.92:58044) 2024-09-21T07:14:09.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc6197a5640 1 -- 172.21.15.92:0/1798351584 learned_addr learned my addr 172.21.15.92:0/1798351584 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:09.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc6197a5640 1 --2- 172.21.15.92:0/1798351584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd34a9070 0x55bdd38533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.199+0000 7fc618fa4640 1 --2- 172.21.15.92:0/1798351584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 0x55bdd3867c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.200+0000 7fc6197a5640 1 -- 172.21.15.92:0/1798351584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd34a9070 msgr2=0x55bdd38533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:09.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.200+0000 7fc6197a5640 1 --2- 172.21.15.92:0/1798351584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd34a9070 0x55bdd38533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.200+0000 7fc6197a5640 1 -- 172.21.15.92:0/1798351584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 msgr2=0x55bdd3867c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:09.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.200+0000 7fc6197a5640 1 --2- 172.21.15.92:0/1798351584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 0x55bdd3867c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.200+0000 7fc6197a5640 1 -- 172.21.15.92:0/1798351584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd385cc90 con 0x55bdd34801b0 2024-09-21T07:14:09.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.200+0000 7fc6197a5640 1 --2- 172.21.15.92:0/1798351584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd385be90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc60c000f80 tx=0x7fc60c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7709fa4783f6b184 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:09.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.200+0000 7fc5fe7fc640 1 -- 172.21.15.92:0/1798351584 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c040040 con 0x55bdd34801b0 2024-09-21T07:14:09.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.200+0000 7fc5fe7fc640 1 -- 172.21.15.92:0/1798351584 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc60c051020 con 0x55bdd34801b0 2024-09-21T07:14:09.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.200+0000 7fc5fe7fc640 1 -- 172.21.15.92:0/1798351584 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c036040 con 0x55bdd34801b0 2024-09-21T07:14:09.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.202+0000 7fc62177c740 1 -- 172.21.15.92:0/1798351584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 msgr2=0x55bdd385be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:09.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.202+0000 7fc62177c740 1 --2- 172.21.15.92:0/1798351584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd385be90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc60c000f80 tx=0x7fc60c005bd0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.202+0000 7fc62177c740 1 -- 172.21.15.92:0/1798351584 shutdown_connections 2024-09-21T07:14:09.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.202+0000 7fc62177c740 1 --2- 172.21.15.92:0/1798351584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd34a9070 0x55bdd38533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.202+0000 7fc62177c740 1 --2- 172.21.15.92:0/1798351584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 0x55bdd3867c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.202+0000 7fc62177c740 1 --2- 172.21.15.92:0/1798351584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd385be90 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.202+0000 7fc62177c740 1 -- 172.21.15.92:0/1798351584 >> 172.21.15.92:0/1798351584 conn(0x55bdd349d460 msgr2=0x55bdd385b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:09.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.202+0000 7fc62177c740 1 -- 172.21.15.92:0/1798351584 shutdown_connections 2024-09-21T07:14:09.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.202+0000 7fc62177c740 1 -- 172.21.15.92:0/1798351584 wait complete. 2024-09-21T07:14:09.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.203+0000 7fc62177c740 1 -- start start 2024-09-21T07:14:09.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.203+0000 7fc62177c740 1 Processor -- start 2024-09-21T07:14:09.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.204+0000 7fc62177c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd38609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.204+0000 7fc62177c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 0x55bdd3860f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.204+0000 7fc6197a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd38609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.204+0000 7fc62177c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd34a9070 0x55bdd38d6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.204+0000 7fc62177c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6141b87d0 con 0x55bdd34801b0 2024-09-21T07:14:09.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.204+0000 7fc62177c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc6141b8100 con 0x55bdd3488390 2024-09-21T07:14:09.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.204+0000 7fc6197a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd38609f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58052/0 (socket says 172.21.15.92:58052) 2024-09-21T07:14:09.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.204+0000 7fc6197a5640 1 -- 172.21.15.92:0/1105173314 learned_addr learned my addr 172.21.15.92:0/1105173314 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:09.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.204+0000 7fc62177c740 1 -- 172.21.15.92:0/1105173314 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6141b53f0 con 0x55bdd34a9070 2024-09-21T07:14:09.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.204+0000 7fc62177c740 10 client.0 _ll_register_callbacks cb 0x7fc60800a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:09.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.205+0000 7fc618fa4640 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 0x55bdd3860f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.205+0000 7fc618fa4640 1 -- 172.21.15.92:0/1105173314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd34a9070 msgr2=0x55bdd38d6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:09.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.205+0000 7fc618fa4640 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd34a9070 0x55bdd38d6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.205+0000 7fc618fa4640 1 -- 172.21.15.92:0/1105173314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 msgr2=0x55bdd38609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:09.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.205+0000 7fc618fa4640 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd38609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.205+0000 7fc618fa4640 1 -- 172.21.15.92:0/1105173314 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd38d70f0 con 0x55bdd3488390 2024-09-21T07:14:09.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.205+0000 7fc618fa4640 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 0x55bdd3860f30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc608012540 tx=0x7fc608004a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc7f2f46120b09c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:09.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.205+0000 7fc5f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:14:09.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.205+0000 7fc5f3fff640 1 -- 172.21.15.92:0/1105173314 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608004220 con 0x55bdd3488390 2024-09-21T07:14:09.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.206+0000 7fc5f3fff640 1 -- 172.21.15.92:0/1105173314 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc6080043c0 con 0x55bdd3488390 2024-09-21T07:14:09.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.206+0000 7fc62177c740 1 -- 172.21.15.92:0/1105173314 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc60c051020 con 0x55bdd3488390 2024-09-21T07:14:09.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.207+0000 7fc5f3fff640 1 -- 172.21.15.92:0/1105173314 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc608004c80 con 0x55bdd3488390 2024-09-21T07:14:09.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.207+0000 7fc62177c740 10 client.25319 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:09.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.207+0000 7fc62177c740 1 -- 172.21.15.92:0/1105173314 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bdd38d8330 con 0x55bdd3488390 2024-09-21T07:14:09.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.207+0000 7fc5f3fff640 1 -- 172.21.15.92:0/1105173314 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc60c051020 con 0x55bdd3488390 2024-09-21T07:14:09.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.207+0000 7fc5f3fff640 1 -- 172.21.15.92:0/1105173314 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc608031030 con 0x55bdd3488390 2024-09-21T07:14:09.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.208+0000 7fc62177c740 10 client.25319 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:09.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.208+0000 7fc62177c740 10 client.25319 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:14:09.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.208+0000 7fc62177c740 20 client.25319 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:09.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.208+0000 7fc62177c740 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55bdd343cda0 0x55bdd38daaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:09.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.208+0000 7fc62177c740 4 client.25319 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:14:09.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.208+0000 7fc62177c740 1 -- 172.21.15.92:0/1105173314 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bdd37c48a0 con 0x55bdd343cda0 2024-09-21T07:14:09.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.208+0000 7fc6197a5640 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55bdd343cda0 0x55bdd38daaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:09.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.209+0000 7fc5f3fff640 10 client.25319 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:14:09.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.209+0000 7fc6197a5640 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55bdd343cda0 0x55bdd38daaf0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=86b4a4b6e08355f8 server_cookie=322ae1fd720ac289 in_seq=0 out_seq=0 2024-09-21T07:14:09.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc5f3fff640 1 -- 172.21.15.92:0/1105173314 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bdd37c48a0 con 0x55bdd343cda0 2024-09-21T07:14:09.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc5f3fff640 10 client.25319 handle_command_reply: tid=0 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 client.25319 shutdown 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 -- 172.21.15.92:0/1105173314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 msgr2=0x55bdd3860f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 0x55bdd3860f30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc608012540 tx=0x7fc608004a90 comp rx=0 tx=0).stop 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 -- 172.21.15.92:0/1105173314 shutdown_connections 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bdd34a9070 0x55bdd38d6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bdd3488390 0x55bdd3860f30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55bdd343cda0 0x55bdd38daaf0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 --2- 172.21.15.92:0/1105173314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bdd34801b0 0x55bdd38609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 -- 172.21.15.92:0/1105173314 >> 172.21.15.92:0/1105173314 conn(0x55bdd349d460 msgr2=0x55bdd38533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc5f3fff640 0 client.25319 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:14:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 -- 172.21.15.92:0/1105173314 shutdown_connections 2024-09-21T07:14:09.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.210+0000 7fc62177c740 1 -- 172.21.15.92:0/1105173314 wait complete. 2024-09-21T07:14:09.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc62177c740 20 client.25319 trim_cache size 0 max 16384 2024-09-21T07:14:09.214 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:14:09.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6040b6790 msgr2=0x7fc6040b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc61b208640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6040b6790 0x7fc6040b8ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc6000e51f0 tx=0x7fc6000a9e30 comp rx=0 tx=0).stop 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6141030f0 msgr2=0x7fc6141a0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc61b208640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6141030f0 0x7fc6141a0f60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc6000058c0 tx=0x7fc60000ee50 comp rx=0 tx=0).stop 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 shutdown_connections 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc61b208640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6040b6790 0x7fc6040b8ca0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc61b208640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc614107be0 0x7fc6141a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc61b208640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6141030f0 0x7fc6141a0f60 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc61b208640 1 --2- 172.21.15.92:0/1551576779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6141027a0 0x7fc6141a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.211+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 >> 172.21.15.92:0/1551576779 conn(0x7fc614079730 msgr2=0x7fc6141055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.212+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 shutdown_connections 2024-09-21T07:14:09.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:09.212+0000 7fc61b208640 1 -- 172.21.15.92:0/1551576779 wait complete. 2024-09-21T07:14:09.566 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:10.149 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:14:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:10 smithi092 ceph-mon[30987]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-21T07:14:10.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.743+0000 7fde66478640 1 -- 172.21.15.92:0/2004082323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60109e10 msgr2=0x7fde60110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:10.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.743+0000 7fde66478640 1 --2- 172.21.15.92:0/2004082323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60109e10 0x7fde60110640 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fde58009ca0 tx=0x7fde5802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.743+0000 7fde66478640 1 -- 172.21.15.92:0/2004082323 shutdown_connections 2024-09-21T07:14:10.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.743+0000 7fde66478640 1 --2- 172.21.15.92:0/2004082323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60109e10 0x7fde60110640 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.743+0000 7fde66478640 1 --2- 172.21.15.92:0/2004082323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde601094c0 0x7fde601098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.743+0000 7fde66478640 1 --2- 172.21.15.92:0/2004082323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde60101f80 0x7fde60102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.743+0000 7fde66478640 1 -- 172.21.15.92:0/2004082323 >> 172.21.15.92:0/2004082323 conn(0x7fde60079f50 msgr2=0x7fde6007a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.743+0000 7fde66478640 1 -- 172.21.15.92:0/2004082323 shutdown_connections 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.743+0000 7fde66478640 1 -- 172.21.15.92:0/2004082323 wait complete. 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.744+0000 7fde66478640 1 Processor -- start 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.744+0000 7fde66478640 1 -- start start 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.744+0000 7fde66478640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60101f80 0x7fde6019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.744+0000 7fde66478640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde601094c0 0x7fde6019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.744+0000 7fde66478640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde60109e10 0x7fde6019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.744+0000 7fde66478640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fde601139d0 con 0x7fde60101f80 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.744+0000 7fde66478640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fde60113850 con 0x7fde60109e10 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.744+0000 7fde66478640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde60113b50 con 0x7fde601094c0 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.744+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60101f80 0x7fde6019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60101f80 0x7fde6019a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49432/0 (socket says 172.21.15.92:49432) 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5ffff640 1 -- 172.21.15.92:0/3955994991 learned_addr learned my addr 172.21.15.92:0/3955994991 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde64a15640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde60109e10 0x7fde6019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde601094c0 0x7fde6019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5ffff640 1 -- 172.21.15.92:0/3955994991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde601094c0 msgr2=0x7fde6019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5ffff640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde601094c0 0x7fde6019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5ffff640 1 -- 172.21.15.92:0/3955994991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde60109e10 msgr2=0x7fde6019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5ffff640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde60109e10 0x7fde6019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5ffff640 1 -- 172.21.15.92:0/3955994991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde601a0330 con 0x7fde60101f80 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5ffff640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60101f80 0x7fde6019a3c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fde5000d770 tx=0x7fde5000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5d7fa640 1 -- 172.21.15.92:0/3955994991 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50017070 con 0x7fde60101f80 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde66478640 1 -- 172.21.15.92:0/3955994991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde601a0620 con 0x7fde60101f80 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.745+0000 7fde5d7fa640 1 -- 172.21.15.92:0/3955994991 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde500054b0 con 0x7fde60101f80 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.746+0000 7fde5d7fa640 1 -- 172.21.15.92:0/3955994991 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50004c60 con 0x7fde60101f80 2024-09-21T07:14:10.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.746+0000 7fde66478640 1 -- 172.21.15.92:0/3955994991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde601a6d80 con 0x7fde60101f80 2024-09-21T07:14:10.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.749+0000 7fde6c9ec740 1 Processor -- start 2024-09-21T07:14:10.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.749+0000 7fde6c9ec740 1 -- start start 2024-09-21T07:14:10.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.749+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7564840 0x55a1f7909000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.749+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 0x55a1f7909540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.749+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 0x55a1f7911200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.749+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a1f7881b90 con 0x55a1f7543b60 2024-09-21T07:14:10.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.749+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a1f7870fc0 con 0x55a1f7564840 2024-09-21T07:14:10.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.749+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a1f7874dd0 con 0x55a1f753b980 2024-09-21T07:14:10.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.749+0000 7fde5d7fa640 1 -- 172.21.15.92:0/3955994991 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7fde50010460 con 0x7fde60101f80 2024-09-21T07:14:10.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.750+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 0x55a1f7911200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.750+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 0x55a1f7911200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49438/0 (socket says 172.21.15.92:49438) 2024-09-21T07:14:10.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.750+0000 7fde5f7fe640 1 -- 172.21.15.92:0/1035711431 learned_addr learned my addr 172.21.15.92:0/1035711431 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:10.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.750+0000 7fde64a15640 1 --2- 172.21.15.92:0/1035711431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7564840 0x55a1f7909000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.750+0000 7fde5ffff640 1 --2- 172.21.15.92:0/1035711431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 0x55a1f7909540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.750+0000 7fde5f7fe640 1 -- 172.21.15.92:0/1035711431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 msgr2=0x55a1f7909540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:10.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.750+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/1035711431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 0x55a1f7909540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.750+0000 7fde5f7fe640 1 -- 172.21.15.92:0/1035711431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7564840 msgr2=0x55a1f7909000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:10.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.750+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/1035711431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7564840 0x55a1f7909000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.750+0000 7fde5f7fe640 1 -- 172.21.15.92:0/1035711431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f77f8060 con 0x55a1f7543b60 2024-09-21T07:14:10.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.751+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/1035711431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 0x55a1f7911200 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fde5400bcb0 tx=0x7fde540327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf2c68f05cc0369 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:10.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.751+0000 7fde467fc640 1 -- 172.21.15.92:0/1035711431 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5403e480 con 0x55a1f7543b60 2024-09-21T07:14:10.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.752+0000 7fde467fc640 1 -- 172.21.15.92:0/1035711431 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde5403eab0 con 0x55a1f7543b60 2024-09-21T07:14:10.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.752+0000 7fde467fc640 1 -- 172.21.15.92:0/1035711431 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde54033be0 con 0x55a1f7543b60 2024-09-21T07:14:10.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.752+0000 7fde5d7fa640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde480b6710 0x7fde480b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.753+0000 7fde5d7fa640 1 -- 172.21.15.92:0/3955994991 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fde500e7450 con 0x7fde60101f80 2024-09-21T07:14:10.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.753+0000 7fde6c9ec740 1 -- 172.21.15.92:0/1035711431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 msgr2=0x55a1f7911200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:10.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.753+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/1035711431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 0x55a1f7911200 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fde5400bcb0 tx=0x7fde540327b0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.753+0000 7fde64a15640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde480b6710 0x7fde480b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.753+0000 7fde6c9ec740 1 -- 172.21.15.92:0/1035711431 shutdown_connections 2024-09-21T07:14:10.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.753+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/1035711431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 0x55a1f7911200 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.753+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/1035711431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 0x55a1f7909540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.753+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/1035711431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7564840 0x55a1f7909000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.753+0000 7fde6c9ec740 1 -- 172.21.15.92:0/1035711431 >> 172.21.15.92:0/1035711431 conn(0x55a1f7558990 msgr2=0x55a1f790b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:10.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.753+0000 7fde64a15640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde480b6710 0x7fde480b8c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde58006010 tx=0x7fde58009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:10.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.754+0000 7fde6c9ec740 1 -- 172.21.15.92:0/1035711431 shutdown_connections 2024-09-21T07:14:10.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.754+0000 7fde6c9ec740 1 -- 172.21.15.92:0/1035711431 wait complete. 2024-09-21T07:14:10.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.754+0000 7fde6c9ec740 1 -- start start 2024-09-21T07:14:10.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.754+0000 7fde6c9ec740 1 Processor -- start 2024-09-21T07:14:10.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 0x55a1f7917850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 0x55a1f7917e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7564840 0x55a1f791ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a1f76d27a0 con 0x55a1f7543b60 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a1f78160a0 con 0x55a1f7564840 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a1f7911c30 con 0x55a1f753b980 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 0x55a1f7917850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 0x55a1f7917850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:57946/0 (socket says 172.21.15.92:57946) 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde5ffff640 1 -- 172.21.15.92:0/3744797698 learned_addr learned my addr 172.21.15.92:0/3744797698 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 0x55a1f7917e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.755+0000 7fde64a15640 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7564840 0x55a1f791ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.756+0000 7fde6c9ec740 10 client.0 _ll_register_callbacks cb 0x55a1f77f33c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.756+0000 7fde5ffff640 1 -- 172.21.15.92:0/3744797698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7564840 msgr2=0x55a1f791ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:10.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.756+0000 7fde5ffff640 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7564840 0x55a1f791ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.756+0000 7fde5ffff640 1 -- 172.21.15.92:0/3744797698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 msgr2=0x55a1f7917e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.756+0000 7fde5ffff640 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 0x55a1f7917e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.756+0000 7fde5ffff640 1 -- 172.21.15.92:0/3744797698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f7804880 con 0x55a1f753b980 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.756+0000 7fde5ffff640 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 0x55a1f7917850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fde500e47d0 tx=0x7fde500a9330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92eb112cc1bf6041 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.756+0000 7fde3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.756+0000 7fde3f7fe640 1 -- 172.21.15.92:0/3744797698 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50020070 con 0x55a1f753b980 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.756+0000 7fde3f7fe640 1 -- 172.21.15.92:0/3744797698 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fde500e49f0 con 0x55a1f753b980 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde6c9ec740 1 -- 172.21.15.92:0/3744797698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde5403eab0 con 0x55a1f753b980 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde3f7fe640 1 -- 172.21.15.92:0/3744797698 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fde500a8ce0 con 0x55a1f753b980 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde6c9ec740 10 client.25459 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:10.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde6c9ec740 1 -- 172.21.15.92:0/3744797698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a1f75deb90 con 0x55a1f753b980 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde3f7fe640 1 -- 172.21.15.92:0/3744797698 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde5403eab0 con 0x55a1f753b980 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde3f7fe640 1 -- 172.21.15.92:0/3744797698 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fde500a8790 con 0x55a1f753b980 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde6c9ec740 10 client.25459 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde6c9ec740 10 client.25459 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde6c9ec740 20 client.25459 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a1f75231c0 0x55a1f7929210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.757+0000 7fde6c9ec740 4 client.25459 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.758+0000 7fde6c9ec740 1 -- 172.21.15.92:0/3744797698 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1f7883ae0 con 0x55a1f75231c0 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.758+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a1f75231c0 0x55a1f7929210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.758+0000 7fde3f7fe640 10 client.25459 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:10.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.758+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a1f75231c0 0x55a1f7929210 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34e31fb202dff900 server_cookie=810565a38e945ba6 in_seq=0 out_seq=0 2024-09-21T07:14:10.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.759+0000 7fde3f7fe640 1 -- 172.21.15.92:0/3744797698 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1f7883ae0 con 0x55a1f75231c0 2024-09-21T07:14:10.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.759+0000 7fde3f7fe640 10 client.25459 handle_command_reply: tid=0 2024-09-21T07:14:10.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.759+0000 7fde6c9ec740 1 client.25459 shutdown 2024-09-21T07:14:10.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.759+0000 7fde6c9ec740 1 -- 172.21.15.92:0/3744797698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 msgr2=0x55a1f7917850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:10.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.759+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 0x55a1f7917850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fde500e47d0 tx=0x7fde500a9330 comp rx=0 tx=0).stop 2024-09-21T07:14:10.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.759+0000 7fde6c9ec740 1 -- 172.21.15.92:0/3744797698 shutdown_connections 2024-09-21T07:14:10.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.760+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a1f75231c0 0x55a1f7929210 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.760+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7564840 0x55a1f791ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.760+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7543b60 0x55a1f7917e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.760+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/3744797698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f753b980 0x55a1f7917850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.760+0000 7fde6c9ec740 1 -- 172.21.15.92:0/3744797698 >> 172.21.15.92:0/3744797698 conn(0x55a1f7558990 msgr2=0x55a1f7908450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:10.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.760+0000 7fde3f7fe640 0 client.25459 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:10.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.760+0000 7fde6c9ec740 1 -- 172.21.15.92:0/3744797698 shutdown_connections 2024-09-21T07:14:10.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.760+0000 7fde6c9ec740 1 -- 172.21.15.92:0/3744797698 wait complete. 2024-09-21T07:14:10.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.760+0000 7fde6c9ec740 20 client.25459 trim_cache size 0 max 16384 2024-09-21T07:14:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.792+0000 7fde6c9ec740 1 Processor -- start 2024-09-21T07:14:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.792+0000 7fde6c9ec740 1 -- start start 2024-09-21T07:14:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.792+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7543b60 0x55a1f7923c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.792+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f7564840 0x55a1f7916890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.792+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f74f8570 0x55a1f7912800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.792+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c00ff50 con 0x55a1f74f8570 2024-09-21T07:14:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.792+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c011a90 con 0x55a1f7543b60 2024-09-21T07:14:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.792+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c010620 con 0x55a1f7564840 2024-09-21T07:14:10.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f7564840 0x55a1f7916890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f7564840 0x55a1f7916890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:57956/0 (socket says 172.21.15.92:57956) 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde5f7fe640 1 -- 172.21.15.92:0/2378694969 learned_addr learned my addr 172.21.15.92:0/2378694969 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde5ffff640 1 --2- 172.21.15.92:0/2378694969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7543b60 0x55a1f7923c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde64a15640 1 --2- 172.21.15.92:0/2378694969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f74f8570 0x55a1f7912800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde5f7fe640 1 -- 172.21.15.92:0/2378694969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7543b60 msgr2=0x55a1f7923c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2378694969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7543b60 0x55a1f7923c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde5f7fe640 1 -- 172.21.15.92:0/2378694969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f74f8570 msgr2=0x55a1f7912800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2378694969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f74f8570 0x55a1f7912800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde5f7fe640 1 -- 172.21.15.92:0/2378694969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f79096e0 con 0x55a1f7564840 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde64a15640 1 --2- 172.21.15.92:0/2378694969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f74f8570 0x55a1f7912800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:14:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2378694969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f7564840 0x55a1f7916890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fde5400bcb0 tx=0x7fde5400b4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d67cfa57743e904b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:10.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.793+0000 7fde45ffb640 1 -- 172.21.15.92:0/2378694969 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde54033650 con 0x55a1f7564840 2024-09-21T07:14:10.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.794+0000 7fde45ffb640 1 -- 172.21.15.92:0/2378694969 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde54033d00 con 0x55a1f7564840 2024-09-21T07:14:10.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.794+0000 7fde45ffb640 1 -- 172.21.15.92:0/2378694969 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde540048c0 con 0x55a1f7564840 2024-09-21T07:14:10.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.795+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2378694969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f7564840 msgr2=0x55a1f7916890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.795+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/2378694969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f7564840 0x55a1f7916890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fde5400bcb0 tx=0x7fde5400b4c0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.795+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2378694969 shutdown_connections 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.795+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/2378694969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f74f8570 0x55a1f7912800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.795+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/2378694969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f7564840 0x55a1f7916890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.795+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/2378694969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7543b60 0x55a1f7923c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.795+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2378694969 >> 172.21.15.92:0/2378694969 conn(0x55a1f7558990 msgr2=0x55a1f7918b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.795+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2378694969 shutdown_connections 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.795+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2378694969 wait complete. 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.796+0000 7fde6c9ec740 1 -- start start 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.796+0000 7fde6c9ec740 1 Processor -- start 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f74f8570 0x55a1f7920950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7543b60 0x55a1f7920e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde6c9ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7564840 0x55a1f7993c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f74f8570 0x55a1f7920950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c0113c0 con 0x55a1f7564840 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c010cf0 con 0x55a1f7543b60 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde6c9ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c00df30 con 0x55a1f74f8570 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f74f8570 0x55a1f7920950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:57960/0 (socket says 172.21.15.92:57960) 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde5ffff640 1 -- 172.21.15.92:0/2503348144 learned_addr learned my addr 172.21.15.92:0/2503348144 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde64a15640 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7564840 0x55a1f7993c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7543b60 0x55a1f7920e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde5ffff640 1 -- 172.21.15.92:0/2503348144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7543b60 msgr2=0x55a1f7920e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde5ffff640 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7543b60 0x55a1f7920e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde5ffff640 1 -- 172.21.15.92:0/2503348144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7564840 msgr2=0x55a1f7993c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:10.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde5ffff640 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7564840 0x55a1f7993c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde5ffff640 1 -- 172.21.15.92:0/2503348144 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f7912ee0 con 0x55a1f74f8570 2024-09-21T07:14:10.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.797+0000 7fde6c9ec740 10 client.0 _ll_register_callbacks cb 0x7fde5000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:10.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.798+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2503348144 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde54033d00 con 0x55a1f74f8570 2024-09-21T07:14:10.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.798+0000 7fde64a15640 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7564840 0x55a1f7993c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:10.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.798+0000 7fde5ffff640 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f74f8570 0x55a1f7920950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde500b67d0 tx=0x7fde50005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b83f73dfbab9664 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:10.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.798+0000 7fde3f7fe640 10 client.25465 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:14:10.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.798+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2503348144 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50020070 con 0x55a1f74f8570 2024-09-21T07:14:10.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.798+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2503348144 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fde500d0220 con 0x55a1f74f8570 2024-09-21T07:14:10.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.798+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2503348144 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fde500ac5b0 con 0x55a1f74f8570 2024-09-21T07:14:10.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.798+0000 7fde6c9ec740 10 client.25465 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:10.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.798+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2503348144 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a1f7995050 con 0x55a1f74f8570 2024-09-21T07:14:10.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.799+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2503348144 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fde5005c0a0 con 0x55a1f74f8570 2024-09-21T07:14:10.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.799+0000 7fde6c9ec740 10 client.25465 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:10.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.799+0000 7fde6c9ec740 10 client.25465 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:14:10.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.799+0000 7fde6c9ec740 20 client.25465 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:10.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.799+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a1f7995670 0x55a1f7997b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:10.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.799+0000 7fde6c9ec740 4 client.25465 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T07:14:10.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.799+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2503348144 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x55a1f787f590 con 0x55a1f7995670 2024-09-21T07:14:10.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.799+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a1f7995670 0x55a1f7997b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:10.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.800+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a1f7995670 0x55a1f7997b80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d257627a04aa4d83 server_cookie=e9bd8eb710d6a7cb in_seq=0 out_seq=0 2024-09-21T07:14:10.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.800+0000 7fde3f7fe640 10 client.25465 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:10.804 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:10.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2503348144 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a1f787f590 con 0x55a1f7995670 2024-09-21T07:14:10.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde3f7fe640 10 client.25465 handle_command_reply: tid=0 2024-09-21T07:14:10.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 client.25465 shutdown 2024-09-21T07:14:10.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2503348144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f74f8570 msgr2=0x55a1f7920950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:10.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f74f8570 0x55a1f7920950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde500b67d0 tx=0x7fde50005bb0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2503348144 shutdown_connections 2024-09-21T07:14:10.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a1f7995670 0x55a1f7997b80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1f7564840 0x55a1f7993c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1f7543b60 0x55a1f7920e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 --2- 172.21.15.92:0/2503348144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a1f74f8570 0x55a1f7920950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde3f7fe640 0 client.25465 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:10.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2503348144 >> 172.21.15.92:0/2503348144 conn(0x55a1f7558990 msgr2=0x55a1f7916660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:10.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2503348144 shutdown_connections 2024-09-21T07:14:10.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.812+0000 7fde6c9ec740 1 -- 172.21.15.92:0/2503348144 wait complete. 2024-09-21T07:14:10.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.813+0000 7fde6c9ec740 20 client.25465 trim_cache size 0 max 16384 2024-09-21T07:14:10.815 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:14:10.815 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-09-21T07:14:10.815 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24649, 2024-09-21T07:14:10.815 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 2, 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "92a69dac": { 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 2, 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 134.5, 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:14:10.816 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-21T07:14:10.817 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:14:10.817 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:10.817 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:10.817 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:10.817 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:10.817 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:10.817 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:14:10.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.813+0000 7fde66478640 1 -- 172.21.15.92:0/3955994991 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde480b6710 msgr2=0x7fde480b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:10.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.813+0000 7fde66478640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde480b6710 0x7fde480b8c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde58006010 tx=0x7fde58009360 comp rx=0 tx=0).stop 2024-09-21T07:14:10.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.813+0000 7fde66478640 1 -- 172.21.15.92:0/3955994991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60101f80 msgr2=0x7fde6019a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:10.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.813+0000 7fde66478640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60101f80 0x7fde6019a3c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fde5000d770 tx=0x7fde5000dc30 comp rx=0 tx=0).stop 2024-09-21T07:14:10.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.814+0000 7fde66478640 1 -- 172.21.15.92:0/3955994991 shutdown_connections 2024-09-21T07:14:10.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.814+0000 7fde66478640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fde480b6710 0x7fde480b8c20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.814+0000 7fde66478640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fde60109e10 0x7fde6019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.814+0000 7fde66478640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde601094c0 0x7fde6019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.814+0000 7fde66478640 1 --2- 172.21.15.92:0/3955994991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60101f80 0x7fde6019a3c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:10.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.814+0000 7fde66478640 1 -- 172.21.15.92:0/3955994991 >> 172.21.15.92:0/3955994991 conn(0x7fde60079f50 msgr2=0x7fde601054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:10.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.814+0000 7fde66478640 1 -- 172.21.15.92:0/3955994991 shutdown_connections 2024-09-21T07:14:10.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:10.814+0000 7fde66478640 1 -- 172.21.15.92:0/3955994991 wait complete. 2024-09-21T07:14:11.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:10 smithi175 ceph-mon[34064]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-21T07:14:11.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:10 smithi169 ceph-mon[33705]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-21T07:14:11.521 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '92a69dac', quiesce took 6.4 seconds. Will release after: 8.1 2024-09-21T07:14:12.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.093+0000 7f46f15b1640 1 -- 172.21.15.92:0/2121262462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ec102a60 msgr2=0x7f46ec102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:12.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.093+0000 7f46f15b1640 1 --2- 172.21.15.92:0/2121262462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ec102a60 0x7f46ec102e70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009900 tx=0x7f46dc02a410 comp rx=0 tx=0).stop 2024-09-21T07:14:12.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.093+0000 7f46f15b1640 1 -- 172.21.15.92:0/2121262462 shutdown_connections 2024-09-21T07:14:12.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.093+0000 7f46f15b1640 1 --2- 172.21.15.92:0/2121262462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec108cf0 0x7f46ec10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.093+0000 7f46f15b1640 1 --2- 172.21.15.92:0/2121262462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46ec1083a0 0x7f46ec1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.093+0000 7f46f15b1640 1 --2- 172.21.15.92:0/2121262462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ec102a60 0x7f46ec102e70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.093+0000 7f46f15b1640 1 -- 172.21.15.92:0/2121262462 >> 172.21.15.92:0/2121262462 conn(0x7f46ec079730 msgr2=0x7f46ec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.093+0000 7f46f15b1640 1 -- 172.21.15.92:0/2121262462 shutdown_connections 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.093+0000 7f46f15b1640 1 -- 172.21.15.92:0/2121262462 wait complete. 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.094+0000 7f46f15b1640 1 Processor -- start 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.094+0000 7f46f15b1640 1 -- start start 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46f15b1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46ec102a60 0x7f46ec199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46f15b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ec1083a0 0x7f46ec1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46f15b1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec108cf0 0x7f46ec19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46eaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46ec102a60 0x7f46ec199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46ea7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ec1083a0 0x7f46ec1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46ea7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ec1083a0 0x7f46ec1998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49472/0 (socket says 172.21.15.92:49472) 2024-09-21T07:14:12.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46eaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46ec102a60 0x7f46ec199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:41872/0 (socket says 172.21.15.92:41872) 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46eaffd640 1 -- 172.21.15.92:0/231015292 learned_addr learned my addr 172.21.15.92:0/231015292 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec112810 con 0x7f46ec1083a0 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec112690 con 0x7f46ec102a60 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec112990 con 0x7f46ec108cf0 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.095+0000 7f46eb7fe640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec108cf0 0x7f46ec19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46eaffd640 1 -- 172.21.15.92:0/231015292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec108cf0 msgr2=0x7f46ec19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46eaffd640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec108cf0 0x7f46ec19eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46eaffd640 1 -- 172.21.15.92:0/231015292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ec1083a0 msgr2=0x7f46ec1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46eaffd640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ec1083a0 0x7f46ec1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46eaffd640 1 -- 172.21.15.92:0/231015292 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec19f2b0 con 0x7f46ec102a60 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46ea7fc640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ec1083a0 0x7f46ec1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46eb7fe640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec108cf0 0x7f46ec19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46eaffd640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46ec102a60 0x7f46ec199340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009230 tx=0x7f46dc004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:12.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46d3fff640 1 -- 172.21.15.92:0/231015292 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc03f030 con 0x7f46ec102a60 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ec19f540 con 0x7f46ec102a60 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ec1a5d00 con 0x7f46ec102a60 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46d3fff640 1 -- 172.21.15.92:0/231015292 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46dc003a80 con 0x7f46ec102a60 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.096+0000 7f46d3fff640 1 -- 172.21.15.92:0/231015292 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc035070 con 0x7f46ec102a60 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.099+0000 7f46f7b25740 1 Processor -- start 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.099+0000 7f46f7b25740 1 -- start start 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.099+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f2b070 0x563f032d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.099+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f021b0 0x563f032d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.099+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.099+0000 7f46f7b25740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563f03248ea0 con 0x563f02f0a390 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.099+0000 7f46f7b25740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563f032382d0 con 0x563f02f2b070 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.099+0000 7f46f7b25740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563f0323c0e0 con 0x563f02f021b0 2024-09-21T07:14:12.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.100+0000 7f46ea7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.100+0000 7f46ea7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032d3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49478/0 (socket says 172.21.15.92:49478) 2024-09-21T07:14:12.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.100+0000 7f46ea7fc640 1 -- 172.21.15.92:0/894243472 learned_addr learned my addr 172.21.15.92:0/894243472 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:12.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.100+0000 7f46ea7fc640 1 -- 172.21.15.92:0/894243472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f021b0 msgr2=0x563f032d2be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:14:12.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.100+0000 7f46ea7fc640 1 --2- 172.21.15.92:0/894243472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f021b0 0x563f032d2be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.100+0000 7f46ea7fc640 1 -- 172.21.15.92:0/894243472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f2b070 msgr2=0x563f032d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:12.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.100+0000 7f46ea7fc640 1 --2- 172.21.15.92:0/894243472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f2b070 0x563f032d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.100+0000 7f46ea7fc640 1 -- 172.21.15.92:0/894243472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f02f96650 con 0x563f02f0a390 2024-09-21T07:14:12.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.101+0000 7f46ea7fc640 1 --2- 172.21.15.92:0/894243472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032d3120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f46e0010480 tx=0x7f46e0010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ae50f843d4a24d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:12.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.101+0000 7f46d3fff640 1 -- 172.21.15.92:0/231015292 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7f46dc042030 con 0x7f46ec102a60 2024-09-21T07:14:12.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.101+0000 7f46d17fa640 1 -- 172.21.15.92:0/894243472 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0011760 con 0x563f02f0a390 2024-09-21T07:14:12.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.101+0000 7f46d17fa640 1 -- 172.21.15.92:0/894243472 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46e0011d90 con 0x563f02f0a390 2024-09-21T07:14:12.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.101+0000 7f46d17fa640 1 -- 172.21.15.92:0/894243472 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e001a380 con 0x563f02f0a390 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.102+0000 7f46d3fff640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f46d40b6710 0x7f46d40b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.102+0000 7f46d3fff640 1 -- 172.21.15.92:0/231015292 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f46dc1083a0 con 0x7f46ec102a60 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.102+0000 7f46f7b25740 1 -- 172.21.15.92:0/894243472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 msgr2=0x563f032d3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.102+0000 7f46f7b25740 1 --2- 172.21.15.92:0/894243472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032d3120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f46e0010480 tx=0x7f46e0010940 comp rx=0 tx=0).stop 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.103+0000 7f46eb7fe640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f46d40b6710 0x7f46d40b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.103+0000 7f46f7b25740 1 -- 172.21.15.92:0/894243472 shutdown_connections 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.103+0000 7f46f7b25740 1 --2- 172.21.15.92:0/894243472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032d3120 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.103+0000 7f46f7b25740 1 --2- 172.21.15.92:0/894243472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f021b0 0x563f032d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.103+0000 7f46f7b25740 1 --2- 172.21.15.92:0/894243472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f2b070 0x563f032d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.103+0000 7f46f7b25740 1 -- 172.21.15.92:0/894243472 >> 172.21.15.92:0/894243472 conn(0x563f02f1f460 msgr2=0x563f032d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.103+0000 7f46f7b25740 1 -- 172.21.15.92:0/894243472 shutdown_connections 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.103+0000 7f46f7b25740 1 -- 172.21.15.92:0/894243472 wait complete. 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.103+0000 7f46eb7fe640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f46d40b6710 0x7f46d40b8c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009fd0 tx=0x7f46e4009920 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:12.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.104+0000 7f46f7b25740 1 -- start start 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.104+0000 7f46f7b25740 1 Processor -- start 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.104+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032e6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.104+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032e7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.104+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f2b070 0x563f032ec550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.104+0000 7f46f7b25740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563f03099700 con 0x563f02f0a390 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.104+0000 7f46f7b25740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563f031d3160 con 0x563f02f021b0 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.104+0000 7f46f7b25740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563f032e0e80 con 0x563f02f2b070 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46ea7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46ea7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032e7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49490/0 (socket says 172.21.15.92:49490) 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46ea7fc640 1 -- 172.21.15.92:0/2050209243 learned_addr learned my addr 172.21.15.92:0/2050209243 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46eaffd640 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032e6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46eb7fe640 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f2b070 0x563f032ec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46ea7fc640 1 -- 172.21.15.92:0/2050209243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f2b070 msgr2=0x563f032ec550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:12.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46ea7fc640 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f2b070 0x563f032ec550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46ea7fc640 1 -- 172.21.15.92:0/2050209243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 msgr2=0x563f032e6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46ea7fc640 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032e6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46ea7fc640 1 -- 172.21.15.92:0/2050209243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f03200c90 con 0x563f02f0a390 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46ea7fc640 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032e7530 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f46e0000c00 tx=0x7f46e000efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55df9e6ec0b7f7c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46ceff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.105+0000 7f46f7b25740 10 client.0 _ll_register_callbacks cb 0x563f031ec9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.106+0000 7f46f7b25740 1 -- 172.21.15.92:0/2050209243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46e0011d90 con 0x563f02f0a390 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.106+0000 7f46ceff5640 1 -- 172.21.15.92:0/2050209243 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0005240 con 0x563f02f0a390 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.106+0000 7f46ceff5640 1 -- 172.21.15.92:0/2050209243 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f46e00053e0 con 0x563f02f0a390 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.106+0000 7f46ceff5640 1 -- 172.21.15.92:0/2050209243 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f46e0005600 con 0x563f02f0a390 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.106+0000 7f46f7b25740 10 client.16002 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.106+0000 7f46f7b25740 1 -- 172.21.15.92:0/2050209243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563f032f5160 con 0x563f02f0a390 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.107+0000 7f46ceff5640 1 -- 172.21.15.92:0/2050209243 <== mon.0 v2:172.21.15.92:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f46e002d030 con 0x563f02f0a390 2024-09-21T07:14:12.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.107+0000 7f46f7b25740 10 client.16002 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.107+0000 7f46f7b25740 10 client.16002 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.107+0000 7f46f7b25740 20 client.16002 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.107+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x563f02ee99f0 0x563f032f8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.107+0000 7f46f7b25740 4 client.16002 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.107+0000 7f46f7b25740 1 -- 172.21.15.92:0/2050209243 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f0324adf0 con 0x563f02ee99f0 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.107+0000 7f46eaffd640 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x563f02ee99f0 0x563f032f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.108+0000 7f46ceff5640 10 client.16002 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.108+0000 7f46eaffd640 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x563f02ee99f0 0x563f032f8520 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0af2ca1167bfb8d server_cookie=8483f14ad29f3281 in_seq=0 out_seq=0 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.108+0000 7f46ceff5640 1 -- 172.21.15.92:0/2050209243 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f0324adf0 con 0x563f02ee99f0 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.108+0000 7f46ceff5640 10 client.16002 handle_command_reply: tid=0 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 client.16002 shutdown 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 -- 172.21.15.92:0/2050209243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 msgr2=0x563f032e7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032e7530 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f46e0000c00 tx=0x7f46e000efb0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 -- 172.21.15.92:0/2050209243 shutdown_connections 2024-09-21T07:14:12.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x563f02ee99f0 0x563f032f8520 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46ceff5640 0 client.16002 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:14:12.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f2b070 0x563f032ec550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f032e7530 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2050209243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032e6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 -- 172.21.15.92:0/2050209243 >> 172.21.15.92:0/2050209243 conn(0x563f02f1f460 msgr2=0x563f032d5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:12.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 -- 172.21.15.92:0/2050209243 shutdown_connections 2024-09-21T07:14:12.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.109+0000 7f46f7b25740 1 -- 172.21.15.92:0/2050209243 wait complete. 2024-09-21T07:14:12.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.110+0000 7f46f7b25740 20 client.16002 trim_cache size 0 max 16384 2024-09-21T07:14:12.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.134+0000 7f46f7b25740 1 Processor -- start 2024-09-21T07:14:12.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.134+0000 7f46f7b25740 1 -- start start 2024-09-21T07:14:12.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02ee99f0 0x563f032e7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46eaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02ee99f0 0x563f032e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46eaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02ee99f0 0x563f032e7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49496/0 (socket says 172.21.15.92:49496) 2024-09-21T07:14:12.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f0a390 0x563f032d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46eaffd640 1 -- 172.21.15.92:0/767584114 learned_addr learned my addr 172.21.15.92:0/767584114 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:12.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46f7b25740 1 -- 172.21.15.92:0/767584114 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec1aecb0 con 0x563f02ee99f0 2024-09-21T07:14:12.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46f7b25740 1 -- 172.21.15.92:0/767584114 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec1b07f0 con 0x563f02f021b0 2024-09-21T07:14:12.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46f7b25740 1 -- 172.21.15.92:0/767584114 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec1af380 con 0x563f02f0a390 2024-09-21T07:14:12.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46ea7fc640 1 --2- 172.21.15.92:0/767584114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46eaffd640 1 -- 172.21.15.92:0/767584114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f0a390 msgr2=0x563f032d01e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:14:12.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46eaffd640 1 --2- 172.21.15.92:0/767584114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f0a390 0x563f032d01e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46eaffd640 1 -- 172.21.15.92:0/767584114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 msgr2=0x563f032cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:12.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46eaffd640 1 --2- 172.21.15.92:0/767584114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46eaffd640 1 -- 172.21.15.92:0/767584114 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f032e0910 con 0x563f02ee99f0 2024-09-21T07:14:12.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.135+0000 7f46ea7fc640 1 --2- 172.21.15.92:0/767584114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:14:12.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.136+0000 7f46eaffd640 1 --2- 172.21.15.92:0/767584114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02ee99f0 0x563f032e7640 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f46dc105d50 tx=0x7f46dc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fec4f86470184d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:12.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.136+0000 7f46d0ff9640 1 -- 172.21.15.92:0/767584114 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc049040 con 0x563f02ee99f0 2024-09-21T07:14:12.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.136+0000 7f46d0ff9640 1 -- 172.21.15.92:0/767584114 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46dc0d7700 con 0x563f02ee99f0 2024-09-21T07:14:12.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.136+0000 7f46d0ff9640 1 -- 172.21.15.92:0/767584114 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0ca000 con 0x563f02ee99f0 2024-09-21T07:14:12.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.137+0000 7f46f7b25740 1 -- 172.21.15.92:0/767584114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02ee99f0 msgr2=0x563f032e7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:12.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.137+0000 7f46f7b25740 1 --2- 172.21.15.92:0/767584114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02ee99f0 0x563f032e7640 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f46dc105d50 tx=0x7f46dc02a410 comp rx=0 tx=0).stop 2024-09-21T07:14:12.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.138+0000 7f46f7b25740 1 -- 172.21.15.92:0/767584114 shutdown_connections 2024-09-21T07:14:12.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.138+0000 7f46f7b25740 1 --2- 172.21.15.92:0/767584114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02f0a390 0x563f032d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.138+0000 7f46f7b25740 1 --2- 172.21.15.92:0/767584114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.138+0000 7f46f7b25740 1 --2- 172.21.15.92:0/767584114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02ee99f0 0x563f032e7640 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.138+0000 7f46f7b25740 1 -- 172.21.15.92:0/767584114 >> 172.21.15.92:0/767584114 conn(0x563f02f1f460 msgr2=0x563f032e6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:12.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.138+0000 7f46f7b25740 1 -- 172.21.15.92:0/767584114 shutdown_connections 2024-09-21T07:14:12.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.138+0000 7f46f7b25740 1 -- 172.21.15.92:0/767584114 wait complete. 2024-09-21T07:14:12.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.138+0000 7f46f7b25740 1 -- start start 2024-09-21T07:14:12.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.139+0000 7f46f7b25740 1 Processor -- start 2024-09-21T07:14:12.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.139+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02ee99f0 0x563f032ee860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.139+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.139+0000 7f46f7b25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f03361e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.139+0000 7f46eaffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02ee99f0 0x563f032ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.139+0000 7f46eaffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02ee99f0 0x563f032ee860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:57988/0 (socket says 172.21.15.92:57988) 2024-09-21T07:14:12.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.139+0000 7f46eaffd640 1 -- 172.21.15.92:0/2648730772 learned_addr learned my addr 172.21.15.92:0/2648730772 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:12.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46eb7fe640 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f03361e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46ea7fc640 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec1b0120 con 0x563f02f0a390 2024-09-21T07:14:12.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec1afa50 con 0x563f02f021b0 2024-09-21T07:14:12.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec1acc90 con 0x563f02ee99f0 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46f7b25740 10 client.0 _ll_register_callbacks cb 0x7f46e000be90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46eb7fe640 1 -- 172.21.15.92:0/2648730772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02ee99f0 msgr2=0x563f032ee860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46eb7fe640 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02ee99f0 0x563f032ee860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46eb7fe640 1 -- 172.21.15.92:0/2648730772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 msgr2=0x563f032eeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46eb7fe640 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032eeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.140+0000 7f46eb7fe640 1 -- 172.21.15.92:0/2648730772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f032ef590 con 0x563f02f0a390 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.141+0000 7f46eb7fe640 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f03361e20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f46e4005fd0 tx=0x7f46e40096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf5a924549467a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.141+0000 7f46ceff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.141+0000 7f46ceff5640 1 -- 172.21.15.92:0/2648730772 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e400e5b0 con 0x563f02f0a390 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.141+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46dc0d7700 con 0x563f02f0a390 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.141+0000 7f46ceff5640 1 -- 172.21.15.92:0/2648730772 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f46e400e750 con 0x563f02f0a390 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.141+0000 7f46ceff5640 1 -- 172.21.15.92:0/2648730772 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f46e402f050 con 0x563f02f0a390 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.141+0000 7f46f7b25740 10 client.16008 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.141+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563f033632f0 con 0x563f02f0a390 2024-09-21T07:14:12.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.142+0000 7f46ceff5640 1 -- 172.21.15.92:0/2648730772 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46dc0d7700 con 0x563f02f0a390 2024-09-21T07:14:12.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.142+0000 7f46ceff5640 1 -- 172.21.15.92:0/2648730772 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f46e40119d0 con 0x563f02f0a390 2024-09-21T07:14:12.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.142+0000 7f46f7b25740 10 client.16008 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.142+0000 7f46f7b25740 10 client.16008 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.142+0000 7f46f7b25740 20 client.16008 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.142+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x563f02f2b070 0x563f03365ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.142+0000 7f46f7b25740 4 client.16008 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.142+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f032468a0 con 0x563f02f2b070 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.142+0000 7f46eaffd640 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x563f02f2b070 0x563f03365ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.143+0000 7f46ceff5640 10 client.16008 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.143+0000 7f46eaffd640 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x563f02f2b070 0x563f03365ab0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6602c73b68c2ba95 server_cookie=5cdb0fab7058afeb in_seq=0 out_seq=0 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.143+0000 7f46ceff5640 1 -- 172.21.15.92:0/2648730772 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f032468a0 con 0x563f02f2b070 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.143+0000 7f46ceff5640 10 client.16008 handle_command_reply: tid=0 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.143+0000 7f46f7b25740 1 client.16008 shutdown 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.143+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 msgr2=0x563f03361e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.143+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f03361e20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f46e4005fd0 tx=0x7f46e40096a0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.143+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 shutdown_connections 2024-09-21T07:14:12.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x563f02f2b070 0x563f03365ab0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46ceff5640 0 client.16008 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:14:12.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563f02f0a390 0x563f03361e20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563f02f021b0 0x563f032eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f7b25740 1 --2- 172.21.15.92:0/2648730772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f02ee99f0 0x563f032ee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 >> 172.21.15.92:0/2648730772 conn(0x563f02f1f460 msgr2=0x563f032d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:12.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 shutdown_connections 2024-09-21T07:14:12.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f7b25740 1 -- 172.21.15.92:0/2648730772 wait complete. 2024-09-21T07:14:12.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f7b25740 20 client.16008 trim_cache size 0 max 16384 2024-09-21T07:14:12.149 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:14:12.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f46d40b6710 msgr2=0x7f46d40b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:12.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f15b1640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f46d40b6710 0x7f46d40b8c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009fd0 tx=0x7f46e4009920 comp rx=0 tx=0).stop 2024-09-21T07:14:12.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46ec102a60 msgr2=0x7f46ec199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:12.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.144+0000 7f46f15b1640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46ec102a60 0x7f46ec199340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009230 tx=0x7f46dc004270 comp rx=0 tx=0).stop 2024-09-21T07:14:12.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.145+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 shutdown_connections 2024-09-21T07:14:12.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.145+0000 7f46f15b1640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f46d40b6710 0x7f46d40b8c20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.145+0000 7f46f15b1640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46ec108cf0 0x7f46ec19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.145+0000 7f46f15b1640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ec1083a0 0x7f46ec1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.145+0000 7f46f15b1640 1 --2- 172.21.15.92:0/231015292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46ec102a60 0x7f46ec199340 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:12.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.145+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 >> 172.21.15.92:0/231015292 conn(0x7f46ec079730 msgr2=0x7f46ec101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:12.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.145+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 shutdown_connections 2024-09-21T07:14:12.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:12.145+0000 7f46f15b1640 1 -- 172.21.15.92:0/231015292 wait complete. 2024-09-21T07:14:12.899 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:14:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:12 smithi175 ceph-mon[34064]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-21T07:14:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:12 smithi092 ceph-mon[30987]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-21T07:14:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:12 smithi169 ceph-mon[33705]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-21T07:14:13.212 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:13.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.746+0000 7fe6ff348640 1 -- 172.21.15.92:0/1880823947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f8108480 msgr2=0x7fe6f810ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:13.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.746+0000 7fe6ff348640 1 --2- 172.21.15.92:0/1880823947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f8108480 0x7fe6f810ecb0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009ca0 tx=0x7fe6f002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.746+0000 7fe6ff348640 1 -- 172.21.15.92:0/1880823947 shutdown_connections 2024-09-21T07:14:13.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.746+0000 7fe6ff348640 1 --2- 172.21.15.92:0/1880823947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f8108480 0x7fe6f810ecb0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.746+0000 7fe6ff348640 1 --2- 172.21.15.92:0/1880823947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f8107b30 0x7fe6f8107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.746+0000 7fe6ff348640 1 --2- 172.21.15.92:0/1880823947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6f81021f0 0x7fe6f8102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.746+0000 7fe6ff348640 1 -- 172.21.15.92:0/1880823947 >> 172.21.15.92:0/1880823947 conn(0x7fe6f8077c60 msgr2=0x7fe6f80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.746+0000 7fe6ff348640 1 -- 172.21.15.92:0/1880823947 shutdown_connections 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.746+0000 7fe6ff348640 1 -- 172.21.15.92:0/1880823947 wait complete. 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6ff348640 1 Processor -- start 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6ff348640 1 -- start start 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6ff348640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6f81021f0 0x7fe6f819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6ff348640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f8107b30 0x7fe6f819a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6ff348640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f8108480 0x7fe6f819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6ff348640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f81117c0 con 0x7fe6f8108480 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6ff348640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f8111640 con 0x7fe6f81021f0 2024-09-21T07:14:13.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6ff348640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f8111940 con 0x7fe6f8107b30 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6fd8e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f8108480 0x7fe6f819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6fd8e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f8108480 0x7fe6f819fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49534/0 (socket says 172.21.15.92:49534) 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6fd8e5640 1 -- 172.21.15.92:0/3958028954 learned_addr learned my addr 172.21.15.92:0/3958028954 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6fd0e4640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6f81021f0 0x7fe6f819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.747+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f8107b30 0x7fe6f819a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6fd8e5640 1 -- 172.21.15.92:0/3958028954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f8107b30 msgr2=0x7fe6f819a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6fd8e5640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f8107b30 0x7fe6f819a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6fd8e5640 1 -- 172.21.15.92:0/3958028954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6f81021f0 msgr2=0x7fe6f819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6fd8e5640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6f81021f0 0x7fe6f819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6fd8e5640 1 -- 172.21.15.92:0/3958028954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f81a02a0 con 0x7fe6f8108480 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f8107b30 0x7fe6f819a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6fd8e5640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f8108480 0x7fe6f819fb70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0031040 tx=0x7fe6f0003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/3958028954 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0032c90 con 0x7fe6f8108480 2024-09-21T07:14:13.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/3958028954 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6f0032e30 con 0x7fe6f8108480 2024-09-21T07:14:13.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/3958028954 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0030af0 con 0x7fe6f8108480 2024-09-21T07:14:13.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6ff348640 1 -- 172.21.15.92:0/3958028954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f81a0530 con 0x7fe6f8108480 2024-09-21T07:14:13.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.748+0000 7fe6ff348640 1 -- 172.21.15.92:0/3958028954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f81a6cf0 con 0x7fe6f8108480 2024-09-21T07:14:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.751+0000 7fe7058bc740 1 Processor -- start 2024-09-21T07:14:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.752+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/3958028954 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7fe6f0030c90 con 0x7fe6f8108480 2024-09-21T07:14:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.752+0000 7fe7058bc740 1 -- start start 2024-09-21T07:14:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.752+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df554b070 0x561df58f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 0x561df58f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df58f7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe7058bc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561df5868ea0 con 0x561df552a390 2024-09-21T07:14:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe7058bc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561df58582d0 con 0x561df554b070 2024-09-21T07:14:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe7058bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561df585c0e0 con 0x561df55221b0 2024-09-21T07:14:13.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6fc8e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df58f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6fc8e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df58f7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49536/0 (socket says 172.21.15.92:49536) 2024-09-21T07:14:13.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6fc8e3640 1 -- 172.21.15.92:0/2713177821 learned_addr learned my addr 172.21.15.92:0/2713177821 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:13.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/2713177821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df554b070 0x561df58f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6fd0e4640 1 --2- 172.21.15.92:0/2713177821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 0x561df58f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6ee7fc640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6e40b6790 0x7fe6e40b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6fc8e3640 1 -- 172.21.15.92:0/2713177821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 msgr2=0x561df58f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/2713177821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 0x561df58f6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6fc8e3640 1 -- 172.21.15.92:0/2713177821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df554b070 msgr2=0x561df58f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/2713177821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df554b070 0x561df58f66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6fc8e3640 1 -- 172.21.15.92:0/2713177821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df55b6650 con 0x561df552a390 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.753+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/3958028954 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe6f0108f70 con 0x7fe6f8108480 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.754+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/2713177821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df58f7150 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8010870 tx=0x7fe6e800a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6115a33625bc3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.754+0000 7fe6fd8e5640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6e40b6790 0x7fe6e40b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.754+0000 7fe6e37fe640 1 -- 172.21.15.92:0/2713177821 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80100d0 con 0x561df552a390 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.754+0000 7fe6e37fe640 1 -- 172.21.15.92:0/2713177821 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6e8010270 con 0x561df552a390 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.754+0000 7fe6e37fe640 1 -- 172.21.15.92:0/2713177821 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800e910 con 0x561df552a390 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.755+0000 7fe7058bc740 1 -- 172.21.15.92:0/2713177821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 msgr2=0x561df58f7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.755+0000 7fe6fd8e5640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6e40b6790 0x7fe6e40b8ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe6f01062c0 tx=0x7fe6f003e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.755+0000 7fe7058bc740 1 --2- 172.21.15.92:0/2713177821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df58f7150 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8010870 tx=0x7fe6e800a740 comp rx=0 tx=0).stop 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.755+0000 7fe7058bc740 1 -- 172.21.15.92:0/2713177821 shutdown_connections 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.755+0000 7fe7058bc740 1 --2- 172.21.15.92:0/2713177821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df58f7150 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.755+0000 7fe7058bc740 1 --2- 172.21.15.92:0/2713177821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 0x561df58f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.755+0000 7fe7058bc740 1 --2- 172.21.15.92:0/2713177821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df554b070 0x561df58f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.755+0000 7fe7058bc740 1 -- 172.21.15.92:0/2713177821 >> 172.21.15.92:0/2713177821 conn(0x561df553f460 msgr2=0x561df58f45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:13.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.755+0000 7fe7058bc740 1 -- 172.21.15.92:0/2713177821 shutdown_connections 2024-09-21T07:14:13.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.755+0000 7fe7058bc740 1 -- 172.21.15.92:0/2713177821 wait complete. 2024-09-21T07:14:13.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.756+0000 7fe7058bc740 1 -- start start 2024-09-21T07:14:13.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.756+0000 7fe7058bc740 1 Processor -- start 2024-09-21T07:14:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 0x561df5901e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df5902340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df554b070 0x561df590e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe7058bc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561df56b9700 con 0x561df552a390 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe7058bc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561df57f3160 con 0x561df554b070 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe7058bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561df5904e50 con 0x561df55221b0 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe6fd0e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df5902340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe7058bc740 10 client.0 _ll_register_callbacks cb 0x561df580c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe6fd0e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df5902340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49540/0 (socket says 172.21.15.92:49540) 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe6fd0e4640 1 -- 172.21.15.92:0/2738134758 learned_addr learned my addr 172.21.15.92:0/2738134758 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 0x561df5901e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df554b070 0x561df590e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe6fc8e3640 1 -- 172.21.15.92:0/2738134758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df554b070 msgr2=0x561df590e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df554b070 0x561df590e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe6fc8e3640 1 -- 172.21.15.92:0/2738134758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 msgr2=0x561df5902340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df5902340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.757+0000 7fe6fc8e3640 1 -- 172.21.15.92:0/2738134758 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df5820c90 con 0x561df55221b0 2024-09-21T07:14:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.758+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 0x561df5901e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8006010 tx=0x7fe6e800e4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5e5fc87a4b70d07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.758+0000 7fe6e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.758+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/2738134758 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80100d0 con 0x561df55221b0 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.758+0000 7fe7058bc740 1 -- 172.21.15.92:0/2738134758 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6e8010270 con 0x561df55221b0 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.758+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/2738134758 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe6e8005250 con 0x561df55221b0 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.758+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/2738134758 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe6e8030050 con 0x561df55221b0 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.758+0000 7fe7058bc740 10 client.25489 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.758+0000 7fe7058bc740 1 -- 172.21.15.92:0/2738134758 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561df5910c40 con 0x561df55221b0 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.758+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/2738134758 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6e8010270 con 0x561df55221b0 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.759+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/2738134758 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe6e800b040 con 0x561df55221b0 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.759+0000 7fe7058bc740 10 client.25489 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.759+0000 7fe7058bc740 10 client.25489 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.759+0000 7fe7058bc740 20 client.25489 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.759+0000 7fe7058bc740 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x561df55099f0 0x561df5913ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.759+0000 7fe7058bc740 4 client.25489 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.759+0000 7fe7058bc740 1 -- 172.21.15.92:0/2738134758 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561df586adf0 con 0x561df55099f0 2024-09-21T07:14:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.759+0000 7fe6fd0e4640 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x561df55099f0 0x561df5913ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.760+0000 7fe6e0ff9640 10 client.25489 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:14:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.760+0000 7fe6fd0e4640 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x561df55099f0 0x561df5913ff0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35d6508c3b2be8a3 server_cookie=3e5767133f038962 in_seq=0 out_seq=0 2024-09-21T07:14:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/2738134758 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561df586adf0 con 0x561df55099f0 2024-09-21T07:14:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe6e0ff9640 10 client.25489 handle_command_reply: tid=0 2024-09-21T07:14:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe7058bc740 1 client.25489 shutdown 2024-09-21T07:14:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe7058bc740 1 -- 172.21.15.92:0/2738134758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 msgr2=0x561df5901e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe7058bc740 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 0x561df5901e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8006010 tx=0x7fe6e800e4f0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe7058bc740 1 -- 172.21.15.92:0/2738134758 shutdown_connections 2024-09-21T07:14:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe7058bc740 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x561df55099f0 0x561df5913ff0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe6e0ff9640 0 client.25489 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:14:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe7058bc740 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df554b070 0x561df590e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe7058bc740 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df552a390 0x561df5902340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe7058bc740 1 --2- 172.21.15.92:0/2738134758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55221b0 0x561df5901e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.761+0000 7fe7058bc740 1 -- 172.21.15.92:0/2738134758 >> 172.21.15.92:0/2738134758 conn(0x561df553f460 msgr2=0x561df58f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.762+0000 7fe7058bc740 1 -- 172.21.15.92:0/2738134758 shutdown_connections 2024-09-21T07:14:13.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.762+0000 7fe7058bc740 1 -- 172.21.15.92:0/2738134758 wait complete. 2024-09-21T07:14:13.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.762+0000 7fe7058bc740 20 client.25489 trim_cache size 0 max 16384 2024-09-21T07:14:13.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.785+0000 7fe7058bc740 1 Processor -- start 2024-09-21T07:14:13.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.785+0000 7fe7058bc740 1 -- start start 2024-09-21T07:14:13.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df55099f0 0x561df58fd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5903ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df552a390 0x561df58f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe7058bc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f81aeb50 con 0x561df55221b0 2024-09-21T07:14:13.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe7058bc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f81b0690 con 0x561df55099f0 2024-09-21T07:14:13.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe7058bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f81af220 con 0x561df552a390 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fd0e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5903ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fd0e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5903ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49552/0 (socket says 172.21.15.92:49552) 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fd0e4640 1 -- 172.21.15.92:0/179522772 learned_addr learned my addr 172.21.15.92:0/179522772 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/179522772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df55099f0 0x561df58fd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/179522772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df552a390 0x561df58f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fc8e3640 1 -- 172.21.15.92:0/179522772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df552a390 msgr2=0x561df58f7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/179522772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df552a390 0x561df58f7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fc8e3640 1 -- 172.21.15.92:0/179522772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 msgr2=0x561df5903ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/179522772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5903ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fc8e3640 1 -- 172.21.15.92:0/179522772 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df59030c0 con 0x561df55099f0 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fd0e4640 1 --2- 172.21.15.92:0/179522772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5903ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:13.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.786+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/179522772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df55099f0 0x561df58fd5e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8004db0 tx=0x7fe6e800e450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8654498cf602bf17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:13.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.787+0000 7fe6e2ffd640 1 -- 172.21.15.92:0/179522772 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800aa70 con 0x561df55099f0 2024-09-21T07:14:13.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.787+0000 7fe6e2ffd640 1 -- 172.21.15.92:0/179522772 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6e800a640 con 0x561df55099f0 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.787+0000 7fe6e2ffd640 1 -- 172.21.15.92:0/179522772 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800ea50 con 0x561df55099f0 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.788+0000 7fe7058bc740 1 -- 172.21.15.92:0/179522772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df55099f0 msgr2=0x561df58fd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.788+0000 7fe7058bc740 1 --2- 172.21.15.92:0/179522772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df55099f0 0x561df58fd5e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8004db0 tx=0x7fe6e800e450 comp rx=0 tx=0).stop 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.788+0000 7fe7058bc740 1 -- 172.21.15.92:0/179522772 shutdown_connections 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.788+0000 7fe7058bc740 1 --2- 172.21.15.92:0/179522772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df552a390 0x561df58f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.788+0000 7fe7058bc740 1 --2- 172.21.15.92:0/179522772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5903ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.788+0000 7fe7058bc740 1 --2- 172.21.15.92:0/179522772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df55099f0 0x561df58fd5e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.788+0000 7fe7058bc740 1 -- 172.21.15.92:0/179522772 >> 172.21.15.92:0/179522772 conn(0x561df553f460 msgr2=0x561df58f7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.788+0000 7fe7058bc740 1 -- 172.21.15.92:0/179522772 shutdown_connections 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.788+0000 7fe7058bc740 1 -- 172.21.15.92:0/179522772 wait complete. 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.788+0000 7fe7058bc740 1 -- start start 2024-09-21T07:14:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe7058bc740 1 Processor -- start 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55099f0 0x561df5917820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5914cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe7058bc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df552a390 0x561df5915250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe7058bc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f81affc0 con 0x561df55221b0 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe7058bc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f81af8f0 con 0x561df552a390 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe7058bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f81acb30 con 0x561df55099f0 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe6fd0e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5914cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe6fd0e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5914cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49566/0 (socket says 172.21.15.92:49566) 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe7058bc740 10 client.0 _ll_register_callbacks cb 0x7fe6e800aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe6fd0e4640 1 -- 172.21.15.92:0/430310366 learned_addr learned my addr 172.21.15.92:0/430310366 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55099f0 0x561df5917820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.789+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df552a390 0x561df5915250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe6fd0e4640 1 -- 172.21.15.92:0/430310366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55099f0 msgr2=0x561df5917820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe6fd0e4640 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55099f0 0x561df5917820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe6fd0e4640 1 -- 172.21.15.92:0/430310366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df552a390 msgr2=0x561df5915250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe6fd0e4640 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df552a390 0x561df5915250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe6fd0e4640 1 -- 172.21.15.92:0/430310366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df59159e0 con 0x561df55221b0 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe6fd0e4640 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5914cf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400bbb0 tx=0x7fe6f40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c3d65eed51fe2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe6e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/430310366 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4005220 con 0x561df55221b0 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/430310366 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe6f40053c0 con 0x561df55221b0 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe7058bc740 1 -- 172.21.15.92:0/430310366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6e800a640 con 0x561df55221b0 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.790+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/430310366 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe6f402f050 con 0x561df55221b0 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.791+0000 7fe7058bc740 10 client.16026 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.791+0000 7fe7058bc740 1 -- 172.21.15.92:0/430310366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561df597e760 con 0x561df55221b0 2024-09-21T07:14:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.791+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/430310366 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6e800a640 con 0x561df55221b0 2024-09-21T07:14:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.791+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/430310366 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe6f4011640 con 0x561df55221b0 2024-09-21T07:14:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.791+0000 7fe7058bc740 10 client.16026 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.791+0000 7fe7058bc740 10 client.16026 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:14:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.791+0000 7fe7058bc740 20 client.16026 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.791+0000 7fe7058bc740 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x561df554b070 0x561df5980f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.791+0000 7fe7058bc740 4 client.16026 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:14:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.791+0000 7fe7058bc740 1 -- 172.21.15.92:0/430310366 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561df58668a0 con 0x561df554b070 2024-09-21T07:14:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.792+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x561df554b070 0x561df5980f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.792+0000 7fe6fc8e3640 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x561df554b070 0x561df5980f80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c287494175a716f server_cookie=5641a61a86faf23c in_seq=0 out_seq=0 2024-09-21T07:14:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.792+0000 7fe6e0ff9640 10 client.16026 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:14:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.792+0000 7fe6e0ff9640 1 -- 172.21.15.92:0/430310366 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561df58668a0 con 0x561df554b070 2024-09-21T07:14:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.792+0000 7fe6e0ff9640 10 client.16026 handle_command_reply: tid=0 2024-09-21T07:14:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 client.16026 shutdown 2024-09-21T07:14:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 -- 172.21.15.92:0/430310366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 msgr2=0x561df5914cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5914cf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400bbb0 tx=0x7fe6f40039c0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 -- 172.21.15.92:0/430310366 shutdown_connections 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x561df554b070 0x561df5980f80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df552a390 0x561df5915250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561df55221b0 0x561df5914cf0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 --2- 172.21.15.92:0/430310366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561df55099f0 0x561df5917820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 -- 172.21.15.92:0/430310366 >> 172.21.15.92:0/430310366 conn(0x561df553f460 msgr2=0x561df5903a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe6e0ff9640 0 client.16026 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 -- 172.21.15.92:0/430310366 shutdown_connections 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 1 -- 172.21.15.92:0/430310366 wait complete. 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.793+0000 7fe7058bc740 20 client.16026 trim_cache size 0 max 16384 2024-09-21T07:14:13.799 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:14:13.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 -- 172.21.15.92:0/3958028954 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6e40b6790 msgr2=0x7fe6e40b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:13.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6e40b6790 0x7fe6e40b8ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe6f01062c0 tx=0x7fe6f003e040 comp rx=0 tx=0).stop 2024-09-21T07:14:13.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 -- 172.21.15.92:0/3958028954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f8108480 msgr2=0x7fe6f819fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:13.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f8108480 0x7fe6f819fb70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0031040 tx=0x7fe6f0003f80 comp rx=0 tx=0).stop 2024-09-21T07:14:13.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 -- 172.21.15.92:0/3958028954 shutdown_connections 2024-09-21T07:14:13.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6e40b6790 0x7fe6e40b8ca0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6f8108480 0x7fe6f819fb70 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6f8107b30 0x7fe6f819a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 --2- 172.21.15.92:0/3958028954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6f81021f0 0x7fe6f819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:13.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 -- 172.21.15.92:0/3958028954 >> 172.21.15.92:0/3958028954 conn(0x7fe6f8077c60 msgr2=0x7fe6f8105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:13.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 -- 172.21.15.92:0/3958028954 shutdown_connections 2024-09-21T07:14:13.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:13.794+0000 7fe6ff348640 1 -- 172.21.15.92:0/3958028954 wait complete. 2024-09-21T07:14:14.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:14:14.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:14 smithi092 ceph-mon[30987]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T07:14:14.926 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:14 smithi175 ceph-mon[34064]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T07:14:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:14 smithi169 ceph-mon[33705]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T07:14:15.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.473+0000 7f9f999f9640 1 -- 172.21.15.92:0/3413293291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f941094c0 msgr2=0x7f9f941098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:15.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.473+0000 7f9f999f9640 1 --2- 172.21.15.92:0/3413293291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f941094c0 0x7f9f941098d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009900 tx=0x7f9f8802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.474+0000 7f9f999f9640 1 -- 172.21.15.92:0/3413293291 shutdown_connections 2024-09-21T07:14:15.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.474+0000 7f9f999f9640 1 --2- 172.21.15.92:0/3413293291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f94109e10 0x7f9f94110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.474+0000 7f9f999f9640 1 --2- 172.21.15.92:0/3413293291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f941094c0 0x7f9f941098d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.474+0000 7f9f999f9640 1 --2- 172.21.15.92:0/3413293291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f94103b80 0x7f9f94103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.474+0000 7f9f999f9640 1 -- 172.21.15.92:0/3413293291 >> 172.21.15.92:0/3413293291 conn(0x7f9f940ff5b0 msgr2=0x7f9f94101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:15.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.474+0000 7f9f999f9640 1 -- 172.21.15.92:0/3413293291 shutdown_connections 2024-09-21T07:14:15.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.474+0000 7f9f999f9640 1 -- 172.21.15.92:0/3413293291 wait complete. 2024-09-21T07:14:15.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.474+0000 7f9f999f9640 1 Processor -- start 2024-09-21T07:14:15.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.475+0000 7f9f999f9640 1 -- start start 2024-09-21T07:14:15.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.475+0000 7f9f999f9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f94103b80 0x7f9f9419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.475+0000 7f9f999f9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f941094c0 0x7f9f9419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.475+0000 7f9f999f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f94109e10 0x7f9f9419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.475+0000 7f9f999f9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941139a0 con 0x7f9f94109e10 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.475+0000 7f9f999f9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94113820 con 0x7f9f941094c0 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.475+0000 7f9f999f9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94113b20 con 0x7f9f94103b80 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.475+0000 7f9f937fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f94109e10 0x7f9f9419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.475+0000 7f9f937fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f94109e10 0x7f9f9419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49586/0 (socket says 172.21.15.92:49586) 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.475+0000 7f9f937fe640 1 -- 172.21.15.92:0/1246703959 learned_addr learned my addr 172.21.15.92:0/1246703959 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f92ffd640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f94103b80 0x7f9f9419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f927fc640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f941094c0 0x7f9f9419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f937fe640 1 -- 172.21.15.92:0/1246703959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f94103b80 msgr2=0x7f9f9419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:15.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f937fe640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f94103b80 0x7f9f9419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f937fe640 1 -- 172.21.15.92:0/1246703959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f941094c0 msgr2=0x7f9f9419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:15.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f937fe640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f941094c0 0x7f9f9419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f937fe640 1 -- 172.21.15.92:0/1246703959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f941a03a0 con 0x7f9f94109e10 2024-09-21T07:14:15.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f927fc640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f941094c0 0x7f9f9419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:14:15.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f937fe640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f94109e10 0x7f9f9419fd30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00b970 tx=0x7f9f8c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:15.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f989f7640 1 -- 172.21.15.92:0/1246703959 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c019070 con 0x7f9f94109e10 2024-09-21T07:14:15.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f999f9640 1 -- 172.21.15.92:0/1246703959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f941a0690 con 0x7f9f94109e10 2024-09-21T07:14:15.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f989f7640 1 -- 172.21.15.92:0/1246703959 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f8c014440 con 0x7f9f94109e10 2024-09-21T07:14:15.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f989f7640 1 -- 172.21.15.92:0/1246703959 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0075d0 con 0x7f9f94109e10 2024-09-21T07:14:15.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.476+0000 7f9f999f9640 1 -- 172.21.15.92:0/1246703959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f941a6eb0 con 0x7f9f94109e10 2024-09-21T07:14:15.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.479+0000 7f9f9ff6d740 1 Processor -- start 2024-09-21T07:14:15.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.480+0000 7f9f989f7640 1 -- 172.21.15.92:0/1246703959 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7f9f8c01c070 con 0x7f9f94109e10 2024-09-21T07:14:15.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.480+0000 7f9f9ff6d740 1 -- start start 2024-09-21T07:14:15.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c898a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 0x5570c898abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85c2390 0x5570c898b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570c8900ea0 con 0x5570c85e3070 2024-09-21T07:14:15.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5570c88f02d0 con 0x5570c85c2390 2024-09-21T07:14:15.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5570c88f40e0 con 0x5570c85ba1b0 2024-09-21T07:14:15.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c898a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c898a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49602/0 (socket says 172.21.15.92:49602) 2024-09-21T07:14:15.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f927fc640 1 -- 172.21.15.92:0/1761033625 learned_addr learned my addr 172.21.15.92:0/1761033625 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:15.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f92ffd640 1 --2- 172.21.15.92:0/1761033625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 0x5570c898abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.481+0000 7f9f927fc640 1 --2- 172.21.15.92:0/1761033625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85c2390 0x5570c898b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f989f7640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9f7c0b6740 0x7f9f7c0b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f927fc640 1 -- 172.21.15.92:0/1761033625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 msgr2=0x5570c898abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:15.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f927fc640 1 --2- 172.21.15.92:0/1761033625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 0x5570c898abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f927fc640 1 -- 172.21.15.92:0/1761033625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85c2390 msgr2=0x5570c898b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:15.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f927fc640 1 --2- 172.21.15.92:0/1761033625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85c2390 0x5570c898b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f927fc640 1 -- 172.21.15.92:0/1761033625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570c864e650 con 0x5570c85e3070 2024-09-21T07:14:15.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f937fe640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9f7c0b6740 0x7f9f7c0b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f927fc640 1 --2- 172.21.15.92:0/1761033625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c898a6a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9f88000c00 tx=0x7f9f88005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26adfb1bb5ca536c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:15.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f989f7640 1 -- 172.21.15.92:0/1246703959 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9f8c0e70e0 con 0x7f9f94109e10 2024-09-21T07:14:15.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f92ffd640 1 --2- 172.21.15.92:0/1761033625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 0x5570c898abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:15.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.482+0000 7f9f79ffb640 1 -- 172.21.15.92:0/1761033625 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88035070 con 0x5570c85e3070 2024-09-21T07:14:15.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.483+0000 7f9f79ffb640 1 -- 172.21.15.92:0/1761033625 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f880044c0 con 0x5570c85e3070 2024-09-21T07:14:15.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.483+0000 7f9f937fe640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9f7c0b6740 0x7f9f7c0b8c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0e4430 tx=0x7f9f8c00e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.484+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/1761033625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 msgr2=0x5570c898a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.484+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/1761033625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c898a6a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9f88000c00 tx=0x7f9f88005ec0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.484+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/1761033625 shutdown_connections 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.484+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/1761033625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85c2390 0x5570c898b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.484+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/1761033625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 0x5570c898abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.484+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/1761033625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c898a6a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.484+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/1761033625 >> 172.21.15.92:0/1761033625 conn(0x5570c85d7460 msgr2=0x5570c8988590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.484+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/1761033625 shutdown_connections 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.484+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/1761033625 wait complete. 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.484+0000 7f9f9ff6d740 1 -- start start 2024-09-21T07:14:15.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.485+0000 7f9f9ff6d740 1 Processor -- start 2024-09-21T07:14:15.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.485+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 0x5570c8995bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.485+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85c2390 0x5570c8996130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.485+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8996670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.485+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570c8751700 con 0x5570c85e3070 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.485+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5570c888b160 con 0x5570c85c2390 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.485+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5570c8998ec0 con 0x5570c85ba1b0 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f9ff6d740 10 client.0 _ll_register_callbacks cb 0x5570c88a49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8996670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f92ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85c2390 0x5570c8996130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8996670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49604/0 (socket says 172.21.15.92:49604) 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f927fc640 1 -- 172.21.15.92:0/2749493096 learned_addr learned my addr 172.21.15.92:0/2749493096 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f927fc640 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 0x5570c8995bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f927fc640 1 -- 172.21.15.92:0/2749493096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 msgr2=0x5570c8995bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f927fc640 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 0x5570c8995bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f927fc640 1 -- 172.21.15.92:0/2749493096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85c2390 msgr2=0x5570c8996130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:15.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f927fc640 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85c2390 0x5570c8996130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f927fc640 1 -- 172.21.15.92:0/2749493096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570c88b8c90 con 0x5570c85e3070 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f927fc640 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8996670 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x5570c898cb40 tx=0x7f9f88009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94c0886985aa959 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.486+0000 7f9f72ffd640 1 -- 172.21.15.92:0/2749493096 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88035070 con 0x5570c85e3070 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f72ffd640 1 -- 172.21.15.92:0/2749493096 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9f88004080 con 0x5570c85e3070 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2749493096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570c8902df0 con 0x5570c85e3070 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f72ffd640 1 -- 172.21.15.92:0/2749493096 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9f8805a050 con 0x5570c85e3070 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f9ff6d740 10 client.16038 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2749493096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5570c89a4aa0 con 0x5570c85e3070 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f72ffd640 1 -- 172.21.15.92:0/2749493096 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5570c8902df0 con 0x5570c85e3070 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f72ffd640 1 -- 172.21.15.92:0/2749493096 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9f8803cc30 con 0x5570c85e3070 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f9ff6d740 10 client.16038 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f9ff6d740 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:15.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f9ff6d740 20 client.16038 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:15.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570c85a19f0 0x5570c89a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f9ff6d740 4 client.16038 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:15.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.487+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2749493096 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570c88fe8a0 con 0x5570c85a19f0 2024-09-21T07:14:15.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.488+0000 7f9f92ffd640 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570c85a19f0 0x5570c89a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.488+0000 7f9f92ffd640 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570c85a19f0 0x5570c89a7e00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=992fdb1244f23386 server_cookie=13e738b892dd24e6 in_seq=0 out_seq=0 2024-09-21T07:14:15.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.488+0000 7f9f72ffd640 10 client.16038 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:15.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.489+0000 7f9f72ffd640 1 -- 172.21.15.92:0/2749493096 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5570c88fe8a0 con 0x5570c85a19f0 2024-09-21T07:14:15.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.489+0000 7f9f72ffd640 10 client.16038 handle_command_reply: tid=0 2024-09-21T07:14:15.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.489+0000 7f9f9ff6d740 1 client.16038 shutdown 2024-09-21T07:14:15.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.489+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2749493096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 msgr2=0x5570c8996670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:15.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.489+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8996670 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x5570c898cb40 tx=0x7f9f88009680 comp rx=0 tx=0).stop 2024-09-21T07:14:15.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.489+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2749493096 shutdown_connections 2024-09-21T07:14:15.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.489+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570c85a19f0 0x5570c89a7e00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.489+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8996670 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.489+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85c2390 0x5570c8996130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.489+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/2749493096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85ba1b0 0x5570c8995bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.490+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2749493096 >> 172.21.15.92:0/2749493096 conn(0x5570c85d7460 msgr2=0x5570c898d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:15.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.490+0000 7f9f72ffd640 0 client.16038 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:15.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.490+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2749493096 shutdown_connections 2024-09-21T07:14:15.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.490+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2749493096 wait complete. 2024-09-21T07:14:15.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.490+0000 7f9f9ff6d740 20 client.16038 trim_cache size 0 max 16384 2024-09-21T07:14:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f9ff6d740 1 Processor -- start 2024-09-21T07:14:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f9ff6d740 1 -- start start 2024-09-21T07:14:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85ba1b0 0x5570c898c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 0x5570c89a1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8992de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941b0f60 con 0x5570c85e3070 2024-09-21T07:14:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941b2aa0 con 0x5570c85ba1b0 2024-09-21T07:14:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941b1630 con 0x5570c85c2390 2024-09-21T07:14:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8992de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8992de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49620/0 (socket says 172.21.15.92:49620) 2024-09-21T07:14:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f927fc640 1 -- 172.21.15.92:0/2881965141 learned_addr learned my addr 172.21.15.92:0/2881965141 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f927fc640 1 --2- 172.21.15.92:0/2881965141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85ba1b0 0x5570c898c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.514+0000 7f9f92ffd640 1 --2- 172.21.15.92:0/2881965141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 0x5570c89a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.515+0000 7f9f927fc640 1 -- 172.21.15.92:0/2881965141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 msgr2=0x5570c89a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.515+0000 7f9f927fc640 1 --2- 172.21.15.92:0/2881965141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 0x5570c89a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.515+0000 7f9f927fc640 1 -- 172.21.15.92:0/2881965141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85ba1b0 msgr2=0x5570c898c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.515+0000 7f9f927fc640 1 --2- 172.21.15.92:0/2881965141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85ba1b0 0x5570c898c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.515+0000 7f9f927fc640 1 -- 172.21.15.92:0/2881965141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570c89ae0f0 con 0x5570c85e3070 2024-09-21T07:14:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.515+0000 7f9f927fc640 1 --2- 172.21.15.92:0/2881965141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8992de0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9f88003a40 tx=0x7f9f880092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69fdf65798b428a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.515+0000 7f9f797fa640 1 -- 172.21.15.92:0/2881965141 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88035040 con 0x5570c85e3070 2024-09-21T07:14:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.515+0000 7f9f797fa640 1 -- 172.21.15.92:0/2881965141 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f880318b0 con 0x5570c85e3070 2024-09-21T07:14:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.515+0000 7f9f797fa640 1 -- 172.21.15.92:0/2881965141 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8803cb60 con 0x5570c85e3070 2024-09-21T07:14:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.516+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2881965141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 msgr2=0x5570c8992de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.516+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/2881965141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8992de0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9f88003a40 tx=0x7f9f880092b0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.516+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2881965141 shutdown_connections 2024-09-21T07:14:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.516+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/2881965141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c8992de0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.516+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/2881965141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 0x5570c89a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.516+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/2881965141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85ba1b0 0x5570c898c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.517+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2881965141 >> 172.21.15.92:0/2881965141 conn(0x5570c85d7460 msgr2=0x5570c89a1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.517+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2881965141 shutdown_connections 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.517+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/2881965141 wait complete. 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.517+0000 7f9f9ff6d740 1 -- start start 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.517+0000 7f9f9ff6d740 1 Processor -- start 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85ba1b0 0x5570c89a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 0x5570c89a9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f9ff6d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c89a9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941b23d0 con 0x5570c85e3070 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941b1d00 con 0x5570c85ba1b0 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f9ff6d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941aef40 con 0x5570c85c2390 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f9ff6d740 10 client.0 _ll_register_callbacks cb 0x7f9f8400a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c89a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f92ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 0x5570c89a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f92ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 0x5570c89a9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:58074/0 (socket says 172.21.15.92:58074) 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c89a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49634/0 (socket says 172.21.15.92:49634) 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f92ffd640 1 -- 172.21.15.92:0/4218660641 learned_addr learned my addr 172.21.15.92:0/4218660641 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.518+0000 7f9f927fc640 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85ba1b0 0x5570c89a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f927fc640 1 -- 172.21.15.92:0/4218660641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 msgr2=0x5570c89a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f927fc640 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 0x5570c89a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f927fc640 1 -- 172.21.15.92:0/4218660641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85ba1b0 msgr2=0x5570c89a8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f927fc640 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85ba1b0 0x5570c89a8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f927fc640 1 -- 172.21.15.92:0/4218660641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570c8a11580 con 0x5570c85e3070 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f927fc640 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c89a9840 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9f88005860 tx=0x7f9f88003870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9716b0c2c90547e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f72ffd640 1 -- 172.21.15.92:0/4218660641 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88035040 con 0x5570c85e3070 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f72ffd640 1 -- 172.21.15.92:0/4218660641 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9f8803eb40 con 0x5570c85e3070 2024-09-21T07:14:15.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/4218660641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570c88fbcd0 con 0x5570c85e3070 2024-09-21T07:14:15.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f72ffd640 1 -- 172.21.15.92:0/4218660641 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9f880314b0 con 0x5570c85e3070 2024-09-21T07:14:15.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.519+0000 7f9f9ff6d740 10 client.16044 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:15.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.520+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/4218660641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5570c8a12790 con 0x5570c85e3070 2024-09-21T07:14:15.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.520+0000 7f9f72ffd640 1 -- 172.21.15.92:0/4218660641 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5570c88fbcd0 con 0x5570c85e3070 2024-09-21T07:14:15.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.520+0000 7f9f72ffd640 1 -- 172.21.15.92:0/4218660641 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9f88056070 con 0x5570c85e3070 2024-09-21T07:14:15.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.520+0000 7f9f9ff6d740 10 client.16044 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:15.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.520+0000 7f9f9ff6d740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.520+0000 7f9f9ff6d740 20 client.16044 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.520+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570c8576da0 0x5570c8a14e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.520+0000 7f9f9ff6d740 4 client.16044 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.520+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/4218660641 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570c8871aa0 con 0x5570c8576da0 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.521+0000 7f9f92ffd640 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570c8576da0 0x5570c8a14e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.521+0000 7f9f72ffd640 10 client.16044 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.521+0000 7f9f92ffd640 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570c8576da0 0x5570c8a14e30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b09158616dc619 server_cookie=b4645ac9ff7a629e in_seq=0 out_seq=0 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.521+0000 7f9f72ffd640 1 -- 172.21.15.92:0/4218660641 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570c8871aa0 con 0x5570c8576da0 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.521+0000 7f9f72ffd640 10 client.16044 handle_command_reply: tid=0 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 client.16044 shutdown 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/4218660641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 msgr2=0x5570c89a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c89a9840 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9f88005860 tx=0x7f9f88003870 comp rx=0 tx=0).stop 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/4218660641 shutdown_connections 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570c8576da0 0x5570c8a14e30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570c85e3070 0x5570c89a9840 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f72ffd640 0 client.16044 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:15.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570c85c2390 0x5570c89a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 --2- 172.21.15.92:0/4218660641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570c85ba1b0 0x5570c89a8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/4218660641 >> 172.21.15.92:0/4218660641 conn(0x5570c85d7460 msgr2=0x5570c898be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:15.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/4218660641 shutdown_connections 2024-09-21T07:14:15.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.522+0000 7f9f9ff6d740 1 -- 172.21.15.92:0/4218660641 wait complete. 2024-09-21T07:14:15.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f9ff6d740 20 client.16044 trim_cache size 0 max 16384 2024-09-21T07:14:15.529 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f999f9640 1 -- 172.21.15.92:0/1246703959 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9f7c0b6740 msgr2=0x7f9f7c0b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f999f9640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9f7c0b6740 0x7f9f7c0b8c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0e4430 tx=0x7f9f8c00e040 comp rx=0 tx=0).stop 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f999f9640 1 -- 172.21.15.92:0/1246703959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f94109e10 msgr2=0x7f9f9419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f999f9640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f94109e10 0x7f9f9419fd30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00b970 tx=0x7f9f8c00bd70 comp rx=0 tx=0).stop 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f999f9640 1 -- 172.21.15.92:0/1246703959 shutdown_connections 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f999f9640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9f7c0b6740 0x7f9f7c0b8c50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f999f9640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f94109e10 0x7f9f9419fd30 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f999f9640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f941094c0 0x7f9f9419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f999f9640 1 --2- 172.21.15.92:0/1246703959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f94103b80 0x7f9f9419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.523+0000 7f9f999f9640 1 -- 172.21.15.92:0/1246703959 >> 172.21.15.92:0/1246703959 conn(0x7f9f940ff5b0 msgr2=0x7f9f94108bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.524+0000 7f9f999f9640 1 -- 172.21.15.92:0/1246703959 shutdown_connections 2024-09-21T07:14:15.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:15.524+0000 7f9f999f9640 1 -- 172.21.15.92:0/1246703959 wait complete. 2024-09-21T07:14:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:16 smithi175 ceph-mon[34064]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T07:14:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:16 smithi092 ceph-mon[30987]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T07:14:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:16 smithi169 ceph-mon[33705]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T07:14:17.354 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:14:17.354 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:14:17.743 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:18.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.301+0000 7fabb5957640 1 -- 172.21.15.92:0/2133564711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb010de10 msgr2=0x7fabb0110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:18.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.301+0000 7fabb5957640 1 --2- 172.21.15.92:0/2133564711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb010de10 0x7fabb0110300 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faba8009ca0 tx=0x7faba802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.301+0000 7fabb5957640 1 -- 172.21.15.92:0/2133564711 shutdown_connections 2024-09-21T07:14:18.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.301+0000 7fabb5957640 1 --2- 172.21.15.92:0/2133564711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb010de10 0x7fabb0110300 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.301+0000 7fabb5957640 1 --2- 172.21.15.92:0/2133564711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0105300 0x7fabb010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.301+0000 7fabb5957640 1 --2- 172.21.15.92:0/2133564711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb01049b0 0x7fabb0104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.301+0000 7fabb5957640 1 -- 172.21.15.92:0/2133564711 >> 172.21.15.92:0/2133564711 conn(0x7fabb0079730 msgr2=0x7fabb0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:18.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.302+0000 7fabb5957640 1 -- 172.21.15.92:0/2133564711 shutdown_connections 2024-09-21T07:14:18.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.302+0000 7fabb5957640 1 -- 172.21.15.92:0/2133564711 wait complete. 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.303+0000 7fabb5957640 1 Processor -- start 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.303+0000 7fabb5957640 1 -- start start 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.303+0000 7fabb5957640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb01049b0 0x7fabb019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.303+0000 7fabb5957640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0105300 0x7fabb019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.303+0000 7fabb5957640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb010de10 0x7fabb019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabb5957640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fabb0113970 con 0x7fabb01049b0 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabb5957640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fabb01137f0 con 0x7fabb0105300 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabb5957640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fabb0113af0 con 0x7fabb010de10 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabaf7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb010de10 0x7fabb019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabaf7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb010de10 0x7fabb019fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:58098/0 (socket says 172.21.15.92:58098) 2024-09-21T07:14:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabaf7fe640 1 -- 172.21.15.92:0/1218588332 learned_addr learned my addr 172.21.15.92:0/1218588332 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabaeffd640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb01049b0 0x7fabb019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabae7fc640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0105300 0x7fabb019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabae7fc640 1 -- 172.21.15.92:0/1218588332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb010de10 msgr2=0x7fabb019fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabae7fc640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb010de10 0x7fabb019fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.304+0000 7fabae7fc640 1 -- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb01049b0 msgr2=0x7fabb019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.305+0000 7fabae7fc640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb01049b0 0x7fabb019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.305+0000 7fabae7fc640 1 -- 172.21.15.92:0/1218588332 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb01a02b0 con 0x7fabb0105300 2024-09-21T07:14:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.305+0000 7fabaeffd640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb01049b0 0x7fabb019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.305+0000 7fabae7fc640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0105300 0x7fabb019a8e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fabb006ad30 tx=0x7faba400ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.305+0000 7fabb4955640 1 -- 172.21.15.92:0/1218588332 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4020070 con 0x7fabb0105300 2024-09-21T07:14:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.305+0000 7fabb4955640 1 -- 172.21.15.92:0/1218588332 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faba400ccc0 con 0x7fabb0105300 2024-09-21T07:14:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.305+0000 7fabb4955640 1 -- 172.21.15.92:0/1218588332 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba401b9d0 con 0x7fabb0105300 2024-09-21T07:14:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.306+0000 7fabb5957640 1 -- 172.21.15.92:0/1218588332 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb01a05a0 con 0x7fabb0105300 2024-09-21T07:14:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.306+0000 7fabb5957640 1 -- 172.21.15.92:0/1218588332 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb01025d0 con 0x7fabb0105300 2024-09-21T07:14:18.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.309+0000 7fabb4955640 1 -- 172.21.15.92:0/1218588332 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7faba4023070 con 0x7fabb0105300 2024-09-21T07:14:18.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.309+0000 7fabbbecb740 1 Processor -- start 2024-09-21T07:14:18.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabbbecb740 1 -- start start 2024-09-21T07:14:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04587e350 0x55a045c25430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a045855490 0x55a045c25970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c25eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabbbecb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a045b9be60 con 0x55a045855490 2024-09-21T07:14:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabbbecb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a045b8b290 con 0x55a04587e350 2024-09-21T07:14:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabbbecb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a045b8f0a0 con 0x55a04585d670 2024-09-21T07:14:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabaf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04587e350 0x55a045c25430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabae7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c25eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabaf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04587e350 0x55a045c25430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:42032/0 (socket says 172.21.15.92:42032) 2024-09-21T07:14:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabae7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c25eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:58112/0 (socket says 172.21.15.92:58112) 2024-09-21T07:14:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabaf7fe640 1 -- 172.21.15.92:0/829040745 learned_addr learned my addr 172.21.15.92:0/829040745 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.310+0000 7fabaeffd640 1 --2- 172.21.15.92:0/829040745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a045855490 0x55a045c25970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.311+0000 7fabb4955640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab980b6790 0x7fab980b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.311+0000 7fabb4955640 1 -- 172.21.15.92:0/1218588332 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7faba40eba70 con 0x7fabb0105300 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.311+0000 7fabaf7fe640 1 -- 172.21.15.92:0/829040745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 msgr2=0x55a045c25eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.311+0000 7fabaf7fe640 1 --2- 172.21.15.92:0/829040745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c25eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.311+0000 7fabaf7fe640 1 -- 172.21.15.92:0/829040745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a045855490 msgr2=0x55a045c25970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.312+0000 7fabaf7fe640 1 --2- 172.21.15.92:0/829040745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a045855490 0x55a045c25970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.312+0000 7fabaf7fe640 1 -- 172.21.15.92:0/829040745 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0458e9930 con 0x55a04587e350 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.312+0000 7fabaeffd640 1 --2- 172.21.15.92:0/829040745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a045855490 0x55a045c25970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.312+0000 7fabaf7fe640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab980b6790 0x7fab980b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.312+0000 7fabaf7fe640 1 --2- 172.21.15.92:0/829040745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04587e350 0x55a045c25430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faba8009dc0 tx=0x7faba8009440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7dacb649b5a1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.312+0000 7fab95ffb640 1 -- 172.21.15.92:0/829040745 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8003b70 con 0x55a04587e350 2024-09-21T07:14:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.312+0000 7fabaf7fe640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab980b6790 0x7fab980b8ca0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faba804c000 tx=0x7faba804d000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:18.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.312+0000 7fab95ffb640 1 -- 172.21.15.92:0/829040745 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faba8036040 con 0x55a04587e350 2024-09-21T07:14:18.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.313+0000 7fab95ffb640 1 -- 172.21.15.92:0/829040745 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8030820 con 0x55a04587e350 2024-09-21T07:14:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.313+0000 7fabbbecb740 1 -- 172.21.15.92:0/829040745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04587e350 msgr2=0x55a045c25430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.313+0000 7fabbbecb740 1 --2- 172.21.15.92:0/829040745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04587e350 0x55a045c25430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faba8009dc0 tx=0x7faba8009440 comp rx=0 tx=0).stop 2024-09-21T07:14:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.313+0000 7fabbbecb740 1 -- 172.21.15.92:0/829040745 shutdown_connections 2024-09-21T07:14:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.313+0000 7fabbbecb740 1 --2- 172.21.15.92:0/829040745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c25eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.313+0000 7fabbbecb740 1 --2- 172.21.15.92:0/829040745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a045855490 0x55a045c25970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.313+0000 7fabbbecb740 1 --2- 172.21.15.92:0/829040745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04587e350 0x55a045c25430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.313+0000 7fabbbecb740 1 -- 172.21.15.92:0/829040745 >> 172.21.15.92:0/829040745 conn(0x55a045872740 msgr2=0x55a045c23320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.314+0000 7fabbbecb740 1 -- 172.21.15.92:0/829040745 shutdown_connections 2024-09-21T07:14:18.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.314+0000 7fabbbecb740 1 -- 172.21.15.92:0/829040745 wait complete. 2024-09-21T07:14:18.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.314+0000 7fabbbecb740 1 -- start start 2024-09-21T07:14:18.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.314+0000 7fabbbecb740 1 Processor -- start 2024-09-21T07:14:18.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c31010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c31550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04587e350 0x55a045c3aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabbbecb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0459ec890 con 0x55a04587e350 2024-09-21T07:14:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabbbecb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a045b25d40 con 0x55a045855490 2024-09-21T07:14:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabbbecb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a045c3c4c0 con 0x55a04585d670 2024-09-21T07:14:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabbbecb740 10 client.0 _ll_register_callbacks cb 0x55a045b89c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabaf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04587e350 0x55a045c3aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabaeffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c31010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabae7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c31550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabaeffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c31010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:42038/0 (socket says 172.21.15.92:42038) 2024-09-21T07:14:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabae7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c31550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:58118/0 (socket says 172.21.15.92:58118) 2024-09-21T07:14:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabaeffd640 1 -- 172.21.15.92:0/2086751560 learned_addr learned my addr 172.21.15.92:0/2086751560 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabae7fc640 1 -- 172.21.15.92:0/2086751560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 msgr2=0x55a045c31010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabae7fc640 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c31010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabae7fc640 1 -- 172.21.15.92:0/2086751560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04587e350 msgr2=0x55a045c3aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.315+0000 7fabae7fc640 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04587e350 0x55a045c3aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.316+0000 7fabae7fc640 1 -- 172.21.15.92:0/2086751560 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a045c3afb0 con 0x55a04585d670 2024-09-21T07:14:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.316+0000 7fabae7fc640 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c31550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faba40e8d60 tx=0x7faba40bace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de42a30858bb5e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.316+0000 7fab8effd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:14:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.316+0000 7fab8effd640 1 -- 172.21.15.92:0/2086751560 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba40adb60 con 0x55a04585d670 2024-09-21T07:14:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.316+0000 7fabbbecb740 1 -- 172.21.15.92:0/2086751560 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faba8036040 con 0x55a04585d670 2024-09-21T07:14:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.316+0000 7fab8effd640 1 -- 172.21.15.92:0/2086751560 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7faba40110b0 con 0x55a04585d670 2024-09-21T07:14:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.316+0000 7fab8effd640 1 -- 172.21.15.92:0/2086751560 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faba40b0c80 con 0x55a04585d670 2024-09-21T07:14:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.316+0000 7fabbbecb740 10 client.25522 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.316+0000 7fabbbecb740 1 -- 172.21.15.92:0/2086751560 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a045c50ed0 con 0x55a04585d670 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.316+0000 7fab8effd640 1 -- 172.21.15.92:0/2086751560 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faba8036040 con 0x55a04585d670 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.317+0000 7fab8effd640 1 -- 172.21.15.92:0/2086751560 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faba40b01e0 con 0x55a04585d670 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.317+0000 7fabbbecb740 10 client.25522 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.317+0000 7fabbbecb740 10 client.25522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.317+0000 7fabbbecb740 20 client.25522 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.317+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04583ccd0 0x55a045c54260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.317+0000 7fabbbecb740 4 client.25522 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.317+0000 7fabbbecb740 1 -- 172.21.15.92:0/2086751560 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a045b9ddb0 con 0x55a04583ccd0 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.317+0000 7fabaeffd640 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04583ccd0 0x55a045c54260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.317+0000 7fab8effd640 10 client.25522 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.318+0000 7fabaeffd640 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04583ccd0 0x55a045c54260 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fe79a229cd494a0 server_cookie=c7a37fc5dfa85cdb in_seq=0 out_seq=0 2024-09-21T07:14:18.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.318+0000 7fab8effd640 1 -- 172.21.15.92:0/2086751560 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a045b9ddb0 con 0x55a04583ccd0 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.318+0000 7fab8effd640 10 client.25522 handle_command_reply: tid=0 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.318+0000 7fabbbecb740 1 client.25522 shutdown 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 1 -- 172.21.15.92:0/2086751560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 msgr2=0x55a045c31550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c31550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faba40e8d60 tx=0x7faba40bace0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 1 -- 172.21.15.92:0/2086751560 shutdown_connections 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04583ccd0 0x55a045c54260 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04587e350 0x55a045c3aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c31550 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2086751560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c31010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 1 -- 172.21.15.92:0/2086751560 >> 172.21.15.92:0/2086751560 conn(0x55a045872740 msgr2=0x55a045c26460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fab8effd640 0 client.25522 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 1 -- 172.21.15.92:0/2086751560 shutdown_connections 2024-09-21T07:14:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 1 -- 172.21.15.92:0/2086751560 wait complete. 2024-09-21T07:14:18.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.319+0000 7fabbbecb740 20 client.25522 trim_cache size 0 max 16384 2024-09-21T07:14:18.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.337+0000 7fabbbecb740 1 Processor -- start 2024-09-21T07:14:18.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.337+0000 7fabbbecb740 1 -- start start 2024-09-21T07:14:18.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.337+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c26ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.337+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04585d670 0x55a045c2b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.337+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04587e350 0x55a045c32a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.337+0000 7fabbbecb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fabb0074c90 con 0x55a04585d670 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.337+0000 7fabbbecb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fabb01a7ee0 con 0x55a045855490 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.337+0000 7fabbbecb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fabb0075360 con 0x55a04587e350 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabae7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04585d670 0x55a045c2b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabae7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04585d670 0x55a045c2b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49676/0 (socket says 172.21.15.92:49676) 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabae7fc640 1 -- 172.21.15.92:0/646728195 learned_addr learned my addr 172.21.15.92:0/646728195 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabaeffd640 1 --2- 172.21.15.92:0/646728195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c26ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabaf7fe640 1 --2- 172.21.15.92:0/646728195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04587e350 0x55a045c32a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabae7fc640 1 -- 172.21.15.92:0/646728195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04587e350 msgr2=0x55a045c32a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabae7fc640 1 --2- 172.21.15.92:0/646728195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04587e350 0x55a045c32a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabae7fc640 1 -- 172.21.15.92:0/646728195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 msgr2=0x55a045c26ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabae7fc640 1 --2- 172.21.15.92:0/646728195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c26ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabae7fc640 1 -- 172.21.15.92:0/646728195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a045c320d0 con 0x55a04585d670 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.338+0000 7fabae7fc640 1 --2- 172.21.15.92:0/646728195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04585d670 0x55a045c2b550 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7faba40b1210 tx=0x7faba40e8e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c84beb60c28d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.339+0000 7fab957fa640 1 -- 172.21.15.92:0/646728195 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba40b0e60 con 0x55a04585d670 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.339+0000 7fab957fa640 1 -- 172.21.15.92:0/646728195 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faba40b1020 con 0x55a04585d670 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.339+0000 7fab957fa640 1 -- 172.21.15.92:0/646728195 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba40b12e0 con 0x55a04585d670 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.340+0000 7fabbbecb740 1 -- 172.21.15.92:0/646728195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04585d670 msgr2=0x55a045c2b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.340+0000 7fabbbecb740 1 --2- 172.21.15.92:0/646728195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04585d670 0x55a045c2b550 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7faba40b1210 tx=0x7faba40e8e40 comp rx=0 tx=0).stop 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.340+0000 7fabbbecb740 1 -- 172.21.15.92:0/646728195 shutdown_connections 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.340+0000 7fabbbecb740 1 --2- 172.21.15.92:0/646728195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04587e350 0x55a045c32a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.340+0000 7fabbbecb740 1 --2- 172.21.15.92:0/646728195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04585d670 0x55a045c2b550 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.340+0000 7fabbbecb740 1 --2- 172.21.15.92:0/646728195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c26ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.340+0000 7fabbbecb740 1 -- 172.21.15.92:0/646728195 >> 172.21.15.92:0/646728195 conn(0x55a045872740 msgr2=0x55a045c32330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:18.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.340+0000 7fabbbecb740 1 -- 172.21.15.92:0/646728195 shutdown_connections 2024-09-21T07:14:18.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.341+0000 7fabbbecb740 1 -- 172.21.15.92:0/646728195 wait complete. 2024-09-21T07:14:18.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.341+0000 7fabbbecb740 1 -- start start 2024-09-21T07:14:18.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.341+0000 7fabbbecb740 1 Processor -- start 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c36600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c36ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabbbecb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04587e350 0x55a045cb7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabbbecb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fabb01a7810 con 0x55a04587e350 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabbbecb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fabb01a7140 con 0x55a045855490 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabbbecb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fabb0072c70 con 0x55a04585d670 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabbbecb740 10 client.0 _ll_register_callbacks cb 0x7faba4013f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabaeffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c36600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabaeffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c36600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:42056/0 (socket says 172.21.15.92:42056) 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabaf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04587e350 0x55a045cb7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabaeffd640 1 -- 172.21.15.92:0/2861990316 learned_addr learned my addr 172.21.15.92:0/2861990316 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabae7fc640 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c36ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabaeffd640 1 -- 172.21.15.92:0/2861990316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 msgr2=0x55a045c36ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabaeffd640 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c36ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabaeffd640 1 -- 172.21.15.92:0/2861990316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04587e350 msgr2=0x55a045cb7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabaeffd640 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04587e350 0x55a045cb7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.342+0000 7fabaeffd640 1 -- 172.21.15.92:0/2861990316 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a045cb8240 con 0x55a045855490 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.343+0000 7fabaeffd640 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c36600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55a045c54970 tx=0x7faba0005b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=717e26ebdc63c0e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.343+0000 7fab8effd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.343+0000 7fab8effd640 1 -- 172.21.15.92:0/2861990316 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba003a020 con 0x55a045855490 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.343+0000 7fabbbecb740 1 -- 172.21.15.92:0/2861990316 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faba40b1020 con 0x55a045855490 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.343+0000 7fab8effd640 1 -- 172.21.15.92:0/2861990316 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7faba0030d40 con 0x55a045855490 2024-09-21T07:14:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.343+0000 7fab8effd640 1 -- 172.21.15.92:0/2861990316 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faba0045050 con 0x55a045855490 2024-09-21T07:14:18.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.343+0000 7fabbbecb740 10 client.25397 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:18.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.343+0000 7fabbbecb740 1 -- 172.21.15.92:0/2861990316 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a045cbf700 con 0x55a045855490 2024-09-21T07:14:18.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.344+0000 7fab8effd640 1 -- 172.21.15.92:0/2861990316 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faba40b1020 con 0x55a045855490 2024-09-21T07:14:18.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.344+0000 7fab8effd640 1 -- 172.21.15.92:0/2861990316 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faba000f040 con 0x55a045855490 2024-09-21T07:14:18.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.344+0000 7fabbbecb740 10 client.25397 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:18.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.344+0000 7fabbbecb740 10 client.25397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:18.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.344+0000 7fabbbecb740 20 client.25397 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:18.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.344+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a045812080 0x55a045cc1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:18.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.344+0000 7fabbbecb740 4 client.25397 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:14:18.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.344+0000 7fabbbecb740 1 -- 172.21.15.92:0/2861990316 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a045b99860 con 0x55a045812080 2024-09-21T07:14:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.344+0000 7fabae7fc640 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a045812080 0x55a045cc1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.346+0000 7fabae7fc640 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a045812080 0x55a045cc1ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63e0e37473680bdf server_cookie=740df9d2b2e2ef48 in_seq=0 out_seq=0 2024-09-21T07:14:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.346+0000 7fab8effd640 10 client.25397 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.347+0000 7fab8effd640 1 -- 172.21.15.92:0/2861990316 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a045b99860 con 0x55a045812080 2024-09-21T07:14:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.347+0000 7fab8effd640 10 client.25397 handle_command_reply: tid=0 2024-09-21T07:14:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.347+0000 7fabbbecb740 1 client.25397 shutdown 2024-09-21T07:14:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.348+0000 7fabbbecb740 1 -- 172.21.15.92:0/2861990316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 msgr2=0x55a045c36600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.348+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c36600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55a045c54970 tx=0x7faba0005b20 comp rx=0 tx=0).stop 2024-09-21T07:14:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.348+0000 7fabbbecb740 1 -- 172.21.15.92:0/2861990316 shutdown_connections 2024-09-21T07:14:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.348+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a045812080 0x55a045cc1ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.348+0000 7fab8effd640 0 client.25397 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.348+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04587e350 0x55a045cb7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.348+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04585d670 0x55a045c36ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.348+0000 7fabbbecb740 1 --2- 172.21.15.92:0/2861990316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a045855490 0x55a045c36600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.348+0000 7fabbbecb740 1 -- 172.21.15.92:0/2861990316 >> 172.21.15.92:0/2861990316 conn(0x55a045872740 msgr2=0x55a045c2a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.349+0000 7fabbbecb740 1 -- 172.21.15.92:0/2861990316 shutdown_connections 2024-09-21T07:14:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.349+0000 7fabbbecb740 1 -- 172.21.15.92:0/2861990316 wait complete. 2024-09-21T07:14:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.349+0000 7fabbbecb740 20 client.25397 trim_cache size 0 max 16384 2024-09-21T07:14:18.352 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:14:18.352 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:14:18.352 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424", 2024-09-21T07:14:18.352 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:14:18.352 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:14:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.349+0000 7fabb5957640 1 -- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab980b6790 msgr2=0x7fab980b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.349+0000 7fabb5957640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab980b6790 0x7fab980b8ca0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faba804c000 tx=0x7faba804d000 comp rx=0 tx=0).stop 2024-09-21T07:14:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.350+0000 7fabb5957640 1 -- 172.21.15.92:0/1218588332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0105300 msgr2=0x7fabb019a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.350+0000 7fabb5957640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0105300 0x7fabb019a8e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fabb006ad30 tx=0x7faba400ed90 comp rx=0 tx=0).stop 2024-09-21T07:14:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.350+0000 7fabb5957640 1 -- 172.21.15.92:0/1218588332 shutdown_connections 2024-09-21T07:14:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.350+0000 7fabb5957640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab980b6790 0x7fab980b8ca0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.350+0000 7fabb5957640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb010de10 0x7fabb019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.350+0000 7fabb5957640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabb0105300 0x7fabb019a8e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.350+0000 7fabb5957640 1 --2- 172.21.15.92:0/1218588332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabb01049b0 0x7fabb019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.350+0000 7fabb5957640 1 -- 172.21.15.92:0/1218588332 >> 172.21.15.92:0/1218588332 conn(0x7fabb0079730 msgr2=0x7fabb00ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.350+0000 7fabb5957640 1 -- 172.21.15.92:0/1218588332 shutdown_connections 2024-09-21T07:14:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:18.350+0000 7fabb5957640 1 -- 172.21.15.92:0/1218588332 wait complete. 2024-09-21T07:14:19.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:18 smithi175 ceph-mon[34064]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:14:19.087 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:18 smithi092 ceph-mon[30987]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:14:19.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:14:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:18 smithi169 ceph-mon[33705]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:14:19.498 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:19.622 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:14:19.949 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:19 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:14:19.949 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:19 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:14:19.949 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:19 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:14:19.949 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:19 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:14:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:19 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:14:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:19 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:14:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:19 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:14:20.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:19 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:14:20.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.092+0000 7f08ff9bf640 1 -- 172.21.15.92:0/1660312387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f8102730 msgr2=0x7f08f8107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.092+0000 7f08ff9bf640 1 --2- 172.21.15.92:0/1660312387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f8102730 0x7f08f8107b30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009900 tx=0x7f08e802a420 comp rx=0 tx=0).stop 2024-09-21T07:14:20.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.092+0000 7f08ff9bf640 1 -- 172.21.15.92:0/1660312387 shutdown_connections 2024-09-21T07:14:20.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.092+0000 7f08ff9bf640 1 --2- 172.21.15.92:0/1660312387 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08f8102b40 0x7f08f8108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.092+0000 7f08ff9bf640 1 --2- 172.21.15.92:0/1660312387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f8102730 0x7f08f8107b30 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.092+0000 7f08ff9bf640 1 --2- 172.21.15.92:0/1660312387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f806a5d0 0x7f08f81021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.092+0000 7f08ff9bf640 1 -- 172.21.15.92:0/1660312387 >> 172.21.15.92:0/1660312387 conn(0x7f08f8077c60 msgr2=0x7f08f80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:20.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.093+0000 7f08ff9bf640 1 -- 172.21.15.92:0/1660312387 shutdown_connections 2024-09-21T07:14:20.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.093+0000 7f08ff9bf640 1 -- 172.21.15.92:0/1660312387 wait complete. 2024-09-21T07:14:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.094+0000 7f08ff9bf640 1 Processor -- start 2024-09-21T07:14:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.094+0000 7f08ff9bf640 1 -- start start 2024-09-21T07:14:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.094+0000 7f08ff9bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08f806a5d0 0x7f08f8115e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.094+0000 7f08ff9bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f8102730 0x7f08f81120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.094+0000 7f08ff9bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f8102b40 0x7f08f8112810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.094+0000 7f08ff9bf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08f810b8d0 con 0x7f08f8102b40 2024-09-21T07:14:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.094+0000 7f08ff9bf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f08f810b750 con 0x7f08f806a5d0 2024-09-21T07:14:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.094+0000 7f08ff9bf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f08f810ba50 con 0x7f08f8102730 2024-09-21T07:14:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.095+0000 7f08fd75b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08f806a5d0 0x7f08f8115e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.095+0000 7f08fd75b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08f806a5d0 0x7f08f8115e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:58680/0 (socket says 172.21.15.92:58680) 2024-09-21T07:14:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.095+0000 7f08fd75b640 1 -- 172.21.15.92:0/741983704 learned_addr learned my addr 172.21.15.92:0/741983704 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.095+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f8102b40 0x7f08f8112810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.095+0000 7f08fd75b640 1 -- 172.21.15.92:0/741983704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f8102730 msgr2=0x7f08f81120f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:14:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.095+0000 7f08fd75b640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f8102730 0x7f08f81120f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.095+0000 7f08fd75b640 1 -- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f8102b40 msgr2=0x7f08f8112810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.095+0000 7f08fd75b640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f8102b40 0x7f08f8112810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.095+0000 7f08fd75b640 1 -- 172.21.15.92:0/741983704 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f81acb80 con 0x7f08f806a5d0 2024-09-21T07:14:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.095+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f8102b40 0x7f08f8112810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.096+0000 7f08fd75b640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08f806a5d0 0x7f08f8115e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c920 tx=0x7f08f400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.096+0000 7f08ee7fc640 1 -- 172.21.15.92:0/741983704 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4007c70 con 0x7f08f806a5d0 2024-09-21T07:14:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.096+0000 7f08ff9bf640 1 -- 172.21.15.92:0/741983704 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f81acd50 con 0x7f08f806a5d0 2024-09-21T07:14:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.096+0000 7f08ee7fc640 1 -- 172.21.15.92:0/741983704 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f4007e10 con 0x7f08f806a5d0 2024-09-21T07:14:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.096+0000 7f08ee7fc640 1 -- 172.21.15.92:0/741983704 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f40186f0 con 0x7f08f806a5d0 2024-09-21T07:14:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.096+0000 7f08ff9bf640 1 -- 172.21.15.92:0/741983704 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f81ad2d0 con 0x7f08f806a5d0 2024-09-21T07:14:20.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.100+0000 7f0905f33740 1 Processor -- start 2024-09-21T07:14:20.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.100+0000 7f0905f33740 1 -- start start 2024-09-21T07:14:20.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.100+0000 7f0905f33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a6c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.100+0000 7f0905f33740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 0x55a551a6cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.100+0000 7f0905f33740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5516a4390 0x55a551a6d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.100+0000 7f0905f33740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a5519e2e50 con 0x55a55169c1b0 2024-09-21T07:14:20.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.100+0000 7f0905f33740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a5519d2280 con 0x55a5516a4390 2024-09-21T07:14:20.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.100+0000 7f0905f33740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a5519d6090 con 0x55a5516c5070 2024-09-21T07:14:20.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.101+0000 7f08fdf5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a6c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.101+0000 7f08fdf5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a6c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:36840/0 (socket says 172.21.15.92:36840) 2024-09-21T07:14:20.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.101+0000 7f08fdf5c640 1 -- 172.21.15.92:0/1599740621 learned_addr learned my addr 172.21.15.92:0/1599740621 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:20.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.101+0000 7f08fcf5a640 1 --2- 172.21.15.92:0/1599740621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5516a4390 0x55a551a6d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.101+0000 7f08fdf5c640 1 -- 172.21.15.92:0/1599740621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5516a4390 msgr2=0x55a551a6d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:20.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.101+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/1599740621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5516a4390 0x55a551a6d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.101+0000 7f08fdf5c640 1 -- 172.21.15.92:0/1599740621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 msgr2=0x55a551a6cb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:14:20.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.101+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/1599740621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 0x55a551a6cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.101+0000 7f08fdf5c640 1 -- 172.21.15.92:0/1599740621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a551730650 con 0x55a5516c5070 2024-09-21T07:14:20.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.101+0000 7f08ee7fc640 1 -- 172.21.15.92:0/741983704 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7f08f40189b0 con 0x7f08f806a5d0 2024-09-21T07:14:20.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.102+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/1599740621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a6c650 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08f000a870 tx=0x7f08f0009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9831f9f7915e4fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:20.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.102+0000 7f08ee7fc640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f08e40b6810 0x7f08e40b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.102+0000 7f08e37fe640 1 -- 172.21.15.92:0/1599740621 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0018020 con 0x55a5516c5070 2024-09-21T07:14:20.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.102+0000 7f08e37fe640 1 -- 172.21.15.92:0/1599740621 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f0014400 con 0x55a5516c5070 2024-09-21T07:14:20.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.102+0000 7f08ee7fc640 1 -- 172.21.15.92:0/741983704 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f08f40e7e50 con 0x7f08f806a5d0 2024-09-21T07:14:20.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.103+0000 7f08fd75b640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f08e40b6810 0x7f08e40b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.103+0000 7f08e37fe640 1 -- 172.21.15.92:0/1599740621 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f00135c0 con 0x55a5516c5070 2024-09-21T07:14:20.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.103+0000 7f0905f33740 1 -- 172.21.15.92:0/1599740621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 msgr2=0x55a551a6c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.103+0000 7f0905f33740 1 --2- 172.21.15.92:0/1599740621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a6c650 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08f000a870 tx=0x7f08f0009650 comp rx=0 tx=0).stop 2024-09-21T07:14:20.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.103+0000 7f08fd75b640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f08e40b6810 0x7f08e40b8d20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f08f40e5140 tx=0x7f08f40ad620 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:20.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.103+0000 7f0905f33740 1 -- 172.21.15.92:0/1599740621 shutdown_connections 2024-09-21T07:14:20.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.103+0000 7f0905f33740 1 --2- 172.21.15.92:0/1599740621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5516a4390 0x55a551a6d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.103+0000 7f0905f33740 1 --2- 172.21.15.92:0/1599740621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 0x55a551a6cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.103+0000 7f0905f33740 1 --2- 172.21.15.92:0/1599740621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a6c650 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.104+0000 7f0905f33740 1 -- 172.21.15.92:0/1599740621 >> 172.21.15.92:0/1599740621 conn(0x55a5516b9460 msgr2=0x55a551a6a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:20.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.104+0000 7f0905f33740 1 -- 172.21.15.92:0/1599740621 shutdown_connections 2024-09-21T07:14:20.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.104+0000 7f0905f33740 1 -- 172.21.15.92:0/1599740621 wait complete. 2024-09-21T07:14:20.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.104+0000 7f0905f33740 1 -- start start 2024-09-21T07:14:20.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.104+0000 7f0905f33740 1 Processor -- start 2024-09-21T07:14:20.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f0905f33740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a77c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f0905f33740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 0x55a551a78140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f0905f33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a78680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f0905f33740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a551833700 con 0x55a5516a4390 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f0905f33740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a55196d110 con 0x55a55169c1b0 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f0905f33740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a551a7aed0 con 0x55a5516c5070 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f08fdf5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a77c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f08fcf5a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 0x55a551a78140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f08fdf5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a77c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:58702/0 (socket says 172.21.15.92:58702) 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f08fdf5c640 1 -- 172.21.15.92:0/3395517249 learned_addr learned my addr 172.21.15.92:0/3395517249 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.105+0000 7f0905f33740 10 client.0 _ll_register_callbacks cb 0x55a551986990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.106+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a78680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.106+0000 7f08fdf5c640 1 -- 172.21.15.92:0/3395517249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 msgr2=0x55a551a78680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.106+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a78680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.106+0000 7f08fdf5c640 1 -- 172.21.15.92:0/3395517249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 msgr2=0x55a551a78140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:20.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.106+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 0x55a551a78140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.106+0000 7f08fdf5c640 1 -- 172.21.15.92:0/3395517249 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a55199ac40 con 0x55a55169c1b0 2024-09-21T07:14:20.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.106+0000 7f08fcf5a640 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 0x55a551a78140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:20.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.106+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a77c00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08f00094c0 tx=0x7f08f0004aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67201f3ebf47b597 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:20.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.109+0000 7f08e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:14:20.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.109+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3395517249 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0018050 con 0x55a55169c1b0 2024-09-21T07:14:20.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.109+0000 7f0905f33740 1 -- 172.21.15.92:0/3395517249 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08f0014400 con 0x55a55169c1b0 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.109+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3395517249 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f08f001d420 con 0x55a55169c1b0 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.109+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3395517249 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f08f0031050 con 0x55a55169c1b0 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.109+0000 7f0905f33740 10 client.25406 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.110+0000 7f0905f33740 1 -- 172.21.15.92:0/3395517249 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a551a7d990 con 0x55a55169c1b0 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.110+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3395517249 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f001dab0 con 0x55a55169c1b0 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.110+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3395517249 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f08f001c640 con 0x55a55169c1b0 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.110+0000 7f0905f33740 10 client.25406 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.110+0000 7f0905f33740 10 client.25406 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.110+0000 7f0905f33740 20 client.25406 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.110+0000 7f0905f33740 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a5516839f0 0x55a551a81220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.110+0000 7f0905f33740 4 client.25406 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:20.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.110+0000 7f0905f33740 1 -- 172.21.15.92:0/3395517249 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f08f0014400 con 0x55a5516839f0 2024-09-21T07:14:20.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.111+0000 7f08fcf5a640 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a5516839f0 0x55a551a81220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.112+0000 7f08fcf5a640 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a5516839f0 0x55a551a81220 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d7ad6adc15e2cb9 server_cookie=c303bc06c84f05e7 in_seq=0 out_seq=0 2024-09-21T07:14:20.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.112+0000 7f08e0ff9640 10 client.25406 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:20.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.112+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3395517249 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f08f0014400 con 0x55a5516839f0 2024-09-21T07:14:20.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.112+0000 7f08e0ff9640 10 client.25406 handle_command_reply: tid=0 2024-09-21T07:14:20.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 client.25406 shutdown 2024-09-21T07:14:20.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 -- 172.21.15.92:0/3395517249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 msgr2=0x55a551a77c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a77c00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08f00094c0 tx=0x7f08f0004aa0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 -- 172.21.15.92:0/3395517249 shutdown_connections 2024-09-21T07:14:20.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a5516839f0 0x55a551a81220 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a78680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 0x55a551a78140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 --2- 172.21.15.92:0/3395517249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a77c00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 -- 172.21.15.92:0/3395517249 >> 172.21.15.92:0/3395517249 conn(0x55a5516b9460 msgr2=0x55a551a6f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:20.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f08e0ff9640 0 client.25406 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:20.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 -- 172.21.15.92:0/3395517249 shutdown_connections 2024-09-21T07:14:20.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.113+0000 7f0905f33740 1 -- 172.21.15.92:0/3395517249 wait complete. 2024-09-21T07:14:20.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.114+0000 7f0905f33740 20 client.25406 trim_cache size 0 max 16384 2024-09-21T07:14:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:19 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:14:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:19 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:14:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:19 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:14:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:19 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:14:20.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.148+0000 7f0905f33740 1 Processor -- start 2024-09-21T07:14:20.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.148+0000 7f0905f33740 1 -- start start 2024-09-21T07:14:20.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.149+0000 7f0905f33740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a79ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.149+0000 7f0905f33740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 0x55a551a6dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.149+0000 7f08fdf5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a79ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.149+0000 7f08fcf5a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 0x55a551a6dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.150+0000 7f0905f33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a69b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.150+0000 7f0905f33740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08f81aecb0 con 0x55a5516a4390 2024-09-21T07:14:20.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.150+0000 7f08fdf5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a79ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:58706/0 (socket says 172.21.15.92:58706) 2024-09-21T07:14:20.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.150+0000 7f08fdf5c640 1 -- 172.21.15.92:0/3468954962 learned_addr learned my addr 172.21.15.92:0/3468954962 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:20.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.150+0000 7f0905f33740 1 -- 172.21.15.92:0/3468954962 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f08f81b07f0 con 0x55a55169c1b0 2024-09-21T07:14:20.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.150+0000 7f0905f33740 1 -- 172.21.15.92:0/3468954962 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f08f81af380 con 0x55a5516c5070 2024-09-21T07:14:20.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.151+0000 7f08fcf5a640 1 -- 172.21.15.92:0/3468954962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 msgr2=0x55a551a69b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:14:20.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.151+0000 7f08fcf5a640 1 --2- 172.21.15.92:0/3468954962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a69b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.151+0000 7f08fcf5a640 1 -- 172.21.15.92:0/3468954962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 msgr2=0x55a551a79ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:20.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.151+0000 7f08fcf5a640 1 --2- 172.21.15.92:0/3468954962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a79ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.151+0000 7f08fcf5a640 1 -- 172.21.15.92:0/3468954962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a551a78ec0 con 0x55a5516a4390 2024-09-21T07:14:20.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.151+0000 7f08fcf5a640 1 --2- 172.21.15.92:0/3468954962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 0x55a551a6dd90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f08f81055e0 tx=0x7f08e80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6603d9ac7581e240 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:20.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.151+0000 7f08e2ffd640 1 -- 172.21.15.92:0/3468954962 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8035040 con 0x55a5516a4390 2024-09-21T07:14:20.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.151+0000 7f08e2ffd640 1 -- 172.21.15.92:0/3468954962 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08e8004b50 con 0x55a5516a4390 2024-09-21T07:14:20.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.152+0000 7f08e2ffd640 1 -- 172.21.15.92:0/3468954962 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e80035f0 con 0x55a5516a4390 2024-09-21T07:14:20.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.153+0000 7f0905f33740 1 -- 172.21.15.92:0/3468954962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 msgr2=0x55a551a6dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.153+0000 7f0905f33740 1 --2- 172.21.15.92:0/3468954962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 0x55a551a6dd90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f08f81055e0 tx=0x7f08e80043c0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.155 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:20.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.153+0000 7f0905f33740 1 -- 172.21.15.92:0/3468954962 shutdown_connections 2024-09-21T07:14:20.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.153+0000 7f0905f33740 1 --2- 172.21.15.92:0/3468954962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551a69b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.153+0000 7f0905f33740 1 --2- 172.21.15.92:0/3468954962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5516a4390 0x55a551a6dd90 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.153+0000 7f0905f33740 1 --2- 172.21.15.92:0/3468954962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a55169c1b0 0x55a551a79ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.153+0000 7f0905f33740 1 -- 172.21.15.92:0/3468954962 >> 172.21.15.92:0/3468954962 conn(0x55a5516b9460 msgr2=0x55a551a6d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:20.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.153+0000 7f0905f33740 1 -- 172.21.15.92:0/3468954962 shutdown_connections 2024-09-21T07:14:20.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.153+0000 7f0905f33740 1 -- 172.21.15.92:0/3468954962 wait complete. 2024-09-21T07:14:20.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.154+0000 7f0905f33740 1 -- start start 2024-09-21T07:14:20.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.154+0000 7f0905f33740 1 Processor -- start 2024-09-21T07:14:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.155+0000 7f0905f33740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 0x55a551a84200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.155+0000 7f08fdf5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 0x55a551a84200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.155+0000 7f08fdf5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 0x55a551a84200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33178/0 (socket says 172.21.15.92:33178) 2024-09-21T07:14:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.155+0000 7f08fdf5c640 1 -- 172.21.15.92:0/3692915873 learned_addr learned my addr 172.21.15.92:0/3692915873 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.155+0000 7f0905f33740 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5516a4390 0x55a551a847a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.155+0000 7f0905f33740 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551b155b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.156+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08f81b0120 con 0x55a55169c1b0 2024-09-21T07:14:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.156+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f08f81afa50 con 0x55a5516a4390 2024-09-21T07:14:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.156+0000 7f08fcf5a640 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5516a4390 0x55a551a847a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.156+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f08f81133f0 con 0x55a5516c5070 2024-09-21T07:14:20.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.156+0000 7f08fdf5c640 1 -- 172.21.15.92:0/3692915873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 msgr2=0x55a551b155b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:20.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.156+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551b155b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.156+0000 7f08fdf5c640 1 -- 172.21.15.92:0/3692915873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5516a4390 msgr2=0x55a551a847a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:20.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.156+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5516a4390 0x55a551a847a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.156+0000 7f08fdf5c640 1 -- 172.21.15.92:0/3692915873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a551b15bf0 con 0x55a55169c1b0 2024-09-21T07:14:20.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.157+0000 7f0905f33740 10 client.0 _ll_register_callbacks cb 0x7f08e8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:20.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.157+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08e8004b50 con 0x55a55169c1b0 2024-09-21T07:14:20.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.157+0000 7f08fdf5c640 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 0x55a551a84200 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f08f001cb20 tx=0x7f08f000e5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d051630fdd8bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.157+0000 7f08e0ff9640 10 client.16077 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.157+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3692915873 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f003a060 con 0x55a55169c1b0 2024-09-21T07:14:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3692915873 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f08f001c5b0 con 0x55a55169c1b0 2024-09-21T07:14:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3692915873 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f08f002e070 con 0x55a55169c1b0 2024-09-21T07:14:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f0905f33740 10 client.16077 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a551b16cc0 con 0x55a55169c1b0 2024-09-21T07:14:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3692915873 <== mon.0 v2:172.21.15.92:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f08f002a420 con 0x55a55169c1b0 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f0905f33740 10 client.16077 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f0905f33740 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f0905f33740 20 client.16077 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f0905f33740 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a551658da0 0x55a551b19340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f0905f33740 4 client.16077 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.158+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a5519e4da0 con 0x55a551658da0 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.159+0000 7f08fcf5a640 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a551658da0 0x55a551b19340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.159+0000 7f08fcf5a640 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a551658da0 0x55a551b19340 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced164dbef27203a server_cookie=e0154370a7abc802 in_seq=0 out_seq=0 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.159+0000 7f08e0ff9640 10 client.16077 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.159+0000 7f08e0ff9640 1 -- 172.21.15.92:0/3692915873 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55a5519e4da0 con 0x55a551658da0 2024-09-21T07:14:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.159+0000 7f08e0ff9640 10 client.16077 handle_command_reply: tid=0 2024-09-21T07:14:20.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.159+0000 7f0905f33740 1 client.16077 shutdown 2024-09-21T07:14:20.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 msgr2=0x55a551a84200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 0x55a551a84200 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f08f001cb20 tx=0x7f08f000e5b0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 shutdown_connections 2024-09-21T07:14:20.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a551658da0 0x55a551b19340 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f08e0ff9640 0 client.16077 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:20.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5516c5070 0x55a551b155b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5516a4390 0x55a551a847a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.164 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:14:20.164 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:14:20.164 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:14:20.164 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:14:20.164 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424", 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:14:20.165 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:14:20.166 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:14:20.166 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:14:20.166 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:14:20.166 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:14:20.166 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:14:20.166 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:14:20.166 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:20.166 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:20.166 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 1 --2- 172.21.15.92:0/3692915873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a55169c1b0 0x55a551a84200 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 >> 172.21.15.92:0/3692915873 conn(0x55a5516b9460 msgr2=0x55a551a79820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 shutdown_connections 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 1 -- 172.21.15.92:0/3692915873 wait complete. 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.160+0000 7f0905f33740 20 client.16077 trim_cache size 0 max 16384 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.162+0000 7f08ff9bf640 1 -- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f08e40b6810 msgr2=0x7f08e40b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.162+0000 7f08ff9bf640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f08e40b6810 0x7f08e40b8d20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f08f40e5140 tx=0x7f08f40ad620 comp rx=0 tx=0).stop 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.162+0000 7f08ff9bf640 1 -- 172.21.15.92:0/741983704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08f806a5d0 msgr2=0x7f08f8115e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.162+0000 7f08ff9bf640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08f806a5d0 0x7f08f8115e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c920 tx=0x7f08f400cde0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.162+0000 7f08ff9bf640 1 -- 172.21.15.92:0/741983704 shutdown_connections 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.162+0000 7f08ff9bf640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f08e40b6810 0x7f08e40b8d20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.163+0000 7f08ff9bf640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08f8102b40 0x7f08f8112810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.163+0000 7f08ff9bf640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f8102730 0x7f08f81120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.163+0000 7f08ff9bf640 1 --2- 172.21.15.92:0/741983704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08f806a5d0 0x7f08f8115e10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.163+0000 7f08ff9bf640 1 -- 172.21.15.92:0/741983704 >> 172.21.15.92:0/741983704 conn(0x7f08f8077c60 msgr2=0x7f08f8100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:20.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.163+0000 7f08ff9bf640 1 -- 172.21.15.92:0/741983704 shutdown_connections 2024-09-21T07:14:20.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:20.163+0000 7f08ff9bf640 1 -- 172.21.15.92:0/741983704 wait complete. 2024-09-21T07:14:20.855 INFO:tasks.cephfs.filesystem:scrub status for tag:a3f536c9-d1d0-43e0-a8b0-f66d83a0e424 - {'path': '/', 'tag': 'a3f536c9-d1d0-43e0-a8b0-f66d83a0e424', 'options': 'recursive,force'} 2024-09-21T07:14:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.970+0000 7f0f2d80e640 1 -- 172.21.15.92:0/2302983767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f28109d80 msgr2=0x7f0f281105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.970+0000 7f0f2d80e640 1 --2- 172.21.15.92:0/2302983767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f28109d80 0x7f0f281105b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009ca0 tx=0x7f0f2002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.970+0000 7f0f2d80e640 1 -- 172.21.15.92:0/2302983767 shutdown_connections 2024-09-21T07:14:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.970+0000 7f0f2d80e640 1 --2- 172.21.15.92:0/2302983767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f28109d80 0x7f0f281105b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.970+0000 7f0f2d80e640 1 --2- 172.21.15.92:0/2302983767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28109430 0x7f0f28109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.970+0000 7f0f2d80e640 1 --2- 172.21.15.92:0/2302983767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f28102060 0x7f0f28102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.970+0000 7f0f2d80e640 1 -- 172.21.15.92:0/2302983767 >> 172.21.15.92:0/2302983767 conn(0x7f0f28079e90 msgr2=0x7f0f2807a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.970+0000 7f0f2d80e640 1 -- 172.21.15.92:0/2302983767 shutdown_connections 2024-09-21T07:14:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.970+0000 7f0f2d80e640 1 -- 172.21.15.92:0/2302983767 wait complete. 2024-09-21T07:14:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.971+0000 7f0f2d80e640 1 Processor -- start 2024-09-21T07:14:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.971+0000 7f0f2d80e640 1 -- start start 2024-09-21T07:14:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.971+0000 7f0f2d80e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f28102060 0x7f0f2810d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.971+0000 7f0f2d80e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f28109430 0x7f0f2810dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.971+0000 7f0f2d80e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28109d80 0x7f0f2810e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.971+0000 7f0f2d80e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f28104830 con 0x7f0f28109430 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.971+0000 7f0f2d80e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f281046b0 con 0x7f0f28102060 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.971+0000 7f0f2d80e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f281049b0 con 0x7f0f28109d80 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f267fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f28109430 0x7f0f2810dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f267fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f28109430 0x7f0f2810dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33196/0 (socket says 172.21.15.92:33196) 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f267fc640 1 -- 172.21.15.92:0/1638005365 learned_addr learned my addr 172.21.15.92:0/1638005365 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f28102060 0x7f0f2810d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f277fe640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28109d80 0x7f0f2810e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f267fc640 1 -- 172.21.15.92:0/1638005365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28109d80 msgr2=0x7f0f2810e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f267fc640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28109d80 0x7f0f2810e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f267fc640 1 -- 172.21.15.92:0/1638005365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f28102060 msgr2=0x7f0f2810d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f267fc640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f28102060 0x7f0f2810d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f267fc640 1 -- 172.21.15.92:0/1638005365 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f281aca00 con 0x7f0f28109430 2024-09-21T07:14:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.972+0000 7f0f267fc640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f28109430 0x7f0f2810dec0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000c8c0 tx=0x7f0f1000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.973+0000 7f0f2c80c640 1 -- 172.21.15.92:0/1638005365 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10007b50 con 0x7f0f28109430 2024-09-21T07:14:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.973+0000 7f0f2d80e640 1 -- 172.21.15.92:0/1638005365 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f281accf0 con 0x7f0f28109430 2024-09-21T07:14:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.973+0000 7f0f2c80c640 1 -- 172.21.15.92:0/1638005365 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f10007cf0 con 0x7f0f28109430 2024-09-21T07:14:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.973+0000 7f0f2c80c640 1 -- 172.21.15.92:0/1638005365 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10018660 con 0x7f0f28109430 2024-09-21T07:14:20.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.973+0000 7f0f2d80e640 1 -- 172.21.15.92:0/1638005365 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f281ad1d0 con 0x7f0f28109430 2024-09-21T07:14:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.976+0000 7f0f34859740 1 Processor -- start 2024-09-21T07:14:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f34859740 1 -- start start 2024-09-21T07:14:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f34859740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd22a1b0 0x5618fd5cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f34859740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f34859740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f34859740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618fd5446f0 con 0x5618fd2094d0 2024-09-21T07:14:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f34859740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618fd533b20 con 0x5618fd22a1b0 2024-09-21T07:14:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f34859740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5618fd537930 con 0x5618fd2012f0 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f26ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f26ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:36884/0 (socket says 172.21.15.92:36884) 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f26ffd640 1 -- 172.21.15.92:0/2430525874 learned_addr learned my addr 172.21.15.92:0/2430525874 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f277fe640 1 --2- 172.21.15.92:0/2430525874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd22a1b0 0x5618fd5cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.977+0000 7f0f2c80c640 1 -- 172.21.15.92:0/1638005365 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7f0f1000f450 con 0x7f0f28109430 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.978+0000 7f0f26ffd640 1 -- 172.21.15.92:0/2430525874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd22a1b0 msgr2=0x5618fd5cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.978+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/2430525874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd22a1b0 0x5618fd5cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.978+0000 7f0f26ffd640 1 -- 172.21.15.92:0/2430525874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 msgr2=0x5618fd5d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.978+0000 7f0f267fc640 1 --2- 172.21.15.92:0/2430525874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.978+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/2430525874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.978+0000 7f0f26ffd640 1 -- 172.21.15.92:0/2430525874 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fd4f9530 con 0x5618fd2012f0 2024-09-21T07:14:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.978+0000 7f0f267fc640 1 --2- 172.21.15.92:0/2430525874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:14:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.978+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/2430525874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5cfef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009a70 tx=0x7f0f18009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=319ea7270765fc78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.978+0000 7f0f1dffb640 1 -- 172.21.15.92:0/2430525874 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18017070 con 0x5618fd2012f0 2024-09-21T07:14:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.979+0000 7f0f1dffb640 1 -- 172.21.15.92:0/2430525874 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f18013470 con 0x5618fd2012f0 2024-09-21T07:14:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.979+0000 7f0f1dffb640 1 -- 172.21.15.92:0/2430525874 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18012630 con 0x5618fd2012f0 2024-09-21T07:14:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.979+0000 7f0f2c80c640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f140b6790 0x7f0f140b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.979+0000 7f0f277fe640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f140b6790 0x7f0f140b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.979+0000 7f0f2c80c640 1 -- 172.21.15.92:0/1638005365 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0f100e7ce0 con 0x7f0f28109430 2024-09-21T07:14:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.980+0000 7f0f34859740 1 -- 172.21.15.92:0/2430525874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 msgr2=0x5618fd5cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.980+0000 7f0f277fe640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f140b6790 0x7f0f140b8ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0f20006010 tx=0x7f0f20005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.980+0000 7f0f34859740 1 --2- 172.21.15.92:0/2430525874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5cfef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009a70 tx=0x7f0f18009f30 comp rx=0 tx=0).stop 2024-09-21T07:14:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.980+0000 7f0f34859740 1 -- 172.21.15.92:0/2430525874 shutdown_connections 2024-09-21T07:14:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.980+0000 7f0f34859740 1 --2- 172.21.15.92:0/2430525874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.980+0000 7f0f34859740 1 --2- 172.21.15.92:0/2430525874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5cfef0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.980+0000 7f0f34859740 1 --2- 172.21.15.92:0/2430525874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd22a1b0 0x5618fd5cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.980+0000 7f0f34859740 1 -- 172.21.15.92:0/2430525874 >> 172.21.15.92:0/2430525874 conn(0x5618fd21e300 msgr2=0x5618fd5cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.980+0000 7f0f34859740 1 -- 172.21.15.92:0/2430525874 shutdown_connections 2024-09-21T07:14:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.980+0000 7f0f34859740 1 -- 172.21.15.92:0/2430525874 wait complete. 2024-09-21T07:14:20.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.981+0000 7f0f34859740 1 -- start start 2024-09-21T07:14:20.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.981+0000 7f0f34859740 1 Processor -- start 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.982+0000 7f0f34859740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5db040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.982+0000 7f0f34859740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5db580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.982+0000 7f0f34859740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd22a1b0 0x5618fd5e7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.982+0000 7f0f34859740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618fd46bab0 con 0x5618fd2094d0 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.982+0000 7f0f267fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5db580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.982+0000 7f0f267fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5db580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33220/0 (socket says 172.21.15.92:33220) 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.982+0000 7f0f267fc640 1 -- 172.21.15.92:0/3995004144 learned_addr learned my addr 172.21.15.92:0/3995004144 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.982+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5db040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.982+0000 7f0f34859740 1 -- 172.21.15.92:0/3995004144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618fd4d9730 con 0x5618fd22a1b0 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f34859740 1 -- 172.21.15.92:0/3995004144 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5618fd5de130 con 0x5618fd2012f0 2024-09-21T07:14:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f277fe640 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd22a1b0 0x5618fd5e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f34859740 10 client.0 _ll_register_callbacks cb 0x5618fd52d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f267fc640 1 -- 172.21.15.92:0/3995004144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 msgr2=0x5618fd5db040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f267fc640 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5db040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f267fc640 1 -- 172.21.15.92:0/3995004144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd22a1b0 msgr2=0x5618fd5e7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f267fc640 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd22a1b0 0x5618fd5e7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f267fc640 1 -- 172.21.15.92:0/3995004144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618fd295790 con 0x5618fd2094d0 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f34859740 1 -- 172.21.15.92:0/3995004144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f18013470 con 0x5618fd2094d0 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f267fc640 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5db580 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0f1001f000 tx=0x7f0f100e5520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99901f7523c4a187 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.983+0000 7f0f06ffd640 10 client.16086 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.984+0000 7f0f06ffd640 1 -- 172.21.15.92:0/3995004144 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f100acd30 con 0x5618fd2094d0 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.984+0000 7f0f06ffd640 1 -- 172.21.15.92:0/3995004144 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0f100ac820 con 0x5618fd2094d0 2024-09-21T07:14:20.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.984+0000 7f0f06ffd640 1 -- 172.21.15.92:0/3995004144 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0f100aca80 con 0x5618fd2094d0 2024-09-21T07:14:20.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.984+0000 7f0f34859740 10 client.16086 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:20.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.984+0000 7f0f34859740 1 -- 172.21.15.92:0/3995004144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5618fd30e620 con 0x5618fd2094d0 2024-09-21T07:14:20.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.984+0000 7f0f06ffd640 1 -- 172.21.15.92:0/3995004144 <== mon.0 v2:172.21.15.92:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0f100a8f10 con 0x5618fd2094d0 2024-09-21T07:14:20.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.984+0000 7f0f34859740 10 client.16086 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:20.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.984+0000 7f0f34859740 10 client.16086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:20.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.985+0000 7f0f34859740 20 client.16086 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:20.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.985+0000 7f0f34859740 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618fd1e8d80 0x5618fd5ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:20.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.985+0000 7f0f34859740 4 client.16086 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:20.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.985+0000 7f0f34859740 1 -- 172.21.15.92:0/3995004144 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618fd546640 con 0x5618fd1e8d80 2024-09-21T07:14:20.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.985+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618fd1e8d80 0x5618fd5ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:20.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.985+0000 7f0f06ffd640 10 client.16086 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.985+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618fd1e8d80 0x5618fd5ecf10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7418040cd9059216 server_cookie=de04f697b7a2842a in_seq=0 out_seq=0 2024-09-21T07:14:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.986+0000 7f0f06ffd640 1 -- 172.21.15.92:0/3995004144 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618fd546640 con 0x5618fd1e8d80 2024-09-21T07:14:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.986+0000 7f0f06ffd640 10 client.16086 handle_command_reply: tid=0 2024-09-21T07:14:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.986+0000 7f0f34859740 1 client.16086 shutdown 2024-09-21T07:14:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.986+0000 7f0f34859740 1 -- 172.21.15.92:0/3995004144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 msgr2=0x5618fd5db580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f34859740 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5db580 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0f1001f000 tx=0x7f0f100e5520 comp rx=0 tx=0).stop 2024-09-21T07:14:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f34859740 1 -- 172.21.15.92:0/3995004144 shutdown_connections 2024-09-21T07:14:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f34859740 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618fd1e8d80 0x5618fd5ecf10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f34859740 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd22a1b0 0x5618fd5e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f34859740 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd2094d0 0x5618fd5db580 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f06ffd640 0 client.16086 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f34859740 1 --2- 172.21.15.92:0/3995004144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5db040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f34859740 1 -- 172.21.15.92:0/3995004144 >> 172.21.15.92:0/3995004144 conn(0x5618fd21e300 msgr2=0x5618fd5d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f34859740 1 -- 172.21.15.92:0/3995004144 shutdown_connections 2024-09-21T07:14:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f34859740 1 -- 172.21.15.92:0/3995004144 wait complete. 2024-09-21T07:14:20.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:20.987+0000 7f0f34859740 20 client.16086 trim_cache size 0 max 16384 2024-09-21T07:14:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.016+0000 7f0f34859740 1 Processor -- start 2024-09-21T07:14:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.016+0000 7f0f34859740 1 -- start start 2024-09-21T07:14:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:20 smithi175 ceph-mon[34064]: pgmap v377: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-21T07:14:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.016+0000 7f0f34859740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5dcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.016+0000 7f0f34859740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5e7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.016+0000 7f0f34859740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd2094d0 0x5618fd5d8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.016+0000 7f0f34859740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f281b7480 con 0x5618fd1e8d80 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.016+0000 7f0f34859740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f281b8fc0 con 0x5618fd2094d0 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.016+0000 7f0f34859740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f281b7b50 con 0x5618fd2012f0 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.016+0000 7f0f26ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5dcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f26ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5dcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33232/0 (socket says 172.21.15.92:33232) 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f26ffd640 1 -- 172.21.15.92:0/2700545117 learned_addr learned my addr 172.21.15.92:0/2700545117 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f267fc640 1 --2- 172.21.15.92:0/2700545117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f277fe640 1 --2- 172.21.15.92:0/2700545117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd2094d0 0x5618fd5d8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f26ffd640 1 -- 172.21.15.92:0/2700545117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 msgr2=0x5618fd5e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/2700545117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f26ffd640 1 -- 172.21.15.92:0/2700545117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd2094d0 msgr2=0x5618fd5d8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/2700545117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd2094d0 0x5618fd5d8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f26ffd640 1 -- 172.21.15.92:0/2700545117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fd5d9520 con 0x5618fd1e8d80 2024-09-21T07:14:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/2700545117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5dcc70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0f18008010 tx=0x7f0f18009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00d78dd28c0350 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f1d7fa640 1 -- 172.21.15.92:0/2700545117 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18017040 con 0x5618fd1e8d80 2024-09-21T07:14:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f1d7fa640 1 -- 172.21.15.92:0/2700545117 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f1800ec40 con 0x5618fd1e8d80 2024-09-21T07:14:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.017+0000 7f0f1d7fa640 1 -- 172.21.15.92:0/2700545117 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1801cc10 con 0x5618fd1e8d80 2024-09-21T07:14:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.019+0000 7f0f34859740 1 -- 172.21.15.92:0/2700545117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 msgr2=0x5618fd5dcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.019+0000 7f0f34859740 1 --2- 172.21.15.92:0/2700545117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5dcc70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0f18008010 tx=0x7f0f18009110 comp rx=0 tx=0).stop 2024-09-21T07:14:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.019+0000 7f0f34859740 1 -- 172.21.15.92:0/2700545117 shutdown_connections 2024-09-21T07:14:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.019+0000 7f0f34859740 1 --2- 172.21.15.92:0/2700545117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd2094d0 0x5618fd5d8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.019+0000 7f0f34859740 1 --2- 172.21.15.92:0/2700545117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.019+0000 7f0f34859740 1 --2- 172.21.15.92:0/2700545117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5dcc70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.019+0000 7f0f34859740 1 -- 172.21.15.92:0/2700545117 >> 172.21.15.92:0/2700545117 conn(0x5618fd21e300 msgr2=0x5618fd5dc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.019+0000 7f0f34859740 1 -- 172.21.15.92:0/2700545117 shutdown_connections 2024-09-21T07:14:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.019+0000 7f0f34859740 1 -- 172.21.15.92:0/2700545117 wait complete. 2024-09-21T07:14:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.019+0000 7f0f34859740 1 -- start start 2024-09-21T07:14:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.020+0000 7f0f34859740 1 Processor -- start 2024-09-21T07:14:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.020+0000 7f0f34859740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5e39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.020+0000 7f0f34859740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.020+0000 7f0f34859740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd2094d0 0x5618fd5e13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.020+0000 7f0f26ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5e39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.020+0000 7f0f26ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5e39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33248/0 (socket says 172.21.15.92:33248) 2024-09-21T07:14:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.020+0000 7f0f26ffd640 1 -- 172.21.15.92:0/1978584409 learned_addr learned my addr 172.21.15.92:0/1978584409 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.020+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f281b88f0 con 0x5618fd1e8d80 2024-09-21T07:14:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.020+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f281b8220 con 0x5618fd2094d0 2024-09-21T07:14:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f281b5460 con 0x5618fd2012f0 2024-09-21T07:14:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f267fc640 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f277fe640 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd2094d0 0x5618fd5e13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f34859740 10 client.0 _ll_register_callbacks cb 0x7f0f100e4e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f26ffd640 1 -- 172.21.15.92:0/1978584409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 msgr2=0x5618fd5e0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5e0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f26ffd640 1 -- 172.21.15.92:0/1978584409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd2094d0 msgr2=0x5618fd5e13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd2094d0 0x5618fd5e13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f26ffd640 1 -- 172.21.15.92:0/1978584409 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618fd5e19b0 con 0x5618fd1e8d80 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f26ffd640 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5e39c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0f180094f0 tx=0x7f0f18009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbc0b33661a0d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.021+0000 7f0f06ffd640 1 -- 172.21.15.92:0/1978584409 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18017040 con 0x5618fd1e8d80 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f06ffd640 1 -- 172.21.15.92:0/1978584409 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0f1801c660 con 0x5618fd1e8d80 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f1800ec40 con 0x5618fd1e8d80 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f06ffd640 1 -- 172.21.15.92:0/1978584409 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0f18040050 con 0x5618fd1e8d80 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f34859740 10 client.16092 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5618fd6576d0 con 0x5618fd1e8d80 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f06ffd640 1 -- 172.21.15.92:0/1978584409 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f1800ec40 con 0x5618fd1e8d80 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f06ffd640 1 -- 172.21.15.92:0/1978584409 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0f1801cb20 con 0x5618fd1e8d80 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f34859740 10 client.16092 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f34859740 10 client.16092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f34859740 20 client.16092 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f34859740 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618fd22a1b0 0x5618fd659ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f34859740 4 client.16092 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:14:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.022+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618fd5420f0 con 0x5618fd22a1b0 2024-09-21T07:14:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.023+0000 7f0f267fc640 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618fd22a1b0 0x5618fd659ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.023+0000 7f0f06ffd640 10 client.16092 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.023+0000 7f0f267fc640 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618fd22a1b0 0x5618fd659ac0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2597bb3302a7df9a server_cookie=5e7e09fa4f8b796f in_seq=0 out_seq=0 2024-09-21T07:14:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.030+0000 7f0f06ffd640 1 -- 172.21.15.92:0/1978584409 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618fd5420f0 con 0x5618fd22a1b0 2024-09-21T07:14:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.030+0000 7f0f06ffd640 10 client.16092 handle_command_reply: tid=0 2024-09-21T07:14:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.030+0000 7f0f34859740 1 client.16092 shutdown 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.030+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 msgr2=0x5618fd5e39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.030+0000 7f0f34859740 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5e39c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0f180094f0 tx=0x7f0f18009520 comp rx=0 tx=0).stop 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.030+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 shutdown_connections 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.030+0000 7f0f34859740 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618fd22a1b0 0x5618fd659ac0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.031+0000 7f0f34859740 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618fd2094d0 0x5618fd5e13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.031+0000 7f0f34859740 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618fd2012f0 0x5618fd5e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.031+0000 7f0f34859740 1 --2- 172.21.15.92:0/1978584409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fd1e8d80 0x5618fd5e39c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.031+0000 7f0f06ffd640 0 client.16092 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.031+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 >> 172.21.15.92:0/1978584409 conn(0x5618fd21e300 msgr2=0x5618fd5d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.031+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 shutdown_connections 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.031+0000 7f0f34859740 1 -- 172.21.15.92:0/1978584409 wait complete. 2024-09-21T07:14:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.031+0000 7f0f34859740 20 client.16092 trim_cache size 0 max 16384 2024-09-21T07:14:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:14:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:14:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:14:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:14:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.031+0000 7f0f2d80e640 1 -- 172.21.15.92:0/1638005365 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f140b6790 msgr2=0x7f0f140b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f140b6790 0x7f0f140b8ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0f20006010 tx=0x7f0f20005c30 comp rx=0 tx=0).stop 2024-09-21T07:14:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 -- 172.21.15.92:0/1638005365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f28109430 msgr2=0x7f0f2810dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f28109430 0x7f0f2810dec0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000c8c0 tx=0x7f0f1000ccc0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 -- 172.21.15.92:0/1638005365 shutdown_connections 2024-09-21T07:14:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f140b6790 0x7f0f140b8ca0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28109d80 0x7f0f2810e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f28109430 0x7f0f2810dec0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 --2- 172.21.15.92:0/1638005365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f28102060 0x7f0f2810d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 -- 172.21.15.92:0/1638005365 >> 172.21.15.92:0/1638005365 conn(0x7f0f28079e90 msgr2=0x7f0f281073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 -- 172.21.15.92:0/1638005365 shutdown_connections 2024-09-21T07:14:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:21.032+0000 7f0f2d80e640 1 -- 172.21.15.92:0/1638005365 wait complete. 2024-09-21T07:14:21.096 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:20 smithi092 ceph-mon[30987]: pgmap v377: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-21T07:14:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:20 smithi169 ceph-mon[33705]: pgmap v377: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-21T07:14:21.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.349+0000 7f35daba7640 1 -- 172.21.15.92:0/1303396830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d4105300 msgr2=0x7f35d410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:21.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.349+0000 7f35daba7640 1 --2- 172.21.15.92:0/1303396830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d4105300 0x7f35d410d850 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009900 tx=0x7f35c002a410 comp rx=0 tx=0).stop 2024-09-21T07:14:21.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.349+0000 7f35daba7640 1 -- 172.21.15.92:0/1303396830 shutdown_connections 2024-09-21T07:14:21.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.349+0000 7f35daba7640 1 --2- 172.21.15.92:0/1303396830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d410de10 0x7f35d4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.349+0000 7f35daba7640 1 --2- 172.21.15.92:0/1303396830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d4105300 0x7f35d410d850 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.349+0000 7f35daba7640 1 --2- 172.21.15.92:0/1303396830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d41049b0 0x7f35d4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.349+0000 7f35daba7640 1 -- 172.21.15.92:0/1303396830 >> 172.21.15.92:0/1303396830 conn(0x7f35d4079730 msgr2=0x7f35d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:21.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.349+0000 7f35daba7640 1 -- 172.21.15.92:0/1303396830 shutdown_connections 2024-09-21T07:14:21.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.349+0000 7f35daba7640 1 -- 172.21.15.92:0/1303396830 wait complete. 2024-09-21T07:14:21.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.350+0000 7f35daba7640 1 Processor -- start 2024-09-21T07:14:21.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.350+0000 7f35daba7640 1 -- start start 2024-09-21T07:14:21.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35daba7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d41049b0 0x7f35d419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35daba7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d4105300 0x7f35d419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35daba7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d410de10 0x7f35d419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d4105300 0x7f35d419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35daba7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f35d4113970 con 0x7f35d4105300 2024-09-21T07:14:21.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35daba7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35d41137f0 con 0x7f35d410de10 2024-09-21T07:14:21.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35daba7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35d4113af0 con 0x7f35d41049b0 2024-09-21T07:14:21.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d8943640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d41049b0 0x7f35d419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d4105300 0x7f35d419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33260/0 (socket says 172.21.15.92:33260) 2024-09-21T07:14:21.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d3fff640 1 -- 172.21.15.92:0/839446416 learned_addr learned my addr 172.21.15.92:0/839446416 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:21.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d8943640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d41049b0 0x7f35d419a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:36926/0 (socket says 172.21.15.92:36926) 2024-09-21T07:14:21.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d9144640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d410de10 0x7f35d419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d8943640 1 -- 172.21.15.92:0/839446416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d410de10 msgr2=0x7f35d419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:21.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d8943640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d410de10 0x7f35d419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d8943640 1 -- 172.21.15.92:0/839446416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d4105300 msgr2=0x7f35d419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:21.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d8943640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d4105300 0x7f35d419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d8943640 1 -- 172.21.15.92:0/839446416 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d41a0310 con 0x7f35d41049b0 2024-09-21T07:14:21.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.351+0000 7f35d3fff640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d4105300 0x7f35d419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:21.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.352+0000 7f35d8943640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d41049b0 0x7f35d419a3a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f35c800d6a0 tx=0x7f35c800db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:21.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.352+0000 7f35d1ffb640 1 -- 172.21.15.92:0/839446416 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8017070 con 0x7f35d41049b0 2024-09-21T07:14:21.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.352+0000 7f35daba7640 1 -- 172.21.15.92:0/839446416 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d41a0600 con 0x7f35d41049b0 2024-09-21T07:14:21.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.352+0000 7f35d1ffb640 1 -- 172.21.15.92:0/839446416 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35c8009cb0 con 0x7f35d41049b0 2024-09-21T07:14:21.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.352+0000 7f35d1ffb640 1 -- 172.21.15.92:0/839446416 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8003b80 con 0x7f35d41049b0 2024-09-21T07:14:21.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.352+0000 7f35daba7640 1 -- 172.21.15.92:0/839446416 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d41025d0 con 0x7f35d41049b0 2024-09-21T07:14:21.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.354+0000 7f35daba7640 1 -- 172.21.15.92:0/839446416 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d4104dc0 con 0x7f35d41049b0 2024-09-21T07:14:21.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.356+0000 7f35d1ffb640 1 -- 172.21.15.92:0/839446416 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7f35c8003d20 con 0x7f35d41049b0 2024-09-21T07:14:21.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.356+0000 7f35d1ffb640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f35c40b6710 0x7f35c40b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:21.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.357+0000 7f35d3fff640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f35c40b6710 0x7f35c40b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:21.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.357+0000 7f35d1ffb640 1 -- 172.21.15.92:0/839446416 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f35c80e7860 con 0x7f35d41049b0 2024-09-21T07:14:21.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.358+0000 7f35d3fff640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f35c40b6710 0x7f35c40b8c20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f35d41023d0 tx=0x7f35c003c040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:21.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.361+0000 7f35d1ffb640 1 -- 172.21.15.92:0/839446416 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35c80b1c80 con 0x7f35d41049b0 2024-09-21T07:14:21.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.728+0000 7f35daba7640 1 -- 172.21.15.92:0/839446416 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35d402e640 con 0x7f35d41049b0 2024-09-21T07:14:21.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.729+0000 7f35d1ffb640 1 -- 172.21.15.92:0/839446416 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f35c80d0090 con 0x7f35d41049b0 2024-09-21T07:14:21.730 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:14:21.731 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:14:21.731 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:14:21.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 -- 172.21.15.92:0/839446416 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f35c40b6710 msgr2=0x7f35c40b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f35c40b6710 0x7f35c40b8c20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f35d41023d0 tx=0x7f35c003c040 comp rx=0 tx=0).stop 2024-09-21T07:14:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 -- 172.21.15.92:0/839446416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d41049b0 msgr2=0x7f35d419a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d41049b0 0x7f35d419a3a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f35c800d6a0 tx=0x7f35c800db60 comp rx=0 tx=0).stop 2024-09-21T07:14:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 -- 172.21.15.92:0/839446416 shutdown_connections 2024-09-21T07:14:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f35c40b6710 0x7f35c40b8c20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d410de10 0x7f35d419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d4105300 0x7f35d419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 --2- 172.21.15.92:0/839446416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d41049b0 0x7f35d419a3a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 -- 172.21.15.92:0/839446416 >> 172.21.15.92:0/839446416 conn(0x7f35d4079730 msgr2=0x7f35d4100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 -- 172.21.15.92:0/839446416 shutdown_connections 2024-09-21T07:14:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:21.731+0000 7f35daba7640 1 -- 172.21.15.92:0/839446416 wait complete. 2024-09-21T07:14:22.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:21 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/839446416' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:22.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:21 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/839446416' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:21 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/839446416' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:22.462 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24649 quiesce db --set-id 92a69dac --release --await' 2024-09-21T07:14:22.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24649 quiesce db --set-id 92a69dac --release --await 2024-09-21T07:14:22.833 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:23.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:22 smithi175 ceph-mon[34064]: pgmap v378: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T07:14:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:22 smithi092 ceph-mon[30987]: pgmap v378: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T07:14:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:22 smithi169 ceph-mon[33705]: pgmap v378: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T07:14:23.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.446+0000 7f4a88d0c640 1 -- 172.21.15.92:0/486069357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a84103b90 msgr2=0x7f4a84103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:23.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.446+0000 7f4a88d0c640 1 --2- 172.21.15.92:0/486069357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a84103b90 0x7f4a84103fa0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009980 tx=0x7f4a7402e820 comp rx=0 tx=0).stop 2024-09-21T07:14:23.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.446+0000 7f4a88d0c640 1 -- 172.21.15.92:0/486069357 shutdown_connections 2024-09-21T07:14:23.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.446+0000 7f4a88d0c640 1 --2- 172.21.15.92:0/486069357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a84109e20 0x7f4a84110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.446+0000 7f4a88d0c640 1 --2- 172.21.15.92:0/486069357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a841094d0 0x7f4a841098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.446+0000 7f4a88d0c640 1 --2- 172.21.15.92:0/486069357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a84103b90 0x7f4a84103fa0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.446+0000 7f4a88d0c640 1 -- 172.21.15.92:0/486069357 >> 172.21.15.92:0/486069357 conn(0x7f4a840ff600 msgr2=0x7f4a84101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:23.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.446+0000 7f4a88d0c640 1 -- 172.21.15.92:0/486069357 shutdown_connections 2024-09-21T07:14:23.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.446+0000 7f4a88d0c640 1 -- 172.21.15.92:0/486069357 wait complete. 2024-09-21T07:14:23.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.448+0000 7f4a88d0c640 1 Processor -- start 2024-09-21T07:14:23.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.448+0000 7f4a88d0c640 1 -- start start 2024-09-21T07:14:23.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.448+0000 7f4a88d0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a84103b90 0x7f4a841981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.448+0000 7f4a88d0c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a841094d0 0x7f4a84198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.448+0000 7f4a88d0c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a84109e20 0x7f4a8419d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.448+0000 7f4a88d0c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4a84111800 con 0x7f4a84103b90 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.448+0000 7f4a88d0c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4a84111680 con 0x7f4a84109e20 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.448+0000 7f4a88d0c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a84111980 con 0x7f4a841094d0 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.449+0000 7f4a8259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a84103b90 0x7f4a841981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.449+0000 7f4a8259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a84103b90 0x7f4a841981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33278/0 (socket says 172.21.15.92:33278) 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.449+0000 7f4a8259c640 1 -- 172.21.15.92:0/2559643878 learned_addr learned my addr 172.21.15.92:0/2559643878 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.449+0000 7f4a81d9b640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a841094d0 0x7f4a84198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.449+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a84109e20 0x7f4a8419d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.449+0000 7f4a81d9b640 1 -- 172.21.15.92:0/2559643878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a84109e20 msgr2=0x7f4a8419d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.449+0000 7f4a81d9b640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a84109e20 0x7f4a8419d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.449+0000 7f4a81d9b640 1 -- 172.21.15.92:0/2559643878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a84103b90 msgr2=0x7f4a841981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.449+0000 7f4a81d9b640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a84103b90 0x7f4a841981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.450+0000 7f4a81d9b640 1 -- 172.21.15.92:0/2559643878 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8419e110 con 0x7f4a841094d0 2024-09-21T07:14:23.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.450+0000 7f4a8259c640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a84103b90 0x7f4a841981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:23.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.450+0000 7f4a81d9b640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a841094d0 0x7f4a84198740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a78005fd0 tx=0x7f4a7800dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:23.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.450+0000 7f4a737fe640 1 -- 172.21.15.92:0/2559643878 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78009c00 con 0x7f4a841094d0 2024-09-21T07:14:23.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.450+0000 7f4a737fe640 1 -- 172.21.15.92:0/2559643878 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a780044c0 con 0x7f4a841094d0 2024-09-21T07:14:23.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.450+0000 7f4a737fe640 1 -- 172.21.15.92:0/2559643878 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78003d80 con 0x7f4a841094d0 2024-09-21T07:14:23.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.450+0000 7f4a88d0c640 1 -- 172.21.15.92:0/2559643878 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8419e400 con 0x7f4a841094d0 2024-09-21T07:14:23.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.450+0000 7f4a88d0c640 1 -- 172.21.15.92:0/2559643878 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a841a4b60 con 0x7f4a841094d0 2024-09-21T07:14:23.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.454+0000 7f4a8f280740 1 Processor -- start 2024-09-21T07:14:23.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.454+0000 7f4a8f280740 1 -- start start 2024-09-21T07:14:23.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.454+0000 7f4a737fe640 1 -- 172.21.15.92:0/2559643878 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7f4a78003f20 con 0x7f4a841094d0 2024-09-21T07:14:23.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.455+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.455+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce1660 0x55784d0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.455+0000 7f4a82d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.456+0000 7f4a82d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33280/0 (socket says 172.21.15.92:33280) 2024-09-21T07:14:23.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.456+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 0x55784d0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.456+0000 7f4a8259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce1660 0x55784d0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.456+0000 7f4a8259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce1660 0x55784d0b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:36952/0 (socket says 172.21.15.92:36952) 2024-09-21T07:14:23.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.456+0000 7f4a8f280740 1 -- 172.21.15.92:0/1562788745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55784cf9bdc0 con 0x55784cd0a520 2024-09-21T07:14:23.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.456+0000 7f4a8f280740 1 -- 172.21.15.92:0/1562788745 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55784d0281f0 con 0x55784cce9840 2024-09-21T07:14:23.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.456+0000 7f4a8f280740 1 -- 172.21.15.92:0/1562788745 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55784d017620 con 0x55784cce1660 2024-09-21T07:14:23.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.456+0000 7f4a82d9d640 1 -- 172.21.15.92:0/1562788745 learned_addr learned my addr 172.21.15.92:0/1562788745 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:23.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.456+0000 7f4a81d9b640 1 --2- 172.21.15.92:0/1562788745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 0x55784d0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.457+0000 7f4a82d9d640 1 -- 172.21.15.92:0/1562788745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce1660 msgr2=0x55784d0b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:23.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.457+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/1562788745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce1660 0x55784d0b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.457+0000 7f4a82d9d640 1 -- 172.21.15.92:0/1562788745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 msgr2=0x55784d0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:23.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.457+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/1562788745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 0x55784d0b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.457+0000 7f4a82d9d640 1 -- 172.21.15.92:0/1562788745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55784cfdffd0 con 0x55784cd0a520 2024-09-21T07:14:23.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.457+0000 7f4a81d9b640 1 --2- 172.21.15.92:0/1562788745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 0x55784d0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:23.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.457+0000 7f4a737fe640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4a6c0b6790 0x7f4a6c0b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.457+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/1562788745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0b0510 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009f20 tx=0x7f4a7c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7751eaf968ed5b42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:23.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.457+0000 7f4a737fe640 1 -- 172.21.15.92:0/2559643878 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4a780e7760 con 0x7f4a841094d0 2024-09-21T07:14:23.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.457+0000 7f4a70ff9640 1 -- 172.21.15.92:0/1562788745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c015070 con 0x55784cd0a520 2024-09-21T07:14:23.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.458+0000 7f4a70ff9640 1 -- 172.21.15.92:0/1562788745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a7c01aaf0 con 0x55784cd0a520 2024-09-21T07:14:23.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.458+0000 7f4a70ff9640 1 -- 172.21.15.92:0/1562788745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c011b10 con 0x55784cd0a520 2024-09-21T07:14:23.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.458+0000 7f4a8259c640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4a6c0b6790 0x7f4a6c0b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.459+0000 7f4a8f280740 1 -- 172.21.15.92:0/1562788745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 msgr2=0x55784d0b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:23.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.459+0000 7f4a8259c640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4a6c0b6790 0x7f4a6c0b8ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a74006010 tx=0x7f4a74005780 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:23.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.459+0000 7f4a8f280740 1 --2- 172.21.15.92:0/1562788745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0b0510 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009f20 tx=0x7f4a7c00f7f0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.459+0000 7f4a8f280740 1 -- 172.21.15.92:0/1562788745 shutdown_connections 2024-09-21T07:14:23.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.459+0000 7f4a8f280740 1 --2- 172.21.15.92:0/1562788745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 0x55784d0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.459+0000 7f4a8f280740 1 --2- 172.21.15.92:0/1562788745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce1660 0x55784d0b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.459+0000 7f4a8f280740 1 --2- 172.21.15.92:0/1562788745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0b0510 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.460+0000 7f4a8f280740 1 -- 172.21.15.92:0/1562788745 >> 172.21.15.92:0/1562788745 conn(0x55784ccfe910 msgr2=0x55784d0ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:23.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.460+0000 7f4a8f280740 1 -- 172.21.15.92:0/1562788745 shutdown_connections 2024-09-21T07:14:23.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.460+0000 7f4a8f280740 1 -- 172.21.15.92:0/1562788745 wait complete. 2024-09-21T07:14:23.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.461+0000 7f4a8f280740 1 -- start start 2024-09-21T07:14:23.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.461+0000 7f4a8f280740 1 Processor -- start 2024-09-21T07:14:23.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce1660 0x55784d0bbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce9840 0x55784d0bc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a8f280740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55784cfb2300 con 0x55784cd0a520 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a8f280740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55784d01b430 con 0x55784cce1660 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a8f280740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55784ce78bb0 con 0x55784cce9840 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a8f280740 10 client.0 _ll_register_callbacks cb 0x55784cfcc120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a82d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a82d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33290/0 (socket says 172.21.15.92:33290) 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a82d9d640 1 -- 172.21.15.92:0/3601944225 learned_addr learned my addr 172.21.15.92:0/3601944225 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a81d9b640 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce9840 0x55784d0bc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a8259c640 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce1660 0x55784d0bbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a82d9d640 1 -- 172.21.15.92:0/3601944225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce9840 msgr2=0x55784d0bc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce9840 0x55784d0bc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a82d9d640 1 -- 172.21.15.92:0/3601944225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce1660 msgr2=0x55784d0bbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:23.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce1660 0x55784d0bbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.462+0000 7f4a82d9d640 1 -- 172.21.15.92:0/3601944225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55784cfa1780 con 0x55784cd0a520 2024-09-21T07:14:23.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.463+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0c7e60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009370 tx=0x7f4a7c01aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66227c0d2b7433c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:23.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.463+0000 7f4a69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:23.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.463+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3601944225 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c015040 con 0x55784cd0a520 2024-09-21T07:14:23.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.463+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3601944225 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4a7c003b70 con 0x55784cd0a520 2024-09-21T07:14:23.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.463+0000 7f4a8f280740 1 -- 172.21.15.92:0/3601944225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a7c01aaf0 con 0x55784cd0a520 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.464+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3601944225 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4a7c003d70 con 0x55784cd0a520 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.464+0000 7f4a8f280740 10 client.16110 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.464+0000 7f4a8f280740 1 -- 172.21.15.92:0/3601944225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55784cd75b00 con 0x55784cd0a520 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.464+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3601944225 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a7c01aaf0 con 0x55784cd0a520 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.465+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3601944225 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4a7c004040 con 0x55784cd0a520 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.465+0000 7f4a8f280740 10 client.16110 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.465+0000 7f4a8f280740 10 client.16110 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.465+0000 7f4a8f280740 20 client.16110 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.465+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55784ccc8ea0 0x55784d0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.465+0000 7f4a8f280740 4 client.16110 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.465+0000 7f4a8f280740 1 -- 172.21.15.92:0/3601944225 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55784d02a140 con 0x55784ccc8ea0 2024-09-21T07:14:23.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.466+0000 7f4a8259c640 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55784ccc8ea0 0x55784d0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.469+0000 7f4a69ffb640 10 client.16110 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:23.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.469+0000 7f4a8259c640 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55784ccc8ea0 0x55784d0cdf10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b21c728d0ada07a5 server_cookie=e271bc4b283e8917 in_seq=0 out_seq=0 2024-09-21T07:14:23.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3601944225 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55784d02a140 con 0x55784ccc8ea0 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a69ffb640 10 client.16110 handle_command_reply: tid=0 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a8f280740 1 client.16110 shutdown 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a8f280740 1 -- 172.21.15.92:0/3601944225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 msgr2=0x55784d0c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0c7e60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009370 tx=0x7f4a7c01aed0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a8f280740 1 -- 172.21.15.92:0/3601944225 shutdown_connections 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55784ccc8ea0 0x55784d0cdf10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cd0a520 0x55784d0c7e60 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce9840 0x55784d0bc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a69ffb640 0 client.16110 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3601944225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce1660 0x55784d0bbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.470+0000 7f4a8f280740 1 -- 172.21.15.92:0/3601944225 >> 172.21.15.92:0/3601944225 conn(0x55784ccfe910 msgr2=0x55784d0b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.471+0000 7f4a8f280740 1 -- 172.21.15.92:0/3601944225 shutdown_connections 2024-09-21T07:14:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.471+0000 7f4a8f280740 1 -- 172.21.15.92:0/3601944225 wait complete. 2024-09-21T07:14:23.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.471+0000 7f4a8f280740 20 client.16110 trim_cache size 0 max 16384 2024-09-21T07:14:23.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.505+0000 7f4a8f280740 1 Processor -- start 2024-09-21T07:14:23.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.505+0000 7f4a8f280740 1 -- start start 2024-09-21T07:14:23.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.505+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.505+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 0x55784d0c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.505+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cd0a520 0x55784d0b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.505+0000 7f4a8f280740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4a841aeca0 con 0x55784cce1660 2024-09-21T07:14:23.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.505+0000 7f4a8f280740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4a841b07e0 con 0x55784cce9840 2024-09-21T07:14:23.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.505+0000 7f4a8f280740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a841af370 con 0x55784cd0a520 2024-09-21T07:14:23.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.505+0000 7f4a8259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a8259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0b73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33292/0 (socket says 172.21.15.92:33292) 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a8259c640 1 -- 172.21.15.92:0/3371504452 learned_addr learned my addr 172.21.15.92:0/3371504452 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a81d9b640 1 --2- 172.21.15.92:0/3371504452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 0x55784d0c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/3371504452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cd0a520 0x55784d0b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a8259c640 1 -- 172.21.15.92:0/3371504452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cd0a520 msgr2=0x55784d0b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a8259c640 1 --2- 172.21.15.92:0/3371504452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cd0a520 0x55784d0b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a8259c640 1 -- 172.21.15.92:0/3371504452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 msgr2=0x55784d0c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a8259c640 1 --2- 172.21.15.92:0/3371504452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 0x55784d0c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a8259c640 1 -- 172.21.15.92:0/3371504452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55784cdec960 con 0x55784cce1660 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/3371504452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cd0a520 0x55784d0b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.506+0000 7f4a8259c640 1 --2- 172.21.15.92:0/3371504452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0b73f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009430 tx=0x7f4a74048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522ebe19accb5ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.507+0000 7f4a6bfff640 1 -- 172.21.15.92:0/3371504452 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74048070 con 0x55784cce1660 2024-09-21T07:14:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.507+0000 7f4a6bfff640 1 -- 172.21.15.92:0/3371504452 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a7405c070 con 0x55784cce1660 2024-09-21T07:14:23.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.507+0000 7f4a6bfff640 1 -- 172.21.15.92:0/3371504452 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7404e9a0 con 0x55784cce1660 2024-09-21T07:14:23.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.508+0000 7f4a8f280740 1 -- 172.21.15.92:0/3371504452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 msgr2=0x55784d0b73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:23.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.508+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3371504452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0b73f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009430 tx=0x7f4a74048000 comp rx=0 tx=0).stop 2024-09-21T07:14:23.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.508+0000 7f4a8f280740 1 -- 172.21.15.92:0/3371504452 shutdown_connections 2024-09-21T07:14:23.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.508+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3371504452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cd0a520 0x55784d0b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.508+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3371504452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cce9840 0x55784d0c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.508+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3371504452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0b73f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.508+0000 7f4a8f280740 1 -- 172.21.15.92:0/3371504452 >> 172.21.15.92:0/3371504452 conn(0x55784ccfe910 msgr2=0x55784d0b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:23.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.509+0000 7f4a8f280740 1 -- 172.21.15.92:0/3371504452 shutdown_connections 2024-09-21T07:14:23.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.509+0000 7f4a8f280740 1 -- 172.21.15.92:0/3371504452 wait complete. 2024-09-21T07:14:23.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.509+0000 7f4a8f280740 1 -- start start 2024-09-21T07:14:23.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.509+0000 7f4a8f280740 1 Processor -- start 2024-09-21T07:14:23.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce9840 0x55784d0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8f280740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cd0a520 0x55784d0cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8f280740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4a841b0110 con 0x55784cce1660 2024-09-21T07:14:23.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8f280740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4a841afa40 con 0x55784cd0a520 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8f280740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a841acc80 con 0x55784cce9840 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8f280740 10 client.0 _ll_register_callbacks cb 0x7f4a780e4880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33304/0 (socket says 172.21.15.92:33304) 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8259c640 1 -- 172.21.15.92:0/3709785875 learned_addr learned my addr 172.21.15.92:0/3709785875 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cd0a520 0x55784d0cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8259c640 1 -- 172.21.15.92:0/3709785875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce9840 msgr2=0x55784d0ccb00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8259c640 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce9840 0x55784d0ccb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.510+0000 7f4a8259c640 1 -- 172.21.15.92:0/3709785875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cd0a520 msgr2=0x55784d0cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.511+0000 7f4a8259c640 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cd0a520 0x55784d0cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.511+0000 7f4a8259c640 1 -- 172.21.15.92:0/3709785875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55784d0cd730 con 0x55784cce1660 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.511+0000 7f4a82d9d640 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cd0a520 0x55784d0cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.511+0000 7f4a8259c640 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0d1650 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4a740092a0 tx=0x7f4a740043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b90ba9c679264 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.511+0000 7f4a69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:23.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.512+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3709785875 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74064030 con 0x55784cce1660 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.512+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3709785875 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4a74033040 con 0x55784cce1660 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.512+0000 7f4a8f280740 1 -- 172.21.15.92:0/3709785875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a7405c070 con 0x55784cce1660 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.512+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3709785875 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4a7404e920 con 0x55784cce1660 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.512+0000 7f4a8f280740 10 client.16116 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.512+0000 7f4a8f280740 1 -- 172.21.15.92:0/3709785875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55784d138520 con 0x55784cce1660 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.512+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3709785875 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a74003a40 con 0x55784cce1660 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.513+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3709785875 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4a74060590 con 0x55784cce1660 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.513+0000 7f4a8f280740 10 client.16116 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.513+0000 7f4a8f280740 10 client.16116 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.513+0000 7f4a8f280740 20 client.16116 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.513+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55784cc9e250 0x55784d13acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.513+0000 7f4a8f280740 4 client.16116 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "92a69dac", "release": true, "await": true}] 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.513+0000 7f4a8f280740 1 -- 172.21.15.92:0/3709785875 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "quiesce db", "set_id": "92a69dac", "release": true, "await": true}) -- 0x7f4a7405c070 con 0x55784cc9e250 2024-09-21T07:14:23.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.513+0000 7f4a81d9b640 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55784cc9e250 0x55784d13acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:23.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.513+0000 7f4a69ffb640 10 client.16116 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:23.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.514+0000 7f4a81d9b640 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55784cc9e250 0x55784d13acb0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=737d52ed03aafe37 server_cookie=159473dd34342e51 in_seq=0 out_seq=0 2024-09-21T07:14:23.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a69ffb640 1 -- 172.21.15.92:0/3709785875 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f4a7405c070 con 0x55784cc9e250 2024-09-21T07:14:23.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a69ffb640 10 client.16116 handle_command_reply: tid=0 2024-09-21T07:14:23.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a8f280740 1 client.16116 shutdown 2024-09-21T07:14:23.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a8f280740 1 -- 172.21.15.92:0/3709785875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 msgr2=0x55784d0d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:23.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0d1650 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4a740092a0 tx=0x7f4a740043d0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a8f280740 1 -- 172.21.15.92:0/3709785875 shutdown_connections 2024-09-21T07:14:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55784cc9e250 0x55784d13acb0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784cd0a520 0x55784d0cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a69ffb640 0 client.16116 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55784cce9840 0x55784d0ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a8f280740 1 --2- 172.21.15.92:0/3709785875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55784cce1660 0x55784d0d1650 secure :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4a740092a0 tx=0x7f4a740043d0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a8f280740 1 -- 172.21.15.92:0/3709785875 >> 172.21.15.92:0/3709785875 conn(0x55784ccfe910 msgr2=0x55784d0ba490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.518+0000 7f4a8f280740 1 -- 172.21.15.92:0/3709785875 shutdown_connections 2024-09-21T07:14:23.523 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24649, 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 4, 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "92a69dac": { 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 4, 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:14:23.524 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 134.5, 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:14:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.519+0000 7f4a8f280740 1 -- 172.21.15.92:0/3709785875 wait complete. 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.519+0000 7f4a8f280740 20 client.16116 trim_cache size 0 max 16384 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.519+0000 7f4a88d0c640 1 -- 172.21.15.92:0/2559643878 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4a6c0b6790 msgr2=0x7f4a6c0b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.519+0000 7f4a88d0c640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4a6c0b6790 0x7f4a6c0b8ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a74006010 tx=0x7f4a74005780 comp rx=0 tx=0).stop 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.520+0000 7f4a88d0c640 1 -- 172.21.15.92:0/2559643878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a841094d0 msgr2=0x7f4a84198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.520+0000 7f4a88d0c640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a841094d0 0x7f4a84198740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a78005fd0 tx=0x7f4a7800dde0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.520+0000 7f4a88d0c640 1 -- 172.21.15.92:0/2559643878 shutdown_connections 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.520+0000 7f4a88d0c640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4a6c0b6790 0x7f4a6c0b8ca0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.520+0000 7f4a88d0c640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a84109e20 0x7f4a8419d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.520+0000 7f4a88d0c640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a841094d0 0x7f4a84198740 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.520+0000 7f4a88d0c640 1 --2- 172.21.15.92:0/2559643878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a84103b90 0x7f4a841981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.520+0000 7f4a88d0c640 1 -- 172.21.15.92:0/2559643878 >> 172.21.15.92:0/2559643878 conn(0x7f4a840ff600 msgr2=0x7f4a84101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.520+0000 7f4a88d0c640 1 -- 172.21.15.92:0/2559643878 shutdown_connections 2024-09-21T07:14:23.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:23.520+0000 7f4a88d0c640 1 -- 172.21.15.92:0/2559643878 wait complete. 2024-09-21T07:14:24.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:23 smithi175 ceph-mon[34064]: pgmap v379: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-21T07:14:24.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:23 smithi092 ceph-mon[30987]: pgmap v379: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-21T07:14:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:23 smithi169 ceph-mon[33705]: pgmap v379: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-21T07:14:24.283 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '92a69dac', total seconds elapsed: 19.2 2024-09-21T07:14:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:24 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:14:25.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:24 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:14:25.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:24 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:14:26.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:25 smithi175 ceph-mon[34064]: pgmap v380: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:14:26.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:25 smithi092 ceph-mon[30987]: pgmap v380: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:14:26.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:25 smithi169 ceph-mon[33705]: pgmap v380: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:14:29.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:28 smithi175 ceph-mon[34064]: pgmap v381: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:14:29.096 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:28 smithi169 ceph-mon[33705]: pgmap v381: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:14:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:28 smithi092 ceph-mon[30987]: pgmap v381: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:14:30.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:30 smithi092 ceph-mon[30987]: pgmap v382: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 170 B/s wr, 13 op/s 2024-09-21T07:14:30.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:30 smithi169 ceph-mon[33705]: pgmap v382: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 170 B/s wr, 13 op/s 2024-09-21T07:14:30.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:30 smithi175 ceph-mon[34064]: pgmap v382: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 170 B/s wr, 13 op/s 2024-09-21T07:14:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:32 smithi175 ceph-mon[34064]: pgmap v383: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:14:33.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:32 smithi092 ceph-mon[30987]: pgmap v383: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:14:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:32 smithi169 ceph-mon[33705]: pgmap v383: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:14:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.183+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2343298951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58103140 msgr2=0x7fbb58103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.183+0000 7fbb5fad5640 1 --2- 172.21.15.92:0/2343298951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58103140 0x7fbb58103550 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009900 tx=0x7fbb5402a410 comp rx=0 tx=0).stop 2024-09-21T07:14:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.183+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2343298951 shutdown_connections 2024-09-21T07:14:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.183+0000 7fbb5fad5640 1 --2- 172.21.15.92:0/2343298951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb58105a50 0x7fbb5810f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.183+0000 7fbb5fad5640 1 --2- 172.21.15.92:0/2343298951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb58105100 0x7fbb58105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.183+0000 7fbb5fad5640 1 --2- 172.21.15.92:0/2343298951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58103140 0x7fbb58103550 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.183+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2343298951 >> 172.21.15.92:0/2343298951 conn(0x7fbb58079d00 msgr2=0x7fbb5807a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.184+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2343298951 shutdown_connections 2024-09-21T07:14:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.184+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2343298951 wait complete. 2024-09-21T07:14:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5fad5640 1 Processor -- start 2024-09-21T07:14:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5fad5640 1 -- start start 2024-09-21T07:14:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5fad5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58103140 0x7fbb5819b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5fad5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb58105100 0x7fbb5819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5fad5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb58105a50 0x7fbb5819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5fad5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb58112850 con 0x7fbb58103140 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5fad5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581126d0 con 0x7fbb58105100 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5fad5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581129d0 con 0x7fbb58105a50 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5d871640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58103140 0x7fbb5819b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5d871640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58103140 0x7fbb5819b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52490/0 (socket says 172.21.15.92:52490) 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5d871640 1 -- 172.21.15.92:0/2820902647 learned_addr learned my addr 172.21.15.92:0/2820902647 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5d070640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb58105100 0x7fbb5819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.185+0000 7fbb5e072640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb58105a50 0x7fbb5819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.186+0000 7fbb5d871640 1 -- 172.21.15.92:0/2820902647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb58105a50 msgr2=0x7fbb5819bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.186+0000 7fbb5d871640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb58105a50 0x7fbb5819bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.186+0000 7fbb5d871640 1 -- 172.21.15.92:0/2820902647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb58105100 msgr2=0x7fbb5819b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.186+0000 7fbb5d871640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb58105100 0x7fbb5819b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.186+0000 7fbb5d871640 1 -- 172.21.15.92:0/2820902647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb581a6440 con 0x7fbb58103140 2024-09-21T07:14:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.186+0000 7fbb5d871640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58103140 0x7fbb5819b180 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fbb54005ab0 tx=0x7fbb54003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.186+0000 7fbb4effd640 1 -- 172.21.15.92:0/2820902647 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5403f070 con 0x7fbb58103140 2024-09-21T07:14:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.186+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2820902647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb581a66d0 con 0x7fbb58103140 2024-09-21T07:14:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.186+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2820902647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb581a6c10 con 0x7fbb58103140 2024-09-21T07:14:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.186+0000 7fbb4effd640 1 -- 172.21.15.92:0/2820902647 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb5403bb00 con 0x7fbb58103140 2024-09-21T07:14:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.188+0000 7fbb4effd640 1 -- 172.21.15.92:0/2820902647 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54049060 con 0x7fbb58103140 2024-09-21T07:14:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.190+0000 7fbb66a3e740 1 Processor -- start 2024-09-21T07:14:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.190+0000 7fbb66a3e740 1 -- start start 2024-09-21T07:14:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 0x557163de59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163de5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 0x557163de6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb66a3e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557163d5a6f0 con 0x557163a172f0 2024-09-21T07:14:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb66a3e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557163d49b20 con 0x557163a1f4d0 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb66a3e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557163d4d930 con 0x557163a401b0 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb5e072640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 0x557163de59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb5e072640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 0x557163de59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:42026/0 (socket says 172.21.15.92:42026) 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb5e072640 1 -- 172.21.15.92:0/2536105458 learned_addr learned my addr 172.21.15.92:0/2536105458 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb5d070640 1 --2- 172.21.15.92:0/2536105458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 0x557163de6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb5d871640 1 --2- 172.21.15.92:0/2536105458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163de5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb4effd640 1 -- 172.21.15.92:0/2820902647 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 154694+0+0 (secure 0 0 0) 0x7fbb54042070 con 0x7fbb58103140 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb5e072640 1 -- 172.21.15.92:0/2536105458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 msgr2=0x557163de6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb5e072640 1 --2- 172.21.15.92:0/2536105458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 0x557163de6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb5e072640 1 -- 172.21.15.92:0/2536105458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 msgr2=0x557163de5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb5e072640 1 --2- 172.21.15.92:0/2536105458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163de5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.191+0000 7fbb5e072640 1 -- 172.21.15.92:0/2536105458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557163d0f530 con 0x557163a401b0 2024-09-21T07:14:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.192+0000 7fbb5d871640 1 --2- 172.21.15.92:0/2536105458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163de5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:14:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.192+0000 7fbb5e072640 1 --2- 172.21.15.92:0/2536105458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 0x557163de59b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbb50011440 tx=0x7fbb50011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a682a458fbdfc4b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.192+0000 7fbb43fff640 1 -- 172.21.15.92:0/2536105458 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50004d20 con 0x557163a401b0 2024-09-21T07:14:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.192+0000 7fbb43fff640 1 -- 172.21.15.92:0/2536105458 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb50004050 con 0x557163a401b0 2024-09-21T07:14:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.192+0000 7fbb43fff640 1 -- 172.21.15.92:0/2536105458 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000f780 con 0x557163a401b0 2024-09-21T07:14:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.192+0000 7fbb4effd640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbb440b6810 0x7fbb440b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.193+0000 7fbb5d871640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbb440b6810 0x7fbb440b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.193+0000 7fbb4effd640 1 -- 172.21.15.92:0/2820902647 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fbb54108290 con 0x7fbb58103140 2024-09-21T07:14:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.193+0000 7fbb66a3e740 1 -- 172.21.15.92:0/2536105458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 msgr2=0x557163de59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.193+0000 7fbb5d871640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbb440b6810 0x7fbb440b8d20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb54105580 tx=0x7fbb54009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.193+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/2536105458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 0x557163de59b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbb50011440 tx=0x7fbb50011900 comp rx=0 tx=0).stop 2024-09-21T07:14:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.193+0000 7fbb66a3e740 1 -- 172.21.15.92:0/2536105458 shutdown_connections 2024-09-21T07:14:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.193+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/2536105458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 0x557163de6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.193+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/2536105458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163de5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.193+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/2536105458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 0x557163de59b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.193+0000 7fbb66a3e740 1 -- 172.21.15.92:0/2536105458 >> 172.21.15.92:0/2536105458 conn(0x557163a34300 msgr2=0x557163de38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.194+0000 7fbb66a3e740 1 -- 172.21.15.92:0/2536105458 shutdown_connections 2024-09-21T07:14:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.194+0000 7fbb66a3e740 1 -- 172.21.15.92:0/2536105458 wait complete. 2024-09-21T07:14:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.194+0000 7fbb66a3e740 1 -- start start 2024-09-21T07:14:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.194+0000 7fbb66a3e740 1 Processor -- start 2024-09-21T07:14:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163df10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 0x557163df1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 0x557163dfd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb66a3e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557163c81ab0 con 0x557163a172f0 2024-09-21T07:14:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb66a3e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557163cef730 con 0x557163a1f4d0 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb66a3e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557163df4130 con 0x557163a401b0 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb66a3e740 10 client.0 _ll_register_callbacks cb 0x557163d436b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb5e072640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163df10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb5e072640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163df10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52506/0 (socket says 172.21.15.92:52506) 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb5e072640 1 -- 172.21.15.92:0/957469216 learned_addr learned my addr 172.21.15.92:0/957469216 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.195+0000 7fbb5d070640 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 0x557163df1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb5d070640 1 -- 172.21.15.92:0/957469216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 msgr2=0x557163dfd420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb5d070640 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 0x557163dfd420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb5d070640 1 -- 172.21.15.92:0/957469216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 msgr2=0x557163df10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb5d070640 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163df10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb5d070640 1 -- 172.21.15.92:0/957469216 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557163aab790 con 0x557163a1f4d0 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb5e072640 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163df10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb5d070640 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 0x557163df1600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb58075710 tx=0x7fbb48012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26148a11849787eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb417fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:14:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb417fa640 1 -- 172.21.15.92:0/957469216 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb48004020 con 0x557163a1f4d0 2024-09-21T07:14:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb66a3e740 1 -- 172.21.15.92:0/957469216 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb50004050 con 0x557163a1f4d0 2024-09-21T07:14:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.196+0000 7fbb417fa640 1 -- 172.21.15.92:0/957469216 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fbb480041c0 con 0x557163a1f4d0 2024-09-21T07:14:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb417fa640 1 -- 172.21.15.92:0/957469216 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb48025050 con 0x557163a1f4d0 2024-09-21T07:14:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb66a3e740 10 client.25463 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb66a3e740 1 -- 172.21.15.92:0/957469216 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557163b24620 con 0x557163a1f4d0 2024-09-21T07:14:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb417fa640 1 -- 172.21.15.92:0/957469216 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb50004050 con 0x557163a1f4d0 2024-09-21T07:14:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb417fa640 1 -- 172.21.15.92:0/957469216 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbb480038b0 con 0x557163a1f4d0 2024-09-21T07:14:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb66a3e740 10 client.25463 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb66a3e740 10 client.25463 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb66a3e740 20 client.25463 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5571639fed80 0x557163e07b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb66a3e740 4 client.25463 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb66a3e740 1 -- 172.21.15.92:0/957469216 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557163d5c640 con 0x5571639fed80 2024-09-21T07:14:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.197+0000 7fbb5e072640 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5571639fed80 0x557163e07b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.198+0000 7fbb5e072640 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5571639fed80 0x557163e07b50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83a1126a78fe24d9 server_cookie=ecafad6ed08bb401 in_seq=0 out_seq=0 2024-09-21T07:14:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.198+0000 7fbb417fa640 10 client.25463 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb417fa640 1 -- 172.21.15.92:0/957469216 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557163d5c640 con 0x5571639fed80 2024-09-21T07:14:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb417fa640 10 client.25463 handle_command_reply: tid=0 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 client.25463 shutdown 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 -- 172.21.15.92:0/957469216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 msgr2=0x557163df1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 0x557163df1600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb58075710 tx=0x7fbb48012b60 comp rx=0 tx=0).stop 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 -- 172.21.15.92:0/957469216 shutdown_connections 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5571639fed80 0x557163e07b50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a401b0 0x557163dfd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb417fa640 0 client.25463 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557163a1f4d0 0x557163df1600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/957469216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a172f0 0x557163df10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 -- 172.21.15.92:0/957469216 >> 172.21.15.92:0/957469216 conn(0x557163a34300 msgr2=0x557163de69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 -- 172.21.15.92:0/957469216 shutdown_connections 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 1 -- 172.21.15.92:0/957469216 wait complete. 2024-09-21T07:14:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.199+0000 7fbb66a3e740 20 client.25463 trim_cache size 0 max 16384 2024-09-21T07:14:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb66a3e740 1 Processor -- start 2024-09-21T07:14:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb66a3e740 1 -- start start 2024-09-21T07:14:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571639fed80 0x557163dec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 0x557163df15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163deb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb66a3e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581aebf0 con 0x557163a1f4d0 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb66a3e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b0730 con 0x5571639fed80 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb66a3e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581af2c0 con 0x557163a172f0 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb5e072640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163deb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb5e072640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163deb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52518/0 (socket says 172.21.15.92:52518) 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb5e072640 1 -- 172.21.15.92:0/1866230628 learned_addr learned my addr 172.21.15.92:0/1866230628 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb5e072640 1 --2- 172.21.15.92:0/1866230628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571639fed80 0x557163dec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.228+0000 7fbb5d070640 1 --2- 172.21.15.92:0/1866230628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 0x557163df15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb5e072640 1 -- 172.21.15.92:0/1866230628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 msgr2=0x557163df15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb5e072640 1 --2- 172.21.15.92:0/1866230628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 0x557163df15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb5e072640 1 -- 172.21.15.92:0/1866230628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571639fed80 msgr2=0x557163dec7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb5e072640 1 --2- 172.21.15.92:0/1866230628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571639fed80 0x557163dec7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb5e072640 1 -- 172.21.15.92:0/1866230628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557163e041c0 con 0x557163a1f4d0 2024-09-21T07:14:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb5d070640 1 --2- 172.21.15.92:0/1866230628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 0x557163df15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb5e072640 1 --2- 172.21.15.92:0/1866230628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163deb180 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fbb50004950 tx=0x7fbb50011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515e518cc90013d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb437fe640 1 -- 172.21.15.92:0/1866230628 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5001d040 con 0x557163a1f4d0 2024-09-21T07:14:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb437fe640 1 -- 172.21.15.92:0/1866230628 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb5000f540 con 0x557163a1f4d0 2024-09-21T07:14:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.229+0000 7fbb437fe640 1 -- 172.21.15.92:0/1866230628 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50019690 con 0x557163a1f4d0 2024-09-21T07:14:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 -- 172.21.15.92:0/1866230628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 msgr2=0x557163deb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/1866230628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163deb180 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fbb50004950 tx=0x7fbb50011900 comp rx=0 tx=0).stop 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 -- 172.21.15.92:0/1866230628 shutdown_connections 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/1866230628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163deb180 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/1866230628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 0x557163df15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/1866230628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571639fed80 0x557163dec7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 -- 172.21.15.92:0/1866230628 >> 172.21.15.92:0/1866230628 conn(0x557163a34300 msgr2=0x557163deaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 -- 172.21.15.92:0/1866230628 shutdown_connections 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 -- 172.21.15.92:0/1866230628 wait complete. 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 -- start start 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.231+0000 7fbb66a3e740 1 Processor -- start 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.232+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571639fed80 0x557163df44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.232+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 0x557163df4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.232+0000 7fbb66a3e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163df4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.232+0000 7fbb5e072640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163df4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.232+0000 7fbb5e072640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163df4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52534/0 (socket says 172.21.15.92:52534) 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.232+0000 7fbb5e072640 1 -- 172.21.15.92:0/3015337578 learned_addr learned my addr 172.21.15.92:0/3015337578 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.232+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b0060 con 0x557163a1f4d0 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.232+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581af990 con 0x5571639fed80 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.232+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581acbd0 con 0x557163a172f0 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.232+0000 7fbb5d070640 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 0x557163df4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.233+0000 7fbb5e072640 1 -- 172.21.15.92:0/3015337578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 msgr2=0x557163df4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.233+0000 7fbb5e072640 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 0x557163df4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.233+0000 7fbb5e072640 1 -- 172.21.15.92:0/3015337578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571639fed80 msgr2=0x557163df44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.233+0000 7fbb5e072640 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571639fed80 0x557163df44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.233+0000 7fbb5e072640 1 -- 172.21.15.92:0/3015337578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557163e706b0 con 0x557163a1f4d0 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.233+0000 7fbb5d070640 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 0x557163df4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.233+0000 7fbb5e072640 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163df4f50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbb50002230 tx=0x7fbb50004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e7b0ed3a841b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.233+0000 7fbb66a3e740 10 client.0 _ll_register_callbacks cb 0x7fbb48009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.233+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb5000f540 con 0x557163a1f4d0 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.233+0000 7fbb417fa640 10 client.16134 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb417fa640 1 -- 172.21.15.92:0/3015337578 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5001d030 con 0x557163a1f4d0 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb417fa640 1 -- 172.21.15.92:0/3015337578 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fbb5000fe30 con 0x557163a1f4d0 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb417fa640 1 -- 172.21.15.92:0/3015337578 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb50019430 con 0x557163a1f4d0 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb66a3e740 10 client.16134 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557163e71640 con 0x557163a1f4d0 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb417fa640 1 -- 172.21.15.92:0/3015337578 <== mon.0 v2:172.21.15.92:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbb50003bf0 con 0x557163a1f4d0 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb66a3e740 10 client.16134 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb66a3e740 10 client.16134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb66a3e740 20 client.16134 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557163a401b0 0x557163e73de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb66a3e740 4 client.16134 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:14:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.234+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557163d580f0 con 0x557163a401b0 2024-09-21T07:14:34.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.235+0000 7fbb5d070640 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557163a401b0 0x557163e73de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:34.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.235+0000 7fbb417fa640 10 client.16134 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:34.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.235+0000 7fbb5d070640 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557163a401b0 0x557163e73de0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d272e26f9f2b26c server_cookie=a93329fe174cec0 in_seq=0 out_seq=0 2024-09-21T07:14:34.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.241+0000 7fbb417fa640 1 -- 172.21.15.92:0/3015337578 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557163d580f0 con 0x557163a401b0 2024-09-21T07:14:34.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb417fa640 10 client.16134 handle_command_reply: tid=0 2024-09-21T07:14:34.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 client.16134 shutdown 2024-09-21T07:14:34.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 msgr2=0x557163df4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:34.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163df4f50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbb50002230 tx=0x7fbb50004710 comp rx=0 tx=0).stop 2024-09-21T07:14:34.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 shutdown_connections 2024-09-21T07:14:34.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557163a401b0 0x557163e73de0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557163a1f4d0 0x557163df4f50 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557163a172f0 0x557163df4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 --2- 172.21.15.92:0/3015337578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571639fed80 0x557163df44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 >> 172.21.15.92:0/3015337578 conn(0x557163a34300 msgr2=0x557163de7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:34.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb417fa640 0 client.16134 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:34.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 shutdown_connections 2024-09-21T07:14:34.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 1 -- 172.21.15.92:0/3015337578 wait complete. 2024-09-21T07:14:34.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.242+0000 7fbb66a3e740 20 client.16134 trim_cache size 0 max 16384 2024-09-21T07:14:34.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:14:34.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:14:34.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:14:34.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:14:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2820902647 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbb440b6810 msgr2=0x7fbb440b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbb440b6810 0x7fbb440b8d20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb54105580 tx=0x7fbb54009260 comp rx=0 tx=0).stop 2024-09-21T07:14:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2820902647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58103140 msgr2=0x7fbb5819b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58103140 0x7fbb5819b180 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fbb54005ab0 tx=0x7fbb54003c10 comp rx=0 tx=0).stop 2024-09-21T07:14:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2820902647 shutdown_connections 2024-09-21T07:14:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbb440b6810 0x7fbb440b8d20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb58105a50 0x7fbb5819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb58105100 0x7fbb5819b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 --2- 172.21.15.92:0/2820902647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58103140 0x7fbb5819b180 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:34.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2820902647 >> 172.21.15.92:0/2820902647 conn(0x7fbb58079d00 msgr2=0x7fbb581072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:34.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.243+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2820902647 shutdown_connections 2024-09-21T07:14:34.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:34.244+0000 7fbb5fad5640 1 -- 172.21.15.92:0/2820902647 wait complete. 2024-09-21T07:14:35.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:34 smithi175 ceph-mon[34064]: pgmap v384: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:14:35.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:34 smithi092 ceph-mon[30987]: pgmap v384: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:14:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:34 smithi169 ceph-mon[33705]: pgmap v384: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:14:37.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:36 smithi175 ceph-mon[34064]: pgmap v385: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:14:37.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:36 smithi092 ceph-mon[30987]: pgmap v385: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:14:37.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:36 smithi169 ceph-mon[33705]: pgmap v385: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:14:39.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:38 smithi175 ceph-mon[34064]: pgmap v386: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:14:39.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:38 smithi092 ceph-mon[30987]: pgmap v386: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:14:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:38 smithi169 ceph-mon[33705]: pgmap v386: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:14:41.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:40 smithi175 ceph-mon[34064]: pgmap v387: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:14:41.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:40 smithi092 ceph-mon[30987]: pgmap v387: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:14:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:40 smithi169 ceph-mon[33705]: pgmap v387: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:14:42.303 INFO:tasks.workunit.client.0.smithi092.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T07:14:42.304 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-21T07:14:42.304 INFO:tasks.workunit.client.0.smithi092.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T07:14:42.304 INFO:tasks.workunit.client.0.smithi092.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T07:14:42.304 INFO:tasks.workunit.client.0.smithi092.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T07:14:42.304 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-21T07:14:42.304 INFO:tasks.workunit.client.0.smithi092.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T07:14:42.304 INFO:tasks.workunit.client.0.smithi092.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T07:14:42.304 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-21T07:14:42.304 INFO:tasks.workunit.client.0.smithi092.stderr: git switch -c 2024-09-21T07:14:42.304 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-21T07:14:42.305 INFO:tasks.workunit.client.0.smithi092.stderr:Or undo this operation with: 2024-09-21T07:14:42.305 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-21T07:14:42.305 INFO:tasks.workunit.client.0.smithi092.stderr: git switch - 2024-09-21T07:14:42.305 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-21T07:14:42.305 INFO:tasks.workunit.client.0.smithi092.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T07:14:42.305 INFO:tasks.workunit.client.0.smithi092.stderr: 2024-09-21T07:14:42.305 INFO:tasks.workunit.client.0.smithi092.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:14:42.308 DEBUG:teuthology.orchestra.run.smithi092:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T07:14:42.371 INFO:tasks.workunit.client.0.smithi092.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T07:14:42.373 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T07:14:42.373 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T07:14:43.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:42 smithi175 ceph-mon[34064]: pgmap v388: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:14:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:42 smithi092 ceph-mon[30987]: pgmap v388: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:14:43.123 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T07:14:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:42 smithi169 ceph-mon[33705]: pgmap v388: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:14:43.191 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T07:14:43.231 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T07:14:43.233 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T07:14:43.233 INFO:tasks.workunit.client.0.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T07:14:43.272 INFO:tasks.workunit.client.0.smithi092.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T07:14:43.275 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:14:43.275 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T07:14:43.331 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-09-21T07:14:43.333 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-09-21T07:14:43.333 DEBUG:teuthology.orchestra.run.smithi092:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-09-21T07:14:43.402 INFO:tasks.workunit.client.0.smithi092.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-21T07:14:43.486 INFO:tasks.workunit.client.0.smithi092.stdout: Iozone: Performance Test of File I/O 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Version $Revision: 3.494 $ 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Compiled for 64 bit mode. 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Build: linux-AMD64 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-21T07:14:43.487 INFO:tasks.workunit.client.0.smithi092.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: Run began: Sat Sep 21 07:14:43 2024 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: Include close in write timing 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: Include fsync in write timing 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: File size set to 1048576 kB 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: Record Size 16 kB 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: Output is in kBytes/sec 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: Time Resolution = 0.000001 seconds. 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: Processor cache size set to 1024 kBytes. 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: Processor cache line size set to 32 bytes. 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: File stride size set to 17 * record size. 2024-09-21T07:14:43.488 INFO:tasks.workunit.client.0.smithi092.stdout: Throughput test with 1 process 2024-09-21T07:14:43.489 INFO:tasks.workunit.client.0.smithi092.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-09-21T07:14:45.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:44 smithi175 ceph-mon[34064]: pgmap v389: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:14:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:44 smithi092 ceph-mon[30987]: pgmap v389: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:14:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:44 smithi169 ceph-mon[33705]: pgmap v389: 129 pgs: 129 active+clean; 1.4 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:14:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:46 smithi175 ceph-mon[34064]: pgmap v390: 129 pgs: 129 active+clean; 37 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-09-21T07:14:47.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:46 smithi175 ceph-mon[34064]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-09-21T07:14:47.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:46 smithi092 ceph-mon[30987]: pgmap v390: 129 pgs: 129 active+clean; 37 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-09-21T07:14:47.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:46 smithi092 ceph-mon[30987]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-09-21T07:14:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:46 smithi169 ceph-mon[33705]: pgmap v390: 129 pgs: 129 active+clean; 37 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-09-21T07:14:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:46 smithi169 ceph-mon[33705]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-09-21T07:14:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.361+0000 7fdcc8f28640 1 -- 172.21.15.92:0/4000890472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcc4108c60 msgr2=0x7fdcc410f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.361+0000 7fdcc8f28640 1 --2- 172.21.15.92:0/4000890472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcc4108c60 0x7fdcc410f490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009be0 tx=0x7fdcbc02a6c0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.362+0000 7fdcc8f28640 1 -- 172.21.15.92:0/4000890472 shutdown_connections 2024-09-21T07:14:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.362+0000 7fdcc8f28640 1 --2- 172.21.15.92:0/4000890472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcc4108c60 0x7fdcc410f490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.362+0000 7fdcc8f28640 1 --2- 172.21.15.92:0/4000890472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcc4108310 0x7fdcc4108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.362+0000 7fdcc8f28640 1 --2- 172.21.15.92:0/4000890472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcc41029e0 0x7fdcc4102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.362+0000 7fdcc8f28640 1 -- 172.21.15.92:0/4000890472 >> 172.21.15.92:0/4000890472 conn(0x7fdcc40fe3e0 msgr2=0x7fdcc4100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.362+0000 7fdcc8f28640 1 -- 172.21.15.92:0/4000890472 shutdown_connections 2024-09-21T07:14:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.362+0000 7fdcc8f28640 1 -- 172.21.15.92:0/4000890472 wait complete. 2024-09-21T07:14:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc8f28640 1 Processor -- start 2024-09-21T07:14:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc8f28640 1 -- start start 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc8f28640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcc41029e0 0x7fdcc419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc8f28640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcc4108310 0x7fdcc419b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc8f28640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcc4108c60 0x7fdcc419bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc8f28640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41127d0 con 0x7fdcc4108c60 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc8f28640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4112650 con 0x7fdcc4108310 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc8f28640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4112950 con 0x7fdcc41029e0 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc1d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcc4108310 0x7fdcc419b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcc41029e0 0x7fdcc419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc1d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcc4108310 0x7fdcc419b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:44866/0 (socket says 172.21.15.92:44866) 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc1d9b640 1 -- 172.21.15.92:0/2304064004 learned_addr learned my addr 172.21.15.92:0/2304064004 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.363+0000 7fdcc2d9d640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcc4108c60 0x7fdcc419bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcc1d9b640 1 -- 172.21.15.92:0/2304064004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcc41029e0 msgr2=0x7fdcc419b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcc1d9b640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcc41029e0 0x7fdcc419b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcc1d9b640 1 -- 172.21.15.92:0/2304064004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcc4108c60 msgr2=0x7fdcc419bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcc1d9b640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcc4108c60 0x7fdcc419bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcc1d9b640 1 -- 172.21.15.92:0/2304064004 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc41a6450 con 0x7fdcc4108310 2024-09-21T07:14:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcc1d9b640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcc4108310 0x7fdcc419b700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800d750 tx=0x7fdcb800dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcb37fe640 1 -- 172.21.15.92:0/2304064004 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8017070 con 0x7fdcc4108310 2024-09-21T07:14:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcb37fe640 1 -- 172.21.15.92:0/2304064004 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcb80054b0 con 0x7fdcc4108310 2024-09-21T07:14:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcb37fe640 1 -- 172.21.15.92:0/2304064004 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8004bc0 con 0x7fdcc4108310 2024-09-21T07:14:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcc8f28640 1 -- 172.21.15.92:0/2304064004 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc41a6740 con 0x7fdcc4108310 2024-09-21T07:14:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.364+0000 7fdcc8f28640 1 -- 172.21.15.92:0/2304064004 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc41a6c40 con 0x7fdcc4108310 2024-09-21T07:14:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdccfe94740 1 Processor -- start 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdccfe94740 1 -- start start 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff390c1b0 0x55dff3cb19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff38eb4d0 0x55dff3cb2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdccfe94740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dff3c266f0 con 0x55dff38e32f0 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdccfe94740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dff3c15b20 con 0x55dff38eb4d0 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdccfe94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dff3c19930 con 0x55dff390c1b0 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdcc2d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff390c1b0 0x55dff3cb19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43592/0 (socket says 172.21.15.92:43592) 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdcc259c640 1 -- 172.21.15.92:0/4171348236 learned_addr learned my addr 172.21.15.92:0/4171348236 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.367+0000 7fdcb37fe640 1 -- 172.21.15.92:0/2304064004 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fdcb8010460 con 0x7fdcc4108310 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.368+0000 7fdcc2d9d640 1 -- 172.21.15.92:0/4171348236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff38eb4d0 msgr2=0x55dff3cb2430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.368+0000 7fdcc2d9d640 1 --2- 172.21.15.92:0/4171348236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff38eb4d0 0x55dff3cb2430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.368+0000 7fdcc2d9d640 1 -- 172.21.15.92:0/4171348236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 msgr2=0x55dff3cb1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.368+0000 7fdcc2d9d640 1 --2- 172.21.15.92:0/4171348236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.368+0000 7fdcc2d9d640 1 -- 172.21.15.92:0/4171348236 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dff3bdb530 con 0x55dff390c1b0 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.368+0000 7fdcc2d9d640 1 --2- 172.21.15.92:0/4171348236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff390c1b0 0x55dff3cb19b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc034040 tx=0x7fdcbc030fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ae800551f3d4d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.368+0000 7fdcb0ff9640 1 -- 172.21.15.92:0/4171348236 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc041070 con 0x55dff390c1b0 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.368+0000 7fdcb0ff9640 1 -- 172.21.15.92:0/4171348236 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcbc037040 con 0x55dff390c1b0 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.368+0000 7fdcb0ff9640 1 -- 172.21.15.92:0/4171348236 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc036040 con 0x55dff390c1b0 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdcb37fe640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdcac0b6700 0x7fdcac0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdcc259c640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdcac0b6700 0x7fdcac0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdcb37fe640 1 -- 172.21.15.92:0/2304064004 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdcb80e7360 con 0x7fdcc4108310 2024-09-21T07:14:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdccfe94740 1 -- 172.21.15.92:0/4171348236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff390c1b0 msgr2=0x55dff3cb19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdccfe94740 1 --2- 172.21.15.92:0/4171348236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff390c1b0 0x55dff3cb19b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc034040 tx=0x7fdcbc030fe0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdcc259c640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdcac0b6700 0x7fdcac0b8c10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55dff3cb0630 tx=0x7fdcb4009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdccfe94740 1 -- 172.21.15.92:0/4171348236 shutdown_connections 2024-09-21T07:14:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdccfe94740 1 --2- 172.21.15.92:0/4171348236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff38eb4d0 0x55dff3cb2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdccfe94740 1 --2- 172.21.15.92:0/4171348236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdccfe94740 1 --2- 172.21.15.92:0/4171348236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff390c1b0 0x55dff3cb19b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.369+0000 7fdccfe94740 1 -- 172.21.15.92:0/4171348236 >> 172.21.15.92:0/4171348236 conn(0x55dff3900300 msgr2=0x55dff3caf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.370+0000 7fdccfe94740 1 -- 172.21.15.92:0/4171348236 shutdown_connections 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.370+0000 7fdccfe94740 1 -- 172.21.15.92:0/4171348236 wait complete. 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.370+0000 7fdccfe94740 1 -- start start 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.370+0000 7fdccfe94740 1 Processor -- start 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.370+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cbd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.370+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cbd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.370+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff390c1b0 0x55dff3cc93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdccfe94740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dff3b4dab0 con 0x55dff38e32f0 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdccfe94740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dff3bbb730 con 0x55dff390c1b0 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdccfe94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dff3cc00d0 con 0x55dff38eb4d0 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdccfe94740 10 client.0 _ll_register_callbacks cb 0x55dff3c0f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cbd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cbd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43596/0 (socket says 172.21.15.92:43596) 2024-09-21T07:14:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc259c640 1 -- 172.21.15.92:0/3925690757 learned_addr learned my addr 172.21.15.92:0/3925690757 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc1d9b640 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cbd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc2d9d640 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff390c1b0 0x55dff3cc93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc1d9b640 1 -- 172.21.15.92:0/3925690757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff390c1b0 msgr2=0x55dff3cc93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc1d9b640 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff390c1b0 0x55dff3cc93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc1d9b640 1 -- 172.21.15.92:0/3925690757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 msgr2=0x55dff3cbd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc1d9b640 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cbd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc1d9b640 1 -- 172.21.15.92:0/3925690757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dff3977790 con 0x55dff38eb4d0 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc259c640 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cbd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdcc1d9b640 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cbd650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80e4710 tx=0x7fdcb80a8e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddee186d7d568c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3925690757 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80e4e60 con 0x55dff38eb4d0 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3925690757 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdcb80942b0 con 0x55dff38eb4d0 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.371+0000 7fdccfe94740 1 -- 172.21.15.92:0/3925690757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcbc037040 con 0x55dff38eb4d0 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3925690757 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdcb8020070 con 0x55dff38eb4d0 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdccfe94740 10 client.25597 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdccfe94740 1 -- 172.21.15.92:0/3925690757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dff39f0620 con 0x55dff38eb4d0 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3925690757 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcbc037040 con 0x55dff38eb4d0 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3925690757 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdcb8098080 con 0x55dff38eb4d0 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdccfe94740 10 client.25597 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdccfe94740 10 client.25597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdccfe94740 20 client.25597 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dff38cad80 0x55dff3ccf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdccfe94740 4 client.25597 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdccfe94740 1 -- 172.21.15.92:0/3925690757 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dff3c28640 con 0x55dff38cad80 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.372+0000 7fdcc259c640 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dff38cad80 0x55dff3ccf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.373+0000 7fdcc259c640 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dff38cad80 0x55dff3ccf200 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=769a09da9b936a8f server_cookie=671252d42bb0e44 in_seq=0 out_seq=0 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.373+0000 7fdca9ffb640 10 client.25597 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.373+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3925690757 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dff3c28640 con 0x55dff38cad80 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.373+0000 7fdca9ffb640 10 client.25597 handle_command_reply: tid=0 2024-09-21T07:14:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.373+0000 7fdccfe94740 1 client.25597 shutdown 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.373+0000 7fdccfe94740 1 -- 172.21.15.92:0/3925690757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 msgr2=0x55dff3cbd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.373+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cbd650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80e4710 tx=0x7fdcb80a8e90 comp rx=0 tx=0).stop 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.374+0000 7fdccfe94740 1 -- 172.21.15.92:0/3925690757 shutdown_connections 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.374+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dff38cad80 0x55dff3ccf200 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.374+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff390c1b0 0x55dff3cc93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.374+0000 7fdca9ffb640 0 client.25597 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.374+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cbd650 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.374+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3925690757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cbd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.374+0000 7fdccfe94740 1 -- 172.21.15.92:0/3925690757 >> 172.21.15.92:0/3925690757 conn(0x55dff3900300 msgr2=0x55dff3cb29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.374+0000 7fdccfe94740 1 -- 172.21.15.92:0/3925690757 shutdown_connections 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.374+0000 7fdccfe94740 1 -- 172.21.15.92:0/3925690757 wait complete. 2024-09-21T07:14:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.374+0000 7fdccfe94740 20 client.25597 trim_cache size 0 max 16384 2024-09-21T07:14:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdccfe94740 1 Processor -- start 2024-09-21T07:14:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdccfe94740 1 -- start start 2024-09-21T07:14:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cbd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff390c1b0 0x55dff3cbed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdccfe94740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41b0e00 con 0x55dff38e32f0 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdccfe94740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41b2940 con 0x55dff390c1b0 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdccfe94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41b14d0 con 0x55dff38eb4d0 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43608/0 (socket says 172.21.15.92:43608) 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.388+0000 7fdcc259c640 1 -- 172.21.15.92:0/1653215059 learned_addr learned my addr 172.21.15.92:0/1653215059 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.389+0000 7fdcc2d9d640 1 --2- 172.21.15.92:0/1653215059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff390c1b0 0x55dff3cbed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.389+0000 7fdcc1d9b640 1 --2- 172.21.15.92:0/1653215059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cbd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.389+0000 7fdcc259c640 1 -- 172.21.15.92:0/1653215059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 msgr2=0x55dff3cbd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.389+0000 7fdcc259c640 1 --2- 172.21.15.92:0/1653215059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cbd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.389+0000 7fdcc259c640 1 -- 172.21.15.92:0/1653215059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff390c1b0 msgr2=0x55dff3cbed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.389+0000 7fdcc259c640 1 --2- 172.21.15.92:0/1653215059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff390c1b0 0x55dff3cbed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.389+0000 7fdcc259c640 1 -- 172.21.15.92:0/1653215059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dff3cb3cb0 con 0x55dff38e32f0 2024-09-21T07:14:47.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.389+0000 7fdcc259c640 1 --2- 172.21.15.92:0/1653215059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb33a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55dff3ccf8a0 tx=0x7fdcb401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e3f2b9f91cc3a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:47.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.389+0000 7fdcabfff640 1 -- 172.21.15.92:0/1653215059 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400f790 con 0x55dff38e32f0 2024-09-21T07:14:47.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.390+0000 7fdcabfff640 1 -- 172.21.15.92:0/1653215059 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcb4037070 con 0x55dff38e32f0 2024-09-21T07:14:47.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.390+0000 7fdcabfff640 1 -- 172.21.15.92:0/1653215059 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40329a0 con 0x55dff38e32f0 2024-09-21T07:14:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.390+0000 7fdccfe94740 1 -- 172.21.15.92:0/1653215059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 msgr2=0x55dff3cb33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.390+0000 7fdccfe94740 1 --2- 172.21.15.92:0/1653215059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb33a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55dff3ccf8a0 tx=0x7fdcb401b000 comp rx=0 tx=0).stop 2024-09-21T07:14:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 -- 172.21.15.92:0/1653215059 shutdown_connections 2024-09-21T07:14:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 --2- 172.21.15.92:0/1653215059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff390c1b0 0x55dff3cbed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 --2- 172.21.15.92:0/1653215059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cbd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 --2- 172.21.15.92:0/1653215059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff38e32f0 0x55dff3cb33a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 -- 172.21.15.92:0/1653215059 >> 172.21.15.92:0/1653215059 conn(0x55dff3900300 msgr2=0x55dff3cbe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 -- 172.21.15.92:0/1653215059 shutdown_connections 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 -- 172.21.15.92:0/1653215059 wait complete. 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 -- start start 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 Processor -- start 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff38e32f0 0x55dff3cc5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cc0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff390c1b0 0x55dff3cc11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41b2270 con 0x55dff390c1b0 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41b1ba0 con 0x55dff38e32f0 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.391+0000 7fdccfe94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41aede0 con 0x55dff38eb4d0 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdccfe94740 10 client.0 _ll_register_callbacks cb 0x7fdcb800d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff390c1b0 0x55dff3cc11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff38e32f0 0x55dff3cc5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff390c1b0 0x55dff3cc11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43616/0 (socket says 172.21.15.92:43616) 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc2d9d640 1 -- 172.21.15.92:0/3200838727 learned_addr learned my addr 172.21.15.92:0/3200838727 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc1d9b640 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cc0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc2d9d640 1 -- 172.21.15.92:0/3200838727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 msgr2=0x55dff3cc0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc2d9d640 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cc0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc2d9d640 1 -- 172.21.15.92:0/3200838727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff38e32f0 msgr2=0x55dff3cc5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc2d9d640 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff38e32f0 0x55dff3cc5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc2d9d640 1 -- 172.21.15.92:0/3200838727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dff3cc1720 con 0x55dff390c1b0 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdcc2d9d640 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff390c1b0 0x55dff3cc11e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004af0 tx=0x7fdcbc030f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d872ec616031a732 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3200838727 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc04e070 con 0x55dff390c1b0 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3200838727 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdcbc046650 con 0x55dff390c1b0 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.392+0000 7fdccfe94740 1 -- 172.21.15.92:0/3200838727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcb4037070 con 0x55dff390c1b0 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3200838727 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdcbc036040 con 0x55dff390c1b0 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdccfe94740 10 client.16152 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdccfe94740 1 -- 172.21.15.92:0/3200838727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dff3d39750 con 0x55dff390c1b0 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3200838727 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcb4037070 con 0x55dff390c1b0 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3200838727 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdcbc03c040 con 0x55dff390c1b0 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdccfe94740 10 client.16152 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdccfe94740 10 client.16152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdccfe94740 20 client.16152 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dff38a01c0 0x55dff3d3bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdccfe94740 4 client.16152 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdccfe94740 1 -- 172.21.15.92:0/3200838727 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dff3c240f0 con 0x55dff38a01c0 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.393+0000 7fdcc259c640 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dff38a01c0 0x55dff3d3bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.394+0000 7fdcc259c640 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dff38a01c0 0x55dff3d3bae0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbc27217869a7333 server_cookie=a347afe4e1bd7a39 in_seq=0 out_seq=0 2024-09-21T07:14:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.394+0000 7fdca9ffb640 10 client.16152 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdca9ffb640 1 -- 172.21.15.92:0/3200838727 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dff3c240f0 con 0x55dff38a01c0 2024-09-21T07:14:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdca9ffb640 10 client.16152 handle_command_reply: tid=0 2024-09-21T07:14:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdccfe94740 1 client.16152 shutdown 2024-09-21T07:14:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdccfe94740 1 -- 172.21.15.92:0/3200838727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff390c1b0 msgr2=0x55dff3cc11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff390c1b0 0x55dff3cc11e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004af0 tx=0x7fdcbc030f60 comp rx=0 tx=0).stop 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdccfe94740 1 -- 172.21.15.92:0/3200838727 shutdown_connections 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dff38a01c0 0x55dff3d3bae0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdca9ffb640 0 client.16152 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dff390c1b0 0x55dff3cc11e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dff38eb4d0 0x55dff3cc0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.403+0000 7fdccfe94740 1 --2- 172.21.15.92:0/3200838727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dff38e32f0 0x55dff3cc5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.404+0000 7fdccfe94740 1 -- 172.21.15.92:0/3200838727 >> 172.21.15.92:0/3200838727 conn(0x55dff3900300 msgr2=0x55dff3cb3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.404+0000 7fdccfe94740 1 -- 172.21.15.92:0/3200838727 shutdown_connections 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.404+0000 7fdccfe94740 1 -- 172.21.15.92:0/3200838727 wait complete. 2024-09-21T07:14:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.404+0000 7fdccfe94740 20 client.16152 trim_cache size 0 max 16384 2024-09-21T07:14:47.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:14:47.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:14:47.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:14:47.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:14:47.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.404+0000 7fdcc8f28640 1 -- 172.21.15.92:0/2304064004 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdcac0b6700 msgr2=0x7fdcac0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.404+0000 7fdcc8f28640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdcac0b6700 0x7fdcac0b8c10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55dff3cb0630 tx=0x7fdcb4009260 comp rx=0 tx=0).stop 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.404+0000 7fdcc8f28640 1 -- 172.21.15.92:0/2304064004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcc4108310 msgr2=0x7fdcc419b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.404+0000 7fdcc8f28640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcc4108310 0x7fdcc419b700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800d750 tx=0x7fdcb800dc10 comp rx=0 tx=0).stop 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.404+0000 7fdcc8f28640 1 -- 172.21.15.92:0/2304064004 shutdown_connections 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.404+0000 7fdcc8f28640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdcac0b6700 0x7fdcac0b8c10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.405+0000 7fdcc8f28640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcc4108c60 0x7fdcc419bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.405+0000 7fdcc8f28640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcc4108310 0x7fdcc419b700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.405+0000 7fdcc8f28640 1 --2- 172.21.15.92:0/2304064004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcc41029e0 0x7fdcc419b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.405+0000 7fdcc8f28640 1 -- 172.21.15.92:0/2304064004 >> 172.21.15.92:0/2304064004 conn(0x7fdcc40fe3e0 msgr2=0x7fdcc4107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.405+0000 7fdcc8f28640 1 -- 172.21.15.92:0/2304064004 shutdown_connections 2024-09-21T07:14:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:14:47.405+0000 7fdcc8f28640 1 -- 172.21.15.92:0/2304064004 wait complete. 2024-09-21T07:14:49.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:48 smithi175 ceph-mon[34064]: pgmap v391: 129 pgs: 129 active+clean; 101 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8.3 MiB/s wr, 11 op/s 2024-09-21T07:14:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:48 smithi092 ceph-mon[30987]: pgmap v391: 129 pgs: 129 active+clean; 101 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8.3 MiB/s wr, 11 op/s 2024-09-21T07:14:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:48 smithi169 ceph-mon[33705]: pgmap v391: 129 pgs: 129 active+clean; 101 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8.3 MiB/s wr, 11 op/s 2024-09-21T07:14:50.856 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:14:51.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:50 smithi175 ceph-mon[34064]: pgmap v392: 129 pgs: 129 active+clean; 425 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 35 MiB/s wr, 24 op/s 2024-09-21T07:14:51.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:50 smithi092 ceph-mon[30987]: pgmap v392: 129 pgs: 129 active+clean; 425 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 35 MiB/s wr, 24 op/s 2024-09-21T07:14:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:50 smithi169 ceph-mon[33705]: pgmap v392: 129 pgs: 129 active+clean; 425 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 35 MiB/s wr, 24 op/s 2024-09-21T07:14:51.170 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:51.213 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T07:14:51.213 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:14:51.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.919+0000 7f65c09bd640 1 -- 172.21.15.92:0/2986773325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65bc1083a0 msgr2=0x7f65bc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:51.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.919+0000 7f65c09bd640 1 --2- 172.21.15.92:0/2986773325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65bc1083a0 0x7f65bc1087b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009900 tx=0x7f65a402a410 comp rx=0 tx=0).stop 2024-09-21T07:14:51.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.919+0000 7f65c09bd640 1 -- 172.21.15.92:0/2986773325 shutdown_connections 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.919+0000 7f65c09bd640 1 --2- 172.21.15.92:0/2986773325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65bc108cf0 0x7f65bc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.919+0000 7f65c09bd640 1 --2- 172.21.15.92:0/2986773325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65bc1083a0 0x7f65bc1087b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.919+0000 7f65c09bd640 1 --2- 172.21.15.92:0/2986773325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc102a60 0x7f65bc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.919+0000 7f65c09bd640 1 -- 172.21.15.92:0/2986773325 >> 172.21.15.92:0/2986773325 conn(0x7f65bc079730 msgr2=0x7f65bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.919+0000 7f65c09bd640 1 -- 172.21.15.92:0/2986773325 shutdown_connections 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.919+0000 7f65c09bd640 1 -- 172.21.15.92:0/2986773325 wait complete. 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.920+0000 7f65c09bd640 1 Processor -- start 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65c09bd640 1 -- start start 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65c09bd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65bc102a60 0x7f65bc19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65c09bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65bc1083a0 0x7f65bc19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65c09bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc108cf0 0x7f65bc19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65c09bd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc113960 con 0x7f65bc1083a0 2024-09-21T07:14:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65c09bd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1137e0 con 0x7f65bc102a60 2024-09-21T07:14:51.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65c09bd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc113ae0 con 0x7f65bc108cf0 2024-09-21T07:14:51.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65bc1083a0 0x7f65bc19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65bc1083a0 0x7f65bc19a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56116/0 (socket says 172.21.15.92:56116) 2024-09-21T07:14:51.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65b3fff640 1 -- 172.21.15.92:0/3157811430 learned_addr learned my addr 172.21.15.92:0/3157811430 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:51.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65ba59c640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65bc102a60 0x7f65bc19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65bad9d640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc108cf0 0x7f65bc19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.921+0000 7f65b3fff640 1 -- 172.21.15.92:0/3157811430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc108cf0 msgr2=0x7f65bc19fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65b3fff640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc108cf0 0x7f65bc19fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65b3fff640 1 -- 172.21.15.92:0/3157811430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65bc102a60 msgr2=0x7f65bc19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65b3fff640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65bc102a60 0x7f65bc19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65b3fff640 1 -- 172.21.15.92:0/3157811430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc1a0320 con 0x7f65bc1083a0 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65ba59c640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65bc102a60 0x7f65bc19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65b3fff640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65bc1083a0 0x7f65bc19a950 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f65a402a930 tx=0x7f65a4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65b37fe640 1 -- 172.21.15.92:0/3157811430 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a403f070 con 0x7f65bc1083a0 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65b37fe640 1 -- 172.21.15.92:0/3157811430 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65a4003e10 con 0x7f65bc1083a0 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65c09bd640 1 -- 172.21.15.92:0/3157811430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65bc1a05b0 con 0x7f65bc1083a0 2024-09-21T07:14:51.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65b37fe640 1 -- 172.21.15.92:0/3157811430 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4035030 con 0x7f65bc1083a0 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.922+0000 7f65c09bd640 1 -- 172.21.15.92:0/3157811430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65bc1a6d70 con 0x7f65bc1083a0 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.925+0000 7f65c6f31740 1 Processor -- start 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.925+0000 7f65b37fe640 1 -- 172.21.15.92:0/3157811430 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f65a4042070 con 0x7f65bc1083a0 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.925+0000 7f65c6f31740 1 -- start start 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.925+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee64d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.925+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee64db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 0x5648ee64e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65c6f31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5648ee5c3e50 con 0x5648ee2a6070 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65c6f31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5648ee5b3280 con 0x5648ee27d1b0 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65c6f31740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5648ee5b7090 con 0x5648ee285390 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee64d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65ba59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee64db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee64d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56126/0 (socket says 172.21.15.92:56126) 2024-09-21T07:14:51.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65bad9d640 1 -- 172.21.15.92:0/4058003031 learned_addr learned my addr 172.21.15.92:0/4058003031 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65ba59c640 1 -- 172.21.15.92:0/4058003031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 msgr2=0x5648ee64e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65ba59c640 1 --2- 172.21.15.92:0/4058003031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 0x5648ee64e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65ba59c640 1 -- 172.21.15.92:0/4058003031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 msgr2=0x5648ee64d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65ba59c640 1 --2- 172.21.15.92:0/4058003031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee64d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65ba59c640 1 -- 172.21.15.92:0/4058003031 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648ee311650 con 0x5648ee27d1b0 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65b37fe640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65a80b6680 0x7f65a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65bad9d640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65a80b6680 0x7f65a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65ba59c640 1 --2- 172.21.15.92:0/4058003031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee64db90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00af30 tx=0x7f65ac00f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e132afb008a44a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.926+0000 7f65b37fe640 1 -- 172.21.15.92:0/3157811430 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f65a4108240 con 0x7f65bc1083a0 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.927+0000 7f65b0ff9640 1 -- 172.21.15.92:0/4058003031 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac01d070 con 0x5648ee27d1b0 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.927+0000 7f65b0ff9640 1 -- 172.21.15.92:0/4058003031 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65ac010d90 con 0x5648ee27d1b0 2024-09-21T07:14:51.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.927+0000 7f65b0ff9640 1 -- 172.21.15.92:0/4058003031 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac018cd0 con 0x5648ee27d1b0 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 -- 172.21.15.92:0/4058003031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 msgr2=0x5648ee64db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65bad9d640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65a80b6680 0x7f65a80b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f65b4005f40 tx=0x7f65b4009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 --2- 172.21.15.92:0/4058003031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee64db90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00af30 tx=0x7f65ac00f850 comp rx=0 tx=0).stop 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 -- 172.21.15.92:0/4058003031 shutdown_connections 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 --2- 172.21.15.92:0/4058003031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 0x5648ee64e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 --2- 172.21.15.92:0/4058003031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee64db90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 --2- 172.21.15.92:0/4058003031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee64d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 -- 172.21.15.92:0/4058003031 >> 172.21.15.92:0/4058003031 conn(0x5648ee29a460 msgr2=0x5648ee64b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 -- 172.21.15.92:0/4058003031 shutdown_connections 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 -- 172.21.15.92:0/4058003031 wait complete. 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 -- start start 2024-09-21T07:14:51.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.928+0000 7f65c6f31740 1 Processor -- start 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee65d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 0x5648ee65d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee669490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65c6f31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5648ee414700 con 0x5648ee2a6070 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65c6f31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5648ee54e110 con 0x5648ee27d1b0 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65c6f31740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5648ee660130 con 0x5648ee285390 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65c6f31740 10 client.0 _ll_register_callbacks cb 0x5648ee567990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee669490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee669490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56134/0 (socket says 172.21.15.92:56134) 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65bad9d640 1 -- 172.21.15.92:0/1422351073 learned_addr learned my addr 172.21.15.92:0/1422351073 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65ba59c640 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee65d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65bad9d640 1 -- 172.21.15.92:0/1422351073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 msgr2=0x5648ee65d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:51.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65bad9d640 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 0x5648ee65d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65bad9d640 1 -- 172.21.15.92:0/1422351073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 msgr2=0x5648ee65d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65bad9d640 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee65d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.929+0000 7f65bad9d640 1 -- 172.21.15.92:0/1422351073 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648ee57bc40 con 0x5648ee2a6070 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.930+0000 7f65bad9d640 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee669490 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f65b40042c0 tx=0x7f65b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65c2e0ac2386cf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.930+0000 7f65a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.930+0000 7f65a1ffb640 1 -- 172.21.15.92:0/1422351073 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b4011de0 con 0x5648ee2a6070 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.930+0000 7f65a1ffb640 1 -- 172.21.15.92:0/1422351073 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f65b4020420 con 0x5648ee2a6070 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.930+0000 7f65c6f31740 1 -- 172.21.15.92:0/1422351073 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65ac010d90 con 0x5648ee2a6070 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.930+0000 7f65a1ffb640 1 -- 172.21.15.92:0/1422351073 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65b4020620 con 0x5648ee2a6070 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.930+0000 7f65c6f31740 10 client.16164 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.930+0000 7f65c6f31740 1 -- 172.21.15.92:0/1422351073 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648ee66bf90 con 0x5648ee2a6070 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.930+0000 7f65a1ffb640 1 -- 172.21.15.92:0/1422351073 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65ac010d90 con 0x5648ee2a6070 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.931+0000 7f65a1ffb640 1 -- 172.21.15.92:0/1422351073 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f65b400f040 con 0x5648ee2a6070 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.931+0000 7f65c6f31740 10 client.16164 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:51.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.931+0000 7f65c6f31740 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.931+0000 7f65c6f31740 20 client.16164 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.931+0000 7f65c6f31740 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5648ee2649f0 0x5648ee66f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.931+0000 7f65c6f31740 4 client.16164 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.931+0000 7f65c6f31740 1 -- 172.21.15.92:0/1422351073 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648ee5c5da0 con 0x5648ee2649f0 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.931+0000 7f65ba59c640 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5648ee2649f0 0x5648ee66f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.931+0000 7f65a1ffb640 10 client.16164 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.931+0000 7f65ba59c640 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5648ee2649f0 0x5648ee66f550 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5723fc2a9aa6127 server_cookie=bc87e2f9086fd58d in_seq=0 out_seq=0 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.932+0000 7f65a1ffb640 1 -- 172.21.15.92:0/1422351073 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648ee5c5da0 con 0x5648ee2649f0 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.932+0000 7f65a1ffb640 10 client.16164 handle_command_reply: tid=0 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.932+0000 7f65c6f31740 1 client.16164 shutdown 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.932+0000 7f65c6f31740 1 -- 172.21.15.92:0/1422351073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 msgr2=0x5648ee669490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.932+0000 7f65c6f31740 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee669490 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f65b40042c0 tx=0x7f65b4004a40 comp rx=0 tx=0).stop 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.932+0000 7f65c6f31740 1 -- 172.21.15.92:0/1422351073 shutdown_connections 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.932+0000 7f65c6f31740 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5648ee2649f0 0x5648ee66f550 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.933+0000 7f65a1ffb640 0 client.16164 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:51.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.933+0000 7f65c6f31740 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee669490 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.933+0000 7f65c6f31740 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 0x5648ee65d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.933+0000 7f65c6f31740 1 --2- 172.21.15.92:0/1422351073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee65d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.933+0000 7f65c6f31740 1 -- 172.21.15.92:0/1422351073 >> 172.21.15.92:0/1422351073 conn(0x5648ee29a460 msgr2=0x5648ee64f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:51.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.933+0000 7f65c6f31740 1 -- 172.21.15.92:0/1422351073 shutdown_connections 2024-09-21T07:14:51.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.933+0000 7f65c6f31740 1 -- 172.21.15.92:0/1422351073 wait complete. 2024-09-21T07:14:51.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.933+0000 7f65c6f31740 20 client.16164 trim_cache size 0 max 16384 2024-09-21T07:14:51.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.952+0000 7f65c6f31740 1 Processor -- start 2024-09-21T07:14:51.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.952+0000 7f65c6f31740 1 -- start start 2024-09-21T07:14:51.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.952+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee65ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.952+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 0x5648ee65bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.952+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee65cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.952+0000 7f65c6f31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1aec50 con 0x5648ee2a6070 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.952+0000 7f65c6f31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1b0790 con 0x5648ee27d1b0 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.952+0000 7f65c6f31740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1af320 con 0x5648ee285390 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee65cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee65cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56148/0 (socket says 172.21.15.92:56148) 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65bad9d640 1 -- 172.21.15.92:0/70890386 learned_addr learned my addr 172.21.15.92:0/70890386 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65ba59c640 1 --2- 172.21.15.92:0/70890386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee65ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65b3fff640 1 --2- 172.21.15.92:0/70890386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 0x5648ee65bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65ba59c640 1 -- 172.21.15.92:0/70890386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 msgr2=0x5648ee65bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65ba59c640 1 --2- 172.21.15.92:0/70890386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 0x5648ee65bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65ba59c640 1 -- 172.21.15.92:0/70890386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 msgr2=0x5648ee65cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:51.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65ba59c640 1 --2- 172.21.15.92:0/70890386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee65cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65ba59c640 1 -- 172.21.15.92:0/70890386 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648ee657d90 con 0x5648ee27d1b0 2024-09-21T07:14:51.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65bad9d640 1 --2- 172.21.15.92:0/70890386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee65cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:51.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65ba59c640 1 --2- 172.21.15.92:0/70890386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee65ba10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65ac01b040 tx=0x7f65ac00ae60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eef57d54b21c3f2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:51.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.953+0000 7f65a3fff640 1 -- 172.21.15.92:0/70890386 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac02a070 con 0x5648ee27d1b0 2024-09-21T07:14:51.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.954+0000 7f65a3fff640 1 -- 172.21.15.92:0/70890386 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65ac01e040 con 0x5648ee27d1b0 2024-09-21T07:14:51.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.954+0000 7f65a3fff640 1 -- 172.21.15.92:0/70890386 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac01d040 con 0x5648ee27d1b0 2024-09-21T07:14:51.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.954+0000 7f65c6f31740 1 -- 172.21.15.92:0/70890386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 msgr2=0x5648ee65ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.954+0000 7f65c6f31740 1 --2- 172.21.15.92:0/70890386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee65ba10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65ac01b040 tx=0x7f65ac00ae60 comp rx=0 tx=0).stop 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.954+0000 7f65c6f31740 1 -- 172.21.15.92:0/70890386 shutdown_connections 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.954+0000 7f65c6f31740 1 --2- 172.21.15.92:0/70890386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee2a6070 0x5648ee65cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.954+0000 7f65c6f31740 1 --2- 172.21.15.92:0/70890386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee285390 0x5648ee65bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.954+0000 7f65c6f31740 1 --2- 172.21.15.92:0/70890386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee27d1b0 0x5648ee65ba10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.954+0000 7f65c6f31740 1 -- 172.21.15.92:0/70890386 >> 172.21.15.92:0/70890386 conn(0x5648ee29a460 msgr2=0x5648ee6695a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.955+0000 7f65c6f31740 1 -- 172.21.15.92:0/70890386 shutdown_connections 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.955+0000 7f65c6f31740 1 -- 172.21.15.92:0/70890386 wait complete. 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.955+0000 7f65c6f31740 1 -- start start 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.955+0000 7f65c6f31740 1 Processor -- start 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.955+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee27d1b0 0x5648ee660ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.955+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee285390 0x5648ee661240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.955+0000 7f65c6f31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee2a6070 0x5648ee6d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.955+0000 7f65c6f31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1b00c0 con 0x5648ee285390 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.955+0000 7f65c6f31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1af9f0 con 0x5648ee2a6070 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.955+0000 7f65c6f31740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1acc30 con 0x5648ee27d1b0 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65c6f31740 10 client.0 _ll_register_callbacks cb 0x7f65b4009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee285390 0x5648ee661240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee285390 0x5648ee661240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56158/0 (socket says 172.21.15.92:56158) 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65b3fff640 1 -- 172.21.15.92:0/3002197283 learned_addr learned my addr 172.21.15.92:0/3002197283 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65ba59c640 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee27d1b0 0x5648ee660ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65bad9d640 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee2a6070 0x5648ee6d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65b3fff640 1 -- 172.21.15.92:0/3002197283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee27d1b0 msgr2=0x5648ee660ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:51.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65b3fff640 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee27d1b0 0x5648ee660ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65b3fff640 1 -- 172.21.15.92:0/3002197283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee2a6070 msgr2=0x5648ee6d1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65b3fff640 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee2a6070 0x5648ee6d1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65b3fff640 1 -- 172.21.15.92:0/3002197283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648ee6d24f0 con 0x5648ee285390 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65bad9d640 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee2a6070 0x5648ee6d1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65b3fff640 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee285390 0x5648ee661240 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f65a40ca370 tx=0x7f65a40c9cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa48b02f6b2df817 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65a1ffb640 1 -- 172.21.15.92:0/3002197283 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4049040 con 0x5648ee285390 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65a1ffb640 1 -- 172.21.15.92:0/3002197283 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f65a40d7280 con 0x5648ee285390 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.956+0000 7f65c6f31740 1 -- 172.21.15.92:0/3002197283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65ac01e040 con 0x5648ee285390 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65a1ffb640 1 -- 172.21.15.92:0/3002197283 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65a40cd510 con 0x5648ee285390 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65c6f31740 10 client.16170 fetch_fsmap learned FSMap version 29 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65c6f31740 1 -- 172.21.15.92:0/3002197283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648ee6d9880 con 0x5648ee285390 2024-09-21T07:14:51.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65a1ffb640 1 -- 172.21.15.92:0/3002197283 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65ac01e040 con 0x5648ee285390 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65a1ffb640 1 -- 172.21.15.92:0/3002197283 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f65a40f5080 con 0x5648ee285390 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65c6f31740 10 client.16170 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65c6f31740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65c6f31740 20 client.16170 populate_metadata read hostname 'smithi092' 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65c6f31740 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5648ee239da0 0x5648ee6dbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65c6f31740 4 client.16170 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65c6f31740 1 -- 172.21.15.92:0/3002197283 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5648ee5c1850 con 0x5648ee239da0 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.957+0000 7f65ba59c640 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5648ee239da0 0x5648ee6dbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65a1ffb640 10 client.16170 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65ba59c640 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5648ee239da0 0x5648ee6dbfd0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8b50f5a0b3448ab server_cookie=cd00d78a308d4ea9 in_seq=0 out_seq=0 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65a1ffb640 1 -- 172.21.15.92:0/3002197283 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x5648ee5c1850 con 0x5648ee239da0 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65a1ffb640 10 client.16170 handle_command_reply: tid=0 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 client.16170 shutdown 2024-09-21T07:14:51.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 -- 172.21.15.92:0/3002197283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee285390 msgr2=0x5648ee661240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee285390 0x5648ee661240 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f65a40ca370 tx=0x7f65a40c9cb0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 -- 172.21.15.92:0/3002197283 shutdown_connections 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5648ee239da0 0x5648ee6dbfd0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65a1ffb640 0 client.16170 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648ee2a6070 0x5648ee6d1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648ee285390 0x5648ee661240 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 --2- 172.21.15.92:0/3002197283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648ee27d1b0 0x5648ee660ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 -- 172.21.15.92:0/3002197283 >> 172.21.15.92:0/3002197283 conn(0x5648ee29a460 msgr2=0x5648ee65b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 -- 172.21.15.92:0/3002197283 shutdown_connections 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.958+0000 7f65c6f31740 1 -- 172.21.15.92:0/3002197283 wait complete. 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c6f31740 20 client.16170 trim_cache size 0 max 16384 2024-09-21T07:14:51.966 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:14:51.967 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:14:51.968 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:14:51.968 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:14:51.968 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:14:51.968 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:14:51.968 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:14:51.968 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:14:51.968 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:51.968 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:14:51.968 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:14:51.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c09bd640 1 -- 172.21.15.92:0/3157811430 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65a80b6680 msgr2=0x7f65a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c09bd640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65a80b6680 0x7f65a80b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f65b4005f40 tx=0x7f65b4009600 comp rx=0 tx=0).stop 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c09bd640 1 -- 172.21.15.92:0/3157811430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65bc1083a0 msgr2=0x7f65bc19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c09bd640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65bc1083a0 0x7f65bc19a950 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f65a402a930 tx=0x7f65a4003c20 comp rx=0 tx=0).stop 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c09bd640 1 -- 172.21.15.92:0/3157811430 shutdown_connections 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c09bd640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f65a80b6680 0x7f65a80b8b90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c09bd640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc108cf0 0x7f65bc19fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c09bd640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65bc1083a0 0x7f65bc19a950 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c09bd640 1 --2- 172.21.15.92:0/3157811430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65bc102a60 0x7f65bc19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.959+0000 7f65c09bd640 1 -- 172.21.15.92:0/3157811430 >> 172.21.15.92:0/3157811430 conn(0x7f65bc079730 msgr2=0x7f65bc104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.960+0000 7f65c09bd640 1 -- 172.21.15.92:0/3157811430 shutdown_connections 2024-09-21T07:14:51.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:51.960+0000 7f65c09bd640 1 -- 172.21.15.92:0/3157811430 wait complete. 2024-09-21T07:14:52.836 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:52 smithi092 ceph-mon[30987]: pgmap v393: 129 pgs: 129 active+clean; 537 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 45 MiB/s wr, 24 op/s 2024-09-21T07:14:52.837 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:14:52.837 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:14:52.859 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:53.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:52 smithi175 ceph-mon[34064]: pgmap v393: 129 pgs: 129 active+clean; 537 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 45 MiB/s wr, 24 op/s 2024-09-21T07:14:53.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:52 smithi169 ceph-mon[33705]: pgmap v393: 129 pgs: 129 active+clean; 537 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 45 MiB/s wr, 24 op/s 2024-09-21T07:14:53.293 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:14:53.293 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 initial writers = 106963.41 kB/sec 2024-09-21T07:14:53.293 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 initial writers = 106960.55 kB/sec 2024-09-21T07:14:53.293 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 106963.41 kB/sec 2024-09-21T07:14:53.293 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 106963.41 kB/sec 2024-09-21T07:14:53.293 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 106963.41 kB/sec 2024-09-21T07:14:53.293 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 1048576.00 kB 2024-09-21T07:14:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:54 smithi092 ceph-mon[30987]: pgmap v394: 129 pgs: 129 active+clean; 809 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 67 MiB/s wr, 32 op/s 2024-09-21T07:14:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:54 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2287527738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:55.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:54 smithi175 ceph-mon[34064]: pgmap v394: 129 pgs: 129 active+clean; 809 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 67 MiB/s wr, 32 op/s 2024-09-21T07:14:55.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:54 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2287527738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:55.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:54 smithi169 ceph-mon[33705]: pgmap v394: 129 pgs: 129 active+clean; 809 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 67 MiB/s wr, 32 op/s 2024-09-21T07:14:55.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:54 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2287527738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:14:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.334+0000 7f32ff484640 1 -- 172.21.15.92:0/13599016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8109e10 msgr2=0x7f32f8110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.334+0000 7f32ff484640 1 --2- 172.21.15.92:0/13599016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8109e10 0x7f32f8110640 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009ca0 tx=0x7f32f002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:14:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.334+0000 7f32ff484640 1 -- 172.21.15.92:0/13599016 shutdown_connections 2024-09-21T07:14:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.334+0000 7f32ff484640 1 --2- 172.21.15.92:0/13599016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8109e10 0x7f32f8110640 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.334+0000 7f32ff484640 1 --2- 172.21.15.92:0/13599016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f81094c0 0x7f32f81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.334+0000 7f32ff484640 1 --2- 172.21.15.92:0/13599016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f8103b80 0x7f32f8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.334+0000 7f32ff484640 1 -- 172.21.15.92:0/13599016 >> 172.21.15.92:0/13599016 conn(0x7f32f80ff5b0 msgr2=0x7f32f8101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.334+0000 7f32ff484640 1 -- 172.21.15.92:0/13599016 shutdown_connections 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.334+0000 7f32ff484640 1 -- 172.21.15.92:0/13599016 wait complete. 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.335+0000 7f32ff484640 1 Processor -- start 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.335+0000 7f32ff484640 1 -- start start 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.335+0000 7f32ff484640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f8103b80 0x7f32f819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.335+0000 7f32ff484640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f81094c0 0x7f32f819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32ff484640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8109e10 0x7f32f819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32ff484640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32f81139d0 con 0x7f32f8109e10 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32ff484640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8113850 con 0x7f32f81094c0 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32ff484640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8113b50 con 0x7f32f8103b80 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fda21640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8109e10 0x7f32f819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:55.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fda21640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8109e10 0x7f32f819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56168/0 (socket says 172.21.15.92:56168) 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fda21640 1 -- 172.21.15.92:0/2287527738 learned_addr learned my addr 172.21.15.92:0/2287527738 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fd220640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f8103b80 0x7f32f819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fca1f640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f81094c0 0x7f32f819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fda21640 1 -- 172.21.15.92:0/2287527738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f8103b80 msgr2=0x7f32f819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fda21640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f8103b80 0x7f32f819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fda21640 1 -- 172.21.15.92:0/2287527738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f81094c0 msgr2=0x7f32f819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fda21640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f81094c0 0x7f32f819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fda21640 1 -- 172.21.15.92:0/2287527738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f81a0370 con 0x7f32f8109e10 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32fda21640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8109e10 0x7f32f819fc40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f32f0005cc0 tx=0x7f32f0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32ee7fc640 1 -- 172.21.15.92:0/2287527738 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0032e00 con 0x7f32f8109e10 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32ff484640 1 -- 172.21.15.92:0/2287527738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f81a0600 con 0x7f32f8109e10 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32ee7fc640 1 -- 172.21.15.92:0/2287527738 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32f00044d0 con 0x7f32f8109e10 2024-09-21T07:14:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.336+0000 7f32ee7fc640 1 -- 172.21.15.92:0/2287527738 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0030b70 con 0x7f32f8109e10 2024-09-21T07:14:55.822 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:14:55.822 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:14:55.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.337+0000 7f32ff484640 1 -- 172.21.15.92:0/2287527738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f81a6dc0 con 0x7f32f8109e10 2024-09-21T07:14:55.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.337+0000 7f32ff484640 1 -- 172.21.15.92:0/2287527738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f8104e00 con 0x7f32f8109e10 2024-09-21T07:14:55.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.340+0000 7f32ee7fc640 1 -- 172.21.15.92:0/2287527738 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f32f0030d10 con 0x7f32f8109e10 2024-09-21T07:14:55.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.340+0000 7f32ee7fc640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32e40b6680 0x7f32e40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:55.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.341+0000 7f32fd220640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32e40b6680 0x7f32e40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.341+0000 7f32ee7fc640 1 -- 172.21.15.92:0/2287527738 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f32f0108f20 con 0x7f32f8109e10 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.341+0000 7f32fd220640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32e40b6680 0x7f32e40b8b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f32e8005fd0 tx=0x7f32e800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.344+0000 7f32ee7fc640 1 -- 172.21.15.92:0/2287527738 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32f00cf0d0 con 0x7f32f8109e10 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.558+0000 7f32ff484640 1 -- 172.21.15.92:0/2287527738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32f8103f90 con 0x7f32f8109e10 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.559+0000 7f32ee7fc640 1 -- 172.21.15.92:0/2287527738 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f32f00d34b0 con 0x7f32f8109e10 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 -- 172.21.15.92:0/2287527738 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32e40b6680 msgr2=0x7f32e40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32e40b6680 0x7f32e40b8b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f32e8005fd0 tx=0x7f32e800b390 comp rx=0 tx=0).stop 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 -- 172.21.15.92:0/2287527738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8109e10 msgr2=0x7f32f819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8109e10 0x7f32f819fc40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f32f0005cc0 tx=0x7f32f0032a10 comp rx=0 tx=0).stop 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 -- 172.21.15.92:0/2287527738 shutdown_connections 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f32e40b6680 0x7f32e40b8b90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f8109e10 0x7f32f819fc40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:55.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32f81094c0 0x7f32f819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:55.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 --2- 172.21.15.92:0/2287527738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f8103b80 0x7f32f819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:55.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 -- 172.21.15.92:0/2287527738 >> 172.21.15.92:0/2287527738 conn(0x7f32f80ff5b0 msgr2=0x7f32f8106a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:55.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 -- 172.21.15.92:0/2287527738 shutdown_connections 2024-09-21T07:14:55.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:54.561+0000 7f32ff484640 1 -- 172.21.15.92:0/2287527738 wait complete. 2024-09-21T07:14:57.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:56 smithi175 ceph-mon[34064]: pgmap v395: 129 pgs: 129 active+clean; 957 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 80 MiB/s wr, 34 op/s 2024-09-21T07:14:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:56 smithi092 ceph-mon[30987]: pgmap v395: 129 pgs: 129 active+clean; 957 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 80 MiB/s wr, 34 op/s 2024-09-21T07:14:57.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:56 smithi169 ceph-mon[33705]: pgmap v395: 129 pgs: 129 active+clean; 957 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 80 MiB/s wr, 34 op/s 2024-09-21T07:14:58.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:57 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:14:58.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:57 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:14:58.118 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:58.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:57 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:14:58.667 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24649 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T07:14:58.667 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24649 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T07:14:58.951 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:58 smithi092 ceph-mon[30987]: pgmap v396: 129 pgs: 129 active+clean; 1009 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 81 MiB/s wr, 34 op/s 2024-09-21T07:14:58.951 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:14:58.951 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:14:58.951 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:14:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:58 smithi175 ceph-mon[34064]: pgmap v396: 129 pgs: 129 active+clean; 1009 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 81 MiB/s wr, 34 op/s 2024-09-21T07:14:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:14:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:14:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:14:59.044 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:58 smithi169 ceph-mon[33705]: pgmap v396: 129 pgs: 129 active+clean; 1009 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 81 MiB/s wr, 34 op/s 2024-09-21T07:14:59.045 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:14:59.045 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:14:59.045 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:14:59.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.184+0000 7f341766f640 1 -- 172.21.15.92:0/1931513772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34101083a0 msgr2=0x7f34101087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:59.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.184+0000 7f341766f640 1 --2- 172.21.15.92:0/1931513772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34101083a0 0x7f34101087b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f340c009900 tx=0x7f340c02a410 comp rx=0 tx=0).stop 2024-09-21T07:14:59.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.184+0000 7f341766f640 1 -- 172.21.15.92:0/1931513772 shutdown_connections 2024-09-21T07:14:59.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.184+0000 7f341766f640 1 --2- 172.21.15.92:0/1931513772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3410108cf0 0x7f341010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:59.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.184+0000 7f341766f640 1 --2- 172.21.15.92:0/1931513772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34101083a0 0x7f34101087b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:59.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.184+0000 7f341766f640 1 --2- 172.21.15.92:0/1931513772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3410102a60 0x7f3410102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:59.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.184+0000 7f341766f640 1 -- 172.21.15.92:0/1931513772 >> 172.21.15.92:0/1931513772 conn(0x7f3410079730 msgr2=0x7f3410079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:59.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.184+0000 7f341766f640 1 -- 172.21.15.92:0/1931513772 shutdown_connections 2024-09-21T07:14:59.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.184+0000 7f341766f640 1 -- 172.21.15.92:0/1931513772 wait complete. 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341766f640 1 Processor -- start 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341766f640 1 -- start start 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341766f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3410102a60 0x7f341019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341766f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34101083a0 0x7f341019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341766f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3410108cf0 0x7f341019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341766f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3410112810 con 0x7f3410102a60 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341766f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3410112690 con 0x7f3410108cf0 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341766f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3410112990 con 0x7f34101083a0 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341540b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3410102a60 0x7f341019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341540b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3410102a60 0x7f341019b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56178/0 (socket says 172.21.15.92:56178) 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341540b640 1 -- 172.21.15.92:0/3231948516 learned_addr learned my addr 172.21.15.92:0/3231948516 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:14:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f3414c0a640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34101083a0 0x7f341019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f3415c0c640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3410108cf0 0x7f341019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341540b640 1 -- 172.21.15.92:0/3231948516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34101083a0 msgr2=0x7f341019b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341540b640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34101083a0 0x7f341019b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341540b640 1 -- 172.21.15.92:0/3231948516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3410108cf0 msgr2=0x7f341019bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341540b640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3410108cf0 0x7f341019bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f341540b640 1 -- 172.21.15.92:0/3231948516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34101a63d0 con 0x7f3410102a60 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.185+0000 7f3415c0c640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3410108cf0 0x7f341019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.186+0000 7f341540b640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3410102a60 0x7f341019b1a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f340000d770 tx=0x7f340000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.186+0000 7f34067fc640 1 -- 172.21.15.92:0/3231948516 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400017070 con 0x7f3410102a60 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.186+0000 7f341766f640 1 -- 172.21.15.92:0/3231948516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34101a66c0 con 0x7f3410102a60 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.186+0000 7f34067fc640 1 -- 172.21.15.92:0/3231948516 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34000054b0 con 0x7f3410102a60 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.186+0000 7f34067fc640 1 -- 172.21.15.92:0/3231948516 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400004c60 con 0x7f3410102a60 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.186+0000 7f341766f640 1 -- 172.21.15.92:0/3231948516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34101a6c00 con 0x7f3410102a60 2024-09-21T07:14:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.187+0000 7f341766f640 1 -- 172.21.15.92:0/3231948516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3410102e70 con 0x7f3410102a60 2024-09-21T07:14:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.188+0000 7f34067fc640 1 -- 172.21.15.92:0/3231948516 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f3400004e00 con 0x7f3410102a60 2024-09-21T07:14:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.189+0000 7f34067fc640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33fc0b6680 0x7f33fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:14:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.189+0000 7f3414c0a640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33fc0b6680 0x7f33fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:14:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.189+0000 7f34067fc640 1 -- 172.21.15.92:0/3231948516 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f34000e7a00 con 0x7f3410102a60 2024-09-21T07:14:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.189+0000 7f3414c0a640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33fc0b6680 0x7f33fc0b8b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f340c02a930 tx=0x7f340c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:14:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.192+0000 7f34067fc640 1 -- 172.21.15.92:0/3231948516 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f34000adbb0 con 0x7f3410102a60 2024-09-21T07:14:59.229 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:14:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.417+0000 7f341766f640 1 -- 172.21.15.92:0/3231948516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f341006b290 con 0x7f3410102a60 2024-09-21T07:14:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.418+0000 7f34067fc640 1 -- 172.21.15.92:0/3231948516 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f341006b290 con 0x7f3410102a60 2024-09-21T07:14:59.420 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:14:59.420 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:14:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.420+0000 7f341766f640 1 -- 172.21.15.92:0/3231948516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33fc0b6680 msgr2=0x7f33fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.420+0000 7f341766f640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33fc0b6680 0x7f33fc0b8b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f340c02a930 tx=0x7f340c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.420+0000 7f341766f640 1 -- 172.21.15.92:0/3231948516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3410102a60 msgr2=0x7f341019b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.420+0000 7f341766f640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3410102a60 0x7f341019b1a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f340000d770 tx=0x7f340000dc30 comp rx=0 tx=0).stop 2024-09-21T07:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.421+0000 7f341766f640 1 -- 172.21.15.92:0/3231948516 shutdown_connections 2024-09-21T07:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.421+0000 7f341766f640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f33fc0b6680 0x7f33fc0b8b90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.421+0000 7f341766f640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3410108cf0 0x7f341019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.421+0000 7f341766f640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34101083a0 0x7f341019b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.421+0000 7f341766f640 1 --2- 172.21.15.92:0/3231948516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3410102a60 0x7f341019b1a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.421+0000 7f341766f640 1 -- 172.21.15.92:0/3231948516 >> 172.21.15.92:0/3231948516 conn(0x7f3410079730 msgr2=0x7f34101044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.421+0000 7f341766f640 1 -- 172.21.15.92:0/3231948516 shutdown_connections 2024-09-21T07:14:59.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:14:59.421+0000 7f341766f640 1 -- 172.21.15.92:0/3231948516 wait complete. 2024-09-21T07:15:00.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:14:59 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3231948516' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:14:59 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3231948516' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:00.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:14:59 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3231948516' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:00.201 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:15:00.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.405+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/963204767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f34109e30 msgr2=0x7f3f34110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.405+0000 7f3f3a2dd640 1 --2- 172.21.15.92:0/963204767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f34109e30 0x7f3f34110660 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009ca0 tx=0x7f3f2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.405+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/963204767 shutdown_connections 2024-09-21T07:15:00.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.405+0000 7f3f3a2dd640 1 --2- 172.21.15.92:0/963204767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f34109e30 0x7f3f34110660 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.405+0000 7f3f3a2dd640 1 --2- 172.21.15.92:0/963204767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f341094e0 0x7f3f341098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.405+0000 7f3f3a2dd640 1 --2- 172.21.15.92:0/963204767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f34103ba0 0x7f3f34103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.405+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/963204767 >> 172.21.15.92:0/963204767 conn(0x7f3f340ff5f0 msgr2=0x7f3f34101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.405+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/963204767 shutdown_connections 2024-09-21T07:15:00.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.405+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/963204767 wait complete. 2024-09-21T07:15:00.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3a2dd640 1 Processor -- start 2024-09-21T07:15:00.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3a2dd640 1 -- start start 2024-09-21T07:15:00.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3a2dd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f34103ba0 0x7f3f34075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3a2dd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f341094e0 0x7f3f34075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3a2dd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f34109e30 0x7f3f34076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3a2dd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3f341139f0 con 0x7f3f34109e30 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3a2dd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3f34113870 con 0x7f3f341094e0 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3a2dd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f34113b70 con 0x7f3f34103ba0 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3887a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f34109e30 0x7f3f34076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3887a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f34109e30 0x7f3f34076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38848/0 (socket says 172.21.15.92:38848) 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f34103ba0 0x7f3f34075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.406+0000 7f3f3887a640 1 -- 172.21.15.92:0/42068473 learned_addr learned my addr 172.21.15.92:0/42068473 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.407+0000 7f3f337fe640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f341094e0 0x7f3f34075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.407+0000 7f3f3887a640 1 -- 172.21.15.92:0/42068473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f34103ba0 msgr2=0x7f3f34075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.407+0000 7f3f3887a640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f34103ba0 0x7f3f34075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.407+0000 7f3f3887a640 1 -- 172.21.15.92:0/42068473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f341094e0 msgr2=0x7f3f34075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.407+0000 7f3f3887a640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f341094e0 0x7f3f34075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.407+0000 7f3f3887a640 1 -- 172.21.15.92:0/42068473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f341a86c0 con 0x7f3f34109e30 2024-09-21T07:15:00.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.407+0000 7f3f33fff640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f34103ba0 0x7f3f34075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:00.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.407+0000 7f3f3887a640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f34109e30 0x7f3f34076190 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c005cc0 tx=0x7f3f2c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.407+0000 7f3f317fa640 1 -- 172.21.15.92:0/42068473 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c032e00 con 0x7f3f34109e30 2024-09-21T07:15:00.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.407+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/42068473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f341a8950 con 0x7f3f34109e30 2024-09-21T07:15:00.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.408+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/42068473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f341a8ee0 con 0x7f3f34109e30 2024-09-21T07:15:00.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.408+0000 7f3f317fa640 1 -- 172.21.15.92:0/42068473 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f2c0044d0 con 0x7f3f34109e30 2024-09-21T07:15:00.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.408+0000 7f3f317fa640 1 -- 172.21.15.92:0/42068473 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c030b70 con 0x7f3f34109e30 2024-09-21T07:15:00.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.411+0000 7f3f40851740 1 Processor -- start 2024-09-21T07:15:00.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.411+0000 7f3f317fa640 1 -- 172.21.15.92:0/42068473 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f3f2c04e440 con 0x7f3f34109e30 2024-09-21T07:15:00.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.411+0000 7f3f40851740 1 -- start start 2024-09-21T07:15:00.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f40851740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 0x556b91407e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f40851740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b9102f980 0x556b91408350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f40851740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 0x556b91408890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f40851740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556b91375b90 con 0x556b91058840 2024-09-21T07:15:00.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f40851740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556b91364fc0 con 0x556b91037b60 2024-09-21T07:15:00.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f40851740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556b91368dd0 con 0x556b9102f980 2024-09-21T07:15:00.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b9102f980 0x556b91408350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f337fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 0x556b91407e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b9102f980 0x556b91408350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:33478/0 (socket says 172.21.15.92:33478) 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f33fff640 1 -- 172.21.15.92:0/258957271 learned_addr learned my addr 172.21.15.92:0/258957271 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.412+0000 7f3f337fe640 1 --2- 172.21.15.92:0/258957271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 0x556b91408890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.413+0000 7f3f337fe640 1 -- 172.21.15.92:0/258957271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b9102f980 msgr2=0x556b91408350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.413+0000 7f3f337fe640 1 --2- 172.21.15.92:0/258957271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b9102f980 0x556b91408350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.413+0000 7f3f337fe640 1 -- 172.21.15.92:0/258957271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 msgr2=0x556b91408890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.413+0000 7f3f337fe640 1 --2- 172.21.15.92:0/258957271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 0x556b91408890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.413+0000 7f3f337fe640 1 -- 172.21.15.92:0/258957271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b912ec060 con 0x556b91058840 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.413+0000 7f3f337fe640 1 --2- 172.21.15.92:0/258957271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 0x556b91407e10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3f28005fd0 tx=0x7f3f28005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48969b7f0d1c40c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.413+0000 7f3f1a7fc640 1 -- 172.21.15.92:0/258957271 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28004030 con 0x556b91058840 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.414+0000 7f3f1a7fc640 1 -- 172.21.15.92:0/258957271 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f28011750 con 0x556b91058840 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.414+0000 7f3f1a7fc640 1 -- 172.21.15.92:0/258957271 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28003850 con 0x556b91058840 2024-09-21T07:15:00.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.414+0000 7f3f317fa640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f1c0b6700 0x7f3f1c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.414+0000 7f3f33fff640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f1c0b6700 0x7f3f1c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.414+0000 7f3f317fa640 1 -- 172.21.15.92:0/42068473 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3f2c108d50 con 0x7f3f34109e30 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.415+0000 7f3f40851740 1 -- 172.21.15.92:0/258957271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 msgr2=0x556b91407e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.415+0000 7f3f40851740 1 --2- 172.21.15.92:0/258957271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 0x556b91407e10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3f28005fd0 tx=0x7f3f28005d10 comp rx=0 tx=0).stop 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.415+0000 7f3f40851740 1 -- 172.21.15.92:0/258957271 shutdown_connections 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.415+0000 7f3f40851740 1 --2- 172.21.15.92:0/258957271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 0x556b91408890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.415+0000 7f3f40851740 1 --2- 172.21.15.92:0/258957271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b9102f980 0x556b91408350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.415+0000 7f3f40851740 1 --2- 172.21.15.92:0/258957271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 0x556b91407e10 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.415+0000 7f3f40851740 1 -- 172.21.15.92:0/258957271 >> 172.21.15.92:0/258957271 conn(0x556b9104c990 msgr2=0x556b91405d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.415+0000 7f3f40851740 1 -- 172.21.15.92:0/258957271 shutdown_connections 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.415+0000 7f3f33fff640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f1c0b6700 0x7f3f1c0b8c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x556b91406a90 tx=0x7f3f2400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.415+0000 7f3f40851740 1 -- 172.21.15.92:0/258957271 wait complete. 2024-09-21T07:15:00.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.416+0000 7f3f40851740 1 -- start start 2024-09-21T07:15:00.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.416+0000 7f3f40851740 1 Processor -- start 2024-09-21T07:15:00.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.417+0000 7f3f40851740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b9102f980 0x556b914138f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.417+0000 7f3f40851740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b91037b60 0x556b91413e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.417+0000 7f3f40851740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 0x556b9141f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.417+0000 7f3f337fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b91037b60 0x556b91413e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.417+0000 7f3f337fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b91037b60 0x556b91413e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:33488/0 (socket says 172.21.15.92:33488) 2024-09-21T07:15:00.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.417+0000 7f3f337fe640 1 -- 172.21.15.92:0/3506085563 learned_addr learned my addr 172.21.15.92:0/3506085563 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:00.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.417+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556b911c67a0 con 0x556b91058840 2024-09-21T07:15:00.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.417+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556b9130a0a0 con 0x556b9102f980 2024-09-21T07:15:00.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.417+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556b91416590 con 0x556b91037b60 2024-09-21T07:15:00.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.417+0000 7f3f33fff640 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b9102f980 0x556b914138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.418+0000 7f3f40851740 10 client.0 _ll_register_callbacks cb 0x556b912e73c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:00.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.418+0000 7f3f3887a640 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 0x556b9141f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.418+0000 7f3f337fe640 1 -- 172.21.15.92:0/3506085563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b9102f980 msgr2=0x556b914138f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.418+0000 7f3f337fe640 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b9102f980 0x556b914138f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.418+0000 7f3f337fe640 1 -- 172.21.15.92:0/3506085563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 msgr2=0x556b9141f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.418+0000 7f3f337fe640 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 0x556b9141f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.418+0000 7f3f337fe640 1 -- 172.21.15.92:0/3506085563 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b912f8880 con 0x556b91037b60 2024-09-21T07:15:00.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.418+0000 7f3f337fe640 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b91037b60 0x556b91413e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800e840 tx=0x7f3f2800e870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b291e690472b5ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.418+0000 7f3f137fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:15:00.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.418+0000 7f3f137fe640 1 -- 172.21.15.92:0/3506085563 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2802c060 con 0x556b91037b60 2024-09-21T07:15:00.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.419+0000 7f3f137fe640 1 -- 172.21.15.92:0/3506085563 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3f28004030 con 0x556b91037b60 2024-09-21T07:15:00.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.419+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f28011750 con 0x556b91037b60 2024-09-21T07:15:00.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.419+0000 7f3f137fe640 1 -- 172.21.15.92:0/3506085563 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3f28014540 con 0x556b91037b60 2024-09-21T07:15:00.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.419+0000 7f3f40851740 10 client.25633 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:00.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.419+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556b910d2b90 con 0x556b91037b60 2024-09-21T07:15:00.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.419+0000 7f3f137fe640 1 -- 172.21.15.92:0/3506085563 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f28011750 con 0x556b91037b60 2024-09-21T07:15:00.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.419+0000 7f3f137fe640 1 -- 172.21.15.92:0/3506085563 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3f2800f040 con 0x556b91037b60 2024-09-21T07:15:00.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.419+0000 7f3f40851740 10 client.25633 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:00.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.420+0000 7f3f40851740 10 client.25633 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:15:00.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.420+0000 7f3f40851740 20 client.25633 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:00.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.420+0000 7f3f40851740 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556b910171c0 0x556b91425640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.420+0000 7f3f40851740 4 client.25633 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:00.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.420+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b91377ae0 con 0x556b910171c0 2024-09-21T07:15:00.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.420+0000 7f3f33fff640 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556b910171c0 0x556b91425640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.420+0000 7f3f137fe640 10 client.25633 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:00.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.420+0000 7f3f33fff640 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556b910171c0 0x556b91425640 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbf6de17a9064f87 server_cookie=e8aa99e50e146bfd in_seq=0 out_seq=0 2024-09-21T07:15:00.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.421+0000 7f3f137fe640 1 -- 172.21.15.92:0/3506085563 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556b91377ae0 con 0x556b910171c0 2024-09-21T07:15:00.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.421+0000 7f3f137fe640 10 client.25633 handle_command_reply: tid=0 2024-09-21T07:15:00.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.421+0000 7f3f40851740 1 client.25633 shutdown 2024-09-21T07:15:00.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b91037b60 msgr2=0x556b91413e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b91037b60 0x556b91413e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800e840 tx=0x7f3f2800e870 comp rx=0 tx=0).stop 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 shutdown_connections 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556b910171c0 0x556b91425640 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91058840 0x556b9141f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b91037b60 0x556b91413e30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f137fe640 0 client.25633 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 1 --2- 172.21.15.92:0/3506085563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b9102f980 0x556b914138f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 >> 172.21.15.92:0/3506085563 conn(0x556b9104c990 msgr2=0x556b9140aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 shutdown_connections 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 1 -- 172.21.15.92:0/3506085563 wait complete. 2024-09-21T07:15:00.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.422+0000 7f3f40851740 20 client.25633 trim_cache size 0 max 16384 2024-09-21T07:15:00.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.451+0000 7f3f40851740 1 Processor -- start 2024-09-21T07:15:00.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.451+0000 7f3f40851740 1 -- start start 2024-09-21T07:15:00.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.451+0000 7f3f40851740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b910171c0 0x556b91415320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.451+0000 7f3f40851740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b9102f980 0x556b9141f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.451+0000 7f3f40851740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91037b60 0x556b9141fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.451+0000 7f3f40851740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3f341aed10 con 0x556b91037b60 2024-09-21T07:15:00.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.451+0000 7f3f40851740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3f341b0850 con 0x556b910171c0 2024-09-21T07:15:00.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.451+0000 7f3f40851740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f341af3e0 con 0x556b9102f980 2024-09-21T07:15:00.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f3887a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91037b60 0x556b9141fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f3887a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91037b60 0x556b9141fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38862/0 (socket says 172.21.15.92:38862) 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f3887a640 1 -- 172.21.15.92:0/1438299463 learned_addr learned my addr 172.21.15.92:0/1438299463 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f33fff640 1 --2- 172.21.15.92:0/1438299463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b910171c0 0x556b91415320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f33fff640 1 -- 172.21.15.92:0/1438299463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b9102f980 msgr2=0x556b9141f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f33fff640 1 --2- 172.21.15.92:0/1438299463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b9102f980 0x556b9141f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f33fff640 1 -- 172.21.15.92:0/1438299463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91037b60 msgr2=0x556b9141fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f33fff640 1 --2- 172.21.15.92:0/1438299463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91037b60 0x556b9141fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f33fff640 1 -- 172.21.15.92:0/1438299463 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b9140ac70 con 0x556b910171c0 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f3887a640 1 --2- 172.21.15.92:0/1438299463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91037b60 0x556b9141fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.452+0000 7f3f33fff640 1 --2- 172.21.15.92:0/1438299463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b910171c0 0x556b91415320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f24005fd0 tx=0x7f3f24016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37df24ddd65efec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.453+0000 7f3f19ffb640 1 -- 172.21.15.92:0/1438299463 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2401eaf0 con 0x556b910171c0 2024-09-21T07:15:00.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.453+0000 7f3f19ffb640 1 -- 172.21.15.92:0/1438299463 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f2401ec90 con 0x556b910171c0 2024-09-21T07:15:00.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.453+0000 7f3f19ffb640 1 -- 172.21.15.92:0/1438299463 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24003ca0 con 0x556b910171c0 2024-09-21T07:15:00.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.454+0000 7f3f40851740 1 -- 172.21.15.92:0/1438299463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b910171c0 msgr2=0x556b91415320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.454+0000 7f3f40851740 1 --2- 172.21.15.92:0/1438299463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b910171c0 0x556b91415320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f24005fd0 tx=0x7f3f24016000 comp rx=0 tx=0).stop 2024-09-21T07:15:00.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.455+0000 7f3f40851740 1 -- 172.21.15.92:0/1438299463 shutdown_connections 2024-09-21T07:15:00.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.455+0000 7f3f40851740 1 --2- 172.21.15.92:0/1438299463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b91037b60 0x556b9141fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.455+0000 7f3f40851740 1 --2- 172.21.15.92:0/1438299463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b9102f980 0x556b9141f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.455+0000 7f3f40851740 1 --2- 172.21.15.92:0/1438299463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b910171c0 0x556b91415320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.455+0000 7f3f40851740 1 -- 172.21.15.92:0/1438299463 >> 172.21.15.92:0/1438299463 conn(0x556b9104c990 msgr2=0x556b91414c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.455+0000 7f3f40851740 1 -- 172.21.15.92:0/1438299463 shutdown_connections 2024-09-21T07:15:00.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.455+0000 7f3f40851740 1 -- 172.21.15.92:0/1438299463 wait complete. 2024-09-21T07:15:00.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.455+0000 7f3f40851740 1 -- start start 2024-09-21T07:15:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.456+0000 7f3f40851740 1 Processor -- start 2024-09-21T07:15:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.456+0000 7f3f40851740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b910171c0 0x556b9141c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.456+0000 7f3f40851740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b9102f980 0x556b914167a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.456+0000 7f3f40851740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 0x556b91416e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.457+0000 7f3f40851740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3f341b0180 con 0x556b9102f980 2024-09-21T07:15:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.457+0000 7f3f40851740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3f341afab0 con 0x556b91037b60 2024-09-21T07:15:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.457+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b910171c0 0x556b9141c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.457+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b910171c0 0x556b9141c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:33502/0 (socket says 172.21.15.92:33502) 2024-09-21T07:15:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.457+0000 7f3f33fff640 1 -- 172.21.15.92:0/1233909241 learned_addr learned my addr 172.21.15.92:0/1233909241 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.457+0000 7f3f3887a640 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 0x556b91416e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.457+0000 7f3f40851740 1 -- 172.21.15.92:0/1233909241 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f341acd10 con 0x556b910171c0 2024-09-21T07:15:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.457+0000 7f3f337fe640 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b9102f980 0x556b914167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.457+0000 7f3f40851740 10 client.0 _ll_register_callbacks cb 0x7f3f2800ee60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f3887a640 1 -- 172.21.15.92:0/1233909241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b910171c0 msgr2=0x556b9141c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f3887a640 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b910171c0 0x556b9141c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f3887a640 1 -- 172.21.15.92:0/1233909241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b9102f980 msgr2=0x556b914167a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f3887a640 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b9102f980 0x556b914167a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f3887a640 1 -- 172.21.15.92:0/1233909241 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b914175d0 con 0x556b91037b60 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f33fff640 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b910171c0 0x556b9141c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f337fe640 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b9102f980 0x556b914167a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f3887a640 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 0x556b91416e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c030670 tx=0x7f3f2c0ce690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=412228b64eb63004 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f137fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f137fe640 1 -- 172.21.15.92:0/1233909241 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0ce310 con 0x556b91037b60 2024-09-21T07:15:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.458+0000 7f3f137fe640 1 -- 172.21.15.92:0/1233909241 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3f2c0d7d90 con 0x556b91037b60 2024-09-21T07:15:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.459+0000 7f3f40851740 1 -- 172.21.15.92:0/1233909241 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f2401ec90 con 0x556b91037b60 2024-09-21T07:15:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.459+0000 7f3f137fe640 1 -- 172.21.15.92:0/1233909241 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3f2c0cef00 con 0x556b91037b60 2024-09-21T07:15:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.459+0000 7f3f40851740 10 client.25520 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.459+0000 7f3f40851740 1 -- 172.21.15.92:0/1233909241 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556b91490f50 con 0x556b91037b60 2024-09-21T07:15:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.459+0000 7f3f137fe640 1 -- 172.21.15.92:0/1233909241 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f2c0e9e50 con 0x556b91037b60 2024-09-21T07:15:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.459+0000 7f3f137fe640 1 -- 172.21.15.92:0/1233909241 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3f2c0f0310 con 0x556b91037b60 2024-09-21T07:15:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.459+0000 7f3f40851740 10 client.25520 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.459+0000 7f3f40851740 10 client.25520 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:15:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.459+0000 7f3f40851740 20 client.25520 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:00.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.459+0000 7f3f40851740 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556b91058840 0x556b91493730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.460+0000 7f3f40851740 4 client.25520 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T07:15:00.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.460+0000 7f3f40851740 1 -- 172.21.15.92:0/1233909241 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x7f3f2401ec90 con 0x556b91058840 2024-09-21T07:15:00.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.460+0000 7f3f33fff640 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556b91058840 0x556b91493730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.461+0000 7f3f33fff640 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556b91058840 0x556b91493730 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3930823c5aab58f3 server_cookie=be7557499998e9f2 in_seq=0 out_seq=0 2024-09-21T07:15:00.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.461+0000 7f3f137fe640 10 client.25520 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f137fe640 1 -- 172.21.15.92:0/1233909241 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f3f2401ec90 con 0x556b91058840 2024-09-21T07:15:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f137fe640 10 client.25520 handle_command_reply: tid=0 2024-09-21T07:15:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 client.25520 shutdown 2024-09-21T07:15:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 -- 172.21.15.92:0/1233909241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 msgr2=0x556b91416e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 0x556b91416e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c030670 tx=0x7f3f2c0ce690 comp rx=0 tx=0).stop 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 -- 172.21.15.92:0/1233909241 shutdown_connections 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556b91058840 0x556b91493730 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556b91037b60 0x556b91416e40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f137fe640 0 client.25520 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556b9102f980 0x556b914167a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 --2- 172.21.15.92:0/1233909241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556b910171c0 0x556b9141c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 -- 172.21.15.92:0/1233909241 >> 172.21.15.92:0/1233909241 conn(0x556b9104c990 msgr2=0x556b91405ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 -- 172.21.15.92:0/1233909241 shutdown_connections 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.474+0000 7f3f40851740 1 -- 172.21.15.92:0/1233909241 wait complete. 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f40851740 20 client.25520 trim_cache size 0 max 16384 2024-09-21T07:15:00.477 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24649, 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 6, 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "8460e8a9": { 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 6, 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 137.0, 2024-09-21T07:15:00.478 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:00.479 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:15:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/42068473 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f1c0b6700 msgr2=0x7f3f1c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f1c0b6700 0x7f3f1c0b8c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x556b91406a90 tx=0x7f3f2400b390 comp rx=0 tx=0).stop 2024-09-21T07:15:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/42068473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f34109e30 msgr2=0x7f3f34076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f34109e30 0x7f3f34076190 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c005cc0 tx=0x7f3f2c032a10 comp rx=0 tx=0).stop 2024-09-21T07:15:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/42068473 shutdown_connections 2024-09-21T07:15:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f1c0b6700 0x7f3f1c0b8c10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f34109e30 0x7f3f34076190 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f341094e0 0x7f3f34075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 --2- 172.21.15.92:0/42068473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f34103ba0 0x7f3f34075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/42068473 >> 172.21.15.92:0/42068473 conn(0x7f3f340ff5f0 msgr2=0x7f3f34101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.475+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/42068473 shutdown_connections 2024-09-21T07:15:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:00.476+0000 7f3f3a2dd640 1 -- 172.21.15.92:0/42068473 wait complete. 2024-09-21T07:15:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.526+0000 7f9ea5aec640 1 -- 172.21.15.92:0/2214914993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea0108c30 msgr2=0x7f9ea010f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.526+0000 7f9ea5aec640 1 --2- 172.21.15.92:0/2214914993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea0108c30 0x7f9ea010f460 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009ca0 tx=0x7f9e9802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.527+0000 7f9ea5aec640 1 -- 172.21.15.92:0/2214914993 shutdown_connections 2024-09-21T07:15:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.527+0000 7f9ea5aec640 1 --2- 172.21.15.92:0/2214914993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea0108c30 0x7f9ea010f460 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.527+0000 7f9ea5aec640 1 --2- 172.21.15.92:0/2214914993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ea01082e0 0x7f9ea01086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.527+0000 7f9ea5aec640 1 --2- 172.21.15.92:0/2214914993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea01029b0 0x7f9ea0102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.527+0000 7f9ea5aec640 1 -- 172.21.15.92:0/2214914993 >> 172.21.15.92:0/2214914993 conn(0x7f9ea007a740 msgr2=0x7f9ea007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.527+0000 7f9ea5aec640 1 -- 172.21.15.92:0/2214914993 shutdown_connections 2024-09-21T07:15:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.527+0000 7f9ea5aec640 1 -- 172.21.15.92:0/2214914993 wait complete. 2024-09-21T07:15:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.527+0000 7f9ea5aec640 1 Processor -- start 2024-09-21T07:15:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.527+0000 7f9ea5aec640 1 -- start start 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9ea5aec640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ea01029b0 0x7f9ea006b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9ea5aec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea01082e0 0x7f9ea0198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9ea5aec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea0108c30 0x7f9ea0199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9ea5aec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea01127f0 con 0x7f9ea0108c30 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9ea5aec640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea0112670 con 0x7f9ea01029b0 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9ea5aec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea0112970 con 0x7f9ea01082e0 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9e9f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ea01029b0 0x7f9ea006b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9e9f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ea01029b0 0x7f9ea006b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:34056/0 (socket says 172.21.15.92:34056) 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9e9f7fe640 1 -- 172.21.15.92:0/3550990483 learned_addr learned my addr 172.21.15.92:0/3550990483 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9e9effd640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea01082e0 0x7f9ea0198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9e9ffff640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea0108c30 0x7f9ea0199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9e9effd640 1 -- 172.21.15.92:0/3550990483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ea01029b0 msgr2=0x7f9ea006b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.528+0000 7f9e9effd640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ea01029b0 0x7f9ea006b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.529+0000 7f9e9effd640 1 -- 172.21.15.92:0/3550990483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea0108c30 msgr2=0x7f9ea0199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.529+0000 7f9e9effd640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea0108c30 0x7f9ea0199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.529+0000 7f9e9effd640 1 -- 172.21.15.92:0/3550990483 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea0199970 con 0x7f9ea01082e0 2024-09-21T07:15:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.529+0000 7f9e9effd640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea01082e0 0x7f9ea0198ce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ea006c9c0 tx=0x7f9e9400db30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.529+0000 7f9e9cff9640 1 -- 172.21.15.92:0/3550990483 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94017070 con 0x7f9ea01082e0 2024-09-21T07:15:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.529+0000 7f9e9cff9640 1 -- 172.21.15.92:0/3550990483 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e94009820 con 0x7f9ea01082e0 2024-09-21T07:15:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.529+0000 7f9ea5aec640 1 -- 172.21.15.92:0/3550990483 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea019dd30 con 0x7f9ea01082e0 2024-09-21T07:15:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.529+0000 7f9e9cff9640 1 -- 172.21.15.92:0/3550990483 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94004b20 con 0x7f9ea01082e0 2024-09-21T07:15:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.529+0000 7f9ea5aec640 1 -- 172.21.15.92:0/3550990483 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea019e2d0 con 0x7f9ea01082e0 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.531+0000 7f9eaca5a740 1 Processor -- start 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9eaca5a740 1 -- start start 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9cff9640 1 -- 172.21.15.92:0/3550990483 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f9e94004cc0 con 0x7f9ea01082e0 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff4b1b0 0x5604f02f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 0x5604f02f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff2a4d0 0x5604f02f1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5604f02656f0 con 0x5604eff2a4d0 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604f0254b20 con 0x5604eff4b1b0 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5604f0258930 con 0x5604eff222f0 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff2a4d0 0x5604f02f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 0x5604f02f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 0x5604f02f0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:33526/0 (socket says 172.21.15.92:33526) 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9f7fe640 1 -- 172.21.15.92:0/1452407594 learned_addr learned my addr 172.21.15.92:0/1452407594 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9ffff640 1 --2- 172.21.15.92:0/1452407594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff4b1b0 0x5604f02f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9effd640 1 -- 172.21.15.92:0/1452407594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 msgr2=0x5604f02f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9effd640 1 --2- 172.21.15.92:0/1452407594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 0x5604f02f0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9effd640 1 -- 172.21.15.92:0/1452407594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff4b1b0 msgr2=0x5604f02f09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9effd640 1 --2- 172.21.15.92:0/1452407594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff4b1b0 0x5604f02f09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9effd640 1 -- 172.21.15.92:0/1452407594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f021a530 con 0x5604eff2a4d0 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9cff9640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e880b6730 0x7f9e880b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9ffff640 1 --2- 172.21.15.92:0/1452407594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff4b1b0 0x5604f02f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.532+0000 7f9e9f7fe640 1 --2- 172.21.15.92:0/1452407594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 0x5604f02f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.533+0000 7f9e9f7fe640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e880b6730 0x7f9e880b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.533+0000 7f9e9cff9640 1 -- 172.21.15.92:0/3550990483 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9e940e7240 con 0x7f9ea01082e0 2024-09-21T07:15:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.533+0000 7f9e9effd640 1 --2- 172.21.15.92:0/1452407594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff2a4d0 0x5604f02f1430 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9e940e45f0 tx=0x7f9e940ef930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1927915285a78e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.533+0000 7f9e85ffb640 1 -- 172.21.15.92:0/1452407594 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94020070 con 0x5604eff2a4d0 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.533+0000 7f9e85ffb640 1 -- 172.21.15.92:0/1452407594 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e940ac8b0 con 0x5604eff2a4d0 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.533+0000 7f9e85ffb640 1 -- 172.21.15.92:0/1452407594 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e940a8c40 con 0x5604eff2a4d0 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9eaca5a740 1 -- 172.21.15.92:0/1452407594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff2a4d0 msgr2=0x5604f02f1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/1452407594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff2a4d0 0x5604f02f1430 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9e940e45f0 tx=0x7f9e940ef930 comp rx=0 tx=0).stop 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9e9f7fe640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e880b6730 0x7f9e880b8c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5604f02ef630 tx=0x7f9e9000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9eaca5a740 1 -- 172.21.15.92:0/1452407594 shutdown_connections 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/1452407594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff2a4d0 0x5604f02f1430 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/1452407594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 0x5604f02f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/1452407594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff4b1b0 0x5604f02f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9eaca5a740 1 -- 172.21.15.92:0/1452407594 >> 172.21.15.92:0/1452407594 conn(0x5604eff3f300 msgr2=0x5604f02ee8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9eaca5a740 1 -- 172.21.15.92:0/1452407594 shutdown_connections 2024-09-21T07:15:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9eaca5a740 1 -- 172.21.15.92:0/1452407594 wait complete. 2024-09-21T07:15:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.534+0000 7f9eaca5a740 1 -- start start 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9eaca5a740 1 Processor -- start 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 0x5604f02fc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 0x5604f02fc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f0308420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5604f018cab0 con 0x5604eff4b1b0 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604f01fa730 con 0x5604eff2a4d0 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5604f02ff130 con 0x5604eff222f0 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9eaca5a740 10 client.0 _ll_register_callbacks cb 0x5604f024e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f0308420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f0308420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38916/0 (socket says 172.21.15.92:38916) 2024-09-21T07:15:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9ffff640 1 -- 172.21.15.92:0/3149992986 learned_addr learned my addr 172.21.15.92:0/3149992986 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9effd640 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 0x5604f02fc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9f7fe640 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 0x5604f02fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9ffff640 1 -- 172.21.15.92:0/3149992986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 msgr2=0x5604f02fc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9ffff640 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 0x5604f02fc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9ffff640 1 -- 172.21.15.92:0/3149992986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 msgr2=0x5604f02fc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9ffff640 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 0x5604f02fc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9ffff640 1 -- 172.21.15.92:0/3149992986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604effb6790 con 0x5604eff4b1b0 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9effd640 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 0x5604f02fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e9ffff640 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f0308420 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9e98035000 tx=0x7f9e980094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d60637a50c5d74a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.535+0000 7f9e7effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9e7effd640 1 -- 172.21.15.92:0/3149992986 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98003970 con 0x5604eff4b1b0 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3149992986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e940ac8b0 con 0x5604eff4b1b0 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9e7effd640 1 -- 172.21.15.92:0/3149992986 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9e98003b10 con 0x5604eff4b1b0 2024-09-21T07:15:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9e7effd640 1 -- 172.21.15.92:0/3149992986 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9e98003d10 con 0x5604eff4b1b0 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9eaca5a740 10 client.16212 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3149992986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5604f002f620 con 0x5604eff4b1b0 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9e7effd640 1 -- 172.21.15.92:0/3149992986 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e940ac8b0 con 0x5604eff4b1b0 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9e7effd640 1 -- 172.21.15.92:0/3149992986 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9e98004560 con 0x5604eff4b1b0 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9eaca5a740 10 client.16212 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9eaca5a740 10 client.16212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9eaca5a740 20 client.16212 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5604eff09d80 0x5604f030e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9eaca5a740 4 client.16212 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3149992986 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604f0267640 con 0x5604eff09d80 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.536+0000 7f9e9f7fe640 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5604eff09d80 0x5604f030e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.537+0000 7f9e7effd640 10 client.16212 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.537+0000 7f9e9f7fe640 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5604eff09d80 0x5604f030e640 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd0ca843bfc690d4 server_cookie=40cab78af6863697 in_seq=0 out_seq=0 2024-09-21T07:15:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.537+0000 7f9e7effd640 1 -- 172.21.15.92:0/3149992986 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604f0267640 con 0x5604eff09d80 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.537+0000 7f9e7effd640 10 client.16212 handle_command_reply: tid=0 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.537+0000 7f9eaca5a740 1 client.16212 shutdown 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3149992986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 msgr2=0x5604f0308420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f0308420 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9e98035000 tx=0x7f9e980094a0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3149992986 shutdown_connections 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5604eff09d80 0x5604f030e640 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f0308420 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 0x5604f02fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3149992986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff222f0 0x5604f02fc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3149992986 >> 172.21.15.92:0/3149992986 conn(0x5604eff3f300 msgr2=0x5604f02f19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9e7effd640 0 client.16212 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3149992986 shutdown_connections 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3149992986 wait complete. 2024-09-21T07:15:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.538+0000 7f9eaca5a740 20 client.16212 trim_cache size 0 max 16384 2024-09-21T07:15:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.552+0000 7f9eaca5a740 1 Processor -- start 2024-09-21T07:15:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.552+0000 7f9eaca5a740 1 -- start start 2024-09-21T07:15:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.552+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff222f0 0x5604f02f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.552+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff2a4d0 0x5604f0308320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.552+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f02fc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.552+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea01b7330 con 0x5604eff4b1b0 2024-09-21T07:15:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.552+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea01b8e70 con 0x5604eff222f0 2024-09-21T07:15:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.552+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea01b7a00 con 0x5604eff2a4d0 2024-09-21T07:15:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f02fc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f02fc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38932/0 (socket says 172.21.15.92:38932) 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9ffff640 1 -- 172.21.15.92:0/2769307244 learned_addr learned my addr 172.21.15.92:0/2769307244 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9f7fe640 1 --2- 172.21.15.92:0/2769307244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff222f0 0x5604f02f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9effd640 1 --2- 172.21.15.92:0/2769307244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff2a4d0 0x5604f0308320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9ffff640 1 -- 172.21.15.92:0/2769307244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff2a4d0 msgr2=0x5604f0308320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9ffff640 1 --2- 172.21.15.92:0/2769307244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff2a4d0 0x5604f0308320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9ffff640 1 -- 172.21.15.92:0/2769307244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff222f0 msgr2=0x5604f02f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9ffff640 1 --2- 172.21.15.92:0/2769307244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff222f0 0x5604f02f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9ffff640 1 -- 172.21.15.92:0/2769307244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f02e9d50 con 0x5604eff4b1b0 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e9ffff640 1 --2- 172.21.15.92:0/2769307244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f02fc550 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9e9802a900 tx=0x7f9e98005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e46e9660a16467 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e857fa640 1 -- 172.21.15.92:0/2769307244 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98059070 con 0x5604eff4b1b0 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e857fa640 1 -- 172.21.15.92:0/2769307244 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e98036050 con 0x5604eff4b1b0 2024-09-21T07:15:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.553+0000 7f9e857fa640 1 -- 172.21.15.92:0/2769307244 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98030bd0 con 0x5604eff4b1b0 2024-09-21T07:15:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.554+0000 7f9eaca5a740 1 -- 172.21.15.92:0/2769307244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 msgr2=0x5604f02fc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.554+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/2769307244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f02fc550 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9e9802a900 tx=0x7f9e98005bd0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.554+0000 7f9eaca5a740 1 -- 172.21.15.92:0/2769307244 shutdown_connections 2024-09-21T07:15:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.554+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/2769307244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff4b1b0 0x5604f02fc550 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.554+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/2769307244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff2a4d0 0x5604f0308320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.554+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/2769307244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff222f0 0x5604f02f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.554+0000 7f9eaca5a740 1 -- 172.21.15.92:0/2769307244 >> 172.21.15.92:0/2769307244 conn(0x5604eff3f300 msgr2=0x5604f02f19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.554+0000 7f9eaca5a740 1 -- 172.21.15.92:0/2769307244 shutdown_connections 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.554+0000 7f9eaca5a740 1 -- 172.21.15.92:0/2769307244 wait complete. 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.554+0000 7f9eaca5a740 1 -- start start 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.555+0000 7f9eaca5a740 1 Processor -- start 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.555+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff222f0 0x5604f02ff470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.555+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 0x5604f02ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.555+0000 7f9eaca5a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff4b1b0 0x5604f02ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.555+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea01b87a0 con 0x5604eff222f0 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.555+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea01b80d0 con 0x5604eff2a4d0 2024-09-21T07:15:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.555+0000 7f9eaca5a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea01b5310 con 0x5604eff4b1b0 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.555+0000 7f9eaca5a740 10 client.0 _ll_register_callbacks cb 0x7f9e98009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.555+0000 7f9e9f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff222f0 0x5604f02ff470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e9f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff222f0 0x5604f02ff470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38944/0 (socket says 172.21.15.92:38944) 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e9f7fe640 1 -- 172.21.15.92:0/3725421600 learned_addr learned my addr 172.21.15.92:0/3725421600 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e9ffff640 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff4b1b0 0x5604f02ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e9effd640 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 0x5604f02ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e9f7fe640 1 -- 172.21.15.92:0/3725421600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff4b1b0 msgr2=0x5604f02ffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e9f7fe640 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff4b1b0 0x5604f02ffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e9f7fe640 1 -- 172.21.15.92:0/3725421600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 msgr2=0x5604f02ff9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e9f7fe640 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 0x5604f02ff9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e9f7fe640 1 -- 172.21.15.92:0/3725421600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604f0377140 con 0x5604eff222f0 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e9f7fe640 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff222f0 0x5604f02ff470 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x5604f02ef550 tx=0x7f9e900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8cd0212b354cb2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e7effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e7effd640 1 -- 172.21.15.92:0/3725421600 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90035060 con 0x5604eff222f0 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e7effd640 1 -- 172.21.15.92:0/3725421600 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9e9001e5a0 con 0x5604eff222f0 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3725421600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e98036050 con 0x5604eff222f0 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9e7effd640 1 -- 172.21.15.92:0/3725421600 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9e9003c050 con 0x5604eff222f0 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9eaca5a740 10 client.16218 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.556+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3725421600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5604f0378460 con 0x5604eff222f0 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.557+0000 7f9e7effd640 1 -- 172.21.15.92:0/3725421600 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e98036050 con 0x5604eff222f0 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.557+0000 7f9e7effd640 1 -- 172.21.15.92:0/3725421600 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9e90030910 con 0x5604eff222f0 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.557+0000 7f9eaca5a740 10 client.16218 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.557+0000 7f9eaca5a740 10 client.16218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.557+0000 7f9eaca5a740 20 client.16218 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.557+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5604efedf1c0 0x5604f037ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.557+0000 7f9eaca5a740 4 client.16218 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.557+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3725421600 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604f02630f0 con 0x5604efedf1c0 2024-09-21T07:15:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.557+0000 7f9e9effd640 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5604efedf1c0 0x5604f037ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:00.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.557+0000 7f9e7effd640 10 client.16218 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:00.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.558+0000 7f9e9effd640 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5604efedf1c0 0x5604f037ac30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0617f6860640fd2 server_cookie=f58c7f0b5fa369d5 in_seq=0 out_seq=0 2024-09-21T07:15:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9e7effd640 1 -- 172.21.15.92:0/3725421600 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604f02630f0 con 0x5604efedf1c0 2024-09-21T07:15:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9e7effd640 10 client.16218 handle_command_reply: tid=0 2024-09-21T07:15:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 client.16218 shutdown 2024-09-21T07:15:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3725421600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff222f0 msgr2=0x5604f02ff470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff222f0 0x5604f02ff470 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x5604f02ef550 tx=0x7f9e900046c0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3725421600 shutdown_connections 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5604efedf1c0 0x5604f037ac30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604eff4b1b0 0x5604f02ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604eff2a4d0 0x5604f02ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 --2- 172.21.15.92:0/3725421600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604eff222f0 0x5604f02ff470 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9e7effd640 0 client.16218 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3725421600 >> 172.21.15.92:0/3725421600 conn(0x5604eff3f300 msgr2=0x5604f02ee880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3725421600 shutdown_connections 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.567+0000 7f9eaca5a740 1 -- 172.21.15.92:0/3725421600 wait complete. 2024-09-21T07:15:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9eaca5a740 20 client.16218 trim_cache size 0 max 16384 2024-09-21T07:15:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:15:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:15:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:15:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 -- 172.21.15.92:0/3550990483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e880b6730 msgr2=0x7f9e880b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e880b6730 0x7f9e880b8c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5604f02ef630 tx=0x7f9e9000b410 comp rx=0 tx=0).stop 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 -- 172.21.15.92:0/3550990483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea01082e0 msgr2=0x7f9ea0198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea01082e0 0x7f9ea0198ce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ea006c9c0 tx=0x7f9e9400db30 comp rx=0 tx=0).stop 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 -- 172.21.15.92:0/3550990483 shutdown_connections 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9e880b6730 0x7f9e880b8c40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea0108c30 0x7f9ea0199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea01082e0 0x7f9ea0198ce0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 --2- 172.21.15.92:0/3550990483 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ea01029b0 0x7f9ea006b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 -- 172.21.15.92:0/3550990483 >> 172.21.15.92:0/3550990483 conn(0x7f9ea007a740 msgr2=0x7f9ea0104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 -- 172.21.15.92:0/3550990483 shutdown_connections 2024-09-21T07:15:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:00.568+0000 7f9ea5aec640 1 -- 172.21.15.92:0/3550990483 wait complete. 2024-09-21T07:15:00.754 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:01.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:00 smithi175 ceph-mon[34064]: pgmap v397: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 77 MiB/s wr, 36 op/s 2024-09-21T07:15:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:00 smithi092 ceph-mon[30987]: pgmap v397: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 77 MiB/s wr, 36 op/s 2024-09-21T07:15:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:00 smithi169 ceph-mon[33705]: pgmap v397: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 77 MiB/s wr, 36 op/s 2024-09-21T07:15:01.204 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8460e8a9', quiesce took 10.0 seconds. Will release after: 7.0 2024-09-21T07:15:01.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.675+0000 7fac08f45640 1 -- 172.21.15.92:0/3439143784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac04102a90 msgr2=0x7fac04102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.675+0000 7fac08f45640 1 --2- 172.21.15.92:0/3439143784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac04102a90 0x7fac04102ea0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009900 tx=0x7fabf402a410 comp rx=0 tx=0).stop 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.675+0000 7fac08f45640 1 -- 172.21.15.92:0/3439143784 shutdown_connections 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.675+0000 7fac08f45640 1 --2- 172.21.15.92:0/3439143784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04108d20 0x7fac0410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.675+0000 7fac08f45640 1 --2- 172.21.15.92:0/3439143784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041083d0 0x7fac041087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.675+0000 7fac08f45640 1 --2- 172.21.15.92:0/3439143784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac04102a90 0x7fac04102ea0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.675+0000 7fac08f45640 1 -- 172.21.15.92:0/3439143784 >> 172.21.15.92:0/3439143784 conn(0x7fac04079750 msgr2=0x7fac04079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.675+0000 7fac08f45640 1 -- 172.21.15.92:0/3439143784 shutdown_connections 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.676+0000 7fac08f45640 1 -- 172.21.15.92:0/3439143784 wait complete. 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.676+0000 7fac08f45640 1 Processor -- start 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.676+0000 7fac08f45640 1 -- start start 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac08f45640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04102a90 0x7fac0419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac08f45640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041083d0 0x7fac0419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac08f45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac04108d20 0x7fac0419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac08f45640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fac04112890 con 0x7fac04108d20 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac08f45640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac04112710 con 0x7fac041083d0 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac08f45640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac04112a10 con 0x7fac04102a90 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac02d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac04108d20 0x7fac0419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac0259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04102a90 0x7fac0419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac02d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac04108d20 0x7fac0419fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38954/0 (socket says 172.21.15.92:38954) 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac02d9d640 1 -- 172.21.15.92:0/1492777109 learned_addr learned my addr 172.21.15.92:0/1492777109 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac0259c640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04102a90 0x7fac0419a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:33564/0 (socket says 172.21.15.92:33564) 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fabfbfff640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041083d0 0x7fac0419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac02d9d640 1 -- 172.21.15.92:0/1492777109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04102a90 msgr2=0x7fac0419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac02d9d640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04102a90 0x7fac0419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac02d9d640 1 -- 172.21.15.92:0/1492777109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041083d0 msgr2=0x7fac0419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac02d9d640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041083d0 0x7fac0419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac02d9d640 1 -- 172.21.15.92:0/1492777109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac041a0360 con 0x7fac04108d20 2024-09-21T07:15:01.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.677+0000 7fac02d9d640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac04108d20 0x7fac0419fc30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00eaa0 tx=0x7fabfc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:01.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.678+0000 7fabfb7fe640 1 -- 172.21.15.92:0/1492777109 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00cdb0 con 0x7fac04108d20 2024-09-21T07:15:01.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.678+0000 7fabfb7fe640 1 -- 172.21.15.92:0/1492777109 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabfc005020 con 0x7fac04108d20 2024-09-21T07:15:01.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.678+0000 7fac08f45640 1 -- 172.21.15.92:0/1492777109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac041a0650 con 0x7fac04108d20 2024-09-21T07:15:01.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.678+0000 7fabfb7fe640 1 -- 172.21.15.92:0/1492777109 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0116d0 con 0x7fac04108d20 2024-09-21T07:15:01.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.678+0000 7fac08f45640 1 -- 172.21.15.92:0/1492777109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac041a6db0 con 0x7fac04108d20 2024-09-21T07:15:01.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.681+0000 7fac0f4b9740 1 Processor -- start 2024-09-21T07:15:01.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.681+0000 7fabfb7fe640 1 -- 172.21.15.92:0/1492777109 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fabfc011870 con 0x7fac04108d20 2024-09-21T07:15:01.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.681+0000 7fac0f4b9740 1 -- start start 2024-09-21T07:15:01.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9ed66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ed6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ed7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b7a9e4cea0 con 0x55b7a9b2f070 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b7a9e3c2d0 con 0x55b7a9b0e390 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b7a9e400e0 con 0x55b7a9b061b0 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9ed66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9ed66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38964/0 (socket says 172.21.15.92:38964) 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfbfff640 1 -- 172.21.15.92:0/840996843 learned_addr learned my addr 172.21.15.92:0/840996843 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fac0259c640 1 --2- 172.21.15.92:0/840996843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ed6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfbfff640 1 --2- 172.21.15.92:0/840996843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ed7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfbfff640 1 -- 172.21.15.92:0/840996843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 msgr2=0x55b7a9ed6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfbfff640 1 --2- 172.21.15.92:0/840996843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ed6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfbfff640 1 -- 172.21.15.92:0/840996843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 msgr2=0x55b7a9ed7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfbfff640 1 --2- 172.21.15.92:0/840996843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ed7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfb7fe640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fabf00b6680 0x7fabf00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfbfff640 1 -- 172.21.15.92:0/840996843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a9b9a650 con 0x55b7a9b2f070 2024-09-21T07:15:01.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fac0259c640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fabf00b6680 0x7fabf00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.682+0000 7fabfbfff640 1 --2- 172.21.15.92:0/840996843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9ed66a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fabec0058a0 tx=0x7fabec00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8176c61d376bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:01.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.683+0000 7fabfb7fe640 1 -- 172.21.15.92:0/1492777109 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fabfc0e7b60 con 0x7fac04108d20 2024-09-21T07:15:01.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.683+0000 7fabf8ff9640 1 -- 172.21.15.92:0/840996843 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec004030 con 0x55b7a9b2f070 2024-09-21T07:15:01.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.683+0000 7fabf8ff9640 1 -- 172.21.15.92:0/840996843 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabec005020 con 0x55b7a9b2f070 2024-09-21T07:15:01.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.683+0000 7fabf8ff9640 1 -- 172.21.15.92:0/840996843 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec004a00 con 0x55b7a9b2f070 2024-09-21T07:15:01.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 -- 172.21.15.92:0/840996843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 msgr2=0x55b7a9ed66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0259c640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fabf00b6680 0x7fabf00b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fabf4006010 tx=0x7fabf4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/840996843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9ed66a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fabec0058a0 tx=0x7fabec00b820 comp rx=0 tx=0).stop 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 -- 172.21.15.92:0/840996843 shutdown_connections 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/840996843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ed7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/840996843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ed6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/840996843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9ed66a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 -- 172.21.15.92:0/840996843 >> 172.21.15.92:0/840996843 conn(0x55b7a9b23460 msgr2=0x55b7a9ed4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 -- 172.21.15.92:0/840996843 shutdown_connections 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 -- 172.21.15.92:0/840996843 wait complete. 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 -- start start 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.684+0000 7fac0f4b9740 1 Processor -- start 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b061b0 0x55b7a9ee1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b2f070 0x55b7a9eee170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b7a9c9d700 con 0x55b7a9b061b0 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b7a9dd7160 con 0x55b7a9b2f070 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b7a9ee4e80 con 0x55b7a9b0e390 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0f4b9740 10 client.0 _ll_register_callbacks cb 0x55b7a9df09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b061b0 0x55b7a9ee1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b061b0 0x55b7a9ee1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38974/0 (socket says 172.21.15.92:38974) 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0259c640 1 -- 172.21.15.92:0/2118253917 learned_addr learned my addr 172.21.15.92:0/2118253917 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fabfbfff640 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac02d9d640 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b2f070 0x55b7a9eee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0259c640 1 -- 172.21.15.92:0/2118253917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b0e390 msgr2=0x55b7a9ee2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0259c640 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0259c640 1 -- 172.21.15.92:0/2118253917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b2f070 msgr2=0x55b7a9eee170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0259c640 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b2f070 0x55b7a9eee170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0259c640 1 -- 172.21.15.92:0/2118253917 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7a9e04c90 con 0x55b7a9b061b0 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fac0259c640 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b061b0 0x55b7a9ee1d00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009900 tx=0x7fabf402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e359463666c925f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.685+0000 7fabe9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fabe9ffb640 1 -- 172.21.15.92:0/2118253917 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf404e070 con 0x55b7a9b061b0 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fabe9ffb640 1 -- 172.21.15.92:0/2118253917 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fabf404a450 con 0x55b7a9b061b0 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fac0f4b9740 1 -- 172.21.15.92:0/2118253917 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabec005020 con 0x55b7a9b061b0 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fabe9ffb640 1 -- 172.21.15.92:0/2118253917 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fabf405a050 con 0x55b7a9b061b0 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fac0f4b9740 10 client.16230 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fac0f4b9740 1 -- 172.21.15.92:0/2118253917 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7a9ef0b30 con 0x55b7a9b061b0 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fabe9ffb640 1 -- 172.21.15.92:0/2118253917 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabec005020 con 0x55b7a9b061b0 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fabe9ffb640 1 -- 172.21.15.92:0/2118253917 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fabf403d730 con 0x55b7a9b061b0 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fac0f4b9740 10 client.16230 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fac0f4b9740 10 client.16230 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:15:01.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fac0f4b9740 20 client.16230 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:01.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.686+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55b7a9aed9f0 0x55b7a9ef4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.687+0000 7fac0f4b9740 4 client.16230 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:01.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.687+0000 7fac0f4b9740 1 -- 172.21.15.92:0/2118253917 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7a9e4edf0 con 0x55b7a9aed9f0 2024-09-21T07:15:01.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.687+0000 7fabfbfff640 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55b7a9aed9f0 0x55b7a9ef4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.687+0000 7fabe9ffb640 10 client.16230 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.687+0000 7fabfbfff640 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55b7a9aed9f0 0x55b7a9ef4050 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c2dc164273058d71 server_cookie=5b7a0205604eca85 in_seq=0 out_seq=0 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fabe9ffb640 1 -- 172.21.15.92:0/2118253917 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7a9e4edf0 con 0x55b7a9aed9f0 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fabe9ffb640 10 client.16230 handle_command_reply: tid=0 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 client.16230 shutdown 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 -- 172.21.15.92:0/2118253917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b061b0 msgr2=0x55b7a9ee1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b061b0 0x55b7a9ee1d00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009900 tx=0x7fabf402a410 comp rx=0 tx=0).stop 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 -- 172.21.15.92:0/2118253917 shutdown_connections 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55b7a9aed9f0 0x55b7a9ef4050 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b2f070 0x55b7a9eee170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fabe9ffb640 0 client.16230 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:15:01.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/2118253917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b061b0 0x55b7a9ee1d00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 -- 172.21.15.92:0/2118253917 >> 172.21.15.92:0/2118253917 conn(0x55b7a9b23460 msgr2=0x55b7a9ed9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:01.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 -- 172.21.15.92:0/2118253917 shutdown_connections 2024-09-21T07:15:01.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.688+0000 7fac0f4b9740 1 -- 172.21.15.92:0/2118253917 wait complete. 2024-09-21T07:15:01.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.689+0000 7fac0f4b9740 20 client.16230 trim_cache size 0 max 16384 2024-09-21T07:15:01.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac0f4b9740 1 Processor -- start 2024-09-21T07:15:01.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac0f4b9740 1 -- start start 2024-09-21T07:15:01.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ed81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9eee070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fac041b0e30 con 0x55b7a9b2f070 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac041b2970 con 0x55b7a9b0e390 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac041b1500 con 0x55b7a9b061b0 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac02d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9eee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac02d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9eee070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38982/0 (socket says 172.21.15.92:38982) 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac02d9d640 1 -- 172.21.15.92:0/287800677 learned_addr learned my addr 172.21.15.92:0/287800677 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac0259c640 1 --2- 172.21.15.92:0/287800677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ed81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fabfbfff640 1 --2- 172.21.15.92:0/287800677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac02d9d640 1 -- 172.21.15.92:0/287800677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 msgr2=0x55b7a9ed81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac02d9d640 1 --2- 172.21.15.92:0/287800677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ed81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac02d9d640 1 -- 172.21.15.92:0/287800677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 msgr2=0x55b7a9ee3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:01.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac02d9d640 1 --2- 172.21.15.92:0/287800677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac02d9d640 1 -- 172.21.15.92:0/287800677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a9ee2fc0 con 0x55b7a9b2f070 2024-09-21T07:15:01.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.702+0000 7fac02d9d640 1 --2- 172.21.15.92:0/287800677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9eee070 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0a9e80 tx=0x7fabfc0ad2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbdca306b5604fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:01.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.703+0000 7fabebfff640 1 -- 172.21.15.92:0/287800677 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc01f070 con 0x55b7a9b2f070 2024-09-21T07:15:01.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.703+0000 7fabebfff640 1 -- 172.21.15.92:0/287800677 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabfc0051d0 con 0x55b7a9b2f070 2024-09-21T07:15:01.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.703+0000 7fabebfff640 1 -- 172.21.15.92:0/287800677 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0ac920 con 0x55b7a9b2f070 2024-09-21T07:15:01.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.703+0000 7fac0f4b9740 1 -- 172.21.15.92:0/287800677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 msgr2=0x55b7a9eee070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:01.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.703+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/287800677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9eee070 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0a9e80 tx=0x7fabfc0ad2e0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.703+0000 7fac0f4b9740 1 -- 172.21.15.92:0/287800677 shutdown_connections 2024-09-21T07:15:01.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.703+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/287800677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9eee070 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.703+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/287800677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.703+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/287800677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ed81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.703+0000 7fac0f4b9740 1 -- 172.21.15.92:0/287800677 >> 172.21.15.92:0/287800677 conn(0x55b7a9b23460 msgr2=0x55b7a9ee0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:01.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 1 -- 172.21.15.92:0/287800677 shutdown_connections 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 1 -- 172.21.15.92:0/287800677 wait complete. 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 1 -- start start 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 1 Processor -- start 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ee64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9f5da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fac041b22a0 con 0x55b7a9b2f070 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac041b1bd0 con 0x55b7a9b0e390 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac041aee10 con 0x55b7a9b061b0 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac0f4b9740 10 client.0 _ll_register_callbacks cb 0x7fabf40045d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac02d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9f5da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac02d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9f5da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38998/0 (socket says 172.21.15.92:38998) 2024-09-21T07:15:01.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.704+0000 7fac02d9d640 1 -- 172.21.15.92:0/326204288 learned_addr learned my addr 172.21.15.92:0/326204288 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fabfbfff640 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fac0259c640 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ee64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fac02d9d640 1 -- 172.21.15.92:0/326204288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 msgr2=0x55b7a9ee64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fac02d9d640 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ee64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fac02d9d640 1 -- 172.21.15.92:0/326204288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 msgr2=0x55b7a9ee6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fac02d9d640 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fac02d9d640 1 -- 172.21.15.92:0/326204288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7a9f5df50 con 0x55b7a9b2f070 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fac02d9d640 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9f5da10 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0a9c90 tx=0x7fabfc0ad500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2c9b80587b1691 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fabe9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fabe9ffb640 1 -- 172.21.15.92:0/326204288 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0d4070 con 0x55b7a9b2f070 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fabe9ffb640 1 -- 172.21.15.92:0/326204288 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fabfc0acb20 con 0x55b7a9b2f070 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fac0f4b9740 1 -- 172.21.15.92:0/326204288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabfc0051d0 con 0x55b7a9b2f070 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fabe9ffb640 1 -- 172.21.15.92:0/326204288 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fabfc01f040 con 0x55b7a9b2f070 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fac0f4b9740 10 client.16236 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:01.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fac0f4b9740 1 -- 172.21.15.92:0/326204288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7a9f5f0a0 con 0x55b7a9b2f070 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.705+0000 7fabe9ffb640 1 -- 172.21.15.92:0/326204288 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabfc0051d0 con 0x55b7a9b2f070 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fabe9ffb640 1 -- 172.21.15.92:0/326204288 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fabfc00f040 con 0x55b7a9b2f070 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fac0f4b9740 10 client.16236 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fac0f4b9740 10 client.16236 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fac0f4b9740 20 client.16236 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55b7a9ac2da0 0x55b7a9f61770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fac0f4b9740 4 client.16236 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fac0f4b9740 1 -- 172.21.15.92:0/326204288 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7a9e4a8a0 con 0x55b7a9ac2da0 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fac0259c640 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55b7a9ac2da0 0x55b7a9f61770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fac0259c640 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55b7a9ac2da0 0x55b7a9f61770 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6df7431450ce9a78 server_cookie=3d943d3ba83029cf in_seq=0 out_seq=0 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fabe9ffb640 10 client.16236 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fabe9ffb640 1 -- 172.21.15.92:0/326204288 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7a9e4a8a0 con 0x55b7a9ac2da0 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.706+0000 7fabe9ffb640 10 client.16236 handle_command_reply: tid=0 2024-09-21T07:15:01.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 client.16236 shutdown 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 -- 172.21.15.92:0/326204288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 msgr2=0x55b7a9f5da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9f5da10 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0a9c90 tx=0x7fabfc0ad500 comp rx=0 tx=0).stop 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 -- 172.21.15.92:0/326204288 shutdown_connections 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55b7a9ac2da0 0x55b7a9f61770 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b7a9b2f070 0x55b7a9f5da10 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7a9b0e390 0x55b7a9ee6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 --2- 172.21.15.92:0/326204288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a9b061b0 0x55b7a9ee64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 -- 172.21.15.92:0/326204288 >> 172.21.15.92:0/326204288 conn(0x55b7a9b23460 msgr2=0x55b7a9ee3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fabe9ffb640 0 client.16236 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 -- 172.21.15.92:0/326204288 shutdown_connections 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 1 -- 172.21.15.92:0/326204288 wait complete. 2024-09-21T07:15:01.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac0f4b9740 20 client.16236 trim_cache size 0 max 16384 2024-09-21T07:15:01.714 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:15:01.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac08f45640 1 -- 172.21.15.92:0/1492777109 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fabf00b6680 msgr2=0x7fabf00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:01.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac08f45640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fabf00b6680 0x7fabf00b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fabf4006010 tx=0x7fabf4000bc0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac08f45640 1 -- 172.21.15.92:0/1492777109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac04108d20 msgr2=0x7fac0419fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:01.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac08f45640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac04108d20 0x7fac0419fc30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00eaa0 tx=0x7fabfc00ef60 comp rx=0 tx=0).stop 2024-09-21T07:15:01.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac08f45640 1 -- 172.21.15.92:0/1492777109 shutdown_connections 2024-09-21T07:15:01.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac08f45640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fabf00b6680 0x7fabf00b8b90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac08f45640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac04108d20 0x7fac0419fc30 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac08f45640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac041083d0 0x7fac0419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac08f45640 1 --2- 172.21.15.92:0/1492777109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac04102a90 0x7fac0419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:01.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.707+0000 7fac08f45640 1 -- 172.21.15.92:0/1492777109 >> 172.21.15.92:0/1492777109 conn(0x7fac04079750 msgr2=0x7fac04101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:01.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.708+0000 7fac08f45640 1 -- 172.21.15.92:0/1492777109 shutdown_connections 2024-09-21T07:15:01.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:01.708+0000 7fac08f45640 1 -- 172.21.15.92:0/1492777109 wait complete. 2024-09-21T07:15:02.074 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:01 smithi092 ceph-mon[30987]: pgmap v398: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 50 MiB/s wr, 23 op/s 2024-09-21T07:15:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:01 smithi169 ceph-mon[33705]: pgmap v398: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 50 MiB/s wr, 23 op/s 2024-09-21T07:15:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:01 smithi175 ceph-mon[34064]: pgmap v398: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 50 MiB/s wr, 23 op/s 2024-09-21T07:15:02.573 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:15:02.820 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.336+0000 7f858d8a3640 1 -- 172.21.15.92:0/495376008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8588102a60 msgr2=0x7f8588102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:03.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.336+0000 7f858d8a3640 1 --2- 172.21.15.92:0/495376008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8588102a60 0x7f8588102e70 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8578009900 tx=0x7f857802a410 comp rx=0 tx=0).stop 2024-09-21T07:15:03.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.336+0000 7f858d8a3640 1 -- 172.21.15.92:0/495376008 shutdown_connections 2024-09-21T07:15:03.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.336+0000 7f858d8a3640 1 --2- 172.21.15.92:0/495376008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8588108cf0 0x7f858810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.336+0000 7f858d8a3640 1 --2- 172.21.15.92:0/495376008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85881083a0 0x7f85881087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.336+0000 7f858d8a3640 1 --2- 172.21.15.92:0/495376008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8588102a60 0x7f8588102e70 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.336+0000 7f858d8a3640 1 -- 172.21.15.92:0/495376008 >> 172.21.15.92:0/495376008 conn(0x7f8588079730 msgr2=0x7f8588079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:03.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.336+0000 7f858d8a3640 1 -- 172.21.15.92:0/495376008 shutdown_connections 2024-09-21T07:15:03.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.336+0000 7f858d8a3640 1 -- 172.21.15.92:0/495376008 wait complete. 2024-09-21T07:15:03.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.337+0000 7f858d8a3640 1 Processor -- start 2024-09-21T07:15:03.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.337+0000 7f858d8a3640 1 -- start start 2024-09-21T07:15:03.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.337+0000 7f858d8a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8588102a60 0x7f858810ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.337+0000 7f858d8a3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85881083a0 0x7f85881104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.337+0000 7f858d8a3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8588108cf0 0x7f8588110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.337+0000 7f858d8a3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8588113930 con 0x7f8588102a60 2024-09-21T07:15:03.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.337+0000 7f858d8a3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85881137b0 con 0x7f85881083a0 2024-09-21T07:15:03.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.337+0000 7f858d8a3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8588113ab0 con 0x7f8588108cf0 2024-09-21T07:15:03.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f8586ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8588102a60 0x7f858810ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f8586ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8588102a60 0x7f858810ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39026/0 (socket says 172.21.15.92:39026) 2024-09-21T07:15:03.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f8586ffd640 1 -- 172.21.15.92:0/3385456731 learned_addr learned my addr 172.21.15.92:0/3385456731 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:03.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f857e7fc640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85881083a0 0x7f85881104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f85877fe640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8588108cf0 0x7f8588110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f8586ffd640 1 -- 172.21.15.92:0/3385456731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8588108cf0 msgr2=0x7f8588110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:03.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f8586ffd640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8588108cf0 0x7f8588110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f8586ffd640 1 -- 172.21.15.92:0/3385456731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85881083a0 msgr2=0x7f85881104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:03.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f8586ffd640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85881083a0 0x7f85881104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f8586ffd640 1 -- 172.21.15.92:0/3385456731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85881a85d0 con 0x7f8588102a60 2024-09-21T07:15:03.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f8586ffd640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8588102a60 0x7f858810ffb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8578009a20 tx=0x7f8578004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:03.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f858c8a1640 1 -- 172.21.15.92:0/3385456731 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857803f030 con 0x7f8588102a60 2024-09-21T07:15:03.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f858d8a3640 1 -- 172.21.15.92:0/3385456731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85881a8860 con 0x7f8588102a60 2024-09-21T07:15:03.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f858c8a1640 1 -- 172.21.15.92:0/3385456731 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85780035f0 con 0x7f8588102a60 2024-09-21T07:15:03.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f858c8a1640 1 -- 172.21.15.92:0/3385456731 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578035070 con 0x7f8588102a60 2024-09-21T07:15:03.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.338+0000 7f858d8a3640 1 -- 172.21.15.92:0/3385456731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85881a8d90 con 0x7f8588102a60 2024-09-21T07:15:03.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f8593e17740 1 Processor -- start 2024-09-21T07:15:03.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f8593e17740 1 -- start start 2024-09-21T07:15:03.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f8593e17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e45070 0x55d8021ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f8593e17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e1c1b0 0x55d8021ecbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f8593e17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 0x55d8021ed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f8593e17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d802162ea0 con 0x55d801e45070 2024-09-21T07:15:03.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f8593e17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d8021522d0 con 0x55d801e24390 2024-09-21T07:15:03.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f8593e17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d8021560e0 con 0x55d801e1c1b0 2024-09-21T07:15:03.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f85877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e45070 0x55d8021ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f85877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e45070 0x55d8021ec6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39034/0 (socket says 172.21.15.92:39034) 2024-09-21T07:15:03.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f85877fe640 1 -- 172.21.15.92:0/583669859 learned_addr learned my addr 172.21.15.92:0/583669859 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:03.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f858c8a1640 1 -- 172.21.15.92:0/3385456731 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f8578031a70 con 0x7f8588102a60 2024-09-21T07:15:03.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.341+0000 7f857e7fc640 1 --2- 172.21.15.92:0/583669859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 0x55d8021ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f85877fe640 1 -- 172.21.15.92:0/583669859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e1c1b0 msgr2=0x55d8021ecbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:03.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f85877fe640 1 --2- 172.21.15.92:0/583669859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e1c1b0 0x55d8021ecbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f85877fe640 1 -- 172.21.15.92:0/583669859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 msgr2=0x55d8021ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:03.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f85877fe640 1 --2- 172.21.15.92:0/583669859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 0x55d8021ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f85877fe640 1 -- 172.21.15.92:0/583669859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d801eb0650 con 0x55d801e45070 2024-09-21T07:15:03.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f857e7fc640 1 --2- 172.21.15.92:0/583669859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 0x55d8021ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:03.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f85877fe640 1 --2- 172.21.15.92:0/583669859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e45070 0x55d8021ec6a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8580007e50 tx=0x7f858000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644e8efa31e0f166 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:03.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f857dffb640 1 -- 172.21.15.92:0/583669859 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580014070 con 0x55d801e45070 2024-09-21T07:15:03.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f857dffb640 1 -- 172.21.15.92:0/583669859 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f858000ee90 con 0x55d801e45070 2024-09-21T07:15:03.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f857dffb640 1 -- 172.21.15.92:0/583669859 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580005310 con 0x55d801e45070 2024-09-21T07:15:03.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f858c8a1640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85740b6680 0x7f85740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.342+0000 7f8586ffd640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85740b6680 0x7f85740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f858c8a1640 1 -- 172.21.15.92:0/3385456731 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f8578108780 con 0x7f8588102a60 2024-09-21T07:15:03.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8593e17740 1 -- 172.21.15.92:0/583669859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e45070 msgr2=0x55d8021ec6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:03.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8593e17740 1 --2- 172.21.15.92:0/583669859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e45070 0x55d8021ec6a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8580007e50 tx=0x7f858000e720 comp rx=0 tx=0).stop 2024-09-21T07:15:03.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8586ffd640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85740b6680 0x7f85740b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55d8021eb320 tx=0x7f85780fecd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:03.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8593e17740 1 -- 172.21.15.92:0/583669859 shutdown_connections 2024-09-21T07:15:03.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8593e17740 1 --2- 172.21.15.92:0/583669859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 0x55d8021ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8593e17740 1 --2- 172.21.15.92:0/583669859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e1c1b0 0x55d8021ecbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8593e17740 1 --2- 172.21.15.92:0/583669859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e45070 0x55d8021ec6a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8593e17740 1 -- 172.21.15.92:0/583669859 >> 172.21.15.92:0/583669859 conn(0x55d801e39460 msgr2=0x55d8021ea590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:03.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8593e17740 1 -- 172.21.15.92:0/583669859 shutdown_connections 2024-09-21T07:15:03.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8593e17740 1 -- 172.21.15.92:0/583669859 wait complete. 2024-09-21T07:15:03.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.343+0000 7f8593e17740 1 -- start start 2024-09-21T07:15:03.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f8593e17740 1 Processor -- start 2024-09-21T07:15:03.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f8593e17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e1c1b0 0x55d8021f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f8593e17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021f8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f8593e17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f8593e17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d801fb3700 con 0x55d801e24390 2024-09-21T07:15:03.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f8593e17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d8020ed160 con 0x55d801e1c1b0 2024-09-21T07:15:03.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f8593e17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d8021fae80 con 0x55d801e45070 2024-09-21T07:15:03.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f8593e17740 10 client.0 _ll_register_callbacks cb 0x55d8021069e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:03.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f857e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f857e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39050/0 (socket says 172.21.15.92:39050) 2024-09-21T07:15:03.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f857e7fc640 1 -- 172.21.15.92:0/3336257737 learned_addr learned my addr 172.21.15.92:0/3336257737 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:03.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f85877fe640 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e1c1b0 0x55d8021f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f85877fe640 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f857e7fc640 1 -- 172.21.15.92:0/3336257737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 msgr2=0x55d8021f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:03.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f857e7fc640 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f857e7fc640 1 -- 172.21.15.92:0/3336257737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e1c1b0 msgr2=0x55d8021f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:03.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f857e7fc640 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e1c1b0 0x55d8021f7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f857e7fc640 1 -- 172.21.15.92:0/3336257737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80211ac90 con 0x55d801e24390 2024-09-21T07:15:03.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.344+0000 7f85877fe640 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:03.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f857e7fc640 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021f8250 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8570010750 tx=0x7f8570010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a865e9d65420d3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:03.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:03.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8566ffd640 1 -- 172.21.15.92:0/3336257737 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857000ed40 con 0x55d801e24390 2024-09-21T07:15:03.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8566ffd640 1 -- 172.21.15.92:0/3336257737 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f8570005020 con 0x55d801e24390 2024-09-21T07:15:03.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8593e17740 1 -- 172.21.15.92:0/3336257737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f858000ee90 con 0x55d801e24390 2024-09-21T07:15:03.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8566ffd640 1 -- 172.21.15.92:0/3336257737 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8570010e60 con 0x55d801e24390 2024-09-21T07:15:03.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8593e17740 10 client.16248 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:03.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8593e17740 1 -- 172.21.15.92:0/3336257737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d802206bb0 con 0x55d801e24390 2024-09-21T07:15:03.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8566ffd640 1 -- 172.21.15.92:0/3336257737 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f858000ee90 con 0x55d801e24390 2024-09-21T07:15:03.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8566ffd640 1 -- 172.21.15.92:0/3336257737 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8570011440 con 0x55d801e24390 2024-09-21T07:15:03.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8593e17740 10 client.16248 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8593e17740 10 client.16248 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:15:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8593e17740 20 client.16248 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8593e17740 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d801e039f0 0x55d80220a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8593e17740 4 client.16248 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.345+0000 7f8593e17740 1 -- 172.21.15.92:0/3336257737 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d802164df0 con 0x55d801e039f0 2024-09-21T07:15:03.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.346+0000 7f85877fe640 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d801e039f0 0x55d80220a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.346+0000 7f85877fe640 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d801e039f0 0x55d80220a0d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=40f335083a71b588 server_cookie=39063545a90ef607 in_seq=0 out_seq=0 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.346+0000 7f8566ffd640 10 client.16248 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8566ffd640 1 -- 172.21.15.92:0/3336257737 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d802164df0 con 0x55d801e039f0 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8566ffd640 10 client.16248 handle_command_reply: tid=0 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 client.16248 shutdown 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 -- 172.21.15.92:0/3336257737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 msgr2=0x55d8021f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021f8250 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8570010750 tx=0x7f8570010c10 comp rx=0 tx=0).stop 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 -- 172.21.15.92:0/3336257737 shutdown_connections 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d801e039f0 0x55d80220a0d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021f8250 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8566ffd640 0 client.16248 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:15:03.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 --2- 172.21.15.92:0/3336257737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e1c1b0 0x55d8021f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 -- 172.21.15.92:0/3336257737 >> 172.21.15.92:0/3336257737 conn(0x55d801e39460 msgr2=0x55d8021ef880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:03.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 -- 172.21.15.92:0/3336257737 shutdown_connections 2024-09-21T07:15:03.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 1 -- 172.21.15.92:0/3336257737 wait complete. 2024-09-21T07:15:03.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.347+0000 7f8593e17740 20 client.16248 trim_cache size 0 max 16384 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.360+0000 7f8593e17740 1 Processor -- start 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.360+0000 7f8593e17740 1 -- start start 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f8593e17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e1c1b0 0x55d8021f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f8593e17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 0x55d8021edde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f8593e17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021e9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f8593e17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85881b2f90 con 0x55d801e1c1b0 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f8593e17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85881b4ad0 con 0x55d801e24390 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f8593e17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85881b3660 con 0x55d801e45070 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f85877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e1c1b0 0x55d8021f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f85877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e1c1b0 0x55d8021f9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39056/0 (socket says 172.21.15.92:39056) 2024-09-21T07:15:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f85877fe640 1 -- 172.21.15.92:0/4982533 learned_addr learned my addr 172.21.15.92:0/4982533 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f857e7fc640 1 --2- 172.21.15.92:0/4982533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 0x55d8021edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f85877fe640 1 -- 172.21.15.92:0/4982533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 msgr2=0x55d8021e9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f85877fe640 1 --2- 172.21.15.92:0/4982533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021e9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f85877fe640 1 -- 172.21.15.92:0/4982533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 msgr2=0x55d8021edde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f85877fe640 1 --2- 172.21.15.92:0/4982533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 0x55d8021edde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f85877fe640 1 -- 172.21.15.92:0/4982533 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8022040a0 con 0x55d801e1c1b0 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f85877fe640 1 --2- 172.21.15.92:0/4982533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e1c1b0 0x55d8021f9bf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8580010f10 tx=0x7f8580007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3318711ac6f23a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f857d7fa640 1 -- 172.21.15.92:0/4982533 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580031070 con 0x55d801e1c1b0 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f857d7fa640 1 -- 172.21.15.92:0/4982533 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8580003e00 con 0x55d801e1c1b0 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.361+0000 7f857d7fa640 1 -- 172.21.15.92:0/4982533 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580028070 con 0x55d801e1c1b0 2024-09-21T07:15:03.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.362+0000 7f8593e17740 1 -- 172.21.15.92:0/4982533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e1c1b0 msgr2=0x55d8021f9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.362+0000 7f8593e17740 1 --2- 172.21.15.92:0/4982533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e1c1b0 0x55d8021f9bf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8580010f10 tx=0x7f8580007610 comp rx=0 tx=0).stop 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.362+0000 7f8593e17740 1 -- 172.21.15.92:0/4982533 shutdown_connections 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.362+0000 7f8593e17740 1 --2- 172.21.15.92:0/4982533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021e9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.362+0000 7f8593e17740 1 --2- 172.21.15.92:0/4982533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e24390 0x55d8021edde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.362+0000 7f8593e17740 1 --2- 172.21.15.92:0/4982533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e1c1b0 0x55d8021f9bf0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.362+0000 7f8593e17740 1 -- 172.21.15.92:0/4982533 >> 172.21.15.92:0/4982533 conn(0x55d801e39460 msgr2=0x55d8021ed6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.362+0000 7f8593e17740 1 -- 172.21.15.92:0/4982533 shutdown_connections 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.362+0000 7f8593e17740 1 -- 172.21.15.92:0/4982533 wait complete. 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f8593e17740 1 -- start start 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f8593e17740 1 Processor -- start 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f8593e17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e1c1b0 0x55d8021fc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f8593e17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f8593e17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f8593e17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85881b4400 con 0x55d801e24390 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f8593e17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85881b3d30 con 0x55d801e1c1b0 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f8593e17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85881b0f70 con 0x55d801e45070 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f8593e17740 10 client.0 _ll_register_callbacks cb 0x7f857000c410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f857e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f857e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021fc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39060/0 (socket says 172.21.15.92:39060) 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f857e7fc640 1 -- 172.21.15.92:0/2022074343 learned_addr learned my addr 172.21.15.92:0/2022074343 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.363+0000 7f85877fe640 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e1c1b0 0x55d8021fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f85877fe640 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f857e7fc640 1 -- 172.21.15.92:0/2022074343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 msgr2=0x55d8021fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f857e7fc640 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f857e7fc640 1 -- 172.21.15.92:0/2022074343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e1c1b0 msgr2=0x55d8021fc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f857e7fc640 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e1c1b0 0x55d8021fc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f857e7fc640 1 -- 172.21.15.92:0/2022074343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d802273bf0 con 0x55d801e24390 2024-09-21T07:15:03.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f857e7fc640 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021fc7b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8570010720 tx=0x7f857000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bda60ee2ce0d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:03.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f8566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:03.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f8566ffd640 1 -- 172.21.15.92:0/2022074343 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570004220 con 0x55d801e24390 2024-09-21T07:15:03.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f8566ffd640 1 -- 172.21.15.92:0/2022074343 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f85700043c0 con 0x55d801e24390 2024-09-21T07:15:03.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f8593e17740 1 -- 172.21.15.92:0/2022074343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8580003e00 con 0x55d801e24390 2024-09-21T07:15:03.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f8566ffd640 1 -- 172.21.15.92:0/2022074343 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8570038050 con 0x55d801e24390 2024-09-21T07:15:03.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f8593e17740 10 client.16254 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:03.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f8593e17740 1 -- 172.21.15.92:0/2022074343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d802274e50 con 0x55d801e24390 2024-09-21T07:15:03.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.364+0000 7f8566ffd640 1 -- 172.21.15.92:0/2022074343 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8580003e00 con 0x55d801e24390 2024-09-21T07:15:03.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8566ffd640 1 -- 172.21.15.92:0/2022074343 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8570011ce0 con 0x55d801e24390 2024-09-21T07:15:03.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8593e17740 10 client.16254 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:03.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8593e17740 10 client.16254 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:15:03.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8593e17740 20 client.16254 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:03.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8593e17740 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d801dd8da0 0x55d802277640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:03.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8593e17740 4 client.16254 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:15:03.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8593e17740 1 -- 172.21.15.92:0/2022074343 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d8021608a0 con 0x55d801dd8da0 2024-09-21T07:15:03.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f85877fe640 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d801dd8da0 0x55d802277640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:03.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8566ffd640 10 client.16254 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:15:03.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f85877fe640 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d801dd8da0 0x55d802277640 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6f60f7ded0e3d37 server_cookie=62e659027623afea in_seq=0 out_seq=0 2024-09-21T07:15:03.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8566ffd640 1 -- 172.21.15.92:0/2022074343 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d8021608a0 con 0x55d801dd8da0 2024-09-21T07:15:03.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8566ffd640 10 client.16254 handle_command_reply: tid=0 2024-09-21T07:15:03.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.365+0000 7f8593e17740 1 client.16254 shutdown 2024-09-21T07:15:03.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 1 -- 172.21.15.92:0/2022074343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 msgr2=0x55d8021fc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:03.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021fc7b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8570010720 tx=0x7f857000edf0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 1 -- 172.21.15.92:0/2022074343 shutdown_connections 2024-09-21T07:15:03.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d801e45070 0x55d8021fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d801dd8da0 0x55d802277640 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d801e24390 0x55d8021fc7b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 1 --2- 172.21.15.92:0/2022074343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801e1c1b0 0x55d8021fc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 1 -- 172.21.15.92:0/2022074343 >> 172.21.15.92:0/2022074343 conn(0x55d801e39460 msgr2=0x55d8021ede60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:03.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8566ffd640 0 client.16254 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:15:03.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 1 -- 172.21.15.92:0/2022074343 shutdown_connections 2024-09-21T07:15:03.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 1 -- 172.21.15.92:0/2022074343 wait complete. 2024-09-21T07:15:03.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f8593e17740 20 client.16254 trim_cache size 0 max 16384 2024-09-21T07:15:03.382 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:15:03.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f858d8a3640 1 -- 172.21.15.92:0/3385456731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85740b6680 msgr2=0x7f85740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:03.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f858d8a3640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85740b6680 0x7f85740b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55d8021eb320 tx=0x7f85780fecd0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f858d8a3640 1 -- 172.21.15.92:0/3385456731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8588102a60 msgr2=0x7f858810ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:03.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f858d8a3640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8588102a60 0x7f858810ffb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8578009a20 tx=0x7f8578004270 comp rx=0 tx=0).stop 2024-09-21T07:15:03.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f858d8a3640 1 -- 172.21.15.92:0/3385456731 shutdown_connections 2024-09-21T07:15:03.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.366+0000 7f858d8a3640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85740b6680 0x7f85740b8b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.367+0000 7f858d8a3640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8588108cf0 0x7f8588110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.367+0000 7f858d8a3640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85881083a0 0x7f85881104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.367+0000 7f858d8a3640 1 --2- 172.21.15.92:0/3385456731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8588102a60 0x7f858810ffb0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:03.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.367+0000 7f858d8a3640 1 -- 172.21.15.92:0/3385456731 >> 172.21.15.92:0/3385456731 conn(0x7f8588079730 msgr2=0x7f8588101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:03.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.367+0000 7f858d8a3640 1 -- 172.21.15.92:0/3385456731 shutdown_connections 2024-09-21T07:15:03.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:03.367+0000 7f858d8a3640 1 -- 172.21.15.92:0/3385456731 wait complete. 2024-09-21T07:15:04.191 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:15:04.437 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:04.857 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:04 smithi092 ceph-mon[30987]: pgmap v399: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 43 MiB/s wr, 39 op/s 2024-09-21T07:15:04.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.946+0000 7f28050f9640 1 -- 172.21.15.92:0/440369297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2800108cf0 msgr2=0x7f280010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:04.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.946+0000 7f28050f9640 1 --2- 172.21.15.92:0/440369297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2800108cf0 0x7f280010f520 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009ca0 tx=0x7f27f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.946+0000 7f28050f9640 1 -- 172.21.15.92:0/440369297 shutdown_connections 2024-09-21T07:15:04.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.946+0000 7f28050f9640 1 --2- 172.21.15.92:0/440369297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2800108cf0 0x7f280010f520 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.946+0000 7f28050f9640 1 --2- 172.21.15.92:0/440369297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28001083a0 0x7f28001087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.946+0000 7f28050f9640 1 --2- 172.21.15.92:0/440369297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2800102a60 0x7f2800102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.946+0000 7f28050f9640 1 -- 172.21.15.92:0/440369297 >> 172.21.15.92:0/440369297 conn(0x7f2800079730 msgr2=0x7f2800079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:04.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.946+0000 7f28050f9640 1 -- 172.21.15.92:0/440369297 shutdown_connections 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.946+0000 7f28050f9640 1 -- 172.21.15.92:0/440369297 wait complete. 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.946+0000 7f28050f9640 1 Processor -- start 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f28050f9640 1 -- start start 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f28050f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2800102a60 0x7f280019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f28050f9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28001083a0 0x7f280019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f28050f9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2800108cf0 0x7f280019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f28050f9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28001128c0 con 0x7f2800102a60 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f28050f9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2800112740 con 0x7f2800108cf0 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f28050f9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2800112a40 con 0x7f28001083a0 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2800102a60 0x7f280019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2800102a60 0x7f280019a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39080/0 (socket says 172.21.15.92:39080) 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f27fed9d640 1 -- 172.21.15.92:0/582100839 learned_addr learned my addr 172.21.15.92:0/582100839 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f27f659c640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28001083a0 0x7f280019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f27ff59e640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2800108cf0 0x7f280019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f27fed9d640 1 -- 172.21.15.92:0/582100839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28001083a0 msgr2=0x7f280019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f27fed9d640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28001083a0 0x7f280019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f27fed9d640 1 -- 172.21.15.92:0/582100839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2800108cf0 msgr2=0x7f280019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.947+0000 7f27fed9d640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2800108cf0 0x7f280019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.948+0000 7f27fed9d640 1 -- 172.21.15.92:0/582100839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28001a0250 con 0x7f2800102a60 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.948+0000 7f27f659c640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28001083a0 0x7f280019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.948+0000 7f27fed9d640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2800102a60 0x7f280019a3a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f27f000c920 tx=0x7f27f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.948+0000 7f27fcd99640 1 -- 172.21.15.92:0/582100839 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0007c70 con 0x7f2800102a60 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.948+0000 7f28050f9640 1 -- 172.21.15.92:0/582100839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28001a0540 con 0x7f2800102a60 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.948+0000 7f27fcd99640 1 -- 172.21.15.92:0/582100839 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27f0007e10 con 0x7f2800102a60 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.948+0000 7f27fcd99640 1 -- 172.21.15.92:0/582100839 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00186f0 con 0x7f2800102a60 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.948+0000 7f28050f9640 1 -- 172.21.15.92:0/582100839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28001a6d60 con 0x7f2800102a60 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f27fcd99640 1 -- 172.21.15.92:0/582100839 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f27f0018890 con 0x7f2800102a60 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f280b66d740 1 Processor -- start 2024-09-21T07:15:04.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f280b66d740 1 -- start start 2024-09-21T07:15:04.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f280b66d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bd3070 0x55e324f7a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f280b66d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f7abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f280b66d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bb2390 0x55e324f7b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f280b66d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e324ef0ea0 con 0x55e324baa1b0 2024-09-21T07:15:04.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f280b66d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e324ee02d0 con 0x55e324bd3070 2024-09-21T07:15:04.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f280b66d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e324ee40e0 con 0x55e324bb2390 2024-09-21T07:15:04.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f7abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f7abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39088/0 (socket says 172.21.15.92:39088) 2024-09-21T07:15:04.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f27fed9d640 1 -- 172.21.15.92:0/3158132450 learned_addr learned my addr 172.21.15.92:0/3158132450 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:04.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.951+0000 7f27ff59e640 1 --2- 172.21.15.92:0/3158132450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bd3070 0x55e324f7a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27fcd99640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27ec0b66b0 0x7f27ec0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27f659c640 1 --2- 172.21.15.92:0/3158132450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bb2390 0x55e324f7b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27fed9d640 1 -- 172.21.15.92:0/3158132450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bb2390 msgr2=0x55e324f7b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27fed9d640 1 --2- 172.21.15.92:0/3158132450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bb2390 0x55e324f7b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27fed9d640 1 -- 172.21.15.92:0/3158132450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bd3070 msgr2=0x55e324f7a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27fed9d640 1 --2- 172.21.15.92:0/3158132450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bd3070 0x55e324f7a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27fed9d640 1 -- 172.21.15.92:0/3158132450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e324c3e650 con 0x55e324baa1b0 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27ff59e640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27ec0b66b0 0x7f27ec0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27fcd99640 1 -- 172.21.15.92:0/582100839 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f27f00e7dc0 con 0x7f2800102a60 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27fed9d640 1 --2- 172.21.15.92:0/3158132450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f7abe0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f27f00e50e0 tx=0x7f27f0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e8cc1a23c0065a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27f559a640 1 -- 172.21.15.92:0/3158132450 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00ad1c0 con 0x55e324baa1b0 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27ff59e640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27ec0b66b0 0x7f27ec0b8bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27f8031040 tx=0x7f27f802a8c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27f559a640 1 -- 172.21.15.92:0/3158132450 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27f00ad380 con 0x55e324baa1b0 2024-09-21T07:15:04.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.952+0000 7f27f559a640 1 -- 172.21.15.92:0/3158132450 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0094fb0 con 0x55e324baa1b0 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.953+0000 7f280b66d740 1 -- 172.21.15.92:0/3158132450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 msgr2=0x55e324f7abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.953+0000 7f280b66d740 1 --2- 172.21.15.92:0/3158132450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f7abe0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f27f00e50e0 tx=0x7f27f0020000 comp rx=0 tx=0).stop 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.953+0000 7f280b66d740 1 -- 172.21.15.92:0/3158132450 shutdown_connections 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.953+0000 7f280b66d740 1 --2- 172.21.15.92:0/3158132450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bb2390 0x55e324f7b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.953+0000 7f280b66d740 1 --2- 172.21.15.92:0/3158132450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f7abe0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.953+0000 7f280b66d740 1 --2- 172.21.15.92:0/3158132450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bd3070 0x55e324f7a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.953+0000 7f280b66d740 1 -- 172.21.15.92:0/3158132450 >> 172.21.15.92:0/3158132450 conn(0x55e324bc7460 msgr2=0x55e324f78590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.953+0000 7f280b66d740 1 -- 172.21.15.92:0/3158132450 shutdown_connections 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.953+0000 7f280b66d740 1 -- 172.21.15.92:0/3158132450 wait complete. 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f280b66d740 1 -- start start 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f280b66d740 1 Processor -- start 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f280b66d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f85d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f280b66d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bb2390 0x55e324f862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f280b66d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bd3070 0x55e324f92110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f280b66d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e324d41700 con 0x55e324baa1b0 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f280b66d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e324e7b160 con 0x55e324bb2390 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f280b66d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e324f88e20 con 0x55e324bd3070 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f85d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f280b66d740 10 client.0 _ll_register_callbacks cb 0x55e324e949e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f85d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39090/0 (socket says 172.21.15.92:39090) 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f27fed9d640 1 -- 172.21.15.92:0/2373358395 learned_addr learned my addr 172.21.15.92:0/2373358395 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f27f659c640 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bb2390 0x55e324f862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f27fed9d640 1 -- 172.21.15.92:0/2373358395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bd3070 msgr2=0x55e324f92110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f27fed9d640 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bd3070 0x55e324f92110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f27fed9d640 1 -- 172.21.15.92:0/2373358395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bb2390 msgr2=0x55e324f862b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f27fed9d640 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bb2390 0x55e324f862b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.954+0000 7f27fed9d640 1 -- 172.21.15.92:0/2373358395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e324ea8c90 con 0x55e324baa1b0 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f27fed9d640 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f85d70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f27f00e5220 tx=0x7f27f00eba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fae4397d4f6b416 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f27e67fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f27e67fc640 1 -- 172.21.15.92:0/2373358395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00acfe0 con 0x55e324baa1b0 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f27e67fc640 1 -- 172.21.15.92:0/2373358395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f27f00a9ae0 con 0x55e324baa1b0 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f280b66d740 1 -- 172.21.15.92:0/2373358395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f00ad380 con 0x55e324baa1b0 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f27e67fc640 1 -- 172.21.15.92:0/2373358395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f27f00ad1c0 con 0x55e324baa1b0 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f280b66d740 10 client.16266 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f280b66d740 1 -- 172.21.15.92:0/2373358395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e324f94b10 con 0x55e324baa1b0 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f27e67fc640 1 -- 172.21.15.92:0/2373358395 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27f00ad380 con 0x55e324baa1b0 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f27e67fc640 1 -- 172.21.15.92:0/2373358395 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f27f00b6e00 con 0x55e324baa1b0 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f280b66d740 10 client.16266 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f280b66d740 10 client.16266 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f280b66d740 20 client.16266 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f280b66d740 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e324b919f0 0x55e324f97e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f280b66d740 4 client.16266 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.955+0000 7f280b66d740 1 -- 172.21.15.92:0/2373358395 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e324ef2df0 con 0x55e324b919f0 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.956+0000 7f27f659c640 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e324b919f0 0x55e324f97e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.956+0000 7f27e67fc640 10 client.16266 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.956+0000 7f27f659c640 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e324b919f0 0x55e324f97e70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2cf84f999083404c server_cookie=a6b957ae89745c26 in_seq=0 out_seq=0 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f27e67fc640 1 -- 172.21.15.92:0/2373358395 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e324ef2df0 con 0x55e324b919f0 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f27e67fc640 10 client.16266 handle_command_reply: tid=0 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 client.16266 shutdown 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 -- 172.21.15.92:0/2373358395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 msgr2=0x55e324f85d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f85d70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f27f00e5220 tx=0x7f27f00eba40 comp rx=0 tx=0).stop 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 -- 172.21.15.92:0/2373358395 shutdown_connections 2024-09-21T07:15:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e324b919f0 0x55e324f97e70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bd3070 0x55e324f92110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bb2390 0x55e324f862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 --2- 172.21.15.92:0/2373358395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f85d70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f27e67fc640 0 client.16266 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:15:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 -- 172.21.15.92:0/2373358395 >> 172.21.15.92:0/2373358395 conn(0x55e324bc7460 msgr2=0x55e324f7b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 -- 172.21.15.92:0/2373358395 shutdown_connections 2024-09-21T07:15:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 1 -- 172.21.15.92:0/2373358395 wait complete. 2024-09-21T07:15:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.957+0000 7f280b66d740 20 client.16266 trim_cache size 0 max 16384 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f280b66d740 1 Processor -- start 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f280b66d740 1 -- start start 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f280b66d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f86230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f280b66d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bb2390 0x55e324f92080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f280b66d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bd3070 0x55e324f82f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f280b66d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28001b0dc0 con 0x55e324baa1b0 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f280b66d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f28001b2900 con 0x55e324bd3070 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f280b66d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28001b1490 con 0x55e324bb2390 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f86230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f86230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39102/0 (socket says 172.21.15.92:39102) 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f27fed9d640 1 -- 172.21.15.92:0/343140886 learned_addr learned my addr 172.21.15.92:0/343140886 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f27f659c640 1 --2- 172.21.15.92:0/343140886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bb2390 0x55e324f92080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.971+0000 7f27ff59e640 1 --2- 172.21.15.92:0/343140886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bd3070 0x55e324f82f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.972+0000 7f27fed9d640 1 -- 172.21.15.92:0/343140886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bb2390 msgr2=0x55e324f92080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.972+0000 7f27fed9d640 1 --2- 172.21.15.92:0/343140886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bb2390 0x55e324f92080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.972+0000 7f27fed9d640 1 -- 172.21.15.92:0/343140886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bd3070 msgr2=0x55e324f82f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.972+0000 7f27fed9d640 1 --2- 172.21.15.92:0/343140886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bd3070 0x55e324f82f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.972+0000 7f27fed9d640 1 -- 172.21.15.92:0/343140886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e324f88350 con 0x55e324baa1b0 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.972+0000 7f27fed9d640 1 --2- 172.21.15.92:0/343140886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f86230 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f27f00e5770 tx=0x7f27f00a9110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0377d3755216115 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.972+0000 7f27f4d99640 1 -- 172.21.15.92:0/343140886 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00ad640 con 0x55e324baa1b0 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.972+0000 7f27f4d99640 1 -- 172.21.15.92:0/343140886 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27f00ad380 con 0x55e324baa1b0 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.972+0000 7f27f4d99640 1 -- 172.21.15.92:0/343140886 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00b6e00 con 0x55e324baa1b0 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 -- 172.21.15.92:0/343140886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 msgr2=0x55e324f86230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 --2- 172.21.15.92:0/343140886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f86230 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f27f00e5770 tx=0x7f27f00a9110 comp rx=0 tx=0).stop 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 -- 172.21.15.92:0/343140886 shutdown_connections 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 --2- 172.21.15.92:0/343140886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324bd3070 0x55e324f82f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 --2- 172.21.15.92:0/343140886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bb2390 0x55e324f92080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 --2- 172.21.15.92:0/343140886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324baa1b0 0x55e324f86230 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 -- 172.21.15.92:0/343140886 >> 172.21.15.92:0/343140886 conn(0x55e324bc7460 msgr2=0x55e324f85b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 -- 172.21.15.92:0/343140886 shutdown_connections 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 -- 172.21.15.92:0/343140886 wait complete. 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 -- start start 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.973+0000 7f280b66d740 1 Processor -- start 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f280b66d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324baa1b0 0x55e324f9b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f280b66d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324bb2390 0x55e324f98cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f280b66d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bd3070 0x55e324f993c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f280b66d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28001b2230 con 0x55e324bb2390 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f280b66d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f28001b1b60 con 0x55e324baa1b0 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f280b66d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28001aeda0 con 0x55e324bd3070 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f280b66d740 10 client.0 _ll_register_callbacks cb 0x7f27f8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27f659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324bb2390 0x55e324f98cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27f659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324bb2390 0x55e324f98cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39108/0 (socket says 172.21.15.92:39108) 2024-09-21T07:15:04.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27f659c640 1 -- 172.21.15.92:0/2887542721 learned_addr learned my addr 172.21.15.92:0/2887542721 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27ff59e640 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bd3070 0x55e324f993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27fed9d640 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324baa1b0 0x55e324f9b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27f659c640 1 -- 172.21.15.92:0/2887542721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bd3070 msgr2=0x55e324f993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27f659c640 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bd3070 0x55e324f993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27f659c640 1 -- 172.21.15.92:0/2887542721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324baa1b0 msgr2=0x55e324f9b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27f659c640 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324baa1b0 0x55e324f9b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27f659c640 1 -- 172.21.15.92:0/2887542721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3250015f0 con 0x55e324bb2390 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27f659c640 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324bb2390 0x55e324f98cd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f280006aaa0 tx=0x7f27e800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e7370391ff14c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27e67fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27e67fc640 1 -- 172.21.15.92:0/2887542721 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e800f040 con 0x55e324bb2390 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f27e67fc640 1 -- 172.21.15.92:0/2887542721 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f27e801d450 con 0x55e324bb2390 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.974+0000 7f280b66d740 1 -- 172.21.15.92:0/2887542721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f00ad380 con 0x55e324bb2390 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f27e67fc640 1 -- 172.21.15.92:0/2887542721 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f27e802e050 con 0x55e324bb2390 2024-09-21T07:15:04.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f280b66d740 10 client.16272 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f280b66d740 1 -- 172.21.15.92:0/2887542721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e325002710 con 0x55e324bb2390 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f27e67fc640 1 -- 172.21.15.92:0/2887542721 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27f00ad380 con 0x55e324bb2390 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f27e67fc640 1 -- 172.21.15.92:0/2887542721 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f27e8025590 con 0x55e324bb2390 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f280b66d740 10 client.16272 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f280b66d740 10 client.16272 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f280b66d740 20 client.16272 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f280b66d740 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e324b66da0 0x55e325004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f280b66d740 4 client.16272 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f280b66d740 1 -- 172.21.15.92:0/2887542721 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e324eee8a0 con 0x55e324b66da0 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.975+0000 7f27fed9d640 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e324b66da0 0x55e325004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f27e67fc640 10 client.16272 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:15:04.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f27fed9d640 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e324b66da0 0x55e325004ee0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c06ca39d373ea3b server_cookie=33ccdab4cd228fc1 in_seq=0 out_seq=0 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f27e67fc640 1 -- 172.21.15.92:0/2887542721 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e324eee8a0 con 0x55e324b66da0 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f27e67fc640 10 client.16272 handle_command_reply: tid=0 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 client.16272 shutdown 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 -- 172.21.15.92:0/2887542721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324bb2390 msgr2=0x55e324f98cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324bb2390 0x55e324f98cd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f280006aaa0 tx=0x7f27e800bea0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 -- 172.21.15.92:0/2887542721 shutdown_connections 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55e324b66da0 0x55e325004ee0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e324bd3070 0x55e324f993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e324bb2390 0x55e324f98cd0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 --2- 172.21.15.92:0/2887542721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e324baa1b0 0x55e324f9b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 -- 172.21.15.92:0/2887542721 >> 172.21.15.92:0/2887542721 conn(0x55e324bc7460 msgr2=0x55e324f7b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f27e67fc640 0 client.16272 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:15:04.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 -- 172.21.15.92:0/2887542721 shutdown_connections 2024-09-21T07:15:04.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.976+0000 7f280b66d740 1 -- 172.21.15.92:0/2887542721 wait complete. 2024-09-21T07:15:04.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f280b66d740 20 client.16272 trim_cache size 0 max 16384 2024-09-21T07:15:04.986 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:15:04.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 -- 172.21.15.92:0/582100839 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27ec0b66b0 msgr2=0x7f27ec0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:04.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27ec0b66b0 0x7f27ec0b8bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27f8031040 tx=0x7f27f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 -- 172.21.15.92:0/582100839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2800102a60 msgr2=0x7f280019a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:04.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2800102a60 0x7f280019a3a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f27f000c920 tx=0x7f27f000cde0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 -- 172.21.15.92:0/582100839 shutdown_connections 2024-09-21T07:15:04.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f27ec0b66b0 0x7f27ec0b8bc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2800108cf0 0x7f280019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28001083a0 0x7f280019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 --2- 172.21.15.92:0/582100839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2800102a60 0x7f280019a3a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:04.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 -- 172.21.15.92:0/582100839 >> 172.21.15.92:0/582100839 conn(0x7f2800079730 msgr2=0x7f280006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:04.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 -- 172.21.15.92:0/582100839 shutdown_connections 2024-09-21T07:15:04.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:04.977+0000 7f28050f9640 1 -- 172.21.15.92:0/582100839 wait complete. 2024-09-21T07:15:05.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:04 smithi175 ceph-mon[34064]: pgmap v399: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 43 MiB/s wr, 39 op/s 2024-09-21T07:15:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:04 smithi169 ceph-mon[33705]: pgmap v399: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 43 MiB/s wr, 39 op/s 2024-09-21T07:15:05.911 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:15:06.158 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.648+0000 7fa4f910e640 1 -- 172.21.15.92:0/3421177576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f4103bb0 msgr2=0x7fa4f4103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.648+0000 7fa4f910e640 1 --2- 172.21.15.92:0/3421177576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f4103bb0 0x7fa4f4103fc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009900 tx=0x7fa4e402a410 comp rx=0 tx=0).stop 2024-09-21T07:15:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.648+0000 7fa4f910e640 1 -- 172.21.15.92:0/3421177576 shutdown_connections 2024-09-21T07:15:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.648+0000 7fa4f910e640 1 --2- 172.21.15.92:0/3421177576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4f4109e40 0x7fa4f4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.648+0000 7fa4f910e640 1 --2- 172.21.15.92:0/3421177576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4f41094f0 0x7fa4f4109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.648+0000 7fa4f910e640 1 --2- 172.21.15.92:0/3421177576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f4103bb0 0x7fa4f4103fc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.648+0000 7fa4f910e640 1 -- 172.21.15.92:0/3421177576 >> 172.21.15.92:0/3421177576 conn(0x7fa4f40ff600 msgr2=0x7fa4f4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.649+0000 7fa4f910e640 1 -- 172.21.15.92:0/3421177576 shutdown_connections 2024-09-21T07:15:06.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.649+0000 7fa4f910e640 1 -- 172.21.15.92:0/3421177576 wait complete. 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.649+0000 7fa4f910e640 1 Processor -- start 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.649+0000 7fa4f910e640 1 -- start start 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4f910e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4f4103bb0 0x7fa4f419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4f910e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f41094f0 0x7fa4f419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4f910e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4f4109e40 0x7fa4f419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4f910e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41139b0 con 0x7fa4f41094f0 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4f910e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f4113830 con 0x7fa4f4109e40 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4f910e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f4113b30 con 0x7fa4f4103bb0 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f41094f0 0x7fa4f419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f41094f0 0x7fa4f419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39134/0 (socket says 172.21.15.92:39134) 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4ebfff640 1 -- 172.21.15.92:0/1143833353 learned_addr learned my addr 172.21.15.92:0/1143833353 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4f2d9d640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4f4103bb0 0x7fa4f419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4f359e640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4f4109e40 0x7fa4f419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4ebfff640 1 -- 172.21.15.92:0/1143833353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4f4103bb0 msgr2=0x7fa4f419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4f4103bb0 0x7fa4f419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4ebfff640 1 -- 172.21.15.92:0/1143833353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4f4109e40 msgr2=0x7fa4f419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4f4109e40 0x7fa4f419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4ebfff640 1 -- 172.21.15.92:0/1143833353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f41a02d0 con 0x7fa4f41094f0 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f41094f0 0x7fa4f419a9c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00d750 tx=0x7fa4dc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.650+0000 7fa4f0d99640 1 -- 172.21.15.92:0/1143833353 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc017070 con 0x7fa4f41094f0 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.651+0000 7fa4f910e640 1 -- 172.21.15.92:0/1143833353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f41a05c0 con 0x7fa4f41094f0 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.651+0000 7fa4f0d99640 1 -- 172.21.15.92:0/1143833353 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4dc0054b0 con 0x7fa4f41094f0 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.651+0000 7fa4f0d99640 1 -- 172.21.15.92:0/1143833353 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc004bc0 con 0x7fa4f41094f0 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.651+0000 7fa4f910e640 1 -- 172.21.15.92:0/1143833353 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f40755f0 con 0x7fa4f41094f0 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.653+0000 7fa4ff682740 1 Processor -- start 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.653+0000 7fa4ff682740 1 -- start start 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.653+0000 7fa4f0d99640 1 -- 172.21.15.92:0/1143833353 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fa4dc009c30 con 0x7fa4f41094f0 2024-09-21T07:15:06.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e61070 0x55b0322086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e381b0 0x55b032208be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032209120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ff682740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b03217eea0 con 0x55b031e40390 2024-09-21T07:15:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ff682740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b03216e2d0 con 0x55b031e381b0 2024-09-21T07:15:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ff682740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b0321720e0 con 0x55b031e61070 2024-09-21T07:15:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032209120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032209120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39144/0 (socket says 172.21.15.92:39144) 2024-09-21T07:15:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ebfff640 1 -- 172.21.15.92:0/3088603210 learned_addr learned my addr 172.21.15.92:0/3088603210 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:06.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4f359e640 1 --2- 172.21.15.92:0/3088603210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e61070 0x55b0322086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4f2d9d640 1 --2- 172.21.15.92:0/3088603210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e381b0 0x55b032208be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ebfff640 1 -- 172.21.15.92:0/3088603210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e61070 msgr2=0x55b0322086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/3088603210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e61070 0x55b0322086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ebfff640 1 -- 172.21.15.92:0/3088603210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e381b0 msgr2=0x55b032208be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/3088603210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e381b0 0x55b032208be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4ebfff640 1 -- 172.21.15.92:0/3088603210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b031ecc650 con 0x55b031e40390 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.654+0000 7fa4f0d99640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa4e00b66b0 0x7fa4e00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.655+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/3088603210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032209120 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0e4720 tx=0x7fa4dc0eda70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13588cca67a4a788 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.655+0000 7fa4f359e640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa4e00b66b0 0x7fa4e00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.655+0000 7fa4e97fa640 1 -- 172.21.15.92:0/3088603210 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0a95b0 con 0x55b031e40390 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.655+0000 7fa4f0d99640 1 -- 172.21.15.92:0/1143833353 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa4dc0e7400 con 0x7fa4f41094f0 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.655+0000 7fa4e97fa640 1 -- 172.21.15.92:0/3088603210 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4dc0aca70 con 0x55b031e40390 2024-09-21T07:15:06.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.655+0000 7fa4e97fa640 1 -- 172.21.15.92:0/3088603210 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc083860 con 0x55b031e40390 2024-09-21T07:15:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 -- 172.21.15.92:0/3088603210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 msgr2=0x55b032209120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4f359e640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa4e00b66b0 0x7fa4e00b8bc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec007f80 tx=0x7fa4ec007520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 --2- 172.21.15.92:0/3088603210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032209120 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0e4720 tx=0x7fa4dc0eda70 comp rx=0 tx=0).stop 2024-09-21T07:15:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 -- 172.21.15.92:0/3088603210 shutdown_connections 2024-09-21T07:15:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 --2- 172.21.15.92:0/3088603210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032209120 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 --2- 172.21.15.92:0/3088603210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e381b0 0x55b032208be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 --2- 172.21.15.92:0/3088603210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e61070 0x55b0322086a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 -- 172.21.15.92:0/3088603210 >> 172.21.15.92:0/3088603210 conn(0x55b031e55460 msgr2=0x55b032206590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 -- 172.21.15.92:0/3088603210 shutdown_connections 2024-09-21T07:15:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 -- 172.21.15.92:0/3088603210 wait complete. 2024-09-21T07:15:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 -- start start 2024-09-21T07:15:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.656+0000 7fa4ff682740 1 Processor -- start 2024-09-21T07:15:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e381b0 0x55b032213d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e40390 0x55b032214250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 0x55b032220170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4ff682740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b031fcf700 con 0x55b031e381b0 2024-09-21T07:15:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4ff682740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b032109160 con 0x55b031e61070 2024-09-21T07:15:06.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4ff682740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b032216e80 con 0x55b031e40390 2024-09-21T07:15:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4ff682740 10 client.0 _ll_register_callbacks cb 0x55b0321229e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4f2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e381b0 0x55b032213d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4f2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e381b0 0x55b032213d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39160/0 (socket says 172.21.15.92:39160) 2024-09-21T07:15:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4f2d9d640 1 -- 172.21.15.92:0/195489612 learned_addr learned my addr 172.21.15.92:0/195489612 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e40390 0x55b032214250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4f359e640 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 0x55b032220170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4f2d9d640 1 -- 172.21.15.92:0/195489612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e40390 msgr2=0x55b032214250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4f2d9d640 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e40390 0x55b032214250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4f2d9d640 1 -- 172.21.15.92:0/195489612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 msgr2=0x55b032220170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4f2d9d640 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 0x55b032220170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4f2d9d640 1 -- 172.21.15.92:0/195489612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b032136c90 con 0x55b031e381b0 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4f2d9d640 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e381b0 0x55b032213d10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa4e402a930 tx=0x7fa4e4031f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddade8a492552293 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.657+0000 7fa4da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4da7fc640 1 -- 172.21.15.92:0/195489612 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4035070 con 0x55b031e381b0 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4ff682740 1 -- 172.21.15.92:0/195489612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4dc0aca70 con 0x55b031e381b0 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4da7fc640 1 -- 172.21.15.92:0/195489612 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa4e4004040 con 0x55b031e381b0 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4da7fc640 1 -- 172.21.15.92:0/195489612 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa4e404e050 con 0x55b031e381b0 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4ff682740 10 client.16284 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4ff682740 1 -- 172.21.15.92:0/195489612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b032222ba0 con 0x55b031e381b0 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4da7fc640 1 -- 172.21.15.92:0/195489612 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4dc0aca70 con 0x55b031e381b0 2024-09-21T07:15:06.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4da7fc640 1 -- 172.21.15.92:0/195489612 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa4e4043020 con 0x55b031e381b0 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4ff682740 10 client.16284 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4ff682740 10 client.16284 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4ff682740 20 client.16284 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4ff682740 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b031e1f9f0 0x55b0322260b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4ff682740 4 client.16284 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4ff682740 1 -- 172.21.15.92:0/195489612 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b032180df0 con 0x55b031e1f9f0 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.658+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b031e1f9f0 0x55b0322260b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.659+0000 7fa4da7fc640 10 client.16284 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.659+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b031e1f9f0 0x55b0322260b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a11449bbf19b36d server_cookie=28cd7712ef53d1a5 in_seq=0 out_seq=0 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4da7fc640 1 -- 172.21.15.92:0/195489612 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b032180df0 con 0x55b031e1f9f0 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4da7fc640 10 client.16284 handle_command_reply: tid=0 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 client.16284 shutdown 2024-09-21T07:15:06.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 -- 172.21.15.92:0/195489612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e381b0 msgr2=0x55b032213d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e381b0 0x55b032213d10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa4e402a930 tx=0x7fa4e4031f00 comp rx=0 tx=0).stop 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 -- 172.21.15.92:0/195489612 shutdown_connections 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b031e1f9f0 0x55b0322260b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 0x55b032220170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e40390 0x55b032214250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 --2- 172.21.15.92:0/195489612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e381b0 0x55b032213d10 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4da7fc640 0 client.16284 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 -- 172.21.15.92:0/195489612 >> 172.21.15.92:0/195489612 conn(0x55b031e55460 msgr2=0x55b03220b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 -- 172.21.15.92:0/195489612 shutdown_connections 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 1 -- 172.21.15.92:0/195489612 wait complete. 2024-09-21T07:15:06.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.660+0000 7fa4ff682740 20 client.16284 trim_cache size 0 max 16384 2024-09-21T07:15:06.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ff682740 1 Processor -- start 2024-09-21T07:15:06.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ff682740 1 -- start start 2024-09-21T07:15:06.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 0x55b032209de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032205bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 0x55b032206100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ff682740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41b2ee0 con 0x55b031e40390 2024-09-21T07:15:06.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ff682740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41b4a20 con 0x55b031e61070 2024-09-21T07:15:06.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ff682740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41b35b0 con 0x55b031e381b0 2024-09-21T07:15:06.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032205bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032205bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39168/0 (socket says 172.21.15.92:39168) 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.674+0000 7fa4ebfff640 1 -- 172.21.15.92:0/2102688380 learned_addr learned my addr 172.21.15.92:0/2102688380 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4f2d9d640 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 0x55b032209de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4ebfff640 1 -- 172.21.15.92:0/2102688380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 msgr2=0x55b032209de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4f359e640 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 0x55b032206100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 0x55b032209de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4ebfff640 1 -- 172.21.15.92:0/2102688380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 msgr2=0x55b032206100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 0x55b032206100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4ebfff640 1 -- 172.21.15.92:0/2102688380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b032216450 con 0x55b031e40390 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4f2d9d640 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 0x55b032209de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4f359e640 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 0x55b032206100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032205bc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc005c20 tx=0x7fa4dc0ec040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ed2c8b9e5bf4a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4e8ff9640 1 -- 172.21.15.92:0/2102688380 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc020040 con 0x55b031e40390 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4e8ff9640 1 -- 172.21.15.92:0/2102688380 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4dc0aca70 con 0x55b031e40390 2024-09-21T07:15:06.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.675+0000 7fa4e8ff9640 1 -- 172.21.15.92:0/2102688380 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc07b600 con 0x55b031e40390 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.676+0000 7fa4ff682740 1 -- 172.21.15.92:0/2102688380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 msgr2=0x55b032205bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.676+0000 7fa4ff682740 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032205bc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc005c20 tx=0x7fa4dc0ec040 comp rx=0 tx=0).stop 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.676+0000 7fa4ff682740 1 -- 172.21.15.92:0/2102688380 shutdown_connections 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.676+0000 7fa4ff682740 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e61070 0x55b032206100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.676+0000 7fa4ff682740 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e40390 0x55b032205bc0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.676+0000 7fa4ff682740 1 --2- 172.21.15.92:0/2102688380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 0x55b032209de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.676+0000 7fa4ff682740 1 -- 172.21.15.92:0/2102688380 >> 172.21.15.92:0/2102688380 conn(0x55b031e55460 msgr2=0x55b0322096d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.676+0000 7fa4ff682740 1 -- 172.21.15.92:0/2102688380 shutdown_connections 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.676+0000 7fa4ff682740 1 -- 172.21.15.92:0/2102688380 wait complete. 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4ff682740 1 -- start start 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4ff682740 1 Processor -- start 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 0x55b03221c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e40390 0x55b032217d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4ff682740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e61070 0x55b032218260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4ff682740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41b4350 con 0x55b031e61070 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4ff682740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41b3c80 con 0x55b031e40390 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4ff682740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f41b0ec0 con 0x55b031e381b0 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4ff682740 10 client.0 _ll_register_callbacks cb 0x7fa4e4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4f359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e61070 0x55b032218260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4f359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e61070 0x55b032218260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39184/0 (socket says 172.21.15.92:39184) 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4f359e640 1 -- 172.21.15.92:0/621909639 learned_addr learned my addr 172.21.15.92:0/621909639 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.677+0000 7fa4f2d9d640 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 0x55b03221c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4ebfff640 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e40390 0x55b032217d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4f359e640 1 -- 172.21.15.92:0/621909639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 msgr2=0x55b03221c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4f359e640 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 0x55b03221c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4f359e640 1 -- 172.21.15.92:0/621909639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e40390 msgr2=0x55b032217d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4f359e640 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e40390 0x55b032217d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4f359e640 1 -- 172.21.15.92:0/621909639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0322189a0 con 0x55b031e61070 2024-09-21T07:15:06.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4f359e640 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e61070 0x55b032218260 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec01fe00 tx=0x7fa4ec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ea6f927adea873 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4da7fc640 1 -- 172.21.15.92:0/621909639 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec01f0d0 con 0x55b031e61070 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4da7fc640 1 -- 172.21.15.92:0/621909639 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa4ec016030 con 0x55b031e61070 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4ff682740 1 -- 172.21.15.92:0/621909639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4dc0aca70 con 0x55b031e61070 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4da7fc640 1 -- 172.21.15.92:0/621909639 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa4ec01f270 con 0x55b031e61070 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4ff682740 10 client.16290 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.678+0000 7fa4ff682740 1 -- 172.21.15.92:0/621909639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b0322908d0 con 0x55b031e61070 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4da7fc640 1 -- 172.21.15.92:0/621909639 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4dc0aca70 con 0x55b031e61070 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4da7fc640 1 -- 172.21.15.92:0/621909639 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa4ec01d4b0 con 0x55b031e61070 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4ff682740 10 client.16290 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4ff682740 10 client.16290 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4ff682740 20 client.16290 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4ff682740 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b031df4da0 0x55b032293110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:06.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4ff682740 4 client.16290 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4ff682740 1 -- 172.21.15.92:0/621909639 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b03217c8a0 con 0x55b031df4da0 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4f2d9d640 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b031df4da0 0x55b032293110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4da7fc640 10 client.16290 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.679+0000 7fa4f2d9d640 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b031df4da0 0x55b032293110 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=48472c29502fa02 server_cookie=204c061bbd1a7ae0 in_seq=0 out_seq=0 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4da7fc640 1 -- 172.21.15.92:0/621909639 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b03217c8a0 con 0x55b031df4da0 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4da7fc640 10 client.16290 handle_command_reply: tid=0 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 client.16290 shutdown 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 -- 172.21.15.92:0/621909639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e61070 msgr2=0x55b032218260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e61070 0x55b032218260 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec01fe00 tx=0x7fa4ec004ab0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 -- 172.21.15.92:0/621909639 shutdown_connections 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55b031df4da0 0x55b032293110 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b031e61070 0x55b032218260 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b031e40390 0x55b032217d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 --2- 172.21.15.92:0/621909639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b031e381b0 0x55b03221c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 -- 172.21.15.92:0/621909639 >> 172.21.15.92:0/621909639 conn(0x55b031e55460 msgr2=0x55b0322151c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:06.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4da7fc640 0 client.16290 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:15:06.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 -- 172.21.15.92:0/621909639 shutdown_connections 2024-09-21T07:15:06.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 1 -- 172.21.15.92:0/621909639 wait complete. 2024-09-21T07:15:06.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.680+0000 7fa4ff682740 20 client.16290 trim_cache size 0 max 16384 2024-09-21T07:15:06.689 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:15:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 -- 172.21.15.92:0/1143833353 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa4e00b66b0 msgr2=0x7fa4e00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa4e00b66b0 0x7fa4e00b8bc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec007f80 tx=0x7fa4ec007520 comp rx=0 tx=0).stop 2024-09-21T07:15:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 -- 172.21.15.92:0/1143833353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f41094f0 msgr2=0x7fa4f419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f41094f0 0x7fa4f419a9c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00d750 tx=0x7fa4dc00dc10 comp rx=0 tx=0).stop 2024-09-21T07:15:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 -- 172.21.15.92:0/1143833353 shutdown_connections 2024-09-21T07:15:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa4e00b66b0 0x7fa4e00b8bc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4f4109e40 0x7fa4f419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f41094f0 0x7fa4f419a9c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 --2- 172.21.15.92:0/1143833353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4f4103bb0 0x7fa4f419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:06.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 -- 172.21.15.92:0/1143833353 >> 172.21.15.92:0/1143833353 conn(0x7fa4f40ff600 msgr2=0x7fa4f4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:06.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 -- 172.21.15.92:0/1143833353 shutdown_connections 2024-09-21T07:15:06.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:06.681+0000 7fa4f910e640 1 -- 172.21.15.92:0/1143833353 wait complete. 2024-09-21T07:15:06.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:06 smithi092 ceph-mon[30987]: pgmap v400: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 22 MiB/s wr, 33 op/s 2024-09-21T07:15:07.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:06 smithi175 ceph-mon[34064]: pgmap v400: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 22 MiB/s wr, 33 op/s 2024-09-21T07:15:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:06 smithi169 ceph-mon[33705]: pgmap v400: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 22 MiB/s wr, 33 op/s 2024-09-21T07:15:07.490 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:15:07.740 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:08.205 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:15:08.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 -- 172.21.15.92:0/2485213027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b4103c30 msgr2=0x7f36b4104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:08.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 --2- 172.21.15.92:0/2485213027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b4103c30 0x7f36b4104040 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009900 tx=0x7f36a402a410 comp rx=0 tx=0).stop 2024-09-21T07:15:08.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 -- 172.21.15.92:0/2485213027 shutdown_connections 2024-09-21T07:15:08.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 --2- 172.21.15.92:0/2485213027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36b4109ec0 0x7f36b41106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 --2- 172.21.15.92:0/2485213027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4109570 0x7f36b4109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 --2- 172.21.15.92:0/2485213027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b4103c30 0x7f36b4104040 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 -- 172.21.15.92:0/2485213027 >> 172.21.15.92:0/2485213027 conn(0x7f36b407b8d0 msgr2=0x7f36b407bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 -- 172.21.15.92:0/2485213027 shutdown_connections 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 -- 172.21.15.92:0/2485213027 wait complete. 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 Processor -- start 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.260+0000 7f36ba741640 1 -- start start 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36ba741640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4103c30 0x7f36b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36ba741640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b4109570 0x7f36b4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36ba741640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36b4109ec0 0x7f36b4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36ba741640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36b4113990 con 0x7f36b4109570 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36ba741640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36b4113810 con 0x7f36b4109ec0 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36ba741640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36b4113b10 con 0x7f36b4103c30 2024-09-21T07:15:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b4109570 0x7f36b4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b4109570 0x7f36b4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39206/0 (socket says 172.21.15.92:39206) 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b37fe640 1 -- 172.21.15.92:0/380583515 learned_addr learned my addr 172.21.15.92:0/380583515 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b8cde640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36b4109ec0 0x7f36b4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b3fff640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4103c30 0x7f36b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b37fe640 1 -- 172.21.15.92:0/380583515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4103c30 msgr2=0x7f36b4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b37fe640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4103c30 0x7f36b4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b37fe640 1 -- 172.21.15.92:0/380583515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36b4109ec0 msgr2=0x7f36b4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b37fe640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36b4109ec0 0x7f36b4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b37fe640 1 -- 172.21.15.92:0/380583515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b41a86b0 con 0x7f36b4109570 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.261+0000 7f36b8cde640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36b4109ec0 0x7f36b4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.262+0000 7f36b37fe640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b4109570 0x7f36b4075c50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f36a800c8c0 tx=0x7f36a800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.262+0000 7f36b17fa640 1 -- 172.21.15.92:0/380583515 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8007bb0 con 0x7f36b4109570 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.262+0000 7f36ba741640 1 -- 172.21.15.92:0/380583515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b41a89a0 con 0x7f36b4109570 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.262+0000 7f36b17fa640 1 -- 172.21.15.92:0/380583515 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36a8007d50 con 0x7f36b4109570 2024-09-21T07:15:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.262+0000 7f36b17fa640 1 -- 172.21.15.92:0/380583515 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8018660 con 0x7f36b4109570 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.262+0000 7f36ba741640 1 -- 172.21.15.92:0/380583515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b41a8f30 con 0x7f36b4109570 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36c0cb5740 1 Processor -- start 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36c0cb5740 1 -- start start 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36b17fa640 1 -- 172.21.15.92:0/380583515 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f36a800fa00 con 0x7f36b4109570 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 0x5568a570a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a533a1b0 0x5568a570a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5342390 0x5568a570ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568a5680ea0 con 0x5568a533a1b0 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5568a56702d0 con 0x5568a5363070 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5568a56740e0 con 0x5568a5342390 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a533a1b0 0x5568a570a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a533a1b0 0x5568a570a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39216/0 (socket says 172.21.15.92:39216) 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36b3fff640 1 -- 172.21.15.92:0/636182405 learned_addr learned my addr 172.21.15.92:0/636182405 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36b8cde640 1 --2- 172.21.15.92:0/636182405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 0x5568a570a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.265+0000 7f36b37fe640 1 --2- 172.21.15.92:0/636182405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5342390 0x5568a570ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f36b8cde640 1 -- 172.21.15.92:0/636182405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5342390 msgr2=0x5568a570ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f36b8cde640 1 --2- 172.21.15.92:0/636182405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5342390 0x5568a570ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f36b8cde640 1 -- 172.21.15.92:0/636182405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a533a1b0 msgr2=0x5568a570a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f36b8cde640 1 --2- 172.21.15.92:0/636182405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a533a1b0 0x5568a570a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f36b8cde640 1 -- 172.21.15.92:0/636182405 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a53ce650 con 0x5568a5363070 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f36b17fa640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f369c0b6680 0x7f369c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f36b8cde640 1 --2- 172.21.15.92:0/636182405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 0x5568a570a2c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00adc0 tx=0x7f36ac00e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e2ed807521ad42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f36b17fa640 1 -- 172.21.15.92:0/380583515 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f36a80e7c60 con 0x7f36b4109570 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f36b3fff640 1 --2- 172.21.15.92:0/636182405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a533a1b0 0x5568a570a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f369a7fc640 1 -- 172.21.15.92:0/636182405 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac003b70 con 0x5568a5363070 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f369a7fc640 1 -- 172.21.15.92:0/636182405 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36ac003d10 con 0x5568a5363070 2024-09-21T07:15:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f369a7fc640 1 -- 172.21.15.92:0/636182405 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac010960 con 0x5568a5363070 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.266+0000 7f36b3fff640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f369c0b6680 0x7f369c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.267+0000 7f36c0cb5740 1 -- 172.21.15.92:0/636182405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 msgr2=0x5568a570a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.267+0000 7f36b3fff640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f369c0b6680 0x7f369c0b8b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5568a5708f40 tx=0x7f36a4009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.267+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/636182405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 0x5568a570a2c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00adc0 tx=0x7f36ac00e720 comp rx=0 tx=0).stop 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.267+0000 7f36c0cb5740 1 -- 172.21.15.92:0/636182405 shutdown_connections 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.267+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/636182405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5342390 0x5568a570ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.267+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/636182405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a533a1b0 0x5568a570a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.267+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/636182405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 0x5568a570a2c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.267+0000 7f36c0cb5740 1 -- 172.21.15.92:0/636182405 >> 172.21.15.92:0/636182405 conn(0x5568a5357460 msgr2=0x5568a57081b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.267+0000 7f36c0cb5740 1 -- 172.21.15.92:0/636182405 shutdown_connections 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.267+0000 7f36c0cb5740 1 -- 172.21.15.92:0/636182405 wait complete. 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36c0cb5740 1 -- start start 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36c0cb5740 1 Processor -- start 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a533a1b0 0x5568a5715a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5715f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 0x5568a5721dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568a54d1700 con 0x5568a5342390 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5568a560b160 con 0x5568a5363070 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5568a5718aa0 con 0x5568a533a1b0 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36c0cb5740 10 client.0 _ll_register_callbacks cb 0x5568a56249e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5715f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5715f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39224/0 (socket says 172.21.15.92:39224) 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36b37fe640 1 -- 172.21.15.92:0/1585366077 learned_addr learned my addr 172.21.15.92:0/1585366077 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36b8cde640 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 0x5568a5721dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.268+0000 7f36b3fff640 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a533a1b0 0x5568a5715a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36b37fe640 1 -- 172.21.15.92:0/1585366077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a533a1b0 msgr2=0x5568a5715a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36b37fe640 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a533a1b0 0x5568a5715a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36b37fe640 1 -- 172.21.15.92:0/1585366077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 msgr2=0x5568a5721dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36b37fe640 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 0x5568a5721dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36b37fe640 1 -- 172.21.15.92:0/1585366077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568a5638c90 con 0x5568a5342390 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36b37fe640 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5715f80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f36a80e5070 tx=0x7f36a801f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8082567257eba250 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36937fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36937fe640 1 -- 172.21.15.92:0/1585366077 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a80a9d60 con 0x5568a5342390 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36937fe640 1 -- 172.21.15.92:0/1585366077 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f36a80a9060 con 0x5568a5342390 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36c0cb5740 1 -- 172.21.15.92:0/1585366077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36ac003d10 con 0x5568a5342390 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36937fe640 1 -- 172.21.15.92:0/1585366077 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36a80ace80 con 0x5568a5342390 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36c0cb5740 10 client.16302 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36c0cb5740 1 -- 172.21.15.92:0/1585366077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5568a5724850 con 0x5568a5342390 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.269+0000 7f36937fe640 1 -- 172.21.15.92:0/1585366077 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36ac003d10 con 0x5568a5342390 2024-09-21T07:15:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.270+0000 7f36937fe640 1 -- 172.21.15.92:0/1585366077 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f36a80a9260 con 0x5568a5342390 2024-09-21T07:15:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.270+0000 7f36c0cb5740 10 client.16302 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.270+0000 7f36c0cb5740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.270+0000 7f36c0cb5740 20 client.16302 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.270+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568a53219f0 0x5568a5727d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.270+0000 7f36c0cb5740 4 client.16302 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.270+0000 7f36c0cb5740 1 -- 172.21.15.92:0/1585366077 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568a5682df0 con 0x5568a53219f0 2024-09-21T07:15:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.270+0000 7f36b3fff640 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568a53219f0 0x5568a5727d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.270+0000 7f36937fe640 10 client.16302 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.270+0000 7f36b3fff640 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568a53219f0 0x5568a5727d20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81882bfb1fe077f7 server_cookie=f827db2220abd028 in_seq=0 out_seq=0 2024-09-21T07:15:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36937fe640 1 -- 172.21.15.92:0/1585366077 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568a5682df0 con 0x5568a53219f0 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36937fe640 10 client.16302 handle_command_reply: tid=0 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36c0cb5740 1 client.16302 shutdown 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36c0cb5740 1 -- 172.21.15.92:0/1585366077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 msgr2=0x5568a5715f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5715f80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f36a80e5070 tx=0x7f36a801f640 comp rx=0 tx=0).stop 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36c0cb5740 1 -- 172.21.15.92:0/1585366077 shutdown_connections 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568a53219f0 0x5568a5727d20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a5363070 0x5568a5721dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36937fe640 0 client.16302 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5715f80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/1585366077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a533a1b0 0x5568a5715a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36c0cb5740 1 -- 172.21.15.92:0/1585366077 >> 172.21.15.92:0/1585366077 conn(0x5568a5357460 msgr2=0x5568a570d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.271+0000 7f36c0cb5740 1 -- 172.21.15.92:0/1585366077 shutdown_connections 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.272+0000 7f36c0cb5740 1 -- 172.21.15.92:0/1585366077 wait complete. 2024-09-21T07:15:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.272+0000 7f36c0cb5740 20 client.16302 trim_cache size 0 max 16384 2024-09-21T07:15:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.285+0000 7f36c0cb5740 1 Processor -- start 2024-09-21T07:15:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.285+0000 7f36c0cb5740 1 -- start start 2024-09-21T07:15:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.285+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a533a1b0 0x5568a570dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.285+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5721cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.285+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 0x5568a5707b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.285+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41b30f0 con 0x5568a5342390 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.285+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41b4c30 con 0x5568a533a1b0 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.285+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41b37c0 con 0x5568a5363070 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5721cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5721cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39238/0 (socket says 172.21.15.92:39238) 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b37fe640 1 -- 172.21.15.92:0/3978444606 learned_addr learned my addr 172.21.15.92:0/3978444606 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b8cde640 1 --2- 172.21.15.92:0/3978444606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 0x5568a5707b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b3fff640 1 --2- 172.21.15.92:0/3978444606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a533a1b0 0x5568a570dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b37fe640 1 -- 172.21.15.92:0/3978444606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 msgr2=0x5568a5707b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b37fe640 1 --2- 172.21.15.92:0/3978444606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 0x5568a5707b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b37fe640 1 -- 172.21.15.92:0/3978444606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a533a1b0 msgr2=0x5568a570dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b37fe640 1 --2- 172.21.15.92:0/3978444606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a533a1b0 0x5568a570dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b37fe640 1 -- 172.21.15.92:0/3978444606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a570c5b0 con 0x5568a5342390 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f36b37fe640 1 --2- 172.21.15.92:0/3978444606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5721cc0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f36a801f000 tx=0x7f36a80eb860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb4ef5beccd1af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f3699ffb640 1 -- 172.21.15.92:0/3978444606 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a80ea070 con 0x5568a5342390 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f3699ffb640 1 -- 172.21.15.92:0/3978444606 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36a8094e50 con 0x5568a5342390 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.286+0000 7f3699ffb640 1 -- 172.21.15.92:0/3978444606 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a80ad060 con 0x5568a5342390 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.287+0000 7f36c0cb5740 1 -- 172.21.15.92:0/3978444606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 msgr2=0x5568a5721cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.287+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/3978444606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5721cc0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f36a801f000 tx=0x7f36a80eb860 comp rx=0 tx=0).stop 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.287+0000 7f36c0cb5740 1 -- 172.21.15.92:0/3978444606 shutdown_connections 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.287+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/3978444606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 0x5568a5707b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.287+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/3978444606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a5721cc0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.287+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/3978444606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a533a1b0 0x5568a570dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.287+0000 7f36c0cb5740 1 -- 172.21.15.92:0/3978444606 >> 172.21.15.92:0/3978444606 conn(0x5568a5357460 msgr2=0x5568a570d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.287+0000 7f36c0cb5740 1 -- 172.21.15.92:0/3978444606 shutdown_connections 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.287+0000 7f36c0cb5740 1 -- 172.21.15.92:0/3978444606 wait complete. 2024-09-21T07:15:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36c0cb5740 1 -- start start 2024-09-21T07:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36c0cb5740 1 Processor -- start 2024-09-21T07:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a533a1b0 0x5568a5719cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a571a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36c0cb5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 0x5568a571a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41b4560 con 0x5568a5342390 2024-09-21T07:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41b3e90 con 0x5568a533a1b0 2024-09-21T07:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36c0cb5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41b10d0 con 0x5568a5363070 2024-09-21T07:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36c0cb5740 10 client.0 _ll_register_callbacks cb 0x7f36a800c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a571a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.288+0000 7f36b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a571a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39254/0 (socket says 172.21.15.92:39254) 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36b37fe640 1 -- 172.21.15.92:0/134185029 learned_addr learned my addr 172.21.15.92:0/134185029 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36b3fff640 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a533a1b0 0x5568a5719cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36b8cde640 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 0x5568a571a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36b37fe640 1 -- 172.21.15.92:0/134185029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 msgr2=0x5568a571a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36b37fe640 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 0x5568a571a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36b37fe640 1 -- 172.21.15.92:0/134185029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a533a1b0 msgr2=0x5568a5719cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36b37fe640 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a533a1b0 0x5568a5719cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36b37fe640 1 -- 172.21.15.92:0/134185029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568a57916a0 con 0x5568a5342390 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36b8cde640 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 0x5568a571a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36b37fe640 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a571a200 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f36a80eb330 tx=0x7f36a80eb610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70a35a3426946c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36937fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36937fe640 1 -- 172.21.15.92:0/134185029 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a80c7020 con 0x5568a5342390 2024-09-21T07:15:08.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36937fe640 1 -- 172.21.15.92:0/134185029 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f36a80a9260 con 0x5568a5342390 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36c0cb5740 1 -- 172.21.15.92:0/134185029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a8094e50 con 0x5568a5342390 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36937fe640 1 -- 172.21.15.92:0/134185029 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36a80ea050 con 0x5568a5342390 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36c0cb5740 10 client.16308 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.289+0000 7f36c0cb5740 1 -- 172.21.15.92:0/134185029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5568a57928f0 con 0x5568a5342390 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.290+0000 7f36937fe640 1 -- 172.21.15.92:0/134185029 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36a8094e50 con 0x5568a5342390 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.290+0000 7f36937fe640 1 -- 172.21.15.92:0/134185029 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f36a80b6670 con 0x5568a5342390 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.290+0000 7f36c0cb5740 10 client.16308 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.290+0000 7f36c0cb5740 10 client.16308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.290+0000 7f36c0cb5740 20 client.16308 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.290+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568a52f6da0 0x5568a5794e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:08.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.290+0000 7f36c0cb5740 4 client.16308 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.290+0000 7f36c0cb5740 1 -- 172.21.15.92:0/134185029 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5568a567e8a0 con 0x5568a52f6da0 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.290+0000 7f36b3fff640 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568a52f6da0 0x5568a5794e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36937fe640 10 client.16308 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36b3fff640 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568a52f6da0 0x5568a5794e10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e22cd13550065274 server_cookie=18c471c42f00cb5c in_seq=0 out_seq=0 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36937fe640 1 -- 172.21.15.92:0/134185029 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5568a567e8a0 con 0x5568a52f6da0 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36937fe640 10 client.16308 handle_command_reply: tid=0 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 client.16308 shutdown 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 -- 172.21.15.92:0/134185029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 msgr2=0x5568a571a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a571a200 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f36a80eb330 tx=0x7f36a80eb610 comp rx=0 tx=0).stop 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 -- 172.21.15.92:0/134185029 shutdown_connections 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568a52f6da0 0x5568a5794e10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568a5363070 0x5568a571a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5342390 0x5568a571a200 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 --2- 172.21.15.92:0/134185029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568a533a1b0 0x5568a5719cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 -- 172.21.15.92:0/134185029 >> 172.21.15.92:0/134185029 conn(0x5568a5357460 msgr2=0x5568a5707ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36937fe640 0 client.16308 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 -- 172.21.15.92:0/134185029 shutdown_connections 2024-09-21T07:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 1 -- 172.21.15.92:0/134185029 wait complete. 2024-09-21T07:15:08.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.291+0000 7f36c0cb5740 20 client.16308 trim_cache size 0 max 16384 2024-09-21T07:15:08.299 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 -- 172.21.15.92:0/380583515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f369c0b6680 msgr2=0x7f369c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f369c0b6680 0x7f369c0b8b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5568a5708f40 tx=0x7f36a4009680 comp rx=0 tx=0).stop 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 -- 172.21.15.92:0/380583515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b4109570 msgr2=0x7f36b4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b4109570 0x7f36b4075c50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f36a800c8c0 tx=0x7f36a800cd80 comp rx=0 tx=0).stop 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 -- 172.21.15.92:0/380583515 shutdown_connections 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f369c0b6680 0x7f369c0b8b90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36b4109ec0 0x7f36b4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b4109570 0x7f36b4075c50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 --2- 172.21.15.92:0/380583515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4103c30 0x7f36b4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 -- 172.21.15.92:0/380583515 >> 172.21.15.92:0/380583515 conn(0x7f36b407b8d0 msgr2=0x7f36b4107760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:08.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 -- 172.21.15.92:0/380583515 shutdown_connections 2024-09-21T07:15:08.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:08.292+0000 7f36ba741640 1 -- 172.21.15.92:0/380583515 wait complete. 2024-09-21T07:15:09.010 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:08 smithi092 ceph-mon[30987]: pgmap v401: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 29 op/s 2024-09-21T07:15:09.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:08 smithi175 ceph-mon[34064]: pgmap v401: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 29 op/s 2024-09-21T07:15:09.099 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:09.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:08 smithi169 ceph-mon[33705]: pgmap v401: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 29 op/s 2024-09-21T07:15:09.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 -- 172.21.15.92:0/1004260426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2a8109df0 msgr2=0x7fa2a8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:09.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 --2- 172.21.15.92:0/1004260426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2a8109df0 0x7fa2a8110620 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009ca0 tx=0x7fa2a002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:15:09.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 -- 172.21.15.92:0/1004260426 shutdown_connections 2024-09-21T07:15:09.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 --2- 172.21.15.92:0/1004260426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2a8109df0 0x7fa2a8110620 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:09.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 --2- 172.21.15.92:0/1004260426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a81094a0 0x7fa2a81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:09.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 --2- 172.21.15.92:0/1004260426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a8103b60 0x7fa2a8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:09.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 -- 172.21.15.92:0/1004260426 >> 172.21.15.92:0/1004260426 conn(0x7fa2a807b850 msgr2=0x7fa2a807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 -- 172.21.15.92:0/1004260426 shutdown_connections 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 -- 172.21.15.92:0/1004260426 wait complete. 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 Processor -- start 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.601+0000 7fa2ae659640 1 -- start start 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2ae659640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a8103b60 0x7fa2a819c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2ae659640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a81094a0 0x7fa2a819cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2ae659640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2a8109df0 0x7fa2a81a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2ae659640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a81139b0 con 0x7fa2a8109df0 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2ae659640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a8113830 con 0x7fa2a81094a0 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2ae659640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a8113b30 con 0x7fa2a8103b60 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2acbf6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2a8109df0 0x7fa2a81a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2acbf6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2a8109df0 0x7fa2a81a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39272/0 (socket says 172.21.15.92:39272) 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2acbf6640 1 -- 172.21.15.92:0/4150188536 learned_addr learned my addr 172.21.15.92:0/4150188536 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2acbf6640 1 -- 172.21.15.92:0/4150188536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a8103b60 msgr2=0x7fa2a819c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2a7fff640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a8103b60 0x7fa2a819c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2acbf6640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a8103b60 0x7fa2a819c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2acbf6640 1 -- 172.21.15.92:0/4150188536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a81094a0 msgr2=0x7fa2a819cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2acbf6640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a81094a0 0x7fa2a819cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2acbf6640 1 -- 172.21.15.92:0/4150188536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a81a24b0 con 0x7fa2a8109df0 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.602+0000 7fa2acbf6640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2a8109df0 0x7fa2a81a1d80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0005cc0 tx=0x7fa2a0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.603+0000 7fa2a57fa640 1 -- 172.21.15.92:0/4150188536 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0032e00 con 0x7fa2a8109df0 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.603+0000 7fa2a57fa640 1 -- 172.21.15.92:0/4150188536 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2a00044d0 con 0x7fa2a8109df0 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.603+0000 7fa2ae659640 1 -- 172.21.15.92:0/4150188536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a81a2740 con 0x7fa2a8109df0 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.603+0000 7fa2a57fa640 1 -- 172.21.15.92:0/4150188536 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0030b70 con 0x7fa2a8109df0 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.603+0000 7fa2ae659640 1 -- 172.21.15.92:0/4150188536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a81a8f00 con 0x7fa2a8109df0 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.604+0000 7fa2ae659640 1 -- 172.21.15.92:0/4150188536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a8103f70 con 0x7fa2a8109df0 2024-09-21T07:15:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.605+0000 7fa2a57fa640 1 -- 172.21.15.92:0/4150188536 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fa2a0030d10 con 0x7fa2a8109df0 2024-09-21T07:15:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.606+0000 7fa2a57fa640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2900b6680 0x7fa2900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.606+0000 7fa2a7fff640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2900b6680 0x7fa2900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.606+0000 7fa2a57fa640 1 -- 172.21.15.92:0/4150188536 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa2a0108fc0 con 0x7fa2a8109df0 2024-09-21T07:15:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.607+0000 7fa2a7fff640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2900b6680 0x7fa2900b8b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa298005fd0 tx=0x7fa298005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.609+0000 7fa2a57fa640 1 -- 172.21.15.92:0/4150188536 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa2a00cf170 con 0x7fa2a8109df0 2024-09-21T07:15:09.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.823+0000 7fa2ae659640 1 -- 172.21.15.92:0/4150188536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2a81a91a0 con 0x7fa2a8109df0 2024-09-21T07:15:09.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.823+0000 7fa2a57fa640 1 -- 172.21.15.92:0/4150188536 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7fa2a00d3550 con 0x7fa2a8109df0 2024-09-21T07:15:09.826 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:15:09.826 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:15:09.826 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:15:09.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.825+0000 7fa2ae659640 1 -- 172.21.15.92:0/4150188536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2900b6680 msgr2=0x7fa2900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:09.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.825+0000 7fa2ae659640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2900b6680 0x7fa2900b8b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa298005fd0 tx=0x7fa298005c70 comp rx=0 tx=0).stop 2024-09-21T07:15:09.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.825+0000 7fa2ae659640 1 -- 172.21.15.92:0/4150188536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2a8109df0 msgr2=0x7fa2a81a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:09.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.825+0000 7fa2ae659640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2a8109df0 0x7fa2a81a1d80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0005cc0 tx=0x7fa2a0032a10 comp rx=0 tx=0).stop 2024-09-21T07:15:09.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.826+0000 7fa2ae659640 1 -- 172.21.15.92:0/4150188536 shutdown_connections 2024-09-21T07:15:09.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.826+0000 7fa2ae659640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2900b6680 0x7fa2900b8b90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:09.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.826+0000 7fa2ae659640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2a8109df0 0x7fa2a81a1d80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:09.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.826+0000 7fa2ae659640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2a81094a0 0x7fa2a819cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:09.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.826+0000 7fa2ae659640 1 --2- 172.21.15.92:0/4150188536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a8103b60 0x7fa2a819c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:09.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.826+0000 7fa2ae659640 1 -- 172.21.15.92:0/4150188536 >> 172.21.15.92:0/4150188536 conn(0x7fa2a807b850 msgr2=0x7fa2a81072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:09.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.826+0000 7fa2ae659640 1 -- 172.21.15.92:0/4150188536 shutdown_connections 2024-09-21T07:15:09.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:09.826+0000 7fa2ae659640 1 -- 172.21.15.92:0/4150188536 wait complete. 2024-09-21T07:15:10.037 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:15:10.038 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:15:10.528 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24649 quiesce db --set-id 8460e8a9 --release --await' 2024-09-21T07:15:10.529 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24649 quiesce db --set-id 8460e8a9 --release --await 2024-09-21T07:15:10.626 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:10.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:10 smithi092 ceph-mon[30987]: pgmap v402: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.2 MiB/s wr, 31 op/s 2024-09-21T07:15:10.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:10 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4150188536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:10 smithi175 ceph-mon[34064]: pgmap v402: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.2 MiB/s wr, 31 op/s 2024-09-21T07:15:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:10 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/4150188536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:11.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:10 smithi169 ceph-mon[33705]: pgmap v402: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.2 MiB/s wr, 31 op/s 2024-09-21T07:15:11.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:10 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/4150188536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:11.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.147+0000 7f794eb81640 1 -- 172.21.15.92:0/3058293601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7948105220 msgr2=0x7f7948105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:11.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.147+0000 7f794eb81640 1 --2- 172.21.15.92:0/3058293601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7948105220 0x7f7948105630 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7934009900 tx=0x7f793402a410 comp rx=0 tx=0).stop 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.147+0000 7f794eb81640 1 -- 172.21.15.92:0/3058293601 shutdown_connections 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.147+0000 7f794eb81640 1 --2- 172.21.15.92:0/3058293601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7948105b70 0x7f794810f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.147+0000 7f794eb81640 1 --2- 172.21.15.92:0/3058293601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7948105220 0x7f7948105630 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.147+0000 7f794eb81640 1 --2- 172.21.15.92:0/3058293601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7948103210 0x7f7948103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.147+0000 7f794eb81640 1 -- 172.21.15.92:0/3058293601 >> 172.21.15.92:0/3058293601 conn(0x7f7948079ec0 msgr2=0x7f794807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.148+0000 7f794eb81640 1 -- 172.21.15.92:0/3058293601 shutdown_connections 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.148+0000 7f794eb81640 1 -- 172.21.15.92:0/3058293601 wait complete. 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.148+0000 7f794eb81640 1 Processor -- start 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.148+0000 7f794eb81640 1 -- start start 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.148+0000 7f794eb81640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7948103210 0x7f794819b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.148+0000 7f794eb81640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7948105220 0x7f794819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794eb81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7948105b70 0x7f794819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794eb81640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f79481129c0 con 0x7f7948105b70 2024-09-21T07:15:11.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794eb81640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7948112840 con 0x7f7948105220 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794eb81640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7948112b40 con 0x7f7948103210 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794d11e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7948105b70 0x7f794819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794d11e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7948105b70 0x7f794819bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36542/0 (socket says 172.21.15.92:36542) 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794d11e640 1 -- 172.21.15.92:0/3090132014 learned_addr learned my addr 172.21.15.92:0/3090132014 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794c91d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7948103210 0x7f794819b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f7947fff640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7948105220 0x7f794819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794d11e640 1 -- 172.21.15.92:0/3090132014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7948103210 msgr2=0x7f794819b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794d11e640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7948103210 0x7f794819b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794d11e640 1 -- 172.21.15.92:0/3090132014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7948105220 msgr2=0x7f794819b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794d11e640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7948105220 0x7f794819b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794d11e640 1 -- 172.21.15.92:0/3090132014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79481a65e0 con 0x7f7948105b70 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794d11e640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7948105b70 0x7f794819bdd0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f794000b970 tx=0x7f794000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f7945ffb640 1 -- 172.21.15.92:0/3090132014 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940019070 con 0x7f7948105b70 2024-09-21T07:15:11.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f794eb81640 1 -- 172.21.15.92:0/3090132014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79481a68d0 con 0x7f7948105b70 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f7945ffb640 1 -- 172.21.15.92:0/3090132014 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7940014440 con 0x7f7948105b70 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.149+0000 7f7945ffb640 1 -- 172.21.15.92:0/3090132014 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79400075d0 con 0x7f7948105b70 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.150+0000 7f794eb81640 1 -- 172.21.15.92:0/3090132014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79481a6e10 con 0x7f7948105b70 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.152+0000 7f79550f5740 1 Processor -- start 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.152+0000 7f7945ffb640 1 -- 172.21.15.92:0/3090132014 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f794001c070 con 0x7f7948105b70 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.152+0000 7f79550f5740 1 -- start start 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f79550f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 0x556c47997430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f79550f5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475c7490 0x556c47997970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f79550f5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c47997eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f79550f5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c4790de60 con 0x556c475c7490 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f79550f5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556c478fd290 con 0x556c475cf670 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f79550f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556c479010a0 con 0x556c475f0350 2024-09-21T07:15:11.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f794c91d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475c7490 0x556c47997970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f794c91d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475c7490 0x556c47997970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36544/0 (socket says 172.21.15.92:36544) 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f794c91d640 1 -- 172.21.15.92:0/1384305755 learned_addr learned my addr 172.21.15.92:0/1384305755 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f7947fff640 1 --2- 172.21.15.92:0/1384305755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 0x556c47997430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f7947fff640 1 --2- 172.21.15.92:0/1384305755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c47997eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f794c91d640 1 -- 172.21.15.92:0/1384305755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 msgr2=0x556c47997430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f794c91d640 1 --2- 172.21.15.92:0/1384305755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 0x556c47997430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f794c91d640 1 -- 172.21.15.92:0/1384305755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 msgr2=0x556c47997eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f794c91d640 1 --2- 172.21.15.92:0/1384305755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c47997eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f794c91d640 1 -- 172.21.15.92:0/1384305755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c4765b930 con 0x556c475c7490 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f7947fff640 1 --2- 172.21.15.92:0/1384305755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 0x556c47997430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f7945ffb640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79380b66b0 0x7f79380b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f794c91d640 1 --2- 172.21.15.92:0/1384305755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475c7490 0x556c47997970 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f793c009a40 tx=0x7f793c009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967dddcae8e36397 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f7947fff640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79380b66b0 0x7f79380b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f7945ffb640 1 -- 172.21.15.92:0/3090132014 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f79400e6eb0 con 0x7f7948105b70 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.153+0000 7f7932ffd640 1 -- 172.21.15.92:0/1384305755 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c017070 con 0x556c475c7490 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.154+0000 7f7932ffd640 1 -- 172.21.15.92:0/1384305755 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f793c013470 con 0x556c475c7490 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.154+0000 7f7932ffd640 1 -- 172.21.15.92:0/1384305755 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c012630 con 0x556c475c7490 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.154+0000 7f79550f5740 1 -- 172.21.15.92:0/1384305755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475c7490 msgr2=0x556c47997970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.154+0000 7f7947fff640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79380b66b0 0x7f79380b8bc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7934005940 tx=0x7f79340058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.154+0000 7f79550f5740 1 --2- 172.21.15.92:0/1384305755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475c7490 0x556c47997970 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f793c009a40 tx=0x7f793c009f00 comp rx=0 tx=0).stop 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 -- 172.21.15.92:0/1384305755 shutdown_connections 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 --2- 172.21.15.92:0/1384305755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c47997eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 --2- 172.21.15.92:0/1384305755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475c7490 0x556c47997970 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 --2- 172.21.15.92:0/1384305755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 0x556c47997430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 -- 172.21.15.92:0/1384305755 >> 172.21.15.92:0/1384305755 conn(0x556c475e4740 msgr2=0x556c47995320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:11.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 -- 172.21.15.92:0/1384305755 shutdown_connections 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 -- 172.21.15.92:0/1384305755 wait complete. 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 -- start start 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 Processor -- start 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475c7490 0x556c479a7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475cf670 0x556c479a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 0x556c479b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c4775e890 con 0x556c475cf670 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556c47897d40 con 0x556c475c7490 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.155+0000 7f79550f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556c479a9f70 con 0x556c475f0350 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f79550f5740 10 client.0 _ll_register_callbacks cb 0x556c478fbc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7947fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475cf670 0x556c479a78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f794c91d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475c7490 0x556c479a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7947fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475cf670 0x556c479a78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36546/0 (socket says 172.21.15.92:36546) 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7947fff640 1 -- 172.21.15.92:0/526535341 learned_addr learned my addr 172.21.15.92:0/526535341 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f794d11e640 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 0x556c479b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7947fff640 1 -- 172.21.15.92:0/526535341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 msgr2=0x556c479b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7947fff640 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 0x556c479b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7947fff640 1 -- 172.21.15.92:0/526535341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475c7490 msgr2=0x556c479a7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7947fff640 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475c7490 0x556c479a7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7947fff640 1 -- 172.21.15.92:0/526535341 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c479b3810 con 0x556c475cf670 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f794d11e640 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 0x556c479b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f794c91d640 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475c7490 0x556c479a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7947fff640 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475cf670 0x556c479a78c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7934000c00 tx=0x7f7934005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fa5dd042622f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7927fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:11.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7927fff640 1 -- 172.21.15.92:0/526535341 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934035040 con 0x556c475cf670 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f79550f5740 1 -- 172.21.15.92:0/526535341 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f793c013470 con 0x556c475cf670 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.156+0000 7f7927fff640 1 -- 172.21.15.92:0/526535341 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f79340035f0 con 0x556c475cf670 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f7927fff640 1 -- 172.21.15.92:0/526535341 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f79340044d0 con 0x556c475cf670 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f79550f5740 10 client.16326 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f79550f5740 1 -- 172.21.15.92:0/526535341 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556c479b6110 con 0x556c475cf670 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f7927fff640 1 -- 172.21.15.92:0/526535341 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f793c013470 con 0x556c475cf670 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f7927fff640 1 -- 172.21.15.92:0/526535341 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7934053900 con 0x556c475cf670 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f79550f5740 10 client.16326 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f79550f5740 10 client.16326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f79550f5740 20 client.16326 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f79550f5740 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556c475aecd0 0x556c479b9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f79550f5740 4 client.16326 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f79550f5740 1 -- 172.21.15.92:0/526535341 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c4790fdb0 con 0x556c475aecd0 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.157+0000 7f794c91d640 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556c475aecd0 0x556c479b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.158+0000 7f7927fff640 10 client.16326 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.158+0000 7f794c91d640 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556c475aecd0 0x556c479b9640 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b01b9f850aa5919 server_cookie=17eab9d406f3591 in_seq=0 out_seq=0 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f7927fff640 1 -- 172.21.15.92:0/526535341 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c4790fdb0 con 0x556c475aecd0 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f7927fff640 10 client.16326 handle_command_reply: tid=0 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 client.16326 shutdown 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 -- 172.21.15.92:0/526535341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475cf670 msgr2=0x556c479a78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475cf670 0x556c479a78c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7934000c00 tx=0x7f7934005fd0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 -- 172.21.15.92:0/526535341 shutdown_connections 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556c475aecd0 0x556c479b9640 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475f0350 0x556c479b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f7927fff640 0 client.16326 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:11.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475cf670 0x556c479a78c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 --2- 172.21.15.92:0/526535341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475c7490 0x556c479a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 -- 172.21.15.92:0/526535341 >> 172.21.15.92:0/526535341 conn(0x556c475e4740 msgr2=0x556c47998e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:11.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 -- 172.21.15.92:0/526535341 shutdown_connections 2024-09-21T07:15:11.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 1 -- 172.21.15.92:0/526535341 wait complete. 2024-09-21T07:15:11.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.159+0000 7f79550f5740 20 client.16326 trim_cache size 0 max 16384 2024-09-21T07:15:11.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.177+0000 7f79550f5740 1 Processor -- start 2024-09-21T07:15:11.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.177+0000 7f79550f5740 1 -- start start 2024-09-21T07:15:11.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f79550f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 0x556c479b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f79550f5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c479a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f79550f5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c479a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f79550f5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f79481aed10 con 0x556c475f0350 2024-09-21T07:15:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f79550f5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f79481b0850 con 0x556c475cf670 2024-09-21T07:15:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f79550f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79481af3e0 con 0x556c475c7490 2024-09-21T07:15:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f794d11e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c479a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f794d11e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c479a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36548/0 (socket says 172.21.15.92:36548) 2024-09-21T07:15:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f794d11e640 1 -- 172.21.15.92:0/3541838035 learned_addr learned my addr 172.21.15.92:0/3541838035 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f794c91d640 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 0x556c479b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f7947fff640 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c479a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f794d11e640 1 -- 172.21.15.92:0/3541838035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 msgr2=0x556c479b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f794d11e640 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 0x556c479b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f794d11e640 1 -- 172.21.15.92:0/3541838035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 msgr2=0x556c479a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f794d11e640 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c479a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f794d11e640 1 -- 172.21.15.92:0/3541838035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c479909e0 con 0x556c475f0350 2024-09-21T07:15:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f794c91d640 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 0x556c479b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.178+0000 7f7947fff640 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c479a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.179+0000 7f794d11e640 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c479a5f40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f79400ac710 tx=0x7f79400ac240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526a1c559f2d4c59 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.179+0000 7f79327fc640 1 -- 172.21.15.92:0/3541838035 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79400b1440 con 0x556c475f0350 2024-09-21T07:15:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.179+0000 7f79327fc640 1 -- 172.21.15.92:0/3541838035 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79400b6380 con 0x556c475f0350 2024-09-21T07:15:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.179+0000 7f79327fc640 1 -- 172.21.15.92:0/3541838035 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79400abc70 con 0x556c475f0350 2024-09-21T07:15:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 -- 172.21.15.92:0/3541838035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 msgr2=0x556c479a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c479a5f40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f79400ac710 tx=0x7f79400ac240 comp rx=0 tx=0).stop 2024-09-21T07:15:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 -- 172.21.15.92:0/3541838035 shutdown_connections 2024-09-21T07:15:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c479a5f40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c479a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 --2- 172.21.15.92:0/3541838035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 0x556c479b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 -- 172.21.15.92:0/3541838035 >> 172.21.15.92:0/3541838035 conn(0x556c475e4740 msgr2=0x556c479a22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 -- 172.21.15.92:0/3541838035 shutdown_connections 2024-09-21T07:15:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 -- 172.21.15.92:0/3541838035 wait complete. 2024-09-21T07:15:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 -- start start 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.180+0000 7f79550f5740 1 Processor -- start 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f79550f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 0x556c479abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f79550f5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c479ac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f79550f5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c47a1d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f79550f5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f79481b0180 con 0x556c475f0350 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f79550f5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f79481afab0 con 0x556c475cf670 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f79550f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79481accf0 con 0x556c475c7490 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f79550f5740 10 client.0 _ll_register_callbacks cb 0x7f7934031d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f794d11e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c47a1d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f794d11e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c47a1d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36554/0 (socket says 172.21.15.92:36554) 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f794d11e640 1 -- 172.21.15.92:0/1189611011 learned_addr learned my addr 172.21.15.92:0/1189611011 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f7947fff640 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c479ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f794c91d640 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 0x556c479abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f794d11e640 1 -- 172.21.15.92:0/1189611011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 msgr2=0x556c479abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.181+0000 7f794d11e640 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 0x556c479abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f794d11e640 1 -- 172.21.15.92:0/1189611011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 msgr2=0x556c479ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f794d11e640 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c479ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f794d11e640 1 -- 172.21.15.92:0/1189611011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c47a1d840 con 0x556c475f0350 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f794d11e640 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c47a1d1d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f794000bfd0 tx=0x7f79400e4710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2147655327e2f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f7927fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f7927fff640 1 -- 172.21.15.92:0/1189611011 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940014930 con 0x556c475f0350 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f7927fff640 1 -- 172.21.15.92:0/1189611011 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f79400abc70 con 0x556c475f0350 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f79550f5740 1 -- 172.21.15.92:0/1189611011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79400b6380 con 0x556c475f0350 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f7927fff640 1 -- 172.21.15.92:0/1189611011 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7940014ad0 con 0x556c475f0350 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f79550f5740 10 client.16332 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f79550f5740 1 -- 172.21.15.92:0/1189611011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556c47a24c70 con 0x556c475f0350 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.182+0000 7f7927fff640 1 -- 172.21.15.92:0/1189611011 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79400b6380 con 0x556c475f0350 2024-09-21T07:15:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.183+0000 7f7927fff640 1 -- 172.21.15.92:0/1189611011 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f79400c2cd0 con 0x556c475f0350 2024-09-21T07:15:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.183+0000 7f79550f5740 10 client.16332 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.183+0000 7f79550f5740 10 client.16332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.183+0000 7f79550f5740 20 client.16332 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.183+0000 7f79550f5740 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556c47584080 0x556c47a272a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.183+0000 7f79550f5740 4 client.16332 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:15:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.183+0000 7f79550f5740 1 -- 172.21.15.92:0/1189611011 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556c4790b860 con 0x556c47584080 2024-09-21T07:15:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.183+0000 7f794c91d640 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556c47584080 0x556c47a272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.184+0000 7f7927fff640 10 client.16332 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.184+0000 7f794c91d640 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556c47584080 0x556c47a272a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d2a41418d9e0fd6 server_cookie=de64f04ef0295872 in_seq=0 out_seq=0 2024-09-21T07:15:11.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.185+0000 7f7927fff640 1 -- 172.21.15.92:0/1189611011 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556c4790b860 con 0x556c47584080 2024-09-21T07:15:11.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.185+0000 7f7927fff640 10 client.16332 handle_command_reply: tid=0 2024-09-21T07:15:11.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.185+0000 7f79550f5740 1 client.16332 shutdown 2024-09-21T07:15:11.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 1 -- 172.21.15.92:0/1189611011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 msgr2=0x556c47a1d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:11.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c47a1d1d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f794000bfd0 tx=0x7f79400e4710 comp rx=0 tx=0).stop 2024-09-21T07:15:11.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 1 -- 172.21.15.92:0/1189611011 shutdown_connections 2024-09-21T07:15:11.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556c47584080 0x556c47a272a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c475f0350 0x556c47a1d1d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556c475cf670 0x556c479ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f7927fff640 0 client.16332 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:11.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 1 --2- 172.21.15.92:0/1189611011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c475c7490 0x556c479abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 1 -- 172.21.15.92:0/1189611011 >> 172.21.15.92:0/1189611011 conn(0x556c475e4740 msgr2=0x556c479a5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:11.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 1 -- 172.21.15.92:0/1189611011 shutdown_connections 2024-09-21T07:15:11.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 1 -- 172.21.15.92:0/1189611011 wait complete. 2024-09-21T07:15:11.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.186+0000 7f79550f5740 20 client.16332 trim_cache size 0 max 16384 2024-09-21T07:15:11.195 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:15:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:15:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "c9198dd4-042b-40fb-8657-b26652eb8d60", 2024-09-21T07:15:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:15:11.196 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:15:11.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 -- 172.21.15.92:0/3090132014 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79380b66b0 msgr2=0x7f79380b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:11.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79380b66b0 0x7f79380b8bc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7934005940 tx=0x7f79340058d0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 -- 172.21.15.92:0/3090132014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7948105b70 msgr2=0x7f794819bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:11.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7948105b70 0x7f794819bdd0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f794000b970 tx=0x7f794000bd70 comp rx=0 tx=0).stop 2024-09-21T07:15:11.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 -- 172.21.15.92:0/3090132014 shutdown_connections 2024-09-21T07:15:11.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79380b66b0 0x7f79380b8bc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7948105b70 0x7f794819bdd0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7948105220 0x7f794819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 --2- 172.21.15.92:0/3090132014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7948103210 0x7f794819b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:11.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 -- 172.21.15.92:0/3090132014 >> 172.21.15.92:0/3090132014 conn(0x7f7948079ec0 msgr2=0x7f79481065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:11.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 -- 172.21.15.92:0/3090132014 shutdown_connections 2024-09-21T07:15:11.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:11.187+0000 7f794eb81640 1 -- 172.21.15.92:0/3090132014 wait complete. 2024-09-21T07:15:11.438 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:11.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:15:12.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.457+0000 7f11b6d54640 1 -- 172.21.15.92:0/4197336667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b010de30 msgr2=0x7f11b0110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:12.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.457+0000 7f11b6d54640 1 --2- 172.21.15.92:0/4197336667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b010de30 0x7f11b0110320 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009900 tx=0x7f11a802a410 comp rx=0 tx=0).stop 2024-09-21T07:15:12.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.457+0000 7f11b6d54640 1 -- 172.21.15.92:0/4197336667 shutdown_connections 2024-09-21T07:15:12.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.457+0000 7f11b6d54640 1 --2- 172.21.15.92:0/4197336667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b010de30 0x7f11b0110320 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.457+0000 7f11b6d54640 1 --2- 172.21.15.92:0/4197336667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b0105320 0x7f11b010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.457+0000 7f11b6d54640 1 --2- 172.21.15.92:0/4197336667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11b01049d0 0x7f11b0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.457+0000 7f11b6d54640 1 -- 172.21.15.92:0/4197336667 >> 172.21.15.92:0/4197336667 conn(0x7f11b0079740 msgr2=0x7f11b0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:12.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.458+0000 7f11b6d54640 1 -- 172.21.15.92:0/4197336667 shutdown_connections 2024-09-21T07:15:12.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.458+0000 7f11b6d54640 1 -- 172.21.15.92:0/4197336667 wait complete. 2024-09-21T07:15:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.458+0000 7f11b6d54640 1 Processor -- start 2024-09-21T07:15:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.458+0000 7f11b6d54640 1 -- start start 2024-09-21T07:15:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b6d54640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b01049d0 0x7f11b019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b6d54640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11b0105320 0x7f11b019a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b6d54640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b010de30 0x7f11b019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b6d54640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0113960 con 0x7f11b010de30 2024-09-21T07:15:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b6d54640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01137e0 con 0x7f11b0105320 2024-09-21T07:15:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b6d54640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0113ae0 con 0x7f11b01049d0 2024-09-21T07:15:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b52f1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b010de30 0x7f11b019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b52f1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b010de30 0x7f11b019fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36580/0 (socket says 172.21.15.92:36580) 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b52f1640 1 -- 172.21.15.92:0/3403158811 learned_addr learned my addr 172.21.15.92:0/3403158811 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11affff640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11b0105320 0x7f11b019a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b4af0640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b01049d0 0x7f11b019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b52f1640 1 -- 172.21.15.92:0/3403158811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b01049d0 msgr2=0x7f11b019a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b52f1640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b01049d0 0x7f11b019a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b52f1640 1 -- 172.21.15.92:0/3403158811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11b0105320 msgr2=0x7f11b019a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b52f1640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11b0105320 0x7f11b019a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b52f1640 1 -- 172.21.15.92:0/3403158811 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b01a02e0 con 0x7f11b010de30 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.459+0000 7f11b4af0640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b01049d0 0x7f11b019a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.460+0000 7f11b52f1640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b010de30 0x7f11b019fbb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f11a8005ab0 tx=0x7f11a8005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.460+0000 7f11adffb640 1 -- 172.21.15.92:0/3403158811 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a803f030 con 0x7f11b010de30 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.460+0000 7f11adffb640 1 -- 172.21.15.92:0/3403158811 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a80043d0 con 0x7f11b010de30 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.460+0000 7f11b6d54640 1 -- 172.21.15.92:0/3403158811 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b01a0570 con 0x7f11b010de30 2024-09-21T07:15:12.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.460+0000 7f11adffb640 1 -- 172.21.15.92:0/3403158811 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8035070 con 0x7f11b010de30 2024-09-21T07:15:12.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.460+0000 7f11b6d54640 1 -- 172.21.15.92:0/3403158811 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b01a6d30 con 0x7f11b010de30 2024-09-21T07:15:12.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11adffb640 1 -- 172.21.15.92:0/3403158811 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f11a8042030 con 0x7f11b010de30 2024-09-21T07:15:12.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11bd2c8740 1 Processor -- start 2024-09-21T07:15:12.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11bd2c8740 1 -- start start 2024-09-21T07:15:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61df7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a28660 0x55bc61df7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a30840 0x55bc61df7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bc61ce2dc0 con 0x55bc61a51520 2024-09-21T07:15:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bc61d6f1f0 con 0x55bc61a30840 2024-09-21T07:15:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bc61d5e620 con 0x55bc61a28660 2024-09-21T07:15:12.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61df7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61df7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36582/0 (socket says 172.21.15.92:36582) 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.463+0000 7f11affff640 1 -- 172.21.15.92:0/1113738920 learned_addr learned my addr 172.21.15.92:0/1113738920 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11b4af0640 1 --2- 172.21.15.92:0/1113738920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a28660 0x55bc61df7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11affff640 1 --2- 172.21.15.92:0/1113738920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a30840 0x55bc61df7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11adffb640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11a00b6680 0x7f11a00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11affff640 1 -- 172.21.15.92:0/1113738920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a28660 msgr2=0x55bc61df7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11affff640 1 --2- 172.21.15.92:0/1113738920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a28660 0x55bc61df7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11affff640 1 -- 172.21.15.92:0/1113738920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a30840 msgr2=0x55bc61df7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11affff640 1 --2- 172.21.15.92:0/1113738920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a30840 0x55bc61df7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11affff640 1 -- 172.21.15.92:0/1113738920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc61d26fd0 con 0x55bc61a51520 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11b52f1640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11a00b6680 0x7f11a00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11affff640 1 --2- 172.21.15.92:0/1113738920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61df7510 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f119c0135b0 tx=0x7f119c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b4abb8ba1cba2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f11adffb640 1 -- 172.21.15.92:0/3403158811 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f11a8107ea0 con 0x7f11b010de30 2024-09-21T07:15:12.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.464+0000 7f119affd640 1 -- 172.21.15.92:0/1113738920 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c004030 con 0x55bc61a51520 2024-09-21T07:15:12.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.465+0000 7f119affd640 1 -- 172.21.15.92:0/1113738920 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f119c0035f0 con 0x55bc61a51520 2024-09-21T07:15:12.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.465+0000 7f119affd640 1 -- 172.21.15.92:0/1113738920 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c00f760 con 0x55bc61a51520 2024-09-21T07:15:12.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.465+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1113738920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 msgr2=0x55bc61df7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:12.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.465+0000 7f11b52f1640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11a00b6680 0x7f11a00b8b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f11a8105300 tx=0x7f11a80ca080 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:12.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.465+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1113738920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61df7510 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f119c0135b0 tx=0x7f119c005850 comp rx=0 tx=0).stop 2024-09-21T07:15:12.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.465+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1113738920 shutdown_connections 2024-09-21T07:15:12.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.465+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1113738920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a30840 0x55bc61df7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.465+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1113738920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a28660 0x55bc61df7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.465+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1113738920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61df7510 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.465+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1113738920 >> 172.21.15.92:0/1113738920 conn(0x55bc61a45910 msgr2=0x55bc61df5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:12.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.466+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1113738920 shutdown_connections 2024-09-21T07:15:12.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.466+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1113738920 wait complete. 2024-09-21T07:15:12.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.466+0000 7f11bd2c8740 1 -- start start 2024-09-21T07:15:12.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.466+0000 7f11bd2c8740 1 Processor -- start 2024-09-21T07:15:12.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61e09750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a30840 0x55bc61e07030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61e07740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bc61cf9300 con 0x55bc61a51520 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bc61d62430 con 0x55bc61a28660 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bc61bbfbb0 con 0x55bc61a30840 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11bd2c8740 10 client.0 _ll_register_callbacks cb 0x55bc61d13120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61e07740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61e07740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36590/0 (socket says 172.21.15.92:36590) 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11affff640 1 -- 172.21.15.92:0/2746933455 learned_addr learned my addr 172.21.15.92:0/2746933455 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11b4af0640 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a30840 0x55bc61e07030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11affff640 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61e09750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11affff640 1 -- 172.21.15.92:0/2746933455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a30840 msgr2=0x55bc61e07030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11affff640 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a30840 0x55bc61e07030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11affff640 1 -- 172.21.15.92:0/2746933455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 msgr2=0x55bc61e09750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11affff640 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61e09750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11affff640 1 -- 172.21.15.92:0/2746933455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc61ce8780 con 0x55bc61a51520 2024-09-21T07:15:12.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f11affff640 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61e07740 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55bc61e018e0 tx=0x7f119c003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47c4a5805fbefe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:12.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.467+0000 7f118ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:12.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.468+0000 7f118ffff640 1 -- 172.21.15.92:0/2746933455 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c029040 con 0x55bc61a51520 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.468+0000 7f11bd2c8740 1 -- 172.21.15.92:0/2746933455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f119c0035f0 con 0x55bc61a51520 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.468+0000 7f118ffff640 1 -- 172.21.15.92:0/2746933455 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f119c005030 con 0x55bc61a51520 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.468+0000 7f118ffff640 1 -- 172.21.15.92:0/2746933455 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f119c005230 con 0x55bc61a51520 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.468+0000 7f11bd2c8740 10 client.16344 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.468+0000 7f11bd2c8740 1 -- 172.21.15.92:0/2746933455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bc61abcb00 con 0x55bc61a51520 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.468+0000 7f118ffff640 1 -- 172.21.15.92:0/2746933455 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f119c0035f0 con 0x55bc61a51520 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.469+0000 7f118ffff640 1 -- 172.21.15.92:0/2746933455 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f119c01d020 con 0x55bc61a51520 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.469+0000 7f11bd2c8740 10 client.16344 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.469+0000 7f11bd2c8740 10 client.16344 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.469+0000 7f11bd2c8740 20 client.16344 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.469+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55bc61a0fea0 0x55bc61e0ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.469+0000 7f11bd2c8740 4 client.16344 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.469+0000 7f11bd2c8740 1 -- 172.21.15.92:0/2746933455 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc61d71140 con 0x55bc61a0fea0 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.469+0000 7f11b4af0640 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55bc61a0fea0 0x55bc61e0ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.470+0000 7f11b4af0640 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55bc61a0fea0 0x55bc61e0ed80 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74766816417f59b6 server_cookie=5d9e17ccf5e22ee2 in_seq=0 out_seq=0 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.470+0000 7f118ffff640 10 client.16344 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f118ffff640 1 -- 172.21.15.92:0/2746933455 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc61d71140 con 0x55bc61a0fea0 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f118ffff640 10 client.16344 handle_command_reply: tid=0 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f11bd2c8740 1 client.16344 shutdown 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f11bd2c8740 1 -- 172.21.15.92:0/2746933455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 msgr2=0x55bc61e07740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61e07740 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55bc61e018e0 tx=0x7f119c003e60 comp rx=0 tx=0).stop 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f11bd2c8740 1 -- 172.21.15.92:0/2746933455 shutdown_connections 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55bc61a0fea0 0x55bc61e0ed80 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a51520 0x55bc61e07740 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a30840 0x55bc61e07030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/2746933455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61e09750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f118ffff640 0 client.16344 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:12.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f11bd2c8740 1 -- 172.21.15.92:0/2746933455 >> 172.21.15.92:0/2746933455 conn(0x55bc61a45910 msgr2=0x55bc61df3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:12.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.471+0000 7f11bd2c8740 1 -- 172.21.15.92:0/2746933455 shutdown_connections 2024-09-21T07:15:12.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.472+0000 7f11bd2c8740 1 -- 172.21.15.92:0/2746933455 wait complete. 2024-09-21T07:15:12.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.472+0000 7f11bd2c8740 20 client.16344 trim_cache size 0 max 16384 2024-09-21T07:15:12.484 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:12.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.489+0000 7f11bd2c8740 1 Processor -- start 2024-09-21T07:15:12.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.489+0000 7f11bd2c8740 1 -- start start 2024-09-21T07:15:12.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a0fea0 0x55bc61e183a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61e08db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a30840 0x55bc61e041e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01aebf0 con 0x55bc61a0fea0 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01b0730 con 0x55bc61a28660 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01af2c0 con 0x55bc61a30840 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a0fea0 0x55bc61e183a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a0fea0 0x55bc61e183a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36600/0 (socket says 172.21.15.92:36600) 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11affff640 1 -- 172.21.15.92:0/1723098280 learned_addr learned my addr 172.21.15.92:0/1723098280 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11b4af0640 1 --2- 172.21.15.92:0/1723098280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61e08db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11affff640 1 --2- 172.21.15.92:0/1723098280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a30840 0x55bc61e041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11affff640 1 -- 172.21.15.92:0/1723098280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a30840 msgr2=0x55bc61e041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11affff640 1 --2- 172.21.15.92:0/1723098280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a30840 0x55bc61e041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11affff640 1 -- 172.21.15.92:0/1723098280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 msgr2=0x55bc61e08db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11affff640 1 --2- 172.21.15.92:0/1723098280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61e08db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11affff640 1 -- 172.21.15.92:0/1723098280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc61e0f0f0 con 0x55bc61a0fea0 2024-09-21T07:15:12.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11b4af0640 1 --2- 172.21.15.92:0/1723098280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61e08db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:12.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.490+0000 7f11affff640 1 --2- 172.21.15.92:0/1723098280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a0fea0 0x55bc61e183a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f119c004390 tx=0x7f119c004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b121dbea8755542b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:12.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.491+0000 7f119a7fc640 1 -- 172.21.15.92:0/1723098280 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0035f0 con 0x55bc61a0fea0 2024-09-21T07:15:12.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.491+0000 7f119a7fc640 1 -- 172.21.15.92:0/1723098280 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f119c009ce0 con 0x55bc61a0fea0 2024-09-21T07:15:12.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.491+0000 7f119a7fc640 1 -- 172.21.15.92:0/1723098280 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0053d0 con 0x55bc61a0fea0 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.492+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1723098280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a0fea0 msgr2=0x55bc61e183a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.492+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1723098280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a0fea0 0x55bc61e183a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f119c004390 tx=0x7f119c004d50 comp rx=0 tx=0).stop 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.492+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1723098280 shutdown_connections 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.492+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1723098280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a30840 0x55bc61e041e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.492+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1723098280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61e08db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.492+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1723098280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a0fea0 0x55bc61e183a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.492+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1723098280 >> 172.21.15.92:0/1723098280 conn(0x55bc61a45910 msgr2=0x55bc61df51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.492+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1723098280 shutdown_connections 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.492+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1723098280 wait complete. 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.492+0000 7f11bd2c8740 1 -- start start 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11bd2c8740 1 Processor -- start 2024-09-21T07:15:12.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a0fea0 0x55bc61dfcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61dfd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11bd2c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a30840 0x55bc61dfd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01b0060 con 0x55bc61a30840 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01af990 con 0x55bc61a28660 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11bd2c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01acbd0 con 0x55bc61a0fea0 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11bd2c8740 10 client.0 _ll_register_callbacks cb 0x7f11a40099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a30840 0x55bc61dfd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a30840 0x55bc61dfd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36608/0 (socket says 172.21.15.92:36608) 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11affff640 1 -- 172.21.15.92:0/1645598716 learned_addr learned my addr 172.21.15.92:0/1645598716 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.493+0000 7f11b4af0640 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61dfd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f11affff640 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a0fea0 0x55bc61dfcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f11affff640 1 -- 172.21.15.92:0/1645598716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a0fea0 msgr2=0x55bc61dfcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f11affff640 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a0fea0 0x55bc61dfcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f11affff640 1 -- 172.21.15.92:0/1645598716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 msgr2=0x55bc61dfd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f11affff640 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61dfd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f11affff640 1 -- 172.21.15.92:0/1645598716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc61b33960 con 0x55bc61a30840 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f11affff640 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a30840 0x55bc61dfd560 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55bc61e0bab0 tx=0x7f119c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d061cf584c4045 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f118ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f118ffff640 1 -- 172.21.15.92:0/1645598716 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c021040 con 0x55bc61a30840 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f118ffff640 1 -- 172.21.15.92:0/1645598716 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f119c0211e0 con 0x55bc61a30840 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1645598716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f119c009ce0 con 0x55bc61a30840 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f118ffff640 1 -- 172.21.15.92:0/1645598716 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f119c0055e0 con 0x55bc61a30840 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f11bd2c8740 10 client.16350 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.494+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1645598716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bc61e90f30 con 0x55bc61a30840 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.495+0000 7f118ffff640 1 -- 172.21.15.92:0/1645598716 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f119c009ce0 con 0x55bc61a30840 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.495+0000 7f118ffff640 1 -- 172.21.15.92:0/1645598716 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f119c01d040 con 0x55bc61a30840 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.495+0000 7f11bd2c8740 10 client.16350 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.495+0000 7f11bd2c8740 10 client.16350 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:15:12.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.495+0000 7f11bd2c8740 20 client.16350 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:12.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.495+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55bc61a51520 0x55bc61e93530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:12.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.495+0000 7f11bd2c8740 4 client.16350 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8460e8a9", "release": true, "await": true}] 2024-09-21T07:15:12.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.495+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1645598716 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8460e8a9", "release": true, "await": true}) -- 0x55bc61d6cbf0 con 0x55bc61a51520 2024-09-21T07:15:12.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.495+0000 7f11b4af0640 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55bc61a51520 0x55bc61e93530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:12.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.496+0000 7f11b4af0640 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55bc61a51520 0x55bc61e93530 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=573cc0e74e479980 server_cookie=7eb72ac05bd4a75e in_seq=0 out_seq=0 2024-09-21T07:15:12.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.496+0000 7f118ffff640 10 client.16350 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.500+0000 7f118ffff640 1 -- 172.21.15.92:0/1645598716 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55bc61d6cbf0 con 0x55bc61a51520 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.500+0000 7f118ffff640 10 client.16350 handle_command_reply: tid=0 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.500+0000 7f11bd2c8740 1 client.16350 shutdown 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1645598716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a30840 msgr2=0x55bc61dfd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a30840 0x55bc61dfd560 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55bc61e0bab0 tx=0x7f119c0098b0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1645598716 shutdown_connections 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55bc61a51520 0x55bc61e93530 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f118ffff640 0 client.16350 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc61a30840 0x55bc61dfd560 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc61a28660 0x55bc61dfd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 1 --2- 172.21.15.92:0/1645598716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc61a0fea0 0x55bc61dfcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1645598716 >> 172.21.15.92:0/1645598716 conn(0x55bc61a45910 msgr2=0x55bc61df8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:12.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1645598716 shutdown_connections 2024-09-21T07:15:12.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 1 -- 172.21.15.92:0/1645598716 wait complete. 2024-09-21T07:15:12.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.501+0000 7f11bd2c8740 20 client.16350 trim_cache size 0 max 16384 2024-09-21T07:15:12.504 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:15:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-09-21T07:15:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24649, 2024-09-21T07:15:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 8, 2024-09-21T07:15:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-21T07:15:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "8460e8a9": { 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 8, 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 137.0, 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:15:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:12.506 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:15:12.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 -- 172.21.15.92:0/3403158811 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11a00b6680 msgr2=0x7f11a00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11a00b6680 0x7f11a00b8b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f11a8105300 tx=0x7f11a80ca080 comp rx=0 tx=0).stop 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 -- 172.21.15.92:0/3403158811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b010de30 msgr2=0x7f11b019fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b010de30 0x7f11b019fbb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f11a8005ab0 tx=0x7f11a8005e10 comp rx=0 tx=0).stop 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 -- 172.21.15.92:0/3403158811 shutdown_connections 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f11a00b6680 0x7f11a00b8b90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b010de30 0x7f11b019fbb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11b0105320 0x7f11b019a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 --2- 172.21.15.92:0/3403158811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b01049d0 0x7f11b019a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 -- 172.21.15.92:0/3403158811 >> 172.21.15.92:0/3403158811 conn(0x7f11b0079740 msgr2=0x7f11b0100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 -- 172.21.15.92:0/3403158811 shutdown_connections 2024-09-21T07:15:12.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:12.502+0000 7f11b6d54640 1 -- 172.21.15.92:0/3403158811 wait complete. 2024-09-21T07:15:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:12 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:15:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:12 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:15:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:12 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:15:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:12 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:15:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:12 smithi092 ceph-mon[30987]: pgmap v403: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.9 MiB/s wr, 28 op/s 2024-09-21T07:15:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:12 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:15:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:12 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:15:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:12 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:15:13.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:12 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:15:13.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:12 smithi175 ceph-mon[34064]: pgmap v403: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.9 MiB/s wr, 28 op/s 2024-09-21T07:15:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:12 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:15:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:12 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:15:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:12 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:15:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:12 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:15:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:12 smithi169 ceph-mon[33705]: pgmap v403: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.9 MiB/s wr, 28 op/s 2024-09-21T07:15:13.238 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8460e8a9', total seconds elapsed: 22.0 2024-09-21T07:15:13.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.677+0000 7fd88f18b640 1 -- 172.21.15.92:0/3577378544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8881029d0 msgr2=0x7fd888102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.677+0000 7fd88f18b640 1 --2- 172.21.15.92:0/3577378544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8881029d0 0x7fd888102de0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009900 tx=0x7fd87c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.677+0000 7fd88f18b640 1 -- 172.21.15.92:0/3577378544 shutdown_connections 2024-09-21T07:15:13.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.677+0000 7fd88f18b640 1 --2- 172.21.15.92:0/3577378544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888108c50 0x7fd88810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.677+0000 7fd88f18b640 1 --2- 172.21.15.92:0/3577378544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd888108300 0x7fd888108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.677+0000 7fd88f18b640 1 --2- 172.21.15.92:0/3577378544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8881029d0 0x7fd888102de0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.677+0000 7fd88f18b640 1 -- 172.21.15.92:0/3577378544 >> 172.21.15.92:0/3577378544 conn(0x7fd88807a6f0 msgr2=0x7fd88807ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.677+0000 7fd88f18b640 1 -- 172.21.15.92:0/3577378544 shutdown_connections 2024-09-21T07:15:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.677+0000 7fd88f18b640 1 -- 172.21.15.92:0/3577378544 wait complete. 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.678+0000 7fd88f18b640 1 Processor -- start 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.678+0000 7fd88f18b640 1 -- start start 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.678+0000 7fd88f18b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8881029d0 0x7fd88819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.678+0000 7fd88f18b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888108300 0x7fd88819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.678+0000 7fd88f18b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd888108c50 0x7fd8881a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.678+0000 7fd88f18b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881116c0 con 0x7fd8881029d0 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.678+0000 7fd88f18b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd888111540 con 0x7fd888108300 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.678+0000 7fd88f18b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd888111840 con 0x7fd888108c50 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88cf27640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8881029d0 0x7fd88819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88cf27640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8881029d0 0x7fd88819c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36620/0 (socket says 172.21.15.92:36620) 2024-09-21T07:15:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88cf27640 1 -- 172.21.15.92:0/2808642920 learned_addr learned my addr 172.21.15.92:0/2808642920 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88d728640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd888108c50 0x7fd8881a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd887fff640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888108300 0x7fd88819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88d728640 1 -- 172.21.15.92:0/2808642920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888108300 msgr2=0x7fd88819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88d728640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888108300 0x7fd88819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88d728640 1 -- 172.21.15.92:0/2808642920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8881029d0 msgr2=0x7fd88819c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88d728640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8881029d0 0x7fd88819c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88d728640 1 -- 172.21.15.92:0/2808642920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8881a2540 con 0x7fd888108c50 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88cf27640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8881029d0 0x7fd88819c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88d728640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd888108c50 0x7fd8881a1e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd880009fd0 tx=0x7fd88000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd885ffb640 1 -- 172.21.15.92:0/2808642920 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88000ce20 con 0x7fd888108c50 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd885ffb640 1 -- 172.21.15.92:0/2808642920 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd880005020 con 0x7fd888108c50 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd88f18b640 1 -- 172.21.15.92:0/2808642920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8881a2830 con 0x7fd888108c50 2024-09-21T07:15:13.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.679+0000 7fd885ffb640 1 -- 172.21.15.92:0/2808642920 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880010690 con 0x7fd888108c50 2024-09-21T07:15:13.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.680+0000 7fd88f18b640 1 -- 172.21.15.92:0/2808642920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8881a8fc0 con 0x7fd888108c50 2024-09-21T07:15:13.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.682+0000 7fd885ffb640 1 -- 172.21.15.92:0/2808642920 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fd880004a40 con 0x7fd888108c50 2024-09-21T07:15:13.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.683+0000 7fd885ffb640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8780b6680 0x7fd8780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.683+0000 7fd88cf27640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8780b6680 0x7fd8780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.683+0000 7fd8961d7740 1 Processor -- start 2024-09-21T07:15:13.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.683+0000 7fd885ffb640 1 -- 172.21.15.92:0/2808642920 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd8800e81f0 con 0x7fd888108c50 2024-09-21T07:15:13.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.683+0000 7fd8961d7740 1 -- start start 2024-09-21T07:15:13.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b459b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 0x55d2b1b45ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b177f4d0 0x55d2b1b46430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd8961d7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d2b1aba6f0 con 0x55d2b17a01b0 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd8961d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d2b1aa9b20 con 0x55d2b177f4d0 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd8961d7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d2b1aad930 con 0x55d2b17772f0 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd88cf27640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd88cf27640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8780b6680 0x7fd8780b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd87c032fd0 tx=0x7fd87c0095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd88cf27640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36626/0 (socket says 172.21.15.92:36626) 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd88cf27640 1 -- 172.21.15.92:0/1076152685 learned_addr learned my addr 172.21.15.92:0/1076152685 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd887fff640 1 --2- 172.21.15.92:0/1076152685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 0x55d2b1b45ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd88cf27640 1 -- 172.21.15.92:0/1076152685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 msgr2=0x55d2b1b45ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd88cf27640 1 --2- 172.21.15.92:0/1076152685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 0x55d2b1b45ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd88cf27640 1 -- 172.21.15.92:0/1076152685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b177f4d0 msgr2=0x55d2b1b46430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd88cf27640 1 --2- 172.21.15.92:0/1076152685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b177f4d0 0x55d2b1b46430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd88cf27640 1 -- 172.21.15.92:0/1076152685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b1a6f530 con 0x55d2b17a01b0 2024-09-21T07:15:13.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.684+0000 7fd88cf27640 1 --2- 172.21.15.92:0/1076152685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b459b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd87c006010 tx=0x7fd87c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89e549e0314adf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.685+0000 7fd872ffd640 1 -- 172.21.15.92:0/1076152685 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c035050 con 0x55d2b17a01b0 2024-09-21T07:15:13.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.685+0000 7fd872ffd640 1 -- 172.21.15.92:0/1076152685 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd87c003c80 con 0x55d2b17a01b0 2024-09-21T07:15:13.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.685+0000 7fd872ffd640 1 -- 172.21.15.92:0/1076152685 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c03cae0 con 0x55d2b17a01b0 2024-09-21T07:15:13.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 -- 172.21.15.92:0/1076152685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 msgr2=0x55d2b1b459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 --2- 172.21.15.92:0/1076152685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b459b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd87c006010 tx=0x7fd87c03e000 comp rx=0 tx=0).stop 2024-09-21T07:15:13.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 -- 172.21.15.92:0/1076152685 shutdown_connections 2024-09-21T07:15:13.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 --2- 172.21.15.92:0/1076152685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b177f4d0 0x55d2b1b46430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 --2- 172.21.15.92:0/1076152685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 0x55d2b1b45ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 --2- 172.21.15.92:0/1076152685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b459b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 -- 172.21.15.92:0/1076152685 >> 172.21.15.92:0/1076152685 conn(0x55d2b1794300 msgr2=0x55d2b1b438a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 -- 172.21.15.92:0/1076152685 shutdown_connections 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 -- 172.21.15.92:0/1076152685 wait complete. 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 -- start start 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.686+0000 7fd8961d7740 1 Processor -- start 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 0x55d2b1b510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b177f4d0 0x55d2b1b515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b5d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd8961d7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d2b19e1ab0 con 0x55d2b17a01b0 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd8961d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d2b1a4f730 con 0x55d2b177f4d0 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd8961d7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d2b1b540d0 con 0x55d2b17772f0 2024-09-21T07:15:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd8961d7740 10 client.0 _ll_register_callbacks cb 0x55d2b1aa36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd88d728640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b5d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd88d728640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b5d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36634/0 (socket says 172.21.15.92:36634) 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd88d728640 1 -- 172.21.15.92:0/4199627375 learned_addr learned my addr 172.21.15.92:0/4199627375 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd88cf27640 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 0x55d2b1b510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd887fff640 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b177f4d0 0x55d2b1b515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd88d728640 1 -- 172.21.15.92:0/4199627375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 msgr2=0x55d2b1b510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd88d728640 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 0x55d2b1b510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd88d728640 1 -- 172.21.15.92:0/4199627375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b177f4d0 msgr2=0x55d2b1b515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd88d728640 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b177f4d0 0x55d2b1b515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd88d728640 1 -- 172.21.15.92:0/4199627375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b180b790 con 0x55d2b17a01b0 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd887fff640 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b177f4d0 0x55d2b1b515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.687+0000 7fd88cf27640 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 0x55d2b1b510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.688+0000 7fd88d728640 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b5d420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd8800e5600 tx=0x7fd8800ad410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9315d8cdb2443651 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.688+0000 7fd867fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.688+0000 7fd867fff640 1 -- 172.21.15.92:0/4199627375 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8800b2780 con 0x55d2b17a01b0 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.688+0000 7fd867fff640 1 -- 172.21.15.92:0/4199627375 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd8800a9f10 con 0x55d2b17a01b0 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.688+0000 7fd8961d7740 1 -- 172.21.15.92:0/4199627375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd87c003c80 con 0x55d2b17a01b0 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.688+0000 7fd867fff640 1 -- 172.21.15.92:0/4199627375 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd8800b76c0 con 0x55d2b17a01b0 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.688+0000 7fd8961d7740 10 client.16362 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.688+0000 7fd8961d7740 1 -- 172.21.15.92:0/4199627375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2b1884620 con 0x55d2b17a01b0 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.688+0000 7fd867fff640 1 -- 172.21.15.92:0/4199627375 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd87c003c80 con 0x55d2b17a01b0 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.688+0000 7fd867fff640 1 -- 172.21.15.92:0/4199627375 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd8800d10e0 con 0x55d2b17a01b0 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.689+0000 7fd8961d7740 10 client.16362 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.689+0000 7fd8961d7740 10 client.16362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.689+0000 7fd8961d7740 20 client.16362 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.689+0000 7fd8961d7740 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d2b175ed80 0x55d2b1b631b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.689+0000 7fd8961d7740 4 client.16362 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.689+0000 7fd8961d7740 1 -- 172.21.15.92:0/4199627375 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2b1abc640 con 0x55d2b175ed80 2024-09-21T07:15:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.689+0000 7fd88cf27640 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d2b175ed80 0x55d2b1b631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.689+0000 7fd867fff640 10 client.16362 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.689+0000 7fd88cf27640 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d2b175ed80 0x55d2b1b631b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e1210806facf454 server_cookie=b2278595b8ce372 in_seq=0 out_seq=0 2024-09-21T07:15:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd867fff640 1 -- 172.21.15.92:0/4199627375 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2b1abc640 con 0x55d2b175ed80 2024-09-21T07:15:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd867fff640 10 client.16362 handle_command_reply: tid=0 2024-09-21T07:15:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd8961d7740 1 client.16362 shutdown 2024-09-21T07:15:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd8961d7740 1 -- 172.21.15.92:0/4199627375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 msgr2=0x55d2b1b5d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd8961d7740 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b5d420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd8800e5600 tx=0x7fd8800ad410 comp rx=0 tx=0).stop 2024-09-21T07:15:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd8961d7740 1 -- 172.21.15.92:0/4199627375 shutdown_connections 2024-09-21T07:15:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd8961d7740 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d2b175ed80 0x55d2b1b631b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd8961d7740 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b5d420 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd8961d7740 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b177f4d0 0x55d2b1b515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd8961d7740 1 --2- 172.21.15.92:0/4199627375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b17772f0 0x55d2b1b510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd8961d7740 1 -- 172.21.15.92:0/4199627375 >> 172.21.15.92:0/4199627375 conn(0x55d2b1794300 msgr2=0x55d2b1b469e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.690+0000 7fd867fff640 0 client.16362 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.691+0000 7fd8961d7740 1 -- 172.21.15.92:0/4199627375 shutdown_connections 2024-09-21T07:15:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.691+0000 7fd8961d7740 1 -- 172.21.15.92:0/4199627375 wait complete. 2024-09-21T07:15:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.691+0000 7fd8961d7740 20 client.16362 trim_cache size 0 max 16384 2024-09-21T07:15:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd8961d7740 1 Processor -- start 2024-09-21T07:15:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd8961d7740 1 -- start start 2024-09-21T07:15:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17772f0 0x55d2b1b4c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 0x55d2b1b52f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b46fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd8961d7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881b2f50 con 0x55d2b17a01b0 2024-09-21T07:15:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd8961d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881b4a90 con 0x55d2b17772f0 2024-09-21T07:15:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd8961d7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881b3620 con 0x55d2b177f4d0 2024-09-21T07:15:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd88cf27640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17772f0 0x55d2b1b4c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd88cf27640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17772f0 0x55d2b1b4c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:44466/0 (socket says 172.21.15.92:44466) 2024-09-21T07:15:13.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd88cf27640 1 -- 172.21.15.92:0/970398038 learned_addr learned my addr 172.21.15.92:0/970398038 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:13.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd88d728640 1 --2- 172.21.15.92:0/970398038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b46fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.713+0000 7fd887fff640 1 --2- 172.21.15.92:0/970398038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 0x55d2b1b52f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.714+0000 7fd88cf27640 1 -- 172.21.15.92:0/970398038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 msgr2=0x55d2b1b52f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.714+0000 7fd88cf27640 1 --2- 172.21.15.92:0/970398038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 0x55d2b1b52f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.714+0000 7fd88cf27640 1 -- 172.21.15.92:0/970398038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 msgr2=0x55d2b1b46fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.714+0000 7fd88cf27640 1 --2- 172.21.15.92:0/970398038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b46fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.714+0000 7fd88cf27640 1 -- 172.21.15.92:0/970398038 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b175efb0 con 0x55d2b17772f0 2024-09-21T07:15:13.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.714+0000 7fd88cf27640 1 --2- 172.21.15.92:0/970398038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17772f0 0x55d2b1b4c7f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009a20 tx=0x7fd87c03c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41e402b7b94df9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.714+0000 7fd8727fc640 1 -- 172.21.15.92:0/970398038 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c035040 con 0x55d2b17772f0 2024-09-21T07:15:13.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.714+0000 7fd8727fc640 1 -- 172.21.15.92:0/970398038 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd87c0035f0 con 0x55d2b17772f0 2024-09-21T07:15:13.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.714+0000 7fd8727fc640 1 -- 172.21.15.92:0/970398038 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c05d680 con 0x55d2b17772f0 2024-09-21T07:15:13.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.715+0000 7fd8961d7740 1 -- 172.21.15.92:0/970398038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17772f0 msgr2=0x55d2b1b4c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.715+0000 7fd8961d7740 1 --2- 172.21.15.92:0/970398038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17772f0 0x55d2b1b4c7f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009a20 tx=0x7fd87c03c740 comp rx=0 tx=0).stop 2024-09-21T07:15:13.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.715+0000 7fd8961d7740 1 -- 172.21.15.92:0/970398038 shutdown_connections 2024-09-21T07:15:13.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.715+0000 7fd8961d7740 1 --2- 172.21.15.92:0/970398038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17a01b0 0x55d2b1b46fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.715+0000 7fd8961d7740 1 --2- 172.21.15.92:0/970398038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 0x55d2b1b52f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.715+0000 7fd8961d7740 1 --2- 172.21.15.92:0/970398038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17772f0 0x55d2b1b4c7f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.715+0000 7fd8961d7740 1 -- 172.21.15.92:0/970398038 >> 172.21.15.92:0/970398038 conn(0x55d2b1794300 msgr2=0x55d2b1b46890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.715+0000 7fd8961d7740 1 -- 172.21.15.92:0/970398038 shutdown_connections 2024-09-21T07:15:13.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.715+0000 7fd8961d7740 1 -- 172.21.15.92:0/970398038 wait complete. 2024-09-21T07:15:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.716+0000 7fd8961d7740 1 -- start start 2024-09-21T07:15:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.716+0000 7fd8961d7740 1 Processor -- start 2024-09-21T07:15:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.716+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17772f0 0x55d2b1b56ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.716+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 0x55d2b1b57010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd8961d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17a01b0 0x55d2b1bd4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd8961d7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881b43c0 con 0x55d2b17772f0 2024-09-21T07:15:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd8961d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881b3cf0 con 0x55d2b17a01b0 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd8961d7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881b0f30 con 0x55d2b177f4d0 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd8961d7740 10 client.0 _ll_register_callbacks cb 0x7fd8800057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88cf27640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17772f0 0x55d2b1b56ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd887fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 0x55d2b1b57010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88cf27640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17772f0 0x55d2b1b56ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36650/0 (socket says 172.21.15.92:36650) 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88cf27640 1 -- 172.21.15.92:0/3493496695 learned_addr learned my addr 172.21.15.92:0/3493496695 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88d728640 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17a01b0 0x55d2b1bd4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88cf27640 1 -- 172.21.15.92:0/3493496695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 msgr2=0x55d2b1b57010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88cf27640 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 0x55d2b1b57010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88cf27640 1 -- 172.21.15.92:0/3493496695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17a01b0 msgr2=0x55d2b1bd4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88cf27640 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17a01b0 0x55d2b1bd4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88cf27640 1 -- 172.21.15.92:0/3493496695 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b1bd48a0 con 0x55d2b17772f0 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88d728640 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17a01b0 0x55d2b1bd4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd887fff640 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 0x55d2b1b57010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd88cf27640 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17772f0 0x55d2b1b56ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0319f0 tx=0x7fd87c03c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3a7fcfc2527ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.717+0000 7fd867fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd867fff640 1 -- 172.21.15.92:0/3493496695 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c035040 con 0x55d2b17772f0 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd867fff640 1 -- 172.21.15.92:0/3493496695 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd87c003c70 con 0x55d2b17772f0 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd8961d7740 1 -- 172.21.15.92:0/3493496695 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd87c0035f0 con 0x55d2b17772f0 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd867fff640 1 -- 172.21.15.92:0/3493496695 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd87c076050 con 0x55d2b17772f0 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd8961d7740 10 client.16368 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd8961d7740 1 -- 172.21.15.92:0/3493496695 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2b1bd5b30 con 0x55d2b17772f0 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd867fff640 1 -- 172.21.15.92:0/3493496695 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd87c0035f0 con 0x55d2b17772f0 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd867fff640 1 -- 172.21.15.92:0/3493496695 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd87c062030 con 0x55d2b17772f0 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd8961d7740 10 client.16368 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd8961d7740 10 client.16368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd8961d7740 20 client.16368 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd8961d7740 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d2b17341c0 0x55d2b1bd7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd8961d7740 4 client.16368 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:15:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.718+0000 7fd8961d7740 1 -- 172.21.15.92:0/3493496695 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d2b1ab80f0 con 0x55d2b17341c0 2024-09-21T07:15:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.719+0000 7fd887fff640 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d2b17341c0 0x55d2b1bd7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.719+0000 7fd887fff640 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d2b17341c0 0x55d2b1bd7d60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99ba7072577181d4 server_cookie=29d450ddbcc166bb in_seq=0 out_seq=0 2024-09-21T07:15:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.719+0000 7fd867fff640 10 client.16368 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:13.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd867fff640 1 -- 172.21.15.92:0/3493496695 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d2b1ab80f0 con 0x55d2b17341c0 2024-09-21T07:15:13.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd867fff640 10 client.16368 handle_command_reply: tid=0 2024-09-21T07:15:13.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 client.16368 shutdown 2024-09-21T07:15:13.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 -- 172.21.15.92:0/3493496695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17772f0 msgr2=0x55d2b1b56ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17772f0 0x55d2b1b56ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0319f0 tx=0x7fd87c03c440 comp rx=0 tx=0).stop 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 -- 172.21.15.92:0/3493496695 shutdown_connections 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d2b17341c0 0x55d2b1bd7d60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b17a01b0 0x55d2b1bd4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2b177f4d0 0x55d2b1b57010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 --2- 172.21.15.92:0/3493496695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2b17772f0 0x55d2b1b56ad0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd867fff640 0 client.16368 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 -- 172.21.15.92:0/3493496695 >> 172.21.15.92:0/3493496695 conn(0x55d2b1794300 msgr2=0x55d2b1b47250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 -- 172.21.15.92:0/3493496695 shutdown_connections 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.726+0000 7fd8961d7740 1 -- 172.21.15.92:0/3493496695 wait complete. 2024-09-21T07:15:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd8961d7740 20 client.16368 trim_cache size 0 max 16384 2024-09-21T07:15:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:15:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:15:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:15:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 -- 172.21.15.92:0/2808642920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8780b6680 msgr2=0x7fd8780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8780b6680 0x7fd8780b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd87c032fd0 tx=0x7fd87c0095c0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 -- 172.21.15.92:0/2808642920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd888108c50 msgr2=0x7fd8881a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd888108c50 0x7fd8881a1e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd880009fd0 tx=0x7fd88000ef10 comp rx=0 tx=0).stop 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 -- 172.21.15.92:0/2808642920 shutdown_connections 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8780b6680 0x7fd8780b8b90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd888108c50 0x7fd8881a1e40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888108300 0x7fd88819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 --2- 172.21.15.92:0/2808642920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8881029d0 0x7fd88819c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 -- 172.21.15.92:0/2808642920 >> 172.21.15.92:0/2808642920 conn(0x7fd88807a6f0 msgr2=0x7fd8881064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 -- 172.21.15.92:0/2808642920 shutdown_connections 2024-09-21T07:15:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:13.727+0000 7fd88f18b640 1 -- 172.21.15.92:0/2808642920 wait complete. 2024-09-21T07:15:13.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.792+0000 7fe0759ea640 1 -- 172.21.15.92:0/3843240945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0701030f0 msgr2=0x7fe070107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.792+0000 7fe0759ea640 1 --2- 172.21.15.92:0/3843240945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0701030f0 0x7fe070107620 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe064009930 tx=0x7fe06402a420 comp rx=0 tx=0).stop 2024-09-21T07:15:13.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.792+0000 7fe0759ea640 1 -- 172.21.15.92:0/3843240945 shutdown_connections 2024-09-21T07:15:13.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.792+0000 7fe0759ea640 1 --2- 172.21.15.92:0/3843240945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe070107be0 0x7fe0701080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.792+0000 7fe0759ea640 1 --2- 172.21.15.92:0/3843240945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0701030f0 0x7fe070107620 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.792+0000 7fe0759ea640 1 --2- 172.21.15.92:0/3843240945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0701027a0 0x7fe070102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.792+0000 7fe0759ea640 1 -- 172.21.15.92:0/3843240945 >> 172.21.15.92:0/3843240945 conn(0x7fe070079730 msgr2=0x7fe070079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.792+0000 7fe0759ea640 1 -- 172.21.15.92:0/3843240945 shutdown_connections 2024-09-21T07:15:13.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.792+0000 7fe0759ea640 1 -- 172.21.15.92:0/3843240945 wait complete. 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.792+0000 7fe0759ea640 1 Processor -- start 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.793+0000 7fe0759ea640 1 -- start start 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.793+0000 7fe0759ea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0701027a0 0x7fe0701a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.793+0000 7fe0759ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0701030f0 0x7fe0701a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.793+0000 7fe0759ea640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe070107be0 0x7fe0701a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.793+0000 7fe0759ea640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe070119ef0 con 0x7fe0701027a0 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.793+0000 7fe0759ea640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe070119d70 con 0x7fe070107be0 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.793+0000 7fe0759ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe07011a070 con 0x7fe0701030f0 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.794+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0701030f0 0x7fe0701a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.794+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0701030f0 0x7fe0701a1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:45732/0 (socket says 172.21.15.92:45732) 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.794+0000 7fe06e7fc640 1 -- 172.21.15.92:0/3964073655 learned_addr learned my addr 172.21.15.92:0/3964073655 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:13.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.794+0000 7fe06f7fe640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe070107be0 0x7fe0701a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.794+0000 7fe06effd640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0701027a0 0x7fe0701a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.794+0000 7fe06e7fc640 1 -- 172.21.15.92:0/3964073655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe070107be0 msgr2=0x7fe0701a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.794+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe070107be0 0x7fe0701a62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.794+0000 7fe06e7fc640 1 -- 172.21.15.92:0/3964073655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0701027a0 msgr2=0x7fe0701a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.794+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0701027a0 0x7fe0701a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.794+0000 7fe06e7fc640 1 -- 172.21.15.92:0/3964073655 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0701a6a10 con 0x7fe0701030f0 2024-09-21T07:15:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.795+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0701030f0 0x7fe0701a1040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe064004770 tx=0x7fe064004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.795+0000 7fe0749e8640 1 -- 172.21.15.92:0/3964073655 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06403f070 con 0x7fe0701030f0 2024-09-21T07:15:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.795+0000 7fe0749e8640 1 -- 172.21.15.92:0/3964073655 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe064003a80 con 0x7fe0701030f0 2024-09-21T07:15:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.795+0000 7fe0749e8640 1 -- 172.21.15.92:0/3964073655 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064035070 con 0x7fe0701030f0 2024-09-21T07:15:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.795+0000 7fe0759ea640 1 -- 172.21.15.92:0/3964073655 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0701a6ca0 con 0x7fe0701030f0 2024-09-21T07:15:13.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.795+0000 7fe0759ea640 1 -- 172.21.15.92:0/3964073655 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0701ad460 con 0x7fe0701030f0 2024-09-21T07:15:13.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.799+0000 7fe0749e8640 1 -- 172.21.15.92:0/3964073655 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fe0640035f0 con 0x7fe0701030f0 2024-09-21T07:15:13.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.799+0000 7fe07bf5e740 1 Processor -- start 2024-09-21T07:15:13.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.799+0000 7fe07bf5e740 1 -- start start 2024-09-21T07:15:13.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe01f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe01f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc57390 0x561efe01fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561efdf95e50 con 0x561efdc4f1b0 2024-09-21T07:15:13.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561efdf85280 con 0x561efdc78070 2024-09-21T07:15:13.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561efdf89090 con 0x561efdc57390 2024-09-21T07:15:13.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe0749e8640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0580b6780 0x7fe0580b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe01f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc57390 0x561efe01fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe01f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:44506/0 (socket says 172.21.15.92:44506) 2024-09-21T07:15:13.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe06f7fe640 1 -- 172.21.15.92:0/1152839571 learned_addr learned my addr 172.21.15.92:0/1152839571 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe06f7fe640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0580b6780 0x7fe0580b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.800+0000 7fe06effd640 1 --2- 172.21.15.92:0/1152839571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe01f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe06e7fc640 1 -- 172.21.15.92:0/1152839571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 msgr2=0x561efe01f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/1152839571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe01f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe06e7fc640 1 -- 172.21.15.92:0/1152839571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 msgr2=0x561efe01f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/1152839571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe01f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe06e7fc640 1 -- 172.21.15.92:0/1152839571 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561efdce3650 con 0x561efdc57390 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe06effd640 1 --2- 172.21.15.92:0/1152839571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe01f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/1152839571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc57390 0x561efe01fcf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe064105080 tx=0x7fe0640cdf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dea3b452209bcc36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe0749e8640 1 -- 172.21.15.92:0/3964073655 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe064107d30 con 0x7fe0701030f0 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe06f7fe640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0580b6780 0x7fe0580b8c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe068009fd0 tx=0x7fe068009240 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe055ffb640 1 -- 172.21.15.92:0/1152839571 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064048030 con 0x561efdc57390 2024-09-21T07:15:13.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.801+0000 7fe055ffb640 1 -- 172.21.15.92:0/1152839571 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0640d2260 con 0x561efdc57390 2024-09-21T07:15:13.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.802+0000 7fe055ffb640 1 -- 172.21.15.92:0/1152839571 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0640d71a0 con 0x561efdc57390 2024-09-21T07:15:13.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.803+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1152839571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc57390 msgr2=0x561efe01fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.803+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/1152839571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc57390 0x561efe01fcf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe064105080 tx=0x7fe0640cdf40 comp rx=0 tx=0).stop 2024-09-21T07:15:13.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.803+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1152839571 shutdown_connections 2024-09-21T07:15:13.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.803+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/1152839571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc57390 0x561efe01fcf0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe064105080 tx=0x7fe0640cdf40 comp rx=0 tx=0).stop 2024-09-21T07:15:13.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.803+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/1152839571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe01f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.803+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/1152839571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe01f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.803+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1152839571 >> 172.21.15.92:0/1152839571 conn(0x561efdc6c460 msgr2=0x561efe01d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.803+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1152839571 shutdown_connections 2024-09-21T07:15:13.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.803+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1152839571 wait complete. 2024-09-21T07:15:13.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.803+0000 7fe07bf5e740 1 -- start start 2024-09-21T07:15:13.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe07bf5e740 1 Processor -- start 2024-09-21T07:15:13.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe02a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe02af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc369f0 0x561efe036980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561efdde6700 con 0x561efdc4f1b0 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561efdf20110 con 0x561efdc78070 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561efdf95e50 con 0x561efdc369f0 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe07bf5e740 10 client.0 _ll_register_callbacks cb 0x561efdf39990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe06effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe02a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe06effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe02a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36682/0 (socket says 172.21.15.92:36682) 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe06effd640 1 -- 172.21.15.92:0/1565587659 learned_addr learned my addr 172.21.15.92:0/1565587659 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe02af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.804+0000 7fe06f7fe640 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc369f0 0x561efe036980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe06effd640 1 -- 172.21.15.92:0/1565587659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc369f0 msgr2=0x561efe036980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe06effd640 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc369f0 0x561efe036980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe06effd640 1 -- 172.21.15.92:0/1565587659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 msgr2=0x561efe02af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe06effd640 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe02af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe06effd640 1 -- 172.21.15.92:0/1565587659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561efdf4dc40 con 0x561efdc4f1b0 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe02af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe06effd640 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe02a9e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe060012700 tx=0x7fe060012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a175775fc9797a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe04effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe04effd640 1 -- 172.21.15.92:0/1565587659 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060004030 con 0x561efdc4f1b0 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe04effd640 1 -- 172.21.15.92:0/1565587659 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe0600041d0 con 0x561efdc4f1b0 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1565587659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0640d2260 con 0x561efdc4f1b0 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.805+0000 7fe04effd640 1 -- 172.21.15.92:0/1565587659 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe0600043d0 con 0x561efdc4f1b0 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe07bf5e740 10 client.16380 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1565587659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561efe0394c0 con 0x561efdc4f1b0 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe04effd640 1 -- 172.21.15.92:0/1565587659 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0640d2260 con 0x561efdc4f1b0 2024-09-21T07:15:13.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe04effd640 1 -- 172.21.15.92:0/1565587659 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe060003a80 con 0x561efdc4f1b0 2024-09-21T07:15:13.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe07bf5e740 10 client.16380 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:13.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe07bf5e740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:13.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe07bf5e740 20 client.16380 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:13.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561efdc0bda0 0x561efe03c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe07bf5e740 4 client.16380 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:13.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1565587659 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561efdf97da0 con 0x561efdc0bda0 2024-09-21T07:15:13.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.806+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561efdc0bda0 0x561efe03c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.807+0000 7fe04effd640 10 client.16380 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.808+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561efdc0bda0 0x561efe03c9d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54442303b99e8831 server_cookie=39f6cd480c63ed91 in_seq=0 out_seq=0 2024-09-21T07:15:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.808+0000 7fe04effd640 1 -- 172.21.15.92:0/1565587659 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561efdf97da0 con 0x561efdc0bda0 2024-09-21T07:15:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.808+0000 7fe04effd640 10 client.16380 handle_command_reply: tid=0 2024-09-21T07:15:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.808+0000 7fe07bf5e740 1 client.16380 shutdown 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1565587659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 msgr2=0x561efe02a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe02a9e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe060012700 tx=0x7fe060012bc0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1565587659 shutdown_connections 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561efdc0bda0 0x561efe03c9d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efdc369f0 0x561efe036980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe02af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/1565587659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc4f1b0 0x561efe02a9e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe04effd640 0 client.16380 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1565587659 >> 172.21.15.92:0/1565587659 conn(0x561efdc6c460 msgr2=0x561efe022450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1565587659 shutdown_connections 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 1 -- 172.21.15.92:0/1565587659 wait complete. 2024-09-21T07:15:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.809+0000 7fe07bf5e740 20 client.16380 trim_cache size 0 max 16384 2024-09-21T07:15:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.836+0000 7fe07bf5e740 1 Processor -- start 2024-09-21T07:15:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.836+0000 7fe07bf5e740 1 -- start start 2024-09-21T07:15:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.836+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc369f0 0x561efe02ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.836+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc78070 0x561efe036880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.836+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe022370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.836+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b90d0 con 0x561efdc78070 2024-09-21T07:15:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.836+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b7c60 con 0x561efdc369f0 2024-09-21T07:15:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.836+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b8330 con 0x561efe036dc0 2024-09-21T07:15:13.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe022370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc78070 0x561efe036880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe022370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:45756/0 (socket says 172.21.15.92:45756) 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06f7fe640 1 -- 172.21.15.92:0/2607100036 learned_addr learned my addr 172.21.15.92:0/2607100036 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06effd640 1 --2- 172.21.15.92:0/2607100036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc369f0 0x561efe02ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06f7fe640 1 -- 172.21.15.92:0/2607100036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc369f0 msgr2=0x561efe02ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06f7fe640 1 --2- 172.21.15.92:0/2607100036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc369f0 0x561efe02ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06f7fe640 1 -- 172.21.15.92:0/2607100036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc78070 msgr2=0x561efe036880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06f7fe640 1 --2- 172.21.15.92:0/2607100036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc78070 0x561efe036880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06f7fe640 1 -- 172.21.15.92:0/2607100036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561efe028ee0 con 0x561efe036dc0 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.837+0000 7fe06f7fe640 1 --2- 172.21.15.92:0/2607100036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe022370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe0680149e0 tx=0x7fe068009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c4751a54b66c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.838+0000 7fe0557fa640 1 -- 172.21.15.92:0/2607100036 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068004750 con 0x561efe036dc0 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.838+0000 7fe0557fa640 1 -- 172.21.15.92:0/2607100036 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe068005020 con 0x561efe036dc0 2024-09-21T07:15:13.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.838+0000 7fe0557fa640 1 -- 172.21.15.92:0/2607100036 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06800f6a0 con 0x561efe036dc0 2024-09-21T07:15:13.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.839+0000 7fe07bf5e740 1 -- 172.21.15.92:0/2607100036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 msgr2=0x561efe022370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.839+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/2607100036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe022370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe0680149e0 tx=0x7fe068009750 comp rx=0 tx=0).stop 2024-09-21T07:15:13.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.839+0000 7fe07bf5e740 1 -- 172.21.15.92:0/2607100036 shutdown_connections 2024-09-21T07:15:13.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.839+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/2607100036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe022370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.839+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/2607100036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc78070 0x561efe036880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.839+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/2607100036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc369f0 0x561efe02ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.839+0000 7fe07bf5e740 1 -- 172.21.15.92:0/2607100036 >> 172.21.15.92:0/2607100036 conn(0x561efdc6c460 msgr2=0x561efe025b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.839+0000 7fe07bf5e740 1 -- 172.21.15.92:0/2607100036 shutdown_connections 2024-09-21T07:15:13.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.839+0000 7fe07bf5e740 1 -- 172.21.15.92:0/2607100036 wait complete. 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.840+0000 7fe07bf5e740 1 -- start start 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.840+0000 7fe07bf5e740 1 Processor -- start 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.840+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc369f0 0x561efe02f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.840+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe02fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.840+0000 7fe07bf5e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe030280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.840+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b5570 con 0x561efdc369f0 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.840+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b8a00 con 0x561efdc78070 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.840+0000 7fe07bf5e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701b5be0 con 0x561efe036dc0 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe07bf5e740 10 client.0 _ll_register_callbacks cb 0x7fe0600097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe030280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe030280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:45760/0 (socket says 172.21.15.92:45760) 2024-09-21T07:15:13.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06f7fe640 1 -- 172.21.15.92:0/230889416 learned_addr learned my addr 172.21.15.92:0/230889416 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:13.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06effd640 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc369f0 0x561efe02f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe02fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06e7fc640 1 -- 172.21.15.92:0/230889416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 msgr2=0x561efe030280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe030280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06e7fc640 1 -- 172.21.15.92:0/230889416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc369f0 msgr2=0x561efe02f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:13.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc369f0 0x561efe02f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06e7fc640 1 -- 172.21.15.92:0/230889416 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561efe0a73a0 con 0x561efdc78070 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.841+0000 7fe06e7fc640 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe02fd40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0640cd710 tx=0x7fe064005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aed45fbb368994e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.842+0000 7fe04effd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.842+0000 7fe04effd640 1 -- 172.21.15.92:0/230889416 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064048040 con 0x561efdc78070 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.842+0000 7fe04effd640 1 -- 172.21.15.92:0/230889416 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe064105300 con 0x561efdc78070 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.842+0000 7fe07bf5e740 1 -- 172.21.15.92:0/230889416 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe068005020 con 0x561efdc78070 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.842+0000 7fe04effd640 1 -- 172.21.15.92:0/230889416 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe0640d2260 con 0x561efdc78070 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.842+0000 7fe07bf5e740 10 client.25679 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.842+0000 7fe07bf5e740 1 -- 172.21.15.92:0/230889416 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561efe0a8560 con 0x561efdc78070 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.842+0000 7fe04effd640 1 -- 172.21.15.92:0/230889416 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe068005020 con 0x561efdc78070 2024-09-21T07:15:13.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.843+0000 7fe04effd640 1 -- 172.21.15.92:0/230889416 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe06404b060 con 0x561efdc78070 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.843+0000 7fe07bf5e740 10 client.25679 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.843+0000 7fe07bf5e740 10 client.25679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.843+0000 7fe07bf5e740 20 client.25679 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.843+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561efe0a8c30 0x561efe0ab050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.843+0000 7fe07bf5e740 4 client.25679 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.843+0000 7fe07bf5e740 1 -- 172.21.15.92:0/230889416 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561efdf93850 con 0x561efe0a8c30 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.843+0000 7fe06effd640 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561efe0a8c30 0x561efe0ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe06effd640 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561efe0a8c30 0x561efe0ab050 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41c6258ae87e0399 server_cookie=ff1c55efbe2e7f31 in_seq=0 out_seq=0 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe04effd640 10 client.25679 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe04effd640 1 -- 172.21.15.92:0/230889416 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x561efdf93850 con 0x561efe0a8c30 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe04effd640 10 client.25679 handle_command_reply: tid=0 2024-09-21T07:15:13.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 client.25679 shutdown 2024-09-21T07:15:13.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 -- 172.21.15.92:0/230889416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 msgr2=0x561efe02fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe02fd40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0640cd710 tx=0x7fe064005ef0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 -- 172.21.15.92:0/230889416 shutdown_connections 2024-09-21T07:15:13.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561efe0a8c30 0x561efe0ab050 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561efe036dc0 0x561efe030280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561efdc78070 0x561efe02fd40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 --2- 172.21.15.92:0/230889416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561efdc369f0 0x561efe02f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 -- 172.21.15.92:0/230889416 >> 172.21.15.92:0/230889416 conn(0x561efdc6c460 msgr2=0x561efe025b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe04effd640 0 client.25679 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:13.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 -- 172.21.15.92:0/230889416 shutdown_connections 2024-09-21T07:15:13.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 1 -- 172.21.15.92:0/230889416 wait complete. 2024-09-21T07:15:13.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.844+0000 7fe07bf5e740 20 client.25679 trim_cache size 0 max 16384 2024-09-21T07:15:13.849 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:15:13.849 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:15:13.849 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:15:13.849 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:15:13.849 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "c9198dd4-042b-40fb-8657-b26652eb8d60", 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:15:13.850 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:13.851 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:13.852 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:15:13.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.845+0000 7fe0759ea640 1 -- 172.21.15.92:0/3964073655 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0580b6780 msgr2=0x7fe0580b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.845+0000 7fe0759ea640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0580b6780 0x7fe0580b8c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe068009fd0 tx=0x7fe068009240 comp rx=0 tx=0).stop 2024-09-21T07:15:13.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.845+0000 7fe0759ea640 1 -- 172.21.15.92:0/3964073655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0701030f0 msgr2=0x7fe0701a1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:13.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.845+0000 7fe0759ea640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0701030f0 0x7fe0701a1040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe064004770 tx=0x7fe064004040 comp rx=0 tx=0).stop 2024-09-21T07:15:13.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.845+0000 7fe0759ea640 1 -- 172.21.15.92:0/3964073655 shutdown_connections 2024-09-21T07:15:13.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.845+0000 7fe0759ea640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe0580b6780 0x7fe0580b8c90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.845+0000 7fe0759ea640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe070107be0 0x7fe0701a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.845+0000 7fe0759ea640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0701030f0 0x7fe0701a1040 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.845+0000 7fe0759ea640 1 --2- 172.21.15.92:0/3964073655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0701027a0 0x7fe0701a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:13.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.845+0000 7fe0759ea640 1 -- 172.21.15.92:0/3964073655 >> 172.21.15.92:0/3964073655 conn(0x7fe070079730 msgr2=0x7fe0701055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:13.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.846+0000 7fe0759ea640 1 -- 172.21.15.92:0/3964073655 shutdown_connections 2024-09-21T07:15:13.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:13.846+0000 7fe0759ea640 1 -- 172.21.15.92:0/3964073655 wait complete. 2024-09-21T07:15:14.798 INFO:tasks.cephfs.filesystem:scrub status for tag:c9198dd4-042b-40fb-8657-b26652eb8d60 - {'path': '/', 'tag': 'c9198dd4-042b-40fb-8657-b26652eb8d60', 'options': 'recursive,force'} 2024-09-21T07:15:15.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:14 smithi175 ceph-mon[34064]: pgmap v404: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 31 op/s 2024-09-21T07:15:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:14 smithi092 ceph-mon[30987]: pgmap v404: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 31 op/s 2024-09-21T07:15:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:14 smithi169 ceph-mon[33705]: pgmap v404: 129 pgs: 129 active+clean; 1.0 GiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 31 op/s 2024-09-21T07:15:16.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:15 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:15:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:15 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:15:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:15 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:15:17.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:16 smithi175 ceph-mon[34064]: pgmap v405: 129 pgs: 129 active+clean; 1.1 GiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 9.0 MiB/s wr, 16 op/s 2024-09-21T07:15:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:16 smithi092 ceph-mon[30987]: pgmap v405: 129 pgs: 129 active+clean; 1.1 GiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 9.0 MiB/s wr, 16 op/s 2024-09-21T07:15:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:16 smithi169 ceph-mon[33705]: pgmap v405: 129 pgs: 129 active+clean; 1.1 GiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 9.0 MiB/s wr, 16 op/s 2024-09-21T07:15:19.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:18 smithi175 ceph-mon[34064]: pgmap v406: 129 pgs: 129 active+clean; 1.2 GiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 18 MiB/s wr, 16 op/s 2024-09-21T07:15:19.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:18 smithi092 ceph-mon[30987]: pgmap v406: 129 pgs: 129 active+clean; 1.2 GiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 18 MiB/s wr, 16 op/s 2024-09-21T07:15:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:18 smithi169 ceph-mon[33705]: pgmap v406: 129 pgs: 129 active+clean; 1.2 GiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 18 MiB/s wr, 16 op/s 2024-09-21T07:15:20.632 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:20.632 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 rewriters = 50713.29 kB/sec 2024-09-21T07:15:20.632 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 rewriters = 50712.66 kB/sec 2024-09-21T07:15:20.633 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 50713.29 kB/sec 2024-09-21T07:15:20.633 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 50713.29 kB/sec 2024-09-21T07:15:20.633 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 50713.29 kB/sec 2024-09-21T07:15:20.633 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 1048576.00 kB 2024-09-21T07:15:21.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:20 smithi175 ceph-mon[34064]: pgmap v407: 129 pgs: 129 active+clean; 1.6 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 52 MiB/s wr, 28 op/s 2024-09-21T07:15:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:20 smithi092 ceph-mon[30987]: pgmap v407: 129 pgs: 129 active+clean; 1.6 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 52 MiB/s wr, 28 op/s 2024-09-21T07:15:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:20 smithi169 ceph-mon[33705]: pgmap v407: 129 pgs: 129 active+clean; 1.6 GiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 52 MiB/s wr, 28 op/s 2024-09-21T07:15:23.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:22 smithi175 ceph-mon[34064]: pgmap v408: 129 pgs: 129 active+clean; 1.7 GiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 60 MiB/s wr, 27 op/s 2024-09-21T07:15:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:22 smithi092 ceph-mon[30987]: pgmap v408: 129 pgs: 129 active+clean; 1.7 GiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 60 MiB/s wr, 27 op/s 2024-09-21T07:15:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:22 smithi169 ceph-mon[33705]: pgmap v408: 129 pgs: 129 active+clean; 1.7 GiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 60 MiB/s wr, 27 op/s 2024-09-21T07:15:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:24 smithi175 ceph-mon[34064]: pgmap v409: 129 pgs: 129 active+clean; 1.9 GiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 76 MiB/s wr, 33 op/s 2024-09-21T07:15:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 readers = 7324208.00 kB/sec 2024-09-21T07:15:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 readers = 7314183.73 kB/sec 2024-09-21T07:15:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 7324208.00 kB/sec 2024-09-21T07:15:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 7324208.00 kB/sec 2024-09-21T07:15:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 7324208.00 kB/sec 2024-09-21T07:15:25.020 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 1048576.00 kB 2024-09-21T07:15:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:24 smithi092 ceph-mon[30987]: pgmap v409: 129 pgs: 129 active+clean; 1.9 GiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 76 MiB/s wr, 33 op/s 2024-09-21T07:15:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:24 smithi169 ceph-mon[33705]: pgmap v409: 129 pgs: 129 active+clean; 1.9 GiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 76 MiB/s wr, 33 op/s 2024-09-21T07:15:26.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.836+0000 7fe010630640 1 -- 172.21.15.92:0/3642880691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe00810dd60 msgr2=0x7fe008110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:26.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.836+0000 7fe010630640 1 --2- 172.21.15.92:0/3642880691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe00810dd60 0x7fe008110250 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe000009900 tx=0x7fe00002a410 comp rx=0 tx=0).stop 2024-09-21T07:15:26.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.836+0000 7fe010630640 1 -- 172.21.15.92:0/3642880691 shutdown_connections 2024-09-21T07:15:26.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.836+0000 7fe010630640 1 --2- 172.21.15.92:0/3642880691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe00810dd60 0x7fe008110250 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.836+0000 7fe010630640 1 --2- 172.21.15.92:0/3642880691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe008105250 0x7fe00810d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.836+0000 7fe010630640 1 --2- 172.21.15.92:0/3642880691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe008104900 0x7fe008104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.836+0000 7fe010630640 1 -- 172.21.15.92:0/3642880691 >> 172.21.15.92:0/3642880691 conn(0x7fe00807a740 msgr2=0x7fe00807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:26.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.836+0000 7fe010630640 1 -- 172.21.15.92:0/3642880691 shutdown_connections 2024-09-21T07:15:26.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.836+0000 7fe010630640 1 -- 172.21.15.92:0/3642880691 wait complete. 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.837+0000 7fe010630640 1 Processor -- start 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.837+0000 7fe010630640 1 -- start start 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.837+0000 7fe010630640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe008104900 0x7fe00819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.837+0000 7fe010630640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008105250 0x7fe00819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.837+0000 7fe010630640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe00810dd60 0x7fe00819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.837+0000 7fe010630640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe008113890 con 0x7fe008105250 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.837+0000 7fe010630640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe008113710 con 0x7fe008104900 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.837+0000 7fe010630640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe008113a10 con 0x7fe00810dd60 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00dbcb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008105250 0x7fe00819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00dbcb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008105250 0x7fe00819a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52188/0 (socket says 172.21.15.92:52188) 2024-09-21T07:15:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00dbcb640 1 -- 172.21.15.92:0/1996003891 learned_addr learned my addr 172.21.15.92:0/1996003891 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe008104900 0x7fe00819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00ebcd640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe00810dd60 0x7fe00819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00dbcb640 1 -- 172.21.15.92:0/1996003891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe00810dd60 msgr2=0x7fe00819fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe00810dd60 0x7fe00819fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00dbcb640 1 -- 172.21.15.92:0/1996003891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe008104900 msgr2=0x7fe00819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe008104900 0x7fe00819a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00dbcb640 1 -- 172.21.15.92:0/1996003891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0081a0240 con 0x7fe008105250 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008105250 0x7fe00819a8b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00e9c0 tx=0x7fdffc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe0077fe640 1 -- 172.21.15.92:0/1996003891 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00ccc0 con 0x7fe008105250 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe0077fe640 1 -- 172.21.15.92:0/1996003891 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdffc0054b0 con 0x7fe008105250 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe010630640 1 -- 172.21.15.92:0/1996003891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0081a0530 con 0x7fe008105250 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe0077fe640 1 -- 172.21.15.92:0/1996003891 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc010430 con 0x7fe008105250 2024-09-21T07:15:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.838+0000 7fe010630640 1 -- 172.21.15.92:0/1996003891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0081a6cc0 con 0x7fe008105250 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.841+0000 7fe017681740 1 Processor -- start 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe017681740 1 -- start start 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe0077fe640 1 -- 172.21.15.92:0/1996003891 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fdffc004f20 con 0x7fe008105250 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe017681740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d3532c1b0 0x560d356d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe017681740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d353032f0 0x560d356d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe017681740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe017681740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560d356466f0 con 0x560d3530b4d0 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe017681740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560d35635b20 con 0x560d3532c1b0 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe017681740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560d35639930 con 0x560d353032f0 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe00dbcb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe00dbcb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356d2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52200/0 (socket says 172.21.15.92:52200) 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe00dbcb640 1 -- 172.21.15.92:0/9880649 learned_addr learned my addr 172.21.15.92:0/9880649 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe00ebcd640 1 --2- 172.21.15.92:0/9880649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d3532c1b0 0x560d356d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/9880649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d353032f0 0x560d356d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe00dbcb640 1 -- 172.21.15.92:0/9880649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d353032f0 msgr2=0x560d356d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/9880649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d353032f0 0x560d356d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.842+0000 7fe00dbcb640 1 -- 172.21.15.92:0/9880649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d3532c1b0 msgr2=0x560d356d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.843+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/9880649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d3532c1b0 0x560d356d19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.843+0000 7fe00dbcb640 1 -- 172.21.15.92:0/9880649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d355fb530 con 0x560d3530b4d0 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.843+0000 7fe00ebcd640 1 --2- 172.21.15.92:0/9880649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d3532c1b0 0x560d356d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.843+0000 7fe0077fe640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdff00b6700 0x7fdff00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.843+0000 7fe00ebcd640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdff00b6700 0x7fdff00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.843+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/9880649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356d2430 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0e5240 tx=0x7fdffc0f00e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb854e416bc454c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.843+0000 7fe0077fe640 1 -- 172.21.15.92:0/1996003891 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdffc0e7f20 con 0x7fe008105250 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.843+0000 7fe004bfe640 1 -- 172.21.15.92:0/9880649 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0a9870 con 0x560d3530b4d0 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.843+0000 7fe004bfe640 1 -- 172.21.15.92:0/9880649 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdffc0a9130 con 0x560d3530b4d0 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.843+0000 7fe004bfe640 1 -- 172.21.15.92:0/9880649 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00ce60 con 0x560d3530b4d0 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.844+0000 7fe017681740 1 -- 172.21.15.92:0/9880649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 msgr2=0x560d356d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.844+0000 7fe017681740 1 --2- 172.21.15.92:0/9880649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356d2430 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0e5240 tx=0x7fdffc0f00e0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.844+0000 7fe00ebcd640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdff00b6700 0x7fdff00b8c10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe000009230 tx=0x7fe0000058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.844+0000 7fe017681740 1 -- 172.21.15.92:0/9880649 shutdown_connections 2024-09-21T07:15:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.844+0000 7fe017681740 1 --2- 172.21.15.92:0/9880649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356d2430 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.844+0000 7fe017681740 1 --2- 172.21.15.92:0/9880649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d353032f0 0x560d356d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.844+0000 7fe017681740 1 --2- 172.21.15.92:0/9880649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d3532c1b0 0x560d356d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.844+0000 7fe017681740 1 -- 172.21.15.92:0/9880649 >> 172.21.15.92:0/9880649 conn(0x560d35320300 msgr2=0x560d356cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.844+0000 7fe017681740 1 -- 172.21.15.92:0/9880649 shutdown_connections 2024-09-21T07:15:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.844+0000 7fe017681740 1 -- 172.21.15.92:0/9880649 wait complete. 2024-09-21T07:15:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe017681740 1 -- start start 2024-09-21T07:15:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe017681740 1 Processor -- start 2024-09-21T07:15:26.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe017681740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d356dd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe017681740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356dd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe017681740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3532c1b0 0x560d356e9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe017681740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560d3556dab0 con 0x560d3530b4d0 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe017681740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560d355db730 con 0x560d353032f0 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe017681740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560d356e0130 con 0x560d3532c1b0 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe017681740 10 client.0 _ll_register_callbacks cb 0x560d3562f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00dbcb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00dbcb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356dd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52210/0 (socket says 172.21.15.92:52210) 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00dbcb640 1 -- 172.21.15.92:0/366560726 learned_addr learned my addr 172.21.15.92:0/366560726 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d356dd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00ebcd640 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3532c1b0 0x560d356e9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00dbcb640 1 -- 172.21.15.92:0/366560726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3532c1b0 msgr2=0x560d356e9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3532c1b0 0x560d356e9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00dbcb640 1 -- 172.21.15.92:0/366560726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 msgr2=0x560d356dd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d356dd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00dbcb640 1 -- 172.21.15.92:0/366560726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d35397790 con 0x560d3530b4d0 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.845+0000 7fe00ebcd640 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3532c1b0 0x560d356e9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356dd600 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0ad6d0 tx=0x7fdffc0aa150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4aaaab2eeb22a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fdfedffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fdfedffb640 1 -- 172.21.15.92:0/366560726 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0ad140 con 0x560d3530b4d0 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fdfedffb640 1 -- 172.21.15.92:0/366560726 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdffc0b6f60 con 0x560d3530b4d0 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fe017681740 1 -- 172.21.15.92:0/366560726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdffc0a9130 con 0x560d3530b4d0 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fdfedffb640 1 -- 172.21.15.92:0/366560726 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdffc0ad320 con 0x560d3530b4d0 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fe017681740 10 client.16398 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fe017681740 1 -- 172.21.15.92:0/366560726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560d35410620 con 0x560d3530b4d0 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fdfedffb640 1 -- 172.21.15.92:0/366560726 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdffc0a9130 con 0x560d3530b4d0 2024-09-21T07:15:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fdfedffb640 1 -- 172.21.15.92:0/366560726 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdffc0b20c0 con 0x560d3530b4d0 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fe017681740 10 client.16398 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fe017681740 10 client.16398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fe017681740 20 client.16398 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fe017681740 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560d352ead80 0x560d356ef030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fe017681740 4 client.16398 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.846+0000 7fe017681740 1 -- 172.21.15.92:0/366560726 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d35648640 con 0x560d352ead80 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.847+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560d352ead80 0x560d356ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.847+0000 7fdfedffb640 10 client.16398 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.847+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560d352ead80 0x560d356ef030 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55299b43687bc9f7 server_cookie=cc07a28de26708d2 in_seq=0 out_seq=0 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fdfedffb640 1 -- 172.21.15.92:0/366560726 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d35648640 con 0x560d352ead80 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fdfedffb640 10 client.16398 handle_command_reply: tid=0 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fe017681740 1 client.16398 shutdown 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fe017681740 1 -- 172.21.15.92:0/366560726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 msgr2=0x560d356dd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fe017681740 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356dd600 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0ad6d0 tx=0x7fdffc0aa150 comp rx=0 tx=0).stop 2024-09-21T07:15:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fe017681740 1 -- 172.21.15.92:0/366560726 shutdown_connections 2024-09-21T07:15:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fe017681740 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560d352ead80 0x560d356ef030 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fe017681740 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3532c1b0 0x560d356e9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fe017681740 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d3530b4d0 0x560d356dd600 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fdfedffb640 0 client.16398 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fe017681740 1 --2- 172.21.15.92:0/366560726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d356dd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fe017681740 1 -- 172.21.15.92:0/366560726 >> 172.21.15.92:0/366560726 conn(0x560d35320300 msgr2=0x560d356d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.848+0000 7fe017681740 1 -- 172.21.15.92:0/366560726 shutdown_connections 2024-09-21T07:15:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.849+0000 7fe017681740 1 -- 172.21.15.92:0/366560726 wait complete. 2024-09-21T07:15:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.849+0000 7fe017681740 20 client.16398 trim_cache size 0 max 16384 2024-09-21T07:15:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.863+0000 7fe017681740 1 Processor -- start 2024-09-21T07:15:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.863+0000 7fe017681740 1 -- start start 2024-09-21T07:15:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe017681740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d356dbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe017681740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d356d33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe017681740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 0x560d356dd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe017681740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe0081b0e80 con 0x560d352ead80 2024-09-21T07:15:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe017681740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0081b29c0 con 0x560d353032f0 2024-09-21T07:15:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe017681740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0081b1550 con 0x560d3530b4d0 2024-09-21T07:15:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00e3cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d356dbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00e3cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d356dbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52218/0 (socket says 172.21.15.92:52218) 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00e3cc640 1 -- 172.21.15.92:0/1921570058 learned_addr learned my addr 172.21.15.92:0/1921570058 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00ebcd640 1 --2- 172.21.15.92:0/1921570058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 0x560d356dd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00e3cc640 1 -- 172.21.15.92:0/1921570058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 msgr2=0x560d356dd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/1921570058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 0x560d356dd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00e3cc640 1 -- 172.21.15.92:0/1921570058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 msgr2=0x560d356d33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/1921570058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d356d33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00e3cc640 1 -- 172.21.15.92:0/1921570058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d356cad50 con 0x560d352ead80 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00ebcd640 1 --2- 172.21.15.92:0/1921570058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 0x560d356dd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/1921570058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d356dbf90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdff8014570 tx=0x7fdff8014a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470126c41d2cd016 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fdfeffff640 1 -- 172.21.15.92:0/1921570058 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff80141d0 con 0x560d352ead80 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fdfeffff640 1 -- 172.21.15.92:0/1921570058 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdff8011990 con 0x560d352ead80 2024-09-21T07:15:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.864+0000 7fdfeffff640 1 -- 172.21.15.92:0/1921570058 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff8012910 con 0x560d352ead80 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.865+0000 7fe017681740 1 -- 172.21.15.92:0/1921570058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 msgr2=0x560d356dbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.865+0000 7fe017681740 1 --2- 172.21.15.92:0/1921570058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d356dbf90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdff8014570 tx=0x7fdff8014a30 comp rx=0 tx=0).stop 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.865+0000 7fe017681740 1 -- 172.21.15.92:0/1921570058 shutdown_connections 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.865+0000 7fe017681740 1 --2- 172.21.15.92:0/1921570058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 0x560d356dd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.865+0000 7fe017681740 1 --2- 172.21.15.92:0/1921570058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d356d33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.865+0000 7fe017681740 1 --2- 172.21.15.92:0/1921570058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d356dbf90 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.865+0000 7fe017681740 1 -- 172.21.15.92:0/1921570058 >> 172.21.15.92:0/1921570058 conn(0x560d35320300 msgr2=0x560d356de5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.865+0000 7fe017681740 1 -- 172.21.15.92:0/1921570058 shutdown_connections 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.865+0000 7fe017681740 1 -- 172.21.15.92:0/1921570058 wait complete. 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.865+0000 7fe017681740 1 -- start start 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe017681740 1 Processor -- start 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe017681740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d3574fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe017681740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d357504a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe017681740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 0x560d357554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe017681740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe0081b22f0 con 0x560d352ead80 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe017681740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0081b1c20 con 0x560d353032f0 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe017681740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0081aee60 con 0x560d3530b4d0 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe017681740 10 client.0 _ll_register_callbacks cb 0x7fdffc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00e3cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d3574fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00e3cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d3574fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52222/0 (socket says 172.21.15.92:52222) 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00e3cc640 1 -- 172.21.15.92:0/2661517068 learned_addr learned my addr 172.21.15.92:0/2661517068 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00ebcd640 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 0x560d357554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d357504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00e3cc640 1 -- 172.21.15.92:0/2661517068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 msgr2=0x560d357554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 0x560d357554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00e3cc640 1 -- 172.21.15.92:0/2661517068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 msgr2=0x560d357504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d357504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00e3cc640 1 -- 172.21.15.92:0/2661517068 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d35755b50 con 0x560d352ead80 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d357504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fe00e3cc640 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d3574fec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fdff800a010 tx=0x7fdff8011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141af4959af389fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.866+0000 7fdfedffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fdfedffb640 1 -- 172.21.15.92:0/2661517068 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff8029040 con 0x560d352ead80 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fdfedffb640 1 -- 172.21.15.92:0/2661517068 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdff8011500 con 0x560d352ead80 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fe017681740 1 -- 172.21.15.92:0/2661517068 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdff8011990 con 0x560d352ead80 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fdfedffb640 1 -- 172.21.15.92:0/2661517068 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdff803c050 con 0x560d352ead80 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fe017681740 10 client.16404 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fe017681740 1 -- 172.21.15.92:0/2661517068 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560d3575cee0 con 0x560d352ead80 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fdfedffb640 1 -- 172.21.15.92:0/2661517068 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdff8011990 con 0x560d352ead80 2024-09-21T07:15:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fdfedffb640 1 -- 172.21.15.92:0/2661517068 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdff800f040 con 0x560d352ead80 2024-09-21T07:15:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fe017681740 10 client.16404 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fe017681740 10 client.16404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fe017681740 20 client.16404 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fe017681740 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560d3532c1b0 0x560d3575f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fe017681740 4 client.16404 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:15:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fe017681740 1 -- 172.21.15.92:0/2661517068 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d356440f0 con 0x560d3532c1b0 2024-09-21T07:15:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.867+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560d3532c1b0 0x560d3575f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.868+0000 7fdfedffb640 10 client.16404 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.868+0000 7fe00dbcb640 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560d3532c1b0 0x560d3575f670 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b480941578f4950e server_cookie=e7edf16c4d55cd41 in_seq=0 out_seq=0 2024-09-21T07:15:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.876+0000 7fdfedffb640 1 -- 172.21.15.92:0/2661517068 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d356440f0 con 0x560d3532c1b0 2024-09-21T07:15:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.876+0000 7fdfedffb640 10 client.16404 handle_command_reply: tid=0 2024-09-21T07:15:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.876+0000 7fe017681740 1 client.16404 shutdown 2024-09-21T07:15:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 1 -- 172.21.15.92:0/2661517068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 msgr2=0x560d3574fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d3574fec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fdff800a010 tx=0x7fdff8011bc0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 1 -- 172.21.15.92:0/2661517068 shutdown_connections 2024-09-21T07:15:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560d3532c1b0 0x560d3575f670 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d3530b4d0 0x560d357554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fdfedffb640 0 client.16404 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560d353032f0 0x560d357504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 1 --2- 172.21.15.92:0/2661517068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d352ead80 0x560d3574fec0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 1 -- 172.21.15.92:0/2661517068 >> 172.21.15.92:0/2661517068 conn(0x560d35320300 msgr2=0x560d356ded50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 1 -- 172.21.15.92:0/2661517068 shutdown_connections 2024-09-21T07:15:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 1 -- 172.21.15.92:0/2661517068 wait complete. 2024-09-21T07:15:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe017681740 20 client.16404 trim_cache size 0 max 16384 2024-09-21T07:15:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:15:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:15:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:15:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:15:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe010630640 1 -- 172.21.15.92:0/1996003891 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdff00b6700 msgr2=0x7fdff00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe010630640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdff00b6700 0x7fdff00b8c10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe000009230 tx=0x7fe0000058d0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe010630640 1 -- 172.21.15.92:0/1996003891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008105250 msgr2=0x7fe00819a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe010630640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008105250 0x7fe00819a8b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00e9c0 tx=0x7fdffc00ee80 comp rx=0 tx=0).stop 2024-09-21T07:15:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe010630640 1 -- 172.21.15.92:0/1996003891 shutdown_connections 2024-09-21T07:15:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe010630640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdff00b6700 0x7fdff00b8c10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.877+0000 7fe010630640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe00810dd60 0x7fe00819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.878+0000 7fe010630640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008105250 0x7fe00819a8b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.878+0000 7fe010630640 1 --2- 172.21.15.92:0/1996003891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe008104900 0x7fe00819a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.878+0000 7fe010630640 1 -- 172.21.15.92:0/1996003891 >> 172.21.15.92:0/1996003891 conn(0x7fe00807a740 msgr2=0x7fe008107850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.878+0000 7fe010630640 1 -- 172.21.15.92:0/1996003891 shutdown_connections 2024-09-21T07:15:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:26.878+0000 7fe010630640 1 -- 172.21.15.92:0/1996003891 wait complete. 2024-09-21T07:15:27.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:26 smithi175 ceph-mon[34064]: pgmap v410: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 80 MiB/s wr, 32 op/s 2024-09-21T07:15:27.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:26 smithi092 ceph-mon[30987]: pgmap v410: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 80 MiB/s wr, 32 op/s 2024-09-21T07:15:27.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:26 smithi169 ceph-mon[33705]: pgmap v410: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 80 MiB/s wr, 32 op/s 2024-09-21T07:15:27.254 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:27.255 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 re-readers = 7646026.50 kB/sec 2024-09-21T07:15:27.255 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 re-readers = 7635274.64 kB/sec 2024-09-21T07:15:27.255 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 7646026.50 kB/sec 2024-09-21T07:15:27.255 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 7646026.50 kB/sec 2024-09-21T07:15:27.255 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 7646026.50 kB/sec 2024-09-21T07:15:27.255 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 1048576.00 kB 2024-09-21T07:15:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:28 smithi175 ceph-mon[34064]: pgmap v411: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 74 MiB/s wr, 28 op/s 2024-09-21T07:15:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:28 smithi092 ceph-mon[30987]: pgmap v411: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 74 MiB/s wr, 28 op/s 2024-09-21T07:15:29.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:28 smithi169 ceph-mon[33705]: pgmap v411: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 74 MiB/s wr, 28 op/s 2024-09-21T07:15:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:30 smithi175 ceph-mon[34064]: pgmap v412: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 63 MiB/s wr, 29 op/s 2024-09-21T07:15:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:30 smithi092 ceph-mon[30987]: pgmap v412: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 63 MiB/s wr, 29 op/s 2024-09-21T07:15:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:30 smithi169 ceph-mon[33705]: pgmap v412: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 63 MiB/s wr, 29 op/s 2024-09-21T07:15:33.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:32 smithi175 ceph-mon[34064]: pgmap v413: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 29 MiB/s wr, 18 op/s 2024-09-21T07:15:33.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:32 smithi092 ceph-mon[30987]: pgmap v413: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 29 MiB/s wr, 18 op/s 2024-09-21T07:15:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:32 smithi169 ceph-mon[33705]: pgmap v413: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 29 MiB/s wr, 18 op/s 2024-09-21T07:15:33.625 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:33.625 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:33.626 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:33.626 INFO:tasks.workunit.client.0.smithi092.stdout:iozone test complete. 2024-09-21T07:15:33.626 INFO:tasks.workunit.client.0.smithi092.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-21T07:15:33.692 INFO:tasks.workunit.client.0.smithi092.stdout: Iozone: Performance Test of File I/O 2024-09-21T07:15:33.692 INFO:tasks.workunit.client.0.smithi092.stdout: Version $Revision: 3.494 $ 2024-09-21T07:15:33.692 INFO:tasks.workunit.client.0.smithi092.stdout: Compiled for 64 bit mode. 2024-09-21T07:15:33.692 INFO:tasks.workunit.client.0.smithi092.stdout: Build: linux-AMD64 2024-09-21T07:15:33.692 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:33.692 INFO:tasks.workunit.client.0.smithi092.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-21T07:15:33.692 INFO:tasks.workunit.client.0.smithi092.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Run began: Sat Sep 21 07:15:33 2024 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Include close in write timing 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Include fsync in write timing 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: File size set to 1048576 kB 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Record Size 1024 kB 2024-09-21T07:15:33.693 INFO:tasks.workunit.client.0.smithi092.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-21T07:15:33.694 INFO:tasks.workunit.client.0.smithi092.stdout: Output is in kBytes/sec 2024-09-21T07:15:33.694 INFO:tasks.workunit.client.0.smithi092.stdout: Time Resolution = 0.000001 seconds. 2024-09-21T07:15:33.694 INFO:tasks.workunit.client.0.smithi092.stdout: Processor cache size set to 1024 kBytes. 2024-09-21T07:15:33.694 INFO:tasks.workunit.client.0.smithi092.stdout: Processor cache line size set to 32 bytes. 2024-09-21T07:15:33.694 INFO:tasks.workunit.client.0.smithi092.stdout: File stride size set to 17 * record size. 2024-09-21T07:15:33.694 INFO:tasks.workunit.client.0.smithi092.stdout: Throughput test with 1 process 2024-09-21T07:15:33.694 INFO:tasks.workunit.client.0.smithi092.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-09-21T07:15:35.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:34 smithi175 ceph-mon[34064]: pgmap v414: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 21 MiB/s wr, 18 op/s 2024-09-21T07:15:35.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:34 smithi092 ceph-mon[30987]: pgmap v414: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 21 MiB/s wr, 18 op/s 2024-09-21T07:15:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:34 smithi169 ceph-mon[33705]: pgmap v414: 129 pgs: 129 active+clean; 1.9 GiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 21 MiB/s wr, 18 op/s 2024-09-21T07:15:35.357 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:35.357 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 initial writers = 642279.19 kB/sec 2024-09-21T07:15:35.357 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 initial writers = 642167.41 kB/sec 2024-09-21T07:15:35.357 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 642279.19 kB/sec 2024-09-21T07:15:35.357 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 642279.19 kB/sec 2024-09-21T07:15:35.357 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 642279.19 kB/sec 2024-09-21T07:15:35.358 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 1048576.00 kB 2024-09-21T07:15:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:35 smithi175 ceph-mon[34064]: pgmap v415: 129 pgs: 129 active+clean; 2.1 GiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 MiB/s wr, 16 op/s 2024-09-21T07:15:36.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:35 smithi092 ceph-mon[30987]: pgmap v415: 129 pgs: 129 active+clean; 2.1 GiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 MiB/s wr, 16 op/s 2024-09-21T07:15:36.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:35 smithi169 ceph-mon[33705]: pgmap v415: 129 pgs: 129 active+clean; 2.1 GiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 MiB/s wr, 16 op/s 2024-09-21T07:15:39.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:38 smithi175 ceph-mon[34064]: pgmap v416: 129 pgs: 129 active+clean; 2.1 GiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-21T07:15:39.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:38 smithi092 ceph-mon[30987]: pgmap v416: 129 pgs: 129 active+clean; 2.1 GiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-21T07:15:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:38 smithi169 ceph-mon[33705]: pgmap v416: 129 pgs: 129 active+clean; 2.1 GiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-21T07:15:39.549 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:39.549 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 rewriters = 711935.31 kB/sec 2024-09-21T07:15:39.549 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 rewriters = 711834.73 kB/sec 2024-09-21T07:15:39.549 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 711935.31 kB/sec 2024-09-21T07:15:39.549 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 711935.31 kB/sec 2024-09-21T07:15:39.550 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 711935.31 kB/sec 2024-09-21T07:15:39.550 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 1048576.00 kB 2024-09-21T07:15:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.982+0000 7f49806d5640 1 -- 172.21.15.92:0/3747398529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49781029b0 msgr2=0x7f4978102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.982+0000 7f49806d5640 1 --2- 172.21.15.92:0/3747398529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49781029b0 0x7f4978102dc0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4974009900 tx=0x7f497402a410 comp rx=0 tx=0).stop 2024-09-21T07:15:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.982+0000 7f49806d5640 1 -- 172.21.15.92:0/3747398529 shutdown_connections 2024-09-21T07:15:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.982+0000 7f49806d5640 1 --2- 172.21.15.92:0/3747398529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4978108c30 0x7f497810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.982+0000 7f49806d5640 1 --2- 172.21.15.92:0/3747398529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f49781082e0 0x7f49781086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.982+0000 7f49806d5640 1 --2- 172.21.15.92:0/3747398529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49781029b0 0x7f4978102dc0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.982+0000 7f49806d5640 1 -- 172.21.15.92:0/3747398529 >> 172.21.15.92:0/3747398529 conn(0x7f497807a740 msgr2=0x7f497807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.982+0000 7f49806d5640 1 -- 172.21.15.92:0/3747398529 shutdown_connections 2024-09-21T07:15:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.982+0000 7f49806d5640 1 -- 172.21.15.92:0/3747398529 wait complete. 2024-09-21T07:15:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f49806d5640 1 Processor -- start 2024-09-21T07:15:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f49806d5640 1 -- start start 2024-09-21T07:15:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f49806d5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49781029b0 0x7f4978199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f49806d5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49781082e0 0x7f4978199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f49806d5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4978108c30 0x7f497819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f49806d5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f49781127a0 con 0x7f49781082e0 2024-09-21T07:15:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f49806d5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4978112620 con 0x7f4978108c30 2024-09-21T07:15:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f49806d5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4978112920 con 0x7f49781029b0 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f497dc70640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49781082e0 0x7f4978199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f497dc70640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49781082e0 0x7f4978199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59094/0 (socket says 172.21.15.92:59094) 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f497dc70640 1 -- 172.21.15.92:0/1211521661 learned_addr learned my addr 172.21.15.92:0/1211521661 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.983+0000 7f497e471640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49781029b0 0x7f4978199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f497ec72640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4978108c30 0x7f497819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f497dc70640 1 -- 172.21.15.92:0/1211521661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49781029b0 msgr2=0x7f4978199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f497dc70640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49781029b0 0x7f4978199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f497dc70640 1 -- 172.21.15.92:0/1211521661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4978108c30 msgr2=0x7f497819ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f497dc70640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4978108c30 0x7f497819ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f497dc70640 1 -- 172.21.15.92:0/1211521661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497819f2b0 con 0x7f49781082e0 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f497e471640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49781029b0 0x7f4978199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f497ec72640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4978108c30 0x7f497819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f497dc70640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49781082e0 0x7f4978199920 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f496800d740 tx=0x7f496800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f496f7fe640 1 -- 172.21.15.92:0/1211521661 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968017070 con 0x7f49781082e0 2024-09-21T07:15:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f496f7fe640 1 -- 172.21.15.92:0/1211521661 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f496800de50 con 0x7f49781082e0 2024-09-21T07:15:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f49806d5640 1 -- 172.21.15.92:0/1211521661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497819f5a0 con 0x7f49781082e0 2024-09-21T07:15:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f496f7fe640 1 -- 172.21.15.92:0/1211521661 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496800f620 con 0x7f49781082e0 2024-09-21T07:15:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.984+0000 7f49806d5640 1 -- 172.21.15.92:0/1211521661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497806abe0 con 0x7f49781082e0 2024-09-21T07:15:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f498763f740 1 Processor -- start 2024-09-21T07:15:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f498763f740 1 -- start start 2024-09-21T07:15:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f496f7fe640 1 -- 172.21.15.92:0/1211521661 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f496801a070 con 0x7f49781082e0 2024-09-21T07:15:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f498763f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9e51b0 0x55d57cd8a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f498763f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cd8aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f498763f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9c44d0 0x55d57cd8b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f498763f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d57ccff6f0 con 0x55d57c9bc2f0 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f498763f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d57cceeb20 con 0x55d57c9e51b0 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f498763f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d57ccf2930 con 0x55d57c9c44d0 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f497e471640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cd8aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f497e471640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cd8aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59106/0 (socket says 172.21.15.92:59106) 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f497e471640 1 -- 172.21.15.92:0/1807719843 learned_addr learned my addr 172.21.15.92:0/1807719843 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.987+0000 7f497ec72640 1 --2- 172.21.15.92:0/1807719843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9e51b0 0x55d57cd8a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f497dc70640 1 --2- 172.21.15.92:0/1807719843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9c44d0 0x55d57cd8b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f497e471640 1 -- 172.21.15.92:0/1807719843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9c44d0 msgr2=0x55d57cd8b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f497e471640 1 --2- 172.21.15.92:0/1807719843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9c44d0 0x55d57cd8b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f497e471640 1 -- 172.21.15.92:0/1807719843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9e51b0 msgr2=0x55d57cd8a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f497e471640 1 --2- 172.21.15.92:0/1807719843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9e51b0 0x55d57cd8a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f497e471640 1 -- 172.21.15.92:0/1807719843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d57ccb4530 con 0x55d57c9bc2f0 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f497e471640 1 --2- 172.21.15.92:0/1807719843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cd8aef0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4974009900 tx=0x7f4974032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93746f54b4a3105e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f496f7fe640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49640b6680 0x7f49640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f497ec72640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49640b6680 0x7f49640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f496cff9640 1 -- 172.21.15.92:0/1807719843 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497403f070 con 0x55d57c9bc2f0 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f496cff9640 1 -- 172.21.15.92:0/1807719843 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4974005de0 con 0x55d57c9bc2f0 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f496cff9640 1 -- 172.21.15.92:0/1807719843 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974035070 con 0x55d57c9bc2f0 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.988+0000 7f496f7fe640 1 -- 172.21.15.92:0/1211521661 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f49680e7570 con 0x7f49781082e0 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.989+0000 7f497ec72640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49640b6680 0x7f49640b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4970009370 tx=0x7f4970009720 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.989+0000 7f498763f740 1 -- 172.21.15.92:0/1807719843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 msgr2=0x55d57cd8aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.989+0000 7f498763f740 1 --2- 172.21.15.92:0/1807719843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cd8aef0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4974009900 tx=0x7f4974032dd0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.989+0000 7f498763f740 1 -- 172.21.15.92:0/1807719843 shutdown_connections 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.989+0000 7f498763f740 1 --2- 172.21.15.92:0/1807719843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9c44d0 0x55d57cd8b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.989+0000 7f498763f740 1 --2- 172.21.15.92:0/1807719843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cd8aef0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.989+0000 7f498763f740 1 --2- 172.21.15.92:0/1807719843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9e51b0 0x55d57cd8a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.989+0000 7f498763f740 1 -- 172.21.15.92:0/1807719843 >> 172.21.15.92:0/1807719843 conn(0x55d57c9d9300 msgr2=0x55d57cd888a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.989+0000 7f498763f740 1 -- 172.21.15.92:0/1807719843 shutdown_connections 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.989+0000 7f498763f740 1 -- 172.21.15.92:0/1807719843 wait complete. 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f498763f740 1 -- start start 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f498763f740 1 Processor -- start 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f498763f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 0x55d57cd960a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f498763f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cd965e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f498763f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9e51b0 0x55d57cda23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f498763f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d57cc26ab0 con 0x55d57c9e51b0 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f498763f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d57cc94730 con 0x55d57c9c44d0 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f498763f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d57cd990d0 con 0x55d57c9bc2f0 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f498763f740 10 client.0 _ll_register_callbacks cb 0x55d57cce86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f497ec72640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9e51b0 0x55d57cda23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f497ec72640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9e51b0 0x55d57cda23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59118/0 (socket says 172.21.15.92:59118) 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f497e471640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 0x55d57cd960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f497ec72640 1 -- 172.21.15.92:0/207686020 learned_addr learned my addr 172.21.15.92:0/207686020 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.990+0000 7f497dc70640 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cd965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f497ec72640 1 -- 172.21.15.92:0/207686020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 msgr2=0x55d57cd960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f497ec72640 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 0x55d57cd960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f497ec72640 1 -- 172.21.15.92:0/207686020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 msgr2=0x55d57cd965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f497ec72640 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cd965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f497ec72640 1 -- 172.21.15.92:0/207686020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d57ca50790 con 0x55d57c9e51b0 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f497e471640 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 0x55d57cd960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f497dc70640 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cd965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f497ec72640 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9e51b0 0x55d57cda23c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4970009d70 tx=0x7f4970004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3412b200c6af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f4961ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f4961ffb640 1 -- 172.21.15.92:0/207686020 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970004d20 con 0x55d57c9e51b0 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f4961ffb640 1 -- 172.21.15.92:0/207686020 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f497000eae0 con 0x55d57c9e51b0 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f498763f740 1 -- 172.21.15.92:0/207686020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d57cd01640 con 0x55d57c9e51b0 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f4961ffb640 1 -- 172.21.15.92:0/207686020 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f497002f050 con 0x55d57c9e51b0 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f498763f740 10 client.16416 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.991+0000 7f498763f740 1 -- 172.21.15.92:0/207686020 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d57cac9620 con 0x55d57c9e51b0 2024-09-21T07:15:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.992+0000 7f4961ffb640 1 -- 172.21.15.92:0/207686020 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d57cd01640 con 0x55d57c9e51b0 2024-09-21T07:15:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.992+0000 7f4961ffb640 1 -- 172.21.15.92:0/207686020 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f497000f040 con 0x55d57c9e51b0 2024-09-21T07:15:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.992+0000 7f498763f740 10 client.16416 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.992+0000 7f498763f740 10 client.16416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.992+0000 7f498763f740 20 client.16416 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.992+0000 7f498763f740 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d57c9a3d80 0x55d57cda82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.992+0000 7f498763f740 4 client.16416 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.992+0000 7f498763f740 1 -- 172.21.15.92:0/207686020 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d57ccfd0f0 con 0x55d57c9a3d80 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.992+0000 7f497e471640 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d57c9a3d80 0x55d57cda82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.993+0000 7f4961ffb640 10 client.16416 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.993+0000 7f497e471640 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d57c9a3d80 0x55d57cda82d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1eb52af01557dc2c server_cookie=e4bafab5cc5da64 in_seq=0 out_seq=0 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.993+0000 7f4961ffb640 1 -- 172.21.15.92:0/207686020 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d57ccfd0f0 con 0x55d57c9a3d80 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.993+0000 7f4961ffb640 10 client.16416 handle_command_reply: tid=0 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 client.16416 shutdown 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 -- 172.21.15.92:0/207686020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9e51b0 msgr2=0x55d57cda23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9e51b0 0x55d57cda23c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4970009d70 tx=0x7f4970004a40 comp rx=0 tx=0).stop 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 -- 172.21.15.92:0/207686020 shutdown_connections 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d57c9a3d80 0x55d57cda82d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9e51b0 0x55d57cda23c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cd965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f4961ffb640 0 client.16416 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 --2- 172.21.15.92:0/207686020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 0x55d57cd960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 -- 172.21.15.92:0/207686020 >> 172.21.15.92:0/207686020 conn(0x55d57c9d9300 msgr2=0x55d57cd8b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 -- 172.21.15.92:0/207686020 shutdown_connections 2024-09-21T07:15:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 1 -- 172.21.15.92:0/207686020 wait complete. 2024-09-21T07:15:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:39.994+0000 7f498763f740 20 client.16416 trim_cache size 0 max 16384 2024-09-21T07:15:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.008+0000 7f498763f740 1 Processor -- start 2024-09-21T07:15:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.008+0000 7f498763f740 1 -- start start 2024-09-21T07:15:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f498763f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9a3d80 0x55d57cd8c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f498763f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cda22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f498763f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cda2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f498763f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f49781b0e60 con 0x55d57c9bc2f0 2024-09-21T07:15:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f498763f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f49781b29a0 con 0x55d57c9c44d0 2024-09-21T07:15:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f498763f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f49781b1530 con 0x55d57c9a3d80 2024-09-21T07:15:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497dc70640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cda22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497dc70640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cda22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59130/0 (socket says 172.21.15.92:59130) 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497dc70640 1 -- 172.21.15.92:0/3272490597 learned_addr learned my addr 172.21.15.92:0/3272490597 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497e471640 1 --2- 172.21.15.92:0/3272490597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9a3d80 0x55d57cd8c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497ec72640 1 --2- 172.21.15.92:0/3272490597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cda2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497dc70640 1 -- 172.21.15.92:0/3272490597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9a3d80 msgr2=0x55d57cd8c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497dc70640 1 --2- 172.21.15.92:0/3272490597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9a3d80 0x55d57cd8c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497dc70640 1 -- 172.21.15.92:0/3272490597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 msgr2=0x55d57cda2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497dc70640 1 --2- 172.21.15.92:0/3272490597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cda2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497dc70640 1 -- 172.21.15.92:0/3272490597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d57cda4d50 con 0x55d57c9bc2f0 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f497dc70640 1 --2- 172.21.15.92:0/3272490597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cda22c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f49680aa290 tx=0x7f49680eaf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29247a700f3361e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f4963fff640 1 -- 172.21.15.92:0/3272490597 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968021040 con 0x55d57c9bc2f0 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f4963fff640 1 -- 172.21.15.92:0/3272490597 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49680acb30 con 0x55d57c9bc2f0 2024-09-21T07:15:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.009+0000 7f4963fff640 1 -- 172.21.15.92:0/3272490597 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49680ad720 con 0x55d57c9bc2f0 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.010+0000 7f498763f740 1 -- 172.21.15.92:0/3272490597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 msgr2=0x55d57cda22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.010+0000 7f498763f740 1 --2- 172.21.15.92:0/3272490597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cda22c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f49680aa290 tx=0x7f49680eaf90 comp rx=0 tx=0).stop 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.010+0000 7f498763f740 1 -- 172.21.15.92:0/3272490597 shutdown_connections 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.010+0000 7f498763f740 1 --2- 172.21.15.92:0/3272490597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cda2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.010+0000 7f498763f740 1 --2- 172.21.15.92:0/3272490597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9bc2f0 0x55d57cda22c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.010+0000 7f498763f740 1 --2- 172.21.15.92:0/3272490597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9a3d80 0x55d57cd8c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.010+0000 7f498763f740 1 -- 172.21.15.92:0/3272490597 >> 172.21.15.92:0/3272490597 conn(0x55d57c9d9300 msgr2=0x55d57cd8b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.010+0000 7f498763f740 1 -- 172.21.15.92:0/3272490597 shutdown_connections 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.010+0000 7f498763f740 1 -- 172.21.15.92:0/3272490597 wait complete. 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f498763f740 1 -- start start 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f498763f740 1 Processor -- start 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f498763f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9a3d80 0x55d57cd9ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f498763f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 0x55d57cd99300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f498763f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cd99a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f498763f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f49781b22d0 con 0x55d57c9a3d80 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f498763f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f49781b1c00 con 0x55d57c9c44d0 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f498763f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f49781aee40 con 0x55d57c9bc2f0 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f498763f740 10 client.0 _ll_register_callbacks cb 0x7f4970009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497e471640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9a3d80 0x55d57cd9ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497e471640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9a3d80 0x55d57cd9ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59140/0 (socket says 172.21.15.92:59140) 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497e471640 1 -- 172.21.15.92:0/3515783747 learned_addr learned my addr 172.21.15.92:0/3515783747 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497dc70640 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 0x55d57cd99300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497ec72640 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cd99a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497e471640 1 -- 172.21.15.92:0/3515783747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 msgr2=0x55d57cd99300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497e471640 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 0x55d57cd99300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497e471640 1 -- 172.21.15.92:0/3515783747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 msgr2=0x55d57cd99a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497e471640 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cd99a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497e471640 1 -- 172.21.15.92:0/3515783747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d57ce10cc0 con 0x55d57c9a3d80 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.011+0000 7f497ec72640 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cd99a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f497e471640 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9a3d80 0x55d57cd9ecf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55d57cd89630 tx=0x7f4974031830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19eb8c3286d4ba56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f4961ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f4961ffb640 1 -- 172.21.15.92:0/3515783747 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497403f040 con 0x55d57c9a3d80 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f4961ffb640 1 -- 172.21.15.92:0/3515783747 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4974031a70 con 0x55d57c9a3d80 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f498763f740 1 -- 172.21.15.92:0/3515783747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49680acb30 con 0x55d57c9a3d80 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f4961ffb640 1 -- 172.21.15.92:0/3515783747 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f497405f050 con 0x55d57c9a3d80 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f498763f740 10 client.16422 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f498763f740 1 -- 172.21.15.92:0/3515783747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d57ce11e00 con 0x55d57c9a3d80 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f4961ffb640 1 -- 172.21.15.92:0/3515783747 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49680acb30 con 0x55d57c9a3d80 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f4961ffb640 1 -- 172.21.15.92:0/3515783747 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4974003710 con 0x55d57c9a3d80 2024-09-21T07:15:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f498763f740 10 client.16422 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f498763f740 10 client.16422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f498763f740 20 client.16422 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f498763f740 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d57c9e51b0 0x55d57ce14260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f498763f740 4 client.16422 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:15:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.012+0000 7f498763f740 1 -- 172.21.15.92:0/3515783747 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d57ccfa520 con 0x55d57c9e51b0 2024-09-21T07:15:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.013+0000 7f497dc70640 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d57c9e51b0 0x55d57ce14260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.013+0000 7f497dc70640 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d57c9e51b0 0x55d57ce14260 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=386c11179bfcb477 server_cookie=748cec1fcd92610c in_seq=0 out_seq=0 2024-09-21T07:15:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.013+0000 7f4961ffb640 10 client.16422 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:40.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f4961ffb640 1 -- 172.21.15.92:0/3515783747 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d57ccfa520 con 0x55d57c9e51b0 2024-09-21T07:15:40.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f4961ffb640 10 client.16422 handle_command_reply: tid=0 2024-09-21T07:15:40.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 client.16422 shutdown 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 -- 172.21.15.92:0/3515783747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9a3d80 msgr2=0x55d57cd9ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9a3d80 0x55d57cd9ecf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55d57cd89630 tx=0x7f4974031830 comp rx=0 tx=0).stop 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 -- 172.21.15.92:0/3515783747 shutdown_connections 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d57c9e51b0 0x55d57ce14260 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d57c9c44d0 0x55d57cd99a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c9bc2f0 0x55d57cd99300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f4961ffb640 0 client.16422 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 --2- 172.21.15.92:0/3515783747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d57c9a3d80 0x55d57cd9ecf0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 -- 172.21.15.92:0/3515783747 >> 172.21.15.92:0/3515783747 conn(0x55d57c9d9300 msgr2=0x55d57cd97360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 -- 172.21.15.92:0/3515783747 shutdown_connections 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 1 -- 172.21.15.92:0/3515783747 wait complete. 2024-09-21T07:15:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.023+0000 7f498763f740 20 client.16422 trim_cache size 0 max 16384 2024-09-21T07:15:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:15:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:15:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:15:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 -- 172.21.15.92:0/1211521661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49640b6680 msgr2=0x7f49640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49640b6680 0x7f49640b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4970009370 tx=0x7f4970009720 comp rx=0 tx=0).stop 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 -- 172.21.15.92:0/1211521661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49781082e0 msgr2=0x7f4978199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49781082e0 0x7f4978199920 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f496800d740 tx=0x7f496800dc00 comp rx=0 tx=0).stop 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 -- 172.21.15.92:0/1211521661 shutdown_connections 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f49640b6680 0x7f49640b8b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4978108c30 0x7f497819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49781082e0 0x7f4978199920 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 --2- 172.21.15.92:0/1211521661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49781029b0 0x7f4978199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 -- 172.21.15.92:0/1211521661 >> 172.21.15.92:0/1211521661 conn(0x7f497807a740 msgr2=0x7f4978106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:40.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 -- 172.21.15.92:0/1211521661 shutdown_connections 2024-09-21T07:15:40.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:40.024+0000 7f49806d5640 1 -- 172.21.15.92:0/1211521661 wait complete. 2024-09-21T07:15:41.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:40 smithi175 ceph-mon[34064]: pgmap v417: 129 pgs: 129 active+clean; 2.0 GiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 104 MiB/s wr, 62 op/s 2024-09-21T07:15:41.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:40 smithi092 ceph-mon[30987]: pgmap v417: 129 pgs: 129 active+clean; 2.0 GiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 104 MiB/s wr, 62 op/s 2024-09-21T07:15:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:40 smithi169 ceph-mon[33705]: pgmap v417: 129 pgs: 129 active+clean; 2.0 GiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 104 MiB/s wr, 62 op/s 2024-09-21T07:15:42.872 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:42.873 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 readers = 7211912.50 kB/sec 2024-09-21T07:15:42.873 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 readers = 7200318.12 kB/sec 2024-09-21T07:15:42.873 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 7211912.50 kB/sec 2024-09-21T07:15:42.873 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 7211912.50 kB/sec 2024-09-21T07:15:42.873 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 7211912.50 kB/sec 2024-09-21T07:15:42.873 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 1048576.00 kB 2024-09-21T07:15:43.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:42 smithi175 ceph-mon[34064]: pgmap v418: 129 pgs: 129 active+clean; 2.0 GiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 121 MiB/s wr, 63 op/s 2024-09-21T07:15:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:42 smithi092 ceph-mon[30987]: pgmap v418: 129 pgs: 129 active+clean; 2.0 GiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 121 MiB/s wr, 63 op/s 2024-09-21T07:15:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:42 smithi169 ceph-mon[33705]: pgmap v418: 129 pgs: 129 active+clean; 2.0 GiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 121 MiB/s wr, 63 op/s 2024-09-21T07:15:44.800 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:15:44.810 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T07:15:44.810 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T07:15:44.810 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:15:45.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:44 smithi175 ceph-mon[34064]: pgmap v419: 129 pgs: 129 active+clean; 2.0 GiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 164 MiB/s wr, 79 op/s 2024-09-21T07:15:45.111 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:15:45.111 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 re-readers = 6959377.00 kB/sec 2024-09-21T07:15:45.111 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 re-readers = 6949326.19 kB/sec 2024-09-21T07:15:45.111 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 6959377.00 kB/sec 2024-09-21T07:15:45.111 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 6959377.00 kB/sec 2024-09-21T07:15:45.111 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 6959377.00 kB/sec 2024-09-21T07:15:45.111 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 1048576.00 kB 2024-09-21T07:15:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:44 smithi092 ceph-mon[30987]: pgmap v419: 129 pgs: 129 active+clean; 2.0 GiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 164 MiB/s wr, 79 op/s 2024-09-21T07:15:45.126 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:44 smithi169 ceph-mon[33705]: pgmap v419: 129 pgs: 129 active+clean; 2.0 GiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 164 MiB/s wr, 79 op/s 2024-09-21T07:15:45.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.737+0000 7f4adc735640 1 -- 172.21.15.92:0/2926733689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ad4109e20 msgr2=0x7f4ad4110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:45.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.737+0000 7f4adc735640 1 --2- 172.21.15.92:0/2926733689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ad4109e20 0x7f4ad4110650 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009ca0 tx=0x7f4acc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.737+0000 7f4adc735640 1 -- 172.21.15.92:0/2926733689 shutdown_connections 2024-09-21T07:15:45.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.737+0000 7f4adc735640 1 --2- 172.21.15.92:0/2926733689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ad4109e20 0x7f4ad4110650 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.737+0000 7f4adc735640 1 --2- 172.21.15.92:0/2926733689 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ad41094d0 0x7f4ad41098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.737+0000 7f4adc735640 1 --2- 172.21.15.92:0/2926733689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad4103b90 0x7f4ad4103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.737+0000 7f4adc735640 1 -- 172.21.15.92:0/2926733689 >> 172.21.15.92:0/2926733689 conn(0x7f4ad40ff5e0 msgr2=0x7f4ad4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:45.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.737+0000 7f4adc735640 1 -- 172.21.15.92:0/2926733689 shutdown_connections 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.737+0000 7f4adc735640 1 -- 172.21.15.92:0/2926733689 wait complete. 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4adc735640 1 Processor -- start 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4adc735640 1 -- start start 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4adc735640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad4103b90 0x7f4ad419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4adc735640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ad41094d0 0x7f4ad419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4adc735640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ad4109e20 0x7f4ad419fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4adc735640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad41139e0 con 0x7f4ad41094d0 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4adc735640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad4113860 con 0x7f4ad4109e20 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4adc735640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad4113b60 con 0x7f4ad4103b90 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4ad9cd0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ad41094d0 0x7f4ad419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4ad9cd0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ad41094d0 0x7f4ad419a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59150/0 (socket says 172.21.15.92:59150) 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4ad9cd0640 1 -- 172.21.15.92:0/1598253178 learned_addr learned my addr 172.21.15.92:0/1598253178 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.738+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad4103b90 0x7f4ad419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4adacd2640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ad4109e20 0x7f4ad419fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4ad9cd0640 1 -- 172.21.15.92:0/1598253178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad4103b90 msgr2=0x7f4ad419a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4ad9cd0640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad4103b90 0x7f4ad419a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4ad9cd0640 1 -- 172.21.15.92:0/1598253178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ad4109e20 msgr2=0x7f4ad419fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4ad9cd0640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ad4109e20 0x7f4ad419fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4ad9cd0640 1 -- 172.21.15.92:0/1598253178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad41a0300 con 0x7f4ad41094d0 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4adacd2640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ad4109e20 0x7f4ad419fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4ad9cd0640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ad41094d0 0x7f4ad419a930 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400d950 tx=0x7f4ac400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4acb7fe640 1 -- 172.21.15.92:0/1598253178 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4017070 con 0x7f4ad41094d0 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4acb7fe640 1 -- 172.21.15.92:0/1598253178 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ac4009c30 con 0x7f4ad41094d0 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4adc735640 1 -- 172.21.15.92:0/1598253178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad41a05f0 con 0x7f4ad41094d0 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4acb7fe640 1 -- 172.21.15.92:0/1598253178 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40047a0 con 0x7f4ad41094d0 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.739+0000 7f4adc735640 1 -- 172.21.15.92:0/1598253178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad41a6d50 con 0x7f4ad41094d0 2024-09-21T07:15:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.742+0000 7f4ae2ca9740 1 Processor -- start 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.742+0000 7f4ae2ca9740 1 -- start start 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b8182650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7db21b0 0x5568b8182b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7dba390 0x5568b81830d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568b80f8e50 con 0x5568b7ddb070 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5568b80e8280 con 0x5568b7db21b0 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5568b80ec090 con 0x5568b7dba390 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4ada4d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7db21b0 0x5568b8182b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4ada4d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7db21b0 0x5568b8182b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:54530/0 (socket says 172.21.15.92:54530) 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4ada4d1640 1 -- 172.21.15.92:0/2730039698 learned_addr learned my addr 172.21.15.92:0/2730039698 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4adacd2640 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b8182650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.743+0000 7f4acb7fe640 1 -- 172.21.15.92:0/1598253178 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f4ac4004940 con 0x7f4ad41094d0 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.744+0000 7f4ad9cd0640 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7dba390 0x5568b81830d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.744+0000 7f4ada4d1640 1 -- 172.21.15.92:0/2730039698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7dba390 msgr2=0x5568b81830d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.744+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7dba390 0x5568b81830d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.744+0000 7f4ada4d1640 1 -- 172.21.15.92:0/2730039698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 msgr2=0x5568b8182650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.744+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b8182650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.744+0000 7f4ada4d1640 1 -- 172.21.15.92:0/2730039698 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b7e46650 con 0x5568b7db21b0 2024-09-21T07:15:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.744+0000 7f4ad9cd0640 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7dba390 0x5568b81830d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.744+0000 7f4adacd2640 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b8182650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.745+0000 7f4acb7fe640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ac00b6680 0x7f4ac00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.745+0000 7f4acb7fe640 1 -- 172.21.15.92:0/1598253178 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4ac40e7840 con 0x7f4ad41094d0 2024-09-21T07:15:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.745+0000 7f4adacd2640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ac00b6680 0x7f4ac00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.745+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7db21b0 0x5568b8182b90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009d20 tx=0x7f4ad0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47d25251e2ed11f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.746+0000 7f4adacd2640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ac00b6680 0x7f4ac00b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006010 tx=0x7f4acc031470 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.746+0000 7f4ac8ff9640 1 -- 172.21.15.92:0/2730039698 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad001e070 con 0x5568b7db21b0 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.746+0000 7f4ac8ff9640 1 -- 172.21.15.92:0/2730039698 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ad0019ac0 con 0x5568b7db21b0 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.746+0000 7f4ac8ff9640 1 -- 172.21.15.92:0/2730039698 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000ea00 con 0x5568b7db21b0 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.747+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/2730039698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7db21b0 msgr2=0x5568b8182b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.747+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7db21b0 0x5568b8182b90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009d20 tx=0x7f4ad0011810 comp rx=0 tx=0).stop 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.747+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/2730039698 shutdown_connections 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.747+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7dba390 0x5568b81830d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.747+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7db21b0 0x5568b8182b90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.747+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/2730039698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b8182650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.747+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/2730039698 >> 172.21.15.92:0/2730039698 conn(0x5568b7dcf460 msgr2=0x5568b8180540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.747+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/2730039698 shutdown_connections 2024-09-21T07:15:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.747+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/2730039698 wait complete. 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.748+0000 7f4ae2ca9740 1 -- start start 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.748+0000 7f4ae2ca9740 1 Processor -- start 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.748+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b818dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.748+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7dba390 0x5568b818e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.748+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b819a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.748+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568b7f49700 con 0x5568b7ddb070 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.748+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5568b8083110 con 0x5568b7dba390 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.748+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5568b8190e30 con 0x5568b7db21b0 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.749+0000 7f4adacd2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.749+0000 7f4adacd2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b819a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59174/0 (socket says 172.21.15.92:59174) 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.749+0000 7f4adacd2640 1 -- 172.21.15.92:0/646097666 learned_addr learned my addr 172.21.15.92:0/646097666 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.748+0000 7f4ae2ca9740 10 client.0 _ll_register_callbacks cb 0x5568b809c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.749+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b818dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.749+0000 7f4adacd2640 1 -- 172.21.15.92:0/646097666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 msgr2=0x5568b818dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:45.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.749+0000 7f4adacd2640 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b818dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.749+0000 7f4adacd2640 1 -- 172.21.15.92:0/646097666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7dba390 msgr2=0x5568b818e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.749+0000 7f4adacd2640 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7dba390 0x5568b818e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.749+0000 7f4adacd2640 1 -- 172.21.15.92:0/646097666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b80b0c40 con 0x5568b7ddb070 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.750+0000 7f4adacd2640 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b819a150 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4acc003f50 tx=0x7f4acc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b6dbbc414db87d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.750+0000 7f4abdffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.750+0000 7f4abdffb640 1 -- 172.21.15.92:0/646097666 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc031600 con 0x5568b7ddb070 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.750+0000 7f4abdffb640 1 -- 172.21.15.92:0/646097666 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4acc004250 con 0x5568b7ddb070 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.750+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/646097666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad0019ac0 con 0x5568b7ddb070 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.750+0000 7f4abdffb640 1 -- 172.21.15.92:0/646097666 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4acc031e80 con 0x5568b7ddb070 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.750+0000 7f4ae2ca9740 10 client.16434 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.750+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/646097666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5568b819ca80 con 0x5568b7ddb070 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.750+0000 7f4abdffb640 1 -- 172.21.15.92:0/646097666 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4acc036040 con 0x5568b7ddb070 2024-09-21T07:15:45.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.750+0000 7f4abdffb640 1 -- 172.21.15.92:0/646097666 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4acc051070 con 0x5568b7ddb070 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.751+0000 7f4ae2ca9740 10 client.16434 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.751+0000 7f4ae2ca9740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.751+0000 7f4ae2ca9740 20 client.16434 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.751+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568b7d999f0 0x5568b81a0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.751+0000 7f4ae2ca9740 4 client.16434 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.751+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/646097666 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4ad0019ac0 con 0x5568b7d999f0 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.751+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568b7d999f0 0x5568b81a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.751+0000 7f4abdffb640 10 client.16434 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.751+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568b7d999f0 0x5568b81a0000 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=241db43fa3d34133 server_cookie=ed5c7352ebc0530 in_seq=0 out_seq=0 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4abdffb640 1 -- 172.21.15.92:0/646097666 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f4ad0019ac0 con 0x5568b7d999f0 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4abdffb640 10 client.16434 handle_command_reply: tid=0 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4ae2ca9740 1 client.16434 shutdown 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/646097666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 msgr2=0x5568b819a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b819a150 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4acc003f50 tx=0x7f4acc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/646097666 shutdown_connections 2024-09-21T07:15:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568b7d999f0 0x5568b81a0000 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7ddb070 0x5568b819a150 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7dba390 0x5568b818e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/646097666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b818dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/646097666 >> 172.21.15.92:0/646097666 conn(0x5568b7dcf460 msgr2=0x5568b8185830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.752+0000 7f4abdffb640 0 client.16434 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.753+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/646097666 shutdown_connections 2024-09-21T07:15:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.753+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/646097666 wait complete. 2024-09-21T07:15:45.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.753+0000 7f4ae2ca9740 20 client.16434 trim_cache size 0 max 16384 2024-09-21T07:15:45.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.771+0000 7f4ae2ca9740 1 Processor -- start 2024-09-21T07:15:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ae2ca9740 1 -- start start 2024-09-21T07:15:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b818e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b817b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 0x5568b817fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad41b0e70 con 0x5568b7dba390 2024-09-21T07:15:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad41b29b0 con 0x5568b7ddb070 2024-09-21T07:15:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad41b1540 con 0x5568b7db21b0 2024-09-21T07:15:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ad9cd0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b817b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ad9cd0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b817b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59188/0 (socket says 172.21.15.92:59188) 2024-09-21T07:15:45.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ada4d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b818e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ad9cd0640 1 -- 172.21.15.92:0/1092885470 learned_addr learned my addr 172.21.15.92:0/1092885470 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4adacd2640 1 --2- 172.21.15.92:0/1092885470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 0x5568b817fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ada4d1640 1 -- 172.21.15.92:0/1092885470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 msgr2=0x5568b817fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/1092885470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 0x5568b817fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ada4d1640 1 -- 172.21.15.92:0/1092885470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 msgr2=0x5568b817b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/1092885470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b817b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ada4d1640 1 -- 172.21.15.92:0/1092885470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b818cc70 con 0x5568b7db21b0 2024-09-21T07:15:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4ad9cd0640 1 --2- 172.21.15.92:0/1092885470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b817b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.772+0000 7f4adacd2640 1 --2- 172.21.15.92:0/1092885470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 0x5568b817fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:45.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.773+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/1092885470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b818e1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5568b8172760 tx=0x7f4ad0005d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a541e3f47cba9ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.773+0000 7f4abffff640 1 -- 172.21.15.92:0/1092885470 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad001e040 con 0x5568b7db21b0 2024-09-21T07:15:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.773+0000 7f4abffff640 1 -- 172.21.15.92:0/1092885470 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ad00199c0 con 0x5568b7db21b0 2024-09-21T07:15:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.773+0000 7f4abffff640 1 -- 172.21.15.92:0/1092885470 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0005340 con 0x5568b7db21b0 2024-09-21T07:15:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/1092885470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 msgr2=0x5568b818e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/1092885470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b818e1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5568b8172760 tx=0x7f4ad0005d90 comp rx=0 tx=0).stop 2024-09-21T07:15:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/1092885470 shutdown_connections 2024-09-21T07:15:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/1092885470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 0x5568b817fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/1092885470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b817b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/1092885470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b818e1d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/1092885470 >> 172.21.15.92:0/1092885470 conn(0x5568b7dcf460 msgr2=0x5568b818dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:45.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/1092885470 shutdown_connections 2024-09-21T07:15:45.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/1092885470 wait complete. 2024-09-21T07:15:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 -- start start 2024-09-21T07:15:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.774+0000 7f4ae2ca9740 1 Processor -- start 2024-09-21T07:15:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b8196a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b8191f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ae2ca9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 0x5568b81925f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad41b22e0 con 0x5568b7dba390 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad41b1c10 con 0x5568b7ddb070 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ae2ca9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad41aee50 con 0x5568b7db21b0 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ae2ca9740 10 client.0 _ll_register_callbacks cb 0x7f4acc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ad9cd0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b8191f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ad9cd0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b8191f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59194/0 (socket says 172.21.15.92:59194) 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ada4d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b8196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ad9cd0640 1 -- 172.21.15.92:0/3423659465 learned_addr learned my addr 172.21.15.92:0/3423659465 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4adacd2640 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 0x5568b81925f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ad9cd0640 1 -- 172.21.15.92:0/3423659465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 msgr2=0x5568b8196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ad9cd0640 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b8196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ad9cd0640 1 -- 172.21.15.92:0/3423659465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 msgr2=0x5568b81925f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ad9cd0640 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 0x5568b81925f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ad9cd0640 1 -- 172.21.15.92:0/3423659465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b8209a00 con 0x5568b7dba390 2024-09-21T07:15:45.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4adacd2640 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 0x5568b81925f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.775+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b8196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.776+0000 7f4ad9cd0640 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b8191f00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40e7ae0 tx=0x7f4ac40ad120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1febecf674750526 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.776+0000 7f4abdffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.776+0000 7f4abdffb640 1 -- 172.21.15.92:0/3423659465 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4004e30 con 0x5568b7dba390 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.776+0000 7f4abdffb640 1 -- 172.21.15.92:0/3423659465 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4ac40ac4f0 con 0x5568b7dba390 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.776+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/3423659465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad00199c0 con 0x5568b7dba390 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.776+0000 7f4abdffb640 1 -- 172.21.15.92:0/3423659465 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ac4005680 con 0x5568b7dba390 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.776+0000 7f4ae2ca9740 10 client.16440 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.776+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/3423659465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5568b820ab00 con 0x5568b7dba390 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.776+0000 7f4abdffb640 1 -- 172.21.15.92:0/3423659465 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ad00199c0 con 0x5568b7dba390 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.776+0000 7f4abdffb640 1 -- 172.21.15.92:0/3423659465 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4ac40a8be0 con 0x5568b7dba390 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4ae2ca9740 10 client.16440 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4ae2ca9740 10 client.16440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:45.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4ae2ca9740 20 client.16440 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568b7d6eda0 0x5568b820d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4ae2ca9740 4 client.16440 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/3423659465 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5568b80fada0 con 0x5568b7d6eda0 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568b7d6eda0 0x5568b820d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4ada4d1640 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568b7d6eda0 0x5568b820d210 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54568a9029ed1abb server_cookie=3781ed6b880d5fcf in_seq=0 out_seq=0 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4abdffb640 10 client.16440 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4abdffb640 1 -- 172.21.15.92:0/3423659465 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x5568b80fada0 con 0x5568b7d6eda0 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.777+0000 7f4abdffb640 10 client.16440 handle_command_reply: tid=0 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 client.16440 shutdown 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/3423659465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 msgr2=0x5568b8191f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:45.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b8191f00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40e7ae0 tx=0x7f4ac40ad120 comp rx=0 tx=0).stop 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/3423659465 shutdown_connections 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5568b7d6eda0 0x5568b820d210 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b7ddb070 0x5568b81925f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568b7dba390 0x5568b8191f00 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4abdffb640 0 client.16440 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 --2- 172.21.15.92:0/3423659465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568b7db21b0 0x5568b8196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/3423659465 >> 172.21.15.92:0/3423659465 conn(0x5568b7dcf460 msgr2=0x5568b8183630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/3423659465 shutdown_connections 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 1 -- 172.21.15.92:0/3423659465 wait complete. 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.778+0000 7f4ae2ca9740 20 client.16440 trim_cache size 0 max 16384 2024-09-21T07:15:45.786 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:15:45.787 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:15:45.788 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:15:45.789 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:45.789 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:45.789 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:15:45.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 -- 172.21.15.92:0/1598253178 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ac00b6680 msgr2=0x7f4ac00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:45.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ac00b6680 0x7f4ac00b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006010 tx=0x7f4acc031470 comp rx=0 tx=0).stop 2024-09-21T07:15:45.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 -- 172.21.15.92:0/1598253178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ad41094d0 msgr2=0x7f4ad419a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:45.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ad41094d0 0x7f4ad419a930 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400d950 tx=0x7f4ac400de10 comp rx=0 tx=0).stop 2024-09-21T07:15:45.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 -- 172.21.15.92:0/1598253178 shutdown_connections 2024-09-21T07:15:45.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ac00b6680 0x7f4ac00b8b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ad4109e20 0x7f4ad419fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ad41094d0 0x7f4ad419a930 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 --2- 172.21.15.92:0/1598253178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad4103b90 0x7f4ad419a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:45.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 -- 172.21.15.92:0/1598253178 >> 172.21.15.92:0/1598253178 conn(0x7f4ad40ff5e0 msgr2=0x7f4ad4101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:45.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 -- 172.21.15.92:0/1598253178 shutdown_connections 2024-09-21T07:15:45.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:45.779+0000 7f4adc735640 1 -- 172.21.15.92:0/1598253178 wait complete. 2024-09-21T07:15:46.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.529+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1425627980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d44108600 msgr2=0x7f0d44108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:46.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.529+0000 7f0d4ad78640 1 --2- 172.21.15.92:0/1425627980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d44108600 0x7f0d44108a10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009900 tx=0x7f0d3402a410 comp rx=0 tx=0).stop 2024-09-21T07:15:46.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.529+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1425627980 shutdown_connections 2024-09-21T07:15:46.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.529+0000 7f0d4ad78640 1 --2- 172.21.15.92:0/1425627980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d44108f50 0x7f0d4410f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.529+0000 7f0d4ad78640 1 --2- 172.21.15.92:0/1425627980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d44108600 0x7f0d44108a10 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.529+0000 7f0d4ad78640 1 --2- 172.21.15.92:0/1425627980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d441031c0 0x7f0d441035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.529+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1425627980 >> 172.21.15.92:0/1425627980 conn(0x7f0d44079e30 msgr2=0x7f0d4407a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.529+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1425627980 shutdown_connections 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.529+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1425627980 wait complete. 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d4ad78640 1 Processor -- start 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d4ad78640 1 -- start start 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d4ad78640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d441031c0 0x7f0d44199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d4ad78640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d44108600 0x7f0d44199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d4ad78640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d44108f50 0x7f0d4419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d4ad78640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44112ac0 con 0x7f0d441031c0 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d4ad78640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44112940 con 0x7f0d44108f50 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d4ad78640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44112c40 con 0x7f0d44108600 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d48b14640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d441031c0 0x7f0d44199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d48b14640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d441031c0 0x7f0d44199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59216/0 (socket says 172.21.15.92:59216) 2024-09-21T07:15:46.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.530+0000 7f0d48b14640 1 -- 172.21.15.92:0/1244853059 learned_addr learned my addr 172.21.15.92:0/1244853059 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d49315640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d44108f50 0x7f0d4419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d43fff640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d44108600 0x7f0d44199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d48b14640 1 -- 172.21.15.92:0/1244853059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d44108600 msgr2=0x7f0d44199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d48b14640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d44108600 0x7f0d44199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d48b14640 1 -- 172.21.15.92:0/1244853059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d44108f50 msgr2=0x7f0d4419edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d48b14640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d44108f50 0x7f0d4419edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d48b14640 1 -- 172.21.15.92:0/1244853059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4419f500 con 0x7f0d441031c0 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d48b14640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d441031c0 0x7f0d44199590 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00ea80 tx=0x7f0d3c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d41ffb640 1 -- 172.21.15.92:0/1244853059 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c00ce40 con 0x7f0d441031c0 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1244853059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4419f7f0 con 0x7f0d441031c0 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d41ffb640 1 -- 172.21.15.92:0/1244853059 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d3c005020 con 0x7f0d441031c0 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d41ffb640 1 -- 172.21.15.92:0/1244853059 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0116d0 con 0x7f0d441031c0 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.531+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1244853059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d441a5f50 con 0x7f0d441031c0 2024-09-21T07:15:46.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.532+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1244853059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d441035d0 con 0x7f0d441031c0 2024-09-21T07:15:46.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.534+0000 7f0d41ffb640 1 -- 172.21.15.92:0/1244853059 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f0d3c004a40 con 0x7f0d441031c0 2024-09-21T07:15:46.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.534+0000 7f0d41ffb640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0d300b6680 0x7f0d300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:46.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.535+0000 7f0d43fff640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0d300b6680 0x7f0d300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:46.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.535+0000 7f0d41ffb640 1 -- 172.21.15.92:0/1244853059 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0d3c0e80f0 con 0x7f0d441031c0 2024-09-21T07:15:46.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.535+0000 7f0d43fff640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0d300b6680 0x7f0d300b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d340057c0 tx=0x7f0d34000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:46.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.538+0000 7f0d41ffb640 1 -- 172.21.15.92:0/1244853059 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d3c016030 con 0x7f0d441031c0 2024-09-21T07:15:46.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.755+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1244853059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d4419a6c0 con 0x7f0d441031c0 2024-09-21T07:15:46.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.755+0000 7f0d41ffb640 1 -- 172.21.15.92:0/1244853059 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f0d3c0ae2a0 con 0x7f0d441031c0 2024-09-21T07:15:46.757 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:15:46.757 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:15:46.758 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:15:46.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1244853059 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0d300b6680 msgr2=0x7f0d300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0d300b6680 0x7f0d300b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d340057c0 tx=0x7f0d34000bc0 comp rx=0 tx=0).stop 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1244853059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d441031c0 msgr2=0x7f0d44199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d441031c0 0x7f0d44199590 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00ea80 tx=0x7f0d3c00ef40 comp rx=0 tx=0).stop 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1244853059 shutdown_connections 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0d300b6680 0x7f0d300b8b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d44108f50 0x7f0d4419edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d44108600 0x7f0d44199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 --2- 172.21.15.92:0/1244853059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d441031c0 0x7f0d44199590 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1244853059 >> 172.21.15.92:0/1244853059 conn(0x7f0d44079e30 msgr2=0x7f0d44104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1244853059 shutdown_connections 2024-09-21T07:15:46.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:46.758+0000 7f0d4ad78640 1 -- 172.21.15.92:0/1244853059 wait complete. 2024-09-21T07:15:46.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:46 smithi092 ceph-mon[30987]: pgmap v420: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 171 MiB/s wr, 79 op/s 2024-09-21T07:15:47.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:46 smithi175 ceph-mon[34064]: pgmap v420: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 171 MiB/s wr, 79 op/s 2024-09-21T07:15:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:46 smithi169 ceph-mon[33705]: pgmap v420: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 171 MiB/s wr, 79 op/s 2024-09-21T07:15:47.763 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24649 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T07:15:47.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24649 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T07:15:47.866 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:15:47.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:15:48.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:47 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1244853059' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:48.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:47 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1244853059' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:48.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:47 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1244853059' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.541+0000 7fb87cf13640 1 -- 172.21.15.92:0/3762024701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb878105b30 msgr2=0x7fb87810f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.541+0000 7fb87cf13640 1 --2- 172.21.15.92:0/3762024701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb878105b30 0x7fb87810f580 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb870009ca0 tx=0x7fb87002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.541+0000 7fb87cf13640 1 -- 172.21.15.92:0/3762024701 shutdown_connections 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.541+0000 7fb87cf13640 1 --2- 172.21.15.92:0/3762024701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb878105b30 0x7fb87810f580 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.541+0000 7fb87cf13640 1 --2- 172.21.15.92:0/3762024701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8781051e0 0x7fb8781055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.541+0000 7fb87cf13640 1 --2- 172.21.15.92:0/3762024701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb878103210 0x7fb878103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.541+0000 7fb87cf13640 1 -- 172.21.15.92:0/3762024701 >> 172.21.15.92:0/3762024701 conn(0x7fb878079f40 msgr2=0x7fb87807a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.541+0000 7fb87cf13640 1 -- 172.21.15.92:0/3762024701 shutdown_connections 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.541+0000 7fb87cf13640 1 -- 172.21.15.92:0/3762024701 wait complete. 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb87cf13640 1 Processor -- start 2024-09-21T07:15:48.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb87cf13640 1 -- start start 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb87cf13640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb878103210 0x7fb87819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb87cf13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8781051e0 0x7fb87819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb87cf13640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb878105b30 0x7fb87819fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb87cf13640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb878113a40 con 0x7fb8781051e0 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb87cf13640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781138c0 con 0x7fb878105b30 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb87cf13640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb878113bc0 con 0x7fb878103210 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb875d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8781051e0 0x7fb87819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb875d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8781051e0 0x7fb87819a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59248/0 (socket says 172.21.15.92:59248) 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb875d9b640 1 -- 172.21.15.92:0/1559726040 learned_addr learned my addr 172.21.15.92:0/1559726040 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb87659c640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb878103210 0x7fb87819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb875d9b640 1 -- 172.21.15.92:0/1559726040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb878103210 msgr2=0x7fb87819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb875d9b640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb878103210 0x7fb87819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb875d9b640 1 -- 172.21.15.92:0/1559726040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb878105b30 msgr2=0x7fb87819fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:48.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb876d9d640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb878105b30 0x7fb87819fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb875d9b640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb878105b30 0x7fb87819fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.542+0000 7fb875d9b640 1 -- 172.21.15.92:0/1559726040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8781a0300 con 0x7fb8781051e0 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.543+0000 7fb875d9b640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8781051e0 0x7fb87819a930 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00b450 tx=0x7fb86c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.543+0000 7fb8677fe640 1 -- 172.21.15.92:0/1559726040 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c015020 con 0x7fb8781051e0 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.543+0000 7fb87cf13640 1 -- 172.21.15.92:0/1559726040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8781a05f0 con 0x7fb8781051e0 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.543+0000 7fb8677fe640 1 -- 172.21.15.92:0/1559726040 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb86c011d20 con 0x7fb8781051e0 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.543+0000 7fb8677fe640 1 -- 172.21.15.92:0/1559726040 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c010e10 con 0x7fb8781051e0 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.543+0000 7fb87cf13640 1 -- 172.21.15.92:0/1559726040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8781a6d50 con 0x7fb8781051e0 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.545+0000 7fb883487740 1 Processor -- start 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb883487740 1 -- start start 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb8677fe640 1 -- 172.21.15.92:0/1559726040 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fb86c018020 con 0x7fb8781051e0 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb883487740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 0x558301ab3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb883487740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016e3980 0x558301ab3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb883487740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016ebb60 0x558301ab4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb883487740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558301a29b90 con 0x5583016ebb60 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb883487740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558301a18fc0 con 0x5583016e3980 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb883487740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558301a1cdd0 con 0x55830170c840 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb875d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016ebb60 0x558301ab4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb875d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016ebb60 0x558301ab4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59250/0 (socket says 172.21.15.92:59250) 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb875d9b640 1 -- 172.21.15.92:0/1872361796 learned_addr learned my addr 172.21.15.92:0/1872361796 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb87659c640 1 --2- 172.21.15.92:0/1872361796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016e3980 0x558301ab3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.546+0000 7fb876d9d640 1 --2- 172.21.15.92:0/1872361796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 0x558301ab3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb875d9b640 1 -- 172.21.15.92:0/1872361796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 msgr2=0x558301ab3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb875d9b640 1 --2- 172.21.15.92:0/1872361796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 0x558301ab3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb875d9b640 1 -- 172.21.15.92:0/1872361796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016e3980 msgr2=0x558301ab3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb875d9b640 1 --2- 172.21.15.92:0/1872361796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016e3980 0x558301ab3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb875d9b640 1 -- 172.21.15.92:0/1872361796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583019a0060 con 0x5583016ebb60 2024-09-21T07:15:48.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb8677fe640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8600b6680 0x7fb8600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb875d9b640 1 --2- 172.21.15.92:0/1872361796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016ebb60 0x558301ab4080 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0e48c0 tx=0x7fb86c0ef690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad37ff51ba0183c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb876d9d640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8600b6680 0x7fb8600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb864ff9640 1 -- 172.21.15.92:0/1872361796 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0a96a0 con 0x5583016ebb60 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb8677fe640 1 -- 172.21.15.92:0/1559726040 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fb86c0e75a0 con 0x7fb8781051e0 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.547+0000 7fb864ff9640 1 -- 172.21.15.92:0/1872361796 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb86c0acb60 con 0x5583016ebb60 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb864ff9640 1 -- 172.21.15.92:0/1872361796 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0afd20 con 0x5583016ebb60 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb883487740 1 -- 172.21.15.92:0/1872361796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016ebb60 msgr2=0x558301ab4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb876d9d640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8600b6680 0x7fb8600b8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb870006010 tx=0x7fb870031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb883487740 1 --2- 172.21.15.92:0/1872361796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016ebb60 0x558301ab4080 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0e48c0 tx=0x7fb86c0ef690 comp rx=0 tx=0).stop 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb883487740 1 -- 172.21.15.92:0/1872361796 shutdown_connections 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb883487740 1 --2- 172.21.15.92:0/1872361796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016ebb60 0x558301ab4080 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb883487740 1 --2- 172.21.15.92:0/1872361796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016e3980 0x558301ab3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb883487740 1 --2- 172.21.15.92:0/1872361796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 0x558301ab3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb883487740 1 -- 172.21.15.92:0/1872361796 >> 172.21.15.92:0/1872361796 conn(0x558301700990 msgr2=0x558301ab14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb883487740 1 -- 172.21.15.92:0/1872361796 shutdown_connections 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.548+0000 7fb883487740 1 -- 172.21.15.92:0/1872361796 wait complete. 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb883487740 1 -- start start 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb883487740 1 Processor -- start 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb883487740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 0x558301abf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb883487740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301abf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb883487740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301acb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb883487740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55830187a7a0 con 0x55830170c840 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb883487740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5583019be0a0 con 0x5583016ebb60 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb883487740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558301ac1e30 con 0x5583016e3980 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb883487740 10 client.0 _ll_register_callbacks cb 0x55830199b3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb876d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301acb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb876d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301acb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59252/0 (socket says 172.21.15.92:59252) 2024-09-21T07:15:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb876d9d640 1 -- 172.21.15.92:0/1714059693 learned_addr learned my addr 172.21.15.92:0/1714059693 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb87659c640 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 0x558301abf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb875d9b640 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301abf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb876d9d640 1 -- 172.21.15.92:0/1714059693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 msgr2=0x558301abf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb876d9d640 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 0x558301abf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb876d9d640 1 -- 172.21.15.92:0/1714059693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 msgr2=0x558301abf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb876d9d640 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301abf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.549+0000 7fb876d9d640 1 -- 172.21.15.92:0/1714059693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583019ac880 con 0x55830170c840 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.550+0000 7fb876d9d640 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301acb150 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb870003d70 tx=0x7fb8700095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d54072db9f75f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.550+0000 7fb85dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.550+0000 7fb85dffb640 1 -- 172.21.15.92:0/1714059693 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87004e070 con 0x55830170c840 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.550+0000 7fb85dffb640 1 -- 172.21.15.92:0/1714059693 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fb8700047c0 con 0x55830170c840 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.550+0000 7fb883487740 1 -- 172.21.15.92:0/1714059693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb86c0acb60 con 0x55830170c840 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.550+0000 7fb85dffb640 1 -- 172.21.15.92:0/1714059693 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb8700305c0 con 0x55830170c840 2024-09-21T07:15:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.550+0000 7fb883487740 10 client.16458 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.550+0000 7fb883487740 1 -- 172.21.15.92:0/1714059693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558301786b90 con 0x55830170c840 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.550+0000 7fb85dffb640 1 -- 172.21.15.92:0/1714059693 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb86c0acb60 con 0x55830170c840 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.550+0000 7fb85dffb640 1 -- 172.21.15.92:0/1714059693 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb870043040 con 0x55830170c840 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.551+0000 7fb883487740 10 client.16458 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.551+0000 7fb883487740 10 client.16458 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.551+0000 7fb883487740 20 client.16458 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.551+0000 7fb883487740 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5583016cb1c0 0x558301ad1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.551+0000 7fb883487740 4 client.16458 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.551+0000 7fb883487740 1 -- 172.21.15.92:0/1714059693 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558301a2bae0 con 0x5583016cb1c0 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.551+0000 7fb87659c640 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5583016cb1c0 0x558301ad1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.551+0000 7fb85dffb640 10 client.16458 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.551+0000 7fb87659c640 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5583016cb1c0 0x558301ad1190 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af35c2b2282e1e5d server_cookie=984a4f8d8c32cf28 in_seq=0 out_seq=0 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb85dffb640 1 -- 172.21.15.92:0/1714059693 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558301a2bae0 con 0x5583016cb1c0 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb85dffb640 10 client.16458 handle_command_reply: tid=0 2024-09-21T07:15:48.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb883487740 1 client.16458 shutdown 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb883487740 1 -- 172.21.15.92:0/1714059693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 msgr2=0x558301acb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb883487740 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301acb150 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb870003d70 tx=0x7fb8700095c0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb883487740 1 -- 172.21.15.92:0/1714059693 shutdown_connections 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb883487740 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5583016cb1c0 0x558301ad1190 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb883487740 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301acb150 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb883487740 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301abf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb85dffb640 0 client.16458 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb883487740 1 --2- 172.21.15.92:0/1714059693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 0x558301abf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.552+0000 7fb883487740 1 -- 172.21.15.92:0/1714059693 >> 172.21.15.92:0/1714059693 conn(0x558301700990 msgr2=0x558301ab4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.553+0000 7fb883487740 1 -- 172.21.15.92:0/1714059693 shutdown_connections 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.553+0000 7fb883487740 1 -- 172.21.15.92:0/1714059693 wait complete. 2024-09-21T07:15:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.553+0000 7fb883487740 20 client.16458 trim_cache size 0 max 16384 2024-09-21T07:15:48.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.571+0000 7fb883487740 1 Processor -- start 2024-09-21T07:15:48.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.571+0000 7fb883487740 1 -- start start 2024-09-21T07:15:48.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb883487740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 0x558301acb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb883487740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301acb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb883487740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301abc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb883487740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781b0dc0 con 0x55830170c840 2024-09-21T07:15:48.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb883487740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781b2900 con 0x5583016ebb60 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb883487740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781b1490 con 0x5583016e3980 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb876d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301abc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb875d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301acb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb876d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301abc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59264/0 (socket says 172.21.15.92:59264) 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb876d9d640 1 -- 172.21.15.92:0/2318367721 learned_addr learned my addr 172.21.15.92:0/2318367721 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb87659c640 1 --2- 172.21.15.92:0/2318367721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 0x558301acb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb876d9d640 1 -- 172.21.15.92:0/2318367721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 msgr2=0x558301acb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb876d9d640 1 --2- 172.21.15.92:0/2318367721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 0x558301acb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb876d9d640 1 -- 172.21.15.92:0/2318367721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 msgr2=0x558301acb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb876d9d640 1 --2- 172.21.15.92:0/2318367721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301acb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb876d9d640 1 -- 172.21.15.92:0/2318367721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558301ab8df0 con 0x55830170c840 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb87659c640 1 --2- 172.21.15.92:0/2318367721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 0x558301acb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:48.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.572+0000 7fb875d9b640 1 --2- 172.21.15.92:0/2318367721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301acb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.573+0000 7fb876d9d640 1 --2- 172.21.15.92:0/2318367721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301abc160 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb870003fd0 tx=0x7fb8700318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4cf98f45f71050 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.573+0000 7fb85ffff640 1 -- 172.21.15.92:0/2318367721 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87004e070 con 0x55830170c840 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.573+0000 7fb85ffff640 1 -- 172.21.15.92:0/2318367721 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb870036040 con 0x55830170c840 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.573+0000 7fb85ffff640 1 -- 172.21.15.92:0/2318367721 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8700309c0 con 0x55830170c840 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 -- 172.21.15.92:0/2318367721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 msgr2=0x558301abc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 --2- 172.21.15.92:0/2318367721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301abc160 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb870003fd0 tx=0x7fb8700318e0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 -- 172.21.15.92:0/2318367721 shutdown_connections 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 --2- 172.21.15.92:0/2318367721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830170c840 0x558301abc160 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 --2- 172.21.15.92:0/2318367721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301acb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 --2- 172.21.15.92:0/2318367721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583016e3980 0x558301acb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 -- 172.21.15.92:0/2318367721 >> 172.21.15.92:0/2318367721 conn(0x558301700990 msgr2=0x558301abd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 -- 172.21.15.92:0/2318367721 shutdown_connections 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 -- 172.21.15.92:0/2318367721 wait complete. 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 -- start start 2024-09-21T07:15:48.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.574+0000 7fb883487740 1 Processor -- start 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb883487740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016e3980 0x558301ac7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb883487740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301ac79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb883487740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 0x558301b364a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb883487740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781b2230 con 0x5583016e3980 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb883487740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781b1b60 con 0x5583016ebb60 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb883487740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781aeda0 con 0x55830170c840 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb883487740 10 client.0 _ll_register_callbacks cb 0x7fb870009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb876d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 0x558301b364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb876d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 0x558301b364a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:43060/0 (socket says 172.21.15.92:43060) 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb876d9d640 1 -- 172.21.15.92:0/556494549 learned_addr learned my addr 172.21.15.92:0/556494549 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb87659c640 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016e3980 0x558301ac7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.575+0000 7fb875d9b640 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301ac79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb876d9d640 1 -- 172.21.15.92:0/556494549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 msgr2=0x558301ac79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:48.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb876d9d640 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301ac79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb876d9d640 1 -- 172.21.15.92:0/556494549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016e3980 msgr2=0x558301ac7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb876d9d640 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016e3980 0x558301ac7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb876d9d640 1 -- 172.21.15.92:0/556494549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558301ad1500 con 0x55830170c840 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb87659c640 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016e3980 0x558301ac7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb876d9d640 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 0x558301b364a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb870045850 tx=0x7fb870009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdf865d605ecc1e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb85dffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb85dffb640 1 -- 172.21.15.92:0/556494549 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87004e050 con 0x55830170c840 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb883487740 1 -- 172.21.15.92:0/556494549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb870036040 con 0x55830170c840 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb85dffb640 1 -- 172.21.15.92:0/556494549 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fb870030760 con 0x55830170c840 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.576+0000 7fb85dffb640 1 -- 172.21.15.92:0/556494549 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb87006f050 con 0x55830170c840 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb883487740 10 client.25852 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb883487740 1 -- 172.21.15.92:0/556494549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558301ac6990 con 0x55830170c840 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb85dffb640 1 -- 172.21.15.92:0/556494549 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb870036040 con 0x55830170c840 2024-09-21T07:15:48.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb85dffb640 1 -- 172.21.15.92:0/556494549 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb870043070 con 0x55830170c840 2024-09-21T07:15:48.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb883487740 10 client.25852 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:48.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb883487740 10 client.25852 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:15:48.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb883487740 20 client.25852 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:48.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb883487740 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5583016a0570 0x558301b43ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:48.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb883487740 4 client.25852 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T07:15:48.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb883487740 1 -- 172.21.15.92:0/556494549 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x558301a27590 con 0x5583016a0570 2024-09-21T07:15:48.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.577+0000 7fb87659c640 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5583016a0570 0x558301b43ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:48.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.578+0000 7fb85dffb640 10 client.25852 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:48.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.578+0000 7fb87659c640 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5583016a0570 0x558301b43ff0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88703ec1e091c193 server_cookie=b82c2174d1e354ed in_seq=0 out_seq=0 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.593+0000 7fb85dffb640 1 -- 172.21.15.92:0/556494549 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558301a27590 con 0x5583016a0570 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.593+0000 7fb85dffb640 10 client.25852 handle_command_reply: tid=0 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.593+0000 7fb883487740 1 client.25852 shutdown 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 1 -- 172.21.15.92:0/556494549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 msgr2=0x558301b364a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 0x558301b364a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb870045850 tx=0x7fb870009360 comp rx=0 tx=0).stop 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 1 -- 172.21.15.92:0/556494549 shutdown_connections 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5583016a0570 0x558301b43ff0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb85dffb640 0 client.25852 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55830170c840 0x558301b364a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583016ebb60 0x558301ac79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 1 --2- 172.21.15.92:0/556494549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5583016e3980 0x558301ac7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 1 -- 172.21.15.92:0/556494549 >> 172.21.15.92:0/556494549 conn(0x558301700990 msgr2=0x558301abd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:48.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 1 -- 172.21.15.92:0/556494549 shutdown_connections 2024-09-21T07:15:48.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 1 -- 172.21.15.92:0/556494549 wait complete. 2024-09-21T07:15:48.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb883487740 20 client.25852 trim_cache size 0 max 16384 2024-09-21T07:15:48.597 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:15:48.597 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-09-21T07:15:48.597 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24649, 2024-09-21T07:15:48.597 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 10, 2024-09-21T07:15:48.597 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-21T07:15:48.597 INFO:teuthology.orchestra.run.smithi092.stdout: "3f0d4d53": { 2024-09-21T07:15:48.597 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 10, 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 147.8, 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:15:48.598 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:48.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:48.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:48.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:48.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:15:48.599 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:15:48.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.594+0000 7fb87cf13640 1 -- 172.21.15.92:0/1559726040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8600b6680 msgr2=0x7fb8600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:48.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8600b6680 0x7fb8600b8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb870006010 tx=0x7fb870031000 comp rx=0 tx=0).stop 2024-09-21T07:15:48.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 -- 172.21.15.92:0/1559726040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8781051e0 msgr2=0x7fb87819a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:48.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8781051e0 0x7fb87819a930 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00b450 tx=0x7fb86c00b910 comp rx=0 tx=0).stop 2024-09-21T07:15:48.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 -- 172.21.15.92:0/1559726040 shutdown_connections 2024-09-21T07:15:48.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb8600b6680 0x7fb8600b8b90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb878105b30 0x7fb87819fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8781051e0 0x7fb87819a930 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 --2- 172.21.15.92:0/1559726040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb878103210 0x7fb87819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:48.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 -- 172.21.15.92:0/1559726040 >> 172.21.15.92:0/1559726040 conn(0x7fb878079f40 msgr2=0x7fb8781063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:48.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 -- 172.21.15.92:0/1559726040 shutdown_connections 2024-09-21T07:15:48.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:48.595+0000 7fb87cf13640 1 -- 172.21.15.92:0/1559726040 wait complete. 2024-09-21T07:15:49.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:48 smithi175 ceph-mon[34064]: pgmap v421: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 159 MiB/s wr, 76 op/s 2024-09-21T07:15:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:48 smithi092 ceph-mon[30987]: pgmap v421: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 159 MiB/s wr, 76 op/s 2024-09-21T07:15:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:48 smithi169 ceph-mon[33705]: pgmap v421: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 159 MiB/s wr, 76 op/s 2024-09-21T07:15:49.375 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3f0d4d53', quiesce took 4.6 seconds. Will release after: 23.200000000000003 2024-09-21T07:15:49.444 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:49.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.890+0000 7f0612c7a640 1 -- 172.21.15.92:0/4133217640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f060c102a60 msgr2=0x7f060c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.890+0000 7f0612c7a640 1 --2- 172.21.15.92:0/4133217640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f060c102a60 0x7f060c102e70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0600009900 tx=0x7f060002a410 comp rx=0 tx=0).stop 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.890+0000 7f0612c7a640 1 -- 172.21.15.92:0/4133217640 shutdown_connections 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.890+0000 7f0612c7a640 1 --2- 172.21.15.92:0/4133217640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f060c108cf0 0x7f060c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.890+0000 7f0612c7a640 1 --2- 172.21.15.92:0/4133217640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f060c1083a0 0x7f060c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.890+0000 7f0612c7a640 1 --2- 172.21.15.92:0/4133217640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f060c102a60 0x7f060c102e70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.890+0000 7f0612c7a640 1 -- 172.21.15.92:0/4133217640 >> 172.21.15.92:0/4133217640 conn(0x7f060c079730 msgr2=0x7f060c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.890+0000 7f0612c7a640 1 -- 172.21.15.92:0/4133217640 shutdown_connections 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.890+0000 7f0612c7a640 1 -- 172.21.15.92:0/4133217640 wait complete. 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0612c7a640 1 Processor -- start 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0612c7a640 1 -- start start 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0612c7a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f060c102a60 0x7f060c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:49.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0612c7a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f060c1083a0 0x7f060c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0612c7a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f060c108cf0 0x7f060c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0612c7a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f060c113930 con 0x7f060c108cf0 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0612c7a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1137b0 con 0x7f060c102a60 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0612c7a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f060c113ab0 con 0x7f060c1083a0 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0611217640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f060c108cf0 0x7f060c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0611217640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f060c108cf0 0x7f060c19fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51274/0 (socket says 172.21.15.92:51274) 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.891+0000 7f0611217640 1 -- 172.21.15.92:0/564221937 learned_addr learned my addr 172.21.15.92:0/564221937 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f060bfff640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f060c1083a0 0x7f060c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0610a16640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f060c102a60 0x7f060c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0611217640 1 -- 172.21.15.92:0/564221937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f060c1083a0 msgr2=0x7f060c19a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0611217640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f060c1083a0 0x7f060c19a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0611217640 1 -- 172.21.15.92:0/564221937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f060c102a60 msgr2=0x7f060c19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:49.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0611217640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f060c102a60 0x7f060c19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0611217640 1 -- 172.21.15.92:0/564221937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060c1a0270 con 0x7f060c108cf0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0611217640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f060c108cf0 0x7f060c19fc00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f060400cce0 tx=0x7f060400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0609ffb640 1 -- 172.21.15.92:0/564221937 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060400f450 con 0x7f060c108cf0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0612c7a640 1 -- 172.21.15.92:0/564221937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060c1a0560 con 0x7f060c108cf0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0609ffb640 1 -- 172.21.15.92:0/564221937 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f060400fa80 con 0x7f060c108cf0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0609ffb640 1 -- 172.21.15.92:0/564221937 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604018ad0 con 0x7f060c108cf0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.892+0000 7f0612c7a640 1 -- 172.21.15.92:0/564221937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f060c1a6d80 con 0x7f060c108cf0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.893+0000 7f0612c7a640 1 -- 172.21.15.92:0/564221937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f060c102e70 con 0x7f060c108cf0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.895+0000 7f0609ffb640 1 -- 172.21.15.92:0/564221937 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f060400f5f0 con 0x7f060c108cf0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.895+0000 7f0609ffb640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05fc0b66b0 0x7f05fc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.896+0000 7f0610a16640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05fc0b66b0 0x7f05fc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.896+0000 7f0609ffb640 1 -- 172.21.15.92:0/564221937 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f06040e8310 con 0x7f060c108cf0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.896+0000 7f0610a16640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05fc0b66b0 0x7f05fc0b8bc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0600000c00 tx=0x7f0600009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:49.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:49.899+0000 7f0609ffb640 1 -- 172.21.15.92:0/564221937 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0604014030 con 0x7f060c108cf0 2024-09-21T07:15:50.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.121+0000 7f0612c7a640 1 -- 172.21.15.92:0/564221937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f060c19b4f0 con 0x7f060c108cf0 2024-09-21T07:15:50.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.122+0000 7f0609ffb640 1 -- 172.21.15.92:0/564221937 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f060c19b4f0 con 0x7f060c108cf0 2024-09-21T07:15:50.125 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:15:50.125 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:15:50.125 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:15:50.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 -- 172.21.15.92:0/564221937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05fc0b66b0 msgr2=0x7f05fc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:50.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05fc0b66b0 0x7f05fc0b8bc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0600000c00 tx=0x7f0600009680 comp rx=0 tx=0).stop 2024-09-21T07:15:50.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 -- 172.21.15.92:0/564221937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f060c108cf0 msgr2=0x7f060c19fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:50.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f060c108cf0 0x7f060c19fc00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f060400cce0 tx=0x7f060400a620 comp rx=0 tx=0).stop 2024-09-21T07:15:50.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 -- 172.21.15.92:0/564221937 shutdown_connections 2024-09-21T07:15:50.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05fc0b66b0 0x7f05fc0b8bc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f060c108cf0 0x7f060c19fc00 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f060c1083a0 0x7f060c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 --2- 172.21.15.92:0/564221937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f060c102a60 0x7f060c19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 -- 172.21.15.92:0/564221937 >> 172.21.15.92:0/564221937 conn(0x7f060c079730 msgr2=0x7f060c101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.124+0000 7f0612c7a640 1 -- 172.21.15.92:0/564221937 shutdown_connections 2024-09-21T07:15:50.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:50.125+0000 7f0612c7a640 1 -- 172.21.15.92:0/564221937 wait complete. 2024-09-21T07:15:50.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:50 smithi092 ceph-mon[30987]: pgmap v422: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 132 MiB/s wr, 63 op/s 2024-09-21T07:15:50.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:50 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/564221937' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:50.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:15:51.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:50 smithi175 ceph-mon[34064]: pgmap v422: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 132 MiB/s wr, 63 op/s 2024-09-21T07:15:51.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:50 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/564221937' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:50 smithi169 ceph-mon[33705]: pgmap v422: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 132 MiB/s wr, 63 op/s 2024-09-21T07:15:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:50 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/564221937' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:15:51.167 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:51.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.674+0000 7f133db36640 1 -- 172.21.15.92:0/436255911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1338102a60 msgr2=0x7f1338102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.674+0000 7f133db36640 1 --2- 172.21.15.92:0/436255911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1338102a60 0x7f1338102e70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1328009900 tx=0x7f132802a410 comp rx=0 tx=0).stop 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.674+0000 7f133db36640 1 -- 172.21.15.92:0/436255911 shutdown_connections 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.674+0000 7f133db36640 1 --2- 172.21.15.92:0/436255911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1338108cf0 0x7f133810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.674+0000 7f133db36640 1 --2- 172.21.15.92:0/436255911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13381083a0 0x7f13381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.674+0000 7f133db36640 1 --2- 172.21.15.92:0/436255911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1338102a60 0x7f1338102e70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.674+0000 7f133db36640 1 -- 172.21.15.92:0/436255911 >> 172.21.15.92:0/436255911 conn(0x7f1338079730 msgr2=0x7f1338079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.674+0000 7f133db36640 1 -- 172.21.15.92:0/436255911 shutdown_connections 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.674+0000 7f133db36640 1 -- 172.21.15.92:0/436255911 wait complete. 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f133db36640 1 Processor -- start 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f133db36640 1 -- start start 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f133db36640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1338102a60 0x7f1338104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f133db36640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13381083a0 0x7f13381049c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f133db36640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1338108cf0 0x7f1338104f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f133db36640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1338112810 con 0x7f13381083a0 2024-09-21T07:15:51.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f133db36640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1338112690 con 0x7f1338108cf0 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f133db36640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1338112990 con 0x7f1338102a60 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f132ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13381083a0 0x7f13381049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f132ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13381083a0 0x7f13381049c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51294/0 (socket says 172.21.15.92:51294) 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f132ffff640 1 -- 172.21.15.92:0/1839454846 learned_addr learned my addr 172.21.15.92:0/1839454846 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f1337fff640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1338108cf0 0x7f1338104f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f13377fe640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1338102a60 0x7f1338104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f132ffff640 1 -- 172.21.15.92:0/1839454846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1338102a60 msgr2=0x7f1338104480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.675+0000 7f132ffff640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1338102a60 0x7f1338104480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.676+0000 7f132ffff640 1 -- 172.21.15.92:0/1839454846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1338108cf0 msgr2=0x7f1338104f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.676+0000 7f132ffff640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1338108cf0 0x7f1338104f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.676+0000 7f132ffff640 1 -- 172.21.15.92:0/1839454846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13381a8690 con 0x7f13381083a0 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.676+0000 7f13377fe640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1338102a60 0x7f1338104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.676+0000 7f132ffff640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13381083a0 0x7f13381049c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f132000c970 tx=0x7f132000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.676+0000 7f13357fa640 1 -- 172.21.15.92:0/1839454846 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320007bb0 con 0x7f13381083a0 2024-09-21T07:15:51.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.676+0000 7f133db36640 1 -- 172.21.15.92:0/1839454846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13381a8980 con 0x7f13381083a0 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.676+0000 7f13357fa640 1 -- 172.21.15.92:0/1839454846 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1320007d50 con 0x7f13381083a0 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.676+0000 7f13357fa640 1 -- 172.21.15.92:0/1839454846 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320018660 con 0x7f13381083a0 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.676+0000 7f133db36640 1 -- 172.21.15.92:0/1839454846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13381a8e70 con 0x7f13381083a0 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f13440aa740 1 Processor -- start 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f13440aa740 1 -- start start 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f13440aa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 0x562c2b8586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f13357fa640 1 -- 172.21.15.92:0/1839454846 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f1320018840 con 0x7f13381083a0 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f13440aa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b858be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f13440aa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 0x562c2b859120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f13440aa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c2b7ceea0 con 0x562c2b4881b0 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f13440aa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562c2b7be2d0 con 0x562c2b4b1070 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f13440aa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c2b7c20e0 con 0x562c2b490390 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f1337fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 0x562c2b8586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f1337fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 0x562c2b8586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:46210/0 (socket says 172.21.15.92:46210) 2024-09-21T07:15:51.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f1337fff640 1 -- 172.21.15.92:0/853372082 learned_addr learned my addr 172.21.15.92:0/853372082 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.679+0000 7f132ffff640 1 --2- 172.21.15.92:0/853372082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 0x562c2b859120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f1337fff640 1 -- 172.21.15.92:0/853372082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 msgr2=0x562c2b859120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f1337fff640 1 --2- 172.21.15.92:0/853372082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 0x562c2b859120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f1337fff640 1 -- 172.21.15.92:0/853372082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 msgr2=0x562c2b858be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f1337fff640 1 --2- 172.21.15.92:0/853372082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b858be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f1337fff640 1 -- 172.21.15.92:0/853372082 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2b51c650 con 0x562c2b4b1070 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f1337fff640 1 --2- 172.21.15.92:0/853372082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 0x562c2b8586a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1330009ee0 tx=0x7f1330010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b65ea8e627cd8e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f13357fa640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13240b6680 0x7f13240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f132dffb640 1 -- 172.21.15.92:0/853372082 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330016070 con 0x562c2b4b1070 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f132dffb640 1 -- 172.21.15.92:0/853372082 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1330004d20 con 0x562c2b4b1070 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f132dffb640 1 -- 172.21.15.92:0/853372082 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13300126b0 con 0x562c2b4b1070 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f13377fe640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13240b6680 0x7f13240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.680+0000 7f13357fa640 1 -- 172.21.15.92:0/1839454846 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f13200e7c00 con 0x7f13381083a0 2024-09-21T07:15:51.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13440aa740 1 -- 172.21.15.92:0/853372082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 msgr2=0x562c2b8586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13377fe640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13240b6680 0x7f13240b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x562c2b857320 tx=0x7f1328000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13440aa740 1 --2- 172.21.15.92:0/853372082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 0x562c2b8586a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1330009ee0 tx=0x7f1330010740 comp rx=0 tx=0).stop 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13440aa740 1 -- 172.21.15.92:0/853372082 shutdown_connections 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13440aa740 1 --2- 172.21.15.92:0/853372082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 0x562c2b859120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13440aa740 1 --2- 172.21.15.92:0/853372082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b858be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13440aa740 1 --2- 172.21.15.92:0/853372082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 0x562c2b8586a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13440aa740 1 -- 172.21.15.92:0/853372082 >> 172.21.15.92:0/853372082 conn(0x562c2b4a5460 msgr2=0x562c2b856590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13440aa740 1 -- 172.21.15.92:0/853372082 shutdown_connections 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13440aa740 1 -- 172.21.15.92:0/853372082 wait complete. 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.681+0000 7f13440aa740 1 -- start start 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13440aa740 1 Processor -- start 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13440aa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b863e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13440aa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 0x562c2b864370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13440aa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 0x562c2b8701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13440aa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c2b61f700 con 0x562c2b4881b0 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13440aa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562c2b759160 con 0x562c2b4b1070 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13440aa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c2b866e80 con 0x562c2b490390 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13440aa740 10 client.0 _ll_register_callbacks cb 0x562c2b7729e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13377fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b863e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13377fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b863e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51300/0 (socket says 172.21.15.92:51300) 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f13377fe640 1 -- 172.21.15.92:0/3661546273 learned_addr learned my addr 172.21.15.92:0/3661546273 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f1337fff640 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 0x562c2b8701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.682+0000 7f132ffff640 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 0x562c2b864370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f13377fe640 1 -- 172.21.15.92:0/3661546273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 msgr2=0x562c2b864370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f13377fe640 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 0x562c2b864370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f13377fe640 1 -- 172.21.15.92:0/3661546273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 msgr2=0x562c2b8701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:51.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f13377fe640 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 0x562c2b8701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f13377fe640 1 -- 172.21.15.92:0/3661546273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2b786c90 con 0x562c2b4881b0 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f132ffff640 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 0x562c2b864370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f13377fe640 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b863e30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1328033000 tx=0x7f132802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba47a5e282c2603 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f1316ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f1316ffd640 1 -- 172.21.15.92:0/3661546273 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328041070 con 0x562c2b4881b0 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f1316ffd640 1 -- 172.21.15.92:0/3661546273 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f1328004450 con 0x562c2b4881b0 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f13440aa740 1 -- 172.21.15.92:0/3661546273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1330004d20 con 0x562c2b4881b0 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f1316ffd640 1 -- 172.21.15.92:0/3661546273 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1328056050 con 0x562c2b4881b0 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f13440aa740 10 client.16479 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f13440aa740 1 -- 172.21.15.92:0/3661546273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c2b872c40 con 0x562c2b4881b0 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f1316ffd640 1 -- 172.21.15.92:0/3661546273 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1330004d20 con 0x562c2b4881b0 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.683+0000 7f1316ffd640 1 -- 172.21.15.92:0/3661546273 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1328004bf0 con 0x562c2b4881b0 2024-09-21T07:15:51.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.684+0000 7f13440aa740 10 client.16479 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.684+0000 7f13440aa740 10 client.16479 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.684+0000 7f13440aa740 20 client.16479 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.684+0000 7f13440aa740 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x562c2b46f9f0 0x562c2b8761e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.684+0000 7f13440aa740 4 client.16479 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.684+0000 7f13440aa740 1 -- 172.21.15.92:0/3661546273 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c2b7d0df0 con 0x562c2b46f9f0 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.684+0000 7f132ffff640 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x562c2b46f9f0 0x562c2b8761e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.684+0000 7f1316ffd640 10 client.16479 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.684+0000 7f132ffff640 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x562c2b46f9f0 0x562c2b8761e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=44c383b7ecec46ac server_cookie=60ef6fb70b629b93 in_seq=0 out_seq=0 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f1316ffd640 1 -- 172.21.15.92:0/3661546273 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c2b7d0df0 con 0x562c2b46f9f0 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f1316ffd640 10 client.16479 handle_command_reply: tid=0 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f13440aa740 1 client.16479 shutdown 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f13440aa740 1 -- 172.21.15.92:0/3661546273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 msgr2=0x562c2b863e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f13440aa740 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b863e30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1328033000 tx=0x7f132802a410 comp rx=0 tx=0).stop 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f13440aa740 1 -- 172.21.15.92:0/3661546273 shutdown_connections 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f13440aa740 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x562c2b46f9f0 0x562c2b8761e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f13440aa740 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b4b1070 0x562c2b8701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f13440aa740 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b490390 0x562c2b864370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f13440aa740 1 --2- 172.21.15.92:0/3661546273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b863e30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f13440aa740 1 -- 172.21.15.92:0/3661546273 >> 172.21.15.92:0/3661546273 conn(0x562c2b4a5460 msgr2=0x562c2b85b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:51.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.685+0000 7f1316ffd640 0 client.16479 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:15:51.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.686+0000 7f13440aa740 1 -- 172.21.15.92:0/3661546273 shutdown_connections 2024-09-21T07:15:51.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.686+0000 7f13440aa740 1 -- 172.21.15.92:0/3661546273 wait complete. 2024-09-21T07:15:51.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.686+0000 7f13440aa740 20 client.16479 trim_cache size 0 max 16384 2024-09-21T07:15:51.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f13440aa740 1 Processor -- start 2024-09-21T07:15:51.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f13440aa740 1 -- start start 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f13440aa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b4881b0 0x562c2b85beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f13440aa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b490390 0x562c2b8700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f13440aa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4b1070 0x562c2b861020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f13440aa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f13381b3060 con 0x562c2b4b1070 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f13440aa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13381b4ba0 con 0x562c2b490390 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f13440aa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f13381b3730 con 0x562c2b4881b0 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f1337fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4b1070 0x562c2b861020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f1337fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4b1070 0x562c2b861020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51302/0 (socket says 172.21.15.92:51302) 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f1337fff640 1 -- 172.21.15.92:0/3851863503 learned_addr learned my addr 172.21.15.92:0/3851863503 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f13377fe640 1 --2- 172.21.15.92:0/3851863503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b4881b0 0x562c2b85beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f1337fff640 1 -- 172.21.15.92:0/3851863503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b4881b0 msgr2=0x562c2b85beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f1337fff640 1 --2- 172.21.15.92:0/3851863503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b4881b0 0x562c2b85beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f1337fff640 1 -- 172.21.15.92:0/3851863503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b490390 msgr2=0x562c2b8700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f1337fff640 1 --2- 172.21.15.92:0/3851863503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b490390 0x562c2b8700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.699+0000 7f1337fff640 1 -- 172.21.15.92:0/3851863503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2b85c3f0 con 0x562c2b4b1070 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.700+0000 7f1337fff640 1 --2- 172.21.15.92:0/3851863503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4b1070 0x562c2b861020 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1330009ee0 tx=0x7f1330009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1939214d068e62c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.700+0000 7f132d7fa640 1 -- 172.21.15.92:0/3851863503 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330029070 con 0x562c2b4b1070 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.700+0000 7f132d7fa640 1 -- 172.21.15.92:0/3851863503 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1330012b60 con 0x562c2b4b1070 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.700+0000 7f132d7fa640 1 -- 172.21.15.92:0/3851863503 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330016050 con 0x562c2b4b1070 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.700+0000 7f13440aa740 1 -- 172.21.15.92:0/3851863503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4b1070 msgr2=0x562c2b861020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.700+0000 7f13440aa740 1 --2- 172.21.15.92:0/3851863503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4b1070 0x562c2b861020 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1330009ee0 tx=0x7f1330009ad0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 -- 172.21.15.92:0/3851863503 shutdown_connections 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 --2- 172.21.15.92:0/3851863503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4b1070 0x562c2b861020 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 --2- 172.21.15.92:0/3851863503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b490390 0x562c2b8700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 --2- 172.21.15.92:0/3851863503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b4881b0 0x562c2b85beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 -- 172.21.15.92:0/3851863503 >> 172.21.15.92:0/3851863503 conn(0x562c2b4a5460 msgr2=0x562c2b85b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:51.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 -- 172.21.15.92:0/3851863503 shutdown_connections 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 -- 172.21.15.92:0/3851863503 wait complete. 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 -- start start 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 Processor -- start 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b86c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b490390 0x562c2b867e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.701+0000 7f13440aa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b4b1070 0x562c2b868470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13440aa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f13381b44d0 con 0x562c2b4881b0 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13440aa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13381b3e00 con 0x562c2b490390 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13440aa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f13381b1040 con 0x562c2b4b1070 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13440aa740 10 client.0 _ll_register_callbacks cb 0x7f1328009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13377fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b86c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13377fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b86c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51304/0 (socket says 172.21.15.92:51304) 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13377fe640 1 -- 172.21.15.92:0/4271052791 learned_addr learned my addr 172.21.15.92:0/4271052791 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:51.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f1337fff640 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b4b1070 0x562c2b868470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f132ffff640 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b490390 0x562c2b867e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13377fe640 1 -- 172.21.15.92:0/4271052791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b4b1070 msgr2=0x562c2b868470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13377fe640 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b4b1070 0x562c2b868470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13377fe640 1 -- 172.21.15.92:0/4271052791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b490390 msgr2=0x562c2b867e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13377fe640 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b490390 0x562c2b867e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13377fe640 1 -- 172.21.15.92:0/4271052791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2b868c00 con 0x562c2b4881b0 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f132ffff640 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b490390 0x562c2b867e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13377fe640 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b86c990 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f13280092a0 tx=0x7f1328004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a117610d876ea8d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f1316ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f1316ffd640 1 -- 172.21.15.92:0/4271052791 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328041070 con 0x562c2b4881b0 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f1316ffd640 1 -- 172.21.15.92:0/4271052791 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f13280053d0 con 0x562c2b4881b0 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.702+0000 7f13440aa740 1 -- 172.21.15.92:0/4271052791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1330012b60 con 0x562c2b4881b0 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f1316ffd640 1 -- 172.21.15.92:0/4271052791 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f132806b050 con 0x562c2b4881b0 2024-09-21T07:15:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f13440aa740 10 client.16485 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f13440aa740 1 -- 172.21.15.92:0/4271052791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c2b8e0bb0 con 0x562c2b4881b0 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f1316ffd640 1 -- 172.21.15.92:0/4271052791 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1330012b60 con 0x562c2b4881b0 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f1316ffd640 1 -- 172.21.15.92:0/4271052791 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f13280047e0 con 0x562c2b4881b0 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f13440aa740 10 client.16485 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f13440aa740 10 client.16485 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f13440aa740 20 client.16485 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f13440aa740 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x562c2b444da0 0x562c2b8e3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f13440aa740 4 client.16485 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f13440aa740 1 -- 172.21.15.92:0/4271052791 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562c2b7cc8a0 con 0x562c2b444da0 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.703+0000 7f132ffff640 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x562c2b444da0 0x562c2b8e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f1316ffd640 10 client.16485 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f132ffff640 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x562c2b444da0 0x562c2b8e3310 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=13cb196a26b6ec98 server_cookie=df8340a0c634b1 in_seq=0 out_seq=0 2024-09-21T07:15:51.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f1316ffd640 1 -- 172.21.15.92:0/4271052791 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562c2b7cc8a0 con 0x562c2b444da0 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f1316ffd640 10 client.16485 handle_command_reply: tid=0 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 client.16485 shutdown 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 -- 172.21.15.92:0/4271052791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 msgr2=0x562c2b86c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b86c990 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f13280092a0 tx=0x7f1328004580 comp rx=0 tx=0).stop 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 -- 172.21.15.92:0/4271052791 shutdown_connections 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x562c2b444da0 0x562c2b8e3310 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2b4b1070 0x562c2b868470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2b490390 0x562c2b867e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f1316ffd640 0 client.16485 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 --2- 172.21.15.92:0/4271052791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2b4881b0 0x562c2b86c990 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 -- 172.21.15.92:0/4271052791 >> 172.21.15.92:0/4271052791 conn(0x562c2b4a5460 msgr2=0x562c2b8596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 -- 172.21.15.92:0/4271052791 shutdown_connections 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 1 -- 172.21.15.92:0/4271052791 wait complete. 2024-09-21T07:15:51.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.704+0000 7f13440aa740 20 client.16485 trim_cache size 0 max 16384 2024-09-21T07:15:51.716 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:15:51.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 -- 172.21.15.92:0/1839454846 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13240b6680 msgr2=0x7f13240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13240b6680 0x7f13240b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x562c2b857320 tx=0x7f1328000bc0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 -- 172.21.15.92:0/1839454846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13381083a0 msgr2=0x7f13381049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13381083a0 0x7f13381049c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f132000c970 tx=0x7f132000ce30 comp rx=0 tx=0).stop 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 -- 172.21.15.92:0/1839454846 shutdown_connections 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f13240b6680 0x7f13240b8b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1338108cf0 0x7f1338104f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13381083a0 0x7f13381049c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 --2- 172.21.15.92:0/1839454846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1338102a60 0x7f1338104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 -- 172.21.15.92:0/1839454846 >> 172.21.15.92:0/1839454846 conn(0x7f1338079730 msgr2=0x7f1338106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 -- 172.21.15.92:0/1839454846 shutdown_connections 2024-09-21T07:15:51.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:51.705+0000 7f133db36640 1 -- 172.21.15.92:0/1839454846 wait complete. 2024-09-21T07:15:52.504 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:15:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:53.013 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:52 smithi092 ceph-mon[30987]: pgmap v423: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 67 MiB/s wr, 31 op/s 2024-09-21T07:15:53.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:52 smithi175 ceph-mon[34064]: pgmap v423: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 67 MiB/s wr, 31 op/s 2024-09-21T07:15:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.126+0000 7f4e50430640 1 -- 172.21.15.92:0/2554453660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e48108c50 msgr2=0x7f4e4810f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.126+0000 7f4e50430640 1 --2- 172.21.15.92:0/2554453660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e48108c50 0x7f4e4810f480 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009ca0 tx=0x7f4e4002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.126+0000 7f4e50430640 1 -- 172.21.15.92:0/2554453660 shutdown_connections 2024-09-21T07:15:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.126+0000 7f4e50430640 1 --2- 172.21.15.92:0/2554453660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e48108c50 0x7f4e4810f480 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.126+0000 7f4e50430640 1 --2- 172.21.15.92:0/2554453660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e48108300 0x7f4e48108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.126+0000 7f4e50430640 1 --2- 172.21.15.92:0/2554453660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e481029d0 0x7f4e48102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.126+0000 7f4e50430640 1 -- 172.21.15.92:0/2554453660 >> 172.21.15.92:0/2554453660 conn(0x7f4e4807a6f0 msgr2=0x7f4e4807ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.126+0000 7f4e50430640 1 -- 172.21.15.92:0/2554453660 shutdown_connections 2024-09-21T07:15:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.126+0000 7f4e50430640 1 -- 172.21.15.92:0/2554453660 wait complete. 2024-09-21T07:15:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e50430640 1 Processor -- start 2024-09-21T07:15:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e50430640 1 -- start start 2024-09-21T07:15:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e50430640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e481029d0 0x7f4e4819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e50430640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e48108300 0x7f4e4819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e50430640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e48108c50 0x7f4e4819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e50430640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4e48113910 con 0x7f4e48108c50 2024-09-21T07:15:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e50430640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4e48113790 con 0x7f4e481029d0 2024-09-21T07:15:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e50430640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e48113a90 con 0x7f4e48108300 2024-09-21T07:15:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e4e9cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e48108c50 0x7f4e4819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e4e9cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e48108c50 0x7f4e4819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51326/0 (socket says 172.21.15.92:51326) 2024-09-21T07:15:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e4e9cd640 1 -- 172.21.15.92:0/1041364899 learned_addr learned my addr 172.21.15.92:0/1041364899 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e481029d0 0x7f4e4819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.127+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e48108300 0x7f4e4819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e4e9cd640 1 -- 172.21.15.92:0/1041364899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e48108300 msgr2=0x7f4e4819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e4e9cd640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e48108300 0x7f4e4819a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e4e9cd640 1 -- 172.21.15.92:0/1041364899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e481029d0 msgr2=0x7f4e4819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e4e9cd640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e481029d0 0x7f4e4819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e4e9cd640 1 -- 172.21.15.92:0/1041364899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e481a02c0 con 0x7f4e48108c50 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e4e9cd640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e48108c50 0x7f4e4819fbc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005cc0 tx=0x7f4e40032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e3f7fe640 1 -- 172.21.15.92:0/1041364899 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40032e00 con 0x7f4e48108c50 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e50430640 1 -- 172.21.15.92:0/1041364899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e481a0550 con 0x7f4e48108c50 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e3f7fe640 1 -- 172.21.15.92:0/1041364899 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e400044d0 con 0x7f4e48108c50 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e3f7fe640 1 -- 172.21.15.92:0/1041364899 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40030b70 con 0x7f4e48108c50 2024-09-21T07:15:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.128+0000 7f4e50430640 1 -- 172.21.15.92:0/1041364899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e481a6d40 con 0x7f4e48108c50 2024-09-21T07:15:53.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.131+0000 7f4e5747a740 1 Processor -- start 2024-09-21T07:15:53.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.131+0000 7f4e3f7fe640 1 -- 172.21.15.92:0/1041364899 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f4e40004680 con 0x7f4e48108c50 2024-09-21T07:15:53.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.131+0000 7f4e5747a740 1 -- start start 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.131+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.131+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff40ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.131+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff41430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.131+0000 7f4e5747a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b84feb56f0 con 0x55b84fb722f0 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.131+0000 7f4e5747a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b84fea4b20 con 0x55b84fb7a4d0 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.131+0000 7f4e5747a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b84fea8930 con 0x55b84fb9b1b0 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.131+0000 7f4e4e1cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff40ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4e1cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff40ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51340/0 (socket says 172.21.15.92:51340) 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4e1cc640 1 -- 172.21.15.92:0/471229931 learned_addr learned my addr 172.21.15.92:0/471229931 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/471229931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/471229931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff41430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e3f7fe640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4e340b6680 0x7f4e340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4e1cc640 1 -- 172.21.15.92:0/471229931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 msgr2=0x55b84ff409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/471229931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4e1cc640 1 -- 172.21.15.92:0/471229931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 msgr2=0x55b84ff41430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/471229931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff41430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4e1cc640 1 -- 172.21.15.92:0/471229931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84fe6a530 con 0x55b84fb722f0 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/471229931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff41430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4e9cd640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4e340b6680 0x7f4e340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/471229931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff40ef0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400bcb0 tx=0x7f4e4400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39423cbaf239fd16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e3f7fe640 1 -- 172.21.15.92:0/1041364899 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4e40109010 con 0x7f4e48108c50 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e3cbfe640 1 -- 172.21.15.92:0/471229931 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44015070 con 0x55b84fb722f0 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e3cbfe640 1 -- 172.21.15.92:0/471229931 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e4401a8f0 con 0x55b84fb722f0 2024-09-21T07:15:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.132+0000 7f4e3cbfe640 1 -- 172.21.15.92:0/471229931 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e440118c0 con 0x55b84fb722f0 2024-09-21T07:15:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.133+0000 7f4e5747a740 1 -- 172.21.15.92:0/471229931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 msgr2=0x55b84ff40ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.133+0000 7f4e4e9cd640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4e340b6680 0x7f4e340b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4e40106470 tx=0x7f4e4009b880 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.133+0000 7f4e5747a740 1 --2- 172.21.15.92:0/471229931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff40ef0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400bcb0 tx=0x7f4e4400f730 comp rx=0 tx=0).stop 2024-09-21T07:15:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.133+0000 7f4e5747a740 1 -- 172.21.15.92:0/471229931 shutdown_connections 2024-09-21T07:15:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.133+0000 7f4e5747a740 1 --2- 172.21.15.92:0/471229931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff41430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.133+0000 7f4e5747a740 1 --2- 172.21.15.92:0/471229931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff40ef0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.133+0000 7f4e5747a740 1 --2- 172.21.15.92:0/471229931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.133+0000 7f4e5747a740 1 -- 172.21.15.92:0/471229931 >> 172.21.15.92:0/471229931 conn(0x55b84fb8f300 msgr2=0x55b84ff3e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.133+0000 7f4e5747a740 1 -- 172.21.15.92:0/471229931 shutdown_connections 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.133+0000 7f4e5747a740 1 -- 172.21.15.92:0/471229931 wait complete. 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e5747a740 1 -- start start 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e5747a740 1 Processor -- start 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff4c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff4c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff58420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e5747a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b84fddcab0 con 0x55b84fb722f0 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e5747a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b84fe4a730 con 0x55b84fb7a4d0 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e5747a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b84ff4f130 con 0x55b84fb9b1b0 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e5747a740 10 client.0 _ll_register_callbacks cb 0x55b84fe9e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e4d9cb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff4c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e4d9cb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff4c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51346/0 (socket says 172.21.15.92:51346) 2024-09-21T07:15:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e4d9cb640 1 -- 172.21.15.92:0/423322183 learned_addr learned my addr 172.21.15.92:0/423322183 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e4d9cb640 1 -- 172.21.15.92:0/423322183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 msgr2=0x55b84ff58420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff58420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff4c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e4d9cb640 1 -- 172.21.15.92:0/423322183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 msgr2=0x55b84ff4c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.134+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff4c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e4d9cb640 1 -- 172.21.15.92:0/423322183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84fc06790 con 0x55b84fb722f0 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff4c020 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800e4c0 tx=0x7f4e38012d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ed017f14482be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e31ffb640 1 -- 172.21.15.92:0/423322183 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38011cb0 con 0x55b84fb722f0 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e31ffb640 1 -- 172.21.15.92:0/423322183 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4e3801a3b0 con 0x55b84fb722f0 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e5747a740 1 -- 172.21.15.92:0/423322183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e4401a8f0 con 0x55b84fb722f0 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e31ffb640 1 -- 172.21.15.92:0/423322183 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4e38011e50 con 0x55b84fb722f0 2024-09-21T07:15:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e5747a740 10 client.16497 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e5747a740 1 -- 172.21.15.92:0/423322183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b84fc7f620 con 0x55b84fb722f0 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e31ffb640 1 -- 172.21.15.92:0/423322183 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e4401a8f0 con 0x55b84fb722f0 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e31ffb640 1 -- 172.21.15.92:0/423322183 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4e3800f040 con 0x55b84fb722f0 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e5747a740 10 client.16497 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e5747a740 10 client.16497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e5747a740 20 client.16497 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e5747a740 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b84fb59d80 0x55b84ff5e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e5747a740 4 client.16497 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.135+0000 7f4e5747a740 1 -- 172.21.15.92:0/423322183 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b84feb7640 con 0x55b84fb59d80 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.136+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b84fb59d80 0x55b84ff5e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.136+0000 7f4e31ffb640 10 client.16497 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.136+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b84fb59d80 0x55b84ff5e150 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b8aa9296aa78d96 server_cookie=1c8e0c7771711ffc in_seq=0 out_seq=0 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e31ffb640 1 -- 172.21.15.92:0/423322183 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b84feb7640 con 0x55b84fb59d80 2024-09-21T07:15:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e31ffb640 10 client.16497 handle_command_reply: tid=0 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 client.16497 shutdown 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 -- 172.21.15.92:0/423322183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 msgr2=0x55b84ff4c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff4c020 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800e4c0 tx=0x7f4e38012d90 comp rx=0 tx=0).stop 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 -- 172.21.15.92:0/423322183 shutdown_connections 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b84fb59d80 0x55b84ff5e150 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff58420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e31ffb640 0 client.16497 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff4c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 --2- 172.21.15.92:0/423322183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff4c020 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 -- 172.21.15.92:0/423322183 >> 172.21.15.92:0/423322183 conn(0x55b84fb8f300 msgr2=0x55b84ff419e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 -- 172.21.15.92:0/423322183 shutdown_connections 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 1 -- 172.21.15.92:0/423322183 wait complete. 2024-09-21T07:15:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.137+0000 7f4e5747a740 20 client.16497 trim_cache size 0 max 16384 2024-09-21T07:15:53.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:52 smithi169 ceph-mon[33705]: pgmap v423: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 67 MiB/s wr, 31 op/s 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e5747a740 1 Processor -- start 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e5747a740 1 -- start start 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff423a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff4dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff58320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e5747a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481b0ea0 con 0x55b84fb722f0 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e5747a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481b29e0 con 0x55b84fb7a4d0 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e5747a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481b1570 con 0x55b84fb9b1b0 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e4d9cb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e4d9cb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51362/0 (socket says 172.21.15.92:51362) 2024-09-21T07:15:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.152+0000 7f4e4d9cb640 1 -- 172.21.15.92:0/4079242490 learned_addr learned my addr 172.21.15.92:0/4079242490 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/4079242490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff58320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/4079242490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff4dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e4d9cb640 1 -- 172.21.15.92:0/4079242490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 msgr2=0x55b84ff58320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/4079242490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff58320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e4d9cb640 1 -- 172.21.15.92:0/4079242490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 msgr2=0x55b84ff4dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/4079242490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff4dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e4d9cb640 1 -- 172.21.15.92:0/4079242490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84ff59160 con 0x55b84fb722f0 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/4079242490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff423a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4e38001eb0 tx=0x7f4e38005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60fa4ed21edbb72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e33fff640 1 -- 172.21.15.92:0/4079242490 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3801b890 con 0x55b84fb722f0 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e33fff640 1 -- 172.21.15.92:0/4079242490 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e380044d0 con 0x55b84fb722f0 2024-09-21T07:15:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.153+0000 7f4e33fff640 1 -- 172.21.15.92:0/4079242490 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38003db0 con 0x55b84fb722f0 2024-09-21T07:15:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 -- 172.21.15.92:0/4079242490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 msgr2=0x55b84ff423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 --2- 172.21.15.92:0/4079242490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff423a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4e38001eb0 tx=0x7f4e38005fd0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 -- 172.21.15.92:0/4079242490 shutdown_connections 2024-09-21T07:15:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 --2- 172.21.15.92:0/4079242490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ff58320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 --2- 172.21.15.92:0/4079242490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb7a4d0 0x55b84ff4dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 --2- 172.21.15.92:0/4079242490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb722f0 0x55b84ff423a0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 -- 172.21.15.92:0/4079242490 >> 172.21.15.92:0/4079242490 conn(0x55b84fb8f300 msgr2=0x55b84ff4d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 -- 172.21.15.92:0/4079242490 shutdown_connections 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 -- 172.21.15.92:0/4079242490 wait complete. 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 -- start start 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.154+0000 7f4e5747a740 1 Processor -- start 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb722f0 0x55b84ff51e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb7a4d0 0x55b84ff523e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e5747a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ffbfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e5747a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481b2310 con 0x55b84fb7a4d0 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e5747a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481b1c40 con 0x55b84fb722f0 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e5747a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481aee80 con 0x55b84fb9b1b0 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e5747a740 10 client.0 _ll_register_callbacks cb 0x7f4e3800ea90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4e1cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb7a4d0 0x55b84ff523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4e1cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb7a4d0 0x55b84ff523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51370/0 (socket says 172.21.15.92:51370) 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4e1cc640 1 -- 172.21.15.92:0/3011346891 learned_addr learned my addr 172.21.15.92:0/3011346891 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb722f0 0x55b84ff51e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ffbfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4e1cc640 1 -- 172.21.15.92:0/3011346891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 msgr2=0x55b84ffbfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ffbfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4e1cc640 1 -- 172.21.15.92:0/3011346891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb722f0 msgr2=0x55b84ff51e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb722f0 0x55b84ff51e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4e1cc640 1 -- 172.21.15.92:0/3011346891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84ffc0190 con 0x55b84fb7a4d0 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ffbfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e4e1cc640 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb7a4d0 0x55b84ff523e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55b84ff3f630 tx=0x7f4e4400b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8126841e0b4fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e31ffb640 1 -- 172.21.15.92:0/3011346891 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4401e070 con 0x55b84fb7a4d0 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e31ffb640 1 -- 172.21.15.92:0/3011346891 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4e44005240 con 0x55b84fb7a4d0 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.155+0000 7f4e5747a740 1 -- 172.21.15.92:0/3011346891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e380044d0 con 0x55b84fb7a4d0 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e31ffb640 1 -- 172.21.15.92:0/3011346891 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4e44035050 con 0x55b84fb7a4d0 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e5747a740 10 client.16503 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e5747a740 1 -- 172.21.15.92:0/3011346891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b84ffc8750 con 0x55b84fb7a4d0 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e31ffb640 1 -- 172.21.15.92:0/3011346891 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e380044d0 con 0x55b84fb7a4d0 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e31ffb640 1 -- 172.21.15.92:0/3011346891 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4e44004ba0 con 0x55b84fb7a4d0 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e5747a740 10 client.16503 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e5747a740 10 client.16503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e5747a740 20 client.16503 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e5747a740 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b84fb2f1c0 0x55b84ffcac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e5747a740 4 client.16503 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e5747a740 1 -- 172.21.15.92:0/3011346891 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b84feb30f0 con 0x55b84fb2f1c0 2024-09-21T07:15:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.156+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b84fb2f1c0 0x55b84ffcac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.157+0000 7f4e31ffb640 10 client.16503 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.157+0000 7f4e4d9cb640 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b84fb2f1c0 0x55b84ffcac00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99fa0ffe787a448d server_cookie=2424b4b63b1606fb in_seq=0 out_seq=0 2024-09-21T07:15:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e31ffb640 1 -- 172.21.15.92:0/3011346891 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b84feb30f0 con 0x55b84fb2f1c0 2024-09-21T07:15:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e31ffb640 10 client.16503 handle_command_reply: tid=0 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e5747a740 1 client.16503 shutdown 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e5747a740 1 -- 172.21.15.92:0/3011346891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb7a4d0 msgr2=0x55b84ff523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e5747a740 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb7a4d0 0x55b84ff523e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55b84ff3f630 tx=0x7f4e4400b9a0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e5747a740 1 -- 172.21.15.92:0/3011346891 shutdown_connections 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e5747a740 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b84fb2f1c0 0x55b84ffcac00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e5747a740 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84fb9b1b0 0x55b84ffbfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e5747a740 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b84fb7a4d0 0x55b84ff523e0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e5747a740 1 --2- 172.21.15.92:0/3011346891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b84fb722f0 0x55b84ff51e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e31ffb640 0 client.16503 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e5747a740 1 -- 172.21.15.92:0/3011346891 >> 172.21.15.92:0/3011346891 conn(0x55b84fb8f300 msgr2=0x55b84ff42170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.165+0000 7f4e5747a740 1 -- 172.21.15.92:0/3011346891 shutdown_connections 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e5747a740 1 -- 172.21.15.92:0/3011346891 wait complete. 2024-09-21T07:15:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e5747a740 20 client.16503 trim_cache size 0 max 16384 2024-09-21T07:15:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:15:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:15:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:15:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:15:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 -- 172.21.15.92:0/1041364899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4e340b6680 msgr2=0x7f4e340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4e340b6680 0x7f4e340b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4e40106470 tx=0x7f4e4009b880 comp rx=0 tx=0).stop 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 -- 172.21.15.92:0/1041364899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e48108c50 msgr2=0x7f4e4819fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e48108c50 0x7f4e4819fbc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005cc0 tx=0x7f4e40032a10 comp rx=0 tx=0).stop 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 -- 172.21.15.92:0/1041364899 shutdown_connections 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4e340b6680 0x7f4e340b8b90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e48108c50 0x7f4e4819fbc0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e48108300 0x7f4e4819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 --2- 172.21.15.92:0/1041364899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e481029d0 0x7f4e4819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 -- 172.21.15.92:0/1041364899 >> 172.21.15.92:0/1041364899 conn(0x7f4e4807a6f0 msgr2=0x7f4e481063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 -- 172.21.15.92:0/1041364899 shutdown_connections 2024-09-21T07:15:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:15:53.166+0000 7f4e50430640 1 -- 172.21.15.92:0/1041364899 wait complete. 2024-09-21T07:15:53.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.249+0000 7fdbc36ab640 1 -- 172.21.15.92:0/1950319829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc1083a0 msgr2=0x7fdbbc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.249+0000 7fdbc36ab640 1 --2- 172.21.15.92:0/1950319829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc1083a0 0x7fdbbc1087b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009900 tx=0x7fdbac02a410 comp rx=0 tx=0).stop 2024-09-21T07:15:53.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.249+0000 7fdbc36ab640 1 -- 172.21.15.92:0/1950319829 shutdown_connections 2024-09-21T07:15:53.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.249+0000 7fdbc36ab640 1 --2- 172.21.15.92:0/1950319829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbbc108cf0 0x7fdbbc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.249+0000 7fdbc36ab640 1 --2- 172.21.15.92:0/1950319829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc1083a0 0x7fdbbc1087b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.249+0000 7fdbc36ab640 1 --2- 172.21.15.92:0/1950319829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc102a60 0x7fdbbc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.249+0000 7fdbc36ab640 1 -- 172.21.15.92:0/1950319829 >> 172.21.15.92:0/1950319829 conn(0x7fdbbc079730 msgr2=0x7fdbbc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.250+0000 7fdbc36ab640 1 -- 172.21.15.92:0/1950319829 shutdown_connections 2024-09-21T07:15:53.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.250+0000 7fdbc36ab640 1 -- 172.21.15.92:0/1950319829 wait complete. 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.250+0000 7fdbc36ab640 1 Processor -- start 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.250+0000 7fdbc36ab640 1 -- start start 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc36ab640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbbc102a60 0x7fdbbc19b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc36ab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1083a0 0x7fdbbc19b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc36ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc108cf0 0x7fdbbc19bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc36ab640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc112810 con 0x7fdbbc108cf0 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc36ab640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc112690 con 0x7fdbbc102a60 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc36ab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc112990 con 0x7fdbbc1083a0 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc1c48640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc108cf0 0x7fdbbc19bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc1c48640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc108cf0 0x7fdbbc19bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51374/0 (socket says 172.21.15.92:51374) 2024-09-21T07:15:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc1c48640 1 -- 172.21.15.92:0/946669367 learned_addr learned my addr 172.21.15.92:0/946669367 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc1447640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbbc102a60 0x7fdbbc19b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc0c46640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1083a0 0x7fdbbc19b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc1c48640 1 -- 172.21.15.92:0/946669367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1083a0 msgr2=0x7fdbbc19b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1083a0 0x7fdbbc19b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc1c48640 1 -- 172.21.15.92:0/946669367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbbc102a60 msgr2=0x7fdbbc19b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbbc102a60 0x7fdbbc19b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc1c48640 1 -- 172.21.15.92:0/946669367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc1a6420 con 0x7fdbbc108cf0 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc108cf0 0x7fdbbc19bca0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400eaa0 tx=0x7fdbb400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbb27fc640 1 -- 172.21.15.92:0/946669367 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4004d20 con 0x7fdbbc108cf0 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbb27fc640 1 -- 172.21.15.92:0/946669367 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbb4005020 con 0x7fdbbc108cf0 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.251+0000 7fdbc36ab640 1 -- 172.21.15.92:0/946669367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbbc1a6710 con 0x7fdbbc108cf0 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.252+0000 7fdbb27fc640 1 -- 172.21.15.92:0/946669367 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40116d0 con 0x7fdbbc108cf0 2024-09-21T07:15:53.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.252+0000 7fdbc36ab640 1 -- 172.21.15.92:0/946669367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbbc1a6c20 con 0x7fdbbc108cf0 2024-09-21T07:15:53.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.254+0000 7fdbb27fc640 1 -- 172.21.15.92:0/946669367 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fdbb40051d0 con 0x7fdbbc108cf0 2024-09-21T07:15:53.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc9c1f740 1 Processor -- start 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc9c1f740 1 -- start start 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbb27fc640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdba80b6730 0x7fdba80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed5230070 0x558ed55d76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed52071b0 0x558ed55d7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed520f390 0x558ed55d8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ed554dea0 con 0x558ed520f390 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558ed553d2d0 con 0x558ed52071b0 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558ed55410e0 con 0x558ed5230070 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc0c46640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdba80b6730 0x7fdba80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbb27fc640 1 -- 172.21.15.92:0/946669367 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdbb40e7b30 con 0x7fdbbc108cf0 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc1c48640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed520f390 0x558ed55d8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc1c48640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed520f390 0x558ed55d8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51376/0 (socket says 172.21.15.92:51376) 2024-09-21T07:15:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc1c48640 1 -- 172.21.15.92:0/1354784414 learned_addr learned my addr 172.21.15.92:0/1354784414 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc0c46640 1 --2- 172.21.15.92:0/1354784414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed52071b0 0x558ed55d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.255+0000 7fdbc1447640 1 --2- 172.21.15.92:0/1354784414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed5230070 0x558ed55d76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.256+0000 7fdbc1c48640 1 -- 172.21.15.92:0/1354784414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed5230070 msgr2=0x558ed55d76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.256+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/1354784414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed5230070 0x558ed55d76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.256+0000 7fdbc1c48640 1 -- 172.21.15.92:0/1354784414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed52071b0 msgr2=0x558ed55d7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.256+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/1354784414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed52071b0 0x558ed55d7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.256+0000 7fdbc1c48640 1 -- 172.21.15.92:0/1354784414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed529b650 con 0x558ed520f390 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.256+0000 7fdbc0c46640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdba80b6730 0x7fdba80b8c40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdbac006010 tx=0x7fdbac032f50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.256+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/1354784414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed520f390 0x558ed55d8120 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40a9bb0 tx=0x7fdbb40a9d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b64025df82123b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.256+0000 7fdba77fe640 1 -- 172.21.15.92:0/1354784414 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb401f070 con 0x558ed520f390 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.256+0000 7fdba77fe640 1 -- 172.21.15.92:0/1354784414 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbb40ad0f0 con 0x558ed520f390 2024-09-21T07:15:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.256+0000 7fdba77fe640 1 -- 172.21.15.92:0/1354784414 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40b20c0 con 0x558ed520f390 2024-09-21T07:15:53.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.257+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/1354784414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed520f390 msgr2=0x558ed55d8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.257+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/1354784414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed520f390 0x558ed55d8120 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40a9bb0 tx=0x7fdbb40a9d60 comp rx=0 tx=0).stop 2024-09-21T07:15:53.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.257+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/1354784414 shutdown_connections 2024-09-21T07:15:53.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.257+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/1354784414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed520f390 0x558ed55d8120 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.257+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/1354784414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed52071b0 0x558ed55d7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.257+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/1354784414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed5230070 0x558ed55d76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.257+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/1354784414 >> 172.21.15.92:0/1354784414 conn(0x558ed5224460 msgr2=0x558ed55d5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.257+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/1354784414 shutdown_connections 2024-09-21T07:15:53.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.257+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/1354784414 wait complete. 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.257+0000 7fdbc9c1f740 1 -- start start 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc9c1f740 1 Processor -- start 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 0x558ed55e3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed5230070 0x558ed55ef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ed539e700 con 0x558ed52071b0 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558ed54d8160 con 0x558ed520f390 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558ed55e5e80 con 0x558ed5230070 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc1447640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc1447640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55e2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51390/0 (socket says 172.21.15.92:51390) 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc1447640 1 -- 172.21.15.92:0/668295739 learned_addr learned my addr 172.21.15.92:0/668295739 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc9c1f740 10 client.0 _ll_register_callbacks cb 0x558ed54f19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc0c46640 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 0x558ed55e3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc1447640 1 -- 172.21.15.92:0/668295739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed5230070 msgr2=0x558ed55ef170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc1447640 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed5230070 0x558ed55ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc1447640 1 -- 172.21.15.92:0/668295739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 msgr2=0x558ed55e3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc1447640 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 0x558ed55e3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.258+0000 7fdbc1447640 1 -- 172.21.15.92:0/668295739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed5505c90 con 0x558ed52071b0 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdbc1447640 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55e2d00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800ac50 tx=0x7fdbb800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ffe9c6fc9b2129 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdba4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdba4ff9640 1 -- 172.21.15.92:0/668295739 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800de60 con 0x558ed52071b0 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdba4ff9640 1 -- 172.21.15.92:0/668295739 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdbb80140d0 con 0x558ed52071b0 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/668295739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb40ad0f0 con 0x558ed52071b0 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdba4ff9640 1 -- 172.21.15.92:0/668295739 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdbb80142d0 con 0x558ed52071b0 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdbc9c1f740 10 client.16515 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/668295739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558ed55f1b70 con 0x558ed52071b0 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdba4ff9640 1 -- 172.21.15.92:0/668295739 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbb40ad0f0 con 0x558ed52071b0 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdba4ff9640 1 -- 172.21.15.92:0/668295739 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdbb801e4b0 con 0x558ed52071b0 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdbc9c1f740 10 client.16515 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdbc9c1f740 10 client.16515 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:15:53.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdbc9c1f740 20 client.16515 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:53.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.259+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558ed51ee9f0 0x558ed55f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.260+0000 7fdbc9c1f740 4 client.16515 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:53.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.260+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/668295739 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ed554fdf0 con 0x558ed51ee9f0 2024-09-21T07:15:53.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.260+0000 7fdbc0c46640 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558ed51ee9f0 0x558ed55f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.260+0000 7fdbc0c46640 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558ed51ee9f0 0x558ed55f51b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7beceaa00e8d799c server_cookie=665e7ede723e3911 in_seq=0 out_seq=0 2024-09-21T07:15:53.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.260+0000 7fdba4ff9640 10 client.16515 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:15:53.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdba4ff9640 1 -- 172.21.15.92:0/668295739 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ed554fdf0 con 0x558ed51ee9f0 2024-09-21T07:15:53.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdba4ff9640 10 client.16515 handle_command_reply: tid=0 2024-09-21T07:15:53.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdbc9c1f740 1 client.16515 shutdown 2024-09-21T07:15:53.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/668295739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 msgr2=0x558ed55e2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55e2d00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800ac50 tx=0x7fdbb800d710 comp rx=0 tx=0).stop 2024-09-21T07:15:53.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/668295739 shutdown_connections 2024-09-21T07:15:53.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed5230070 0x558ed55ef170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 0x558ed55e3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558ed51ee9f0 0x558ed55f51b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/668295739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55e2d00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdba4ff9640 0 client.16515 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:15:53.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/668295739 >> 172.21.15.92:0/668295739 conn(0x558ed5224460 msgr2=0x558ed55da830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.261+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/668295739 shutdown_connections 2024-09-21T07:15:53.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.262+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/668295739 wait complete. 2024-09-21T07:15:53.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.262+0000 7fdbc9c1f740 20 client.16515 trim_cache size 0 max 16384 2024-09-21T07:15:53.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc9c1f740 1 Processor -- start 2024-09-21T07:15:53.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc9c1f740 1 -- start start 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed520f390 0x558ed55e4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed5230070 0x558ed55d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1aec90 con 0x558ed52071b0 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1b07d0 con 0x558ed5230070 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1af360 con 0x558ed520f390 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc1447640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc1447640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55d9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51402/0 (socket says 172.21.15.92:51402) 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc1447640 1 -- 172.21.15.92:0/3554151795 learned_addr learned my addr 172.21.15.92:0/3554151795 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc0c46640 1 --2- 172.21.15.92:0/3554151795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed520f390 0x558ed55e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc1447640 1 -- 172.21.15.92:0/3554151795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed520f390 msgr2=0x558ed55e4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc1447640 1 --2- 172.21.15.92:0/3554151795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed520f390 0x558ed55e4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc1447640 1 -- 172.21.15.92:0/3554151795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed5230070 msgr2=0x558ed55d4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/3554151795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed5230070 0x558ed55d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc1447640 1 --2- 172.21.15.92:0/3554151795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed5230070 0x558ed55d4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc1447640 1 -- 172.21.15.92:0/3554151795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed55e1200 con 0x558ed52071b0 2024-09-21T07:15:53.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.275+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/3554151795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed5230070 0x558ed55d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:53.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.276+0000 7fdbc1447640 1 --2- 172.21.15.92:0/3554151795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55d9090 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8001eb0 tx=0x7fdbb800dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7315b84061920270 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.276+0000 7fdba6ffd640 1 -- 172.21.15.92:0/3554151795 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb801eb60 con 0x558ed52071b0 2024-09-21T07:15:53.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.276+0000 7fdba6ffd640 1 -- 172.21.15.92:0/3554151795 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbb801ed00 con 0x558ed52071b0 2024-09-21T07:15:53.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.276+0000 7fdba6ffd640 1 -- 172.21.15.92:0/3554151795 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb801e680 con 0x558ed52071b0 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.277+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3554151795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 msgr2=0x558ed55d9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.277+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/3554151795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55d9090 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8001eb0 tx=0x7fdbb800dcd0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.277+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3554151795 shutdown_connections 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.277+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/3554151795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed5230070 0x558ed55d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.277+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/3554151795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed520f390 0x558ed55e4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.277+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/3554151795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed52071b0 0x558ed55d9090 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.277+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3554151795 >> 172.21.15.92:0/3554151795 conn(0x558ed5224460 msgr2=0x558ed55e4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.277+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3554151795 shutdown_connections 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.277+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3554151795 wait complete. 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.277+0000 7fdbc9c1f740 1 -- start start 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc9c1f740 1 Processor -- start 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed52071b0 0x558ed55eba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 0x558ed55e6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc9c1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed5230070 0x558ed55e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1b0100 con 0x558ed5230070 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1afa30 con 0x558ed520f390 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc9c1f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1acc70 con 0x558ed52071b0 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc9c1f740 10 client.0 _ll_register_callbacks cb 0x7fdbb8014840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc1c48640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed5230070 0x558ed55e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc1c48640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed5230070 0x558ed55e75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51408/0 (socket says 172.21.15.92:51408) 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc1c48640 1 -- 172.21.15.92:0/3365859958 learned_addr learned my addr 172.21.15.92:0/3365859958 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.278+0000 7fdbc1447640 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed52071b0 0x558ed55eba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc0c46640 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 0x558ed55e6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc1c48640 1 -- 172.21.15.92:0/3365859958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed52071b0 msgr2=0x558ed55eba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed52071b0 0x558ed55eba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc1c48640 1 -- 172.21.15.92:0/3365859958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 msgr2=0x558ed55e6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 0x558ed55e6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc1c48640 1 -- 172.21.15.92:0/3365859958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed565ebb0 con 0x558ed5230070 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc0c46640 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 0x558ed55e6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc1c48640 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed5230070 0x558ed55e75e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4004ff0 tx=0x7fdbb40a9ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f73a9ac677bf35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdba4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdba4ff9640 1 -- 172.21.15.92:0/3365859958 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb401f030 con 0x558ed5230070 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdba4ff9640 1 -- 172.21.15.92:0/3365859958 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fdbb400caf0 con 0x558ed5230070 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3365859958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb801ed00 con 0x558ed5230070 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdba4ff9640 1 -- 172.21.15.92:0/3365859958 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdbb40adce0 con 0x558ed5230070 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc9c1f740 10 client.16521 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.279+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3365859958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558ed565fbf0 con 0x558ed5230070 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.280+0000 7fdba4ff9640 1 -- 172.21.15.92:0/3365859958 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbb801ed00 con 0x558ed5230070 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.280+0000 7fdba4ff9640 1 -- 172.21.15.92:0/3365859958 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdbb40a7ce0 con 0x558ed5230070 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.280+0000 7fdbc9c1f740 10 client.16521 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.280+0000 7fdbc9c1f740 10 client.16521 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:15:53.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.280+0000 7fdbc9c1f740 20 client.16521 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.280+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558ed51c3da0 0x558ed5661f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.280+0000 7fdbc9c1f740 4 client.16521 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:15:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.280+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3365859958 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558ed554b8a0 con 0x558ed51c3da0 2024-09-21T07:15:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.280+0000 7fdbc1447640 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558ed51c3da0 0x558ed5661f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdba4ff9640 10 client.16521 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:15:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdbc1447640 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558ed51c3da0 0x558ed5661f60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=26a5ec5f13eb9b67 server_cookie=4c4a3b9709f4d380 in_seq=0 out_seq=0 2024-09-21T07:15:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdba4ff9640 1 -- 172.21.15.92:0/3365859958 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558ed554b8a0 con 0x558ed51c3da0 2024-09-21T07:15:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdba4ff9640 10 client.16521 handle_command_reply: tid=0 2024-09-21T07:15:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdbc9c1f740 1 client.16521 shutdown 2024-09-21T07:15:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3365859958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed5230070 msgr2=0x558ed55e75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed5230070 0x558ed55e75e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4004ff0 tx=0x7fdbb40a9ab0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3365859958 shutdown_connections 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558ed51c3da0 0x558ed5661f60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ed5230070 0x558ed55e75e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ed520f390 0x558ed55e6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdba4ff9640 0 client.16521 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdbc9c1f740 1 --2- 172.21.15.92:0/3365859958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed52071b0 0x558ed55eba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.281+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3365859958 >> 172.21.15.92:0/3365859958 conn(0x558ed5224460 msgr2=0x558ed55d8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3365859958 shutdown_connections 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc9c1f740 1 -- 172.21.15.92:0/3365859958 wait complete. 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc9c1f740 20 client.16521 trim_cache size 0 max 16384 2024-09-21T07:15:53.287 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:15:53.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc36ab640 1 -- 172.21.15.92:0/946669367 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdba80b6730 msgr2=0x7fdba80b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc36ab640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdba80b6730 0x7fdba80b8c40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdbac006010 tx=0x7fdbac032f50 comp rx=0 tx=0).stop 2024-09-21T07:15:53.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc36ab640 1 -- 172.21.15.92:0/946669367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc108cf0 msgr2=0x7fdbbc19bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:53.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc36ab640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc108cf0 0x7fdbbc19bca0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400eaa0 tx=0x7fdbb400eea0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc36ab640 1 -- 172.21.15.92:0/946669367 shutdown_connections 2024-09-21T07:15:53.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc36ab640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fdba80b6730 0x7fdba80b8c40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc36ab640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc108cf0 0x7fdbbc19bca0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc36ab640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1083a0 0x7fdbbc19b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc36ab640 1 --2- 172.21.15.92:0/946669367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbbc102a60 0x7fdbbc19b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:53.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.282+0000 7fdbc36ab640 1 -- 172.21.15.92:0/946669367 >> 172.21.15.92:0/946669367 conn(0x7fdbbc079730 msgr2=0x7fdbbc104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:53.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.283+0000 7fdbc36ab640 1 -- 172.21.15.92:0/946669367 shutdown_connections 2024-09-21T07:15:53.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:53.283+0000 7fdbc36ab640 1 -- 172.21.15.92:0/946669367 wait complete. 2024-09-21T07:15:53.972 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:15:54.222 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:54.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.682+0000 7f9a7d198640 1 -- 172.21.15.92:0/617044650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a78103bc0 msgr2=0x7f9a78103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:54.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.682+0000 7f9a7d198640 1 --2- 172.21.15.92:0/617044650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a78103bc0 0x7f9a78103fd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9a68009900 tx=0x7f9a6802a410 comp rx=0 tx=0).stop 2024-09-21T07:15:54.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.682+0000 7f9a7d198640 1 -- 172.21.15.92:0/617044650 shutdown_connections 2024-09-21T07:15:54.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.682+0000 7f9a7d198640 1 --2- 172.21.15.92:0/617044650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a78109e00 0x7f9a78110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.682+0000 7f9a7d198640 1 --2- 172.21.15.92:0/617044650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a781094b0 0x7f9a781098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.682+0000 7f9a7d198640 1 --2- 172.21.15.92:0/617044650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a78103bc0 0x7f9a78103fd0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.682+0000 7f9a7d198640 1 -- 172.21.15.92:0/617044650 >> 172.21.15.92:0/617044650 conn(0x7f9a7807b910 msgr2=0x7f9a7807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.682+0000 7f9a7d198640 1 -- 172.21.15.92:0/617044650 shutdown_connections 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.682+0000 7f9a7d198640 1 -- 172.21.15.92:0/617044650 wait complete. 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.683+0000 7f9a7d198640 1 Processor -- start 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.683+0000 7f9a7d198640 1 -- start start 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.683+0000 7f9a7d198640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a78103bc0 0x7f9a7819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.683+0000 7f9a7d198640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a781094b0 0x7f9a7819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.683+0000 7f9a7d198640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a78109e00 0x7f9a7819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.683+0000 7f9a7d198640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78113970 con 0x7f9a78109e00 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.683+0000 7f9a7d198640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a781137f0 con 0x7f9a781094b0 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.683+0000 7f9a7d198640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78113af0 con 0x7f9a78103bc0 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a78109e00 0x7f9a7819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a78109e00 0x7f9a7819fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51420/0 (socket says 172.21.15.92:51420) 2024-09-21T07:15:54.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7759e640 1 -- 172.21.15.92:0/2181667919 learned_addr learned my addr 172.21.15.92:0/2181667919 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a76d9d640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a78103bc0 0x7f9a7819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7659c640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a781094b0 0x7f9a7819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7759e640 1 -- 172.21.15.92:0/2181667919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a78103bc0 msgr2=0x7f9a7819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7759e640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a78103bc0 0x7f9a7819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7759e640 1 -- 172.21.15.92:0/2181667919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a781094b0 msgr2=0x7f9a7819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7759e640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a781094b0 0x7f9a7819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7759e640 1 -- 172.21.15.92:0/2181667919 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a781a0350 con 0x7f9a78109e00 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7759e640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a78109e00 0x7f9a7819fc20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000eb10 tx=0x7f9a7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a5ffff640 1 -- 172.21.15.92:0/2181667919 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70004b20 con 0x7f9a78109e00 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7d198640 1 -- 172.21.15.92:0/2181667919 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a781a0640 con 0x7f9a78109e00 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a5ffff640 1 -- 172.21.15.92:0/2181667919 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a70004cc0 con 0x7f9a78109e00 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a5ffff640 1 -- 172.21.15.92:0/2181667919 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70010690 con 0x7f9a78109e00 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.684+0000 7f9a7d198640 1 -- 172.21.15.92:0/2181667919 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a781a6da0 con 0x7f9a78109e00 2024-09-21T07:15:54.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.687+0000 7f9a5ffff640 1 -- 172.21.15.92:0/2181667919 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f9a70010830 con 0x7f9a78109e00 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.687+0000 7f9a8370c740 1 Processor -- start 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.687+0000 7f9a8370c740 1 -- start start 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.687+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689426a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.687+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0685721b0 0x55a068942be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.687+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06857a390 0x55a068943120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.687+0000 7f9a8370c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0688b8ea0 con 0x55a06859b070 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.687+0000 7f9a8370c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a0688a82d0 con 0x55a0685721b0 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.687+0000 7f9a8370c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a0688ac0e0 con 0x55a06857a390 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689426a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51426/0 (socket says 172.21.15.92:51426) 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7659c640 1 -- 172.21.15.92:0/1776660217 learned_addr learned my addr 172.21.15.92:0/1776660217 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a76d9d640 1 --2- 172.21.15.92:0/1776660217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0685721b0 0x55a068942be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7659c640 1 --2- 172.21.15.92:0/1776660217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06857a390 0x55a068943120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a5ffff640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a600b6680 0x7f9a600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7659c640 1 -- 172.21.15.92:0/1776660217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06857a390 msgr2=0x55a068943120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7659c640 1 --2- 172.21.15.92:0/1776660217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06857a390 0x55a068943120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7659c640 1 -- 172.21.15.92:0/1776660217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0685721b0 msgr2=0x55a068942be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7659c640 1 --2- 172.21.15.92:0/1776660217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0685721b0 0x55a068942be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7659c640 1 -- 172.21.15.92:0/1776660217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a068606650 con 0x55a06859b070 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7759e640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a600b6680 0x7f9a600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a7659c640 1 --2- 172.21.15.92:0/1776660217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689426a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c013530 tx=0x7f9a6c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6712b5cc5e71a2f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a5ffff640 1 -- 172.21.15.92:0/2181667919 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9a700e80e0 con 0x7f9a78109e00 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a5d7fa640 1 -- 172.21.15.92:0/1776660217 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c004050 con 0x55a06859b070 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a5d7fa640 1 -- 172.21.15.92:0/1776660217 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a6c0035f0 con 0x55a06859b070 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.688+0000 7f9a5d7fa640 1 -- 172.21.15.92:0/1776660217 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c00f760 con 0x55a06859b070 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.689+0000 7f9a8370c740 1 -- 172.21.15.92:0/1776660217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 msgr2=0x55a0689426a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.689+0000 7f9a8370c740 1 --2- 172.21.15.92:0/1776660217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689426a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c013530 tx=0x7f9a6c005850 comp rx=0 tx=0).stop 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.689+0000 7f9a7759e640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a600b6680 0x7f9a600b8b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a700aa100 tx=0x7f9a7007bcb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:54.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.689+0000 7f9a8370c740 1 -- 172.21.15.92:0/1776660217 shutdown_connections 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.689+0000 7f9a8370c740 1 --2- 172.21.15.92:0/1776660217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06857a390 0x55a068943120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.689+0000 7f9a8370c740 1 --2- 172.21.15.92:0/1776660217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0685721b0 0x55a068942be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.689+0000 7f9a8370c740 1 --2- 172.21.15.92:0/1776660217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689426a0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.689+0000 7f9a8370c740 1 -- 172.21.15.92:0/1776660217 >> 172.21.15.92:0/1776660217 conn(0x55a06858f460 msgr2=0x55a068940590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.689+0000 7f9a8370c740 1 -- 172.21.15.92:0/1776660217 shutdown_connections 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.689+0000 7f9a8370c740 1 -- 172.21.15.92:0/1776660217 wait complete. 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a8370c740 1 -- start start 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a8370c740 1 Processor -- start 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0685721b0 0x55a06894ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06857a390 0x55a06894e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06859b070 0x55a06895a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a8370c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a068709700 con 0x55a06857a390 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a8370c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a068843160 con 0x55a0685721b0 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a8370c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a068950e80 con 0x55a06859b070 2024-09-21T07:15:54.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a8370c740 10 client.0 _ll_register_callbacks cb 0x55a06885c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a76d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06857a390 0x55a06894e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a76d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06857a390 0x55a06894e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51442/0 (socket says 172.21.15.92:51442) 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a76d9d640 1 -- 172.21.15.92:0/2975819858 learned_addr learned my addr 172.21.15.92:0/2975819858 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.690+0000 7f9a7659c640 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0685721b0 0x55a06894ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a7659c640 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06859b070 0x55a06895a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a76d9d640 1 -- 172.21.15.92:0/2975819858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06859b070 msgr2=0x55a06895a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a76d9d640 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06859b070 0x55a06895a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a76d9d640 1 -- 172.21.15.92:0/2975819858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0685721b0 msgr2=0x55a06894ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a76d9d640 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0685721b0 0x55a06894ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a76d9d640 1 -- 172.21.15.92:0/2975819858 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a068870c90 con 0x55a06857a390 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a76d9d640 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06857a390 0x55a06894e300 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9a6802a930 tx=0x7f9a68031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180d3ee6bb04be19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a5aff5640 1 -- 172.21.15.92:0/2975819858 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68035070 con 0x55a06857a390 2024-09-21T07:15:54.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a5aff5640 1 -- 172.21.15.92:0/2975819858 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9a68031810 con 0x55a06857a390 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a8370c740 1 -- 172.21.15.92:0/2975819858 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a6c0035f0 con 0x55a06857a390 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a5aff5640 1 -- 172.21.15.92:0/2975819858 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9a6804d050 con 0x55a06857a390 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a8370c740 10 client.16533 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a8370c740 1 -- 172.21.15.92:0/2975819858 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a06895cb90 con 0x55a06857a390 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.691+0000 7f9a5aff5640 1 -- 172.21.15.92:0/2975819858 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a6c0035f0 con 0x55a06857a390 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.692+0000 7f9a5aff5640 1 -- 172.21.15.92:0/2975819858 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9a68003c50 con 0x55a06857a390 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.692+0000 7f9a8370c740 10 client.16533 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.692+0000 7f9a8370c740 10 client.16533 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.692+0000 7f9a8370c740 20 client.16533 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.692+0000 7f9a8370c740 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55a0685599f0 0x55a068960130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.692+0000 7f9a8370c740 4 client.16533 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.692+0000 7f9a8370c740 1 -- 172.21.15.92:0/2975819858 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0688badf0 con 0x55a0685599f0 2024-09-21T07:15:54.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.692+0000 7f9a7659c640 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55a0685599f0 0x55a068960130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.692+0000 7f9a7659c640 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55a0685599f0 0x55a068960130 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33a6270df4042c53 server_cookie=cad5a51bf5426ea4 in_seq=0 out_seq=0 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.692+0000 7f9a5aff5640 10 client.16533 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a5aff5640 1 -- 172.21.15.92:0/2975819858 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0688badf0 con 0x55a0685599f0 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a5aff5640 10 client.16533 handle_command_reply: tid=0 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 client.16533 shutdown 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 -- 172.21.15.92:0/2975819858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06857a390 msgr2=0x55a06894e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06857a390 0x55a06894e300 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9a6802a930 tx=0x7f9a68031ca0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 -- 172.21.15.92:0/2975819858 shutdown_connections 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55a0685599f0 0x55a068960130 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06859b070 0x55a06895a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06857a390 0x55a06894e300 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 --2- 172.21.15.92:0/2975819858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0685721b0 0x55a06894ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 -- 172.21.15.92:0/2975819858 >> 172.21.15.92:0/2975819858 conn(0x55a06858f460 msgr2=0x55a068945880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a5aff5640 0 client.16533 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:15:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 -- 172.21.15.92:0/2975819858 shutdown_connections 2024-09-21T07:15:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.693+0000 7f9a8370c740 1 -- 172.21.15.92:0/2975819858 wait complete. 2024-09-21T07:15:54.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.694+0000 7f9a8370c740 20 client.16533 trim_cache size 0 max 16384 2024-09-21T07:15:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.706+0000 7f9a8370c740 1 Processor -- start 2024-09-21T07:15:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.706+0000 7f9a8370c740 1 -- start start 2024-09-21T07:15:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.706+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0685721b0 0x55a068943de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.706+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06857a390 0x55a06894afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.706+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a06859b070 0x55a06894b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.706+0000 7f9a8370c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a781b0e70 con 0x55a0685721b0 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a8370c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a781b29b0 con 0x55a06859b070 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a8370c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a781b1540 con 0x55a06857a390 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0685721b0 0x55a068943de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0685721b0 0x55a068943de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51450/0 (socket says 172.21.15.92:51450) 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a7659c640 1 -- 172.21.15.92:0/2334867454 learned_addr learned my addr 172.21.15.92:0/2334867454 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a76d9d640 1 --2- 172.21.15.92:0/2334867454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06857a390 0x55a06894afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a7659c640 1 --2- 172.21.15.92:0/2334867454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a06859b070 0x55a06894b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a7659c640 1 -- 172.21.15.92:0/2334867454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06857a390 msgr2=0x55a06894afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a7659c640 1 --2- 172.21.15.92:0/2334867454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06857a390 0x55a06894afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a7659c640 1 -- 172.21.15.92:0/2334867454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a06859b070 msgr2=0x55a06894b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a7659c640 1 --2- 172.21.15.92:0/2334867454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a06859b070 0x55a06894b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a7659c640 1 -- 172.21.15.92:0/2334867454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a068944990 con 0x55a0685721b0 2024-09-21T07:15:54.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a7659c640 1 --2- 172.21.15.92:0/2334867454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0685721b0 0x55a068943de0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c013e80 tx=0x7f9a6c009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ba6651783f03ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a5cff9640 1 -- 172.21.15.92:0/2334867454 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c005070 con 0x55a0685721b0 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a5cff9640 1 -- 172.21.15.92:0/2334867454 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a6c0035f0 con 0x55a0685721b0 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.707+0000 7f9a5cff9640 1 -- 172.21.15.92:0/2334867454 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c00f500 con 0x55a0685721b0 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.708+0000 7f9a8370c740 1 -- 172.21.15.92:0/2334867454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0685721b0 msgr2=0x55a068943de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.708+0000 7f9a8370c740 1 --2- 172.21.15.92:0/2334867454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0685721b0 0x55a068943de0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c013e80 tx=0x7f9a6c009f20 comp rx=0 tx=0).stop 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.708+0000 7f9a8370c740 1 -- 172.21.15.92:0/2334867454 shutdown_connections 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.708+0000 7f9a8370c740 1 --2- 172.21.15.92:0/2334867454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a06859b070 0x55a06894b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.708+0000 7f9a8370c740 1 --2- 172.21.15.92:0/2334867454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a06857a390 0x55a06894afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.708+0000 7f9a8370c740 1 --2- 172.21.15.92:0/2334867454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0685721b0 0x55a068943de0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.708+0000 7f9a8370c740 1 -- 172.21.15.92:0/2334867454 >> 172.21.15.92:0/2334867454 conn(0x55a06858f460 msgr2=0x55a0689436d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.708+0000 7f9a8370c740 1 -- 172.21.15.92:0/2334867454 shutdown_connections 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.708+0000 7f9a8370c740 1 -- 172.21.15.92:0/2334867454 wait complete. 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a8370c740 1 -- start start 2024-09-21T07:15:54.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a8370c740 1 Processor -- start 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0685721b0 0x55a068953940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a06857a390 0x55a068953f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a8370c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a8370c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a781b22e0 con 0x55a06859b070 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a8370c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a781b1c10 con 0x55a06857a390 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a8370c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a781aee50 con 0x55a0685721b0 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a8370c740 10 client.0 _ll_register_callbacks cb 0x7f9a700093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51454/0 (socket says 172.21.15.92:51454) 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a7659c640 1 -- 172.21.15.92:0/4283288590 learned_addr learned my addr 172.21.15.92:0/4283288590 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a76d9d640 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a06857a390 0x55a068953f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a7659c640 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0685721b0 0x55a068953940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.709+0000 7f9a7659c640 1 -- 172.21.15.92:0/4283288590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0685721b0 msgr2=0x55a068953940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a7659c640 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0685721b0 0x55a068953940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a7659c640 1 -- 172.21.15.92:0/4283288590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a06857a390 msgr2=0x55a068953f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a7659c640 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a06857a390 0x55a068953f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a7659c640 1 -- 172.21.15.92:0/4283288590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0689c9160 con 0x55a06859b070 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a7659c640 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689c8af0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c005bf0 tx=0x7f9a6c005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5352326fa592fecb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a5aff5640 1 -- 172.21.15.92:0/4283288590 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c03c060 con 0x55a06859b070 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a5aff5640 1 -- 172.21.15.92:0/4283288590 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f9a6c005290 con 0x55a06859b070 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a8370c740 1 -- 172.21.15.92:0/4283288590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a6c0035f0 con 0x55a06859b070 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a5aff5640 1 -- 172.21.15.92:0/4283288590 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9a6c005490 con 0x55a06859b070 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a8370c740 10 client.16539 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a8370c740 1 -- 172.21.15.92:0/4283288590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a0689ca3e0 con 0x55a06859b070 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a5aff5640 1 -- 172.21.15.92:0/4283288590 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a6c0035f0 con 0x55a06859b070 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a5aff5640 1 -- 172.21.15.92:0/4283288590 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9a6c01d020 con 0x55a06859b070 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a8370c740 10 client.16539 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a8370c740 10 client.16539 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:15:54.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.710+0000 7f9a8370c740 20 client.16539 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:54.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a8370c740 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55a06852eda0 0x55a0689cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:54.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a8370c740 4 client.16539 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:15:54.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a8370c740 1 -- 172.21.15.92:0/4283288590 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0688b68a0 con 0x55a06852eda0 2024-09-21T07:15:54.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a76d9d640 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55a06852eda0 0x55a0689cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a76d9d640 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55a06852eda0 0x55a0689cc920 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2ec3fd064f222aa6 server_cookie=7de570284cb8ee97 in_seq=0 out_seq=0 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a5aff5640 10 client.16539 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a5aff5640 1 -- 172.21.15.92:0/4283288590 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0688b68a0 con 0x55a06852eda0 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a5aff5640 10 client.16539 handle_command_reply: tid=0 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a8370c740 1 client.16539 shutdown 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a8370c740 1 -- 172.21.15.92:0/4283288590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 msgr2=0x55a0689c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.711+0000 7f9a8370c740 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689c8af0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c005bf0 tx=0x7f9a6c005970 comp rx=0 tx=0).stop 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a8370c740 1 -- 172.21.15.92:0/4283288590 shutdown_connections 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a8370c740 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55a06852eda0 0x55a0689cc920 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a8370c740 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a06859b070 0x55a0689c8af0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a5aff5640 0 client.16539 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a8370c740 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a06857a390 0x55a068953f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a8370c740 1 --2- 172.21.15.92:0/4283288590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0685721b0 0x55a068953940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a8370c740 1 -- 172.21.15.92:0/4283288590 >> 172.21.15.92:0/4283288590 conn(0x55a06858f460 msgr2=0x55a06894f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:54.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a8370c740 1 -- 172.21.15.92:0/4283288590 shutdown_connections 2024-09-21T07:15:54.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a8370c740 1 -- 172.21.15.92:0/4283288590 wait complete. 2024-09-21T07:15:54.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a8370c740 20 client.16539 trim_cache size 0 max 16384 2024-09-21T07:15:54.719 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a7d198640 1 -- 172.21.15.92:0/2181667919 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a600b6680 msgr2=0x7f9a600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a7d198640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a600b6680 0x7f9a600b8b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a700aa100 tx=0x7f9a7007bcb0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a7d198640 1 -- 172.21.15.92:0/2181667919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a78109e00 msgr2=0x7f9a7819fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a7d198640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a78109e00 0x7f9a7819fc20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000eb10 tx=0x7f9a7000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a7d198640 1 -- 172.21.15.92:0/2181667919 shutdown_connections 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a7d198640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a600b6680 0x7f9a600b8b90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a7d198640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a78109e00 0x7f9a7819fc20 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a7d198640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a781094b0 0x7f9a7819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a7d198640 1 --2- 172.21.15.92:0/2181667919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a78103bc0 0x7f9a7819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.712+0000 7f9a7d198640 1 -- 172.21.15.92:0/2181667919 >> 172.21.15.92:0/2181667919 conn(0x7f9a7807b910 msgr2=0x7f9a781075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.713+0000 7f9a7d198640 1 -- 172.21.15.92:0/2181667919 shutdown_connections 2024-09-21T07:15:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:54.713+0000 7f9a7d198640 1 -- 172.21.15.92:0/2181667919 wait complete. 2024-09-21T07:15:54.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:54 smithi092 ceph-mon[30987]: pgmap v424: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 50 MiB/s wr, 27 op/s 2024-09-21T07:15:55.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:54 smithi175 ceph-mon[34064]: pgmap v424: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 50 MiB/s wr, 27 op/s 2024-09-21T07:15:55.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:54 smithi169 ceph-mon[33705]: pgmap v424: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 50 MiB/s wr, 27 op/s 2024-09-21T07:15:55.474 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:15:55.725 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:56.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.199+0000 7f80be019640 1 -- 172.21.15.92:0/1543302108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80b8103140 msgr2=0x7f80b8103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:56.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.199+0000 7f80be019640 1 --2- 172.21.15.92:0/1543302108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80b8103140 0x7f80b8103550 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009900 tx=0x7f80a802a410 comp rx=0 tx=0).stop 2024-09-21T07:15:56.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.199+0000 7f80be019640 1 -- 172.21.15.92:0/1543302108 shutdown_connections 2024-09-21T07:15:56.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.199+0000 7f80be019640 1 --2- 172.21.15.92:0/1543302108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b8108d00 0x7f80b810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.199+0000 7f80be019640 1 --2- 172.21.15.92:0/1543302108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b81083b0 0x7f80b81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.199+0000 7f80be019640 1 --2- 172.21.15.92:0/1543302108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80b8103140 0x7f80b8103550 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.199+0000 7f80be019640 1 -- 172.21.15.92:0/1543302108 >> 172.21.15.92:0/1543302108 conn(0x7f80b8077c60 msgr2=0x7f80b80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.199+0000 7f80be019640 1 -- 172.21.15.92:0/1543302108 shutdown_connections 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.199+0000 7f80be019640 1 -- 172.21.15.92:0/1543302108 wait complete. 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.199+0000 7f80be019640 1 Processor -- start 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80be019640 1 -- start start 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80be019640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b8103140 0x7f80b81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80be019640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b81083b0 0x7f80b8199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80be019640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80b8108d00 0x7f80b819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80be019640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8112870 con 0x7f80b8108d00 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80be019640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80b81126f0 con 0x7f80b81083b0 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80be019640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80b81129f0 con 0x7f80b8103140 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80b7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80b8108d00 0x7f80b819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80b7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80b8108d00 0x7f80b819eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51470/0 (socket says 172.21.15.92:51470) 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80b7fff640 1 -- 172.21.15.92:0/805164216 learned_addr learned my addr 172.21.15.92:0/805164216 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80b77fe640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b8103140 0x7f80b81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80affff640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b81083b0 0x7f80b8199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80b7fff640 1 -- 172.21.15.92:0/805164216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b8103140 msgr2=0x7f80b81992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80b7fff640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b8103140 0x7f80b81992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80b7fff640 1 -- 172.21.15.92:0/805164216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b81083b0 msgr2=0x7f80b8199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80b7fff640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b81083b0 0x7f80b8199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80b7fff640 1 -- 172.21.15.92:0/805164216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b819f250 con 0x7f80b8108d00 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80affff640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b81083b0 0x7f80b8199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.200+0000 7f80b7fff640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80b8108d00 0x7f80b819eb20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009fd0 tx=0x7f80b000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.201+0000 7f80b57fa640 1 -- 172.21.15.92:0/805164216 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0017070 con 0x7f80b8108d00 2024-09-21T07:15:56.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.201+0000 7f80b57fa640 1 -- 172.21.15.92:0/805164216 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b0003e00 con 0x7f80b8108d00 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.201+0000 7f80b57fa640 1 -- 172.21.15.92:0/805164216 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0010460 con 0x7f80b8108d00 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.201+0000 7f80be019640 1 -- 172.21.15.92:0/805164216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b819f540 con 0x7f80b8108d00 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.201+0000 7f80be019640 1 -- 172.21.15.92:0/805164216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b81a5ca0 con 0x7f80b8108d00 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.203+0000 7f80c458d740 1 Processor -- start 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.203+0000 7f80b57fa640 1 -- 172.21.15.92:0/805164216 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f80b0003970 con 0x7f80b8108d00 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.203+0000 7f80c458d740 1 -- start start 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80c458d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80c458d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80c458d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2de4390 0x55f5f31ad120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80c458d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f5f3122ea0 con 0x55f5f2ddc1b0 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80c458d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f5f31122d0 con 0x55f5f2e05070 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80c458d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f5f31160e0 con 0x55f5f2de4390 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31acbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51472/0 (socket says 172.21.15.92:51472) 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b77fe640 1 -- 172.21.15.92:0/388911582 learned_addr learned my addr 172.21.15.92:0/388911582 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80affff640 1 --2- 172.21.15.92:0/388911582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2de4390 0x55f5f31ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b57fa640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80a40b6680 0x7f80a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80affff640 1 --2- 172.21.15.92:0/388911582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b77fe640 1 -- 172.21.15.92:0/388911582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2de4390 msgr2=0x55f5f31ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b77fe640 1 --2- 172.21.15.92:0/388911582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2de4390 0x55f5f31ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b77fe640 1 -- 172.21.15.92:0/388911582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 msgr2=0x55f5f31ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b77fe640 1 --2- 172.21.15.92:0/388911582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b77fe640 1 -- 172.21.15.92:0/388911582 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f2e70650 con 0x55f5f2ddc1b0 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80affff640 1 --2- 172.21.15.92:0/388911582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2de4390 0x55f5f31ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b7fff640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80a40b6680 0x7f80a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b77fe640 1 --2- 172.21.15.92:0/388911582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31acbe0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009900 tx=0x7f80a8032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc5570002918abb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.204+0000 7f80b57fa640 1 -- 172.21.15.92:0/805164216 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f80b00e7cf0 con 0x7f80b8108d00 2024-09-21T07:15:56.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.205+0000 7f80adffb640 1 -- 172.21.15.92:0/388911582 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a803f070 con 0x55f5f2ddc1b0 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.205+0000 7f80adffb640 1 -- 172.21.15.92:0/388911582 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80a8004030 con 0x55f5f2ddc1b0 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.205+0000 7f80adffb640 1 -- 172.21.15.92:0/388911582 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8035070 con 0x55f5f2ddc1b0 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.205+0000 7f80b7fff640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80a40b6680 0x7f80a40b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f80b00e56a0 tx=0x7f80b007aa80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 -- 172.21.15.92:0/388911582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2ddc1b0 msgr2=0x55f5f31acbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 --2- 172.21.15.92:0/388911582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31acbe0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009900 tx=0x7f80a8032ba0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 -- 172.21.15.92:0/388911582 shutdown_connections 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 --2- 172.21.15.92:0/388911582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2de4390 0x55f5f31ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 --2- 172.21.15.92:0/388911582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31acbe0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 --2- 172.21.15.92:0/388911582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 -- 172.21.15.92:0/388911582 >> 172.21.15.92:0/388911582 conn(0x55f5f2df9460 msgr2=0x55f5f31aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 -- 172.21.15.92:0/388911582 shutdown_connections 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 -- 172.21.15.92:0/388911582 wait complete. 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 -- start start 2024-09-21T07:15:56.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.206+0000 7f80c458d740 1 Processor -- start 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80c458d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80c458d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80c458d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31ba9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80c458d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f5f2f73700 con 0x55f5f2de4390 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80c458d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f5f30ad160 con 0x55f5f2e05070 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80c458d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f5f31bcf80 con 0x55f5f2ddc1b0 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80c458d740 10 client.0 _ll_register_callbacks cb 0x55f5f30c69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80b77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80b77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51474/0 (socket says 172.21.15.92:51474) 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80b77fe640 1 -- 172.21.15.92:0/1488543557 learned_addr learned my addr 172.21.15.92:0/1488543557 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80affff640 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31ba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80affff640 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80b77fe640 1 -- 172.21.15.92:0/1488543557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 msgr2=0x55f5f31b9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80b77fe640 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31b9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80b77fe640 1 -- 172.21.15.92:0/1488543557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 msgr2=0x55f5f31ba9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80b77fe640 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31ba9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80b77fe640 1 -- 172.21.15.92:0/1488543557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f30dac90 con 0x55f5f2de4390 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80affff640 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f80b77fe640 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba440 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f80a802a930 tx=0x7f80a8005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1467c2b37ea078f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.207+0000 7f8096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f8096ffd640 1 -- 172.21.15.92:0/1488543557 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8035070 con 0x55f5f2de4390 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f8096ffd640 1 -- 172.21.15.92:0/1488543557 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f80a8031400 con 0x55f5f2de4390 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f80c458d740 1 -- 172.21.15.92:0/1488543557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80a8004030 con 0x55f5f2de4390 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f8096ffd640 1 -- 172.21.15.92:0/1488543557 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f80a8055050 con 0x55f5f2de4390 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f80c458d740 10 client.16551 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f80c458d740 1 -- 172.21.15.92:0/1488543557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5f31c8ca0 con 0x55f5f2de4390 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f8096ffd640 1 -- 172.21.15.92:0/1488543557 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80a8004030 con 0x55f5f2de4390 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f8096ffd640 1 -- 172.21.15.92:0/1488543557 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f80a80035f0 con 0x55f5f2de4390 2024-09-21T07:15:56.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f80c458d740 10 client.16551 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f80c458d740 10 client.16551 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f80c458d740 20 client.16551 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f80c458d740 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55f5f2dc39f0 0x55f5f31cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f80c458d740 4 client.16551 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.208+0000 7f80c458d740 1 -- 172.21.15.92:0/1488543557 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5f3124df0 con 0x55f5f2dc39f0 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.209+0000 7f80affff640 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55f5f2dc39f0 0x55f5f31cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.209+0000 7f8096ffd640 10 client.16551 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.209+0000 7f80affff640 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55f5f2dc39f0 0x55f5f31cc000 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=168a09a726d7d9c server_cookie=1b53310af8252bdc in_seq=0 out_seq=0 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f8096ffd640 1 -- 172.21.15.92:0/1488543557 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f5f3124df0 con 0x55f5f2dc39f0 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f8096ffd640 10 client.16551 handle_command_reply: tid=0 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 client.16551 shutdown 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 -- 172.21.15.92:0/1488543557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 msgr2=0x55f5f31ba440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba440 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f80a802a930 tx=0x7f80a8005e90 comp rx=0 tx=0).stop 2024-09-21T07:15:56.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 -- 172.21.15.92:0/1488543557 shutdown_connections 2024-09-21T07:15:56.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55f5f2dc39f0 0x55f5f31cc000 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31ba9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba440 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f8096ffd640 0 client.16551 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:15:56.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 --2- 172.21.15.92:0/1488543557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 -- 172.21.15.92:0/1488543557 >> 172.21.15.92:0/1488543557 conn(0x55f5f2df9460 msgr2=0x55f5f31ae090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:56.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 -- 172.21.15.92:0/1488543557 shutdown_connections 2024-09-21T07:15:56.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 1 -- 172.21.15.92:0/1488543557 wait complete. 2024-09-21T07:15:56.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.210+0000 7f80c458d740 20 client.16551 trim_cache size 0 max 16384 2024-09-21T07:15:56.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80c458d740 1 Processor -- start 2024-09-21T07:15:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80c458d740 1 -- start start 2024-09-21T07:15:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80c458d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31b9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80c458d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80c458d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80c458d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80b81aebf0 con 0x55f5f2de4390 2024-09-21T07:15:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80c458d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80b81b0730 con 0x55f5f2e05070 2024-09-21T07:15:56.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80c458d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80b81af2c0 con 0x55f5f2ddc1b0 2024-09-21T07:15:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80b77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80b77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51476/0 (socket says 172.21.15.92:51476) 2024-09-21T07:15:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80b77fe640 1 -- 172.21.15.92:0/3075781963 learned_addr learned my addr 172.21.15.92:0/3075781963 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80affff640 1 --2- 172.21.15.92:0/3075781963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80affff640 1 --2- 172.21.15.92:0/3075781963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31b9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80b77fe640 1 -- 172.21.15.92:0/3075781963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 msgr2=0x55f5f31b9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80b77fe640 1 --2- 172.21.15.92:0/3075781963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31b9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80b77fe640 1 -- 172.21.15.92:0/3075781963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 msgr2=0x55f5f31a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:56.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80b77fe640 1 --2- 172.21.15.92:0/3075781963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31a9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.230+0000 7f80b77fe640 1 -- 172.21.15.92:0/3075781963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f31b8400 con 0x55f5f2de4390 2024-09-21T07:15:56.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.231+0000 7f80b77fe640 1 --2- 172.21.15.92:0/3075781963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba1f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f80a802a450 tx=0x7f80a8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a9bca29e980658 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:56.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.231+0000 7f80ad7fa640 1 -- 172.21.15.92:0/3075781963 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8035070 con 0x55f5f2de4390 2024-09-21T07:15:56.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.231+0000 7f80ad7fa640 1 -- 172.21.15.92:0/3075781963 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80a804c070 con 0x55f5f2de4390 2024-09-21T07:15:56.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.231+0000 7f80ad7fa640 1 -- 172.21.15.92:0/3075781963 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a803f040 con 0x55f5f2de4390 2024-09-21T07:15:56.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.232+0000 7f80c458d740 1 -- 172.21.15.92:0/3075781963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 msgr2=0x55f5f31ba1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:56.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.232+0000 7f80c458d740 1 --2- 172.21.15.92:0/3075781963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba1f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f80a802a450 tx=0x7f80a8005d50 comp rx=0 tx=0).stop 2024-09-21T07:15:56.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.232+0000 7f80c458d740 1 -- 172.21.15.92:0/3075781963 shutdown_connections 2024-09-21T07:15:56.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.232+0000 7f80c458d740 1 --2- 172.21.15.92:0/3075781963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2e05070 0x55f5f31a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.232+0000 7f80c458d740 1 --2- 172.21.15.92:0/3075781963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2de4390 0x55f5f31ba1f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.232+0000 7f80c458d740 1 --2- 172.21.15.92:0/3075781963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31b9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.232+0000 7f80c458d740 1 -- 172.21.15.92:0/3075781963 >> 172.21.15.92:0/3075781963 conn(0x55f5f2df9460 msgr2=0x55f5f31b8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:56.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.232+0000 7f80c458d740 1 -- 172.21.15.92:0/3075781963 shutdown_connections 2024-09-21T07:15:56.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.233+0000 7f80c458d740 1 -- 172.21.15.92:0/3075781963 wait complete. 2024-09-21T07:15:56.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.233+0000 7f80c458d740 1 -- start start 2024-09-21T07:15:56.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.233+0000 7f80c458d740 1 Processor -- start 2024-09-21T07:15:56.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80c458d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80c458d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2de4390 0x55f5f31cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80c458d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2e05070 0x55f5f31cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80c458d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80b81b0060 con 0x55f5f2e05070 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80c458d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80b81af990 con 0x55f5f2de4390 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80c458d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80b81acbd0 con 0x55f5f2ddc1b0 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80c458d740 10 client.0 _ll_register_callbacks cb 0x7f80a8032af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2e05070 0x55f5f31cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2e05070 0x55f5f31cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51490/0 (socket says 172.21.15.92:51490) 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80affff640 1 -- 172.21.15.92:0/4005163333 learned_addr learned my addr 172.21.15.92:0/4005163333 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80b77fe640 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2de4390 0x55f5f31cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.234+0000 7f80affff640 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.235+0000 7f80affff640 1 -- 172.21.15.92:0/4005163333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 msgr2=0x55f5f31cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.235+0000 7f80affff640 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.235+0000 7f80affff640 1 -- 172.21.15.92:0/4005163333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2de4390 msgr2=0x55f5f31cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.235+0000 7f80affff640 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2de4390 0x55f5f31cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.235+0000 7f80affff640 1 -- 172.21.15.92:0/4005163333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f32318b0 con 0x55f5f2e05070 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.235+0000 7f80b77fe640 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2de4390 0x55f5f31cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.235+0000 7f80affff640 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2e05070 0x55f5f31cbc30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f80a0005890 tx=0x7f80a8005110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7adef7cfa01bda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.235+0000 7f8096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.235+0000 7f8096ffd640 1 -- 172.21.15.92:0/4005163333 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a0004030 con 0x55f5f2e05070 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f8096ffd640 1 -- 172.21.15.92:0/4005163333 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f80a00041d0 con 0x55f5f2e05070 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f80c458d740 1 -- 172.21.15.92:0/4005163333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80a804c070 con 0x55f5f2e05070 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f8096ffd640 1 -- 172.21.15.92:0/4005163333 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f80a00043d0 con 0x55f5f2e05070 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f80c458d740 10 client.16557 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f80c458d740 1 -- 172.21.15.92:0/4005163333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5f3238fb0 con 0x55f5f2e05070 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f8096ffd640 1 -- 172.21.15.92:0/4005163333 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80a804c070 con 0x55f5f2e05070 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f8096ffd640 1 -- 172.21.15.92:0/4005163333 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f80a0026040 con 0x55f5f2e05070 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f80c458d740 10 client.16557 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:56.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f80c458d740 10 client.16557 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:15:56.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f80c458d740 20 client.16557 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:56.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f80c458d740 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55f5f2d98da0 0x55f5f323b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:56.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f80c458d740 4 client.16557 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:15:56.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.236+0000 7f80c458d740 1 -- 172.21.15.92:0/4005163333 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f5f31208a0 con 0x55f5f2d98da0 2024-09-21T07:15:56.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.237+0000 7f80b77fe640 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55f5f2d98da0 0x55f5f323b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:56.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.237+0000 7f8096ffd640 10 client.16557 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:15:56.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.237+0000 7f80b77fe640 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55f5f2d98da0 0x55f5f323b7a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c48eb2cdd6c23202 server_cookie=4256675c63df3f3c in_seq=0 out_seq=0 2024-09-21T07:15:56.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.237+0000 7f8096ffd640 1 -- 172.21.15.92:0/4005163333 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f5f31208a0 con 0x55f5f2d98da0 2024-09-21T07:15:56.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.237+0000 7f8096ffd640 10 client.16557 handle_command_reply: tid=0 2024-09-21T07:15:56.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.237+0000 7f80c458d740 1 client.16557 shutdown 2024-09-21T07:15:56.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 1 -- 172.21.15.92:0/4005163333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2e05070 msgr2=0x55f5f31cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:56.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2e05070 0x55f5f31cbc30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f80a0005890 tx=0x7f80a8005110 comp rx=0 tx=0).stop 2024-09-21T07:15:56.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 1 -- 172.21.15.92:0/4005163333 shutdown_connections 2024-09-21T07:15:56.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55f5f2d98da0 0x55f5f323b7a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5f2e05070 0x55f5f31cbc30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f5f2de4390 0x55f5f31cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f8096ffd640 0 client.16557 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:15:56.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 1 --2- 172.21.15.92:0/4005163333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5f2ddc1b0 0x55f5f31cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 1 -- 172.21.15.92:0/4005163333 >> 172.21.15.92:0/4005163333 conn(0x55f5f2df9460 msgr2=0x55f5f31b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:56.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 1 -- 172.21.15.92:0/4005163333 shutdown_connections 2024-09-21T07:15:56.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 1 -- 172.21.15.92:0/4005163333 wait complete. 2024-09-21T07:15:56.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.238+0000 7f80c458d740 20 client.16557 trim_cache size 0 max 16384 2024-09-21T07:15:56.245 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:15:56.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 -- 172.21.15.92:0/805164216 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80a40b6680 msgr2=0x7f80a40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:56.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80a40b6680 0x7f80a40b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f80b00e56a0 tx=0x7f80b007aa80 comp rx=0 tx=0).stop 2024-09-21T07:15:56.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 -- 172.21.15.92:0/805164216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80b8108d00 msgr2=0x7f80b819eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:56.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80b8108d00 0x7f80b819eb20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009fd0 tx=0x7f80b000b260 comp rx=0 tx=0).stop 2024-09-21T07:15:56.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 -- 172.21.15.92:0/805164216 shutdown_connections 2024-09-21T07:15:56.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f80a40b6680 0x7f80a40b8b90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80b8108d00 0x7f80b819eb20 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80b81083b0 0x7f80b8199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 --2- 172.21.15.92:0/805164216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b8103140 0x7f80b81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:56.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 -- 172.21.15.92:0/805164216 >> 172.21.15.92:0/805164216 conn(0x7f80b8077c60 msgr2=0x7f80b8106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:56.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 -- 172.21.15.92:0/805164216 shutdown_connections 2024-09-21T07:15:56.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:56.239+0000 7f80be019640 1 -- 172.21.15.92:0/805164216 wait complete. 2024-09-21T07:15:57.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:56 smithi175 ceph-mon[34064]: pgmap v425: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-09-21T07:15:57.075 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:56 smithi092 ceph-mon[30987]: pgmap v425: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-09-21T07:15:57.101 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:15:57.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:56 smithi169 ceph-mon[33705]: pgmap v425: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-09-21T07:15:57.350 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:15:57.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.843+0000 7f1d4cb68640 1 -- 172.21.15.92:0/2141564611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d481083a0 msgr2=0x7f1d481087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:57.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.843+0000 7f1d4cb68640 1 --2- 172.21.15.92:0/2141564611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d481083a0 0x7f1d481087b0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009900 tx=0x7f1d3c02a410 comp rx=0 tx=0).stop 2024-09-21T07:15:57.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.844+0000 7f1d4cb68640 1 -- 172.21.15.92:0/2141564611 shutdown_connections 2024-09-21T07:15:57.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.844+0000 7f1d4cb68640 1 --2- 172.21.15.92:0/2141564611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d48108cf0 0x7f1d4810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.844+0000 7f1d4cb68640 1 --2- 172.21.15.92:0/2141564611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d481083a0 0x7f1d481087b0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.844+0000 7f1d4cb68640 1 --2- 172.21.15.92:0/2141564611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d48102a60 0x7f1d48102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.844+0000 7f1d4cb68640 1 -- 172.21.15.92:0/2141564611 >> 172.21.15.92:0/2141564611 conn(0x7f1d48079730 msgr2=0x7f1d48079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:57.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.844+0000 7f1d4cb68640 1 -- 172.21.15.92:0/2141564611 shutdown_connections 2024-09-21T07:15:57.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.844+0000 7f1d4cb68640 1 -- 172.21.15.92:0/2141564611 wait complete. 2024-09-21T07:15:57.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.844+0000 7f1d4cb68640 1 Processor -- start 2024-09-21T07:15:57.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d4cb68640 1 -- start start 2024-09-21T07:15:57.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d4cb68640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d48102a60 0x7f1d4819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d4cb68640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d481083a0 0x7f1d4819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d4cb68640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d48108cf0 0x7f1d4819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d4cb68640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1d48112850 con 0x7f1d481083a0 2024-09-21T07:15:57.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d4cb68640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1d481126d0 con 0x7f1d48108cf0 2024-09-21T07:15:57.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d4cb68640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d481129d0 con 0x7f1d48102a60 2024-09-21T07:15:57.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d45d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d481083a0 0x7f1d4819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d45d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d481083a0 0x7f1d4819b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51496/0 (socket says 172.21.15.92:51496) 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d45d9b640 1 -- 172.21.15.92:0/460558899 learned_addr learned my addr 172.21.15.92:0/460558899 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d48108cf0 0x7f1d4819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d4659c640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d48102a60 0x7f1d4819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d45d9b640 1 -- 172.21.15.92:0/460558899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d48102a60 msgr2=0x7f1d4819b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d45d9b640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d48102a60 0x7f1d4819b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d45d9b640 1 -- 172.21.15.92:0/460558899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d48108cf0 msgr2=0x7f1d4819bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d45d9b640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d48108cf0 0x7f1d4819bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d45d9b640 1 -- 172.21.15.92:0/460558899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d481a64c0 con 0x7f1d481083a0 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.845+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d48108cf0 0x7f1d4819bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.846+0000 7f1d45d9b640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d481083a0 0x7f1d4819b740 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c005940 tx=0x7f1d3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.846+0000 7f1d377fe640 1 -- 172.21.15.92:0/460558899 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c03f030 con 0x7f1d481083a0 2024-09-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.846+0000 7f1d377fe640 1 -- 172.21.15.92:0/460558899 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d3c003c90 con 0x7f1d481083a0 2024-09-21T07:15:57.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.846+0000 7f1d4cb68640 1 -- 172.21.15.92:0/460558899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d481a6750 con 0x7f1d481083a0 2024-09-21T07:15:57.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.846+0000 7f1d377fe640 1 -- 172.21.15.92:0/460558899 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c035070 con 0x7f1d481083a0 2024-09-21T07:15:57.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.846+0000 7f1d4cb68640 1 -- 172.21.15.92:0/460558899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d481a6cb0 con 0x7f1d481083a0 2024-09-21T07:15:57.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d530dc740 1 Processor -- start 2024-09-21T07:15:57.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d530dc740 1 -- start start 2024-09-21T07:15:57.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d377fe640 1 -- 172.21.15.92:0/460558899 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f1d3c042030 con 0x7f1d481083a0 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90063070 0x559b9040a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b9003a1b0 0x559b9040a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 0x559b9040ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d530dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b90380ea0 con 0x559b9003a1b0 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d530dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b903702d0 con 0x559b90063070 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d530dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559b903740e0 con 0x559b90042390 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d4659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b9003a1b0 0x559b9040a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d4659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b9003a1b0 0x559b9040a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51502/0 (socket says 172.21.15.92:51502) 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.849+0000 7f1d4659c640 1 -- 172.21.15.92:0/615072947 learned_addr learned my addr 172.21.15.92:0/615072947 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d45d9b640 1 --2- 172.21.15.92:0/615072947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 0x559b9040ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/615072947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90063070 0x559b9040a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d4659c640 1 -- 172.21.15.92:0/615072947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 msgr2=0x559b9040ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:57.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d4659c640 1 --2- 172.21.15.92:0/615072947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 0x559b9040ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d4659c640 1 -- 172.21.15.92:0/615072947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90063070 msgr2=0x559b9040a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:57.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d4659c640 1 --2- 172.21.15.92:0/615072947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90063070 0x559b9040a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d4659c640 1 -- 172.21.15.92:0/615072947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b900ce650 con 0x559b9003a1b0 2024-09-21T07:15:57.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/615072947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90063070 0x559b9040a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:15:57.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d4659c640 1 --2- 172.21.15.92:0/615072947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b9003a1b0 0x559b9040a800 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800ac10 tx=0x7f1d3800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d905f0a3c5deea82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:57.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d377fe640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1d300b6680 0x7f1d300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d34ff9640 1 -- 172.21.15.92:0/615072947 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38005220 con 0x559b9003a1b0 2024-09-21T07:15:57.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1d300b6680 0x7f1d300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d34ff9640 1 -- 172.21.15.92:0/615072947 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d380047a0 con 0x559b9003a1b0 2024-09-21T07:15:57.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d34ff9640 1 -- 172.21.15.92:0/615072947 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380186a0 con 0x559b9003a1b0 2024-09-21T07:15:57.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.850+0000 7f1d377fe640 1 -- 172.21.15.92:0/460558899 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f1d3c108000 con 0x7f1d481083a0 2024-09-21T07:15:57.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.851+0000 7f1d530dc740 1 -- 172.21.15.92:0/615072947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b9003a1b0 msgr2=0x559b9040a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:57.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.851+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1d300b6680 0x7f1d300b8b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a9c0 tx=0x7f1d4000d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:57.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.851+0000 7f1d530dc740 1 --2- 172.21.15.92:0/615072947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b9003a1b0 0x559b9040a800 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800ac10 tx=0x7f1d3800f790 comp rx=0 tx=0).stop 2024-09-21T07:15:57.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.851+0000 7f1d530dc740 1 -- 172.21.15.92:0/615072947 shutdown_connections 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.851+0000 7f1d530dc740 1 --2- 172.21.15.92:0/615072947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 0x559b9040ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.851+0000 7f1d530dc740 1 --2- 172.21.15.92:0/615072947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b9003a1b0 0x559b9040a800 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.851+0000 7f1d530dc740 1 --2- 172.21.15.92:0/615072947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90063070 0x559b9040a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.851+0000 7f1d530dc740 1 -- 172.21.15.92:0/615072947 >> 172.21.15.92:0/615072947 conn(0x559b90057460 msgr2=0x559b904081b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 1 -- 172.21.15.92:0/615072947 shutdown_connections 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 1 -- 172.21.15.92:0/615072947 wait complete. 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 1 -- start start 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 1 Processor -- start 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b9003a1b0 0x559b90419ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90042390 0x559b9041a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90063070 0x559b9041a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559b901d1700 con 0x559b90042390 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b9030b160 con 0x559b9003a1b0 2024-09-21T07:15:57.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559b9041cdd0 con 0x559b90063070 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d530dc740 10 client.0 _ll_register_callbacks cb 0x559b903249e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.852+0000 7f1d45d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90042390 0x559b9041a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d45d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90042390 0x559b9041a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51514/0 (socket says 172.21.15.92:51514) 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d45d9b640 1 -- 172.21.15.92:0/1102425745 learned_addr learned my addr 172.21.15.92:0/1102425745 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d4659c640 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b9003a1b0 0x559b90419ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90063070 0x559b9041a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d45d9b640 1 -- 172.21.15.92:0/1102425745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90063070 msgr2=0x559b9041a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d45d9b640 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90063070 0x559b9041a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d45d9b640 1 -- 172.21.15.92:0/1102425745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b9003a1b0 msgr2=0x559b90419ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d45d9b640 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b9003a1b0 0x559b90419ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d45d9b640 1 -- 172.21.15.92:0/1102425745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b90338c90 con 0x559b90042390 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90063070 0x559b9041a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d45d9b640 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90042390 0x559b9041a1e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c000c00 tx=0x7f1d3c009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cf264a647b4329 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:57.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d2dffb640 1 -- 172.21.15.92:0/1102425745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c049070 con 0x559b90042390 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d2dffb640 1 -- 172.21.15.92:0/1102425745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f1d3c0c9dd0 con 0x559b90042390 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d530dc740 1 -- 172.21.15.92:0/1102425745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d380047a0 con 0x559b90042390 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d2dffb640 1 -- 172.21.15.92:0/1102425745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1d3c0cd930 con 0x559b90042390 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d530dc740 10 client.16569 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.853+0000 7f1d530dc740 1 -- 172.21.15.92:0/1102425745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559b90428a70 con 0x559b90042390 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.854+0000 7f1d2dffb640 1 -- 172.21.15.92:0/1102425745 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d380047a0 con 0x559b90042390 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.854+0000 7f1d2dffb640 1 -- 172.21.15.92:0/1102425745 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1d3c10a0d0 con 0x559b90042390 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.854+0000 7f1d530dc740 10 client.16569 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.854+0000 7f1d530dc740 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.854+0000 7f1d530dc740 20 client.16569 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.854+0000 7f1d530dc740 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b900219f0 0x559b9042bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.854+0000 7f1d530dc740 4 client.16569 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:15:57.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.854+0000 7f1d530dc740 1 -- 172.21.15.92:0/1102425745 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b90382df0 con 0x559b900219f0 2024-09-21T07:15:57.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.854+0000 7f1d4659c640 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b900219f0 0x559b9042bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.855+0000 7f1d2dffb640 10 client.16569 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.855+0000 7f1d4659c640 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b900219f0 0x559b9042bfd0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab0ed9e08bcb990c server_cookie=b6a887ec0a47d6c5 in_seq=0 out_seq=0 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d2dffb640 1 -- 172.21.15.92:0/1102425745 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b90382df0 con 0x559b900219f0 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d2dffb640 10 client.16569 handle_command_reply: tid=0 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 client.16569 shutdown 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 -- 172.21.15.92:0/1102425745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90042390 msgr2=0x559b9041a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90042390 0x559b9041a1e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c000c00 tx=0x7f1d3c009620 comp rx=0 tx=0).stop 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 -- 172.21.15.92:0/1102425745 shutdown_connections 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b900219f0 0x559b9042bfd0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90063070 0x559b9041a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90042390 0x559b9041a1e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 --2- 172.21.15.92:0/1102425745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b9003a1b0 0x559b90419ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 -- 172.21.15.92:0/1102425745 >> 172.21.15.92:0/1102425745 conn(0x559b90057460 msgr2=0x559b9040d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:57.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d2dffb640 0 client.16569 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:57.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 -- 172.21.15.92:0/1102425745 shutdown_connections 2024-09-21T07:15:57.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 1 -- 172.21.15.92:0/1102425745 wait complete. 2024-09-21T07:15:57.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.856+0000 7f1d530dc740 20 client.16569 trim_cache size 0 max 16384 2024-09-21T07:15:57.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d530dc740 1 Processor -- start 2024-09-21T07:15:57.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d530dc740 1 -- start start 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b9003a1b0 0x559b9041b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90042390 0x559b90416e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b904173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d530dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1d481aecf0 con 0x559b90063070 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d530dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1d481b0830 con 0x559b90042390 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d530dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d481af3c0 con 0x559b9003a1b0 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d46d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b904173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d46d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b904173d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51522/0 (socket says 172.21.15.92:51522) 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d46d9d640 1 -- 172.21.15.92:0/4107587992 learned_addr learned my addr 172.21.15.92:0/4107587992 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d4659c640 1 --2- 172.21.15.92:0/4107587992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b9003a1b0 0x559b9041b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d45d9b640 1 --2- 172.21.15.92:0/4107587992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90042390 0x559b90416e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d46d9d640 1 -- 172.21.15.92:0/4107587992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b9003a1b0 msgr2=0x559b9041b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:57.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/4107587992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b9003a1b0 0x559b9041b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d46d9d640 1 -- 172.21.15.92:0/4107587992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90042390 msgr2=0x559b90416e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:57.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.870+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/4107587992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90042390 0x559b90416e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.871+0000 7f1d46d9d640 1 -- 172.21.15.92:0/4107587992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b9040d0c0 con 0x559b90063070 2024-09-21T07:15:57.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.871+0000 7f1d4659c640 1 --2- 172.21.15.92:0/4107587992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b9003a1b0 0x559b9041b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:57.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.871+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/4107587992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b904173d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1d40011c00 tx=0x7f1d40014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd72dd5f0ab8a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:57.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.871+0000 7f1d2ffff640 1 -- 172.21.15.92:0/4107587992 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4001e040 con 0x559b90063070 2024-09-21T07:15:57.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.871+0000 7f1d2ffff640 1 -- 172.21.15.92:0/4107587992 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d40029070 con 0x559b90063070 2024-09-21T07:15:57.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.871+0000 7f1d2ffff640 1 -- 172.21.15.92:0/4107587992 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40016430 con 0x559b90063070 2024-09-21T07:15:57.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 -- 172.21.15.92:0/4107587992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 msgr2=0x559b904173d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:57.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 --2- 172.21.15.92:0/4107587992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b904173d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1d40011c00 tx=0x7f1d40014000 comp rx=0 tx=0).stop 2024-09-21T07:15:57.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 -- 172.21.15.92:0/4107587992 shutdown_connections 2024-09-21T07:15:57.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 --2- 172.21.15.92:0/4107587992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b904173d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 --2- 172.21.15.92:0/4107587992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b90042390 0x559b90416e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 --2- 172.21.15.92:0/4107587992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b9003a1b0 0x559b9041b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 -- 172.21.15.92:0/4107587992 >> 172.21.15.92:0/4107587992 conn(0x559b90057460 msgr2=0x559b9041b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 -- 172.21.15.92:0/4107587992 shutdown_connections 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 -- 172.21.15.92:0/4107587992 wait complete. 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 -- start start 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 Processor -- start 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.872+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b9003a1b0 0x559b9041e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 0x559b9041ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d530dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b90495990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d530dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1d481b0160 con 0x559b90063070 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d530dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1d481afa90 con 0x559b9003a1b0 2024-09-21T07:15:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d530dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d481accd0 con 0x559b90042390 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d46d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b90495990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d530dc740 10 client.0 _ll_register_callbacks cb 0x7f1d3c005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d46d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b90495990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51532/0 (socket says 172.21.15.92:51532) 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d46d9d640 1 -- 172.21.15.92:0/3925494938 learned_addr learned my addr 172.21.15.92:0/3925494938 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d4659c640 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b9003a1b0 0x559b9041e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d45d9b640 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 0x559b9041ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d46d9d640 1 -- 172.21.15.92:0/3925494938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 msgr2=0x559b9041ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 0x559b9041ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d46d9d640 1 -- 172.21.15.92:0/3925494938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b9003a1b0 msgr2=0x559b9041e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b9003a1b0 0x559b9041e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d46d9d640 1 -- 172.21.15.92:0/3925494938 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b90495ed0 con 0x559b90063070 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d45d9b640 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 0x559b9041ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d46d9d640 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b90495990 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a010 tx=0x7f1d400246a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4773c7a6e84681 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:15:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d2dffb640 1 -- 172.21.15.92:0/3925494938 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4002d420 con 0x559b90063070 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d2dffb640 1 -- 172.21.15.92:0/3925494938 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f1d4002d5c0 con 0x559b90063070 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.873+0000 7f1d530dc740 1 -- 172.21.15.92:0/3925494938 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d40029070 con 0x559b90063070 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d2dffb640 1 -- 172.21.15.92:0/3925494938 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1d4003e050 con 0x559b90063070 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d530dc740 10 client.16575 fetch_fsmap learned FSMap version 29 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d530dc740 1 -- 172.21.15.92:0/3925494938 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559b904970e0 con 0x559b90063070 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d2dffb640 1 -- 172.21.15.92:0/3925494938 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d40029070 con 0x559b90063070 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d2dffb640 1 -- 172.21.15.92:0/3925494938 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1d400398f0 con 0x559b90063070 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d530dc740 10 client.16575 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d530dc740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d530dc740 20 client.16575 populate_metadata read hostname 'smithi092' 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d530dc740 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b8fff6da0 0x559b90499830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d530dc740 4 client.16575 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.874+0000 7f1d530dc740 1 -- 172.21.15.92:0/3925494938 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b9037e8a0 con 0x559b8fff6da0 2024-09-21T07:15:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d4659c640 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b8fff6da0 0x559b90499830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d2dffb640 10 client.16575 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d4659c640 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b8fff6da0 0x559b90499830 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ca41b13c14b6ed0 server_cookie=86c4fbfb41e49d56 in_seq=0 out_seq=0 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d2dffb640 1 -- 172.21.15.92:0/3925494938 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b9037e8a0 con 0x559b8fff6da0 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d2dffb640 10 client.16575 handle_command_reply: tid=0 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d530dc740 1 client.16575 shutdown 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d530dc740 1 -- 172.21.15.92:0/3925494938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 msgr2=0x559b90495990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d530dc740 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b90495990 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a010 tx=0x7f1d400246a0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d530dc740 1 -- 172.21.15.92:0/3925494938 shutdown_connections 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d530dc740 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x559b8fff6da0 0x559b90499830 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d530dc740 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559b90063070 0x559b90495990 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d530dc740 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559b90042390 0x559b9041ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d530dc740 1 --2- 172.21.15.92:0/3925494938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b9003a1b0 0x559b9041e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d2dffb640 0 client.16575 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:15:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.875+0000 7f1d530dc740 1 -- 172.21.15.92:0/3925494938 >> 172.21.15.92:0/3925494938 conn(0x559b90057460 msgr2=0x559b9040b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d530dc740 1 -- 172.21.15.92:0/3925494938 shutdown_connections 2024-09-21T07:15:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d530dc740 1 -- 172.21.15.92:0/3925494938 wait complete. 2024-09-21T07:15:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d530dc740 20 client.16575 trim_cache size 0 max 16384 2024-09-21T07:15:57.883 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 -- 172.21.15.92:0/460558899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1d300b6680 msgr2=0x7f1d300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1d300b6680 0x7f1d300b8b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a9c0 tx=0x7f1d4000d040 comp rx=0 tx=0).stop 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 -- 172.21.15.92:0/460558899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d481083a0 msgr2=0x7f1d4819b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d481083a0 0x7f1d4819b740 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c005940 tx=0x7f1d3c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 -- 172.21.15.92:0/460558899 shutdown_connections 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1d300b6680 0x7f1d300b8b90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d48108cf0 0x7f1d4819bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d481083a0 0x7f1d4819b740 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 --2- 172.21.15.92:0/460558899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d48102a60 0x7f1d4819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 -- 172.21.15.92:0/460558899 >> 172.21.15.92:0/460558899 conn(0x7f1d48079730 msgr2=0x7f1d48105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 -- 172.21.15.92:0/460558899 shutdown_connections 2024-09-21T07:15:57.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:15:57.876+0000 7f1d4cb68640 1 -- 172.21.15.92:0/460558899 wait complete. 2024-09-21T07:15:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:58 smithi175 ceph-mon[34064]: pgmap v426: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T07:15:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:15:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:15:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:15:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:15:58 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:15:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:58 smithi092 ceph-mon[30987]: pgmap v426: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T07:15:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:15:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:15:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:15:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:15:58 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:15:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:58 smithi169 ceph-mon[33705]: pgmap v426: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T07:15:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:15:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:15:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:15:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:15:58 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:15:59.580 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:15:59.581 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:15:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:00.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.275+0000 7f8423adf640 1 -- 172.21.15.92:0/3845288761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f841c102f20 msgr2=0x7f841c10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:00.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.275+0000 7f8423adf640 1 --2- 172.21.15.92:0/3845288761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f841c102f20 0x7f841c10fc40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f840c009900 tx=0x7f840c02a480 comp rx=0 tx=0).stop 2024-09-21T07:16:00.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.275+0000 7f8423adf640 1 -- 172.21.15.92:0/3845288761 shutdown_connections 2024-09-21T07:16:00.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.275+0000 7f8423adf640 1 --2- 172.21.15.92:0/3845288761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f841c110180 0x7f841c1125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.275+0000 7f8423adf640 1 --2- 172.21.15.92:0/3845288761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f841c102f20 0x7f841c10fc40 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.275+0000 7f8423adf640 1 --2- 172.21.15.92:0/3845288761 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f841c1025d0 0x7f841c1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.275+0000 7f8423adf640 1 -- 172.21.15.92:0/3845288761 >> 172.21.15.92:0/3845288761 conn(0x7f841c079730 msgr2=0x7f841c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:00.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.275+0000 7f8423adf640 1 -- 172.21.15.92:0/3845288761 shutdown_connections 2024-09-21T07:16:00.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.275+0000 7f8423adf640 1 -- 172.21.15.92:0/3845288761 wait complete. 2024-09-21T07:16:00.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.275+0000 7f8423adf640 1 Processor -- start 2024-09-21T07:16:00.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f8423adf640 1 -- start start 2024-09-21T07:16:00.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f8423adf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f841c1025d0 0x7f841c19c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f8423adf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f841c102f20 0x7f841c19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f8423adf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f841c110180 0x7f841c1a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f8423adf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f841c115b20 con 0x7f841c1025d0 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f8423adf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1159a0 con 0x7f841c110180 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f8423adf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f841c115ca0 con 0x7f841c102f20 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842187b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f841c1025d0 0x7f841c19c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842187b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f841c1025d0 0x7f841c19c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54696/0 (socket says 172.21.15.92:54696) 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842187b640 1 -- 172.21.15.92:0/3982004385 learned_addr learned my addr 172.21.15.92:0/3982004385 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842107a640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f841c102f20 0x7f841c19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842207c640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f841c110180 0x7f841c1a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842187b640 1 -- 172.21.15.92:0/3982004385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f841c102f20 msgr2=0x7f841c19cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842187b640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f841c102f20 0x7f841c19cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842187b640 1 -- 172.21.15.92:0/3982004385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f841c110180 msgr2=0x7f841c1a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842187b640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f841c110180 0x7f841c1a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842187b640 1 -- 172.21.15.92:0/3982004385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c1a2500 con 0x7f841c1025d0 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842107a640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f841c102f20 0x7f841c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:00.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.276+0000 7f842207c640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f841c110180 0x7f841c1a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.277+0000 7f842187b640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f841c1025d0 0x7f841c19c590 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f841800c890 tx=0x7f841800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.277+0000 7f8412ffd640 1 -- 172.21.15.92:0/3982004385 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418004220 con 0x7f841c1025d0 2024-09-21T07:16:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.277+0000 7f8412ffd640 1 -- 172.21.15.92:0/3982004385 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8418007e40 con 0x7f841c1025d0 2024-09-21T07:16:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.277+0000 7f8423adf640 1 -- 172.21.15.92:0/3982004385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c1a27f0 con 0x7f841c1025d0 2024-09-21T07:16:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.277+0000 7f8412ffd640 1 -- 172.21.15.92:0/3982004385 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418004a00 con 0x7f841c1025d0 2024-09-21T07:16:00.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.277+0000 7f8423adf640 1 -- 172.21.15.92:0/3982004385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c1a8f50 con 0x7f841c1025d0 2024-09-21T07:16:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.279+0000 7f842a053740 1 Processor -- start 2024-09-21T07:16:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842a053740 1 -- start start 2024-09-21T07:16:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f8412ffd640 1 -- 172.21.15.92:0/3982004385 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f84180079b0 con 0x7f841c1025d0 2024-09-21T07:16:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842a053740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4370430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842a053740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d4370970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842a053740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d4370eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842a053740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e3d42e6e60 con 0x55e3d3fc9350 2024-09-21T07:16:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842a053740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e3d42d6290 con 0x55e3d3fa0490 2024-09-21T07:16:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842a053740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3d42da0a0 con 0x55e3d3fa8670 2024-09-21T07:16:00.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842207c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4370430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842207c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4370430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54698/0 (socket says 172.21.15.92:54698) 2024-09-21T07:16:00.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842207c640 1 -- 172.21.15.92:0/1071223721 learned_addr learned my addr 172.21.15.92:0/1071223721 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:00.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842187b640 1 --2- 172.21.15.92:0/1071223721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d4370970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842107a640 1 --2- 172.21.15.92:0/1071223721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d4370eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842207c640 1 -- 172.21.15.92:0/1071223721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 msgr2=0x55e3d4370eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:00.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842207c640 1 --2- 172.21.15.92:0/1071223721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d4370eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842207c640 1 -- 172.21.15.92:0/1071223721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 msgr2=0x55e3d4370970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:00.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842207c640 1 --2- 172.21.15.92:0/1071223721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d4370970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842207c640 1 -- 172.21.15.92:0/1071223721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3d4034930 con 0x55e3d3fc9350 2024-09-21T07:16:00.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.280+0000 7f842187b640 1 --2- 172.21.15.92:0/1071223721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d4370970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:00.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.281+0000 7f8412ffd640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b6680 0x7f84080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.281+0000 7f842207c640 1 --2- 172.21.15.92:0/1071223721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4370430 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8414009fb0 tx=0x7f8414010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f79cff24ea19250 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.281+0000 7f842187b640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b6680 0x7f84080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.281+0000 7f8407fff640 1 -- 172.21.15.92:0/1071223721 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414016070 con 0x55e3d3fc9350 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.281+0000 7f8412ffd640 1 -- 172.21.15.92:0/3982004385 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f84180e7830 con 0x7f841c1025d0 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.281+0000 7f8407fff640 1 -- 172.21.15.92:0/1071223721 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8414012ba0 con 0x55e3d3fc9350 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.281+0000 7f8407fff640 1 -- 172.21.15.92:0/1071223721 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414011ae0 con 0x55e3d3fc9350 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.282+0000 7f842a053740 1 -- 172.21.15.92:0/1071223721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 msgr2=0x55e3d4370430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.282+0000 7f842a053740 1 --2- 172.21.15.92:0/1071223721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4370430 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8414009fb0 tx=0x7f8414010800 comp rx=0 tx=0).stop 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.282+0000 7f842187b640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b6680 0x7f84080b8b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f84180e4c90 tx=0x7f84180a9a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.282+0000 7f842a053740 1 -- 172.21.15.92:0/1071223721 shutdown_connections 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.282+0000 7f842a053740 1 --2- 172.21.15.92:0/1071223721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d4370eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.282+0000 7f842a053740 1 --2- 172.21.15.92:0/1071223721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d4370970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.282+0000 7f842a053740 1 --2- 172.21.15.92:0/1071223721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4370430 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.282+0000 7f842a053740 1 -- 172.21.15.92:0/1071223721 >> 172.21.15.92:0/1071223721 conn(0x55e3d3fbd740 msgr2=0x55e3d436e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:00.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.282+0000 7f842a053740 1 -- 172.21.15.92:0/1071223721 shutdown_connections 2024-09-21T07:16:00.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.282+0000 7f842a053740 1 -- 172.21.15.92:0/1071223721 wait complete. 2024-09-21T07:16:00.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842a053740 1 -- start start 2024-09-21T07:16:00.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842a053740 1 Processor -- start 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842a053740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa0490 0x55e3d437c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842a053740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa8670 0x55e3d437c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842a053740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4387f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842a053740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e3d4137890 con 0x55e3d3fc9350 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842a053740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e3d4270d40 con 0x55e3d3fa8670 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842a053740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3d437ec10 con 0x55e3d3fa0490 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842a053740 10 client.0 _ll_register_callbacks cb 0x55e3d42d4c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842207c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4387f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842207c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4387f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54704/0 (socket says 172.21.15.92:54704) 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842207c640 1 -- 172.21.15.92:0/343343877 learned_addr learned my addr 172.21.15.92:0/343343877 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.283+0000 7f842207c640 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa0490 0x55e3d437c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f842107a640 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa8670 0x55e3d437c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f842207c640 1 -- 172.21.15.92:0/343343877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa0490 msgr2=0x55e3d437c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f842207c640 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa0490 0x55e3d437c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f842207c640 1 -- 172.21.15.92:0/343343877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa8670 msgr2=0x55e3d437c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f842207c640 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa8670 0x55e3d437c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f842207c640 1 -- 172.21.15.92:0/343343877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3d43884c0 con 0x55e3d3fc9350 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f842207c640 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4387f00 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8414009be0 tx=0x7f8414011780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68967d373d950a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f84057fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f84057fa640 1 -- 172.21.15.92:0/343343877 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414016040 con 0x55e3d3fc9350 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f84057fa640 1 -- 172.21.15.92:0/343343877 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f8414004d10 con 0x55e3d3fc9350 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f842a053740 1 -- 172.21.15.92:0/343343877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8414012ba0 con 0x55e3d3fc9350 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f84057fa640 1 -- 172.21.15.92:0/343343877 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8414031050 con 0x55e3d3fc9350 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f842a053740 10 client.16587 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f842a053740 1 -- 172.21.15.92:0/343343877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e3d438add0 con 0x55e3d3fc9350 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.284+0000 7f84057fa640 1 -- 172.21.15.92:0/343343877 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8414012ba0 con 0x55e3d3fc9350 2024-09-21T07:16:00.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.285+0000 7f84057fa640 1 -- 172.21.15.92:0/343343877 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f841400f040 con 0x55e3d3fc9350 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.285+0000 7f842a053740 10 client.16587 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.285+0000 7f842a053740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.285+0000 7f842a053740 20 client.16587 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.285+0000 7f842a053740 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3d3f87cd0 0x55e3d438e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.285+0000 7f842a053740 4 client.16587 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.285+0000 7f842a053740 1 -- 172.21.15.92:0/343343877 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3d42e8db0 con 0x55e3d3f87cd0 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.285+0000 7f842107a640 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3d3f87cd0 0x55e3d438e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.286+0000 7f84057fa640 10 client.16587 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.286+0000 7f842107a640 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3d3f87cd0 0x55e3d438e190 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d61670795e2a92b server_cookie=8f0b395317966943 in_seq=0 out_seq=0 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.286+0000 7f84057fa640 1 -- 172.21.15.92:0/343343877 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3d42e8db0 con 0x55e3d3f87cd0 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.286+0000 7f84057fa640 10 client.16587 handle_command_reply: tid=0 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.286+0000 7f842a053740 1 client.16587 shutdown 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.286+0000 7f842a053740 1 -- 172.21.15.92:0/343343877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 msgr2=0x55e3d4387f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:00.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.286+0000 7f842a053740 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4387f00 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8414009be0 tx=0x7f8414011780 comp rx=0 tx=0).stop 2024-09-21T07:16:00.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.287+0000 7f842a053740 1 -- 172.21.15.92:0/343343877 shutdown_connections 2024-09-21T07:16:00.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.287+0000 7f842a053740 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3d3f87cd0 0x55e3d438e190 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.287+0000 7f842a053740 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3fc9350 0x55e3d4387f00 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.287+0000 7f842a053740 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa8670 0x55e3d437c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.287+0000 7f84057fa640 0 client.16587 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:00.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.287+0000 7f842a053740 1 --2- 172.21.15.92:0/343343877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa0490 0x55e3d437c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.287+0000 7f842a053740 1 -- 172.21.15.92:0/343343877 >> 172.21.15.92:0/343343877 conn(0x55e3d3fbd740 msgr2=0x55e3d4373610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:00.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.287+0000 7f842a053740 1 -- 172.21.15.92:0/343343877 shutdown_connections 2024-09-21T07:16:00.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.287+0000 7f842a053740 1 -- 172.21.15.92:0/343343877 wait complete. 2024-09-21T07:16:00.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.287+0000 7f842a053740 20 client.16587 trim_cache size 0 max 16384 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.304+0000 7f842a053740 1 Processor -- start 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.304+0000 7f842a053740 1 -- start start 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.304+0000 7f842a053740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d4387e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.304+0000 7f842a053740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d4379000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.304+0000 7f842a053740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d4379540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.304+0000 7f842a053740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1b30c0 con 0x55e3d3f87cd0 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.304+0000 7f842a053740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1b4c00 con 0x55e3d3fa0490 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.304+0000 7f842a053740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1b3790 con 0x55e3d3fa8670 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842207c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d4387e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842207c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d4387e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54716/0 (socket says 172.21.15.92:54716) 2024-09-21T07:16:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842207c640 1 -- 172.21.15.92:0/1363802881 learned_addr learned my addr 172.21.15.92:0/1363802881 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842207c640 1 --2- 172.21.15.92:0/1363802881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d4379540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842107a640 1 --2- 172.21.15.92:0/1363802881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d4379000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842207c640 1 -- 172.21.15.92:0/1363802881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 msgr2=0x55e3d4379540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842207c640 1 --2- 172.21.15.92:0/1363802881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d4379540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842207c640 1 -- 172.21.15.92:0/1363802881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 msgr2=0x55e3d4379000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842207c640 1 --2- 172.21.15.92:0/1363802881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d4379000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842207c640 1 -- 172.21.15.92:0/1363802881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3d4372720 con 0x55e3d3f87cd0 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f842207c640 1 --2- 172.21.15.92:0/1363802881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d4387e70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f841401b760 tx=0x7f84140113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac74511cdf240778 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f84077fe640 1 -- 172.21.15.92:0/1363802881 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841403a070 con 0x55e3d3f87cd0 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f84077fe640 1 -- 172.21.15.92:0/1363802881 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8414012ba0 con 0x55e3d3f87cd0 2024-09-21T07:16:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.305+0000 7f84077fe640 1 -- 172.21.15.92:0/1363802881 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414016040 con 0x55e3d3f87cd0 2024-09-21T07:16:00.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.306+0000 7f842a053740 1 -- 172.21.15.92:0/1363802881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 msgr2=0x55e3d4387e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:00.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.306+0000 7f842a053740 1 --2- 172.21.15.92:0/1363802881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d4387e70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f841401b760 tx=0x7f84140113e0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.306+0000 7f842a053740 1 -- 172.21.15.92:0/1363802881 shutdown_connections 2024-09-21T07:16:00.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.306+0000 7f842a053740 1 --2- 172.21.15.92:0/1363802881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d4379540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.306+0000 7f842a053740 1 --2- 172.21.15.92:0/1363802881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d4379000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.306+0000 7f842a053740 1 --2- 172.21.15.92:0/1363802881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d4387e70 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.306+0000 7f842a053740 1 -- 172.21.15.92:0/1363802881 >> 172.21.15.92:0/1363802881 conn(0x55e3d3fbd740 msgr2=0x55e3d437a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:00.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.306+0000 7f842a053740 1 -- 172.21.15.92:0/1363802881 shutdown_connections 2024-09-21T07:16:00.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.306+0000 7f842a053740 1 -- 172.21.15.92:0/1363802881 wait complete. 2024-09-21T07:16:00.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.306+0000 7f842a053740 1 -- start start 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842a053740 1 Processor -- start 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842a053740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d438fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842a053740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d43901d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842a053740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d43f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842a053740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1b4530 con 0x55e3d3f87cd0 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842a053740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1b3e60 con 0x55e3d3fa0490 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842a053740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1b10a0 con 0x55e3d3fa8670 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842a053740 10 client.0 _ll_register_callbacks cb 0x7f840c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842207c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d438fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842207c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d438fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54722/0 (socket says 172.21.15.92:54722) 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842207c640 1 -- 172.21.15.92:0/3811542159 learned_addr learned my addr 172.21.15.92:0/3811542159 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842107a640 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d43901d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842207c640 1 -- 172.21.15.92:0/3811542159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 msgr2=0x55e3d43f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:00.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842207c640 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d43f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842207c640 1 -- 172.21.15.92:0/3811542159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 msgr2=0x55e3d43901d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842207c640 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d43901d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.307+0000 7f842207c640 1 -- 172.21.15.92:0/3811542159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3d43f2030 con 0x55e3d3f87cd0 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f842207c640 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d438fbf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8414011010 tx=0x7f8414011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07e29b993d4be59 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f84057fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f84057fa640 1 -- 172.21.15.92:0/3811542159 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841403a070 con 0x55e3d3f87cd0 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f84057fa640 1 -- 172.21.15.92:0/3811542159 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f8414012510 con 0x55e3d3f87cd0 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f842a053740 1 -- 172.21.15.92:0/3811542159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8414012ba0 con 0x55e3d3f87cd0 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f84057fa640 1 -- 172.21.15.92:0/3811542159 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8414049050 con 0x55e3d3f87cd0 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f842a053740 10 client.16593 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f842a053740 1 -- 172.21.15.92:0/3811542159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e3d43f93b0 con 0x55e3d3f87cd0 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f84057fa640 1 -- 172.21.15.92:0/3811542159 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8414012ba0 con 0x55e3d3f87cd0 2024-09-21T07:16:00.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f84057fa640 1 -- 172.21.15.92:0/3811542159 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f841401ba30 con 0x55e3d3f87cd0 2024-09-21T07:16:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f842a053740 10 client.16593 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f842a053740 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f842a053740 20 client.16593 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.308+0000 7f842a053740 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3d3fc9350 0x55e3d43fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.309+0000 7f842a053740 4 client.16593 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:16:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.309+0000 7f842a053740 1 -- 172.21.15.92:0/3811542159 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e3d42e4860 con 0x55e3d3fc9350 2024-09-21T07:16:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.309+0000 7f842107a640 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3d3fc9350 0x55e3d43fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.309+0000 7f842107a640 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3d3fc9350 0x55e3d43fbae0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51edc69a5b5dd2cc server_cookie=a3f4e684b6c3252b in_seq=0 out_seq=0 2024-09-21T07:16:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.309+0000 7f84057fa640 10 client.16593 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f84057fa640 1 -- 172.21.15.92:0/3811542159 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e3d42e4860 con 0x55e3d3fc9350 2024-09-21T07:16:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f84057fa640 10 client.16593 handle_command_reply: tid=0 2024-09-21T07:16:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 client.16593 shutdown 2024-09-21T07:16:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 -- 172.21.15.92:0/3811542159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 msgr2=0x55e3d438fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d438fbf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8414011010 tx=0x7f8414011720 comp rx=0 tx=0).stop 2024-09-21T07:16:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 -- 172.21.15.92:0/3811542159 shutdown_connections 2024-09-21T07:16:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3d3fc9350 0x55e3d43fbae0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d3fa8670 0x55e3d43f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3d3fa0490 0x55e3d43901d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f84057fa640 0 client.16593 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:00.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 --2- 172.21.15.92:0/3811542159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3d3f87cd0 0x55e3d438fbf0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 -- 172.21.15.92:0/3811542159 >> 172.21.15.92:0/3811542159 conn(0x55e3d3fbd740 msgr2=0x55e3d4371460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:00.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 -- 172.21.15.92:0/3811542159 shutdown_connections 2024-09-21T07:16:00.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 1 -- 172.21.15.92:0/3811542159 wait complete. 2024-09-21T07:16:00.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.311+0000 7f842a053740 20 client.16593 trim_cache size 0 max 16384 2024-09-21T07:16:00.316 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:16:00.316 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:16:00.316 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "40c1cdf7-9a11-43e9-af28-0a82c962cfb4", 2024-09-21T07:16:00.316 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:16:00.317 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:16:00.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 -- 172.21.15.92:0/3982004385 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b6680 msgr2=0x7f84080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:00.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b6680 0x7f84080b8b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f84180e4c90 tx=0x7f84180a9a40 comp rx=0 tx=0).stop 2024-09-21T07:16:00.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 -- 172.21.15.92:0/3982004385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f841c1025d0 msgr2=0x7f841c19c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:00.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f841c1025d0 0x7f841c19c590 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f841800c890 tx=0x7f841800cd50 comp rx=0 tx=0).stop 2024-09-21T07:16:00.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 -- 172.21.15.92:0/3982004385 shutdown_connections 2024-09-21T07:16:00.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b6680 0x7f84080b8b90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f841c110180 0x7f841c1a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f841c102f20 0x7f841c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 --2- 172.21.15.92:0/3982004385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f841c1025d0 0x7f841c19c590 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:00.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 -- 172.21.15.92:0/3982004385 >> 172.21.15.92:0/3982004385 conn(0x7f841c079730 msgr2=0x7f841c111600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:00.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 -- 172.21.15.92:0/3982004385 shutdown_connections 2024-09-21T07:16:00.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:00.312+0000 7f8423adf640 1 -- 172.21.15.92:0/3982004385 wait complete. 2024-09-21T07:16:01.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:00 smithi175 ceph-mon[34064]: pgmap v427: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-21T07:16:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:00 smithi092 ceph-mon[30987]: pgmap v427: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-21T07:16:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:00 smithi169 ceph-mon[33705]: pgmap v427: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-21T07:16:01.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:16:01.411 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:01.834 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:01 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:16:01.834 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:01 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:01.834 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:01 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:16:01.834 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:01 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:01.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.832+0000 7f6d5f562640 1 -- 172.21.15.92:0/2948913736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d5810de10 msgr2=0x7f6d58110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:01.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.832+0000 7f6d5f562640 1 --2- 172.21.15.92:0/2948913736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d5810de10 0x7f6d58110300 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009ca0 tx=0x7f6d5002a8e0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.832+0000 7f6d5f562640 1 -- 172.21.15.92:0/2948913736 shutdown_connections 2024-09-21T07:16:01.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.832+0000 7f6d5f562640 1 --2- 172.21.15.92:0/2948913736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d5810de10 0x7f6d58110300 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.832+0000 7f6d5f562640 1 --2- 172.21.15.92:0/2948913736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d58105300 0x7f6d5810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.832+0000 7f6d5f562640 1 --2- 172.21.15.92:0/2948913736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d581049b0 0x7f6d58104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.832+0000 7f6d5f562640 1 -- 172.21.15.92:0/2948913736 >> 172.21.15.92:0/2948913736 conn(0x7f6d58079730 msgr2=0x7f6d58079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:01.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.832+0000 7f6d5f562640 1 -- 172.21.15.92:0/2948913736 shutdown_connections 2024-09-21T07:16:01.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.832+0000 7f6d5f562640 1 -- 172.21.15.92:0/2948913736 wait complete. 2024-09-21T07:16:01.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5f562640 1 Processor -- start 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5f562640 1 -- start start 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5f562640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d581049b0 0x7f6d5819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5f562640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d58105300 0x7f6d5819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5f562640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d5810de10 0x7f6d5819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5f562640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58113a20 con 0x7f6d58105300 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5f562640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581138a0 con 0x7f6d5810de10 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5f562640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58113ba0 con 0x7f6d581049b0 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5cafd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d58105300 0x7f6d5819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5cafd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d58105300 0x7f6d5819aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54744/0 (socket says 172.21.15.92:54744) 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5cafd640 1 -- 172.21.15.92:0/2896575746 learned_addr learned my addr 172.21.15.92:0/2896575746 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d581049b0 0x7f6d5819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.833+0000 7f6d5daff640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d5810de10 0x7f6d5819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d5cafd640 1 -- 172.21.15.92:0/2896575746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d581049b0 msgr2=0x7f6d5819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d581049b0 0x7f6d5819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d5cafd640 1 -- 172.21.15.92:0/2896575746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d5810de10 msgr2=0x7f6d5819fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d5810de10 0x7f6d5819fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d5cafd640 1 -- 172.21.15.92:0/2896575746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d581a0460 con 0x7f6d58105300 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d58105300 0x7f6d5819aa90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6d48006fd0 tx=0x7f6d4800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d4e7fc640 1 -- 172.21.15.92:0/2896575746 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48015020 con 0x7f6d58105300 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d5f562640 1 -- 172.21.15.92:0/2896575746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d581a0750 con 0x7f6d58105300 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d4e7fc640 1 -- 172.21.15.92:0/2896575746 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d48011cc0 con 0x7f6d58105300 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d4e7fc640 1 -- 172.21.15.92:0/2896575746 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48010cd0 con 0x7f6d58105300 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.834+0000 7f6d5f562640 1 -- 172.21.15.92:0/2896575746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d581a6f30 con 0x7f6d58105300 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d65ad6740 1 Processor -- start 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d65ad6740 1 -- start start 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d4e7fc640 1 -- 172.21.15.92:0/2896575746 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f6d48018020 con 0x7f6d58105300 2024-09-21T07:16:01.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4d5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f1051b0 0x55576f4d57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55576f44be50 con 0x55576f10d390 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55576f43b280 con 0x55576f12e070 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55576f43f090 con 0x55576f1051b0 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d5cafd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d5daff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4d5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d5cafd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4d5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54758/0 (socket says 172.21.15.92:54758) 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.837+0000 7f6d5cafd640 1 -- 172.21.15.92:0/3834497864 learned_addr learned my addr 172.21.15.92:0/3834497864 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/3834497864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f1051b0 0x55576f4d57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d5daff640 1 -- 172.21.15.92:0/3834497864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f1051b0 msgr2=0x55576f4d57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d5daff640 1 --2- 172.21.15.92:0/3834497864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f1051b0 0x55576f4d57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d4e7fc640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6d440b6680 0x7f6d440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d5daff640 1 -- 172.21.15.92:0/3834497864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 msgr2=0x55576f4d5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d5daff640 1 --2- 172.21.15.92:0/3834497864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4d5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d5daff640 1 -- 172.21.15.92:0/3834497864 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55576f199650 con 0x55576f12e070 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/3834497864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4d5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d4e7fc640 1 -- 172.21.15.92:0/2896575746 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6d480e7200 con 0x7f6d58105300 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d5daff640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6d440b6680 0x7f6d440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.838+0000 7f6d5daff640 1 --2- 172.21.15.92:0/3834497864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4d5270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d50006010 tx=0x7f6d50031520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91732b837a913f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.839+0000 7f6d437fe640 1 -- 172.21.15.92:0/3834497864 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5004c070 con 0x55576f12e070 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.839+0000 7f6d437fe640 1 -- 172.21.15.92:0/3834497864 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d50036040 con 0x55576f12e070 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.839+0000 7f6d437fe640 1 -- 172.21.15.92:0/3834497864 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50030b30 con 0x55576f12e070 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.839+0000 7f6d5daff640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6d440b6680 0x7f6d440b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6d50049000 tx=0x7f6d5004a000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.839+0000 7f6d65ad6740 1 -- 172.21.15.92:0/3834497864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 msgr2=0x55576f4d5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.839+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/3834497864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4d5270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d50006010 tx=0x7f6d50031520 comp rx=0 tx=0).stop 2024-09-21T07:16:01.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.840+0000 7f6d65ad6740 1 -- 172.21.15.92:0/3834497864 shutdown_connections 2024-09-21T07:16:01.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.840+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/3834497864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4d5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.840+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/3834497864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f1051b0 0x55576f4d57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.840+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/3834497864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4d5270 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.840+0000 7f6d65ad6740 1 -- 172.21.15.92:0/3834497864 >> 172.21.15.92:0/3834497864 conn(0x55576f122460 msgr2=0x55576f4d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:01.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.840+0000 7f6d65ad6740 1 -- 172.21.15.92:0/3834497864 shutdown_connections 2024-09-21T07:16:01.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.840+0000 7f6d65ad6740 1 -- 172.21.15.92:0/3834497864 wait complete. 2024-09-21T07:16:01.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.840+0000 7f6d65ad6740 1 -- start start 2024-09-21T07:16:01.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.840+0000 7f6d65ad6740 1 Processor -- start 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f1051b0 0x55576f4e4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4e5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f12e070 0x55576f4f1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55576f29c700 con 0x55576f10d390 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55576f3d6110 con 0x55576f1051b0 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55576f4e7cf0 con 0x55576f12e070 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d65ad6740 10 client.0 _ll_register_callbacks cb 0x55576f3ef990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5cafd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5cafd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4e5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54774/0 (socket says 172.21.15.92:54774) 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5d2fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f1051b0 0x55576f4e4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5cafd640 1 -- 172.21.15.92:0/2016581914 learned_addr learned my addr 172.21.15.92:0/2016581914 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5daff640 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f12e070 0x55576f4f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5cafd640 1 -- 172.21.15.92:0/2016581914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f12e070 msgr2=0x55576f4f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f12e070 0x55576f4f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5cafd640 1 -- 172.21.15.92:0/2016581914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f1051b0 msgr2=0x55576f4e4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f1051b0 0x55576f4e4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5cafd640 1 -- 172.21.15.92:0/2016581914 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55576f403c40 con 0x55576f10d390 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.841+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f1051b0 0x55576f4e4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4e5250 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6d480a9f20 tx=0x7f6d480e4ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a40c4cf1ba538e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d40ff9640 1 -- 172.21.15.92:0/2016581914 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d480a8b50 con 0x55576f10d390 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d40ff9640 1 -- 172.21.15.92:0/2016581914 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6d480d00e0 con 0x55576f10d390 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d65ad6740 1 -- 172.21.15.92:0/2016581914 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d50036040 con 0x55576f10d390 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d40ff9640 1 -- 172.21.15.92:0/2016581914 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6d480a8420 con 0x55576f10d390 2024-09-21T07:16:01.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d65ad6740 10 client.16605 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d65ad6740 1 -- 172.21.15.92:0/2016581914 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55576f4f3a70 con 0x55576f10d390 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d40ff9640 1 -- 172.21.15.92:0/2016581914 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d50036040 con 0x55576f10d390 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d40ff9640 1 -- 172.21.15.92:0/2016581914 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6d48018ba0 con 0x55576f10d390 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d65ad6740 10 client.16605 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d65ad6740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d65ad6740 20 client.16605 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55576f0ec9f0 0x55576f4f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d65ad6740 4 client.16605 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.842+0000 7f6d65ad6740 1 -- 172.21.15.92:0/2016581914 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55576f44dda0 con 0x55576f0ec9f0 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.843+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55576f0ec9f0 0x55576f4f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.843+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55576f0ec9f0 0x55576f4f6e20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfcd63812b4d2bee server_cookie=fcf1921cbb9ce8fa in_seq=0 out_seq=0 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.843+0000 7f6d40ff9640 10 client.16605 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d40ff9640 1 -- 172.21.15.92:0/2016581914 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55576f44dda0 con 0x55576f0ec9f0 2024-09-21T07:16:01.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d40ff9640 10 client.16605 handle_command_reply: tid=0 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 client.16605 shutdown 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 -- 172.21.15.92:0/2016581914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 msgr2=0x55576f4e5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4e5250 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6d480a9f20 tx=0x7f6d480e4ab0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 -- 172.21.15.92:0/2016581914 shutdown_connections 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55576f0ec9f0 0x55576f4f6e20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f12e070 0x55576f4f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f10d390 0x55576f4e5250 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d40ff9640 0 client.16605 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/2016581914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f1051b0 0x55576f4e4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 -- 172.21.15.92:0/2016581914 >> 172.21.15.92:0/2016581914 conn(0x55576f122460 msgr2=0x55576f4d1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 -- 172.21.15.92:0/2016581914 shutdown_connections 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 1 -- 172.21.15.92:0/2016581914 wait complete. 2024-09-21T07:16:01.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.844+0000 7f6d65ad6740 20 client.16605 trim_cache size 0 max 16384 2024-09-21T07:16:01.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d65ad6740 1 Processor -- start 2024-09-21T07:16:01.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d65ad6740 1 -- start start 2024-09-21T07:16:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 0x55576f4f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581aedb0 con 0x55576f1051b0 2024-09-21T07:16:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581b08f0 con 0x55576f12e070 2024-09-21T07:16:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581af480 con 0x55576f10d390 2024-09-21T07:16:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d5d2fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d5d2fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4e51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54778/0 (socket says 172.21.15.92:54778) 2024-09-21T07:16:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.862+0000 7f6d5d2fe640 1 -- 172.21.15.92:0/1130793928 learned_addr learned my addr 172.21.15.92:0/1130793928 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 0x55576f4f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d5d2fe640 1 -- 172.21.15.92:0/1130793928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 msgr2=0x55576f4f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d5daff640 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 0x55576f4f0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d5d2fe640 1 -- 172.21.15.92:0/1130793928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 msgr2=0x55576f4d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4d2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d5d2fe640 1 -- 172.21.15.92:0/1130793928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55576f4d3a50 con 0x55576f1051b0 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 0x55576f4f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d5daff640 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4d2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4e51d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x55576f4f75a0 tx=0x7f6d54009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d9eb3d9c623a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d42ffd640 1 -- 172.21.15.92:0/1130793928 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54015540 con 0x55576f1051b0 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d42ffd640 1 -- 172.21.15.92:0/1130793928 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d54015b70 con 0x55576f1051b0 2024-09-21T07:16:01.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.863+0000 7f6d42ffd640 1 -- 172.21.15.92:0/1130793928 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d540148b0 con 0x55576f1051b0 2024-09-21T07:16:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.864+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1130793928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 msgr2=0x55576f4e51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.864+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4e51d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x55576f4f75a0 tx=0x7f6d54009110 comp rx=0 tx=0).stop 2024-09-21T07:16:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.864+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1130793928 shutdown_connections 2024-09-21T07:16:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.864+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4d2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.864+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 0x55576f4f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.864+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/1130793928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4e51d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.864+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1130793928 >> 172.21.15.92:0/1130793928 conn(0x55576f122460 msgr2=0x55576f4e4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.864+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1130793928 shutdown_connections 2024-09-21T07:16:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.864+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1130793928 wait complete. 2024-09-21T07:16:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.864+0000 7f6d65ad6740 1 -- start start 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d65ad6740 1 Processor -- start 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 0x55576f4ed500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d65ad6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581b0220 con 0x55576f1051b0 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581afb50 con 0x55576f12e070 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d65ad6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581acd90 con 0x55576f10d390 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d65ad6740 10 client.0 _ll_register_callbacks cb 0x7f6d48010690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d5d2fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d5d2fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4ecfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54790/0 (socket says 172.21.15.92:54790) 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d5d2fe640 1 -- 172.21.15.92:0/1651404778 learned_addr learned my addr 172.21.15.92:0/1651404778 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 0x55576f4ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d5d2fe640 1 -- 172.21.15.92:0/1651404778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 msgr2=0x55576f4ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:01.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 0x55576f4ed500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d5daff640 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d5d2fe640 1 -- 172.21.15.92:0/1651404778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 msgr2=0x55576f4e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.865+0000 7f6d5d2fe640 1 -- 172.21.15.92:0/1651404778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55576f4e84b0 con 0x55576f1051b0 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d5daff640 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d5d2fe640 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4ecfc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6d54004700 tx=0x7f6d54015f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832ca3a842a898a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d40ff9640 1 -- 172.21.15.92:0/1651404778 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5402d070 con 0x55576f1051b0 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d40ff9640 1 -- 172.21.15.92:0/1651404778 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6d540158c0 con 0x55576f1051b0 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1651404778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d54015b70 con 0x55576f1051b0 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d40ff9640 1 -- 172.21.15.92:0/1651404778 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6d54026420 con 0x55576f1051b0 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d65ad6740 10 client.16611 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1651404778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55576f561de0 con 0x55576f1051b0 2024-09-21T07:16:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d40ff9640 1 -- 172.21.15.92:0/1651404778 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d54015b70 con 0x55576f1051b0 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.866+0000 7f6d40ff9640 1 -- 172.21.15.92:0/1651404778 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6d540145d0 con 0x55576f1051b0 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.867+0000 7f6d65ad6740 10 client.16611 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.867+0000 7f6d65ad6740 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.867+0000 7f6d65ad6740 20 client.16611 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.867+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55576f0c1da0 0x55576f5644e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.867+0000 7f6d65ad6740 4 client.16611 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.867+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1651404778 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55576f449850 con 0x55576f0c1da0 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.867+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55576f0c1da0 0x55576f5644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.867+0000 7f6d5cafd640 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55576f0c1da0 0x55576f5644e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=718e7c373cc20b45 server_cookie=1cbdb1c960cfdfe1 in_seq=0 out_seq=0 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.867+0000 7f6d40ff9640 10 client.16611 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d40ff9640 1 -- 172.21.15.92:0/1651404778 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x55576f449850 con 0x55576f0c1da0 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d40ff9640 10 client.16611 handle_command_reply: tid=0 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 client.16611 shutdown 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1651404778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 msgr2=0x55576f4ecfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4ecfc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6d54004700 tx=0x7f6d54015f60 comp rx=0 tx=0).stop 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1651404778 shutdown_connections 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55576f0c1da0 0x55576f5644e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55576f12e070 0x55576f4e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55576f10d390 0x55576f4ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 --2- 172.21.15.92:0/1651404778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55576f1051b0 0x55576f4ecfc0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1651404778 >> 172.21.15.92:0/1651404778 conn(0x55576f122460 msgr2=0x55576f4d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d40ff9640 0 client.16611 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1651404778 shutdown_connections 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 1 -- 172.21.15.92:0/1651404778 wait complete. 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.868+0000 7f6d65ad6740 20 client.16611 trim_cache size 0 max 16384 2024-09-21T07:16:01.874 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "40c1cdf7-9a11-43e9-af28-0a82c962cfb4", 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:01.875 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:16:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:01.877 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:01.878 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:16:01.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 -- 172.21.15.92:0/2896575746 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6d440b6680 msgr2=0x7f6d440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:01.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6d440b6680 0x7f6d440b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6d50049000 tx=0x7f6d5004a000 comp rx=0 tx=0).stop 2024-09-21T07:16:01.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 -- 172.21.15.92:0/2896575746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d58105300 msgr2=0x7f6d5819aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:01.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d58105300 0x7f6d5819aa90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6d48006fd0 tx=0x7f6d4800b820 comp rx=0 tx=0).stop 2024-09-21T07:16:01.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 -- 172.21.15.92:0/2896575746 shutdown_connections 2024-09-21T07:16:01.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6d440b6680 0x7f6d440b8b90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d5810de10 0x7f6d5819fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d58105300 0x7f6d5819aa90 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 --2- 172.21.15.92:0/2896575746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d581049b0 0x7f6d5819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:01.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 -- 172.21.15.92:0/2896575746 >> 172.21.15.92:0/2896575746 conn(0x7f6d58079730 msgr2=0x7f6d580ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:01.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 -- 172.21.15.92:0/2896575746 shutdown_connections 2024-09-21T07:16:01.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:01.869+0000 7f6d5f562640 1 -- 172.21.15.92:0/2896575746 wait complete. 2024-09-21T07:16:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:01 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:16:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:01 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:01 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:16:02.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:01 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:01 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:16:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:01 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:01 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:16:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:01 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:02.608 INFO:tasks.cephfs.filesystem:scrub status for tag:40c1cdf7-9a11-43e9-af28-0a82c962cfb4 - {'path': '/', 'tag': '40c1cdf7-9a11-43e9-af28-0a82c962cfb4', 'options': 'recursive,force'} 2024-09-21T07:16:02.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:02 smithi092 ceph-mon[30987]: pgmap v428: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T07:16:03.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:02 smithi175 ceph-mon[34064]: pgmap v428: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T07:16:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:02 smithi169 ceph-mon[33705]: pgmap v428: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T07:16:04.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:03 smithi092 ceph-mon[30987]: pgmap v429: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 27 op/s 2024-09-21T07:16:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:03 smithi169 ceph-mon[33705]: pgmap v429: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 27 op/s 2024-09-21T07:16:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:03 smithi175 ceph-mon[34064]: pgmap v429: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 27 op/s 2024-09-21T07:16:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.263+0000 7f0aebe38640 1 -- 172.21.15.92:0/3325445169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ae41082e0 msgr2=0x7f0ae41086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.263+0000 7f0aebe38640 1 --2- 172.21.15.92:0/3325445169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ae41082e0 0x7f0ae41086f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009900 tx=0x7f0ad402a410 comp rx=0 tx=0).stop 2024-09-21T07:16:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.263+0000 7f0aebe38640 1 -- 172.21.15.92:0/3325445169 shutdown_connections 2024-09-21T07:16:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.263+0000 7f0aebe38640 1 --2- 172.21.15.92:0/3325445169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae4108c30 0x7f0ae410f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.263+0000 7f0aebe38640 1 --2- 172.21.15.92:0/3325445169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ae41082e0 0x7f0ae41086f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.263+0000 7f0aebe38640 1 --2- 172.21.15.92:0/3325445169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ae41029b0 0x7f0ae4102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.263+0000 7f0aebe38640 1 -- 172.21.15.92:0/3325445169 >> 172.21.15.92:0/3325445169 conn(0x7f0ae407a740 msgr2=0x7f0ae407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.263+0000 7f0aebe38640 1 -- 172.21.15.92:0/3325445169 shutdown_connections 2024-09-21T07:16:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.263+0000 7f0aebe38640 1 -- 172.21.15.92:0/3325445169 wait complete. 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aebe38640 1 Processor -- start 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aebe38640 1 -- start start 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aebe38640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ae41029b0 0x7f0ae41992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aebe38640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae41082e0 0x7f0ae4199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aebe38640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ae4108c30 0x7f0ae419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aebe38640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41127a0 con 0x7f0ae4108c30 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aebe38640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4112620 con 0x7f0ae41029b0 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aebe38640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4112920 con 0x7f0ae41082e0 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aea3d5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ae4108c30 0x7f0ae419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aea3d5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ae4108c30 0x7f0ae419eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54808/0 (socket says 172.21.15.92:54808) 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aea3d5640 1 -- 172.21.15.92:0/26312513 learned_addr learned my addr 172.21.15.92:0/26312513 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae41082e0 0x7f0ae4199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aea3d5640 1 -- 172.21.15.92:0/26312513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae41082e0 msgr2=0x7f0ae4199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0aea3d5640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae41082e0 0x7f0ae4199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.264+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ae41029b0 0x7f0ae41992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0aea3d5640 1 -- 172.21.15.92:0/26312513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ae41029b0 msgr2=0x7f0ae41992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0aea3d5640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ae41029b0 0x7f0ae41992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0aea3d5640 1 -- 172.21.15.92:0/26312513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae419f210 con 0x7f0ae4108c30 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae41082e0 0x7f0ae4199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ae41029b0 0x7f0ae41992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0aea3d5640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ae4108c30 0x7f0ae419eb10 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00eaa0 tx=0x7f0adc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0adaffd640 1 -- 172.21.15.92:0/26312513 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00cdb0 con 0x7f0ae4108c30 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0adaffd640 1 -- 172.21.15.92:0/26312513 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0adc005020 con 0x7f0ae4108c30 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0aebe38640 1 -- 172.21.15.92:0/26312513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae419f500 con 0x7f0ae4108c30 2024-09-21T07:16:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0adaffd640 1 -- 172.21.15.92:0/26312513 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0116d0 con 0x7f0ae4108c30 2024-09-21T07:16:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.265+0000 7f0aebe38640 1 -- 172.21.15.92:0/26312513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae41a5c90 con 0x7f0ae4108c30 2024-09-21T07:16:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.268+0000 7f0af2e84740 1 Processor -- start 2024-09-21T07:16:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.268+0000 7f0adaffd640 1 -- 172.21.15.92:0/26312513 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f0adc011870 con 0x7f0ae4108c30 2024-09-21T07:16:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0af2e84740 1 -- start start 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626517631b0 0x562651b089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b08ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b09430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0af2e84740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562651a7d6f0 con 0x56265173a2f0 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0af2e84740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562651a6cb20 con 0x5626517424d0 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0af2e84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562651a70930 con 0x5626517631b0 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0ae9bd4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b08ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0ae9bd4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b08ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54820/0 (socket says 172.21.15.92:54820) 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0ae9bd4640 1 -- 172.21.15.92:0/605680109 learned_addr learned my addr 172.21.15.92:0/605680109 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/605680109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626517631b0 0x562651b089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/605680109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b09430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0adaffd640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0ad00b6680 0x7f0ad00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0ae9bd4640 1 -- 172.21.15.92:0/605680109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626517631b0 msgr2=0x562651b089b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/605680109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626517631b0 0x562651b089b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0ae9bd4640 1 -- 172.21.15.92:0/605680109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 msgr2=0x562651b09430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/605680109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b09430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.269+0000 7f0ae9bd4640 1 -- 172.21.15.92:0/605680109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562651a32530 con 0x56265173a2f0 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.270+0000 7f0aea3d5640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0ad00b6680 0x7f0ad00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.270+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/605680109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b08ef0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009c50 tx=0x7f0ae000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531743c26c67798d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.270+0000 7f0adaffd640 1 -- 172.21.15.92:0/26312513 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0adc0e7ce0 con 0x7f0ae4108c30 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.270+0000 7f0acffff640 1 -- 172.21.15.92:0/605680109 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0016070 con 0x56265173a2f0 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.270+0000 7f0acffff640 1 -- 172.21.15.92:0/605680109 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ae00054b0 con 0x56265173a2f0 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.270+0000 7f0acffff640 1 -- 172.21.15.92:0/605680109 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0011470 con 0x56265173a2f0 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 -- 172.21.15.92:0/605680109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 msgr2=0x562651b08ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0aea3d5640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0ad00b6680 0x7f0ad00b8b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0ad720 tx=0x7f0adc0de230 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 --2- 172.21.15.92:0/605680109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b08ef0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009c50 tx=0x7f0ae000e6c0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 -- 172.21.15.92:0/605680109 shutdown_connections 2024-09-21T07:16:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 --2- 172.21.15.92:0/605680109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b09430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 --2- 172.21.15.92:0/605680109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b08ef0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 --2- 172.21.15.92:0/605680109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626517631b0 0x562651b089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 -- 172.21.15.92:0/605680109 >> 172.21.15.92:0/605680109 conn(0x562651757300 msgr2=0x562651b068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 -- 172.21.15.92:0/605680109 shutdown_connections 2024-09-21T07:16:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 -- 172.21.15.92:0/605680109 wait complete. 2024-09-21T07:16:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 -- start start 2024-09-21T07:16:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.271+0000 7f0af2e84740 1 Processor -- start 2024-09-21T07:16:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56265173a2f0 0x562651b14030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626517424d0 0x562651b14570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626517631b0 0x562651b20420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0af2e84740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5626519a4ab0 con 0x5626517631b0 2024-09-21T07:16:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0af2e84740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562651a12730 con 0x56265173a2f0 2024-09-21T07:16:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0af2e84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562651b17130 con 0x5626517424d0 2024-09-21T07:16:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0af2e84740 10 client.0 _ll_register_callbacks cb 0x562651a666b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae93d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626517631b0 0x562651b20420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae93d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626517631b0 0x562651b20420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54824/0 (socket says 172.21.15.92:54824) 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae93d3640 1 -- 172.21.15.92:0/804094998 learned_addr learned my addr 172.21.15.92:0/804094998 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626517424d0 0x562651b14570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56265173a2f0 0x562651b14030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae93d3640 1 -- 172.21.15.92:0/804094998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626517424d0 msgr2=0x562651b14570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626517424d0 0x562651b14570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae93d3640 1 -- 172.21.15.92:0/804094998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56265173a2f0 msgr2=0x562651b14030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56265173a2f0 0x562651b14030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae93d3640 1 -- 172.21.15.92:0/804094998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626517ce790 con 0x5626517631b0 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626517631b0 0x562651b20420 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4005760 tx=0x7f0ad40056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caeb998d37b0ea64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.272+0000 7f0acd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0acd7fa640 1 -- 172.21.15.92:0/804094998 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4035040 con 0x5626517631b0 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0acd7fa640 1 -- 172.21.15.92:0/804094998 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0ad4004450 con 0x5626517631b0 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0af2e84740 1 -- 172.21.15.92:0/804094998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ae00054b0 con 0x5626517631b0 2024-09-21T07:16:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0acd7fa640 1 -- 172.21.15.92:0/804094998 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ad4051050 con 0x5626517631b0 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0af2e84740 10 client.16623 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0af2e84740 1 -- 172.21.15.92:0/804094998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562651847620 con 0x5626517631b0 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0acd7fa640 1 -- 172.21.15.92:0/804094998 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ae00054b0 con 0x5626517631b0 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0acd7fa640 1 -- 172.21.15.92:0/804094998 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0ad403a040 con 0x5626517631b0 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0af2e84740 10 client.16623 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0af2e84740 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0af2e84740 20 client.16623 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0af2e84740 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562651721d80 0x562651b26110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0af2e84740 4 client.16623 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.273+0000 7f0af2e84740 1 -- 172.21.15.92:0/804094998 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562651a7f640 con 0x562651721d80 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.274+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562651721d80 0x562651b26110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.274+0000 7f0acd7fa640 10 client.16623 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.274+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562651721d80 0x562651b26110 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a23034e18d193a9 server_cookie=3d5cef93cb76bf06 in_seq=0 out_seq=0 2024-09-21T07:16:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0acd7fa640 1 -- 172.21.15.92:0/804094998 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562651a7f640 con 0x562651721d80 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0acd7fa640 10 client.16623 handle_command_reply: tid=0 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 client.16623 shutdown 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 -- 172.21.15.92:0/804094998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626517631b0 msgr2=0x562651b20420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626517631b0 0x562651b20420 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4005760 tx=0x7f0ad40056d0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 -- 172.21.15.92:0/804094998 shutdown_connections 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562651721d80 0x562651b26110 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626517631b0 0x562651b20420 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0acd7fa640 0 client.16623 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626517424d0 0x562651b14570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 --2- 172.21.15.92:0/804094998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56265173a2f0 0x562651b14030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 -- 172.21.15.92:0/804094998 >> 172.21.15.92:0/804094998 conn(0x562651757300 msgr2=0x562651b099e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 -- 172.21.15.92:0/804094998 shutdown_connections 2024-09-21T07:16:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 1 -- 172.21.15.92:0/804094998 wait complete. 2024-09-21T07:16:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.275+0000 7f0af2e84740 20 client.16623 trim_cache size 0 max 16384 2024-09-21T07:16:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.290+0000 7f0af2e84740 1 Processor -- start 2024-09-21T07:16:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.290+0000 7f0af2e84740 1 -- start start 2024-09-21T07:16:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562651721d80 0x562651b14510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b0a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b15c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0af2e84740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41afe90 con 0x56265173a2f0 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0af2e84740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41b19d0 con 0x5626517424d0 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0af2e84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41b0560 con 0x562651721d80 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae9bd4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b0a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae9bd4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b0a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54828/0 (socket says 172.21.15.92:54828) 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae9bd4640 1 -- 172.21.15.92:0/3281342039 learned_addr learned my addr 172.21.15.92:0/3281342039 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae9bd4640 1 -- 172.21.15.92:0/3281342039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562651721d80 msgr2=0x562651b14510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/3281342039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562651721d80 0x562651b14510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae9bd4640 1 -- 172.21.15.92:0/3281342039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 msgr2=0x562651b15c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/3281342039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b15c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/3281342039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b15c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae9bd4640 1 -- 172.21.15.92:0/3281342039 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562651b12510 con 0x56265173a2f0 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/3281342039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b15c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/3281342039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b0a3a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009c50 tx=0x7f0ae0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3eb0f800ae464dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.291+0000 7f0acf7fe640 1 -- 172.21.15.92:0/3281342039 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0032070 con 0x56265173a2f0 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0acf7fe640 1 -- 172.21.15.92:0/3281342039 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ae0004c00 con 0x56265173a2f0 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0acf7fe640 1 -- 172.21.15.92:0/3281342039 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0016040 con 0x56265173a2f0 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0af2e84740 1 -- 172.21.15.92:0/3281342039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 msgr2=0x562651b0a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0af2e84740 1 --2- 172.21.15.92:0/3281342039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b0a3a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009c50 tx=0x7f0ae0005850 comp rx=0 tx=0).stop 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0af2e84740 1 -- 172.21.15.92:0/3281342039 shutdown_connections 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0af2e84740 1 --2- 172.21.15.92:0/3281342039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b15c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0af2e84740 1 --2- 172.21.15.92:0/3281342039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56265173a2f0 0x562651b0a3a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0af2e84740 1 --2- 172.21.15.92:0/3281342039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562651721d80 0x562651b14510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0af2e84740 1 -- 172.21.15.92:0/3281342039 >> 172.21.15.92:0/3281342039 conn(0x562651757300 msgr2=0x562651b15550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0af2e84740 1 -- 172.21.15.92:0/3281342039 shutdown_connections 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.292+0000 7f0af2e84740 1 -- 172.21.15.92:0/3281342039 wait complete. 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.293+0000 7f0af2e84740 1 -- start start 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.293+0000 7f0af2e84740 1 Processor -- start 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.293+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562651721d80 0x562651b1cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.293+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56265173a2f0 0x562651b1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.293+0000 7f0af2e84740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b1a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.293+0000 7f0af2e84740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41b1300 con 0x562651721d80 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.293+0000 7f0af2e84740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41b0c30 con 0x5626517424d0 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.293+0000 7f0af2e84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41ade70 con 0x56265173a2f0 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.293+0000 7f0af2e84740 10 client.0 _ll_register_callbacks cb 0x7f0ad4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.293+0000 7f0ae93d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562651721d80 0x562651b1cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0ae93d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562651721d80 0x562651b1cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54842/0 (socket says 172.21.15.92:54842) 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0ae93d3640 1 -- 172.21.15.92:0/2264841623 learned_addr learned my addr 172.21.15.92:0/2264841623 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b1a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56265173a2f0 0x562651b1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0ae93d3640 1 -- 172.21.15.92:0/2264841623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56265173a2f0 msgr2=0x562651b1a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56265173a2f0 0x562651b1a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0ae93d3640 1 -- 172.21.15.92:0/2264841623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 msgr2=0x562651b1a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b1a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0ae93d3640 1 -- 172.21.15.92:0/2264841623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562651b1adc0 con 0x562651721d80 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0ae93d3640 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562651721d80 0x562651b1cbd0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40096c0 tx=0x7f0ad402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b0b5869bf9fdf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0acd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0acd7fa640 1 -- 172.21.15.92:0/2264841623 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad404e040 con 0x562651721d80 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0acd7fa640 1 -- 172.21.15.92:0/2264841623 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0ad4048a10 con 0x562651721d80 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0af2e84740 1 -- 172.21.15.92:0/2264841623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ae0004c00 con 0x562651721d80 2024-09-21T07:16:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0acd7fa640 1 -- 172.21.15.92:0/2264841623 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ad4035040 con 0x562651721d80 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0af2e84740 10 client.16629 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0af2e84740 1 -- 172.21.15.92:0/2264841623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562651b90a10 con 0x562651721d80 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.294+0000 7f0acd7fa640 1 -- 172.21.15.92:0/2264841623 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ae0004c00 con 0x562651721d80 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.295+0000 7f0acd7fa640 1 -- 172.21.15.92:0/2264841623 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0ad40046c0 con 0x562651721d80 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.295+0000 7f0af2e84740 10 client.16629 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.295+0000 7f0af2e84740 10 client.16629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.295+0000 7f0af2e84740 20 client.16629 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.295+0000 7f0af2e84740 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626517631b0 0x562651b93200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.295+0000 7f0af2e84740 4 client.16629 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.295+0000 7f0af2e84740 1 -- 172.21.15.92:0/2264841623 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562651a7b0f0 con 0x5626517631b0 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.295+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626517631b0 0x562651b93200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.295+0000 7f0acd7fa640 10 client.16629 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.295+0000 7f0ae9bd4640 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626517631b0 0x562651b93200 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8e0e795e788745f server_cookie=c69ff2b2437099ae in_seq=0 out_seq=0 2024-09-21T07:16:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.301+0000 7f0acd7fa640 1 -- 172.21.15.92:0/2264841623 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562651a7b0f0 con 0x5626517631b0 2024-09-21T07:16:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.301+0000 7f0acd7fa640 10 client.16629 handle_command_reply: tid=0 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.301+0000 7f0af2e84740 1 client.16629 shutdown 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 1 -- 172.21.15.92:0/2264841623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562651721d80 msgr2=0x562651b1cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562651721d80 0x562651b1cbd0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40096c0 tx=0x7f0ad402a410 comp rx=0 tx=0).stop 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 1 -- 172.21.15.92:0/2264841623 shutdown_connections 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5626517631b0 0x562651b93200 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626517424d0 0x562651b1a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56265173a2f0 0x562651b1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 1 --2- 172.21.15.92:0/2264841623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562651721d80 0x562651b1cbd0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0acd7fa640 0 client.16629 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 1 -- 172.21.15.92:0/2264841623 >> 172.21.15.92:0/2264841623 conn(0x562651757300 msgr2=0x562651b0a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 1 -- 172.21.15.92:0/2264841623 shutdown_connections 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 1 -- 172.21.15.92:0/2264841623 wait complete. 2024-09-21T07:16:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0af2e84740 20 client.16629 trim_cache size 0 max 16384 2024-09-21T07:16:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:16:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:16:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:16:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0aebe38640 1 -- 172.21.15.92:0/26312513 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0ad00b6680 msgr2=0x7f0ad00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0aebe38640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0ad00b6680 0x7f0ad00b8b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0ad720 tx=0x7f0adc0de230 comp rx=0 tx=0).stop 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0aebe38640 1 -- 172.21.15.92:0/26312513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ae4108c30 msgr2=0x7f0ae419eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0aebe38640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ae4108c30 0x7f0ae419eb10 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00eaa0 tx=0x7f0adc00ef60 comp rx=0 tx=0).stop 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0aebe38640 1 -- 172.21.15.92:0/26312513 shutdown_connections 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0aebe38640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0ad00b6680 0x7f0ad00b8b90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0aebe38640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ae4108c30 0x7f0ae419eb10 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0aebe38640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae41082e0 0x7f0ae4199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0aebe38640 1 --2- 172.21.15.92:0/26312513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ae41029b0 0x7f0ae41992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.302+0000 7f0aebe38640 1 -- 172.21.15.92:0/26312513 >> 172.21.15.92:0/26312513 conn(0x7f0ae407a740 msgr2=0x7f0ae4106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.303+0000 7f0aebe38640 1 -- 172.21.15.92:0/26312513 shutdown_connections 2024-09-21T07:16:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:06.303+0000 7f0aebe38640 1 -- 172.21.15.92:0/26312513 wait complete. 2024-09-21T07:16:07.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:06 smithi175 ceph-mon[34064]: pgmap v430: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T07:16:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:06 smithi092 ceph-mon[30987]: pgmap v430: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T07:16:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:06 smithi169 ceph-mon[33705]: pgmap v430: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T07:16:09.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:08 smithi175 ceph-mon[34064]: pgmap v431: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-09-21T07:16:09.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:08 smithi092 ceph-mon[30987]: pgmap v431: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-09-21T07:16:09.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:08 smithi169 ceph-mon[33705]: pgmap v431: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-09-21T07:16:11.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:10 smithi175 ceph-mon[34064]: pgmap v432: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-21T07:16:11.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:10 smithi092 ceph-mon[30987]: pgmap v432: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-21T07:16:11.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:10 smithi169 ceph-mon[33705]: pgmap v432: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-21T07:16:12.577 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:16:12.827 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:12.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:12 smithi092 ceph-mon[30987]: pgmap v433: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-21T07:16:13.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:12 smithi175 ceph-mon[34064]: pgmap v433: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-21T07:16:13.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:12 smithi169 ceph-mon[33705]: pgmap v433: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-21T07:16:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.322+0000 7f870b496640 1 -- 172.21.15.92:0/246005601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8704105300 msgr2=0x7f870410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.322+0000 7f870b496640 1 --2- 172.21.15.92:0/246005601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8704105300 0x7f870410d850 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009900 tx=0x7f86f402a410 comp rx=0 tx=0).stop 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.322+0000 7f870b496640 1 -- 172.21.15.92:0/246005601 shutdown_connections 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.322+0000 7f870b496640 1 --2- 172.21.15.92:0/246005601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f870410de10 0x7f8704110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.322+0000 7f870b496640 1 --2- 172.21.15.92:0/246005601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8704105300 0x7f870410d850 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.322+0000 7f870b496640 1 --2- 172.21.15.92:0/246005601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87041049b0 0x7f8704104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.322+0000 7f870b496640 1 -- 172.21.15.92:0/246005601 >> 172.21.15.92:0/246005601 conn(0x7f8704079730 msgr2=0x7f8704079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.323+0000 7f870b496640 1 -- 172.21.15.92:0/246005601 shutdown_connections 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.323+0000 7f870b496640 1 -- 172.21.15.92:0/246005601 wait complete. 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.323+0000 7f870b496640 1 Processor -- start 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.323+0000 7f870b496640 1 -- start start 2024-09-21T07:16:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.323+0000 7f870b496640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87041049b0 0x7f870419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.323+0000 7f870b496640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8704105300 0x7f870419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.323+0000 7f870b496640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f870410de10 0x7f870419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.323+0000 7f870b496640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8704113920 con 0x7f8704105300 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.323+0000 7f870b496640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f87041137a0 con 0x7f870410de10 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.323+0000 7f870b496640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8704113aa0 con 0x7f87041049b0 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8708a31640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8704105300 0x7f870419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8708a31640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8704105300 0x7f870419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39076/0 (socket says 172.21.15.92:39076) 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8708a31640 1 -- 172.21.15.92:0/297580730 learned_addr learned my addr 172.21.15.92:0/297580730 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8709232640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87041049b0 0x7f870419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8709a33640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f870410de10 0x7f870419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8708a31640 1 -- 172.21.15.92:0/297580730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87041049b0 msgr2=0x7f870419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8708a31640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87041049b0 0x7f870419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8708a31640 1 -- 172.21.15.92:0/297580730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f870410de10 msgr2=0x7f870419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8708a31640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f870410de10 0x7f870419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8708a31640 1 -- 172.21.15.92:0/297580730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87041a0380 con 0x7f8704105300 2024-09-21T07:16:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8709a33640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f870410de10 0x7f870419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f8708a31640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8704105300 0x7f870419a9b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005940 tx=0x7f86f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f86fa7fc640 1 -- 172.21.15.92:0/297580730 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f403f030 con 0x7f8704105300 2024-09-21T07:16:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f86fa7fc640 1 -- 172.21.15.92:0/297580730 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86f4003c90 con 0x7f8704105300 2024-09-21T07:16:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f86fa7fc640 1 -- 172.21.15.92:0/297580730 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4035070 con 0x7f8704105300 2024-09-21T07:16:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.324+0000 7f870b496640 1 -- 172.21.15.92:0/297580730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87041a0610 con 0x7f8704105300 2024-09-21T07:16:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.325+0000 7f870b496640 1 -- 172.21.15.92:0/297580730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87041a6dd0 con 0x7f8704105300 2024-09-21T07:16:13.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.325+0000 7f870b496640 1 -- 172.21.15.92:0/297580730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8704104dc0 con 0x7f8704105300 2024-09-21T07:16:13.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.327+0000 7f86fa7fc640 1 -- 172.21.15.92:0/297580730 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f86f4042030 con 0x7f8704105300 2024-09-21T07:16:13.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.328+0000 7f86fa7fc640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86f00b6700 0x7f86f00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:13.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.328+0000 7f8709232640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86f00b6700 0x7f86f00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:13.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.328+0000 7f86fa7fc640 1 -- 172.21.15.92:0/297580730 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f86f41083a0 con 0x7f8704105300 2024-09-21T07:16:13.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.328+0000 7f8709232640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86f00b6700 0x7f86f00b8c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f87000058c0 tx=0x7f870000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:13.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.331+0000 7f86fa7fc640 1 -- 172.21.15.92:0/297580730 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86f40ce550 con 0x7f8704105300 2024-09-21T07:16:13.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.560+0000 7f870b496640 1 -- 172.21.15.92:0/297580730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f870419b540 con 0x7f8704105300 2024-09-21T07:16:13.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.561+0000 7f86fa7fc640 1 -- 172.21.15.92:0/297580730 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f86f40d2930 con 0x7f8704105300 2024-09-21T07:16:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:16:13.563 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:16:13.564 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 -- 172.21.15.92:0/297580730 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86f00b6700 msgr2=0x7f86f00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86f00b6700 0x7f86f00b8c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f87000058c0 tx=0x7f870000a2d0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 -- 172.21.15.92:0/297580730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8704105300 msgr2=0x7f870419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8704105300 0x7f870419a9b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005940 tx=0x7f86f40042f0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 -- 172.21.15.92:0/297580730 shutdown_connections 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86f00b6700 0x7f86f00b8c10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f870410de10 0x7f870419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8704105300 0x7f870419a9b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 --2- 172.21.15.92:0/297580730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87041049b0 0x7f870419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 -- 172.21.15.92:0/297580730 >> 172.21.15.92:0/297580730 conn(0x7f8704079730 msgr2=0x7f87041009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 -- 172.21.15.92:0/297580730 shutdown_connections 2024-09-21T07:16:13.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:13.564+0000 7f870b496640 1 -- 172.21.15.92:0/297580730 wait complete. 2024-09-21T07:16:13.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:13 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/297580730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:14.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:13 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/297580730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:13 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/297580730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:14.359 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24649 quiesce db --set-id 3f0d4d53 --release --await' 2024-09-21T07:16:14.359 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24649 quiesce db --set-id 3f0d4d53 --release --await 2024-09-21T07:16:14.605 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:14 smithi092 ceph-mon[30987]: pgmap v434: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T07:16:15.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:14 smithi175 ceph-mon[34064]: pgmap v434: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T07:16:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.100+0000 7ff46a1f5640 1 -- 172.21.15.92:0/1530327846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4641083a0 msgr2=0x7ff4641087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.100+0000 7ff46a1f5640 1 --2- 172.21.15.92:0/1530327846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4641083a0 0x7ff4641087b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff458009900 tx=0x7ff45802a410 comp rx=0 tx=0).stop 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.100+0000 7ff46a1f5640 1 -- 172.21.15.92:0/1530327846 shutdown_connections 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.100+0000 7ff46a1f5640 1 --2- 172.21.15.92:0/1530327846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff464108cf0 0x7ff46410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.100+0000 7ff46a1f5640 1 --2- 172.21.15.92:0/1530327846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4641083a0 0x7ff4641087b0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.100+0000 7ff46a1f5640 1 --2- 172.21.15.92:0/1530327846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff464102a60 0x7ff464102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.100+0000 7ff46a1f5640 1 -- 172.21.15.92:0/1530327846 >> 172.21.15.92:0/1530327846 conn(0x7ff464079730 msgr2=0x7ff464079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.100+0000 7ff46a1f5640 1 -- 172.21.15.92:0/1530327846 shutdown_connections 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.101+0000 7ff46a1f5640 1 -- 172.21.15.92:0/1530327846 wait complete. 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.101+0000 7ff46a1f5640 1 Processor -- start 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.101+0000 7ff46a1f5640 1 -- start start 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff46a1f5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff464102a60 0x7ff46419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff46a1f5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4641083a0 0x7ff46419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff46a1f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff464108cf0 0x7ff4641a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff46a1f5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff464112810 con 0x7ff4641083a0 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff46a1f5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff464112690 con 0x7ff464108cf0 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff46a1f5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff464112990 con 0x7ff464102a60 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4641083a0 0x7ff46419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4641083a0 0x7ff46419cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39102/0 (socket says 172.21.15.92:39102) 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff462ffd640 1 -- 172.21.15.92:0/3928182782 learned_addr learned my addr 172.21.15.92:0/3928182782 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff463fff640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff464108cf0 0x7ff4641a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff4637fe640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff464102a60 0x7ff46419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff462ffd640 1 -- 172.21.15.92:0/3928182782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff464102a60 msgr2=0x7ff46419c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff462ffd640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff464102a60 0x7ff46419c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff462ffd640 1 -- 172.21.15.92:0/3928182782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff464108cf0 msgr2=0x7ff4641a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff462ffd640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff464108cf0 0x7ff4641a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff462ffd640 1 -- 172.21.15.92:0/3928182782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4641a2520 con 0x7ff4641083a0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.102+0000 7ff462ffd640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4641083a0 0x7ff46419cb50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff458005940 tx=0x7ff4580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.103+0000 7ff460ff9640 1 -- 172.21.15.92:0/3928182782 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45803f030 con 0x7ff4641083a0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.103+0000 7ff460ff9640 1 -- 172.21.15.92:0/3928182782 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff458003c90 con 0x7ff4641083a0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.103+0000 7ff46a1f5640 1 -- 172.21.15.92:0/3928182782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4641a27b0 con 0x7ff4641083a0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.103+0000 7ff460ff9640 1 -- 172.21.15.92:0/3928182782 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458035070 con 0x7ff4641083a0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.103+0000 7ff46a1f5640 1 -- 172.21.15.92:0/3928182782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4641a8f70 con 0x7ff4641083a0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.105+0000 7ff460ff9640 1 -- 172.21.15.92:0/3928182782 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7ff458042030 con 0x7ff4641083a0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.106+0000 7ff460ff9640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff44c0b6680 0x7ff44c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.106+0000 7ff4637fe640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff44c0b6680 0x7ff44c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.106+0000 7ff460ff9640 1 -- 172.21.15.92:0/3928182782 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff458107fd0 con 0x7ff4641083a0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.106+0000 7ff470769740 1 Processor -- start 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.106+0000 7ff470769740 1 -- start start 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff4637fe640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff44c0b6680 0x7ff44c0b8b90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff4540058c0 tx=0x7ff45400a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff470769740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419ec520 0x562041d92510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff470769740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419c3660 0x562041d92a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff470769740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419cb840 0x562041d92f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff470769740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562041c7ddc0 con 0x5620419c3660 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff470769740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562041d0a1f0 con 0x5620419cb840 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff470769740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562041cf9620 con 0x5620419ec520 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419c3660 0x562041d92a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419c3660 0x562041d92a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39108/0 (socket says 172.21.15.92:39108) 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff462ffd640 1 -- 172.21.15.92:0/4243066237 learned_addr learned my addr 172.21.15.92:0/4243066237 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff4637fe640 1 --2- 172.21.15.92:0/4243066237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419ec520 0x562041d92510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff463fff640 1 --2- 172.21.15.92:0/4243066237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419cb840 0x562041d92f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff462ffd640 1 -- 172.21.15.92:0/4243066237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419ec520 msgr2=0x562041d92510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff462ffd640 1 --2- 172.21.15.92:0/4243066237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419ec520 0x562041d92510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff462ffd640 1 -- 172.21.15.92:0/4243066237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419cb840 msgr2=0x562041d92f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:15.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff462ffd640 1 --2- 172.21.15.92:0/4243066237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419cb840 0x562041d92f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff462ffd640 1 -- 172.21.15.92:0/4243066237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562041cc1fd0 con 0x5620419c3660 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.107+0000 7ff462ffd640 1 --2- 172.21.15.92:0/4243066237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419c3660 0x562041d92a50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff458005760 tx=0x7ff4580cd420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45da5fe47032f3cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.108+0000 7ff449ffb640 1 -- 172.21.15.92:0/4243066237 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458049070 con 0x5620419c3660 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.108+0000 7ff449ffb640 1 -- 172.21.15.92:0/4243066237 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff458003e40 con 0x5620419c3660 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.108+0000 7ff449ffb640 1 -- 172.21.15.92:0/4243066237 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4581055a0 con 0x5620419c3660 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 -- 172.21.15.92:0/4243066237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419c3660 msgr2=0x562041d92a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 --2- 172.21.15.92:0/4243066237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419c3660 0x562041d92a50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff458005760 tx=0x7ff4580cd420 comp rx=0 tx=0).stop 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 -- 172.21.15.92:0/4243066237 shutdown_connections 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 --2- 172.21.15.92:0/4243066237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419cb840 0x562041d92f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 --2- 172.21.15.92:0/4243066237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419c3660 0x562041d92a50 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 --2- 172.21.15.92:0/4243066237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419ec520 0x562041d92510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 -- 172.21.15.92:0/4243066237 >> 172.21.15.92:0/4243066237 conn(0x5620419e0910 msgr2=0x562041d90400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 -- 172.21.15.92:0/4243066237 shutdown_connections 2024-09-21T07:16:15.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 -- 172.21.15.92:0/4243066237 wait complete. 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 -- start start 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.109+0000 7ff470769740 1 Processor -- start 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff470769740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419c3660 0x562041d9db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff470769740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041d9e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff470769740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 0x562041d9e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff470769740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562041c94300 con 0x5620419cb840 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff470769740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562041cfd430 con 0x5620419ec520 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff470769740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562041b5abb0 con 0x5620419c3660 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff470769740 10 client.0 _ll_register_callbacks cb 0x562041cae120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041d9e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041d9e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39124/0 (socket says 172.21.15.92:39124) 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff462ffd640 1 -- 172.21.15.92:0/3847418115 learned_addr learned my addr 172.21.15.92:0/3847418115 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff4637fe640 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419c3660 0x562041d9db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff462ffd640 1 -- 172.21.15.92:0/3847418115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419c3660 msgr2=0x562041d9db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff463fff640 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 0x562041d9e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff462ffd640 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419c3660 0x562041d9db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff462ffd640 1 -- 172.21.15.92:0/3847418115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 msgr2=0x562041d9e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff462ffd640 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 0x562041d9e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff462ffd640 1 -- 172.21.15.92:0/3847418115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562041c83780 con 0x5620419cb840 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.110+0000 7ff463fff640 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 0x562041d9e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff462ffd640 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041d9e0b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff458000c00 tx=0x7ff45803b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf7b7ad829a3633 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff442ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff442ffd640 1 -- 172.21.15.92:0/3847418115 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458049050 con 0x5620419cb840 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff442ffd640 1 -- 172.21.15.92:0/3847418115 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff4580c9d40 con 0x5620419cb840 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff470769740 1 -- 172.21.15.92:0/3847418115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562041d0c140 con 0x5620419cb840 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff442ffd640 1 -- 172.21.15.92:0/3847418115 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff4580d2500 con 0x5620419cb840 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff470769740 10 client.16647 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:15.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff470769740 1 -- 172.21.15.92:0/3847418115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562041a57b00 con 0x5620419cb840 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff442ffd640 1 -- 172.21.15.92:0/3847418115 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562041d0c140 con 0x5620419cb840 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff442ffd640 1 -- 172.21.15.92:0/3847418115 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff4580d7020 con 0x5620419cb840 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff470769740 10 client.16647 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff470769740 10 client.16647 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff470769740 20 client.16647 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff470769740 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5620419aaea0 0x562041daf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff470769740 4 client.16647 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.111+0000 7ff470769740 1 -- 172.21.15.92:0/3847418115 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562041d07bf0 con 0x5620419aaea0 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.112+0000 7ff4637fe640 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5620419aaea0 0x562041daf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.112+0000 7ff4637fe640 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5620419aaea0 0x562041daf9d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75987a10848b7b23 server_cookie=cb8dac0755fef1f4 in_seq=0 out_seq=0 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.112+0000 7ff442ffd640 10 client.16647 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff442ffd640 1 -- 172.21.15.92:0/3847418115 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562041d07bf0 con 0x5620419aaea0 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff442ffd640 10 client.16647 handle_command_reply: tid=0 2024-09-21T07:16:15.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 client.16647 shutdown 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 -- 172.21.15.92:0/3847418115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 msgr2=0x562041d9e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041d9e0b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff458000c00 tx=0x7ff45803b4a0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 -- 172.21.15.92:0/3847418115 shutdown_connections 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5620419aaea0 0x562041daf9d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 0x562041d9e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041d9e0b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff442ffd640 0 client.16647 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 --2- 172.21.15.92:0/3847418115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419c3660 0x562041d9db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 -- 172.21.15.92:0/3847418115 >> 172.21.15.92:0/3847418115 conn(0x5620419e0910 msgr2=0x562041d956a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 -- 172.21.15.92:0/3847418115 shutdown_connections 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 1 -- 172.21.15.92:0/3847418115 wait complete. 2024-09-21T07:16:15.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.113+0000 7ff470769740 20 client.16647 trim_cache size 0 max 16384 2024-09-21T07:16:15.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff470769740 1 Processor -- start 2024-09-21T07:16:15.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff470769740 1 -- start start 2024-09-21T07:16:15.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff470769740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419c3660 0x562041d93bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff470769740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419cb840 0x562041d9c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff470769740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419ec520 0x562041d9fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff470769740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641b2fc0 con 0x5620419ec520 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff470769740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641b4b00 con 0x5620419c3660 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff470769740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641b3690 con 0x5620419cb840 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff463fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419ec520 0x562041d9fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff463fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419ec520 0x562041d9fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39130/0 (socket says 172.21.15.92:39130) 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.131+0000 7ff463fff640 1 -- 172.21.15.92:0/2966020913 learned_addr learned my addr 172.21.15.92:0/2966020913 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff462ffd640 1 --2- 172.21.15.92:0/2966020913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419cb840 0x562041d9c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff4637fe640 1 --2- 172.21.15.92:0/2966020913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419c3660 0x562041d93bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff463fff640 1 -- 172.21.15.92:0/2966020913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419cb840 msgr2=0x562041d9c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff463fff640 1 --2- 172.21.15.92:0/2966020913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419cb840 0x562041d9c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff463fff640 1 -- 172.21.15.92:0/2966020913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419c3660 msgr2=0x562041d93bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:15.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff463fff640 1 --2- 172.21.15.92:0/2966020913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419c3660 0x562041d93bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff463fff640 1 -- 172.21.15.92:0/2966020913 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562041ace960 con 0x5620419ec520 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff4637fe640 1 --2- 172.21.15.92:0/2966020913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419c3660 0x562041d93bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff463fff640 1 --2- 172.21.15.92:0/2966020913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419ec520 0x562041d9fa50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff45c012520 tx=0x7ff45c0129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc173be18296486 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff4497fa640 1 -- 172.21.15.92:0/2966020913 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c004b20 con 0x5620419ec520 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff4497fa640 1 -- 172.21.15.92:0/2966020913 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff45c004cc0 con 0x5620419ec520 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.132+0000 7ff4497fa640 1 -- 172.21.15.92:0/2966020913 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c010750 con 0x5620419ec520 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.133+0000 7ff470769740 1 -- 172.21.15.92:0/2966020913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419ec520 msgr2=0x562041d9fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.133+0000 7ff470769740 1 --2- 172.21.15.92:0/2966020913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419ec520 0x562041d9fa50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff45c012520 tx=0x7ff45c0129e0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.133+0000 7ff470769740 1 -- 172.21.15.92:0/2966020913 shutdown_connections 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.133+0000 7ff470769740 1 --2- 172.21.15.92:0/2966020913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419ec520 0x562041d9fa50 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.133+0000 7ff470769740 1 --2- 172.21.15.92:0/2966020913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419cb840 0x562041d9c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.133+0000 7ff470769740 1 --2- 172.21.15.92:0/2966020913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419c3660 0x562041d93bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.133+0000 7ff470769740 1 -- 172.21.15.92:0/2966020913 >> 172.21.15.92:0/2966020913 conn(0x5620419e0910 msgr2=0x562041da8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:15.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.133+0000 7ff470769740 1 -- 172.21.15.92:0/2966020913 shutdown_connections 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.133+0000 7ff470769740 1 -- 172.21.15.92:0/2966020913 wait complete. 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff470769740 1 -- start start 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff470769740 1 Processor -- start 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff470769740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419c3660 0x562041da41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff470769740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041da46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff470769740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 0x562041e193c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff470769740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641b4430 con 0x5620419cb840 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff470769740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641b3d60 con 0x5620419ec520 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff470769740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641b0fa0 con 0x5620419c3660 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff470769740 10 client.0 _ll_register_callbacks cb 0x7ff45c009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041da46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041da46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39136/0 (socket says 172.21.15.92:39136) 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.134+0000 7ff462ffd640 1 -- 172.21.15.92:0/2251676108 learned_addr learned my addr 172.21.15.92:0/2251676108 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff4637fe640 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419c3660 0x562041da41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff463fff640 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 0x562041e193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff462ffd640 1 -- 172.21.15.92:0/2251676108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419c3660 msgr2=0x562041da41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff462ffd640 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419c3660 0x562041da41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff462ffd640 1 -- 172.21.15.92:0/2251676108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 msgr2=0x562041e193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff462ffd640 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 0x562041e193c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff462ffd640 1 -- 172.21.15.92:0/2251676108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562041e19900 con 0x5620419cb840 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff462ffd640 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041da46f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff45803b510 tx=0x7ff458009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ea43700c3c84ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff442ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff442ffd640 1 -- 172.21.15.92:0/2251676108 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458049070 con 0x5620419cb840 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff442ffd640 1 -- 172.21.15.92:0/2251676108 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff4580c9040 con 0x5620419cb840 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff470769740 1 -- 172.21.15.92:0/2251676108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff45c004cc0 con 0x5620419cb840 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff442ffd640 1 -- 172.21.15.92:0/2251676108 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff4580cd240 con 0x5620419cb840 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff470769740 10 client.16653 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.135+0000 7ff470769740 1 -- 172.21.15.92:0/2251676108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562041e19900 con 0x5620419cb840 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.136+0000 7ff442ffd640 1 -- 172.21.15.92:0/2251676108 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4580c94c0 con 0x5620419cb840 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.136+0000 7ff442ffd640 1 -- 172.21.15.92:0/2251676108 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff4580e3bd0 con 0x5620419cb840 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.136+0000 7ff470769740 10 client.16653 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.136+0000 7ff470769740 10 client.16653 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.136+0000 7ff470769740 20 client.16653 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.136+0000 7ff470769740 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562041980250 0x562041e1cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.136+0000 7ff470769740 4 client.16653 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3f0d4d53", "release": true, "await": true}] 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.136+0000 7ff470769740 1 -- 172.21.15.92:0/2251676108 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3f0d4d53", "release": true, "await": true}) -- 0x7ff45c004cc0 con 0x562041980250 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.136+0000 7ff4637fe640 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562041980250 0x562041e1cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.136+0000 7ff442ffd640 10 client.16653 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.137+0000 7ff4637fe640 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562041980250 0x562041e1cee0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814533ad4774c726 server_cookie=c16d15083b4e8335 in_seq=0 out_seq=0 2024-09-21T07:16:15.149 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:14 smithi169 ceph-mon[33705]: pgmap v434: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-21T07:16:15.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.141+0000 7ff442ffd640 1 -- 172.21.15.92:0/2251676108 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7ff45c004cc0 con 0x562041980250 2024-09-21T07:16:15.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.141+0000 7ff442ffd640 10 client.16653 handle_command_reply: tid=0 2024-09-21T07:16:15.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.141+0000 7ff470769740 1 client.16653 shutdown 2024-09-21T07:16:15.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 1 -- 172.21.15.92:0/2251676108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 msgr2=0x562041da46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:15.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041da46f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff45803b510 tx=0x7ff458009560 comp rx=0 tx=0).stop 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 1 -- 172.21.15.92:0/2251676108 shutdown_connections 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562041980250 0x562041e1cee0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620419ec520 0x562041e193c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620419cb840 0x562041da46f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff442ffd640 0 client.16653 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 1 --2- 172.21.15.92:0/2251676108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620419c3660 0x562041da41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 1 -- 172.21.15.92:0/2251676108 >> 172.21.15.92:0/2251676108 conn(0x5620419e0910 msgr2=0x562041d9d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 1 -- 172.21.15.92:0/2251676108 shutdown_connections 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 1 -- 172.21.15.92:0/2251676108 wait complete. 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff470769740 20 client.16653 trim_cache size 0 max 16384 2024-09-21T07:16:15.151 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24649, 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 12, 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "3f0d4d53": { 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 12, 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 147.8, 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-21T07:16:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-21T07:16:15.153 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-21T07:16:15.153 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:16:15.153 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-21T07:16:15.153 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:16:15.153 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:15.153 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:15.153 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:15.153 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:15.153 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:15.153 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:16:15.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.142+0000 7ff46a1f5640 1 -- 172.21.15.92:0/3928182782 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff44c0b6680 msgr2=0x7ff44c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:15.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff44c0b6680 0x7ff44c0b8b90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff4540058c0 tx=0x7ff45400a250 comp rx=0 tx=0).stop 2024-09-21T07:16:15.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 -- 172.21.15.92:0/3928182782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4641083a0 msgr2=0x7ff46419cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:15.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4641083a0 0x7ff46419cb50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff458005940 tx=0x7ff4580042f0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 -- 172.21.15.92:0/3928182782 shutdown_connections 2024-09-21T07:16:15.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff44c0b6680 0x7ff44c0b8b90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff464108cf0 0x7ff4641a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4641083a0 0x7ff46419cb50 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 --2- 172.21.15.92:0/3928182782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff464102a60 0x7ff46419c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:15.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 -- 172.21.15.92:0/3928182782 >> 172.21.15.92:0/3928182782 conn(0x7ff464079730 msgr2=0x7ff46406b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:15.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 -- 172.21.15.92:0/3928182782 shutdown_connections 2024-09-21T07:16:15.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:15.143+0000 7ff46a1f5640 1 -- 172.21.15.92:0/3928182782 wait complete. 2024-09-21T07:16:16.372 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3f0d4d53', total seconds elapsed: 31.6 2024-09-21T07:16:16.372 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T07:16:16.373 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:16:16.622 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:17.007 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:16 smithi092 ceph-mon[30987]: pgmap v435: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T07:16:17.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:16 smithi175 ceph-mon[34064]: pgmap v435: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T07:16:17.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.095+0000 7f31df330640 1 -- 172.21.15.92:0/3477881528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8103b80 msgr2=0x7f31d8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:17.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.095+0000 7f31df330640 1 --2- 172.21.15.92:0/3477881528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8103b80 0x7f31d8103f90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009900 tx=0x7f31d402a410 comp rx=0 tx=0).stop 2024-09-21T07:16:17.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.095+0000 7f31df330640 1 -- 172.21.15.92:0/3477881528 shutdown_connections 2024-09-21T07:16:17.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.095+0000 7f31df330640 1 --2- 172.21.15.92:0/3477881528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d8109e10 0x7f31d8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.095+0000 7f31df330640 1 --2- 172.21.15.92:0/3477881528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d81094c0 0x7f31d81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.095+0000 7f31df330640 1 --2- 172.21.15.92:0/3477881528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8103b80 0x7f31d8103f90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.095+0000 7f31df330640 1 -- 172.21.15.92:0/3477881528 >> 172.21.15.92:0/3477881528 conn(0x7f31d80ff5d0 msgr2=0x7f31d8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.096+0000 7f31df330640 1 -- 172.21.15.92:0/3477881528 shutdown_connections 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.096+0000 7f31df330640 1 -- 172.21.15.92:0/3477881528 wait complete. 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.096+0000 7f31df330640 1 Processor -- start 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.096+0000 7f31df330640 1 -- start start 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.096+0000 7f31df330640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d8103b80 0x7f31d819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.096+0000 7f31df330640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d81094c0 0x7f31d819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31df330640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109e10 0x7f31d819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31df330640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8113a00 con 0x7f31d8109e10 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31df330640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8113880 con 0x7f31d8103b80 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31df330640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8113b80 con 0x7f31d81094c0 2024-09-21T07:16:17.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dd0cc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d8103b80 0x7f31d819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dd8cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109e10 0x7f31d819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dd0cc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d8103b80 0x7f31d819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:46446/0 (socket says 172.21.15.92:46446) 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dd0cc640 1 -- 172.21.15.92:0/747010046 learned_addr learned my addr 172.21.15.92:0/747010046 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dc8cb640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d81094c0 0x7f31d819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dd8cd640 1 -- 172.21.15.92:0/747010046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d81094c0 msgr2=0x7f31d819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dd8cd640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d81094c0 0x7f31d819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dd8cd640 1 -- 172.21.15.92:0/747010046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d8103b80 msgr2=0x7f31d819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dd8cd640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d8103b80 0x7f31d819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dd8cd640 1 -- 172.21.15.92:0/747010046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d81a03e0 con 0x7f31d8109e10 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31dd8cd640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109e10 0x7f31d819fcb0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f31d000ff40 tx=0x7f31d000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.097+0000 7f31ce7fc640 1 -- 172.21.15.92:0/747010046 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d000d0d0 con 0x7f31d8109e10 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.098+0000 7f31ce7fc640 1 -- 172.21.15.92:0/747010046 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31d000b6c0 con 0x7f31d8109e10 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.098+0000 7f31df330640 1 -- 172.21.15.92:0/747010046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d81a0670 con 0x7f31d8109e10 2024-09-21T07:16:17.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.098+0000 7f31ce7fc640 1 -- 172.21.15.92:0/747010046 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0018650 con 0x7f31d8109e10 2024-09-21T07:16:17.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.098+0000 7f31df330640 1 -- 172.21.15.92:0/747010046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d80755f0 con 0x7f31d8109e10 2024-09-21T07:16:17.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.099+0000 7f31df330640 1 -- 172.21.15.92:0/747010046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d8103f90 con 0x7f31d8109e10 2024-09-21T07:16:17.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.100+0000 7f31ce7fc640 1 -- 172.21.15.92:0/747010046 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f31d000d270 con 0x7f31d8109e10 2024-09-21T07:16:17.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.101+0000 7f31ce7fc640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f31c40b6680 0x7f31c40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:17.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.101+0000 7f31dd0cc640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f31c40b6680 0x7f31c40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:17.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.101+0000 7f31ce7fc640 1 -- 172.21.15.92:0/747010046 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f31d00eb160 con 0x7f31d8109e10 2024-09-21T07:16:17.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.101+0000 7f31dd0cc640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f31c40b6680 0x7f31c40b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f31d4000c00 tx=0x7f31d4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:17.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.104+0000 7f31ce7fc640 1 -- 172.21.15.92:0/747010046 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31d00b56f0 con 0x7f31d8109e10 2024-09-21T07:16:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:16 smithi169 ceph-mon[33705]: pgmap v435: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T07:16:17.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.318+0000 7f31df330640 1 -- 172.21.15.92:0/747010046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31d810bbe0 con 0x7f31d8109e10 2024-09-21T07:16:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.319+0000 7f31ce7fc640 1 -- 172.21.15.92:0/747010046 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f31d00ba630 con 0x7f31d8109e10 2024-09-21T07:16:17.321 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:16:17.321 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:16:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:16:17.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.321+0000 7f31df330640 1 -- 172.21.15.92:0/747010046 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f31c40b6680 msgr2=0x7f31c40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:17.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.321+0000 7f31df330640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f31c40b6680 0x7f31c40b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f31d4000c00 tx=0x7f31d4009560 comp rx=0 tx=0).stop 2024-09-21T07:16:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.321+0000 7f31df330640 1 -- 172.21.15.92:0/747010046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109e10 msgr2=0x7f31d819fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.321+0000 7f31df330640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109e10 0x7f31d819fcb0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f31d000ff40 tx=0x7f31d000ff70 comp rx=0 tx=0).stop 2024-09-21T07:16:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.321+0000 7f31df330640 1 -- 172.21.15.92:0/747010046 shutdown_connections 2024-09-21T07:16:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.322+0000 7f31df330640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f31c40b6680 0x7f31c40b8b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.322+0000 7f31df330640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109e10 0x7f31d819fcb0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.322+0000 7f31df330640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d81094c0 0x7f31d819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.322+0000 7f31df330640 1 --2- 172.21.15.92:0/747010046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d8103b80 0x7f31d819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.322+0000 7f31df330640 1 -- 172.21.15.92:0/747010046 >> 172.21.15.92:0/747010046 conn(0x7f31d80ff5d0 msgr2=0x7f31d81019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.322+0000 7f31df330640 1 -- 172.21.15.92:0/747010046 shutdown_connections 2024-09-21T07:16:17.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:17.322+0000 7f31df330640 1 -- 172.21.15.92:0/747010046 wait complete. 2024-09-21T07:16:17.877 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:16:17.877 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:16:17.878 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:16:17.878 INFO:tasks.workunit.client.0.smithi092.stdout:iozone test complete. 2024-09-21T07:16:17.878 INFO:tasks.workunit.client.0.smithi092.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-21T07:16:17.943 INFO:tasks.workunit.client.0.smithi092.stdout: Iozone: Performance Test of File I/O 2024-09-21T07:16:17.943 INFO:tasks.workunit.client.0.smithi092.stdout: Version $Revision: 3.494 $ 2024-09-21T07:16:17.943 INFO:tasks.workunit.client.0.smithi092.stdout: Compiled for 64 bit mode. 2024-09-21T07:16:17.943 INFO:tasks.workunit.client.0.smithi092.stdout: Build: linux-AMD64 2024-09-21T07:16:17.943 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:16:17.943 INFO:tasks.workunit.client.0.smithi092.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-21T07:16:17.943 INFO:tasks.workunit.client.0.smithi092.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-21T07:16:17.943 INFO:tasks.workunit.client.0.smithi092.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-21T07:16:17.943 INFO:tasks.workunit.client.0.smithi092.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Run began: Sat Sep 21 07:16:17 2024 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Include close in write timing 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Include fsync in write timing 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: File size set to 10485760 kB 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Record Size 1024 kB 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-21T07:16:17.944 INFO:tasks.workunit.client.0.smithi092.stdout: Output is in kBytes/sec 2024-09-21T07:16:17.945 INFO:tasks.workunit.client.0.smithi092.stdout: Time Resolution = 0.000001 seconds. 2024-09-21T07:16:17.945 INFO:tasks.workunit.client.0.smithi092.stdout: Processor cache size set to 1024 kBytes. 2024-09-21T07:16:17.945 INFO:tasks.workunit.client.0.smithi092.stdout: Processor cache line size set to 32 bytes. 2024-09-21T07:16:17.945 INFO:tasks.workunit.client.0.smithi092.stdout: File stride size set to 17 * record size. 2024-09-21T07:16:17.945 INFO:tasks.workunit.client.0.smithi092.stdout: Throughput test with 1 process 2024-09-21T07:16:17.945 INFO:tasks.workunit.client.0.smithi092.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-09-21T07:16:18.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:17 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/747010046' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:18.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:17 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/747010046' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:17 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/747010046' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:18.347 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24649 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T07:16:18.348 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24649 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T07:16:18.748 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:19.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:18 smithi175 ceph-mon[34064]: pgmap v436: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:16:19.029 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:18 smithi092 ceph-mon[30987]: pgmap v436: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:16:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:18 smithi169 ceph-mon[33705]: pgmap v436: 129 pgs: 129 active+clean; 2.0 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:16:19.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.325+0000 7febad950640 1 -- 172.21.15.92:0/494967700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba8103b90 msgr2=0x7feba8103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.325+0000 7febad950640 1 --2- 172.21.15.92:0/494967700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba8103b90 0x7feba8103fa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7feb98009900 tx=0x7feb9802a410 comp rx=0 tx=0).stop 2024-09-21T07:16:19.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.325+0000 7febad950640 1 -- 172.21.15.92:0/494967700 shutdown_connections 2024-09-21T07:16:19.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.325+0000 7febad950640 1 --2- 172.21.15.92:0/494967700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feba8109e20 0x7feba8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.325+0000 7febad950640 1 --2- 172.21.15.92:0/494967700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba81094d0 0x7feba81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.325+0000 7febad950640 1 --2- 172.21.15.92:0/494967700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba8103b90 0x7feba8103fa0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.325+0000 7febad950640 1 -- 172.21.15.92:0/494967700 >> 172.21.15.92:0/494967700 conn(0x7feba80ff5e0 msgr2=0x7feba8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.325+0000 7febad950640 1 -- 172.21.15.92:0/494967700 shutdown_connections 2024-09-21T07:16:19.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.325+0000 7febad950640 1 -- 172.21.15.92:0/494967700 wait complete. 2024-09-21T07:16:19.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.326+0000 7febad950640 1 Processor -- start 2024-09-21T07:16:19.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.327+0000 7febad950640 1 -- start start 2024-09-21T07:16:19.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.327+0000 7febad950640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feba8103b90 0x7feba819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.327+0000 7febad950640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba81094d0 0x7feba819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.327+0000 7febad950640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba8109e20 0x7feba819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.327+0000 7febad950640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feba8113990 con 0x7feba81094d0 2024-09-21T07:16:19.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.327+0000 7febad950640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feba8113810 con 0x7feba8109e20 2024-09-21T07:16:19.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.327+0000 7febad950640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feba8113b10 con 0x7feba8103b90 2024-09-21T07:16:19.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.327+0000 7feb9e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba81094d0 0x7feba819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.327+0000 7feb9e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba81094d0 0x7feba819a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39160/0 (socket says 172.21.15.92:39160) 2024-09-21T07:16:19.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.327+0000 7feb9e7fc640 1 -- 172.21.15.92:0/1361905458 learned_addr learned my addr 172.21.15.92:0/1361905458 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:19.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.328+0000 7feba77fe640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba8109e20 0x7feba819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.328+0000 7feba6ffd640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feba8103b90 0x7feba819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.328+0000 7feb9e7fc640 1 -- 172.21.15.92:0/1361905458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feba8103b90 msgr2=0x7feba819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.328+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feba8103b90 0x7feba819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.328+0000 7feb9e7fc640 1 -- 172.21.15.92:0/1361905458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba8109e20 msgr2=0x7feba819fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.328+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba8109e20 0x7feba819fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.328+0000 7feb9e7fc640 1 -- 172.21.15.92:0/1361905458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba81a02d0 con 0x7feba81094d0 2024-09-21T07:16:19.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.329+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba81094d0 0x7feba819a900 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7feb90009ab0 tx=0x7feb9000ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.329+0000 7febac94e640 1 -- 172.21.15.92:0/1361905458 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9001f070 con 0x7feba81094d0 2024-09-21T07:16:19.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.329+0000 7febad950640 1 -- 172.21.15.92:0/1361905458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba81a05c0 con 0x7feba81094d0 2024-09-21T07:16:19.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.329+0000 7febad950640 1 -- 172.21.15.92:0/1361905458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba80755f0 con 0x7feba81094d0 2024-09-21T07:16:19.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.330+0000 7febac94e640 1 -- 172.21.15.92:0/1361905458 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb90007db0 con 0x7feba81094d0 2024-09-21T07:16:19.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.330+0000 7febac94e640 1 -- 172.21.15.92:0/1361905458 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90029060 con 0x7feba81094d0 2024-09-21T07:16:19.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.333+0000 7febb3ec4740 1 Processor -- start 2024-09-21T07:16:19.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.333+0000 7febb3ec4740 1 -- start start 2024-09-21T07:16:19.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.334+0000 7febb3ec4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb180840 0x5607fb527600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.334+0000 7febb3ec4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb527b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.334+0000 7febb3ec4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb528080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.334+0000 7febb3ec4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5607fb49db90 con 0x5607fb157980 2024-09-21T07:16:19.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.334+0000 7febb3ec4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5607fb48cfc0 con 0x5607fb180840 2024-09-21T07:16:19.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.334+0000 7febb3ec4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5607fb490dd0 con 0x5607fb15fb60 2024-09-21T07:16:19.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.334+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb527b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.334+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb527b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39162/0 (socket says 172.21.15.92:39162) 2024-09-21T07:16:19.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.334+0000 7feba6ffd640 1 -- 172.21.15.92:0/2763937521 learned_addr learned my addr 172.21.15.92:0/2763937521 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:19.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.335+0000 7febac94e640 1 -- 172.21.15.92:0/1361905458 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7feb90022070 con 0x7feba81094d0 2024-09-21T07:16:19.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.335+0000 7feba6ffd640 1 -- 172.21.15.92:0/2763937521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 msgr2=0x5607fb528080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:16:19.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.335+0000 7feba6ffd640 1 --2- 172.21.15.92:0/2763937521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb528080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.335+0000 7feba6ffd640 1 -- 172.21.15.92:0/2763937521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb180840 msgr2=0x5607fb527600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.335+0000 7feba6ffd640 1 --2- 172.21.15.92:0/2763937521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb180840 0x5607fb527600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.335+0000 7feba6ffd640 1 -- 172.21.15.92:0/2763937521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607fb414060 con 0x5607fb157980 2024-09-21T07:16:19.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.336+0000 7feba6ffd640 1 --2- 172.21.15.92:0/2763937521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb527b40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7feb98009900 tx=0x7feb98032af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da23c3795bacc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.337+0000 7febac94e640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feb940b6680 0x7feb940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.337+0000 7feba77fe640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feb940b6680 0x7feb940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.337+0000 7febac94e640 1 -- 172.21.15.92:0/1361905458 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7feb900eaf40 con 0x7feba81094d0 2024-09-21T07:16:19.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.338+0000 7feb9dffb640 1 -- 172.21.15.92:0/2763937521 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9803f070 con 0x5607fb157980 2024-09-21T07:16:19.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.338+0000 7feba77fe640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feb940b6680 0x7feb940b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feba0005c40 tx=0x7feba0005bd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.338+0000 7feb9dffb640 1 -- 172.21.15.92:0/2763937521 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb98004030 con 0x5607fb157980 2024-09-21T07:16:19.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.338+0000 7feb9dffb640 1 -- 172.21.15.92:0/2763937521 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98035070 con 0x5607fb157980 2024-09-21T07:16:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.339+0000 7febb3ec4740 1 -- 172.21.15.92:0/2763937521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 msgr2=0x5607fb527b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.339+0000 7febb3ec4740 1 --2- 172.21.15.92:0/2763937521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb527b40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7feb98009900 tx=0x7feb98032af0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.340+0000 7febb3ec4740 1 -- 172.21.15.92:0/2763937521 shutdown_connections 2024-09-21T07:16:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.340+0000 7febb3ec4740 1 --2- 172.21.15.92:0/2763937521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb528080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.340+0000 7febb3ec4740 1 --2- 172.21.15.92:0/2763937521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb527b40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.340+0000 7febb3ec4740 1 --2- 172.21.15.92:0/2763937521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb180840 0x5607fb527600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.340+0000 7febb3ec4740 1 -- 172.21.15.92:0/2763937521 >> 172.21.15.92:0/2763937521 conn(0x5607fb174990 msgr2=0x5607fb5254f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.340+0000 7febb3ec4740 1 -- 172.21.15.92:0/2763937521 shutdown_connections 2024-09-21T07:16:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.340+0000 7febb3ec4740 1 -- 172.21.15.92:0/2763937521 wait complete. 2024-09-21T07:16:19.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.340+0000 7febb3ec4740 1 -- start start 2024-09-21T07:16:19.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.341+0000 7febb3ec4740 1 Processor -- start 2024-09-21T07:16:19.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.342+0000 7febb3ec4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb5332d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.342+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb5332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.342+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb5332d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39176/0 (socket says 172.21.15.92:39176) 2024-09-21T07:16:19.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.342+0000 7feba6ffd640 1 -- 172.21.15.92:0/1606460764 learned_addr learned my addr 172.21.15.92:0/1606460764 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:19.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.342+0000 7febb3ec4740 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb5338b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.342+0000 7febb3ec4740 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb180840 0x5607fb539070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.343+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5607fb2ee7a0 con 0x5607fb157980 2024-09-21T07:16:19.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.343+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb5338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.343+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5607fb4320a0 con 0x5607fb180840 2024-09-21T07:16:19.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.343+0000 7feba77fe640 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb180840 0x5607fb539070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.343+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5607fb535d80 con 0x5607fb15fb60 2024-09-21T07:16:19.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.344+0000 7feba6ffd640 1 -- 172.21.15.92:0/1606460764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 msgr2=0x5607fb5338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.344+0000 7feba6ffd640 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb5338b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.344+0000 7feba6ffd640 1 -- 172.21.15.92:0/1606460764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb180840 msgr2=0x5607fb539070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.344+0000 7feba6ffd640 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb180840 0x5607fb539070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.344+0000 7feba6ffd640 1 -- 172.21.15.92:0/1606460764 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607fb420880 con 0x5607fb157980 2024-09-21T07:16:19.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.344+0000 7feba6ffd640 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb5332d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7feb98032f10 tx=0x7feb98005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda117fdbfdab920 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.344+0000 7febb3ec4740 10 client.0 _ll_register_callbacks cb 0x5607fb40f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:19.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.344+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb98004030 con 0x5607fb157980 2024-09-21T07:16:19.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.345+0000 7feb86ffd640 10 client.16671 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:19.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.345+0000 7feb86ffd640 1 -- 172.21.15.92:0/1606460764 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9803f070 con 0x5607fb157980 2024-09-21T07:16:19.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.345+0000 7feb86ffd640 1 -- 172.21.15.92:0/1606460764 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7feb980051e0 con 0x5607fb157980 2024-09-21T07:16:19.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.345+0000 7feb86ffd640 1 -- 172.21.15.92:0/1606460764 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb98057050 con 0x5607fb157980 2024-09-21T07:16:19.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.345+0000 7febb3ec4740 10 client.16671 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:19.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.345+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5607fb1fab90 con 0x5607fb157980 2024-09-21T07:16:19.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.346+0000 7feb86ffd640 1 -- 172.21.15.92:0/1606460764 <== mon.0 v2:172.21.15.92:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7feb980053e0 con 0x5607fb157980 2024-09-21T07:16:19.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.346+0000 7febb3ec4740 10 client.16671 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:19.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.346+0000 7febb3ec4740 10 client.16671 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:16:19.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.346+0000 7febb3ec4740 20 client.16671 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:19.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.346+0000 7febb3ec4740 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5607fb13f1c0 0x5607fb544bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.346+0000 7febb3ec4740 4 client.16671 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:19.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.346+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607fb49fae0 con 0x5607fb13f1c0 2024-09-21T07:16:19.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.347+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5607fb13f1c0 0x5607fb544bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.348+0000 7feb86ffd640 10 client.16671 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:19.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.348+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5607fb13f1c0 0x5607fb544bb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c5c825e097427ea server_cookie=7e0df2f2935c5cca in_seq=0 out_seq=0 2024-09-21T07:16:19.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.348+0000 7feb86ffd640 1 -- 172.21.15.92:0/1606460764 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607fb49fae0 con 0x5607fb13f1c0 2024-09-21T07:16:19.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.348+0000 7feb86ffd640 10 client.16671 handle_command_reply: tid=0 2024-09-21T07:16:19.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.348+0000 7febb3ec4740 1 client.16671 shutdown 2024-09-21T07:16:19.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 msgr2=0x5607fb5332d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb5332d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7feb98032f10 tx=0x7feb98005dd0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 shutdown_connections 2024-09-21T07:16:19.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5607fb13f1c0 0x5607fb544bb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb180840 0x5607fb539070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb5338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 1 --2- 172.21.15.92:0/1606460764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb157980 0x5607fb5332d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7feb86ffd640 0 client.16671 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:19.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 >> 172.21.15.92:0/1606460764 conn(0x5607fb174990 msgr2=0x5607fb52a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 shutdown_connections 2024-09-21T07:16:19.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 1 -- 172.21.15.92:0/1606460764 wait complete. 2024-09-21T07:16:19.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.349+0000 7febb3ec4740 20 client.16671 trim_cache size 0 max 16384 2024-09-21T07:16:19.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.373+0000 7febb3ec4740 1 Processor -- start 2024-09-21T07:16:19.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.373+0000 7febb3ec4740 1 -- start start 2024-09-21T07:16:19.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.373+0000 7febb3ec4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 0x5607fb5302c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.373+0000 7febb3ec4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb530800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.373+0000 7febb3ec4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 0x5607fb54a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.373+0000 7febb3ec4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feba81aecc0 con 0x5607fb180840 2024-09-21T07:16:19.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.373+0000 7febb3ec4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feba81b0800 con 0x5607fb157980 2024-09-21T07:16:19.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.373+0000 7febb3ec4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feba81af390 con 0x5607fb15fb60 2024-09-21T07:16:19.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feb9e7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb530800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feb9e7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb530800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:39474/0 (socket says 172.21.15.92:39474) 2024-09-21T07:16:19.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feb9e7fc640 1 -- 172.21.15.92:0/806275613 learned_addr learned my addr 172.21.15.92:0/806275613 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feba77fe640 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 0x5607fb54a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feba6ffd640 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 0x5607fb5302c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feb9e7fc640 1 -- 172.21.15.92:0/806275613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 msgr2=0x5607fb5302c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 0x5607fb5302c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feb9e7fc640 1 -- 172.21.15.92:0/806275613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 msgr2=0x5607fb54a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 0x5607fb54a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feb9e7fc640 1 -- 172.21.15.92:0/806275613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607fb529e90 con 0x5607fb15fb60 2024-09-21T07:16:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feba77fe640 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 0x5607fb54a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:19.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.374+0000 7feba6ffd640 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 0x5607fb5302c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:19.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.375+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb530800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb90007fd0 tx=0x7feb90005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99b714239e3ca7a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.375+0000 7feb9d7fa640 1 -- 172.21.15.92:0/806275613 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb900b54d0 con 0x5607fb15fb60 2024-09-21T07:16:19.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.375+0000 7feb9d7fa640 1 -- 172.21.15.92:0/806275613 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb900ba410 con 0x5607fb15fb60 2024-09-21T07:16:19.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.375+0000 7feb9d7fa640 1 -- 172.21.15.92:0/806275613 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb900acdd0 con 0x5607fb15fb60 2024-09-21T07:16:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.377+0000 7febb3ec4740 1 -- 172.21.15.92:0/806275613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 msgr2=0x5607fb530800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.377+0000 7febb3ec4740 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb530800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb90007fd0 tx=0x7feb90005bb0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.377+0000 7febb3ec4740 1 -- 172.21.15.92:0/806275613 shutdown_connections 2024-09-21T07:16:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.377+0000 7febb3ec4740 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 0x5607fb54a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.377+0000 7febb3ec4740 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb530800 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.377+0000 7febb3ec4740 1 --2- 172.21.15.92:0/806275613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 0x5607fb5302c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.377+0000 7febb3ec4740 1 -- 172.21.15.92:0/806275613 >> 172.21.15.92:0/806275613 conn(0x5607fb174990 msgr2=0x5607fb52cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.377+0000 7febb3ec4740 1 -- 172.21.15.92:0/806275613 shutdown_connections 2024-09-21T07:16:19.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.377+0000 7febb3ec4740 1 -- 172.21.15.92:0/806275613 wait complete. 2024-09-21T07:16:19.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.378+0000 7febb3ec4740 1 -- start start 2024-09-21T07:16:19.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.378+0000 7febb3ec4740 1 Processor -- start 2024-09-21T07:16:19.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.379+0000 7febb3ec4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 0x5607fb53f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.379+0000 7febb3ec4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb53ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.379+0000 7febb3ec4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 0x5607fb53b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.379+0000 7febb3ec4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feba81b0130 con 0x5607fb180840 2024-09-21T07:16:19.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.379+0000 7febb3ec4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feba81afa60 con 0x5607fb157980 2024-09-21T07:16:19.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.380+0000 7febb3ec4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feba81acca0 con 0x5607fb15fb60 2024-09-21T07:16:19.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.380+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 0x5607fb53f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.380+0000 7febb3ec4740 10 client.0 _ll_register_callbacks cb 0x7feb98009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:19.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.380+0000 7feba77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 0x5607fb53b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.380+0000 7feba77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 0x5607fb53b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39200/0 (socket says 172.21.15.92:39200) 2024-09-21T07:16:19.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.380+0000 7feba77fe640 1 -- 172.21.15.92:0/3828554685 learned_addr learned my addr 172.21.15.92:0/3828554685 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:19.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.380+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb53ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.381+0000 7feba6ffd640 1 -- 172.21.15.92:0/3828554685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 msgr2=0x5607fb53ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.381+0000 7feba6ffd640 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb53ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.381+0000 7feba6ffd640 1 -- 172.21.15.92:0/3828554685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 msgr2=0x5607fb53b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.381+0000 7feba6ffd640 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 0x5607fb53b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.381+0000 7feba6ffd640 1 -- 172.21.15.92:0/3828554685 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607fb53b980 con 0x5607fb157980 2024-09-21T07:16:19.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.382+0000 7feba6ffd640 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 0x5607fb53f770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feb98005e40 tx=0x7feb98032a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f63371197dc28c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.382+0000 7feb86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:16:19.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.382+0000 7feb86ffd640 1 -- 172.21.15.92:0/3828554685 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98069060 con 0x5607fb157980 2024-09-21T07:16:19.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.382+0000 7feb86ffd640 1 -- 172.21.15.92:0/3828554685 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7feb98003cb0 con 0x5607fb157980 2024-09-21T07:16:19.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.383+0000 7febb3ec4740 1 -- 172.21.15.92:0/3828554685 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb900ba410 con 0x5607fb157980 2024-09-21T07:16:19.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.383+0000 7feb86ffd640 1 -- 172.21.15.92:0/3828554685 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb98035040 con 0x5607fb157980 2024-09-21T07:16:19.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.384+0000 7febb3ec4740 10 client.25895 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:19.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.384+0000 7febb3ec4740 1 -- 172.21.15.92:0/3828554685 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5607fb5b1290 con 0x5607fb157980 2024-09-21T07:16:19.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.385+0000 7feb86ffd640 1 -- 172.21.15.92:0/3828554685 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb900ba410 con 0x5607fb157980 2024-09-21T07:16:19.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.385+0000 7feb86ffd640 1 -- 172.21.15.92:0/3828554685 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7feb98063030 con 0x5607fb157980 2024-09-21T07:16:19.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.385+0000 7febb3ec4740 10 client.25895 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:19.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.385+0000 7febb3ec4740 10 client.25895 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:16:19.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.385+0000 7febb3ec4740 20 client.25895 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:19.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.385+0000 7febb3ec4740 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5607fb114570 0x5607fb5b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.385+0000 7febb3ec4740 4 client.25895 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T07:16:19.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.385+0000 7febb3ec4740 1 -- 172.21.15.92:0/3828554685 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x5607fb49b590 con 0x5607fb114570 2024-09-21T07:16:19.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.385+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5607fb114570 0x5607fb5b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.386+0000 7feb86ffd640 10 client.25895 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:19.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.386+0000 7feb9e7fc640 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5607fb114570 0x5607fb5b3a90 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aac6a9908634b1a2 server_cookie=55cdbc7994ec063b in_seq=0 out_seq=0 2024-09-21T07:16:19.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7feb86ffd640 1 -- 172.21.15.92:0/3828554685 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5607fb49b590 con 0x5607fb114570 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7feb86ffd640 10 client.25895 handle_command_reply: tid=0 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7febb3ec4740 1 client.25895 shutdown 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7febb3ec4740 1 -- 172.21.15.92:0/3828554685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 msgr2=0x5607fb53f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7febb3ec4740 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 0x5607fb53f770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feb98005e40 tx=0x7feb98032a80 comp rx=0 tx=0).stop 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7febb3ec4740 1 -- 172.21.15.92:0/3828554685 shutdown_connections 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7febb3ec4740 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5607fb114570 0x5607fb5b3a90 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7febb3ec4740 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5607fb180840 0x5607fb53b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7febb3ec4740 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607fb15fb60 0x5607fb53ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7febb3ec4740 1 --2- 172.21.15.92:0/3828554685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5607fb157980 0x5607fb53f770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.405+0000 7feb86ffd640 0 client.25895 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.406+0000 7febb3ec4740 1 -- 172.21.15.92:0/3828554685 >> 172.21.15.92:0/3828554685 conn(0x5607fb174990 msgr2=0x5607fb5285c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.406+0000 7febb3ec4740 1 -- 172.21.15.92:0/3828554685 shutdown_connections 2024-09-21T07:16:19.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.406+0000 7febb3ec4740 1 -- 172.21.15.92:0/3828554685 wait complete. 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.406+0000 7febb3ec4740 20 client.25895 trim_cache size 0 max 16384 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24649, 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 14, 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stdout: "b6b97c80": { 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 14, 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:16:19.409 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 147.8, 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:19.410 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:19.411 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:19.411 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:19.411 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:16:19.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.406+0000 7febad950640 1 -- 172.21.15.92:0/1361905458 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feb940b6680 msgr2=0x7feb940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.406+0000 7febad950640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feb940b6680 0x7feb940b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feba0005c40 tx=0x7feba0005bd0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.406+0000 7febad950640 1 -- 172.21.15.92:0/1361905458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba81094d0 msgr2=0x7feba819a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.406+0000 7febad950640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba81094d0 0x7feba819a900 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7feb90009ab0 tx=0x7feb9000ff80 comp rx=0 tx=0).stop 2024-09-21T07:16:19.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.407+0000 7febad950640 1 -- 172.21.15.92:0/1361905458 shutdown_connections 2024-09-21T07:16:19.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.407+0000 7febad950640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feb940b6680 0x7feb940b8b90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.407+0000 7febad950640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feba8109e20 0x7feba819fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.407+0000 7febad950640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba81094d0 0x7feba819a900 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.407+0000 7febad950640 1 --2- 172.21.15.92:0/1361905458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feba8103b90 0x7feba819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.407+0000 7febad950640 1 -- 172.21.15.92:0/1361905458 >> 172.21.15.92:0/1361905458 conn(0x7feba80ff5e0 msgr2=0x7feba8101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.407+0000 7febad950640 1 -- 172.21.15.92:0/1361905458 shutdown_connections 2024-09-21T07:16:19.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:19.407+0000 7febad950640 1 -- 172.21.15.92:0/1361905458 wait complete. 2024-09-21T07:16:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.435+0000 7f6120790640 1 -- 172.21.15.92:0/3016787301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61181029d0 msgr2=0x7f6118102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.435+0000 7f6120790640 1 --2- 172.21.15.92:0/3016787301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61181029d0 0x7f6118102de0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6114009900 tx=0x7f611402a410 comp rx=0 tx=0).stop 2024-09-21T07:16:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.435+0000 7f6120790640 1 -- 172.21.15.92:0/3016787301 shutdown_connections 2024-09-21T07:16:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.435+0000 7f6120790640 1 --2- 172.21.15.92:0/3016787301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6118108c50 0x7f611810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.435+0000 7f6120790640 1 --2- 172.21.15.92:0/3016787301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6118108300 0x7f6118108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.435+0000 7f6120790640 1 --2- 172.21.15.92:0/3016787301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61181029d0 0x7f6118102de0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.435+0000 7f6120790640 1 -- 172.21.15.92:0/3016787301 >> 172.21.15.92:0/3016787301 conn(0x7f611807a6f0 msgr2=0x7f611807ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.435+0000 7f6120790640 1 -- 172.21.15.92:0/3016787301 shutdown_connections 2024-09-21T07:16:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.435+0000 7f6120790640 1 -- 172.21.15.92:0/3016787301 wait complete. 2024-09-21T07:16:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f6120790640 1 Processor -- start 2024-09-21T07:16:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f6120790640 1 -- start start 2024-09-21T07:16:19.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f6120790640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61181029d0 0x7f6118198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f6120790640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6118108300 0x7f6118198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f6120790640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6118108c50 0x7f611819d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f6120790640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61181116c0 con 0x7f6118108c50 2024-09-21T07:16:19.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f6120790640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6118111540 con 0x7f6118108300 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f6120790640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6118111840 con 0x7f61181029d0 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f611ed2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6118108c50 0x7f611819d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f611dd2b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6118108300 0x7f6118198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f611ed2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6118108c50 0x7f611819d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39220/0 (socket says 172.21.15.92:39220) 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.436+0000 7f611ed2d640 1 -- 172.21.15.92:0/1022856192 learned_addr learned my addr 172.21.15.92:0/1022856192 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f611e52c640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61181029d0 0x7f6118198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f611dd2b640 1 -- 172.21.15.92:0/1022856192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61181029d0 msgr2=0x7f6118198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f611dd2b640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61181029d0 0x7f6118198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f611dd2b640 1 -- 172.21.15.92:0/1022856192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6118108c50 msgr2=0x7f611819d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f611dd2b640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6118108c50 0x7f611819d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f611dd2b640 1 -- 172.21.15.92:0/1022856192 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611819e090 con 0x7f6118108300 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f611ed2d640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6118108c50 0x7f611819d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f611dd2b640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6118108300 0x7f6118198700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f611806c980 tx=0x7f610800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f610f7fe640 1 -- 172.21.15.92:0/1022856192 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610800cc40 con 0x7f6118108300 2024-09-21T07:16:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f6120790640 1 -- 172.21.15.92:0/1022856192 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611819e380 con 0x7f6118108300 2024-09-21T07:16:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f610f7fe640 1 -- 172.21.15.92:0/1022856192 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f610800cde0 con 0x7f6118108300 2024-09-21T07:16:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f610f7fe640 1 -- 172.21.15.92:0/1022856192 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108004800 con 0x7f6118108300 2024-09-21T07:16:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.437+0000 7f6120790640 1 -- 172.21.15.92:0/1022856192 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61181a4b10 con 0x7f6118108300 2024-09-21T07:16:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.440+0000 7f610f7fe640 1 -- 172.21.15.92:0/1022856192 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f6108004a20 con 0x7f6118108300 2024-09-21T07:16:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.440+0000 7f61277e0740 1 Processor -- start 2024-09-21T07:16:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.440+0000 7f61277e0740 1 -- start start 2024-09-21T07:16:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.440+0000 7f61277e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043831b0 0x562c047289b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.440+0000 7f61277e0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 0x562c04728ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f61277e0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c043624d0 0x562c04729430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f61277e0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c0469d6f0 con 0x562c043624d0 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f61277e0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562c0468cb20 con 0x562c0435a2f0 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f61277e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c04690930 con 0x562c043831b0 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f610f7fe640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61040b6680 0x7f61040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611e52c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 0x562c04728ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611e52c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 0x562c04728ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:46532/0 (socket says 172.21.15.92:46532) 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611e52c640 1 -- 172.21.15.92:0/1503271660 learned_addr learned my addr 172.21.15.92:0/1503271660 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611dd2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c043624d0 0x562c04729430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611ed2d640 1 --2- 172.21.15.92:0/1503271660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043831b0 0x562c047289b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f610f7fe640 1 -- 172.21.15.92:0/1022856192 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f61080e7aa0 con 0x7f6118108300 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611e52c640 1 -- 172.21.15.92:0/1503271660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043831b0 msgr2=0x562c047289b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611ed2d640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61040b6680 0x7f61040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611e52c640 1 --2- 172.21.15.92:0/1503271660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043831b0 0x562c047289b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611e52c640 1 -- 172.21.15.92:0/1503271660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c043624d0 msgr2=0x562c04729430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611e52c640 1 --2- 172.21.15.92:0/1503271660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c043624d0 0x562c04729430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611e52c640 1 -- 172.21.15.92:0/1503271660 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c04652530 con 0x562c0435a2f0 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f611e52c640 1 --2- 172.21.15.92:0/1503271660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 0x562c04728ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6114009900 tx=0x7f6114031a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284eee920ae658d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.441+0000 7f610cff9640 1 -- 172.21.15.92:0/1503271660 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114035070 con 0x562c0435a2f0 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.442+0000 7f610cff9640 1 -- 172.21.15.92:0/1503271660 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6114040070 con 0x562c0435a2f0 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.442+0000 7f610cff9640 1 -- 172.21.15.92:0/1503271660 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114003bb0 con 0x562c0435a2f0 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.442+0000 7f611ed2d640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61040b6680 0x7f61040b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f611000bfd0 tx=0x7f611000d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.442+0000 7f61277e0740 1 -- 172.21.15.92:0/1503271660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 msgr2=0x562c04728ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.442+0000 7f61277e0740 1 --2- 172.21.15.92:0/1503271660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 0x562c04728ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6114009900 tx=0x7f6114031a70 comp rx=0 tx=0).stop 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.442+0000 7f61277e0740 1 -- 172.21.15.92:0/1503271660 shutdown_connections 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.442+0000 7f61277e0740 1 --2- 172.21.15.92:0/1503271660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c043624d0 0x562c04729430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.442+0000 7f61277e0740 1 --2- 172.21.15.92:0/1503271660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 0x562c04728ef0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.442+0000 7f61277e0740 1 --2- 172.21.15.92:0/1503271660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043831b0 0x562c047289b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.442+0000 7f61277e0740 1 -- 172.21.15.92:0/1503271660 >> 172.21.15.92:0/1503271660 conn(0x562c04377300 msgr2=0x562c047268a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f61277e0740 1 -- 172.21.15.92:0/1503271660 shutdown_connections 2024-09-21T07:16:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f61277e0740 1 -- 172.21.15.92:0/1503271660 wait complete. 2024-09-21T07:16:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f61277e0740 1 -- start start 2024-09-21T07:16:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f61277e0740 1 Processor -- start 2024-09-21T07:16:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f61277e0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c0435a2f0 0x562c04734060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f61277e0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 0x562c047345a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f61277e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043831b0 0x562c047403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f61277e0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c045c4ab0 con 0x562c0435a2f0 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f61277e0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562c04632730 con 0x562c043624d0 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f61277e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c047370d0 con 0x562c043831b0 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.443+0000 7f611e52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c0435a2f0 0x562c04734060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f61277e0740 10 client.0 _ll_register_callbacks cb 0x562c046866b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611e52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c0435a2f0 0x562c04734060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39244/0 (socket says 172.21.15.92:39244) 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611dd2b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 0x562c047345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611e52c640 1 -- 172.21.15.92:0/1528418216 learned_addr learned my addr 172.21.15.92:0/1528418216 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611ed2d640 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043831b0 0x562c047403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611e52c640 1 -- 172.21.15.92:0/1528418216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043831b0 msgr2=0x562c047403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611e52c640 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043831b0 0x562c047403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611e52c640 1 -- 172.21.15.92:0/1528418216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 msgr2=0x562c047345a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611e52c640 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 0x562c047345a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611e52c640 1 -- 172.21.15.92:0/1528418216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c043ee790 con 0x562c0435a2f0 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611dd2b640 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 0x562c047345a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f611e52c640 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c0435a2f0 0x562c04734060 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f611402a930 tx=0x7f6114031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb90097a4c7fef07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f6101ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f6101ffb640 1 -- 172.21.15.92:0/1528418216 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611404c020 con 0x562c0435a2f0 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f6101ffb640 1 -- 172.21.15.92:0/1528418216 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6114045870 con 0x562c0435a2f0 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f61277e0740 1 -- 172.21.15.92:0/1528418216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6114040070 con 0x562c0435a2f0 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f6101ffb640 1 -- 172.21.15.92:0/1528418216 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6114057050 con 0x562c0435a2f0 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f61277e0740 10 client.16689 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.444+0000 7f61277e0740 1 -- 172.21.15.92:0/1528418216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c04467620 con 0x562c0435a2f0 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.445+0000 7f6101ffb640 1 -- 172.21.15.92:0/1528418216 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6114040070 con 0x562c0435a2f0 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.445+0000 7f6101ffb640 1 -- 172.21.15.92:0/1528418216 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f611403c830 con 0x562c0435a2f0 2024-09-21T07:16:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.445+0000 7f61277e0740 10 client.16689 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.445+0000 7f61277e0740 10 client.16689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.445+0000 7f61277e0740 20 client.16689 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.445+0000 7f61277e0740 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c04341d80 0x562c04745f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.445+0000 7f61277e0740 4 client.16689 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.445+0000 7f61277e0740 1 -- 172.21.15.92:0/1528418216 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c0469f640 con 0x562c04341d80 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.445+0000 7f611dd2b640 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c04341d80 0x562c04745f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f6101ffb640 10 client.16689 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f611dd2b640 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c04341d80 0x562c04745f10 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6b6f3c1cfa23939 server_cookie=b3901f1927958d9a in_seq=0 out_seq=0 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f6101ffb640 1 -- 172.21.15.92:0/1528418216 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c0469f640 con 0x562c04341d80 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f6101ffb640 10 client.16689 handle_command_reply: tid=0 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 client.16689 shutdown 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 -- 172.21.15.92:0/1528418216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c0435a2f0 msgr2=0x562c04734060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c0435a2f0 0x562c04734060 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f611402a930 tx=0x7f6114031770 comp rx=0 tx=0).stop 2024-09-21T07:16:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 -- 172.21.15.92:0/1528418216 shutdown_connections 2024-09-21T07:16:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c04341d80 0x562c04745f10 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043831b0 0x562c047403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f6101ffb640 0 client.16689 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 0x562c047345a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 --2- 172.21.15.92:0/1528418216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c0435a2f0 0x562c04734060 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 -- 172.21.15.92:0/1528418216 >> 172.21.15.92:0/1528418216 conn(0x562c04377300 msgr2=0x562c047299e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 -- 172.21.15.92:0/1528418216 shutdown_connections 2024-09-21T07:16:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.446+0000 7f61277e0740 1 -- 172.21.15.92:0/1528418216 wait complete. 2024-09-21T07:16:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.447+0000 7f61277e0740 20 client.16689 trim_cache size 0 max 16384 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f61277e0740 1 Processor -- start 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f61277e0740 1 -- start start 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f61277e0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c0472a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f61277e0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 0x562c047255b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f61277e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043624d0 0x562c04731230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f61277e0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61181aebb0 con 0x562c04341d80 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f61277e0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61181b06f0 con 0x562c0435a2f0 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f61277e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f61181af280 con 0x562c043624d0 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f611e52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c0472a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f611e52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c0472a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39250/0 (socket says 172.21.15.92:39250) 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f611e52c640 1 -- 172.21.15.92:0/4232611626 learned_addr learned my addr 172.21.15.92:0/4232611626 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f611ed2d640 1 --2- 172.21.15.92:0/4232611626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043624d0 0x562c04731230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f611dd2b640 1 --2- 172.21.15.92:0/4232611626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 0x562c047255b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f611e52c640 1 -- 172.21.15.92:0/4232611626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043624d0 msgr2=0x562c04731230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f611e52c640 1 --2- 172.21.15.92:0/4232611626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043624d0 0x562c04731230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f611e52c640 1 -- 172.21.15.92:0/4232611626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 msgr2=0x562c047255b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f611e52c640 1 --2- 172.21.15.92:0/4232611626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 0x562c047255b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.461+0000 7f611e52c640 1 -- 172.21.15.92:0/4232611626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c04727630 con 0x562c04341d80 2024-09-21T07:16:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f611e52c640 1 --2- 172.21.15.92:0/4232611626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c0472a3a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6114006010 tx=0x7f6114031be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f1e118001f6c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f6103fff640 1 -- 172.21.15.92:0/4232611626 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611404c040 con 0x562c04341d80 2024-09-21T07:16:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f6103fff640 1 -- 172.21.15.92:0/4232611626 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6114040070 con 0x562c04341d80 2024-09-21T07:16:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f6103fff640 1 -- 172.21.15.92:0/4232611626 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114035070 con 0x562c04341d80 2024-09-21T07:16:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f61277e0740 1 -- 172.21.15.92:0/4232611626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 msgr2=0x562c0472a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f61277e0740 1 --2- 172.21.15.92:0/4232611626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c0472a3a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6114006010 tx=0x7f6114031be0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f61277e0740 1 -- 172.21.15.92:0/4232611626 shutdown_connections 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f61277e0740 1 --2- 172.21.15.92:0/4232611626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c043624d0 0x562c04731230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f61277e0740 1 --2- 172.21.15.92:0/4232611626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c0435a2f0 0x562c047255b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f61277e0740 1 --2- 172.21.15.92:0/4232611626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c0472a3a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.462+0000 7f61277e0740 1 -- 172.21.15.92:0/4232611626 >> 172.21.15.92:0/4232611626 conn(0x562c04377300 msgr2=0x562c04724ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 1 -- 172.21.15.92:0/4232611626 shutdown_connections 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 1 -- 172.21.15.92:0/4232611626 wait complete. 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 1 -- start start 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 1 Processor -- start 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c04748c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c0435a2f0 0x562c04749270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f611e52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c04748c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f611e52c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c04748c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39258/0 (socket says 172.21.15.92:39258) 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f611e52c640 1 -- 172.21.15.92:0/1042530604 learned_addr learned my addr 172.21.15.92:0/1042530604 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 0x562c047a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61181b0020 con 0x562c04341d80 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61181af950 con 0x562c043624d0 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f61181acb90 con 0x562c0435a2f0 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.463+0000 7f61277e0740 10 client.0 _ll_register_callbacks cb 0x7f61080a9390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f611ed2d640 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 0x562c047a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f611e52c640 1 -- 172.21.15.92:0/1042530604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c0435a2f0 msgr2=0x562c04749270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f611e52c640 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c0435a2f0 0x562c04749270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f611e52c640 1 -- 172.21.15.92:0/1042530604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 msgr2=0x562c047a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f611e52c640 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 0x562c047a89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f611e52c640 1 -- 172.21.15.92:0/1042530604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c047a9080 con 0x562c04341d80 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f611e52c640 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c04748c90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f611403c670 tx=0x7f611403c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5d963e20f02bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f6101ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f6101ffb640 1 -- 172.21.15.92:0/1042530604 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114035070 con 0x562c04341d80 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f6101ffb640 1 -- 172.21.15.92:0/1042530604 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6114045870 con 0x562c04341d80 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6114040070 con 0x562c04341d80 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f6101ffb640 1 -- 172.21.15.92:0/1042530604 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f611406c050 con 0x562c04341d80 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f61277e0740 10 client.16695 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c047b0450 con 0x562c04341d80 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f6101ffb640 1 -- 172.21.15.92:0/1042530604 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6114040070 con 0x562c04341d80 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.464+0000 7f6101ffb640 1 -- 172.21.15.92:0/1042530604 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f611405c7e0 con 0x562c04341d80 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.465+0000 7f61277e0740 10 client.16695 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.465+0000 7f61277e0740 10 client.16695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.465+0000 7f61277e0740 20 client.16695 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.465+0000 7f61277e0740 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c043831b0 0x562c047b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.465+0000 7f61277e0740 4 client.16695 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:16:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.465+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562c0469b0f0 con 0x562c043831b0 2024-09-21T07:16:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.465+0000 7f611dd2b640 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c043831b0 0x562c047b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.466+0000 7f6101ffb640 10 client.16695 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.466+0000 7f611dd2b640 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c043831b0 0x562c047b2a70 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=312cda5caab529fa server_cookie=af7a9d6cf80309b2 in_seq=0 out_seq=0 2024-09-21T07:16:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f6101ffb640 1 -- 172.21.15.92:0/1042530604 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562c0469b0f0 con 0x562c043831b0 2024-09-21T07:16:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f6101ffb640 10 client.16695 handle_command_reply: tid=0 2024-09-21T07:16:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 client.16695 shutdown 2024-09-21T07:16:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 msgr2=0x562c04748c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c04748c90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f611403c670 tx=0x7f611403c6a0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 shutdown_connections 2024-09-21T07:16:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c043831b0 0x562c047b2a70 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c043624d0 0x562c047a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c0435a2f0 0x562c04749270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f6101ffb640 0 client.16695 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 --2- 172.21.15.92:0/1042530604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c04341d80 0x562c04748c90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 >> 172.21.15.92:0/1042530604 conn(0x562c04377300 msgr2=0x562c0472a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 shutdown_connections 2024-09-21T07:16:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 1 -- 172.21.15.92:0/1042530604 wait complete. 2024-09-21T07:16:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.476+0000 7f61277e0740 20 client.16695 trim_cache size 0 max 16384 2024-09-21T07:16:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:16:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:16:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:16:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:16:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 -- 172.21.15.92:0/1022856192 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61040b6680 msgr2=0x7f61040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61040b6680 0x7f61040b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f611000bfd0 tx=0x7f611000d040 comp rx=0 tx=0).stop 2024-09-21T07:16:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 -- 172.21.15.92:0/1022856192 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6118108300 msgr2=0x7f6118198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6118108300 0x7f6118198700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f611806c980 tx=0x7f610800ee50 comp rx=0 tx=0).stop 2024-09-21T07:16:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 -- 172.21.15.92:0/1022856192 shutdown_connections 2024-09-21T07:16:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f61040b6680 0x7f61040b8b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6118108c50 0x7f611819d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6118108300 0x7f6118198700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 --2- 172.21.15.92:0/1022856192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61181029d0 0x7f6118198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 -- 172.21.15.92:0/1022856192 >> 172.21.15.92:0/1022856192 conn(0x7f611807a6f0 msgr2=0x7f6118106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 -- 172.21.15.92:0/1022856192 shutdown_connections 2024-09-21T07:16:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:19.477+0000 7f6120790640 1 -- 172.21.15.92:0/1022856192 wait complete. 2024-09-21T07:16:20.033 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:19 smithi092 ceph-mon[30987]: pgmap v437: 129 pgs: 129 active+clean; 2.2 GiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-09-21T07:16:20.126 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b6b97c80', quiesce took 3.8 seconds. Will release after: 24.0 2024-09-21T07:16:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:19 smithi169 ceph-mon[33705]: pgmap v437: 129 pgs: 129 active+clean; 2.2 GiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-09-21T07:16:20.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:19 smithi175 ceph-mon[34064]: pgmap v437: 129 pgs: 129 active+clean; 2.2 GiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 16 MiB/s wr, 13 op/s 2024-09-21T07:16:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:20 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:16:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:20 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:16:21.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:20 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:16:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:21 smithi092 ceph-mon[30987]: pgmap v438: 129 pgs: 129 active+clean; 2.3 GiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 27 MiB/s wr, 19 op/s 2024-09-21T07:16:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:21 smithi169 ceph-mon[33705]: pgmap v438: 129 pgs: 129 active+clean; 2.3 GiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 27 MiB/s wr, 19 op/s 2024-09-21T07:16:22.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:21 smithi175 ceph-mon[34064]: pgmap v438: 129 pgs: 129 active+clean; 2.3 GiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 27 MiB/s wr, 19 op/s 2024-09-21T07:16:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:24 smithi175 ceph-mon[34064]: pgmap v439: 129 pgs: 129 active+clean; 2.8 GiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 67 MiB/s wr, 45 op/s 2024-09-21T07:16:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:24 smithi092 ceph-mon[30987]: pgmap v439: 129 pgs: 129 active+clean; 2.8 GiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 67 MiB/s wr, 45 op/s 2024-09-21T07:16:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:24 smithi169 ceph-mon[33705]: pgmap v439: 129 pgs: 129 active+clean; 2.8 GiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 67 MiB/s wr, 45 op/s 2024-09-21T07:16:27.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:26 smithi175 ceph-mon[34064]: pgmap v440: 129 pgs: 129 active+clean; 2.8 GiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 71 MiB/s wr, 54 op/s 2024-09-21T07:16:27.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:26 smithi092 ceph-mon[30987]: pgmap v440: 129 pgs: 129 active+clean; 2.8 GiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 71 MiB/s wr, 54 op/s 2024-09-21T07:16:27.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:26 smithi169 ceph-mon[33705]: pgmap v440: 129 pgs: 129 active+clean; 2.8 GiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 71 MiB/s wr, 54 op/s 2024-09-21T07:16:29.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:28 smithi175 ceph-mon[34064]: pgmap v441: 129 pgs: 129 active+clean; 2.8 GiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 71 MiB/s wr, 55 op/s 2024-09-21T07:16:29.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:28 smithi092 ceph-mon[30987]: pgmap v441: 129 pgs: 129 active+clean; 2.8 GiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 71 MiB/s wr, 55 op/s 2024-09-21T07:16:29.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:28 smithi169 ceph-mon[33705]: pgmap v441: 129 pgs: 129 active+clean; 2.8 GiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 71 MiB/s wr, 55 op/s 2024-09-21T07:16:31.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:30 smithi175 ceph-mon[34064]: pgmap v442: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 72 MiB/s wr, 54 op/s 2024-09-21T07:16:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:30 smithi092 ceph-mon[30987]: pgmap v442: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 72 MiB/s wr, 54 op/s 2024-09-21T07:16:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:30 smithi169 ceph-mon[33705]: pgmap v442: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 72 MiB/s wr, 54 op/s 2024-09-21T07:16:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.582+0000 7feb18ede640 1 -- 172.21.15.92:0/2189690797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb14108310 msgr2=0x7feb14108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.582+0000 7feb18ede640 1 --2- 172.21.15.92:0/2189690797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb14108310 0x7feb14108720 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7feb08009900 tx=0x7feb0802a410 comp rx=0 tx=0).stop 2024-09-21T07:16:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.582+0000 7feb18ede640 1 -- 172.21.15.92:0/2189690797 shutdown_connections 2024-09-21T07:16:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.582+0000 7feb18ede640 1 --2- 172.21.15.92:0/2189690797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb14108c60 0x7feb1410f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.582+0000 7feb18ede640 1 --2- 172.21.15.92:0/2189690797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb14108310 0x7feb14108720 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.582+0000 7feb18ede640 1 --2- 172.21.15.92:0/2189690797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb141029e0 0x7feb14102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.582+0000 7feb18ede640 1 -- 172.21.15.92:0/2189690797 >> 172.21.15.92:0/2189690797 conn(0x7feb140fe3e0 msgr2=0x7feb14100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.582+0000 7feb18ede640 1 -- 172.21.15.92:0/2189690797 shutdown_connections 2024-09-21T07:16:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.582+0000 7feb18ede640 1 -- 172.21.15.92:0/2189690797 wait complete. 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb18ede640 1 Processor -- start 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb18ede640 1 -- start start 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb18ede640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb141029e0 0x7feb14199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb18ede640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb14108310 0x7feb141998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb18ede640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb14108c60 0x7feb1419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb18ede640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb141127d0 con 0x7feb141029e0 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb18ede640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb14112650 con 0x7feb14108310 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb18ede640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb14112950 con 0x7feb14108c60 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb1259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb141029e0 0x7feb14199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb1259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb141029e0 0x7feb14199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54326/0 (socket says 172.21.15.92:54326) 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.583+0000 7feb1259c640 1 -- 172.21.15.92:0/3475983346 learned_addr learned my addr 172.21.15.92:0/3475983346 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb12d9d640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb14108c60 0x7feb1419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb1259c640 1 -- 172.21.15.92:0/3475983346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb14108c60 msgr2=0x7feb1419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb1259c640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb14108c60 0x7feb1419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb11d9b640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb14108310 0x7feb141998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb1259c640 1 -- 172.21.15.92:0/3475983346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb14108310 msgr2=0x7feb141998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb1259c640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb14108310 0x7feb141998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb1259c640 1 -- 172.21.15.92:0/3475983346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1419f240 con 0x7feb141029e0 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb1259c640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb141029e0 0x7feb14199310 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7feb0400eab0 tx=0x7feb0400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb037fe640 1 -- 172.21.15.92:0/3475983346 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0400ce40 con 0x7feb141029e0 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb037fe640 1 -- 172.21.15.92:0/3475983346 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb04011900 con 0x7feb141029e0 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb18ede640 1 -- 172.21.15.92:0/3475983346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1419f530 con 0x7feb141029e0 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb037fe640 1 -- 172.21.15.92:0/3475983346 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04010990 con 0x7feb141029e0 2024-09-21T07:16:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.584+0000 7feb18ede640 1 -- 172.21.15.92:0/3475983346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb141a5cc0 con 0x7feb141029e0 2024-09-21T07:16:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.587+0000 7feb1fe53740 1 Processor -- start 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.587+0000 7feb037fe640 1 -- 172.21.15.92:0/3475983346 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7feb04011470 con 0x7feb141029e0 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.587+0000 7feb1fe53740 1 -- start start 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.587+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa0059b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 0x5558aa006430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1fe53740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5558a9f7a6f0 con 0x5558a9c372f0 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1fe53740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5558a9f69b20 con 0x5558a9c3f4d0 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1fe53740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5558a9f6d930 con 0x5558a9c601b0 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa005ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54336/0 (socket says 172.21.15.92:54336) 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1259c640 1 -- 172.21.15.92:0/3506359027 learned_addr learned my addr 172.21.15.92:0/3506359027 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb12d9d640 1 --2- 172.21.15.92:0/3506359027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa0059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb11d9b640 1 --2- 172.21.15.92:0/3506359027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 0x5558aa006430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb037fe640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feafc0b6700 0x7feafc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1259c640 1 -- 172.21.15.92:0/3506359027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 msgr2=0x5558aa0059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1259c640 1 --2- 172.21.15.92:0/3506359027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa0059b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1259c640 1 -- 172.21.15.92:0/3506359027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 msgr2=0x5558aa006430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1259c640 1 --2- 172.21.15.92:0/3506359027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 0x5558aa006430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1259c640 1 -- 172.21.15.92:0/3506359027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558a9f2f530 con 0x5558a9c372f0 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb12d9d640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feafc0b6700 0x7feafc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb037fe640 1 -- 172.21.15.92:0/3475983346 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7feb040e8180 con 0x7feb141029e0 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.588+0000 7feb1259c640 1 --2- 172.21.15.92:0/3506359027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa005ef0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7feb040e54a0 tx=0x7feb040ade20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9c01ab37f71667 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.589+0000 7feb00ff9640 1 -- 172.21.15.92:0/3506359027 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb040ada00 con 0x5558a9c372f0 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.589+0000 7feb00ff9640 1 -- 172.21.15.92:0/3506359027 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb040ad740 con 0x5558a9c372f0 2024-09-21T07:16:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.589+0000 7feb00ff9640 1 -- 172.21.15.92:0/3506359027 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04011760 con 0x5558a9c372f0 2024-09-21T07:16:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 -- 172.21.15.92:0/3506359027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 msgr2=0x5558aa005ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb12d9d640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feafc0b6700 0x7feafc0b8c10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feb0c005d80 tx=0x7feb0c0046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 --2- 172.21.15.92:0/3506359027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa005ef0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7feb040e54a0 tx=0x7feb040ade20 comp rx=0 tx=0).stop 2024-09-21T07:16:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 -- 172.21.15.92:0/3506359027 shutdown_connections 2024-09-21T07:16:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 --2- 172.21.15.92:0/3506359027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 0x5558aa006430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 --2- 172.21.15.92:0/3506359027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa005ef0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 --2- 172.21.15.92:0/3506359027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa0059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 -- 172.21.15.92:0/3506359027 >> 172.21.15.92:0/3506359027 conn(0x5558a9c54300 msgr2=0x5558aa0038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 -- 172.21.15.92:0/3506359027 shutdown_connections 2024-09-21T07:16:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 -- 172.21.15.92:0/3506359027 wait complete. 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 -- start start 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 Processor -- start 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.590+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c372f0 0x5558aa013210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c3f4d0 0x5558aa013750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa01f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb1fe53740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5558a9ea1ab0 con 0x5558a9c3f4d0 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb1fe53740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5558a9f0f730 con 0x5558a9c372f0 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb1fe53740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5558aa016310 con 0x5558a9c601b0 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb1fe53740 10 client.0 _ll_register_callbacks cb 0x5558a9f636b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb11d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c3f4d0 0x5558aa013750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb11d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c3f4d0 0x5558aa013750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54346/0 (socket says 172.21.15.92:54346) 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb11d9b640 1 -- 172.21.15.92:0/655791956 learned_addr learned my addr 172.21.15.92:0/655791956 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb1259c640 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c372f0 0x5558aa013210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb12d9d640 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa01f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb11d9b640 1 -- 172.21.15.92:0/655791956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 msgr2=0x5558aa01f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb11d9b640 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa01f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb11d9b640 1 -- 172.21.15.92:0/655791956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c372f0 msgr2=0x5558aa013210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb11d9b640 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c372f0 0x5558aa013210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb11d9b640 1 -- 172.21.15.92:0/655791956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558a9ccb790 con 0x5558a9c3f4d0 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb1259c640 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c372f0 0x5558aa013210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb11d9b640 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c3f4d0 0x5558aa013750 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7feb08005940 tx=0x7feb08032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5255552c7741bf6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feaf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feaf9ffb640 1 -- 172.21.15.92:0/655791956 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08040070 con 0x5558a9c3f4d0 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feaf9ffb640 1 -- 172.21.15.92:0/655791956 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7feb08004040 con 0x5558a9c3f4d0 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.591+0000 7feb1fe53740 1 -- 172.21.15.92:0/655791956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb040ad740 con 0x5558a9c3f4d0 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feaf9ffb640 1 -- 172.21.15.92:0/655791956 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb08035040 con 0x5558a9c3f4d0 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feb1fe53740 10 client.16707 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feb1fe53740 1 -- 172.21.15.92:0/655791956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5558a9d44620 con 0x5558a9c3f4d0 2024-09-21T07:16:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feaf9ffb640 1 -- 172.21.15.92:0/655791956 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb040ad740 con 0x5558a9c3f4d0 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feaf9ffb640 1 -- 172.21.15.92:0/655791956 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7feb080046c0 con 0x5558a9c3f4d0 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feb1fe53740 10 client.16707 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feb1fe53740 10 client.16707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feb1fe53740 20 client.16707 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feb1fe53740 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5558a9c1ed80 0x5558aa0253b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feb1fe53740 4 client.16707 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feb1fe53740 1 -- 172.21.15.92:0/655791956 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558a9f7c640 con 0x5558a9c1ed80 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.592+0000 7feb1259c640 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5558a9c1ed80 0x5558aa0253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.593+0000 7feaf9ffb640 10 client.16707 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.593+0000 7feb1259c640 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5558a9c1ed80 0x5558aa0253b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e96fdcd5385a9627 server_cookie=6ee068a4e26caa6 in_seq=0 out_seq=0 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.593+0000 7feaf9ffb640 1 -- 172.21.15.92:0/655791956 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5558a9f7c640 con 0x5558a9c1ed80 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.593+0000 7feaf9ffb640 10 client.16707 handle_command_reply: tid=0 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 client.16707 shutdown 2024-09-21T07:16:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 -- 172.21.15.92:0/655791956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c3f4d0 msgr2=0x5558aa013750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c3f4d0 0x5558aa013750 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7feb08005940 tx=0x7feb08032dd0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 -- 172.21.15.92:0/655791956 shutdown_connections 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5558a9c1ed80 0x5558aa0253b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa01f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feaf9ffb640 0 client.16707 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c3f4d0 0x5558aa013750 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 --2- 172.21.15.92:0/655791956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c372f0 0x5558aa013210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 -- 172.21.15.92:0/655791956 >> 172.21.15.92:0/655791956 conn(0x5558a9c54300 msgr2=0x5558aa001ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 -- 172.21.15.92:0/655791956 shutdown_connections 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 1 -- 172.21.15.92:0/655791956 wait complete. 2024-09-21T07:16:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.594+0000 7feb1fe53740 20 client.16707 trim_cache size 0 max 16384 2024-09-21T07:16:32.609 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:16:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.608+0000 7feb1fe53740 1 Processor -- start 2024-09-21T07:16:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.608+0000 7feb1fe53740 1 -- start start 2024-09-21T07:16:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.608+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa0136f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.608+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 0x5558aa014e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa01f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1fe53740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb141aed10 con 0x5558a9c372f0 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1fe53740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb141b0850 con 0x5558a9c3f4d0 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1fe53740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb141af3e0 con 0x5558a9c601b0 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa0136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa0136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54354/0 (socket says 172.21.15.92:54354) 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1259c640 1 -- 172.21.15.92:0/3543858772 learned_addr learned my addr 172.21.15.92:0/3543858772 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb12d9d640 1 --2- 172.21.15.92:0/3543858772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa01f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb11d9b640 1 --2- 172.21.15.92:0/3543858772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 0x5558aa014e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1259c640 1 -- 172.21.15.92:0/3543858772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 msgr2=0x5558aa01f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1259c640 1 --2- 172.21.15.92:0/3543858772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa01f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1259c640 1 -- 172.21.15.92:0/3543858772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 msgr2=0x5558aa014e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1259c640 1 --2- 172.21.15.92:0/3543858772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 0x5558aa014e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1259c640 1 -- 172.21.15.92:0/3543858772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558aa007e40 con 0x5558a9c372f0 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb11d9b640 1 --2- 172.21.15.92:0/3543858772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 0x5558aa014e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feb1259c640 1 --2- 172.21.15.92:0/3543858772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa0136f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7feb040ea040 tx=0x7feb040ebe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc3f63761a3f2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feafbfff640 1 -- 172.21.15.92:0/3543858772 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb040ad3a0 con 0x5558a9c372f0 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feafbfff640 1 -- 172.21.15.92:0/3543858772 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb040ebaa0 con 0x5558a9c372f0 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.609+0000 7feafbfff640 1 -- 172.21.15.92:0/3543858772 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb040ad580 con 0x5558a9c372f0 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.610+0000 7feb1fe53740 1 -- 172.21.15.92:0/3543858772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 msgr2=0x5558aa0136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.610+0000 7feb1fe53740 1 --2- 172.21.15.92:0/3543858772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa0136f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7feb040ea040 tx=0x7feb040ebe00 comp rx=0 tx=0).stop 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.610+0000 7feb1fe53740 1 -- 172.21.15.92:0/3543858772 shutdown_connections 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.610+0000 7feb1fe53740 1 --2- 172.21.15.92:0/3543858772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c601b0 0x5558aa01f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.610+0000 7feb1fe53740 1 --2- 172.21.15.92:0/3543858772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c3f4d0 0x5558aa014e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.610+0000 7feb1fe53740 1 --2- 172.21.15.92:0/3543858772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa0136f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.610+0000 7feb1fe53740 1 -- 172.21.15.92:0/3543858772 >> 172.21.15.92:0/3543858772 conn(0x5558a9c54300 msgr2=0x5558aa014730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.610+0000 7feb1fe53740 1 -- 172.21.15.92:0/3543858772 shutdown_connections 2024-09-21T07:16:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.610+0000 7feb1fe53740 1 -- 172.21.15.92:0/3543858772 wait complete. 2024-09-21T07:16:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1fe53740 1 -- start start 2024-09-21T07:16:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1fe53740 1 Processor -- start 2024-09-21T07:16:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa01ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c3f4d0 0x5558aa01c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1fe53740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c601b0 0x5558aa0170e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1fe53740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb141b0180 con 0x5558a9c372f0 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1fe53740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb141afab0 con 0x5558a9c601b0 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1fe53740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb141accf0 con 0x5558a9c3f4d0 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1fe53740 10 client.0 _ll_register_callbacks cb 0x7feb08005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa01ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa01ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54364/0 (socket says 172.21.15.92:54364) 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.611+0000 7feb1259c640 1 -- 172.21.15.92:0/4073078472 learned_addr learned my addr 172.21.15.92:0/4073078472 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb1259c640 1 -- 172.21.15.92:0/4073078472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c3f4d0 msgr2=0x5558aa01c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb12d9d640 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c601b0 0x5558aa0170e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb11d9b640 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c3f4d0 0x5558aa01c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb1259c640 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c3f4d0 0x5558aa01c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb1259c640 1 -- 172.21.15.92:0/4073078472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c601b0 msgr2=0x5558aa0170e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb1259c640 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c601b0 0x5558aa0170e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb1259c640 1 -- 172.21.15.92:0/4073078472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558aa017870 con 0x5558a9c372f0 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb12d9d640 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c601b0 0x5558aa0170e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb1259c640 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa01ba70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7feb04010480 tx=0x7feb04095110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9881abae708ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feaf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feaf9ffb640 1 -- 172.21.15.92:0/4073078472 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb040ad580 con 0x5558a9c372f0 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feaf9ffb640 1 -- 172.21.15.92:0/4073078472 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7feb040a9ea0 con 0x5558a9c372f0 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb1fe53740 1 -- 172.21.15.92:0/4073078472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb040ebaa0 con 0x5558a9c372f0 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feaf9ffb640 1 -- 172.21.15.92:0/4073078472 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb04011760 con 0x5558a9c372f0 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb1fe53740 10 client.16713 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feb1fe53740 1 -- 172.21.15.92:0/4073078472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5558aa08f980 con 0x5558a9c372f0 2024-09-21T07:16:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feaf9ffb640 1 -- 172.21.15.92:0/4073078472 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb040ebaa0 con 0x5558a9c372f0 2024-09-21T07:16:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.612+0000 7feaf9ffb640 1 -- 172.21.15.92:0/4073078472 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7feb0400f040 con 0x5558a9c372f0 2024-09-21T07:16:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.613+0000 7feb1fe53740 10 client.16713 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.613+0000 7feb1fe53740 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.613+0000 7feb1fe53740 20 client.16713 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.613+0000 7feb1fe53740 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5558a9bf41c0 0x5558aa091c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.613+0000 7feb1fe53740 4 client.16713 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:16:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.613+0000 7feb1fe53740 1 -- 172.21.15.92:0/4073078472 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5558a9f780f0 con 0x5558a9bf41c0 2024-09-21T07:16:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.613+0000 7feb11d9b640 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5558a9bf41c0 0x5558aa091c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.613+0000 7feb11d9b640 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5558a9bf41c0 0x5558aa091c00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2fd4f0b3caf3526 server_cookie=6e668ff3e5513205 in_seq=0 out_seq=0 2024-09-21T07:16:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.613+0000 7feaf9ffb640 10 client.16713 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.621+0000 7feaf9ffb640 1 -- 172.21.15.92:0/4073078472 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5558a9f780f0 con 0x5558a9bf41c0 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.621+0000 7feaf9ffb640 10 client.16713 handle_command_reply: tid=0 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.621+0000 7feb1fe53740 1 client.16713 shutdown 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.621+0000 7feb1fe53740 1 -- 172.21.15.92:0/4073078472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 msgr2=0x5558aa01ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.621+0000 7feb1fe53740 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa01ba70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7feb04010480 tx=0x7feb04095110 comp rx=0 tx=0).stop 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb1fe53740 1 -- 172.21.15.92:0/4073078472 shutdown_connections 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb1fe53740 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5558a9bf41c0 0x5558aa091c00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb1fe53740 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558a9c601b0 0x5558aa0170e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feaf9ffb640 0 client.16713 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb1fe53740 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558a9c3f4d0 0x5558aa01c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb1fe53740 1 --2- 172.21.15.92:0/4073078472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558a9c372f0 0x5558aa01ba70 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb1fe53740 1 -- 172.21.15.92:0/4073078472 >> 172.21.15.92:0/4073078472 conn(0x5558a9c54300 msgr2=0x5558aa0069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb1fe53740 1 -- 172.21.15.92:0/4073078472 shutdown_connections 2024-09-21T07:16:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb1fe53740 1 -- 172.21.15.92:0/4073078472 wait complete. 2024-09-21T07:16:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb1fe53740 20 client.16713 trim_cache size 0 max 16384 2024-09-21T07:16:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:16:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:16:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:16:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:16:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb18ede640 1 -- 172.21.15.92:0/3475983346 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feafc0b6700 msgr2=0x7feafc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb18ede640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feafc0b6700 0x7feafc0b8c10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feb0c005d80 tx=0x7feb0c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb18ede640 1 -- 172.21.15.92:0/3475983346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb141029e0 msgr2=0x7feb14199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb18ede640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb141029e0 0x7feb14199310 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7feb0400eab0 tx=0x7feb0400ef70 comp rx=0 tx=0).stop 2024-09-21T07:16:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb18ede640 1 -- 172.21.15.92:0/3475983346 shutdown_connections 2024-09-21T07:16:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb18ede640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feafc0b6700 0x7feafc0b8c10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb18ede640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb14108c60 0x7feb1419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb18ede640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb14108310 0x7feb141998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb18ede640 1 --2- 172.21.15.92:0/3475983346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb141029e0 0x7feb14199310 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.622+0000 7feb18ede640 1 -- 172.21.15.92:0/3475983346 >> 172.21.15.92:0/3475983346 conn(0x7feb140fe3e0 msgr2=0x7feb14100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.623+0000 7feb18ede640 1 -- 172.21.15.92:0/3475983346 shutdown_connections 2024-09-21T07:16:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:32.623+0000 7feb18ede640 1 -- 172.21.15.92:0/3475983346 wait complete. 2024-09-21T07:16:32.860 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:32.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:32 smithi092 ceph-mon[30987]: pgmap v443: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 56 MiB/s wr, 50 op/s 2024-09-21T07:16:33.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:32 smithi175 ceph-mon[34064]: pgmap v443: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 56 MiB/s wr, 50 op/s 2024-09-21T07:16:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:32 smithi169 ceph-mon[33705]: pgmap v443: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 56 MiB/s wr, 50 op/s 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.483+0000 7eff32ea3640 1 -- 172.21.15.92:0/531609223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c1094a0 msgr2=0x7eff2c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.483+0000 7eff32ea3640 1 --2- 172.21.15.92:0/531609223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c1094a0 0x7eff2c1098b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7eff18009900 tx=0x7eff1802a410 comp rx=0 tx=0).stop 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.483+0000 7eff32ea3640 1 -- 172.21.15.92:0/531609223 shutdown_connections 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.483+0000 7eff32ea3640 1 --2- 172.21.15.92:0/531609223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c109df0 0x7eff2c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.483+0000 7eff32ea3640 1 --2- 172.21.15.92:0/531609223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c1094a0 0x7eff2c1098b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.483+0000 7eff32ea3640 1 --2- 172.21.15.92:0/531609223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff2c103b60 0x7eff2c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.483+0000 7eff32ea3640 1 -- 172.21.15.92:0/531609223 >> 172.21.15.92:0/531609223 conn(0x7eff2c07b850 msgr2=0x7eff2c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.484+0000 7eff32ea3640 1 -- 172.21.15.92:0/531609223 shutdown_connections 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.484+0000 7eff32ea3640 1 -- 172.21.15.92:0/531609223 wait complete. 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.484+0000 7eff32ea3640 1 Processor -- start 2024-09-21T07:16:33.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.484+0000 7eff32ea3640 1 -- start start 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.484+0000 7eff32ea3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff2c103b60 0x7eff2c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.484+0000 7eff32ea3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c1094a0 0x7eff2c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff32ea3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c109df0 0x7eff2c1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff32ea3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c113960 con 0x7eff2c109df0 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff32ea3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1137e0 con 0x7eff2c103b60 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff32ea3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c113ae0 con 0x7eff2c1094a0 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff31440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c109df0 0x7eff2c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff31440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c109df0 0x7eff2c1a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54380/0 (socket says 172.21.15.92:54380) 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff31440640 1 -- 172.21.15.92:0/3684127663 learned_addr learned my addr 172.21.15.92:0/3684127663 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff30c3f640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff2c103b60 0x7eff2c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff2bfff640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c1094a0 0x7eff2c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff31440640 1 -- 172.21.15.92:0/3684127663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c1094a0 msgr2=0x7eff2c19cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff31440640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c1094a0 0x7eff2c19cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff31440640 1 -- 172.21.15.92:0/3684127663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff2c103b60 msgr2=0x7eff2c19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff31440640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff2c103b60 0x7eff2c19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff31440640 1 -- 172.21.15.92:0/3684127663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c1a2540 con 0x7eff2c109df0 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff31440640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c109df0 0x7eff2c1a1e10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7eff2400eaa0 tx=0x7eff2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff29ffb640 1 -- 172.21.15.92:0/3684127663 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2400cdb0 con 0x7eff2c109df0 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff32ea3640 1 -- 172.21.15.92:0/3684127663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2c1a2830 con 0x7eff2c109df0 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff29ffb640 1 -- 172.21.15.92:0/3684127663 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff24005020 con 0x7eff2c109df0 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.485+0000 7eff29ffb640 1 -- 172.21.15.92:0/3684127663 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff240116d0 con 0x7eff2c109df0 2024-09-21T07:16:33.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.486+0000 7eff32ea3640 1 -- 172.21.15.92:0/3684127663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff2c1a8f90 con 0x7eff2c109df0 2024-09-21T07:16:33.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.488+0000 7eff39417740 1 Processor -- start 2024-09-21T07:16:33.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.488+0000 7eff29ffb640 1 -- 172.21.15.92:0/3684127663 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7eff240051d0 con 0x7eff2c109df0 2024-09-21T07:16:33.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.488+0000 7eff39417740 1 -- start start 2024-09-21T07:16:33.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff39417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 0x55b377227650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff39417740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e571b0 0x55b377227b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff39417740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e5f390 0x55b3772280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff39417740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b37719de50 con 0x55b376e5f390 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff39417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b37718d280 con 0x55b376e80070 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff39417740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b377191090 con 0x55b376e571b0 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e5f390 0x55b3772280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e5f390 0x55b3772280d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54390/0 (socket says 172.21.15.92:54390) 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff2bfff640 1 -- 172.21.15.92:0/1772773133 learned_addr learned my addr 172.21.15.92:0/1772773133 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff30c3f640 1 --2- 172.21.15.92:0/1772773133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e571b0 0x55b377227b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff2bfff640 1 --2- 172.21.15.92:0/1772773133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 0x55b377227650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff2bfff640 1 -- 172.21.15.92:0/1772773133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e571b0 msgr2=0x55b377227b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff2bfff640 1 --2- 172.21.15.92:0/1772773133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e571b0 0x55b377227b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff2bfff640 1 -- 172.21.15.92:0/1772773133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 msgr2=0x55b377227650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff2bfff640 1 --2- 172.21.15.92:0/1772773133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 0x55b377227650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff2bfff640 1 -- 172.21.15.92:0/1772773133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b376eeb650 con 0x55b376e5f390 2024-09-21T07:16:33.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff29ffb640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff1c0b6680 0x7eff1c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff2bfff640 1 --2- 172.21.15.92:0/1772773133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e5f390 0x55b3772280d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7eff18005ab0 tx=0x7eff18005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5f55ea2687f032 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:33.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff30c3f640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff1c0b6680 0x7eff1c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff29ffb640 1 -- 172.21.15.92:0/3684127663 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7eff240e7d50 con 0x7eff2c109df0 2024-09-21T07:16:33.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.489+0000 7eff16ffd640 1 -- 172.21.15.92:0/1772773133 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18035040 con 0x55b376e5f390 2024-09-21T07:16:33.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.490+0000 7eff16ffd640 1 -- 172.21.15.92:0/1772773133 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff18004030 con 0x55b376e5f390 2024-09-21T07:16:33.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.490+0000 7eff16ffd640 1 -- 172.21.15.92:0/1772773133 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180039e0 con 0x55b376e5f390 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 -- 172.21.15.92:0/1772773133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e5f390 msgr2=0x55b3772280d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 --2- 172.21.15.92:0/1772773133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e5f390 0x55b3772280d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7eff18005ab0 tx=0x7eff18005a40 comp rx=0 tx=0).stop 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff30c3f640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff1c0b6680 0x7eff1c0b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7eff20005fd0 tx=0x7eff20005f20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 -- 172.21.15.92:0/1772773133 shutdown_connections 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 --2- 172.21.15.92:0/1772773133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e5f390 0x55b3772280d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 --2- 172.21.15.92:0/1772773133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e571b0 0x55b377227b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 --2- 172.21.15.92:0/1772773133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 0x55b377227650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 -- 172.21.15.92:0/1772773133 >> 172.21.15.92:0/1772773133 conn(0x55b376e74460 msgr2=0x55b377225540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 -- 172.21.15.92:0/1772773133 shutdown_connections 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 -- 172.21.15.92:0/1772773133 wait complete. 2024-09-21T07:16:33.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 -- start start 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.491+0000 7eff39417740 1 Processor -- start 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff39417740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377232c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff39417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e5f390 0x55b3772331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff39417740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e80070 0x55b377233750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff39417740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b376fee700 con 0x55b376e571b0 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff39417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b377128110 con 0x55b376e5f390 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff39417740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b377235dd0 con 0x55b376e80070 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff30c3f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377232c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff30c3f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377232c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54402/0 (socket says 172.21.15.92:54402) 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff30c3f640 1 -- 172.21.15.92:0/3877349502 learned_addr learned my addr 172.21.15.92:0/3877349502 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff39417740 10 client.0 _ll_register_callbacks cb 0x55b377141990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff31440640 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e80070 0x55b377233750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff2bfff640 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e5f390 0x55b3772331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff30c3f640 1 -- 172.21.15.92:0/3877349502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e80070 msgr2=0x55b377233750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff30c3f640 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e80070 0x55b377233750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff30c3f640 1 -- 172.21.15.92:0/3877349502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e5f390 msgr2=0x55b3772331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff30c3f640 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e5f390 0x55b3772331d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff30c3f640 1 -- 172.21.15.92:0/3877349502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b377155c40 con 0x55b376e571b0 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff31440640 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e80070 0x55b377233750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff30c3f640 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377232c90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7eff20011b00 tx=0x7eff200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4178ce3abe74d62a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.492+0000 7eff0bfff640 1 -- 172.21.15.92:0/3877349502 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2000ee50 con 0x55b376e571b0 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff39417740 1 -- 172.21.15.92:0/3877349502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff18004030 con 0x55b376e571b0 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff0bfff640 1 -- 172.21.15.92:0/3877349502 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7eff20004020 con 0x55b376e571b0 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff0bfff640 1 -- 172.21.15.92:0/3877349502 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7eff2002e050 con 0x55b376e571b0 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff39417740 10 client.16725 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff39417740 1 -- 172.21.15.92:0/3877349502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b377241b60 con 0x55b376e571b0 2024-09-21T07:16:33.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff0bfff640 1 -- 172.21.15.92:0/3877349502 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff18004030 con 0x55b376e571b0 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff0bfff640 1 -- 172.21.15.92:0/3877349502 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7eff2001e420 con 0x55b376e571b0 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff39417740 10 client.16725 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff39417740 10 client.16725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff39417740 20 client.16725 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff39417740 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b376e3e9f0 0x55b377245030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff39417740 4 client.16725 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.493+0000 7eff39417740 1 -- 172.21.15.92:0/3877349502 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b37719fda0 con 0x55b376e3e9f0 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.494+0000 7eff2bfff640 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b376e3e9f0 0x55b377245030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.494+0000 7eff2bfff640 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b376e3e9f0 0x55b377245030 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb2445f2c84ab075 server_cookie=23fe2eb0f95eba62 in_seq=0 out_seq=0 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.494+0000 7eff0bfff640 10 client.16725 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff0bfff640 1 -- 172.21.15.92:0/3877349502 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b37719fda0 con 0x55b376e3e9f0 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff0bfff640 10 client.16725 handle_command_reply: tid=0 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 client.16725 shutdown 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 -- 172.21.15.92:0/3877349502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 msgr2=0x55b377232c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:33.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377232c90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7eff20011b00 tx=0x7eff200046c0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 -- 172.21.15.92:0/3877349502 shutdown_connections 2024-09-21T07:16:33.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b376e3e9f0 0x55b377245030 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e80070 0x55b377233750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e5f390 0x55b3772331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 --2- 172.21.15.92:0/3877349502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377232c90 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 -- 172.21.15.92:0/3877349502 >> 172.21.15.92:0/3877349502 conn(0x55b376e74460 msgr2=0x55b37722a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:33.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff0bfff640 0 client.16725 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:33.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 -- 172.21.15.92:0/3877349502 shutdown_connections 2024-09-21T07:16:33.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 1 -- 172.21.15.92:0/3877349502 wait complete. 2024-09-21T07:16:33.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.495+0000 7eff39417740 20 client.16725 trim_cache size 0 max 16384 2024-09-21T07:16:33.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff39417740 1 Processor -- start 2024-09-21T07:16:33.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff39417740 1 -- start start 2024-09-21T07:16:33.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff39417740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e571b0 0x55b377233150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff39417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e5f390 0x55b3772250b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff39417740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e80070 0x55b37722fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff39417740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1b2fa0 con 0x55b376e80070 2024-09-21T07:16:33.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff39417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1b4ae0 con 0x55b376e5f390 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff39417740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1b3670 con 0x55b376e571b0 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff31440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e80070 0x55b37722fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff31440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e80070 0x55b37722fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54406/0 (socket says 172.21.15.92:54406) 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff31440640 1 -- 172.21.15.92:0/3075678427 learned_addr learned my addr 172.21.15.92:0/3075678427 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff30c3f640 1 --2- 172.21.15.92:0/3075678427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e571b0 0x55b377233150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff2bfff640 1 --2- 172.21.15.92:0/3075678427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e5f390 0x55b3772250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff31440640 1 -- 172.21.15.92:0/3075678427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e571b0 msgr2=0x55b377233150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff31440640 1 --2- 172.21.15.92:0/3075678427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e571b0 0x55b377233150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff31440640 1 -- 172.21.15.92:0/3075678427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e5f390 msgr2=0x55b3772250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff31440640 1 --2- 172.21.15.92:0/3075678427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e5f390 0x55b3772250b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff31440640 1 -- 172.21.15.92:0/3075678427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b377231bf0 con 0x55b376e80070 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff31440640 1 --2- 172.21.15.92:0/3075678427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e80070 0x55b37722fe80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7eff240ad500 tx=0x7eff240ad310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4da3a8ef30fe7a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff167fc640 1 -- 172.21.15.92:0/3075678427 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff240b2020 con 0x55b376e80070 2024-09-21T07:16:33.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff167fc640 1 -- 172.21.15.92:0/3075678427 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff240b22e0 con 0x55b376e80070 2024-09-21T07:16:33.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.513+0000 7eff167fc640 1 -- 172.21.15.92:0/3075678427 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2401f040 con 0x55b376e80070 2024-09-21T07:16:33.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.514+0000 7eff39417740 1 -- 172.21.15.92:0/3075678427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e80070 msgr2=0x55b37722fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:33.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.514+0000 7eff39417740 1 --2- 172.21.15.92:0/3075678427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e80070 0x55b37722fe80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7eff240ad500 tx=0x7eff240ad310 comp rx=0 tx=0).stop 2024-09-21T07:16:33.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.514+0000 7eff39417740 1 -- 172.21.15.92:0/3075678427 shutdown_connections 2024-09-21T07:16:33.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.514+0000 7eff39417740 1 --2- 172.21.15.92:0/3075678427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e80070 0x55b37722fe80 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.514+0000 7eff39417740 1 --2- 172.21.15.92:0/3075678427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e5f390 0x55b3772250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.514+0000 7eff39417740 1 --2- 172.21.15.92:0/3075678427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e571b0 0x55b377233150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.514+0000 7eff39417740 1 -- 172.21.15.92:0/3075678427 >> 172.21.15.92:0/3075678427 conn(0x55b376e74460 msgr2=0x55b377232a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.514+0000 7eff39417740 1 -- 172.21.15.92:0/3075678427 shutdown_connections 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.514+0000 7eff39417740 1 -- 172.21.15.92:0/3075678427 wait complete. 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.514+0000 7eff39417740 1 -- start start 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff39417740 1 Processor -- start 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff39417740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377237290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff39417740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e5f390 0x55b3772377d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff39417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 0x55b377237d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff39417740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1b4410 con 0x55b376e571b0 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff39417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1b3d40 con 0x55b376e80070 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff39417740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1b0f80 con 0x55b376e5f390 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff39417740 10 client.0 _ll_register_callbacks cb 0x7eff2000c430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:33.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff30c3f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377237290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff30c3f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377237290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54416/0 (socket says 172.21.15.92:54416) 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff30c3f640 1 -- 172.21.15.92:0/3296026664 learned_addr learned my addr 172.21.15.92:0/3296026664 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff31440640 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 0x55b377237d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff30c3f640 1 -- 172.21.15.92:0/3296026664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e5f390 msgr2=0x55b3772377d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff30c3f640 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e5f390 0x55b3772377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff30c3f640 1 -- 172.21.15.92:0/3296026664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 msgr2=0x55b377237d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff30c3f640 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 0x55b377237d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff30c3f640 1 -- 172.21.15.92:0/3296026664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3772aec30 con 0x55b376e571b0 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.515+0000 7eff31440640 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 0x55b377237d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff30c3f640 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377237290 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7eff20000c00 tx=0x7eff2000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50032ee7c1ed9fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff0bfff640 1 -- 172.21.15.92:0/3296026664 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2001ecb0 con 0x55b376e571b0 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff0bfff640 1 -- 172.21.15.92:0/3296026664 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7eff20005040 con 0x55b376e571b0 2024-09-21T07:16:33.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff39417740 1 -- 172.21.15.92:0/3296026664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff240b22e0 con 0x55b376e571b0 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff0bfff640 1 -- 172.21.15.92:0/3296026664 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7eff20005240 con 0x55b376e571b0 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff39417740 10 client.16731 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff39417740 1 -- 172.21.15.92:0/3296026664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b3772afea0 con 0x55b376e571b0 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff0bfff640 1 -- 172.21.15.92:0/3296026664 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff240b22e0 con 0x55b376e571b0 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff0bfff640 1 -- 172.21.15.92:0/3296026664 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7eff2003e500 con 0x55b376e571b0 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff39417740 10 client.16731 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff39417740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.516+0000 7eff39417740 20 client.16731 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.517+0000 7eff39417740 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b376e13da0 0x55b3772b2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.517+0000 7eff39417740 4 client.16731 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.517+0000 7eff39417740 1 -- 172.21.15.92:0/3296026664 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b37719b850 con 0x55b376e13da0 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.517+0000 7eff2bfff640 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b376e13da0 0x55b3772b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:33.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.517+0000 7eff0bfff640 10 client.16731 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.517+0000 7eff2bfff640 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b376e13da0 0x55b3772b2690 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2ccd71e6157c07 server_cookie=864575e4db6a56d2 in_seq=0 out_seq=0 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.517+0000 7eff0bfff640 1 -- 172.21.15.92:0/3296026664 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55b37719b850 con 0x55b376e13da0 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.517+0000 7eff0bfff640 10 client.16731 handle_command_reply: tid=0 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.517+0000 7eff39417740 1 client.16731 shutdown 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 1 -- 172.21.15.92:0/3296026664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 msgr2=0x55b377237290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377237290 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7eff20000c00 tx=0x7eff2000ef50 comp rx=0 tx=0).stop 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 1 -- 172.21.15.92:0/3296026664 shutdown_connections 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b376e13da0 0x55b3772b2690 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b376e80070 0x55b377237d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b376e5f390 0x55b3772377d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff0bfff640 0 client.16731 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 1 --2- 172.21.15.92:0/3296026664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b376e571b0 0x55b377237290 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 1 -- 172.21.15.92:0/3296026664 >> 172.21.15.92:0/3296026664 conn(0x55b376e74460 msgr2=0x55b37723e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:33.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 1 -- 172.21.15.92:0/3296026664 shutdown_connections 2024-09-21T07:16:33.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 1 -- 172.21.15.92:0/3296026664 wait complete. 2024-09-21T07:16:33.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.518+0000 7eff39417740 20 client.16731 trim_cache size 0 max 16384 2024-09-21T07:16:33.526 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:16:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:16:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:16:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:16:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:16:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:33.529 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:16:33.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 -- 172.21.15.92:0/3684127663 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff1c0b6680 msgr2=0x7eff1c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:33.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff1c0b6680 0x7eff1c0b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7eff20005fd0 tx=0x7eff20005f20 comp rx=0 tx=0).stop 2024-09-21T07:16:33.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 -- 172.21.15.92:0/3684127663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c109df0 msgr2=0x7eff2c1a1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:33.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c109df0 0x7eff2c1a1e10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7eff2400eaa0 tx=0x7eff2400ef60 comp rx=0 tx=0).stop 2024-09-21T07:16:33.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 -- 172.21.15.92:0/3684127663 shutdown_connections 2024-09-21T07:16:33.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7eff1c0b6680 0x7eff1c0b8b90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff2c109df0 0x7eff2c1a1e10 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c1094a0 0x7eff2c19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 --2- 172.21.15.92:0/3684127663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7eff2c103b60 0x7eff2c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:33.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 -- 172.21.15.92:0/3684127663 >> 172.21.15.92:0/3684127663 conn(0x7eff2c07b850 msgr2=0x7eff2c1052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:33.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 -- 172.21.15.92:0/3684127663 shutdown_connections 2024-09-21T07:16:33.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:33.519+0000 7eff32ea3640 1 -- 172.21.15.92:0/3684127663 wait complete. 2024-09-21T07:16:34.530 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:16:34.531 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:16:34.818 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:35.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:34 smithi175 ceph-mon[34064]: pgmap v444: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 MiB/s wr, 46 op/s 2024-09-21T07:16:35.078 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:34 smithi092 ceph-mon[30987]: pgmap v444: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 MiB/s wr, 46 op/s 2024-09-21T07:16:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:34 smithi169 ceph-mon[33705]: pgmap v444: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 MiB/s wr, 46 op/s 2024-09-21T07:16:35.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.294+0000 7f04d7c54640 1 -- 172.21.15.92:0/453820436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d0109df0 msgr2=0x7f04d0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.294+0000 7f04d7c54640 1 --2- 172.21.15.92:0/453820436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d0109df0 0x7f04d0110620 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009ca0 tx=0x7f04c802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.294+0000 7f04d7c54640 1 -- 172.21.15.92:0/453820436 shutdown_connections 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.294+0000 7f04d7c54640 1 --2- 172.21.15.92:0/453820436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d0109df0 0x7f04d0110620 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.294+0000 7f04d7c54640 1 --2- 172.21.15.92:0/453820436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04d01094a0 0x7f04d01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.294+0000 7f04d7c54640 1 --2- 172.21.15.92:0/453820436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d0103b60 0x7f04d0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.294+0000 7f04d7c54640 1 -- 172.21.15.92:0/453820436 >> 172.21.15.92:0/453820436 conn(0x7f04d007b850 msgr2=0x7f04d007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.294+0000 7f04d7c54640 1 -- 172.21.15.92:0/453820436 shutdown_connections 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.294+0000 7f04d7c54640 1 -- 172.21.15.92:0/453820436 wait complete. 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.294+0000 7f04d7c54640 1 Processor -- start 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d7c54640 1 -- start start 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d7c54640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d0103b60 0x7f04d019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:35.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d7c54640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d01094a0 0x7f04d019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d7c54640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04d0109df0 0x7f04d019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d7c54640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f04d01139b0 con 0x7f04d0103b60 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d7c54640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f04d0113830 con 0x7f04d0109df0 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d7c54640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04d0113b30 con 0x7f04d01094a0 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d59f0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d0103b60 0x7f04d019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d59f0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d0103b60 0x7f04d019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54438/0 (socket says 172.21.15.92:54438) 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d59f0640 1 -- 172.21.15.92:0/2017778360 learned_addr learned my addr 172.21.15.92:0/2017778360 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d51ef640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d01094a0 0x7f04d019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d61f1640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04d0109df0 0x7f04d019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d59f0640 1 -- 172.21.15.92:0/2017778360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d01094a0 msgr2=0x7f04d019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d59f0640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d01094a0 0x7f04d019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d59f0640 1 -- 172.21.15.92:0/2017778360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04d0109df0 msgr2=0x7f04d019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d59f0640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04d0109df0 0x7f04d019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d59f0640 1 -- 172.21.15.92:0/2017778360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d01a0370 con 0x7f04d0103b60 2024-09-21T07:16:35.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.295+0000 7f04d59f0640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d0103b60 0x7f04d019a4c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00d770 tx=0x7f04cc00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:35.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.296+0000 7f04c6ffd640 1 -- 172.21.15.92:0/2017778360 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc017070 con 0x7f04d0103b60 2024-09-21T07:16:35.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.296+0000 7f04d7c54640 1 -- 172.21.15.92:0/2017778360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d01a0660 con 0x7f04d0103b60 2024-09-21T07:16:35.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.296+0000 7f04c6ffd640 1 -- 172.21.15.92:0/2017778360 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04cc009820 con 0x7f04d0103b60 2024-09-21T07:16:35.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.296+0000 7f04c6ffd640 1 -- 172.21.15.92:0/2017778360 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc004b20 con 0x7f04d0103b60 2024-09-21T07:16:35.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.296+0000 7f04d7c54640 1 -- 172.21.15.92:0/2017778360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d01a6e80 con 0x7f04d0103b60 2024-09-21T07:16:35.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.297+0000 7f04d7c54640 1 -- 172.21.15.92:0/2017778360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d0104de0 con 0x7f04d0103b60 2024-09-21T07:16:35.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.298+0000 7f04c6ffd640 1 -- 172.21.15.92:0/2017778360 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f04cc0099d0 con 0x7f04d0103b60 2024-09-21T07:16:35.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.299+0000 7f04c6ffd640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04bc0b66b0 0x7f04bc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:35.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.299+0000 7f04d51ef640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04bc0b66b0 0x7f04bc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:35.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.300+0000 7f04c6ffd640 1 -- 172.21.15.92:0/2017778360 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f04cc0e7920 con 0x7f04d0103b60 2024-09-21T07:16:35.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.300+0000 7f04d51ef640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04bc0b66b0 0x7f04bc0b8bc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f04d01071a0 tx=0x7f04c000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:35.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.303+0000 7f04c6ffd640 1 -- 172.21.15.92:0/2017778360 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f04cc0adad0 con 0x7f04d0103b60 2024-09-21T07:16:35.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.522+0000 7f04d7c54640 1 -- 172.21.15.92:0/2017778360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04d010bbe0 con 0x7f04d0103b60 2024-09-21T07:16:35.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.523+0000 7f04c6ffd640 1 -- 172.21.15.92:0/2017778360 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f04cc0b1eb0 con 0x7f04d0103b60 2024-09-21T07:16:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:16:35.525 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:16:35.525 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:16:35.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 -- 172.21.15.92:0/2017778360 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04bc0b66b0 msgr2=0x7f04bc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:35.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04bc0b66b0 0x7f04bc0b8bc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f04d01071a0 tx=0x7f04c000a2d0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 -- 172.21.15.92:0/2017778360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d0103b60 msgr2=0x7f04d019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:35.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d0103b60 0x7f04d019a4c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00d770 tx=0x7f04cc00db70 comp rx=0 tx=0).stop 2024-09-21T07:16:35.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 -- 172.21.15.92:0/2017778360 shutdown_connections 2024-09-21T07:16:35.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04bc0b66b0 0x7f04bc0b8bc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04d0109df0 0x7f04d019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d01094a0 0x7f04d019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 --2- 172.21.15.92:0/2017778360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d0103b60 0x7f04d019a4c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:35.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 -- 172.21.15.92:0/2017778360 >> 172.21.15.92:0/2017778360 conn(0x7f04d007b850 msgr2=0x7f04d0105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:35.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 -- 172.21.15.92:0/2017778360 shutdown_connections 2024-09-21T07:16:35.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:35.525+0000 7f04d7c54640 1 -- 172.21.15.92:0/2017778360 wait complete. 2024-09-21T07:16:35.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:35 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2017778360' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:36.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:35 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2017778360' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:36.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:35 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2017778360' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:36.315 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:16:36.562 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:36.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:36 smithi092 ceph-mon[30987]: pgmap v445: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.9 MiB/s wr, 21 op/s 2024-09-21T07:16:37.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.054+0000 7fc54aefe640 1 -- 172.21.15.92:0/3766299934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc544102ae0 msgr2=0x7fc544102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:37.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.054+0000 7fc54aefe640 1 --2- 172.21.15.92:0/3766299934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc544102ae0 0x7fc544102ef0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc540009900 tx=0x7fc54002a410 comp rx=0 tx=0).stop 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.054+0000 7fc54aefe640 1 -- 172.21.15.92:0/3766299934 shutdown_connections 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.054+0000 7fc54aefe640 1 --2- 172.21.15.92:0/3766299934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544108d70 0x7fc54410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.054+0000 7fc54aefe640 1 --2- 172.21.15.92:0/3766299934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc544108420 0x7fc544108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.054+0000 7fc54aefe640 1 --2- 172.21.15.92:0/3766299934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc544102ae0 0x7fc544102ef0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.054+0000 7fc54aefe640 1 -- 172.21.15.92:0/3766299934 >> 172.21.15.92:0/3766299934 conn(0x7fc544079770 msgr2=0x7fc544079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.054+0000 7fc54aefe640 1 -- 172.21.15.92:0/3766299934 shutdown_connections 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.054+0000 7fc54aefe640 1 -- 172.21.15.92:0/3766299934 wait complete. 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.055+0000 7fc54aefe640 1 Processor -- start 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.055+0000 7fc54aefe640 1 -- start start 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.055+0000 7fc54aefe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544102ae0 0x7fc54419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc54aefe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc544108420 0x7fc54419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc54aefe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc544108d70 0x7fc54419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc54aefe640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc544112920 con 0x7fc544108420 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc54aefe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5441127a0 con 0x7fc544102ae0 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc54aefe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc544112aa0 con 0x7fc544108d70 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc544108420 0x7fc54419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc544108420 0x7fc54419b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54454/0 (socket says 172.21.15.92:54454) 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc53bfff640 1 -- 172.21.15.92:0/1721302279 learned_addr learned my addr 172.21.15.92:0/1721302279 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc548c9a640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544102ae0 0x7fc54419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc54949b640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc544108d70 0x7fc54419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc53bfff640 1 -- 172.21.15.92:0/1721302279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc544108d70 msgr2=0x7fc54419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc53bfff640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc544108d70 0x7fc54419bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc53bfff640 1 -- 172.21.15.92:0/1721302279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544102ae0 msgr2=0x7fc54419b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc53bfff640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544102ae0 0x7fc54419b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc53bfff640 1 -- 172.21.15.92:0/1721302279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5441a6590 con 0x7fc544108420 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc548c9a640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544102ae0 0x7fc54419b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc54949b640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc544108d70 0x7fc54419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:37.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc53bfff640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc544108420 0x7fc54419b810 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc534006fd0 tx=0x7fc53400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:37.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.056+0000 7fc539ffb640 1 -- 172.21.15.92:0/1721302279 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534011830 con 0x7fc544108420 2024-09-21T07:16:37.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.057+0000 7fc539ffb640 1 -- 172.21.15.92:0/1721302279 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc534016070 con 0x7fc544108420 2024-09-21T07:16:37.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.057+0000 7fc54aefe640 1 -- 172.21.15.92:0/1721302279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5441a6880 con 0x7fc544108420 2024-09-21T07:16:37.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.057+0000 7fc539ffb640 1 -- 172.21.15.92:0/1721302279 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534010d30 con 0x7fc544108420 2024-09-21T07:16:37.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.057+0000 7fc54aefe640 1 -- 172.21.15.92:0/1721302279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5441a6dc0 con 0x7fc544108420 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.059+0000 7fc539ffb640 1 -- 172.21.15.92:0/1721302279 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fc5340119d0 con 0x7fc544108420 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.059+0000 7fc551472740 1 Processor -- start 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.059+0000 7fc551472740 1 -- start start 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc551472740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a04719070 0x561a04ac02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc551472740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ac0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc551472740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f8390 0x561a04ac0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc551472740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a04a36ea0 con 0x561a046f01b0 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc551472740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561a04a262d0 con 0x561a04719070 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc551472740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561a04a2a0e0 con 0x561a046f8390 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc548c9a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ac0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc548c9a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ac0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54460/0 (socket says 172.21.15.92:54460) 2024-09-21T07:16:37.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc548c9a640 1 -- 172.21.15.92:0/3715096256 learned_addr learned my addr 172.21.15.92:0/3715096256 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc53bfff640 1 --2- 172.21.15.92:0/3715096256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f8390 0x561a04ac0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc54949b640 1 --2- 172.21.15.92:0/3715096256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a04719070 0x561a04ac02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc539ffb640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc52c0b6680 0x7fc52c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc548c9a640 1 -- 172.21.15.92:0/3715096256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f8390 msgr2=0x561a04ac0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc548c9a640 1 --2- 172.21.15.92:0/3715096256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f8390 0x561a04ac0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc548c9a640 1 -- 172.21.15.92:0/3715096256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a04719070 msgr2=0x561a04ac02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc548c9a640 1 --2- 172.21.15.92:0/3715096256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a04719070 0x561a04ac02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc548c9a640 1 -- 172.21.15.92:0/3715096256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a04784650 con 0x561a046f01b0 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc54949b640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc52c0b6680 0x7fc52c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc548c9a640 1 --2- 172.21.15.92:0/3715096256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ac0800 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc54002a930 tx=0x7fc540031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb15596520ede6ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.060+0000 7fc539ffb640 1 -- 172.21.15.92:0/1721302279 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc5340e70f0 con 0x7fc544108420 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.061+0000 7fc52affd640 1 -- 172.21.15.92:0/3715096256 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc540035030 con 0x561a046f01b0 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.061+0000 7fc52affd640 1 -- 172.21.15.92:0/3715096256 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc540005de0 con 0x561a046f01b0 2024-09-21T07:16:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.061+0000 7fc52affd640 1 -- 172.21.15.92:0/3715096256 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc540003b10 con 0x561a046f01b0 2024-09-21T07:16:37.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 -- 172.21.15.92:0/3715096256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 msgr2=0x561a04ac0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:37.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc54949b640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc52c0b6680 0x7fc52c0b8b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0113e0 tx=0x7fc53c004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:37.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 --2- 172.21.15.92:0/3715096256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ac0800 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc54002a930 tx=0x7fc540031dc0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 -- 172.21.15.92:0/3715096256 shutdown_connections 2024-09-21T07:16:37.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 --2- 172.21.15.92:0/3715096256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f8390 0x561a04ac0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 --2- 172.21.15.92:0/3715096256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ac0800 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 --2- 172.21.15.92:0/3715096256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a04719070 0x561a04ac02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 -- 172.21.15.92:0/3715096256 >> 172.21.15.92:0/3715096256 conn(0x561a0470d460 msgr2=0x561a04abe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 -- 172.21.15.92:0/3715096256 shutdown_connections 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 -- 172.21.15.92:0/3715096256 wait complete. 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 -- start start 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.062+0000 7fc551472740 1 Processor -- start 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc551472740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a046f01b0 0x561a04acb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc551472740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f8390 0x561a04acbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc551472740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a04719070 0x561a04ad7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc551472740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a04887700 con 0x561a046f8390 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc551472740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561a049c1160 con 0x561a046f01b0 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc551472740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561a04acea40 con 0x561a04719070 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc551472740 10 client.0 _ll_register_callbacks cb 0x561a049da9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f8390 0x561a04acbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f8390 0x561a04acbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54474/0 (socket says 172.21.15.92:54474) 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc53bfff640 1 -- 172.21.15.92:0/2504742926 learned_addr learned my addr 172.21.15.92:0/2504742926 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc548c9a640 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a046f01b0 0x561a04acb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc54949b640 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a04719070 0x561a04ad7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc53bfff640 1 -- 172.21.15.92:0/2504742926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a04719070 msgr2=0x561a04ad7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc53bfff640 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a04719070 0x561a04ad7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc53bfff640 1 -- 172.21.15.92:0/2504742926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a046f01b0 msgr2=0x561a04acb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc53bfff640 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a046f01b0 0x561a04acb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.063+0000 7fc53bfff640 1 -- 172.21.15.92:0/2504742926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a049eec90 con 0x561a046f8390 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc53bfff640 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f8390 0x561a04acbeb0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc5340e4aa0 tx=0x7fc534010fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd4b48e57e48050 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc523fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc523fff640 1 -- 172.21.15.92:0/2504742926 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5340a8a40 con 0x561a046f8390 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc523fff640 1 -- 172.21.15.92:0/2504742926 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc5340a8e10 con 0x561a046f8390 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc551472740 1 -- 172.21.15.92:0/2504742926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a04a38df0 con 0x561a046f8390 2024-09-21T07:16:37.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc523fff640 1 -- 172.21.15.92:0/2504742926 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc5340ac310 con 0x561a046f8390 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc551472740 10 client.16749 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc551472740 1 -- 172.21.15.92:0/2504742926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561a04ada710 con 0x561a046f8390 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc523fff640 1 -- 172.21.15.92:0/2504742926 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561a04a38df0 con 0x561a046f8390 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc523fff640 1 -- 172.21.15.92:0/2504742926 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc5340d00b0 con 0x561a046f8390 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc551472740 10 client.16749 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc551472740 10 client.16749 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc551472740 20 client.16749 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc551472740 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x561a046d79f0 0x561a04addc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc551472740 4 client.16749 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.064+0000 7fc551472740 1 -- 172.21.15.92:0/2504742926 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a04a348a0 con 0x561a046d79f0 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.065+0000 7fc548c9a640 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x561a046d79f0 0x561a04addc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.065+0000 7fc523fff640 10 client.16749 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:16:37.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.065+0000 7fc548c9a640 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x561a046d79f0 0x561a04addc20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=768ba02db7559924 server_cookie=9c3c32887744e0c2 in_seq=0 out_seq=0 2024-09-21T07:16:37.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc523fff640 1 -- 172.21.15.92:0/2504742926 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a04a348a0 con 0x561a046d79f0 2024-09-21T07:16:37.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc523fff640 10 client.16749 handle_command_reply: tid=0 2024-09-21T07:16:37.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 client.16749 shutdown 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 -- 172.21.15.92:0/2504742926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f8390 msgr2=0x561a04acbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f8390 0x561a04acbeb0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc5340e4aa0 tx=0x7fc534010fe0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 -- 172.21.15.92:0/2504742926 shutdown_connections 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x561a046d79f0 0x561a04addc20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a04719070 0x561a04ad7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f8390 0x561a04acbeb0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 --2- 172.21.15.92:0/2504742926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a046f01b0 0x561a04acb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 -- 172.21.15.92:0/2504742926 >> 172.21.15.92:0/2504742926 conn(0x561a0470d460 msgr2=0x561a04ac34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc523fff640 0 client.16749 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 -- 172.21.15.92:0/2504742926 shutdown_connections 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 1 -- 172.21.15.92:0/2504742926 wait complete. 2024-09-21T07:16:37.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.066+0000 7fc551472740 20 client.16749 trim_cache size 0 max 16384 2024-09-21T07:16:37.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.079+0000 7fc551472740 1 Processor -- start 2024-09-21T07:16:37.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.079+0000 7fc551472740 1 -- start start 2024-09-21T07:16:37.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc551472740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f01b0 0x561a04ac1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc551472740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a046f8390 0x561a04abd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc551472740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a04719070 0x561a04abdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc551472740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc5441b0f10 con 0x561a04719070 2024-09-21T07:16:37.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc551472740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5441b2a50 con 0x561a046f8390 2024-09-21T07:16:37.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc551472740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5441b15e0 con 0x561a046f01b0 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc54949b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a04719070 0x561a04abdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc54949b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a04719070 0x561a04abdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54484/0 (socket says 172.21.15.92:54484) 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc54949b640 1 -- 172.21.15.92:0/3833303470 learned_addr learned my addr 172.21.15.92:0/3833303470 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc548c9a640 1 --2- 172.21.15.92:0/3833303470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f01b0 0x561a04ac1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc53bfff640 1 --2- 172.21.15.92:0/3833303470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a046f8390 0x561a04abd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc54949b640 1 -- 172.21.15.92:0/3833303470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f01b0 msgr2=0x561a04ac1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc54949b640 1 --2- 172.21.15.92:0/3833303470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f01b0 0x561a04ac1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc54949b640 1 -- 172.21.15.92:0/3833303470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a046f8390 msgr2=0x561a04abd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc54949b640 1 --2- 172.21.15.92:0/3833303470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a046f8390 0x561a04abd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc54949b640 1 -- 172.21.15.92:0/3833303470 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a04acca10 con 0x561a04719070 2024-09-21T07:16:37.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc54949b640 1 --2- 172.21.15.92:0/3833303470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a04719070 0x561a04abdca0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc53c012a30 tx=0x7fc53c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460299b511695bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:37.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc52a7fc640 1 -- 172.21.15.92:0/3833303470 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c01b440 con 0x561a04719070 2024-09-21T07:16:37.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc52a7fc640 1 -- 172.21.15.92:0/3833303470 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc53c016070 con 0x561a04719070 2024-09-21T07:16:37.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.080+0000 7fc52a7fc640 1 -- 172.21.15.92:0/3833303470 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c01d910 con 0x561a04719070 2024-09-21T07:16:37.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.081+0000 7fc551472740 1 -- 172.21.15.92:0/3833303470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a04719070 msgr2=0x561a04abdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:37.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.081+0000 7fc551472740 1 --2- 172.21.15.92:0/3833303470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a04719070 0x561a04abdca0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc53c012a30 tx=0x7fc53c014000 comp rx=0 tx=0).stop 2024-09-21T07:16:37.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.081+0000 7fc551472740 1 -- 172.21.15.92:0/3833303470 shutdown_connections 2024-09-21T07:16:37.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.081+0000 7fc551472740 1 --2- 172.21.15.92:0/3833303470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a04719070 0x561a04abdca0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.081+0000 7fc551472740 1 --2- 172.21.15.92:0/3833303470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a046f8390 0x561a04abd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.081+0000 7fc551472740 1 --2- 172.21.15.92:0/3833303470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f01b0 0x561a04ac1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.081+0000 7fc551472740 1 -- 172.21.15.92:0/3833303470 >> 172.21.15.92:0/3833303470 conn(0x561a0470d460 msgr2=0x561a04ac12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.081+0000 7fc551472740 1 -- 172.21.15.92:0/3833303470 shutdown_connections 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.081+0000 7fc551472740 1 -- 172.21.15.92:0/3833303470 wait complete. 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc551472740 1 -- start start 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc551472740 1 Processor -- start 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc551472740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ad44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc551472740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f8390 0x561a04acf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc551472740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a04719070 0x561a04acfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc551472740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc5441b2380 con 0x561a046f01b0 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc551472740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5441b1cb0 con 0x561a04719070 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc551472740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5441aeef0 con 0x561a046f8390 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc548c9a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ad44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc551472740 10 client.0 _ll_register_callbacks cb 0x7fc5340ea930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc548c9a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ad44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54488/0 (socket says 172.21.15.92:54488) 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.082+0000 7fc548c9a640 1 -- 172.21.15.92:0/3217505168 learned_addr learned my addr 172.21.15.92:0/3217505168 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc53bfff640 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f8390 0x561a04acf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc548c9a640 1 -- 172.21.15.92:0/3217505168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f8390 msgr2=0x561a04acf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc54949b640 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a04719070 0x561a04acfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc548c9a640 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f8390 0x561a04acf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc548c9a640 1 -- 172.21.15.92:0/3217505168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a04719070 msgr2=0x561a04acfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc548c9a640 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a04719070 0x561a04acfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc548c9a640 1 -- 172.21.15.92:0/3217505168 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a04ad0680 con 0x561a046f01b0 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc548c9a640 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ad44c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc540031bd0 tx=0x7fc540003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdfa661c8cbf954 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc523fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc523fff640 1 -- 172.21.15.92:0/3217505168 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54005b070 con 0x561a046f01b0 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc523fff640 1 -- 172.21.15.92:0/3217505168 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc540051710 con 0x561a046f01b0 2024-09-21T07:16:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc551472740 1 -- 172.21.15.92:0/3217505168 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc53c016070 con 0x561a046f01b0 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc523fff640 1 -- 172.21.15.92:0/3217505168 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc540067050 con 0x561a046f01b0 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc551472740 10 client.16755 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc551472740 1 -- 172.21.15.92:0/3217505168 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561a04b48530 con 0x561a046f01b0 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.083+0000 7fc523fff640 1 -- 172.21.15.92:0/3217505168 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc53c016070 con 0x561a046f01b0 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.084+0000 7fc523fff640 1 -- 172.21.15.92:0/3217505168 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc540057970 con 0x561a046f01b0 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.084+0000 7fc551472740 10 client.16755 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.084+0000 7fc551472740 10 client.16755 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.084+0000 7fc551472740 20 client.16755 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.084+0000 7fc551472740 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x561a046acda0 0x561a04b4a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.084+0000 7fc551472740 4 client.16755 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.084+0000 7fc551472740 1 -- 172.21.15.92:0/3217505168 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a04a31cd0 con 0x561a046acda0 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.084+0000 7fc53bfff640 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x561a046acda0 0x561a04b4a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.084+0000 7fc53bfff640 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x561a046acda0 0x561a04b4a880 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fefd95d2f8fc1faf server_cookie=791e3f9c7d4d3d38 in_seq=0 out_seq=0 2024-09-21T07:16:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.084+0000 7fc523fff640 10 client.16755 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc523fff640 1 -- 172.21.15.92:0/3217505168 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a04a31cd0 con 0x561a046acda0 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc523fff640 10 client.16755 handle_command_reply: tid=0 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 client.16755 shutdown 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 -- 172.21.15.92:0/3217505168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 msgr2=0x561a04ad44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ad44c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc540031bd0 tx=0x7fc540003680 comp rx=0 tx=0).stop 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 -- 172.21.15.92:0/3217505168 shutdown_connections 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x561a046acda0 0x561a04b4a880 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a04719070 0x561a04acfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a046f8390 0x561a04acf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 --2- 172.21.15.92:0/3217505168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a046f01b0 0x561a04ad44c0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 -- 172.21.15.92:0/3217505168 >> 172.21.15.92:0/3217505168 conn(0x561a0470d460 msgr2=0x561a04ac1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc523fff640 0 client.16755 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 -- 172.21.15.92:0/3217505168 shutdown_connections 2024-09-21T07:16:37.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 1 -- 172.21.15.92:0/3217505168 wait complete. 2024-09-21T07:16:37.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.085+0000 7fc551472740 20 client.16755 trim_cache size 0 max 16384 2024-09-21T07:16:37.092 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:16:37.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 -- 172.21.15.92:0/1721302279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc52c0b6680 msgr2=0x7fc52c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:37.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc52c0b6680 0x7fc52c0b8b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0113e0 tx=0x7fc53c004a40 comp rx=0 tx=0).stop 2024-09-21T07:16:37.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 -- 172.21.15.92:0/1721302279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc544108420 msgr2=0x7fc54419b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:37.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc544108420 0x7fc54419b810 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc534006fd0 tx=0x7fc53400b8e0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 -- 172.21.15.92:0/1721302279 shutdown_connections 2024-09-21T07:16:37.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc52c0b6680 0x7fc52c0b8b90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc544108d70 0x7fc54419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc544108420 0x7fc54419b810 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 --2- 172.21.15.92:0/1721302279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544102ae0 0x7fc54419b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:37.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 -- 172.21.15.92:0/1721302279 >> 172.21.15.92:0/1721302279 conn(0x7fc544079770 msgr2=0x7fc544106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:37.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 -- 172.21.15.92:0/1721302279 shutdown_connections 2024-09-21T07:16:37.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:37.086+0000 7fc54aefe640 1 -- 172.21.15.92:0/1721302279 wait complete. 2024-09-21T07:16:37.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:36 smithi169 ceph-mon[33705]: pgmap v445: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.9 MiB/s wr, 21 op/s 2024-09-21T07:16:37.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:36 smithi175 ceph-mon[34064]: pgmap v445: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.9 MiB/s wr, 21 op/s 2024-09-21T07:16:37.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:16:38.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:37 smithi092 ceph-mon[30987]: pgmap v446: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 631 KiB/s wr, 13 op/s 2024-09-21T07:16:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:37 smithi169 ceph-mon[33705]: pgmap v446: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 631 KiB/s wr, 13 op/s 2024-09-21T07:16:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:38.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:37 smithi175 ceph-mon[34064]: pgmap v446: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 631 KiB/s wr, 13 op/s 2024-09-21T07:16:38.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.919+0000 7fd7ac905640 1 -- 172.21.15.92:0/1746983696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7a8108cf0 msgr2=0x7fd7a810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:38.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.919+0000 7fd7ac905640 1 --2- 172.21.15.92:0/1746983696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7a8108cf0 0x7fd7a810f520 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009ca0 tx=0x7fd7a002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.919+0000 7fd7ac905640 1 -- 172.21.15.92:0/1746983696 shutdown_connections 2024-09-21T07:16:38.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.919+0000 7fd7ac905640 1 --2- 172.21.15.92:0/1746983696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7a8108cf0 0x7fd7a810f520 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.919+0000 7fd7ac905640 1 --2- 172.21.15.92:0/1746983696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7a81083a0 0x7fd7a81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.919+0000 7fd7ac905640 1 --2- 172.21.15.92:0/1746983696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a8102a60 0x7fd7a8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.919+0000 7fd7ac905640 1 -- 172.21.15.92:0/1746983696 >> 172.21.15.92:0/1746983696 conn(0x7fd7a8079730 msgr2=0x7fd7a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.919+0000 7fd7ac905640 1 -- 172.21.15.92:0/1746983696 shutdown_connections 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.919+0000 7fd7ac905640 1 -- 172.21.15.92:0/1746983696 wait complete. 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.920+0000 7fd7ac905640 1 Processor -- start 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.920+0000 7fd7ac905640 1 -- start start 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7ac905640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7a8102a60 0x7fd7a8199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7ac905640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a81083a0 0x7fd7a81997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7ac905640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7a8108cf0 0x7fd7a819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7ac905640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8112860 con 0x7fd7a8108cf0 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7ac905640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a81126e0 con 0x7fd7a8102a60 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7ac905640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a81129e0 con 0x7fd7a81083a0 2024-09-21T07:16:38.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7a8108cf0 0x7fd7a819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7a8108cf0 0x7fd7a819ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54514/0 (socket says 172.21.15.92:54514) 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a6d9d640 1 -- 172.21.15.92:0/2520912669 learned_addr learned my addr 172.21.15.92:0/2520912669 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a659c640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7a8102a60 0x7fd7a8199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a81083a0 0x7fd7a81997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a6d9d640 1 -- 172.21.15.92:0/2520912669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a81083a0 msgr2=0x7fd7a81997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a6d9d640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a81083a0 0x7fd7a81997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a6d9d640 1 -- 172.21.15.92:0/2520912669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7a8102a60 msgr2=0x7fd7a8199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a6d9d640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7a8102a60 0x7fd7a8199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a6d9d640 1 -- 172.21.15.92:0/2520912669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a819f180 con 0x7fd7a8108cf0 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7a6d9d640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7a8108cf0 0x7fd7a819ea50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0005cc0 tx=0x7fd7a0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd79f7fe640 1 -- 172.21.15.92:0/2520912669 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0032e00 con 0x7fd7a8108cf0 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.921+0000 7fd7ac905640 1 -- 172.21.15.92:0/2520912669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a819f410 con 0x7fd7a8108cf0 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.922+0000 7fd79f7fe640 1 -- 172.21.15.92:0/2520912669 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7a00044d0 con 0x7fd7a8108cf0 2024-09-21T07:16:38.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.922+0000 7fd79f7fe640 1 -- 172.21.15.92:0/2520912669 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0030b70 con 0x7fd7a8108cf0 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.922+0000 7fd7ac905640 1 -- 172.21.15.92:0/2520912669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a806ae60 con 0x7fd7a8108cf0 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.924+0000 7fd79f7fe640 1 -- 172.21.15.92:0/2520912669 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fd7a0004680 con 0x7fd7a8108cf0 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7b2e79740 1 Processor -- start 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7b2e79740 1 -- start start 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b39642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35941b0 0x5648b3964800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd79f7fe640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7940b6700 0x7fd7940b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 0x5648b3964d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5648b38daea0 con 0x5648b35bd070 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5648b38ca2d0 con 0x5648b35941b0 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5648b38ce0e0 con 0x5648b359c390 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7a659c640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7940b6700 0x7fd7940b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7a5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b39642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7a5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b39642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54516/0 (socket says 172.21.15.92:54516) 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.925+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/2056816537 learned_addr learned my addr 172.21.15.92:0/2056816537 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd7a6d9d640 1 --2- 172.21.15.92:0/2056816537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 0x5648b3964d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/2056816537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35941b0 0x5648b3964800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/2056816537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 msgr2=0x5648b3964d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd79f7fe640 1 -- 172.21.15.92:0/2520912669 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd7a0108d90 con 0x7fd7a8108cf0 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/2056816537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 0x5648b3964d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/2056816537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35941b0 msgr2=0x5648b3964800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/2056816537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35941b0 0x5648b3964800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/2056816537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b3628650 con 0x5648b35bd070 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd7a6d9d640 1 --2- 172.21.15.92:0/2056816537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 0x5648b3964d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd7a659c640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7940b6700 0x7fd7940b8c10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd798005d00 tx=0x7fd79800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/2056816537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b39642c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd7900134f0 tx=0x7fd79000b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c106427e022656 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd79cff9640 1 -- 172.21.15.92:0/2056816537 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790019030 con 0x5648b35bd070 2024-09-21T07:16:38.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd79cff9640 1 -- 172.21.15.92:0/2056816537 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd790005bf0 con 0x5648b35bd070 2024-09-21T07:16:38.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.926+0000 7fd79cff9640 1 -- 172.21.15.92:0/2056816537 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79001d620 con 0x5648b35bd070 2024-09-21T07:16:38.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.927+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2056816537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 msgr2=0x5648b39642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:38.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.927+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/2056816537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b39642c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd7900134f0 tx=0x7fd79000b600 comp rx=0 tx=0).stop 2024-09-21T07:16:38.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.927+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2056816537 shutdown_connections 2024-09-21T07:16:38.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.927+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/2056816537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 0x5648b3964d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.927+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/2056816537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35941b0 0x5648b3964800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.927+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/2056816537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b39642c0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.927+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2056816537 >> 172.21.15.92:0/2056816537 conn(0x5648b35b1460 msgr2=0x5648b39621b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:38.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.927+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2056816537 shutdown_connections 2024-09-21T07:16:38.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.927+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2056816537 wait complete. 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7b2e79740 1 -- start start 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7b2e79740 1 Processor -- start 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 0x5648b3973d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3974260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35bd070 0x5648b39747c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5648b372b700 con 0x5648b359c390 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5648b3865160 con 0x5648b35bd070 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5648b3976da0 con 0x5648b35941b0 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7b2e79740 10 client.0 _ll_register_callbacks cb 0x5648b387e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7a5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3974260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7a5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3974260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54518/0 (socket says 172.21.15.92:54518) 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/3489117273 learned_addr learned my addr 172.21.15.92:0/3489117273 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7a659c640 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 0x5648b3973d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/3489117273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 msgr2=0x5648b3973d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7a6d9d640 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35bd070 0x5648b39747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 0x5648b3973d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/3489117273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35bd070 msgr2=0x5648b39747c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35bd070 0x5648b39747c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.928+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/3489117273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648b3892c90 con 0x5648b359c390 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3974260 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd790005f70 tx=0x7fd7900052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff9a126fba30081 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd78dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd78dffb640 1 -- 172.21.15.92:0/3489117273 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790019040 con 0x5648b359c390 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd78dffb640 1 -- 172.21.15.92:0/3489117273 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd7900048c0 con 0x5648b359c390 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3489117273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5648b38dcdf0 con 0x5648b359c390 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd78dffb640 1 -- 172.21.15.92:0/3489117273 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd790030050 con 0x5648b359c390 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd7b2e79740 10 client.16767 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3489117273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648b3982a00 con 0x5648b359c390 2024-09-21T07:16:38.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd78dffb640 1 -- 172.21.15.92:0/3489117273 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5648b38dcdf0 con 0x5648b359c390 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd78dffb640 1 -- 172.21.15.92:0/3489117273 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd790025020 con 0x5648b359c390 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd7b2e79740 10 client.16767 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd7b2e79740 10 client.16767 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd7b2e79740 20 client.16767 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5648b357b9f0 0x5648b3985e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd7b2e79740 4 client.16767 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.929+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3489117273 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648b38d88a0 con 0x5648b357b9f0 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.930+0000 7fd7a659c640 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5648b357b9f0 0x5648b3985e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.930+0000 7fd78dffb640 10 client.16767 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.930+0000 7fd7a659c640 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5648b357b9f0 0x5648b3985e70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=658d694d37c487ab server_cookie=7efb7686e2592285 in_seq=0 out_seq=0 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd78dffb640 1 -- 172.21.15.92:0/3489117273 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648b38d88a0 con 0x5648b357b9f0 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd78dffb640 10 client.16767 handle_command_reply: tid=0 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 client.16767 shutdown 2024-09-21T07:16:38.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3489117273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 msgr2=0x5648b3974260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3974260 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd790005f70 tx=0x7fd7900052f0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3489117273 shutdown_connections 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35bd070 0x5648b39747c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5648b357b9f0 0x5648b3985e70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3974260 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/3489117273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 0x5648b3973d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3489117273 >> 172.21.15.92:0/3489117273 conn(0x5648b35b1460 msgr2=0x5648b3960750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd78dffb640 0 client.16767 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3489117273 shutdown_connections 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3489117273 wait complete. 2024-09-21T07:16:38.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.931+0000 7fd7b2e79740 20 client.16767 trim_cache size 0 max 16384 2024-09-21T07:16:38.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.944+0000 7fd7b2e79740 1 Processor -- start 2024-09-21T07:16:38.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.944+0000 7fd7b2e79740 1 -- start start 2024-09-21T07:16:38.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 0x5648b3965a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3970f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35bd070 0x5648b3971450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a81aeb30 con 0x5648b359c390 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a81b0670 con 0x5648b35bd070 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a81af200 con 0x5648b35941b0 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3970f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3970f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54526/0 (socket says 172.21.15.92:54526) 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/3613896810 learned_addr learned my addr 172.21.15.92:0/3613896810 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a6d9d640 1 --2- 172.21.15.92:0/3613896810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35bd070 0x5648b3971450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/3613896810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 msgr2=0x5648b3965a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a659c640 1 --2- 172.21.15.92:0/3613896810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 0x5648b3965a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/3613896810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 0x5648b3965a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/3613896810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35bd070 msgr2=0x5648b3971450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:38.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/3613896810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35bd070 0x5648b3971450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a5d9b640 1 -- 172.21.15.92:0/3613896810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b3962b70 con 0x5648b359c390 2024-09-21T07:16:38.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a659c640 1 --2- 172.21.15.92:0/3613896810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 0x5648b3965a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:38.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/3613896810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3970f10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd790013440 tx=0x7fd79000b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d657fc21fb77b42e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:38.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd78ffff640 1 -- 172.21.15.92:0/3613896810 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790019070 con 0x5648b359c390 2024-09-21T07:16:38.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd78ffff640 1 -- 172.21.15.92:0/3613896810 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd790011b00 con 0x5648b359c390 2024-09-21T07:16:38.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.945+0000 7fd78ffff640 1 -- 172.21.15.92:0/3613896810 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790004680 con 0x5648b359c390 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.946+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3613896810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 msgr2=0x5648b3970f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.946+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/3613896810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3970f10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd790013440 tx=0x7fd79000b3a0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.946+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3613896810 shutdown_connections 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.946+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/3613896810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35bd070 0x5648b3971450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.946+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/3613896810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b359c390 0x5648b3970f10 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.946+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/3613896810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b35941b0 0x5648b3965a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.946+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3613896810 >> 172.21.15.92:0/3613896810 conn(0x5648b35b1460 msgr2=0x5648b39652f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.946+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3613896810 shutdown_connections 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.946+0000 7fd7b2e79740 1 -- 172.21.15.92:0/3613896810 wait complete. 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.946+0000 7fd7b2e79740 1 -- start start 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7b2e79740 1 Processor -- start 2024-09-21T07:16:38.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35941b0 0x5648b397ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 0x5648b3979ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7b2e79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b397a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a81affa0 con 0x5648b35bd070 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a81af8d0 con 0x5648b35941b0 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7b2e79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a81acb10 con 0x5648b359c390 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7b2e79740 10 client.0 _ll_register_callbacks cb 0x7fd79000bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b397a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b397a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54540/0 (socket says 172.21.15.92:54540) 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a6d9d640 1 -- 172.21.15.92:0/2551198204 learned_addr learned my addr 172.21.15.92:0/2551198204 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a659c640 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35941b0 0x5648b397ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 0x5648b3979ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a6d9d640 1 -- 172.21.15.92:0/2551198204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 msgr2=0x5648b3979ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a6d9d640 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 0x5648b3979ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a6d9d640 1 -- 172.21.15.92:0/2551198204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35941b0 msgr2=0x5648b397ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a6d9d640 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35941b0 0x5648b397ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a6d9d640 1 -- 172.21.15.92:0/2551198204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648b39ef710 con 0x5648b35bd070 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.947+0000 7fd7a5d9b640 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 0x5648b3979ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd7a6d9d640 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b397a600 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00cadb0 tx=0x7fd7a0106590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef38913d18dacd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd78dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd78dffb640 1 -- 172.21.15.92:0/2551198204 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00bbe60 con 0x5648b35bd070 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd78dffb640 1 -- 172.21.15.92:0/2551198204 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd7a0092ba0 con 0x5648b35bd070 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2551198204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd790011b00 con 0x5648b35bd070 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd78dffb640 1 -- 172.21.15.92:0/2551198204 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd7a00ce5b0 con 0x5648b35bd070 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd7b2e79740 10 client.16773 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2551198204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648b39f0800 con 0x5648b35bd070 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd78dffb640 1 -- 172.21.15.92:0/2551198204 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd790011b00 con 0x5648b35bd070 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd78dffb640 1 -- 172.21.15.92:0/2551198204 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd7a00d7d70 con 0x5648b35bd070 2024-09-21T07:16:38.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd7b2e79740 10 client.16773 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd7b2e79740 10 client.16773 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd7b2e79740 20 client.16773 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5648b3550da0 0x5648b39f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd7b2e79740 4 client.16773 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.948+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2551198204 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648b38d5cd0 con 0x5648b3550da0 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd7a659c640 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5648b3550da0 0x5648b39f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd7a659c640 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5648b3550da0 0x5648b39f2fe0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8241585597199a5e server_cookie=3092c7192653213 in_seq=0 out_seq=0 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd78dffb640 10 client.16773 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd78dffb640 1 -- 172.21.15.92:0/2551198204 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648b38d5cd0 con 0x5648b3550da0 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd78dffb640 10 client.16773 handle_command_reply: tid=0 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd7b2e79740 1 client.16773 shutdown 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2551198204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 msgr2=0x5648b397a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:38.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b397a600 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00cadb0 tx=0x7fd7a0106590 comp rx=0 tx=0).stop 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2551198204 shutdown_connections 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5648b3550da0 0x5648b39f2fe0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.949+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648b35bd070 0x5648b397a600 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd78dffb640 0 client.16773 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5648b359c390 0x5648b3979ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7b2e79740 1 --2- 172.21.15.92:0/2551198204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648b35941b0 0x5648b397ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2551198204 >> 172.21.15.92:0/2551198204 conn(0x5648b35b1460 msgr2=0x5648b3969bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2551198204 shutdown_connections 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7b2e79740 1 -- 172.21.15.92:0/2551198204 wait complete. 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7b2e79740 20 client.16773 trim_cache size 0 max 16384 2024-09-21T07:16:38.957 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:16:38.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 -- 172.21.15.92:0/2520912669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7940b6700 msgr2=0x7fd7940b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:38.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7940b6700 0x7fd7940b8c10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd798005d00 tx=0x7fd79800b410 comp rx=0 tx=0).stop 2024-09-21T07:16:38.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 -- 172.21.15.92:0/2520912669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7a8108cf0 msgr2=0x7fd7a819ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:38.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7a8108cf0 0x7fd7a819ea50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0005cc0 tx=0x7fd7a0032a10 comp rx=0 tx=0).stop 2024-09-21T07:16:38.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 -- 172.21.15.92:0/2520912669 shutdown_connections 2024-09-21T07:16:38.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7940b6700 0x7fd7940b8c10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7a8108cf0 0x7fd7a819ea50 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a81083a0 0x7fd7a81997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 --2- 172.21.15.92:0/2520912669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7a8102a60 0x7fd7a8199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:38.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 -- 172.21.15.92:0/2520912669 >> 172.21.15.92:0/2520912669 conn(0x7fd7a8079730 msgr2=0x7fd7a81043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:38.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 -- 172.21.15.92:0/2520912669 shutdown_connections 2024-09-21T07:16:38.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:38.950+0000 7fd7ac905640 1 -- 172.21.15.92:0/2520912669 wait complete. 2024-09-21T07:16:39.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:16:40.000 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.476+0000 7f26a1b2f640 1 -- 172.21.15.92:0/2377764788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f269c108d70 msgr2=0x7f269c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.476+0000 7f26a1b2f640 1 --2- 172.21.15.92:0/2377764788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f269c108d70 0x7f269c10f5a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2694009ca0 tx=0x7f269402a8e0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.476+0000 7f26a1b2f640 1 -- 172.21.15.92:0/2377764788 shutdown_connections 2024-09-21T07:16:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.476+0000 7f26a1b2f640 1 --2- 172.21.15.92:0/2377764788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f269c108d70 0x7f269c10f5a0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.476+0000 7f26a1b2f640 1 --2- 172.21.15.92:0/2377764788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f269c108420 0x7f269c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.476+0000 7f26a1b2f640 1 --2- 172.21.15.92:0/2377764788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f269c102ae0 0x7f269c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.476+0000 7f26a1b2f640 1 -- 172.21.15.92:0/2377764788 >> 172.21.15.92:0/2377764788 conn(0x7f269c079770 msgr2=0x7f269c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:40.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.476+0000 7f26a1b2f640 1 -- 172.21.15.92:0/2377764788 shutdown_connections 2024-09-21T07:16:40.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.476+0000 7f26a1b2f640 1 -- 172.21.15.92:0/2377764788 wait complete. 2024-09-21T07:16:40.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.477+0000 7f26a1b2f640 1 Processor -- start 2024-09-21T07:16:40.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.477+0000 7f26a1b2f640 1 -- start start 2024-09-21T07:16:40.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.477+0000 7f26a1b2f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f269c102ae0 0x7f269c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.477+0000 7f26a1b2f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f269c108420 0x7f269c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.477+0000 7f26a1b2f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f269c108d70 0x7f269c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.477+0000 7f26a1b2f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f269c1129a0 con 0x7f269c108420 2024-09-21T07:16:40.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.477+0000 7f26a1b2f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f269c112820 con 0x7f269c108d70 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.477+0000 7f26a1b2f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f269c112b20 con 0x7f269c102ae0 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.478+0000 7f269bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f269c108d70 0x7f269c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.478+0000 7f269bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f269c108d70 0x7f269c19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:55772/0 (socket says 172.21.15.92:55772) 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.478+0000 7f269bfff640 1 -- 172.21.15.92:0/921985189 learned_addr learned my addr 172.21.15.92:0/921985189 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.478+0000 7f269b7fe640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f269c102ae0 0x7f269c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.478+0000 7f269affd640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f269c108420 0x7f269c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.478+0000 7f269bfff640 1 -- 172.21.15.92:0/921985189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f269c102ae0 msgr2=0x7f269c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.478+0000 7f269bfff640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f269c102ae0 0x7f269c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.478+0000 7f269bfff640 1 -- 172.21.15.92:0/921985189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f269c108420 msgr2=0x7f269c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.478+0000 7f269bfff640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f269c108420 0x7f269c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.478+0000 7f269bfff640 1 -- 172.21.15.92:0/921985189 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c1a0410 con 0x7f269c108d70 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.479+0000 7f269bfff640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f269c108d70 0x7f269c19fce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2694006010 tx=0x7f2694003c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.479+0000 7f2698ff9640 1 -- 172.21.15.92:0/921985189 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694004240 con 0x7f269c108d70 2024-09-21T07:16:40.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.479+0000 7f26a1b2f640 1 -- 172.21.15.92:0/921985189 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c1a06a0 con 0x7f269c108d70 2024-09-21T07:16:40.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.479+0000 7f2698ff9640 1 -- 172.21.15.92:0/921985189 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26940305e0 con 0x7f269c108d70 2024-09-21T07:16:40.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.479+0000 7f2698ff9640 1 -- 172.21.15.92:0/921985189 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269403b660 con 0x7f269c108d70 2024-09-21T07:16:40.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.479+0000 7f26a1b2f640 1 -- 172.21.15.92:0/921985189 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c1a6e60 con 0x7f269c108d70 2024-09-21T07:16:40.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.481+0000 7f26a80a3740 1 Processor -- start 2024-09-21T07:16:40.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.482+0000 7f2698ff9640 1 -- 172.21.15.92:0/921985189 <== mon.2 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f26940043e0 con 0x7f269c108d70 2024-09-21T07:16:40.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.482+0000 7f26a80a3740 1 -- start start 2024-09-21T07:16:40.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.482+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa827062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.482+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa823361b0 0x55fa82706800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.482+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa8233e390 0x55fa82706d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.482+0000 7f26a80a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fa8267cea0 con 0x55fa8235f070 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.482+0000 7f26a80a3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fa8266c2d0 con 0x55fa823361b0 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.482+0000 7f26a80a3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fa826700e0 con 0x55fa8233e390 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.482+0000 7f269affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa827062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.482+0000 7f269affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa827062c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35752/0 (socket says 172.21.15.92:35752) 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f269affd640 1 -- 172.21.15.92:0/514299521 learned_addr learned my addr 172.21.15.92:0/514299521 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f269b7fe640 1 --2- 172.21.15.92:0/514299521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa823361b0 0x55fa82706800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f269affd640 1 --2- 172.21.15.92:0/514299521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa8233e390 0x55fa82706d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f269affd640 1 -- 172.21.15.92:0/514299521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa8233e390 msgr2=0x55fa82706d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:40.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f269affd640 1 --2- 172.21.15.92:0/514299521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa8233e390 0x55fa82706d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f269affd640 1 -- 172.21.15.92:0/514299521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa823361b0 msgr2=0x55fa82706800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f269affd640 1 --2- 172.21.15.92:0/514299521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa823361b0 0x55fa82706800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f269affd640 1 -- 172.21.15.92:0/514299521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa823ca650 con 0x55fa8235f070 2024-09-21T07:16:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f2698ff9640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26840b6680 0x7f26840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f269affd640 1 --2- 172.21.15.92:0/514299521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa827062c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2690009f00 tx=0x7f2690009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c29972b4c69b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f269b7fe640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26840b6680 0x7f26840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f2698ff9640 1 -- 172.21.15.92:0/921985189 <== mon.2 v2:172.21.15.169:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2694108e00 con 0x7f269c108d70 2024-09-21T07:16:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f2681ffb640 1 -- 172.21.15.92:0/514299521 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690017410 con 0x55fa8235f070 2024-09-21T07:16:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.483+0000 7f2681ffb640 1 -- 172.21.15.92:0/514299521 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f269001c070 con 0x55fa8235f070 2024-09-21T07:16:40.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f2681ffb640 1 -- 172.21.15.92:0/514299521 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690015630 con 0x55fa8235f070 2024-09-21T07:16:40.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f26a80a3740 1 -- 172.21.15.92:0/514299521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 msgr2=0x55fa827062c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:40.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f269b7fe640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26840b6680 0x7f26840b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55fa82704f40 tx=0x7f268c009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f26a80a3740 1 --2- 172.21.15.92:0/514299521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa827062c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2690009f00 tx=0x7f2690009690 comp rx=0 tx=0).stop 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f26a80a3740 1 -- 172.21.15.92:0/514299521 shutdown_connections 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f26a80a3740 1 --2- 172.21.15.92:0/514299521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa8233e390 0x55fa82706d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f26a80a3740 1 --2- 172.21.15.92:0/514299521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa823361b0 0x55fa82706800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f26a80a3740 1 --2- 172.21.15.92:0/514299521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa827062c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f26a80a3740 1 -- 172.21.15.92:0/514299521 >> 172.21.15.92:0/514299521 conn(0x55fa82353460 msgr2=0x55fa827041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f26a80a3740 1 -- 172.21.15.92:0/514299521 shutdown_connections 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.484+0000 7f26a80a3740 1 -- 172.21.15.92:0/514299521 wait complete. 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.485+0000 7f26a80a3740 1 -- start start 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.485+0000 7f26a80a3740 1 Processor -- start 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.485+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 0x55fa82715de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.485+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 0x55fa82716320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.485+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa82722100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.485+0000 7f26a80a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fa824cd700 con 0x55fa8235f070 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.485+0000 7f26a80a3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fa82607160 con 0x55fa8233e390 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.485+0000 7f26a80a3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fa82718da0 con 0x55fa823361b0 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.485+0000 7f26a80a3740 10 client.0 _ll_register_callbacks cb 0x55fa826209e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa82722100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa82722100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35760/0 (socket says 172.21.15.92:35760) 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269bfff640 1 -- 172.21.15.92:0/3776877458 learned_addr learned my addr 172.21.15.92:0/3776877458 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269b7fe640 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 0x55fa82715de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269affd640 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 0x55fa82716320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269bfff640 1 -- 172.21.15.92:0/3776877458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 msgr2=0x55fa82715de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269bfff640 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 0x55fa82715de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269bfff640 1 -- 172.21.15.92:0/3776877458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 msgr2=0x55fa82716320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269bfff640 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 0x55fa82716320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269bfff640 1 -- 172.21.15.92:0/3776877458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa82634c90 con 0x55fa8235f070 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269b7fe640 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 0x55fa82715de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269affd640 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 0x55fa82716320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f269bfff640 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa82722100 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f26940cae80 tx=0x7f26940ce740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f0c2ba8b3e1191 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f267affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f267affd640 1 -- 172.21.15.92:0/3776877458 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26940ce3c0 con 0x55fa8235f070 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f26a80a3740 1 -- 172.21.15.92:0/3776877458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f269001c070 con 0x55fa8235f070 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f267affd640 1 -- 172.21.15.92:0/3776877458 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f26940046d0 con 0x55fa8235f070 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f267affd640 1 -- 172.21.15.92:0/3776877458 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f26940cefb0 con 0x55fa8235f070 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f26a80a3740 10 client.16785 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.486+0000 7f26a80a3740 1 -- 172.21.15.92:0/3776877458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fa82724b50 con 0x55fa8235f070 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.487+0000 7f267affd640 1 -- 172.21.15.92:0/3776877458 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f269001c070 con 0x55fa8235f070 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.487+0000 7f267affd640 1 -- 172.21.15.92:0/3776877458 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f26940cab20 con 0x55fa8235f070 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.487+0000 7f26a80a3740 10 client.16785 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:40.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.487+0000 7f26a80a3740 10 client.16785 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.487+0000 7f26a80a3740 20 client.16785 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.487+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fa8231d9f0 0x55fa82727f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.487+0000 7f26a80a3740 4 client.16785 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.487+0000 7f26a80a3740 1 -- 172.21.15.92:0/3776877458 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa8267edf0 con 0x55fa8231d9f0 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.487+0000 7f269b7fe640 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fa8231d9f0 0x55fa82727f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.488+0000 7f269b7fe640 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fa8231d9f0 0x55fa82727f50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e6d56161ea874cf server_cookie=cb6b49bab3c1624 in_seq=0 out_seq=0 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.488+0000 7f267affd640 10 client.16785 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.488+0000 7f267affd640 1 -- 172.21.15.92:0/3776877458 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa8267edf0 con 0x55fa8231d9f0 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.488+0000 7f267affd640 10 client.16785 handle_command_reply: tid=0 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 client.16785 shutdown 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 -- 172.21.15.92:0/3776877458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 msgr2=0x55fa82722100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa82722100 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f26940cae80 tx=0x7f26940ce740 comp rx=0 tx=0).stop 2024-09-21T07:16:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 -- 172.21.15.92:0/3776877458 shutdown_connections 2024-09-21T07:16:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fa8231d9f0 0x55fa82727f50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8235f070 0x55fa82722100 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f267affd640 0 client.16785 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:16:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 0x55fa82716320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3776877458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 0x55fa82715de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 -- 172.21.15.92:0/3776877458 >> 172.21.15.92:0/3776877458 conn(0x55fa82353460 msgr2=0x55fa82707cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 -- 172.21.15.92:0/3776877458 shutdown_connections 2024-09-21T07:16:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 1 -- 172.21.15.92:0/3776877458 wait complete. 2024-09-21T07:16:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.489+0000 7f26a80a3740 20 client.16785 trim_cache size 0 max 16384 2024-09-21T07:16:40.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.502+0000 7f26a80a3740 1 Processor -- start 2024-09-21T07:16:40.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.502+0000 7f26a80a3740 1 -- start start 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.502+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8231d9f0 0x55fa82722000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa823361b0 0x55fa82703af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa8233e390 0x55fa82704030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f26a80a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f269c1aec60 con 0x55fa823361b0 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f26a80a3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f269c1b07a0 con 0x55fa8231d9f0 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f26a80a3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f269c1af330 con 0x55fa8233e390 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f269affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa823361b0 0x55fa82703af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f269affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa823361b0 0x55fa82703af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35764/0 (socket says 172.21.15.92:35764) 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f269affd640 1 -- 172.21.15.92:0/2596669039 learned_addr learned my addr 172.21.15.92:0/2596669039 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f269b7fe640 1 --2- 172.21.15.92:0/2596669039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8231d9f0 0x55fa82722000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f269affd640 1 -- 172.21.15.92:0/2596669039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa8233e390 msgr2=0x55fa82704030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f269affd640 1 --2- 172.21.15.92:0/2596669039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa8233e390 0x55fa82704030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f269affd640 1 -- 172.21.15.92:0/2596669039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8231d9f0 msgr2=0x55fa82722000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f269affd640 1 --2- 172.21.15.92:0/2596669039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8231d9f0 0x55fa82722000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f269affd640 1 -- 172.21.15.92:0/2596669039 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa82718520 con 0x55fa823361b0 2024-09-21T07:16:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f269affd640 1 --2- 172.21.15.92:0/2596669039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa823361b0 0x55fa82703af0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f269000ea30 tx=0x7f26900093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabf5630646d8edc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f26817fa640 1 -- 172.21.15.92:0/2596669039 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690005bc0 con 0x55fa823361b0 2024-09-21T07:16:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f26817fa640 1 -- 172.21.15.92:0/2596669039 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f269001c040 con 0x55fa823361b0 2024-09-21T07:16:40.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.503+0000 7f26817fa640 1 -- 172.21.15.92:0/2596669039 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690029770 con 0x55fa823361b0 2024-09-21T07:16:40.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.504+0000 7f26a80a3740 1 -- 172.21.15.92:0/2596669039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa823361b0 msgr2=0x55fa82703af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:40.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.504+0000 7f26a80a3740 1 --2- 172.21.15.92:0/2596669039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa823361b0 0x55fa82703af0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f269000ea30 tx=0x7f26900093a0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.504+0000 7f26a80a3740 1 -- 172.21.15.92:0/2596669039 shutdown_connections 2024-09-21T07:16:40.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.504+0000 7f26a80a3740 1 --2- 172.21.15.92:0/2596669039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa8233e390 0x55fa82704030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.504+0000 7f26a80a3740 1 --2- 172.21.15.92:0/2596669039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa823361b0 0x55fa82703af0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.504+0000 7f26a80a3740 1 --2- 172.21.15.92:0/2596669039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8231d9f0 0x55fa82722000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.504+0000 7f26a80a3740 1 -- 172.21.15.92:0/2596669039 >> 172.21.15.92:0/2596669039 conn(0x55fa82353460 msgr2=0x55fa82714660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.504+0000 7f26a80a3740 1 -- 172.21.15.92:0/2596669039 shutdown_connections 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.504+0000 7f26a80a3740 1 -- 172.21.15.92:0/2596669039 wait complete. 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.505+0000 7f26a80a3740 1 -- start start 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.505+0000 7f26a80a3740 1 Processor -- start 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.505+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8231d9f0 0x55fa8271a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.505+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 0x55fa8271ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.505+0000 7f26a80a3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 0x55fa827918f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.505+0000 7f26a80a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f269c1b00d0 con 0x55fa8231d9f0 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.505+0000 7f26a80a3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f269c1afa00 con 0x55fa8233e390 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.505+0000 7f26a80a3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f269c1acc40 con 0x55fa823361b0 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.505+0000 7f26a80a3740 10 client.0 _ll_register_callbacks cb 0x7f2694003e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:40.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.505+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8231d9f0 0x55fa8271a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8231d9f0 0x55fa8271a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35766/0 (socket says 172.21.15.92:35766) 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269b7fe640 1 -- 172.21.15.92:0/3822947042 learned_addr learned my addr 172.21.15.92:0/3822947042 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269bfff640 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 0x55fa827918f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269affd640 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 0x55fa8271ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269b7fe640 1 -- 172.21.15.92:0/3822947042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 msgr2=0x55fa8271ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269b7fe640 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 0x55fa8271ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269b7fe640 1 -- 172.21.15.92:0/3822947042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 msgr2=0x55fa827918f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269b7fe640 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 0x55fa827918f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269b7fe640 1 -- 172.21.15.92:0/3822947042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa82791eb0 con 0x55fa8231d9f0 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269affd640 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 0x55fa8271ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f269b7fe640 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8231d9f0 0x55fa8271a840 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f268c011ba0 tx=0x7f268c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a16158957a3b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f267affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f267affd640 1 -- 172.21.15.92:0/3822947042 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c032060 con 0x55fa8231d9f0 2024-09-21T07:16:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f267affd640 1 -- 172.21.15.92:0/3822947042 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f268c02d440 con 0x55fa8231d9f0 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f26a80a3740 1 -- 172.21.15.92:0/3822947042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f269001c040 con 0x55fa8231d9f0 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f267affd640 1 -- 172.21.15.92:0/3822947042 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f268c039050 con 0x55fa8231d9f0 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f26a80a3740 10 client.16791 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.506+0000 7f26a80a3740 1 -- 172.21.15.92:0/3822947042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fa827931c0 con 0x55fa8231d9f0 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f267affd640 1 -- 172.21.15.92:0/3822947042 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f269001c040 con 0x55fa8231d9f0 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f267affd640 1 -- 172.21.15.92:0/3822947042 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f268c0145d0 con 0x55fa8231d9f0 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f26a80a3740 10 client.16791 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f26a80a3740 10 client.16791 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f26a80a3740 20 client.16791 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fa8235f070 0x55fa82795990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f26a80a3740 4 client.16791 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f26a80a3740 1 -- 172.21.15.92:0/3822947042 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa8267a8a0 con 0x55fa8235f070 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f269affd640 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fa8235f070 0x55fa82795990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f269affd640 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fa8235f070 0x55fa82795990 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e47e6bdbbdc03c76 server_cookie=6d572e0f37c6b5bc in_seq=0 out_seq=0 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.507+0000 7f267affd640 10 client.16791 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f267affd640 1 -- 172.21.15.92:0/3822947042 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa8267a8a0 con 0x55fa8235f070 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f267affd640 10 client.16791 handle_command_reply: tid=0 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 client.16791 shutdown 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 -- 172.21.15.92:0/3822947042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8231d9f0 msgr2=0x55fa8271a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8231d9f0 0x55fa8271a840 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f268c011ba0 tx=0x7f268c014000 comp rx=0 tx=0).stop 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 -- 172.21.15.92:0/3822947042 shutdown_connections 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fa8235f070 0x55fa82795990 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa8233e390 0x55fa827918f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa823361b0 0x55fa8271ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 --2- 172.21.15.92:0/3822947042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa8231d9f0 0x55fa8271a840 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 -- 172.21.15.92:0/3822947042 >> 172.21.15.92:0/3822947042 conn(0x55fa82353460 msgr2=0x55fa82717220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f267affd640 0 client.16791 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:16:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 -- 172.21.15.92:0/3822947042 shutdown_connections 2024-09-21T07:16:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 1 -- 172.21.15.92:0/3822947042 wait complete. 2024-09-21T07:16:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.508+0000 7f26a80a3740 20 client.16791 trim_cache size 0 max 16384 2024-09-21T07:16:40.516 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:16:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 -- 172.21.15.92:0/921985189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26840b6680 msgr2=0x7f26840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26840b6680 0x7f26840b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55fa82704f40 tx=0x7f268c009110 comp rx=0 tx=0).stop 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 -- 172.21.15.92:0/921985189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f269c108d70 msgr2=0x7f269c19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f269c108d70 0x7f269c19fce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2694006010 tx=0x7f2694003c90 comp rx=0 tx=0).stop 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 -- 172.21.15.92:0/921985189 shutdown_connections 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f26840b6680 0x7f26840b8b90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f269c108d70 0x7f269c19fce0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f269c108420 0x7f269c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 --2- 172.21.15.92:0/921985189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f269c102ae0 0x7f269c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 -- 172.21.15.92:0/921985189 >> 172.21.15.92:0/921985189 conn(0x7f269c079770 msgr2=0x7f269c101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 -- 172.21.15.92:0/921985189 shutdown_connections 2024-09-21T07:16:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:40.509+0000 7f26a1b2f640 1 -- 172.21.15.92:0/921985189 wait complete. 2024-09-21T07:16:41.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:40 smithi175 ceph-mon[34064]: pgmap v447: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 630 KiB/s wr, 11 op/s 2024-09-21T07:16:41.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:40 smithi092 ceph-mon[30987]: pgmap v447: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 630 KiB/s wr, 11 op/s 2024-09-21T07:16:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:40 smithi169 ceph-mon[33705]: pgmap v447: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 630 KiB/s wr, 11 op/s 2024-09-21T07:16:41.316 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:16:41.566 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:42.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.020+0000 7f6137429640 1 -- 172.21.15.92:0/352459407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61301083a0 msgr2=0x7f61301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:42.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.020+0000 7f6137429640 1 --2- 172.21.15.92:0/352459407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61301083a0 0x7f61301087b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6124009900 tx=0x7f612402a410 comp rx=0 tx=0).stop 2024-09-21T07:16:42.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.020+0000 7f6137429640 1 -- 172.21.15.92:0/352459407 shutdown_connections 2024-09-21T07:16:42.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.020+0000 7f6137429640 1 --2- 172.21.15.92:0/352459407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6130108cf0 0x7f613010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.020+0000 7f6137429640 1 --2- 172.21.15.92:0/352459407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61301083a0 0x7f61301087b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.020+0000 7f6137429640 1 --2- 172.21.15.92:0/352459407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6130102a60 0x7f6130102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.020+0000 7f6137429640 1 -- 172.21.15.92:0/352459407 >> 172.21.15.92:0/352459407 conn(0x7f6130079760 msgr2=0x7f6130079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:42.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.020+0000 7f6137429640 1 -- 172.21.15.92:0/352459407 shutdown_connections 2024-09-21T07:16:42.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.020+0000 7f6137429640 1 -- 172.21.15.92:0/352459407 wait complete. 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.021+0000 7f6137429640 1 Processor -- start 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.021+0000 7f6137429640 1 -- start start 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f6137429640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6130102a60 0x7f61301993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f6137429640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61301083a0 0x7f6130199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f6137429640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6130108cf0 0x7f613019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f6137429640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6130112860 con 0x7f6130102a60 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f6137429640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61301126e0 con 0x7f61301083a0 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f6137429640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f61301129e0 con 0x7f6130108cf0 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61351c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6130102a60 0x7f61301993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61351c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6130102a60 0x7f61301993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35786/0 (socket says 172.21.15.92:35786) 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61351c5640 1 -- 172.21.15.92:0/2662125974 learned_addr learned my addr 172.21.15.92:0/2662125974 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61349c4640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61301083a0 0x7f6130199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61359c6640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6130108cf0 0x7f613019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61351c5640 1 -- 172.21.15.92:0/2662125974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6130108cf0 msgr2=0x7f613019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61351c5640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6130108cf0 0x7f613019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61351c5640 1 -- 172.21.15.92:0/2662125974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61301083a0 msgr2=0x7f6130199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61351c5640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61301083a0 0x7f6130199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61351c5640 1 -- 172.21.15.92:0/2662125974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613019f340 con 0x7f6130102a60 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61349c4640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61301083a0 0x7f6130199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.022+0000 7f61351c5640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6130102a60 0x7f61301993d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f612800c890 tx=0x7f612800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.023+0000 7f61227fc640 1 -- 172.21.15.92:0/2662125974 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128004220 con 0x7f6130102a60 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.023+0000 7f6137429640 1 -- 172.21.15.92:0/2662125974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613019f630 con 0x7f6130102a60 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.023+0000 7f61227fc640 1 -- 172.21.15.92:0/2662125974 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6128007e40 con 0x7f6130102a60 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.023+0000 7f61227fc640 1 -- 172.21.15.92:0/2662125974 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128004a00 con 0x7f6130102a60 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.023+0000 7f6137429640 1 -- 172.21.15.92:0/2662125974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61301a5d90 con 0x7f6130102a60 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.025+0000 7f613d99d740 1 Processor -- start 2024-09-21T07:16:42.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.025+0000 7f61227fc640 1 -- 172.21.15.92:0/2662125974 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f61280079b0 con 0x7f6130102a60 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.025+0000 7f613d99d740 1 -- start start 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f613d99d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d294d070 0x5576d2cf46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f613d99d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2cf4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f613d99d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 0x5576d2cf5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f613d99d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5576d2c6aea0 con 0x5576d29241b0 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f613d99d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5576d2c5a2d0 con 0x5576d292c390 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f613d99d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5576d2c5e0e0 con 0x5576d294d070 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61351c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2cf4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61351c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2cf4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35792/0 (socket says 172.21.15.92:35792) 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61351c5640 1 -- 172.21.15.92:0/368505070 learned_addr learned my addr 172.21.15.92:0/368505070 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61359c6640 1 --2- 172.21.15.92:0/368505070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d294d070 0x5576d2cf46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61349c4640 1 --2- 172.21.15.92:0/368505070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 0x5576d2cf5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61351c5640 1 -- 172.21.15.92:0/368505070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d294d070 msgr2=0x5576d2cf46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:42.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61351c5640 1 --2- 172.21.15.92:0/368505070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d294d070 0x5576d2cf46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61351c5640 1 -- 172.21.15.92:0/368505070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 msgr2=0x5576d2cf5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61351c5640 1 --2- 172.21.15.92:0/368505070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 0x5576d2cf5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61351c5640 1 -- 172.21.15.92:0/368505070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d29b8650 con 0x5576d29241b0 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61349c4640 1 --2- 172.21.15.92:0/368505070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 0x5576d2cf5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.026+0000 7f61351c5640 1 --2- 172.21.15.92:0/368505070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2cf4be0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f61280e4aa0 tx=0x7f61280ef690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f27bba976b8ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.027+0000 7f61227fc640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f611c0b6680 0x7f611c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.027+0000 7f611b7fe640 1 -- 172.21.15.92:0/368505070 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61280f6070 con 0x5576d29241b0 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.027+0000 7f61359c6640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f611c0b6680 0x7f611c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.027+0000 7f611b7fe640 1 -- 172.21.15.92:0/368505070 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61280043c0 con 0x5576d29241b0 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.027+0000 7f611b7fe640 1 -- 172.21.15.92:0/368505070 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61280a9880 con 0x5576d29241b0 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.027+0000 7f61227fc640 1 -- 172.21.15.92:0/2662125974 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f61280e7780 con 0x7f6130102a60 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 -- 172.21.15.92:0/368505070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 msgr2=0x5576d2cf4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f61359c6640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f611c0b6680 0x7f611c0b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f612c005fd0 tx=0x7f612c009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:42.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 --2- 172.21.15.92:0/368505070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2cf4be0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f61280e4aa0 tx=0x7f61280ef690 comp rx=0 tx=0).stop 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 -- 172.21.15.92:0/368505070 shutdown_connections 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 --2- 172.21.15.92:0/368505070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 0x5576d2cf5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 --2- 172.21.15.92:0/368505070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2cf4be0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 --2- 172.21.15.92:0/368505070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d294d070 0x5576d2cf46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 -- 172.21.15.92:0/368505070 >> 172.21.15.92:0/368505070 conn(0x5576d2941460 msgr2=0x5576d2cf2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 -- 172.21.15.92:0/368505070 shutdown_connections 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 -- 172.21.15.92:0/368505070 wait complete. 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 -- start start 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.028+0000 7f613d99d740 1 Processor -- start 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f613d99d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d29241b0 0x5576d2cffd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f613d99d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 0x5576d2d00240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f613d99d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2d007c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f613d99d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5576d2abb700 con 0x5576d294d070 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f613d99d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5576d2bf5160 con 0x5576d292c390 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f613d99d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5576d2d02e80 con 0x5576d29241b0 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f613d99d740 10 client.0 _ll_register_callbacks cb 0x5576d2c0e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f61359c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2d007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f61359c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2d007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35806/0 (socket says 172.21.15.92:35806) 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f61359c6640 1 -- 172.21.15.92:0/1367179644 learned_addr learned my addr 172.21.15.92:0/1367179644 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f61349c4640 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 0x5576d2d00240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f61351c5640 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d29241b0 0x5576d2cffd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f61359c6640 1 -- 172.21.15.92:0/1367179644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d29241b0 msgr2=0x5576d2cffd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f61359c6640 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d29241b0 0x5576d2cffd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f61359c6640 1 -- 172.21.15.92:0/1367179644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 msgr2=0x5576d2d00240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f61359c6640 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 0x5576d2d00240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.029+0000 7f61359c6640 1 -- 172.21.15.92:0/1367179644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d2c22c90 con 0x5576d294d070 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f61359c6640 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2d007c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f612c010bf0 tx=0x7f612c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ece88b4fb72a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f6118ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f6118ff9640 1 -- 172.21.15.92:0/1367179644 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c021d40 con 0x5576d294d070 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f6118ff9640 1 -- 172.21.15.92:0/1367179644 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f612c019030 con 0x5576d294d070 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f613d99d740 1 -- 172.21.15.92:0/1367179644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61280043c0 con 0x5576d294d070 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f6118ff9640 1 -- 172.21.15.92:0/1367179644 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f612c034050 con 0x5576d294d070 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f613d99d740 10 client.16803 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f613d99d740 1 -- 172.21.15.92:0/1367179644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5576d2d0ebb0 con 0x5576d294d070 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f6118ff9640 1 -- 172.21.15.92:0/1367179644 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61280043c0 con 0x5576d294d070 2024-09-21T07:16:42.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f6118ff9640 1 -- 172.21.15.92:0/1367179644 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f612c00f040 con 0x5576d294d070 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f613d99d740 10 client.16803 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f613d99d740 10 client.16803 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f613d99d740 20 client.16803 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f613d99d740 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5576d290b9f0 0x5576d2d121a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f613d99d740 4 client.16803 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.030+0000 7f613d99d740 1 -- 172.21.15.92:0/1367179644 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576d2c6cdf0 con 0x5576d290b9f0 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.031+0000 7f61351c5640 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5576d290b9f0 0x5576d2d121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.031+0000 7f6118ff9640 10 client.16803 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.031+0000 7f61351c5640 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5576d290b9f0 0x5576d2d121a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ce5623d839414893 server_cookie=5f02c54e61c59c3f in_seq=0 out_seq=0 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f6118ff9640 1 -- 172.21.15.92:0/1367179644 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576d2c6cdf0 con 0x5576d290b9f0 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f6118ff9640 10 client.16803 handle_command_reply: tid=0 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f613d99d740 1 client.16803 shutdown 2024-09-21T07:16:42.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f613d99d740 1 -- 172.21.15.92:0/1367179644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 msgr2=0x5576d2d007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f613d99d740 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2d007c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f612c010bf0 tx=0x7f612c004ab0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f613d99d740 1 -- 172.21.15.92:0/1367179644 shutdown_connections 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f613d99d740 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5576d290b9f0 0x5576d2d121a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f613d99d740 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2d007c0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f6118ff9640 0 client.16803 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f613d99d740 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d292c390 0x5576d2d00240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f613d99d740 1 --2- 172.21.15.92:0/1367179644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d29241b0 0x5576d2cffd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.032+0000 7f613d99d740 1 -- 172.21.15.92:0/1367179644 >> 172.21.15.92:0/1367179644 conn(0x5576d2941460 msgr2=0x5576d2cf7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.033+0000 7f613d99d740 1 -- 172.21.15.92:0/1367179644 shutdown_connections 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.033+0000 7f613d99d740 1 -- 172.21.15.92:0/1367179644 wait complete. 2024-09-21T07:16:42.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.033+0000 7f613d99d740 20 client.16803 trim_cache size 0 max 16384 2024-09-21T07:16:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f613d99d740 1 Processor -- start 2024-09-21T07:16:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f613d99d740 1 -- start start 2024-09-21T07:16:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f613d99d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d29241b0 0x5576d2cf5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f613d99d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 0x5576d2cfcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f613d99d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2cfd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f613d99d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61301aed00 con 0x5576d294d070 2024-09-21T07:16:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f613d99d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61301b0840 con 0x5576d29241b0 2024-09-21T07:16:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f613d99d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f61301af3d0 con 0x5576d292c390 2024-09-21T07:16:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f61359c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2cfd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f61359c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2cfd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35816/0 (socket says 172.21.15.92:35816) 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f61359c6640 1 -- 172.21.15.92:0/1819042367 learned_addr learned my addr 172.21.15.92:0/1819042367 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f61349c4640 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 0x5576d2cfcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.046+0000 7f61351c5640 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d29241b0 0x5576d2cf5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f61359c6640 1 -- 172.21.15.92:0/1819042367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 msgr2=0x5576d2cfcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f61359c6640 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 0x5576d2cfcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f61359c6640 1 -- 172.21.15.92:0/1819042367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d29241b0 msgr2=0x5576d2cf5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f61359c6640 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d29241b0 0x5576d2cf5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f61359c6640 1 -- 172.21.15.92:0/1819042367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d2cf2680 con 0x5576d294d070 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f61349c4640 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 0x5576d2cfcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f61351c5640 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d29241b0 0x5576d2cf5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f61359c6640 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2cfd430 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f612c010bc0 tx=0x7f612c005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597e9d65a93264 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f611affd640 1 -- 172.21.15.92:0/1819042367 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c013270 con 0x5576d294d070 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f611affd640 1 -- 172.21.15.92:0/1819042367 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f612c013410 con 0x5576d294d070 2024-09-21T07:16:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.047+0000 7f611affd640 1 -- 172.21.15.92:0/1819042367 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c01e720 con 0x5576d294d070 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 -- 172.21.15.92:0/1819042367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 msgr2=0x5576d2cfd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2cfd430 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f612c010bc0 tx=0x7f612c005c30 comp rx=0 tx=0).stop 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 -- 172.21.15.92:0/1819042367 shutdown_connections 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d294d070 0x5576d2cfd430 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 0x5576d2cfcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 --2- 172.21.15.92:0/1819042367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d29241b0 0x5576d2cf5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 -- 172.21.15.92:0/1819042367 >> 172.21.15.92:0/1819042367 conn(0x5576d2941460 msgr2=0x5576d2cf5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 -- 172.21.15.92:0/1819042367 shutdown_connections 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 -- 172.21.15.92:0/1819042367 wait complete. 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 -- start start 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.048+0000 7f613d99d740 1 Processor -- start 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f613d99d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2d08100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f613d99d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 0x5576d2d08640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f613d99d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d294d070 0x5576d2d75b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f613d99d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61301b0170 con 0x5576d29241b0 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f613d99d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61301afaa0 con 0x5576d294d070 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f613d99d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f61301acce0 con 0x5576d292c390 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f613d99d740 10 client.0 _ll_register_callbacks cb 0x7f612c010a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61351c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2d08100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61351c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2d08100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35828/0 (socket says 172.21.15.92:35828) 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61351c5640 1 -- 172.21.15.92:0/2630616726 learned_addr learned my addr 172.21.15.92:0/2630616726 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61359c6640 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d294d070 0x5576d2d75b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61349c4640 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 0x5576d2d08640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61351c5640 1 -- 172.21.15.92:0/2630616726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 msgr2=0x5576d2d08640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61351c5640 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 0x5576d2d08640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61351c5640 1 -- 172.21.15.92:0/2630616726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d294d070 msgr2=0x5576d2d75b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61351c5640 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d294d070 0x5576d2d75b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61351c5640 1 -- 172.21.15.92:0/2630616726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d2d08b80 con 0x5576d29241b0 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61359c6640 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d294d070 0x5576d2d75b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f61351c5640 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2d08100 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f61280ad1c0 tx=0x7f612800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be321b319e6942bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.049+0000 7f6118ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f6118ff9640 1 -- 172.21.15.92:0/2630616726 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612801b540 con 0x5576d29241b0 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f6118ff9640 1 -- 172.21.15.92:0/2630616726 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f61280e4db0 con 0x5576d29241b0 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f613d99d740 1 -- 172.21.15.92:0/2630616726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f612c013410 con 0x5576d29241b0 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f6118ff9640 1 -- 172.21.15.92:0/2630616726 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f612801b730 con 0x5576d29241b0 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f613d99d740 10 client.16809 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f613d99d740 1 -- 172.21.15.92:0/2630616726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5576d2d81150 con 0x5576d29241b0 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f6118ff9640 1 -- 172.21.15.92:0/2630616726 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f612c013410 con 0x5576d29241b0 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f6118ff9640 1 -- 172.21.15.92:0/2630616726 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f61280e7040 con 0x5576d29241b0 2024-09-21T07:16:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f613d99d740 10 client.16809 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f613d99d740 10 client.16809 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f613d99d740 20 client.16809 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f613d99d740 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5576d28e0da0 0x5576d2d834f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f613d99d740 4 client.16809 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.050+0000 7f613d99d740 1 -- 172.21.15.92:0/2630616726 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576d2c688a0 con 0x5576d28e0da0 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f61349c4640 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5576d28e0da0 0x5576d2d834f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f6118ff9640 10 client.16809 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f61349c4640 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5576d28e0da0 0x5576d2d834f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb8d6e45b652d1df server_cookie=6a4141791b5f8d36 in_seq=0 out_seq=0 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f6118ff9640 1 -- 172.21.15.92:0/2630616726 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576d2c688a0 con 0x5576d28e0da0 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f6118ff9640 10 client.16809 handle_command_reply: tid=0 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f613d99d740 1 client.16809 shutdown 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f613d99d740 1 -- 172.21.15.92:0/2630616726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 msgr2=0x5576d2d08100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f613d99d740 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2d08100 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f61280ad1c0 tx=0x7f612800c810 comp rx=0 tx=0).stop 2024-09-21T07:16:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f613d99d740 1 -- 172.21.15.92:0/2630616726 shutdown_connections 2024-09-21T07:16:42.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f613d99d740 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5576d28e0da0 0x5576d2d834f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f613d99d740 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5576d294d070 0x5576d2d75b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f613d99d740 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576d292c390 0x5576d2d08640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f6118ff9640 0 client.16809 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:16:42.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f613d99d740 1 --2- 172.21.15.92:0/2630616726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576d29241b0 0x5576d2d08100 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.051+0000 7f613d99d740 1 -- 172.21.15.92:0/2630616726 >> 172.21.15.92:0/2630616726 conn(0x5576d2941460 msgr2=0x5576d2d0b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:42.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f613d99d740 1 -- 172.21.15.92:0/2630616726 shutdown_connections 2024-09-21T07:16:42.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f613d99d740 1 -- 172.21.15.92:0/2630616726 wait complete. 2024-09-21T07:16:42.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f613d99d740 20 client.16809 trim_cache size 0 max 16384 2024-09-21T07:16:42.062 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:16:42.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 -- 172.21.15.92:0/2662125974 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f611c0b6680 msgr2=0x7f611c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:42.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f611c0b6680 0x7f611c0b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f612c005fd0 tx=0x7f612c009600 comp rx=0 tx=0).stop 2024-09-21T07:16:42.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 -- 172.21.15.92:0/2662125974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6130102a60 msgr2=0x7f61301993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:42.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6130102a60 0x7f61301993d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f612800c890 tx=0x7f612800cd50 comp rx=0 tx=0).stop 2024-09-21T07:16:42.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 -- 172.21.15.92:0/2662125974 shutdown_connections 2024-09-21T07:16:42.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f611c0b6680 0x7f611c0b8b90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6130108cf0 0x7f613019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61301083a0 0x7f6130199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 --2- 172.21.15.92:0/2662125974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6130102a60 0x7f61301993d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:42.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 -- 172.21.15.92:0/2662125974 >> 172.21.15.92:0/2662125974 conn(0x7f6130079760 msgr2=0x7f61301045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:42.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 -- 172.21.15.92:0/2662125974 shutdown_connections 2024-09-21T07:16:42.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:42.052+0000 7f6137429640 1 -- 172.21.15.92:0/2662125974 wait complete. 2024-09-21T07:16:42.825 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:16:43.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:42 smithi175 ceph-mon[34064]: pgmap v448: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-21T07:16:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:42 smithi092 ceph-mon[30987]: pgmap v448: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-21T07:16:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:42 smithi169 ceph-mon[33705]: pgmap v448: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.680+0000 7f2d7769d640 1 -- 172.21.15.92:0/330289983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d701083a0 msgr2=0x7f2d701087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.680+0000 7f2d7769d640 1 --2- 172.21.15.92:0/330289983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d701083a0 0x7f2d701087b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009900 tx=0x7f2d6002a410 comp rx=0 tx=0).stop 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.680+0000 7f2d7769d640 1 -- 172.21.15.92:0/330289983 shutdown_connections 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.680+0000 7f2d7769d640 1 --2- 172.21.15.92:0/330289983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d70108cf0 0x7f2d7010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.680+0000 7f2d7769d640 1 --2- 172.21.15.92:0/330289983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d701083a0 0x7f2d701087b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.680+0000 7f2d7769d640 1 --2- 172.21.15.92:0/330289983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d70102a60 0x7f2d70102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.680+0000 7f2d7769d640 1 -- 172.21.15.92:0/330289983 >> 172.21.15.92:0/330289983 conn(0x7f2d70079730 msgr2=0x7f2d70079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.680+0000 7f2d7769d640 1 -- 172.21.15.92:0/330289983 shutdown_connections 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.680+0000 7f2d7769d640 1 -- 172.21.15.92:0/330289983 wait complete. 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.681+0000 7f2d7769d640 1 Processor -- start 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.681+0000 7f2d7769d640 1 -- start start 2024-09-21T07:16:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.681+0000 7f2d7769d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d70102a60 0x7f2d7019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.681+0000 7f2d7769d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d701083a0 0x7f2d7019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.681+0000 7f2d7769d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d70108cf0 0x7f2d7019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.681+0000 7f2d7769d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d70112810 con 0x7f2d70102a60 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.681+0000 7f2d7769d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d70112690 con 0x7f2d701083a0 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.681+0000 7f2d7769d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d70112990 con 0x7f2d70108cf0 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d75439640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d70102a60 0x7f2d7019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d75439640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d70102a60 0x7f2d7019a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35848/0 (socket says 172.21.15.92:35848) 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d75439640 1 -- 172.21.15.92:0/3770317888 learned_addr learned my addr 172.21.15.92:0/3770317888 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d74c38640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d701083a0 0x7f2d7019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d70108cf0 0x7f2d7019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d75439640 1 -- 172.21.15.92:0/3770317888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d70108cf0 msgr2=0x7f2d7019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d75439640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d70108cf0 0x7f2d7019fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d75439640 1 -- 172.21.15.92:0/3770317888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d701083a0 msgr2=0x7f2d7019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:43.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d75439640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d701083a0 0x7f2d7019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d75439640 1 -- 172.21.15.92:0/3770317888 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d701a0320 con 0x7f2d70102a60 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d74c38640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d701083a0 0x7f2d7019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d75439640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d70102a60 0x7f2d7019a3b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00c970 tx=0x7f2d6c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d667fc640 1 -- 172.21.15.92:0/3770317888 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c007bb0 con 0x7f2d70102a60 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d7769d640 1 -- 172.21.15.92:0/3770317888 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d701a0610 con 0x7f2d70102a60 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d667fc640 1 -- 172.21.15.92:0/3770317888 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d6c007d50 con 0x7f2d70102a60 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d667fc640 1 -- 172.21.15.92:0/3770317888 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c004e40 con 0x7f2d70102a60 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.682+0000 7f2d7769d640 1 -- 172.21.15.92:0/3770317888 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d701a6d70 con 0x7f2d70102a60 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d7dc11740 1 Processor -- start 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d7dc11740 1 -- start start 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d667fc640 1 -- 172.21.15.92:0/3770317888 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f2d6c005020 con 0x7f2d70102a60 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c166a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e48461b0 0x5567e4c16be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 0x5567e4c17120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5567e4b8cea0 con 0x5567e486f070 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5567e4b7c2d0 con 0x5567e48461b0 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5567e4b800e0 con 0x5567e484e390 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d75c3a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c166a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d75c3a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c166a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35860/0 (socket says 172.21.15.92:35860) 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.685+0000 7f2d75c3a640 1 -- 172.21.15.92:0/1886348893 learned_addr learned my addr 172.21.15.92:0/1886348893 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d75439640 1 --2- 172.21.15.92:0/1886348893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e48461b0 0x5567e4c16be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d74c38640 1 --2- 172.21.15.92:0/1886348893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 0x5567e4c17120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d75c3a640 1 -- 172.21.15.92:0/1886348893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 msgr2=0x5567e4c17120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/1886348893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 0x5567e4c17120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d75c3a640 1 -- 172.21.15.92:0/1886348893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e48461b0 msgr2=0x5567e4c16be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/1886348893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e48461b0 0x5567e4c16be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d75c3a640 1 -- 172.21.15.92:0/1886348893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567e48da650 con 0x5567e486f070 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d74c38640 1 --2- 172.21.15.92:0/1886348893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 0x5567e4c17120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:43.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d667fc640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d5c0b6680 0x7f2d5c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d75439640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d5c0b6680 0x7f2d5c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/1886348893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c166a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009ee0 tx=0x7f2d68010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466cb062f9aef474 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:43.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d667fc640 1 -- 172.21.15.92:0/3770317888 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2d6c0e78a0 con 0x7f2d70102a60 2024-09-21T07:16:43.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d5b7fe640 1 -- 172.21.15.92:0/1886348893 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68016070 con 0x5567e486f070 2024-09-21T07:16:43.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d5b7fe640 1 -- 172.21.15.92:0/1886348893 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d68004d20 con 0x5567e486f070 2024-09-21T07:16:43.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.686+0000 7f2d5b7fe640 1 -- 172.21.15.92:0/1886348893 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d680126b0 con 0x5567e486f070 2024-09-21T07:16:43.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.687+0000 7f2d7dc11740 1 -- 172.21.15.92:0/1886348893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 msgr2=0x5567e4c166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:43.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.687+0000 7f2d75439640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d5c0b6680 0x7f2d5c0b8b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0e4d00 tx=0x7f2d6c007f80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:43.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.687+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/1886348893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c166a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009ee0 tx=0x7f2d68010740 comp rx=0 tx=0).stop 2024-09-21T07:16:43.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.687+0000 7f2d7dc11740 1 -- 172.21.15.92:0/1886348893 shutdown_connections 2024-09-21T07:16:43.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.687+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/1886348893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 0x5567e4c17120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.687+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/1886348893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e48461b0 0x5567e4c16be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.687+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/1886348893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c166a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.687+0000 7f2d7dc11740 1 -- 172.21.15.92:0/1886348893 >> 172.21.15.92:0/1886348893 conn(0x5567e4863460 msgr2=0x5567e4c14590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.687+0000 7f2d7dc11740 1 -- 172.21.15.92:0/1886348893 shutdown_connections 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.687+0000 7f2d7dc11740 1 -- 172.21.15.92:0/1886348893 wait complete. 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d7dc11740 1 -- start start 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d7dc11740 1 Processor -- start 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e48461b0 0x5567e4c21de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e484e390 0x5567e4c22320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c2e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5567e49dd700 con 0x5567e486f070 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5567e4b17160 con 0x5567e484e390 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5567e4c24e80 con 0x5567e48461b0 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d7dc11740 10 client.0 _ll_register_callbacks cb 0x5567e4b309e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d75c3a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c2e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d75c3a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c2e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35876/0 (socket says 172.21.15.92:35876) 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d75c3a640 1 -- 172.21.15.92:0/3722511347 learned_addr learned my addr 172.21.15.92:0/3722511347 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.688+0000 7f2d74c38640 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e484e390 0x5567e4c22320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e48461b0 0x5567e4c21de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d75c3a640 1 -- 172.21.15.92:0/3722511347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e48461b0 msgr2=0x5567e4c21de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e48461b0 0x5567e4c21de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d75c3a640 1 -- 172.21.15.92:0/3722511347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e484e390 msgr2=0x5567e4c22320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e484e390 0x5567e4c22320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d75c3a640 1 -- 172.21.15.92:0/3722511347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567e4b44c90 con 0x5567e486f070 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c2e170 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2d680058c0 tx=0x7f2d68005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a329bac784aa1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d58ff9640 1 -- 172.21.15.92:0/3722511347 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68016030 con 0x5567e486f070 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d58ff9640 1 -- 172.21.15.92:0/3722511347 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2d68012ce0 con 0x5567e486f070 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3722511347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d68004d20 con 0x5567e486f070 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d58ff9640 1 -- 172.21.15.92:0/3722511347 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d68004ed0 con 0x5567e486f070 2024-09-21T07:16:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d7dc11740 10 client.16821 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3722511347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5567e4c30b60 con 0x5567e486f070 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.689+0000 7f2d58ff9640 1 -- 172.21.15.92:0/3722511347 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d68004d20 con 0x5567e486f070 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.690+0000 7f2d58ff9640 1 -- 172.21.15.92:0/3722511347 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2d6800f040 con 0x5567e486f070 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.690+0000 7f2d7dc11740 10 client.16821 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.690+0000 7f2d7dc11740 10 client.16821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.690+0000 7f2d7dc11740 20 client.16821 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.690+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567e482d9f0 0x5567e4c33ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.690+0000 7f2d7dc11740 4 client.16821 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.690+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3722511347 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567e4b8edf0 con 0x5567e482d9f0 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.690+0000 7f2d74c38640 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567e482d9f0 0x5567e4c33ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.690+0000 7f2d58ff9640 10 client.16821 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.690+0000 7f2d74c38640 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567e482d9f0 0x5567e4c33ec0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca46ddd33c0277f7 server_cookie=2a6596b53d7cde1b in_seq=0 out_seq=0 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d58ff9640 1 -- 172.21.15.92:0/3722511347 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5567e4b8edf0 con 0x5567e482d9f0 2024-09-21T07:16:43.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d58ff9640 10 client.16821 handle_command_reply: tid=0 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d7dc11740 1 client.16821 shutdown 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3722511347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 msgr2=0x5567e4c2e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c2e170 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2d680058c0 tx=0x7f2d68005c40 comp rx=0 tx=0).stop 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3722511347 shutdown_connections 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567e482d9f0 0x5567e4c33ec0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e486f070 0x5567e4c2e170 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d58ff9640 0 client.16821 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e484e390 0x5567e4c22320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/3722511347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e48461b0 0x5567e4c21de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.691+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3722511347 >> 172.21.15.92:0/3722511347 conn(0x5567e4863460 msgr2=0x5567e4c19880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.692+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3722511347 shutdown_connections 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.692+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3722511347 wait complete. 2024-09-21T07:16:43.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.692+0000 7f2d7dc11740 20 client.16821 trim_cache size 0 max 16384 2024-09-21T07:16:43.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d7dc11740 1 Processor -- start 2024-09-21T07:16:43.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d7dc11740 1 -- start start 2024-09-21T07:16:43.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e482d9f0 0x5567e4c222a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e48461b0 0x5567e4c197a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e484e390 0x5567e4c19ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701b0e70 con 0x5567e484e390 2024-09-21T07:16:43.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701b29b0 con 0x5567e482d9f0 2024-09-21T07:16:43.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701b1540 con 0x5567e48461b0 2024-09-21T07:16:43.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d75c3a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e484e390 0x5567e4c19ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d75c3a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e484e390 0x5567e4c19ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35884/0 (socket says 172.21.15.92:35884) 2024-09-21T07:16:43.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.705+0000 7f2d75c3a640 1 -- 172.21.15.92:0/3130571972 learned_addr learned my addr 172.21.15.92:0/3130571972 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:43.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d74c38640 1 --2- 172.21.15.92:0/3130571972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e48461b0 0x5567e4c197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/3130571972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e482d9f0 0x5567e4c222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d75c3a640 1 -- 172.21.15.92:0/3130571972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e48461b0 msgr2=0x5567e4c197a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/3130571972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e48461b0 0x5567e4c197a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d75c3a640 1 -- 172.21.15.92:0/3130571972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e482d9f0 msgr2=0x5567e4c222a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/3130571972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e482d9f0 0x5567e4c222a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d75c3a640 1 -- 172.21.15.92:0/3130571972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567e4c19500 con 0x5567e484e390 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/3130571972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e484e390 0x5567e4c19ce0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2d680058f0 tx=0x7f2d68010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e56a5aedbdfb87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d5affd640 1 -- 172.21.15.92:0/3130571972 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68039070 con 0x5567e484e390 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d5affd640 1 -- 172.21.15.92:0/3130571972 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d68024040 con 0x5567e484e390 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.706+0000 7f2d5affd640 1 -- 172.21.15.92:0/3130571972 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68016040 con 0x5567e484e390 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.707+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3130571972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e484e390 msgr2=0x5567e4c19ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.707+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/3130571972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e484e390 0x5567e4c19ce0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2d680058f0 tx=0x7f2d68010740 comp rx=0 tx=0).stop 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.707+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3130571972 shutdown_connections 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.707+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/3130571972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e484e390 0x5567e4c19ce0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.707+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/3130571972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e48461b0 0x5567e4c197a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.707+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/3130571972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e482d9f0 0x5567e4c222a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.707+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3130571972 >> 172.21.15.92:0/3130571972 conn(0x5567e4863460 msgr2=0x5567e4c21b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.707+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3130571972 shutdown_connections 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.707+0000 7f2d7dc11740 1 -- 172.21.15.92:0/3130571972 wait complete. 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d7dc11740 1 -- start start 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d7dc11740 1 Processor -- start 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e482d9f0 0x5567e4c37720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e48461b0 0x5567e4c34bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d7dc11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 0x5567e4c35170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701b22e0 con 0x5567e482d9f0 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701b1c10 con 0x5567e48461b0 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d7dc11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701aee50 con 0x5567e484e390 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d7dc11740 10 client.0 _ll_register_callbacks cb 0x7f2d68009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d75c3a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e482d9f0 0x5567e4c37720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d75c3a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e482d9f0 0x5567e4c37720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35892/0 (socket says 172.21.15.92:35892) 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.708+0000 7f2d75c3a640 1 -- 172.21.15.92:0/2103086641 learned_addr learned my addr 172.21.15.92:0/2103086641 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 0x5567e4c35170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d74c38640 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e48461b0 0x5567e4c34bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d75c3a640 1 -- 172.21.15.92:0/2103086641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 msgr2=0x5567e4c35170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 0x5567e4c35170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d75c3a640 1 -- 172.21.15.92:0/2103086641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e48461b0 msgr2=0x5567e4c34bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e48461b0 0x5567e4c34bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d75c3a640 1 -- 172.21.15.92:0/2103086641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567e4c35900 con 0x5567e482d9f0 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d75c3a640 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e482d9f0 0x5567e4c37720 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009ca0 tx=0x7f2d6801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbe4a44d9062a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d58ff9640 1 -- 172.21.15.92:0/2103086641 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68016070 con 0x5567e482d9f0 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d58ff9640 1 -- 172.21.15.92:0/2103086641 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2d68005960 con 0x5567e482d9f0 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d7dc11740 1 -- 172.21.15.92:0/2103086641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d68024040 con 0x5567e482d9f0 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d58ff9640 1 -- 172.21.15.92:0/2103086641 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d68039050 con 0x5567e482d9f0 2024-09-21T07:16:43.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d7dc11740 10 client.16827 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.709+0000 7f2d7dc11740 1 -- 172.21.15.92:0/2103086641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5567e4c9e5c0 con 0x5567e482d9f0 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.710+0000 7f2d58ff9640 1 -- 172.21.15.92:0/2103086641 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d68024040 con 0x5567e482d9f0 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.710+0000 7f2d58ff9640 1 -- 172.21.15.92:0/2103086641 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2d68034420 con 0x5567e482d9f0 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.710+0000 7f2d7dc11740 10 client.16827 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.710+0000 7f2d7dc11740 10 client.16827 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.710+0000 7f2d7dc11740 20 client.16827 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.710+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567e486f070 0x5567e4ca0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.710+0000 7f2d7dc11740 4 client.16827 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.710+0000 7f2d7dc11740 1 -- 172.21.15.92:0/2103086641 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5567e4b8a8a0 con 0x5567e486f070 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.710+0000 7f2d74c38640 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567e486f070 0x5567e4ca0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d58ff9640 10 client.16827 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:43.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d74c38640 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567e486f070 0x5567e4ca0bc0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15e94f24b8f2702 server_cookie=4d820fc9f5ae447e in_seq=0 out_seq=0 2024-09-21T07:16:43.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d58ff9640 1 -- 172.21.15.92:0/2103086641 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5567e4b8a8a0 con 0x5567e486f070 2024-09-21T07:16:43.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d58ff9640 10 client.16827 handle_command_reply: tid=0 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 client.16827 shutdown 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 -- 172.21.15.92:0/2103086641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e482d9f0 msgr2=0x5567e4c37720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e482d9f0 0x5567e4c37720 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009ca0 tx=0x7f2d6801ac60 comp rx=0 tx=0).stop 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 -- 172.21.15.92:0/2103086641 shutdown_connections 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567e486f070 0x5567e4ca0bc0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567e484e390 0x5567e4c35170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567e48461b0 0x5567e4c34bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 --2- 172.21.15.92:0/2103086641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567e482d9f0 0x5567e4c37720 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 -- 172.21.15.92:0/2103086641 >> 172.21.15.92:0/2103086641 conn(0x5567e4863460 msgr2=0x5567e4c197a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d58ff9640 0 client.16827 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 -- 172.21.15.92:0/2103086641 shutdown_connections 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 1 -- 172.21.15.92:0/2103086641 wait complete. 2024-09-21T07:16:43.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.711+0000 7f2d7dc11740 20 client.16827 trim_cache size 0 max 16384 2024-09-21T07:16:43.720 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:16:43.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 -- 172.21.15.92:0/3770317888 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d5c0b6680 msgr2=0x7f2d5c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:43.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d5c0b6680 0x7f2d5c0b8b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0e4d00 tx=0x7f2d6c007f80 comp rx=0 tx=0).stop 2024-09-21T07:16:43.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 -- 172.21.15.92:0/3770317888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d70102a60 msgr2=0x7f2d7019a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:43.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d70102a60 0x7f2d7019a3b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00c970 tx=0x7f2d6c00ce30 comp rx=0 tx=0).stop 2024-09-21T07:16:43.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 -- 172.21.15.92:0/3770317888 shutdown_connections 2024-09-21T07:16:43.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d5c0b6680 0x7f2d5c0b8b90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d70108cf0 0x7f2d7019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d701083a0 0x7f2d7019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 --2- 172.21.15.92:0/3770317888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d70102a60 0x7f2d7019a3b0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:43.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 -- 172.21.15.92:0/3770317888 >> 172.21.15.92:0/3770317888 conn(0x7f2d70079730 msgr2=0x7f2d7006b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:43.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 -- 172.21.15.92:0/3770317888 shutdown_connections 2024-09-21T07:16:43.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:43.712+0000 7f2d7769d640 1 -- 172.21.15.92:0/3770317888 wait complete. 2024-09-21T07:16:44.127 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:16:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:44.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:44 smithi092 ceph-mon[30987]: pgmap v449: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T07:16:45.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:44 smithi175 ceph-mon[34064]: pgmap v449: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T07:16:45.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:44 smithi169 ceph-mon[33705]: pgmap v449: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T07:16:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.237+0000 7f0f28593640 1 -- 172.21.15.92:0/1899338878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f20102a60 msgr2=0x7f0f20102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.237+0000 7f0f28593640 1 --2- 172.21.15.92:0/1899338878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f20102a60 0x7f0f20102e70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009900 tx=0x7f0f1c02a410 comp rx=0 tx=0).stop 2024-09-21T07:16:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.237+0000 7f0f28593640 1 -- 172.21.15.92:0/1899338878 shutdown_connections 2024-09-21T07:16:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.237+0000 7f0f28593640 1 --2- 172.21.15.92:0/1899338878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f20108cf0 0x7f0f2010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.237+0000 7f0f28593640 1 --2- 172.21.15.92:0/1899338878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f201083a0 0x7f0f201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.237+0000 7f0f28593640 1 --2- 172.21.15.92:0/1899338878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f20102a60 0x7f0f20102e70 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.237+0000 7f0f28593640 1 -- 172.21.15.92:0/1899338878 >> 172.21.15.92:0/1899338878 conn(0x7f0f20079730 msgr2=0x7f0f20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.237+0000 7f0f28593640 1 -- 172.21.15.92:0/1899338878 shutdown_connections 2024-09-21T07:16:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.238+0000 7f0f28593640 1 -- 172.21.15.92:0/1899338878 wait complete. 2024-09-21T07:16:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f28593640 1 Processor -- start 2024-09-21T07:16:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f28593640 1 -- start start 2024-09-21T07:16:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f28593640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f20102a60 0x7f0f2019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f28593640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f201083a0 0x7f0f2019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f28593640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20108cf0 0x7f0f2019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f28593640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20112810 con 0x7f0f201083a0 2024-09-21T07:16:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f28593640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20112690 con 0x7f0f20102a60 2024-09-21T07:16:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f28593640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20112990 con 0x7f0f20108cf0 2024-09-21T07:16:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f25b2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f201083a0 0x7f0f2019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f25b2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f201083a0 0x7f0f2019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35908/0 (socket says 172.21.15.92:35908) 2024-09-21T07:16:45.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.239+0000 7f0f25b2e640 1 -- 172.21.15.92:0/623346648 learned_addr learned my addr 172.21.15.92:0/623346648 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:45.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f2632f640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f20102a60 0x7f0f2019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f26b30640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20108cf0 0x7f0f2019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f25b2e640 1 -- 172.21.15.92:0/623346648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20108cf0 msgr2=0x7f0f2019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f25b2e640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20108cf0 0x7f0f2019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f25b2e640 1 -- 172.21.15.92:0/623346648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f20102a60 msgr2=0x7f0f2019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f25b2e640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f20102a60 0x7f0f2019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f25b2e640 1 -- 172.21.15.92:0/623346648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f201a02c0 con 0x7f0f201083a0 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f26b30640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20108cf0 0x7f0f2019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f2632f640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f20102a60 0x7f0f2019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f25b2e640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f201083a0 0x7f0f2019a9b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0f10005fd0 tx=0x7f0f1000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f177fe640 1 -- 172.21.15.92:0/623346648 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10017070 con 0x7f0f201083a0 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f28593640 1 -- 172.21.15.92:0/623346648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f201a05b0 con 0x7f0f201083a0 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f177fe640 1 -- 172.21.15.92:0/623346648 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f10009c30 con 0x7f0f201083a0 2024-09-21T07:16:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f177fe640 1 -- 172.21.15.92:0/623346648 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10003c70 con 0x7f0f201083a0 2024-09-21T07:16:45.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.240+0000 7f0f28593640 1 -- 172.21.15.92:0/623346648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f201043c0 con 0x7f0f201083a0 2024-09-21T07:16:45.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.242+0000 7f0f28593640 1 -- 172.21.15.92:0/623346648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f20103ce0 con 0x7f0f201083a0 2024-09-21T07:16:45.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.243+0000 7f0f177fe640 1 -- 172.21.15.92:0/623346648 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f0f10003e10 con 0x7f0f201083a0 2024-09-21T07:16:45.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.244+0000 7f0f177fe640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f0c0b6730 0x7f0f0c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.244+0000 7f0f2632f640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f0c0b6730 0x7f0f0c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.244+0000 7f0f177fe640 1 -- 172.21.15.92:0/623346648 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0f100e7f10 con 0x7f0f201083a0 2024-09-21T07:16:45.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.245+0000 7f0f2632f640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f0c0b6730 0x7f0f0c0b8c40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c000c00 tx=0x7f0f1c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:45.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.247+0000 7f0f177fe640 1 -- 172.21.15.92:0/623346648 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f10020030 con 0x7f0f201083a0 2024-09-21T07:16:45.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.471+0000 7f0f28593640 1 -- 172.21.15.92:0/623346648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f20102e70 con 0x7f0f201083a0 2024-09-21T07:16:45.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.472+0000 7f0f177fe640 1 -- 172.21.15.92:0/623346648 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f0f100ae140 con 0x7f0f201083a0 2024-09-21T07:16:45.474 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:16:45.474 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:16:45.474 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:16:45.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.475+0000 7f0f28593640 1 -- 172.21.15.92:0/623346648 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f0c0b6730 msgr2=0x7f0f0c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.475+0000 7f0f28593640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f0c0b6730 0x7f0f0c0b8c40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c000c00 tx=0x7f0f1c005a20 comp rx=0 tx=0).stop 2024-09-21T07:16:45.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.475+0000 7f0f28593640 1 -- 172.21.15.92:0/623346648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f201083a0 msgr2=0x7f0f2019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.475+0000 7f0f28593640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f201083a0 0x7f0f2019a9b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0f10005fd0 tx=0x7f0f1000dde0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.476+0000 7f0f28593640 1 -- 172.21.15.92:0/623346648 shutdown_connections 2024-09-21T07:16:45.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.476+0000 7f0f28593640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0f0c0b6730 0x7f0f0c0b8c40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.476+0000 7f0f28593640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20108cf0 0x7f0f2019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.476+0000 7f0f28593640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f201083a0 0x7f0f2019a9b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.476+0000 7f0f28593640 1 --2- 172.21.15.92:0/623346648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f20102a60 0x7f0f2019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.476+0000 7f0f28593640 1 -- 172.21.15.92:0/623346648 >> 172.21.15.92:0/623346648 conn(0x7f0f20079730 msgr2=0x7f0f20106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:45.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.476+0000 7f0f28593640 1 -- 172.21.15.92:0/623346648 shutdown_connections 2024-09-21T07:16:45.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:45.476+0000 7f0f28593640 1 -- 172.21.15.92:0/623346648 wait complete. 2024-09-21T07:16:45.637 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:16:45.638 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:16:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.724+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1607404187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c4108330 msgr2=0x7f58c4108740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.724+0000 7f58ca4fa640 1 --2- 172.21.15.92:0/1607404187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c4108330 0x7f58c4108740 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009900 tx=0x7f58b802a410 comp rx=0 tx=0).stop 2024-09-21T07:16:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.724+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1607404187 shutdown_connections 2024-09-21T07:16:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.724+0000 7f58ca4fa640 1 --2- 172.21.15.92:0/1607404187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4108c80 0x7f58c410f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.724+0000 7f58ca4fa640 1 --2- 172.21.15.92:0/1607404187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c4108330 0x7f58c4108740 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.724+0000 7f58ca4fa640 1 --2- 172.21.15.92:0/1607404187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c4103170 0x7f58c4103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.724+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1607404187 >> 172.21.15.92:0/1607404187 conn(0x7f58c4079e90 msgr2=0x7f58c407a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.725+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1607404187 shutdown_connections 2024-09-21T07:16:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.725+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1607404187 wait complete. 2024-09-21T07:16:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.725+0000 7f58ca4fa640 1 Processor -- start 2024-09-21T07:16:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.725+0000 7f58ca4fa640 1 -- start start 2024-09-21T07:16:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58ca4fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c4103170 0x7f58c419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58ca4fa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4108330 0x7f58c419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58ca4fa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c4108c80 0x7f58c419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58ca4fa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41127f0 con 0x7f58c4108c80 2024-09-21T07:16:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58ca4fa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4112670 con 0x7f58c4103170 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58ca4fa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4112970 con 0x7f58c4108330 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58c8a97640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c4108c80 0x7f58c419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58c8a97640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c4108c80 0x7f58c419bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35930/0 (socket says 172.21.15.92:35930) 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58c8a97640 1 -- 172.21.15.92:0/1404459732 learned_addr learned my addr 172.21.15.92:0/1404459732 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58c37fe640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4108330 0x7f58c419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58c3fff640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c4103170 0x7f58c419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58c8a97640 1 -- 172.21.15.92:0/1404459732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4108330 msgr2=0x7f58c419b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58c8a97640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4108330 0x7f58c419b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58c8a97640 1 -- 172.21.15.92:0/1404459732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c4103170 msgr2=0x7f58c419b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58c8a97640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c4103170 0x7f58c419b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.726+0000 7f58c8a97640 1 -- 172.21.15.92:0/1404459732 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c41a6470 con 0x7f58c4108c80 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.727+0000 7f58c8a97640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c4108c80 0x7f58c419bc60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009fd0 tx=0x7f58bc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.727+0000 7f58c17fa640 1 -- 172.21.15.92:0/1404459732 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc017070 con 0x7f58c4108c80 2024-09-21T07:16:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.727+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1404459732 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c4199030 con 0x7f58c4108c80 2024-09-21T07:16:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.727+0000 7f58c17fa640 1 -- 172.21.15.92:0/1404459732 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58bc003e00 con 0x7f58c4108c80 2024-09-21T07:16:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.727+0000 7f58c17fa640 1 -- 172.21.15.92:0/1404459732 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc010460 con 0x7f58c4108c80 2024-09-21T07:16:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.727+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1404459732 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c4199550 con 0x7f58c4108c80 2024-09-21T07:16:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.729+0000 7f58d1463740 1 Processor -- start 2024-09-21T07:16:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58c17fa640 1 -- 172.21.15.92:0/1404459732 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f58bc003970 con 0x7f58c4108c80 2024-09-21T07:16:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58d1463740 1 -- start start 2024-09-21T07:16:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58d1463740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b35a1b0 0x56101b6ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58d1463740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b3312f0 0x56101b6ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58d1463740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3394d0 0x56101b700430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58d1463740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56101b6746f0 con 0x56101b3312f0 2024-09-21T07:16:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58d1463740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56101b663b20 con 0x56101b35a1b0 2024-09-21T07:16:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58d1463740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56101b667930 con 0x56101b3394d0 2024-09-21T07:16:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58c3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b3312f0 0x56101b6ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58c3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b3312f0 0x56101b6ffef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35938/0 (socket says 172.21.15.92:35938) 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58c3fff640 1 -- 172.21.15.92:0/4155518825 learned_addr learned my addr 172.21.15.92:0/4155518825 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58c17fa640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58ac0b6680 0x7f58ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58c37fe640 1 --2- 172.21.15.92:0/4155518825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3394d0 0x56101b700430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.730+0000 7f58c37fe640 1 --2- 172.21.15.92:0/4155518825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b35a1b0 0x56101b6ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58c8a97640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58ac0b6680 0x7f58ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58c3fff640 1 -- 172.21.15.92:0/4155518825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3394d0 msgr2=0x56101b700430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58c3fff640 1 --2- 172.21.15.92:0/4155518825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3394d0 0x56101b700430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58c3fff640 1 -- 172.21.15.92:0/4155518825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b35a1b0 msgr2=0x56101b6ff9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58c3fff640 1 --2- 172.21.15.92:0/4155518825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b35a1b0 0x56101b6ff9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58c3fff640 1 -- 172.21.15.92:0/4155518825 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56101b629530 con 0x56101b3312f0 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58c37fe640 1 --2- 172.21.15.92:0/4155518825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b35a1b0 0x56101b6ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58c17fa640 1 -- 172.21.15.92:0/1404459732 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f58bc0e7bc0 con 0x7f58c4108c80 2024-09-21T07:16:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58c3fff640 1 --2- 172.21.15.92:0/4155518825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b3312f0 0x56101b6ffef0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f58b400abe0 tx=0x7f58b400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189076ea869cba22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58aa7fc640 1 -- 172.21.15.92:0/4155518825 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4005220 con 0x56101b3312f0 2024-09-21T07:16:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58c8a97640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58ac0b6680 0x7f58ac0b8b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0e5020 tx=0x7f58bc076240 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58aa7fc640 1 -- 172.21.15.92:0/4155518825 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58b40047a0 con 0x56101b3312f0 2024-09-21T07:16:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.731+0000 7f58aa7fc640 1 -- 172.21.15.92:0/4155518825 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b40186a0 con 0x56101b3312f0 2024-09-21T07:16:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.732+0000 7f58d1463740 1 -- 172.21.15.92:0/4155518825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b3312f0 msgr2=0x56101b6ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.732+0000 7f58d1463740 1 --2- 172.21.15.92:0/4155518825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b3312f0 0x56101b6ffef0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f58b400abe0 tx=0x7f58b400f790 comp rx=0 tx=0).stop 2024-09-21T07:16:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.732+0000 7f58d1463740 1 -- 172.21.15.92:0/4155518825 shutdown_connections 2024-09-21T07:16:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.732+0000 7f58d1463740 1 --2- 172.21.15.92:0/4155518825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3394d0 0x56101b700430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.732+0000 7f58d1463740 1 --2- 172.21.15.92:0/4155518825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b3312f0 0x56101b6ffef0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.732+0000 7f58d1463740 1 --2- 172.21.15.92:0/4155518825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b35a1b0 0x56101b6ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.732+0000 7f58d1463740 1 -- 172.21.15.92:0/4155518825 >> 172.21.15.92:0/4155518825 conn(0x56101b34e300 msgr2=0x56101b6fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.732+0000 7f58d1463740 1 -- 172.21.15.92:0/4155518825 shutdown_connections 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.732+0000 7f58d1463740 1 -- 172.21.15.92:0/4155518825 wait complete. 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.732+0000 7f58d1463740 1 -- start start 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58d1463740 1 Processor -- start 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58d1463740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3312f0 0x56101b70b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58d1463740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 0x56101b70b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58d1463740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b35a1b0 0x56101b717420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58d1463740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56101b59bab0 con 0x56101b35a1b0 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58d1463740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56101b609730 con 0x56101b3394d0 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58d1463740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56101b70e130 con 0x56101b3312f0 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58d1463740 10 client.0 _ll_register_callbacks cb 0x56101b65d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b35a1b0 0x56101b717420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b35a1b0 0x56101b717420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35950/0 (socket says 172.21.15.92:35950) 2024-09-21T07:16:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58c37fe640 1 -- 172.21.15.92:0/778277378 learned_addr learned my addr 172.21.15.92:0/778277378 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58c37fe640 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3312f0 0x56101b70b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.733+0000 7f58c3fff640 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 0x56101b70b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58c37fe640 1 -- 172.21.15.92:0/778277378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3312f0 msgr2=0x56101b70b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58c37fe640 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3312f0 0x56101b70b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58c37fe640 1 -- 172.21.15.92:0/778277378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 msgr2=0x56101b70b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58c37fe640 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 0x56101b70b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58c37fe640 1 -- 172.21.15.92:0/778277378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56101b3c5790 con 0x56101b35a1b0 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58c3fff640 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 0x56101b70b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58c37fe640 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b35a1b0 0x56101b717420 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f58b8000c00 tx=0x7f58b802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92800a6dde85ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58a37fe640 1 -- 172.21.15.92:0/778277378 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8035040 con 0x56101b35a1b0 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58a37fe640 1 -- 172.21.15.92:0/778277378 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f58b8004250 con 0x56101b35a1b0 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58d1463740 1 -- 172.21.15.92:0/778277378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b40047a0 con 0x56101b35a1b0 2024-09-21T07:16:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58a37fe640 1 -- 172.21.15.92:0/778277378 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f58b8053050 con 0x56101b35a1b0 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58d1463740 10 client.16845 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58d1463740 1 -- 172.21.15.92:0/778277378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56101b43e620 con 0x56101b35a1b0 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.734+0000 7f58a37fe640 1 -- 172.21.15.92:0/778277378 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58b40047a0 con 0x56101b35a1b0 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.735+0000 7f58a37fe640 1 -- 172.21.15.92:0/778277378 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f58b803d450 con 0x56101b35a1b0 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.735+0000 7f58d1463740 10 client.16845 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.735+0000 7f58d1463740 10 client.16845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.735+0000 7f58d1463740 20 client.16845 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.735+0000 7f58d1463740 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56101b318d80 0x56101b71d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.735+0000 7f58d1463740 4 client.16845 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.735+0000 7f58d1463740 1 -- 172.21.15.92:0/778277378 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56101b676640 con 0x56101b318d80 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.735+0000 7f58c3fff640 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56101b318d80 0x56101b71d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.736+0000 7f58a37fe640 10 client.16845 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.736+0000 7f58c3fff640 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56101b318d80 0x56101b71d120 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa6faa00884938aa server_cookie=db41385b40b48e57 in_seq=0 out_seq=0 2024-09-21T07:16:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.736+0000 7f58a37fe640 1 -- 172.21.15.92:0/778277378 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56101b676640 con 0x56101b318d80 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.736+0000 7f58a37fe640 10 client.16845 handle_command_reply: tid=0 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.736+0000 7f58d1463740 1 client.16845 shutdown 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 1 -- 172.21.15.92:0/778277378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b35a1b0 msgr2=0x56101b717420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b35a1b0 0x56101b717420 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f58b8000c00 tx=0x7f58b802a410 comp rx=0 tx=0).stop 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 1 -- 172.21.15.92:0/778277378 shutdown_connections 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56101b318d80 0x56101b71d120 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b35a1b0 0x56101b717420 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 0x56101b70b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 1 --2- 172.21.15.92:0/778277378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3312f0 0x56101b70b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 1 -- 172.21.15.92:0/778277378 >> 172.21.15.92:0/778277378 conn(0x56101b34e300 msgr2=0x56101b7009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58a37fe640 0 client.16845 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 1 -- 172.21.15.92:0/778277378 shutdown_connections 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 1 -- 172.21.15.92:0/778277378 wait complete. 2024-09-21T07:16:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.737+0000 7f58d1463740 20 client.16845 trim_cache size 0 max 16384 2024-09-21T07:16:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58d1463740 1 Processor -- start 2024-09-21T07:16:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58d1463740 1 -- start start 2024-09-21T07:16:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58d1463740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3312f0 0x56101b6fc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58d1463740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3394d0 0x56101b70cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58d1463740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b708210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58d1463740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b2f50 con 0x56101b2ee1c0 2024-09-21T07:16:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58d1463740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b4a90 con 0x56101b3312f0 2024-09-21T07:16:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58d1463740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b3620 con 0x56101b3394d0 2024-09-21T07:16:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b708210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b708210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35964/0 (socket says 172.21.15.92:35964) 2024-09-21T07:16:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58c37fe640 1 -- 172.21.15.92:0/344344208 learned_addr learned my addr 172.21.15.92:0/344344208 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58c37fe640 1 --2- 172.21.15.92:0/344344208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3312f0 0x56101b6fc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58c3fff640 1 --2- 172.21.15.92:0/344344208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3394d0 0x56101b70cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58c37fe640 1 -- 172.21.15.92:0/344344208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3394d0 msgr2=0x56101b70cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58c37fe640 1 --2- 172.21.15.92:0/344344208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3394d0 0x56101b70cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58c37fe640 1 -- 172.21.15.92:0/344344208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3312f0 msgr2=0x56101b6fc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.755+0000 7f58c37fe640 1 --2- 172.21.15.92:0/344344208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3312f0 0x56101b6fc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.756+0000 7f58c37fe640 1 -- 172.21.15.92:0/344344208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56101b70b960 con 0x56101b2ee1c0 2024-09-21T07:16:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.756+0000 7f58c37fe640 1 --2- 172.21.15.92:0/344344208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b708210 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f58b803d990 tx=0x7f58b8040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ddf2b99b5f7a5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.756+0000 7f58a9ffb640 1 -- 172.21.15.92:0/344344208 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8035070 con 0x56101b2ee1c0 2024-09-21T07:16:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.756+0000 7f58a9ffb640 1 -- 172.21.15.92:0/344344208 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58b8005850 con 0x56101b2ee1c0 2024-09-21T07:16:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.756+0000 7f58a9ffb640 1 -- 172.21.15.92:0/344344208 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b80035f0 con 0x56101b2ee1c0 2024-09-21T07:16:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.757+0000 7f58d1463740 1 -- 172.21.15.92:0/344344208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 msgr2=0x56101b708210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.757+0000 7f58d1463740 1 --2- 172.21.15.92:0/344344208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b708210 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f58b803d990 tx=0x7f58b8040040 comp rx=0 tx=0).stop 2024-09-21T07:16:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.757+0000 7f58d1463740 1 -- 172.21.15.92:0/344344208 shutdown_connections 2024-09-21T07:16:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.757+0000 7f58d1463740 1 --2- 172.21.15.92:0/344344208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b708210 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.757+0000 7f58d1463740 1 --2- 172.21.15.92:0/344344208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3394d0 0x56101b70cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.757+0000 7f58d1463740 1 --2- 172.21.15.92:0/344344208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3312f0 0x56101b6fc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.757+0000 7f58d1463740 1 -- 172.21.15.92:0/344344208 >> 172.21.15.92:0/344344208 conn(0x56101b34e300 msgr2=0x56101b70c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.757+0000 7f58d1463740 1 -- 172.21.15.92:0/344344208 shutdown_connections 2024-09-21T07:16:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.757+0000 7f58d1463740 1 -- 172.21.15.92:0/344344208 wait complete. 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.757+0000 7f58d1463740 1 -- start start 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.758+0000 7f58d1463740 1 Processor -- start 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.758+0000 7f58d1463740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b713ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.758+0000 7f58d1463740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3312f0 0x56101b710f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.758+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b713ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.758+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b713ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35970/0 (socket says 172.21.15.92:35970) 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.758+0000 7f58c37fe640 1 -- 172.21.15.92:0/974542968 learned_addr learned my addr 172.21.15.92:0/974542968 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.758+0000 7f58d1463740 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 0x56101b7114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.758+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b43c0 con 0x56101b2ee1c0 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.758+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b3cf0 con 0x56101b3394d0 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.758+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41b0f30 con 0x56101b3312f0 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58d1463740 10 client.0 _ll_register_callbacks cb 0x7f58b8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58c3fff640 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3312f0 0x56101b710f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58c37fe640 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 0x56101b7114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58c37fe640 1 -- 172.21.15.92:0/974542968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3312f0 msgr2=0x56101b710f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58c37fe640 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3312f0 0x56101b710f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58c37fe640 1 -- 172.21.15.92:0/974542968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 msgr2=0x56101b7114b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58c37fe640 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 0x56101b7114b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58c37fe640 1 -- 172.21.15.92:0/974542968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56101b711ba0 con 0x56101b2ee1c0 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58c37fe640 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b713ab0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f58b8006010 tx=0x7f58b802ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dffc4a64dc6a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.759+0000 7f58a37fe640 1 -- 172.21.15.92:0/974542968 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8035030 con 0x56101b2ee1c0 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b8005850 con 0x56101b2ee1c0 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58a37fe640 1 -- 172.21.15.92:0/974542968 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f58b8048070 con 0x56101b2ee1c0 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58a37fe640 1 -- 172.21.15.92:0/974542968 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f58b8031a20 con 0x56101b2ee1c0 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58d1463740 10 client.16851 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56101b787970 con 0x56101b2ee1c0 2024-09-21T07:16:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58a37fe640 1 -- 172.21.15.92:0/974542968 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58b8005850 con 0x56101b2ee1c0 2024-09-21T07:16:45.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58a37fe640 1 -- 172.21.15.92:0/974542968 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f58b8062020 con 0x56101b2ee1c0 2024-09-21T07:16:45.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58d1463740 10 client.16851 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:45.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58d1463740 10 client.16851 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:45.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58d1463740 20 client.16851 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:45.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58d1463740 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56101b788020 0x56101b78a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:45.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58d1463740 4 client.16851 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:16:45.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.760+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56101b6720f0 con 0x56101b788020 2024-09-21T07:16:45.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.761+0000 7f58c3fff640 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56101b788020 0x56101b78a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:45.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.761+0000 7f58a37fe640 10 client.16851 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:45.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.761+0000 7f58c3fff640 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56101b788020 0x56101b78a440 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ffc7241cdaad21 server_cookie=97b3ebbdeba6c613 in_seq=0 out_seq=0 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.767+0000 7f58a37fe640 1 -- 172.21.15.92:0/974542968 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56101b6720f0 con 0x56101b788020 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.767+0000 7f58a37fe640 10 client.16851 handle_command_reply: tid=0 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 client.16851 shutdown 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 msgr2=0x56101b713ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b713ab0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f58b8006010 tx=0x7f58b802ab90 comp rx=0 tx=0).stop 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 shutdown_connections 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56101b788020 0x56101b78a440 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56101b3394d0 0x56101b7114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58a37fe640 0 client.16851 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56101b3312f0 0x56101b710f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 --2- 172.21.15.92:0/974542968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56101b2ee1c0 0x56101b713ab0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 >> 172.21.15.92:0/974542968 conn(0x56101b34e300 msgr2=0x56101b6fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:45.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 shutdown_connections 2024-09-21T07:16:45.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 1 -- 172.21.15.92:0/974542968 wait complete. 2024-09-21T07:16:45.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58d1463740 20 client.16851 trim_cache size 0 max 16384 2024-09-21T07:16:45.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:16:45.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:16:45.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:16:45.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:16:45.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1404459732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58ac0b6680 msgr2=0x7f58ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.768+0000 7f58ca4fa640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58ac0b6680 0x7f58ac0b8b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0e5020 tx=0x7f58bc076240 comp rx=0 tx=0).stop 2024-09-21T07:16:45.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.769+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1404459732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c4108c80 msgr2=0x7f58c419bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:45.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.769+0000 7f58ca4fa640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c4108c80 0x7f58c419bc60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009fd0 tx=0x7f58bc00b260 comp rx=0 tx=0).stop 2024-09-21T07:16:45.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.769+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1404459732 shutdown_connections 2024-09-21T07:16:45.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.769+0000 7f58ca4fa640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f58ac0b6680 0x7f58ac0b8b90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.769+0000 7f58ca4fa640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58c4108c80 0x7f58c419bc60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.769+0000 7f58ca4fa640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4108330 0x7f58c419b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.769+0000 7f58ca4fa640 1 --2- 172.21.15.92:0/1404459732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c4103170 0x7f58c419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.769+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1404459732 >> 172.21.15.92:0/1404459732 conn(0x7f58c4079e90 msgr2=0x7f58c4104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.769+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1404459732 shutdown_connections 2024-09-21T07:16:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:45.769+0000 7f58ca4fa640 1 -- 172.21.15.92:0/1404459732 wait complete. 2024-09-21T07:16:46.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:45 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/623346648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:46.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:45 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/623346648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:46.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:45 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/623346648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:16:46.280 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24649 quiesce db --set-id b6b97c80 --release --await' 2024-09-21T07:16:46.281 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24649 quiesce db --set-id b6b97c80 --release --await 2024-09-21T07:16:46.360 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:46.864 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:46.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.867+0000 7f29d6c9c640 1 -- 172.21.15.92:0/3667234350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d01049b0 msgr2=0x7f29d0104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:46.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.867+0000 7f29d6c9c640 1 --2- 172.21.15.92:0/3667234350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d01049b0 0x7f29d0104dc0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009900 tx=0x7f29c402a410 comp rx=0 tx=0).stop 2024-09-21T07:16:46.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.867+0000 7f29d6c9c640 1 -- 172.21.15.92:0/3667234350 shutdown_connections 2024-09-21T07:16:46.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.867+0000 7f29d6c9c640 1 --2- 172.21.15.92:0/3667234350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29d010de10 0x7f29d0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.867+0000 7f29d6c9c640 1 --2- 172.21.15.92:0/3667234350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d0105300 0x7f29d010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.867+0000 7f29d6c9c640 1 --2- 172.21.15.92:0/3667234350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d01049b0 0x7f29d0104dc0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.867+0000 7f29d6c9c640 1 -- 172.21.15.92:0/3667234350 >> 172.21.15.92:0/3667234350 conn(0x7f29d0079730 msgr2=0x7f29d0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:46.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.867+0000 7f29d6c9c640 1 -- 172.21.15.92:0/3667234350 shutdown_connections 2024-09-21T07:16:46.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.867+0000 7f29d6c9c640 1 -- 172.21.15.92:0/3667234350 wait complete. 2024-09-21T07:16:46.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29d6c9c640 1 Processor -- start 2024-09-21T07:16:46.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29d6c9c640 1 -- start start 2024-09-21T07:16:46.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29d6c9c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d01049b0 0x7f29d019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29d6c9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d0105300 0x7f29d019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29d6c9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29d010de10 0x7f29d019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29d6c9c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29d0113920 con 0x7f29d0105300 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29d6c9c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29d01137a0 con 0x7f29d01049b0 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29d6c9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29d0113aa0 con 0x7f29d010de10 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d0105300 0x7f29d019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d0105300 0x7f29d019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35988/0 (socket says 172.21.15.92:35988) 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29cffff640 1 -- 172.21.15.92:0/2575488372 learned_addr learned my addr 172.21.15.92:0/2575488372 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29d4a38640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d01049b0 0x7f29d019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.868+0000 7f29d5239640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29d010de10 0x7f29d019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29cffff640 1 -- 172.21.15.92:0/2575488372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29d010de10 msgr2=0x7f29d019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29cffff640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29d010de10 0x7f29d019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29cffff640 1 -- 172.21.15.92:0/2575488372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d01049b0 msgr2=0x7f29d019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:46.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29cffff640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d01049b0 0x7f29d019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29cffff640 1 -- 172.21.15.92:0/2575488372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d01a03e0 con 0x7f29d0105300 2024-09-21T07:16:46.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29d5239640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29d010de10 0x7f29d019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:46.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29cffff640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d0105300 0x7f29d019aa10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00d740 tx=0x7f29bc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:46.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29cdffb640 1 -- 172.21.15.92:0/2575488372 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc017070 con 0x7f29d0105300 2024-09-21T07:16:46.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29d6c9c640 1 -- 172.21.15.92:0/2575488372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d01a06d0 con 0x7f29d0105300 2024-09-21T07:16:46.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29cdffb640 1 -- 172.21.15.92:0/2575488372 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29bc00de50 con 0x7f29d0105300 2024-09-21T07:16:46.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29cdffb640 1 -- 172.21.15.92:0/2575488372 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00f620 con 0x7f29d0105300 2024-09-21T07:16:46.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.869+0000 7f29d6c9c640 1 -- 172.21.15.92:0/2575488372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d01a6e30 con 0x7f29d0105300 2024-09-21T07:16:46.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.872+0000 7f29dd210740 1 Processor -- start 2024-09-21T07:16:46.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.872+0000 7f29dd210740 1 -- start start 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.872+0000 7f29dd210740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 0x5618ee89b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.872+0000 7f29dd210740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee89b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.872+0000 7f29dd210740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee89beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29dd210740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618ee811e60 con 0x5618ee4d3670 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29dd210740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618ee801290 con 0x5618ee4cb490 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29dd210740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5618ee8050a0 con 0x5618ee4f4350 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29d5239640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 0x5618ee89b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29d5239640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 0x5618ee89b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:35538/0 (socket says 172.21.15.92:35538) 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29d5239640 1 -- 172.21.15.92:0/3020193301 learned_addr learned my addr 172.21.15.92:0/3020193301 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29d4a38640 1 --2- 172.21.15.92:0/3020193301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee89b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29cdffb640 1 -- 172.21.15.92:0/2575488372 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f29bc01a070 con 0x7f29d0105300 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29cffff640 1 --2- 172.21.15.92:0/3020193301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee89beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29d5239640 1 -- 172.21.15.92:0/3020193301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 msgr2=0x5618ee89b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29d5239640 1 --2- 172.21.15.92:0/3020193301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee89b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29d5239640 1 -- 172.21.15.92:0/3020193301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 msgr2=0x5618ee89beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29d5239640 1 --2- 172.21.15.92:0/3020193301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee89beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29d5239640 1 -- 172.21.15.92:0/3020193301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618ee55f930 con 0x5618ee4f4350 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.873+0000 7f29cffff640 1 --2- 172.21.15.92:0/3020193301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee89beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.874+0000 7f29d5239640 1 --2- 172.21.15.92:0/3020193301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 0x5618ee89b430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f29c800f360 tx=0x7f29c800f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6b11e3b51ada63a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.874+0000 7f29baffd640 1 -- 172.21.15.92:0/3020193301 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8015070 con 0x5618ee4f4350 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.874+0000 7f29cdffb640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f29c00b6700 0x7f29c00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.874+0000 7f29baffd640 1 -- 172.21.15.92:0/3020193301 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c8011b90 con 0x5618ee4f4350 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.874+0000 7f29baffd640 1 -- 172.21.15.92:0/3020193301 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8010a90 con 0x5618ee4f4350 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.874+0000 7f29cdffb640 1 -- 172.21.15.92:0/2575488372 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f29bc0e7480 con 0x7f29d0105300 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.874+0000 7f29d4a38640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f29c00b6700 0x7f29c00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.875+0000 7f29dd210740 1 -- 172.21.15.92:0/3020193301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 msgr2=0x5618ee89b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:46.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.875+0000 7f29d4a38640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f29c00b6700 0x7f29c00b8c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f29c4006010 tx=0x7f29c4005a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:46.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.875+0000 7f29dd210740 1 --2- 172.21.15.92:0/3020193301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 0x5618ee89b430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f29c800f360 tx=0x7f29c800f820 comp rx=0 tx=0).stop 2024-09-21T07:16:46.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.875+0000 7f29dd210740 1 -- 172.21.15.92:0/3020193301 shutdown_connections 2024-09-21T07:16:46.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.875+0000 7f29dd210740 1 --2- 172.21.15.92:0/3020193301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee89beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.875+0000 7f29dd210740 1 --2- 172.21.15.92:0/3020193301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee89b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.875+0000 7f29dd210740 1 --2- 172.21.15.92:0/3020193301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 0x5618ee89b430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.875+0000 7f29dd210740 1 -- 172.21.15.92:0/3020193301 >> 172.21.15.92:0/3020193301 conn(0x5618ee4e8740 msgr2=0x5618ee899320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:46.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.875+0000 7f29dd210740 1 -- 172.21.15.92:0/3020193301 shutdown_connections 2024-09-21T07:16:46.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.875+0000 7f29dd210740 1 -- 172.21.15.92:0/3020193301 wait complete. 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29dd210740 1 -- start start 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29dd210740 1 Processor -- start 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29dd210740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4cb490 0x5618ee8ab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29dd210740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 0x5618ee8aba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29dd210740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4f4350 0x5618ee8b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29dd210740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618ee662890 con 0x5618ee4cb490 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29dd210740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5618ee79bd40 con 0x5618ee4f4350 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29dd210740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5618ee8adf40 con 0x5618ee4d3670 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29d4a38640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4cb490 0x5618ee8ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29dd210740 10 client.0 _ll_register_callbacks cb 0x5618ee7ffc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29d4a38640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4cb490 0x5618ee8ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36014/0 (socket says 172.21.15.92:36014) 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.876+0000 7f29d4a38640 1 -- 172.21.15.92:0/3827192380 learned_addr learned my addr 172.21.15.92:0/3827192380 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29d5239640 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4f4350 0x5618ee8b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29cffff640 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 0x5618ee8aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29d4a38640 1 -- 172.21.15.92:0/3827192380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 msgr2=0x5618ee8aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29d4a38640 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 0x5618ee8aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29d4a38640 1 -- 172.21.15.92:0/3827192380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4f4350 msgr2=0x5618ee8b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29d4a38640 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4f4350 0x5618ee8b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29d4a38640 1 -- 172.21.15.92:0/3827192380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618ee8b7910 con 0x5618ee4cb490 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29d5239640 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4f4350 0x5618ee8b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29cffff640 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 0x5618ee8aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29d4a38640 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4cb490 0x5618ee8ab480 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f29c4005f70 tx=0x7f29c4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44eb970bfa661ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.877+0000 7f29affff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29affff640 1 -- 172.21.15.92:0/3827192380 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c404c030 con 0x5618ee4cb490 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29affff640 1 -- 172.21.15.92:0/3827192380 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f29c40035f0 con 0x5618ee4cb490 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29dd210740 1 -- 172.21.15.92:0/3827192380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29c8011b90 con 0x5618ee4cb490 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29affff640 1 -- 172.21.15.92:0/3827192380 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29c4059050 con 0x5618ee4cb490 2024-09-21T07:16:46.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29dd210740 10 client.16860 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29dd210740 1 -- 172.21.15.92:0/3827192380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5618ee8ba190 con 0x5618ee4cb490 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29affff640 1 -- 172.21.15.92:0/3827192380 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c8011b90 con 0x5618ee4cb490 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29affff640 1 -- 172.21.15.92:0/3827192380 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f29c40487e0 con 0x5618ee4cb490 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29dd210740 10 client.16860 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29dd210740 10 client.16860 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29dd210740 20 client.16860 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29dd210740 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618ee4b2cd0 0x5618ee8bd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29dd210740 4 client.16860 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.878+0000 7f29dd210740 1 -- 172.21.15.92:0/3827192380 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618ee813db0 con 0x5618ee4b2cd0 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.879+0000 7f29cffff640 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618ee4b2cd0 0x5618ee8bd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.879+0000 7f29affff640 10 client.16860 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:46.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.879+0000 7f29cffff640 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618ee4b2cd0 0x5618ee8bd730 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2010347d8fb3c88 server_cookie=43dbf9eb2e7acb22 in_seq=0 out_seq=0 2024-09-21T07:16:46.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29affff640 1 -- 172.21.15.92:0/3827192380 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618ee813db0 con 0x5618ee4b2cd0 2024-09-21T07:16:46.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29affff640 10 client.16860 handle_command_reply: tid=0 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 client.16860 shutdown 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 -- 172.21.15.92:0/3827192380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4cb490 msgr2=0x5618ee8ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4cb490 0x5618ee8ab480 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f29c4005f70 tx=0x7f29c4009260 comp rx=0 tx=0).stop 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 -- 172.21.15.92:0/3827192380 shutdown_connections 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618ee4b2cd0 0x5618ee8bd730 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4f4350 0x5618ee8b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 0x5618ee8aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29affff640 0 client.16860 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 --2- 172.21.15.92:0/3827192380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4cb490 0x5618ee8ab480 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 -- 172.21.15.92:0/3827192380 >> 172.21.15.92:0/3827192380 conn(0x5618ee4e8740 msgr2=0x5618ee89e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 -- 172.21.15.92:0/3827192380 shutdown_connections 2024-09-21T07:16:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.880+0000 7f29dd210740 1 -- 172.21.15.92:0/3827192380 wait complete. 2024-09-21T07:16:46.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.881+0000 7f29dd210740 20 client.16860 trim_cache size 0 max 16384 2024-09-21T07:16:46.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29dd210740 1 Processor -- start 2024-09-21T07:16:46.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29dd210740 1 -- start start 2024-09-21T07:16:46.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29dd210740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee89ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29dd210740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 0x5618ee8b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29dd210740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4f4350 0x5618ee8aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29dd210740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29d01aed50 con 0x5618ee4f4350 2024-09-21T07:16:46.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29dd210740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29d01b0890 con 0x5618ee4cb490 2024-09-21T07:16:46.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29dd210740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29d01af420 con 0x5618ee4d3670 2024-09-21T07:16:46.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29d5239640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4f4350 0x5618ee8aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29d5239640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4f4350 0x5618ee8aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36030/0 (socket says 172.21.15.92:36030) 2024-09-21T07:16:46.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.899+0000 7f29d5239640 1 -- 172.21.15.92:0/649808988 learned_addr learned my addr 172.21.15.92:0/649808988 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:46.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29d4a38640 1 --2- 172.21.15.92:0/649808988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee89ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29cffff640 1 --2- 172.21.15.92:0/649808988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 0x5618ee8b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29d4a38640 1 -- 172.21.15.92:0/649808988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 msgr2=0x5618ee8b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29d4a38640 1 --2- 172.21.15.92:0/649808988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 0x5618ee8b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29d4a38640 1 -- 172.21.15.92:0/649808988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4f4350 msgr2=0x5618ee8aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29d4a38640 1 --2- 172.21.15.92:0/649808988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4f4350 0x5618ee8aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29d4a38640 1 -- 172.21.15.92:0/649808988 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618ee8949e0 con 0x5618ee4cb490 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29d5239640 1 --2- 172.21.15.92:0/649808988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4f4350 0x5618ee8aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29d4a38640 1 --2- 172.21.15.92:0/649808988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee89ec30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009900 tx=0x7f29c402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d81b28cc5dbddec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29ba7fc640 1 -- 172.21.15.92:0/649808988 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c404c040 con 0x5618ee4cb490 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29ba7fc640 1 -- 172.21.15.92:0/649808988 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c4009520 con 0x5618ee4cb490 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.900+0000 7f29ba7fc640 1 -- 172.21.15.92:0/649808988 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4035040 con 0x5618ee4cb490 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.901+0000 7f29dd210740 1 -- 172.21.15.92:0/649808988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 msgr2=0x5618ee89ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.901+0000 7f29dd210740 1 --2- 172.21.15.92:0/649808988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee89ec30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009900 tx=0x7f29c402a410 comp rx=0 tx=0).stop 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.901+0000 7f29dd210740 1 -- 172.21.15.92:0/649808988 shutdown_connections 2024-09-21T07:16:46.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.901+0000 7f29dd210740 1 --2- 172.21.15.92:0/649808988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4f4350 0x5618ee8aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.901+0000 7f29dd210740 1 --2- 172.21.15.92:0/649808988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4d3670 0x5618ee8b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.901+0000 7f29dd210740 1 --2- 172.21.15.92:0/649808988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee89ec30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.901+0000 7f29dd210740 1 -- 172.21.15.92:0/649808988 >> 172.21.15.92:0/649808988 conn(0x5618ee4e8740 msgr2=0x5618ee8ac7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:46.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.901+0000 7f29dd210740 1 -- 172.21.15.92:0/649808988 shutdown_connections 2024-09-21T07:16:46.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.901+0000 7f29dd210740 1 -- 172.21.15.92:0/649808988 wait complete. 2024-09-21T07:16:46.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29dd210740 1 -- start start 2024-09-21T07:16:46.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29dd210740 1 Processor -- start 2024-09-21T07:16:46.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29dd210740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee8af290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29dd210740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee8af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29dd210740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 0x5618ee8afd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29dd210740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29d01b01c0 con 0x5618ee4d3670 2024-09-21T07:16:46.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29dd210740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29d01afaf0 con 0x5618ee4cb490 2024-09-21T07:16:46.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29dd210740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29d01acd30 con 0x5618ee4f4350 2024-09-21T07:16:46.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29dd210740 10 client.0 _ll_register_callbacks cb 0x7f29c4031890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:46.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee8af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee8af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36034/0 (socket says 172.21.15.92:36034) 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.902+0000 7f29cffff640 1 -- 172.21.15.92:0/2024047544 learned_addr learned my addr 172.21.15.92:0/2024047544 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29d4a38640 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee8af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29d5239640 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 0x5618ee8afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29cffff640 1 -- 172.21.15.92:0/2024047544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 msgr2=0x5618ee8afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29cffff640 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 0x5618ee8afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29cffff640 1 -- 172.21.15.92:0/2024047544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 msgr2=0x5618ee8af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29cffff640 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee8af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29cffff640 1 -- 172.21.15.92:0/2024047544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618ee8ad9c0 con 0x5618ee4d3670 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29cffff640 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee8af7d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0aa240 tx=0x7f29bc0aced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d6c3a6a0336cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29affff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29affff640 1 -- 172.21.15.92:0/2024047544 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc021040 con 0x5618ee4d3670 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29affff640 1 -- 172.21.15.92:0/2024047544 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f29bc0e7110 con 0x5618ee4d3670 2024-09-21T07:16:46.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29dd210740 1 -- 172.21.15.92:0/2024047544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29c4009520 con 0x5618ee4d3670 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29affff640 1 -- 172.21.15.92:0/2024047544 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29bc0ad6d0 con 0x5618ee4d3670 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29dd210740 10 client.16866 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.903+0000 7f29dd210740 1 -- 172.21.15.92:0/2024047544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5618ee9282a0 con 0x5618ee4d3670 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29affff640 1 -- 172.21.15.92:0/2024047544 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c4009520 con 0x5618ee4d3670 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29affff640 1 -- 172.21.15.92:0/2024047544 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f29bc098080 con 0x5618ee4d3670 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29dd210740 10 client.16866 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29dd210740 10 client.16866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29dd210740 20 client.16866 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29dd210740 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618ee488080 0x5618ee92aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29dd210740 4 client.16866 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29dd210740 1 -- 172.21.15.92:0/2024047544 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5618ee80f860 con 0x5618ee488080 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29d4a38640 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618ee488080 0x5618ee92aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29affff640 10 client.16866 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:46.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.904+0000 7f29d4a38640 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618ee488080 0x5618ee92aa40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4434ce3dbcce62d6 server_cookie=f90e97f9f600addf in_seq=0 out_seq=0 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29affff640 1 -- 172.21.15.92:0/2024047544 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5618ee80f860 con 0x5618ee488080 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29affff640 10 client.16866 handle_command_reply: tid=0 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 client.16866 shutdown 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 -- 172.21.15.92:0/2024047544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 msgr2=0x5618ee8af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee8af7d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0aa240 tx=0x7f29bc0aced0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 -- 172.21.15.92:0/2024047544 shutdown_connections 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5618ee488080 0x5618ee92aa40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ee4f4350 0x5618ee8afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29affff640 0 client.16866 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618ee4d3670 0x5618ee8af7d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 --2- 172.21.15.92:0/2024047544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5618ee4cb490 0x5618ee8af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 -- 172.21.15.92:0/2024047544 >> 172.21.15.92:0/2024047544 conn(0x5618ee4e8740 msgr2=0x5618ee89ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 -- 172.21.15.92:0/2024047544 shutdown_connections 2024-09-21T07:16:46.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.906+0000 7f29dd210740 1 -- 172.21.15.92:0/2024047544 wait complete. 2024-09-21T07:16:46.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29dd210740 20 client.16866 trim_cache size 0 max 16384 2024-09-21T07:16:46.912 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:16:46.912 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:16:46.912 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76", 2024-09-21T07:16:46.912 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:16:46.912 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:16:46.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 -- 172.21.15.92:0/2575488372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f29c00b6700 msgr2=0x7f29c00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:46.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f29c00b6700 0x7f29c00b8c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f29c4006010 tx=0x7f29c4005a40 comp rx=0 tx=0).stop 2024-09-21T07:16:46.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 -- 172.21.15.92:0/2575488372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d0105300 msgr2=0x7f29d019aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:46.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d0105300 0x7f29d019aa10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00d740 tx=0x7f29bc00dc00 comp rx=0 tx=0).stop 2024-09-21T07:16:46.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 -- 172.21.15.92:0/2575488372 shutdown_connections 2024-09-21T07:16:46.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f29c00b6700 0x7f29c00b8c10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29d010de10 0x7f29d019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d0105300 0x7f29d019aa10 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 --2- 172.21.15.92:0/2575488372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d01049b0 0x7f29d019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:46.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 -- 172.21.15.92:0/2575488372 >> 172.21.15.92:0/2575488372 conn(0x7f29d0079730 msgr2=0x7f29d00ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:46.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 -- 172.21.15.92:0/2575488372 shutdown_connections 2024-09-21T07:16:46.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:46.907+0000 7f29d6c9c640 1 -- 172.21.15.92:0/2575488372 wait complete. 2024-09-21T07:16:47.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:46 smithi175 ceph-mon[34064]: pgmap v450: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:16:47.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:46 smithi092 ceph-mon[30987]: pgmap v450: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:16:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:46 smithi169 ceph-mon[33705]: pgmap v450: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:16:47.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:16:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.080+0000 7f0603741640 1 -- 172.21.15.92:0/3373030273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc1083c0 msgr2=0x7f05fc1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.080+0000 7f0603741640 1 --2- 172.21.15.92:0/3373030273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc1083c0 0x7f05fc1087d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009900 tx=0x7f05f002a410 comp rx=0 tx=0).stop 2024-09-21T07:16:48.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.080+0000 7f0603741640 1 -- 172.21.15.92:0/3373030273 shutdown_connections 2024-09-21T07:16:48.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.080+0000 7f0603741640 1 --2- 172.21.15.92:0/3373030273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05fc108d10 0x7f05fc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.080+0000 7f0603741640 1 --2- 172.21.15.92:0/3373030273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc1083c0 0x7f05fc1087d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.080+0000 7f0603741640 1 --2- 172.21.15.92:0/3373030273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05fc102a80 0x7f05fc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.080+0000 7f0603741640 1 -- 172.21.15.92:0/3373030273 >> 172.21.15.92:0/3373030273 conn(0x7f05fc079740 msgr2=0x7f05fc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:48.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.080+0000 7f0603741640 1 -- 172.21.15.92:0/3373030273 shutdown_connections 2024-09-21T07:16:48.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.080+0000 7f0603741640 1 -- 172.21.15.92:0/3373030273 wait complete. 2024-09-21T07:16:48.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.081+0000 7f0603741640 1 Processor -- start 2024-09-21T07:16:48.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.081+0000 7f0603741640 1 -- start start 2024-09-21T07:16:48.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0603741640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05fc102a80 0x7f05fc19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0603741640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc1083c0 0x7f05fc19a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0603741640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05fc108d10 0x7f05fc19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0603741640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc113950 con 0x7f05fc1083c0 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0603741640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc1137d0 con 0x7f05fc102a80 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0603741640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc113ad0 con 0x7f05fc108d10 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0600cdc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc1083c0 0x7f05fc19a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0600cdc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc1083c0 0x7f05fc19a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36060/0 (socket says 172.21.15.92:36060) 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0600cdc640 1 -- 172.21.15.92:0/1867636583 learned_addr learned my addr 172.21.15.92:0/1867636583 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f06014dd640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05fc102a80 0x7f05fc19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0601cde640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05fc108d10 0x7f05fc19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0600cdc640 1 -- 172.21.15.92:0/1867636583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05fc108d10 msgr2=0x7f05fc19fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0600cdc640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05fc108d10 0x7f05fc19fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0600cdc640 1 -- 172.21.15.92:0/1867636583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05fc102a80 msgr2=0x7f05fc19a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:48.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0600cdc640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05fc102a80 0x7f05fc19a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.082+0000 7f0600cdc640 1 -- 172.21.15.92:0/1867636583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05fc1a0310 con 0x7f05fc1083c0 2024-09-21T07:16:48.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.083+0000 7f0601cde640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05fc108d10 0x7f05fc19fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:48.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.083+0000 7f0600cdc640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc1083c0 0x7f05fc19a940 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f05f0005940 tx=0x7f05f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:48.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.083+0000 7f05fa7fc640 1 -- 172.21.15.92:0/1867636583 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f003f030 con 0x7f05fc1083c0 2024-09-21T07:16:48.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.083+0000 7f0603741640 1 -- 172.21.15.92:0/1867636583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05fc1a05a0 con 0x7f05fc1083c0 2024-09-21T07:16:48.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.083+0000 7f05fa7fc640 1 -- 172.21.15.92:0/1867636583 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05f0003c90 con 0x7f05fc1083c0 2024-09-21T07:16:48.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.083+0000 7f05fa7fc640 1 -- 172.21.15.92:0/1867636583 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0035070 con 0x7f05fc1083c0 2024-09-21T07:16:48.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.083+0000 7f0603741640 1 -- 172.21.15.92:0/1867636583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05fc1a6d60 con 0x7f05fc1083c0 2024-09-21T07:16:48.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.086+0000 7f05fa7fc640 1 -- 172.21.15.92:0/1867636583 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f05f0042030 con 0x7f05fc1083c0 2024-09-21T07:16:48.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.086+0000 7f0609cb5740 1 Processor -- start 2024-09-21T07:16:48.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.086+0000 7f0609cb5740 1 -- start start 2024-09-21T07:16:48.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.086+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 0x5643f939e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.086+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fcf660 0x5643f939ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.086+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fd7840 0x5643f939ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.086+0000 7f0609cb5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5643f9289dc0 con 0x5643f8fd7840 2024-09-21T07:16:48.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.086+0000 7f0609cb5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5643f93161f0 con 0x5643f8ff8520 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.086+0000 7f0609cb5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5643f9305620 con 0x5643f8fcf660 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f0600cdc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fd7840 0x5643f939ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f0601cde640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 0x5643f939e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f06014dd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fcf660 0x5643f939ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f0601cde640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 0x5643f939e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:56092/0 (socket says 172.21.15.92:56092) 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f0601cde640 1 -- 172.21.15.92:0/3293177044 learned_addr learned my addr 172.21.15.92:0/3293177044 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f0601cde640 1 -- 172.21.15.92:0/3293177044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fcf660 msgr2=0x5643f939ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f0601cde640 1 --2- 172.21.15.92:0/3293177044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fcf660 0x5643f939ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f0601cde640 1 -- 172.21.15.92:0/3293177044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fd7840 msgr2=0x5643f939ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f0601cde640 1 --2- 172.21.15.92:0/3293177044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fd7840 0x5643f939ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f0601cde640 1 -- 172.21.15.92:0/3293177044 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f92cdfd0 con 0x5643f8ff8520 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f05fa7fc640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05e40b6700 0x7f05e40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f06014dd640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05e40b6700 0x7f05e40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f0601cde640 1 --2- 172.21.15.92:0/3293177044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 0x5643f939e4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009fb0 tx=0x7f05ec010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8b61f045687b395 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.087+0000 7f05fa7fc640 1 -- 172.21.15.92:0/1867636583 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f05f0107fc0 con 0x7f05fc1083c0 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.088+0000 7f05e37fe640 1 -- 172.21.15.92:0/3293177044 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec016070 con 0x5643f8ff8520 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.088+0000 7f05e37fe640 1 -- 172.21.15.92:0/3293177044 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05ec012ba0 con 0x5643f8ff8520 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.088+0000 7f05e37fe640 1 -- 172.21.15.92:0/3293177044 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec01bba0 con 0x5643f8ff8520 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.088+0000 7f06014dd640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05e40b6700 0x7f05e40b8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5643f939d170 tx=0x7f05f400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 -- 172.21.15.92:0/3293177044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 msgr2=0x5643f939e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 --2- 172.21.15.92:0/3293177044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 0x5643f939e4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009fb0 tx=0x7f05ec010800 comp rx=0 tx=0).stop 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 -- 172.21.15.92:0/3293177044 shutdown_connections 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 --2- 172.21.15.92:0/3293177044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fd7840 0x5643f939ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 --2- 172.21.15.92:0/3293177044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fcf660 0x5643f939ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 --2- 172.21.15.92:0/3293177044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 0x5643f939e4f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 -- 172.21.15.92:0/3293177044 >> 172.21.15.92:0/3293177044 conn(0x5643f8fec910 msgr2=0x5643f939c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 -- 172.21.15.92:0/3293177044 shutdown_connections 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 -- 172.21.15.92:0/3293177044 wait complete. 2024-09-21T07:16:48.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 -- start start 2024-09-21T07:16:48.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.089+0000 7f0609cb5740 1 Processor -- start 2024-09-21T07:16:48.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8fd7840 0x5643f93aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8ff8520 0x5643f93b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f0609cb5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5643f92a0300 con 0x5643f8fcf660 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f0609cb5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5643f9309430 con 0x5643f8fd7840 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f0609cb5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5643f9166bb0 con 0x5643f8ff8520 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f0609cb5740 10 client.0 _ll_register_callbacks cb 0x5643f92ba120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f06014dd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f06014dd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93a9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36074/0 (socket says 172.21.15.92:36074) 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f06014dd640 1 -- 172.21.15.92:0/713103170 learned_addr learned my addr 172.21.15.92:0/713103170 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f0600cdc640 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8fd7840 0x5643f93aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.090+0000 7f0601cde640 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8ff8520 0x5643f93b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f06014dd640 1 -- 172.21.15.92:0/713103170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8ff8520 msgr2=0x5643f93b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f06014dd640 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8ff8520 0x5643f93b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f06014dd640 1 -- 172.21.15.92:0/713103170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8fd7840 msgr2=0x5643f93aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f06014dd640 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8fd7840 0x5643f93aa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f06014dd640 1 -- 172.21.15.92:0/713103170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f928f780 con 0x5643f8fcf660 2024-09-21T07:16:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f06014dd640 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93a9bc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f05f4003cb0 tx=0x7f05f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53e53280894ecc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f05e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f05e0ff9640 1 -- 172.21.15.92:0/713103170 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f402c060 con 0x5643f8fcf660 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f05e0ff9640 1 -- 172.21.15.92:0/713103170 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f05f4017030 con 0x5643f8fcf660 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f0609cb5740 1 -- 172.21.15.92:0/713103170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05ec012ba0 con 0x5643f8fcf660 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f05e0ff9640 1 -- 172.21.15.92:0/713103170 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f05f4033050 con 0x5643f8fcf660 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f0609cb5740 10 client.16878 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f0609cb5740 1 -- 172.21.15.92:0/713103170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5643f9063b00 con 0x5643f8fcf660 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.091+0000 7f05e0ff9640 1 -- 172.21.15.92:0/713103170 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05ec012ba0 con 0x5643f8fcf660 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.092+0000 7f05e0ff9640 1 -- 172.21.15.92:0/713103170 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f05f401c3f0 con 0x5643f8fcf660 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.092+0000 7f0609cb5740 10 client.16878 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.092+0000 7f0609cb5740 10 client.16878 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.092+0000 7f0609cb5740 20 client.16878 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.092+0000 7f0609cb5740 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5643f8fb6ea0 0x5643f93bc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.092+0000 7f0609cb5740 4 client.16878 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.092+0000 7f0609cb5740 1 -- 172.21.15.92:0/713103170 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643f9318140 con 0x5643f8fb6ea0 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.092+0000 7f0600cdc640 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5643f8fb6ea0 0x5643f93bc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.093+0000 7f05e0ff9640 10 client.16878 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.093+0000 7f0600cdc640 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5643f8fb6ea0 0x5643f93bc4c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=149d44406f6312f1 server_cookie=df5356bcb37d3f33 in_seq=0 out_seq=0 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.093+0000 7f05e0ff9640 1 -- 172.21.15.92:0/713103170 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643f9318140 con 0x5643f8fb6ea0 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.093+0000 7f05e0ff9640 10 client.16878 handle_command_reply: tid=0 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.093+0000 7f0609cb5740 1 client.16878 shutdown 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 1 -- 172.21.15.92:0/713103170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 msgr2=0x5643f93a9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93a9bc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f05f4003cb0 tx=0x7f05f4004730 comp rx=0 tx=0).stop 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 1 -- 172.21.15.92:0/713103170 shutdown_connections 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5643f8fb6ea0 0x5643f93bc4c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8ff8520 0x5643f93b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8fd7840 0x5643f93aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 1 --2- 172.21.15.92:0/713103170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93a9bc0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 1 -- 172.21.15.92:0/713103170 >> 172.21.15.92:0/713103170 conn(0x5643f8fec910 msgr2=0x5643f93a1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:48.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f05e0ff9640 0 client.16878 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:48.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 1 -- 172.21.15.92:0/713103170 shutdown_connections 2024-09-21T07:16:48.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 1 -- 172.21.15.92:0/713103170 wait complete. 2024-09-21T07:16:48.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.094+0000 7f0609cb5740 20 client.16878 trim_cache size 0 max 16384 2024-09-21T07:16:48.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.114+0000 7f0609cb5740 1 Processor -- start 2024-09-21T07:16:48.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.114+0000 7f0609cb5740 1 -- start start 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.114+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93ab750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.114+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 0x5643f93a8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.114+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 0x5643f939fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.114+0000 7f0609cb5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc1b0e10 con 0x5643f8fcf660 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.114+0000 7f0609cb5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc1b2950 con 0x5643f8ff8520 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.114+0000 7f0609cb5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc1b14e0 con 0x5643f8fd7840 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f06014dd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f06014dd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36086/0 (socket says 172.21.15.92:36086) 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f06014dd640 1 -- 172.21.15.92:0/2656248933 learned_addr learned my addr 172.21.15.92:0/2656248933 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f0600cdc640 1 --2- 172.21.15.92:0/2656248933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 0x5643f93a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f06014dd640 1 -- 172.21.15.92:0/2656248933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 msgr2=0x5643f93a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:48.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f06014dd640 1 --2- 172.21.15.92:0/2656248933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 0x5643f93a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f06014dd640 1 -- 172.21.15.92:0/2656248933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 msgr2=0x5643f939fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:48.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f06014dd640 1 --2- 172.21.15.92:0/2656248933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 0x5643f939fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f06014dd640 1 -- 172.21.15.92:0/2656248933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f90da960 con 0x5643f8fcf660 2024-09-21T07:16:48.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f0600cdc640 1 --2- 172.21.15.92:0/2656248933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 0x5643f93a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:48.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f06014dd640 1 --2- 172.21.15.92:0/2656248933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93ab750 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f05f4018040 tx=0x7f05f4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9445aba08333996 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:48.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f05e2ffd640 1 -- 172.21.15.92:0/2656248933 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f403c070 con 0x5643f8fcf660 2024-09-21T07:16:48.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f05e2ffd640 1 -- 172.21.15.92:0/2656248933 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05f401ce40 con 0x5643f8fcf660 2024-09-21T07:16:48.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.115+0000 7f05e2ffd640 1 -- 172.21.15.92:0/2656248933 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4004e50 con 0x5643f8fcf660 2024-09-21T07:16:48.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.116+0000 7f0609cb5740 1 -- 172.21.15.92:0/2656248933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 msgr2=0x5643f93ab750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:48.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.116+0000 7f0609cb5740 1 --2- 172.21.15.92:0/2656248933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93ab750 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f05f4018040 tx=0x7f05f4004610 comp rx=0 tx=0).stop 2024-09-21T07:16:48.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.117+0000 7f0609cb5740 1 -- 172.21.15.92:0/2656248933 shutdown_connections 2024-09-21T07:16:48.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.117+0000 7f0609cb5740 1 --2- 172.21.15.92:0/2656248933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8ff8520 0x5643f939fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.117+0000 7f0609cb5740 1 --2- 172.21.15.92:0/2656248933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 0x5643f93a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.117+0000 7f0609cb5740 1 --2- 172.21.15.92:0/2656248933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8fcf660 0x5643f93ab750 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.117+0000 7f0609cb5740 1 -- 172.21.15.92:0/2656248933 >> 172.21.15.92:0/2656248933 conn(0x5643f8fec910 msgr2=0x5643f93b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:48.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.117+0000 7f0609cb5740 1 -- 172.21.15.92:0/2656248933 shutdown_connections 2024-09-21T07:16:48.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.117+0000 7f0609cb5740 1 -- 172.21.15.92:0/2656248933 wait complete. 2024-09-21T07:16:48.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.117+0000 7f0609cb5740 1 -- start start 2024-09-21T07:16:48.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.117+0000 7f0609cb5740 1 Processor -- start 2024-09-21T07:16:48.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8fcf660 0x5643f94201c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 0x5643f9420780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0609cb5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8ff8520 0x5643f93b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0609cb5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc1b2280 con 0x5643f8ff8520 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0609cb5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc1b1bb0 con 0x5643f8fcf660 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0609cb5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc1aedf0 con 0x5643f8fd7840 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0609cb5740 10 client.0 _ll_register_callbacks cb 0x7f05f4003bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0601cde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8ff8520 0x5643f93b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0601cde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8ff8520 0x5643f93b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36094/0 (socket says 172.21.15.92:36094) 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0601cde640 1 -- 172.21.15.92:0/3968330096 learned_addr learned my addr 172.21.15.92:0/3968330096 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0600cdc640 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 0x5643f9420780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f06014dd640 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8fcf660 0x5643f94201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0601cde640 1 -- 172.21.15.92:0/3968330096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 msgr2=0x5643f9420780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0601cde640 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 0x5643f9420780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0601cde640 1 -- 172.21.15.92:0/3968330096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8fcf660 msgr2=0x5643f94201c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0601cde640 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8fcf660 0x5643f94201c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.118+0000 7f0601cde640 1 -- 172.21.15.92:0/3968330096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f93b0db0 con 0x5643f8ff8520 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.119+0000 7f0601cde640 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8ff8520 0x5643f93b0640 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f05ec010d00 tx=0x7f05ec009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfd0b2827dd60cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.119+0000 7f05e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.119+0000 7f05e0ff9640 1 -- 172.21.15.92:0/3968330096 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec016040 con 0x5643f8ff8520 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.119+0000 7f05e0ff9640 1 -- 172.21.15.92:0/3968330096 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f05ec004c00 con 0x5643f8ff8520 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.119+0000 7f0609cb5740 1 -- 172.21.15.92:0/3968330096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5643f9313bf0 con 0x5643f8ff8520 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.119+0000 7f05e0ff9640 1 -- 172.21.15.92:0/3968330096 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f05ec033050 con 0x5643f8ff8520 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.119+0000 7f0609cb5740 10 client.16884 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.119+0000 7f0609cb5740 1 -- 172.21.15.92:0/3968330096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5643f94279b0 con 0x5643f8ff8520 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.119+0000 7f05e0ff9640 1 -- 172.21.15.92:0/3968330096 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5643f9313bf0 con 0x5643f8ff8520 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.120+0000 7f05e0ff9640 1 -- 172.21.15.92:0/3968330096 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f05ec00f040 con 0x5643f8ff8520 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.120+0000 7f0609cb5740 10 client.16884 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.120+0000 7f0609cb5740 10 client.16884 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:16:48.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.120+0000 7f0609cb5740 20 client.16884 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:48.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.120+0000 7f0609cb5740 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5643f8f8c250 0x5643f9429f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:48.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.120+0000 7f0609cb5740 4 client.16884 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b6b97c80", "release": true, "await": true}] 2024-09-21T07:16:48.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.120+0000 7f0609cb5740 1 -- 172.21.15.92:0/3968330096 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b6b97c80", "release": true, "await": true}) -- 0x5643f9311020 con 0x5643f8f8c250 2024-09-21T07:16:48.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.120+0000 7f06014dd640 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5643f8f8c250 0x5643f9429f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:48.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.120+0000 7f05e0ff9640 10 client.16884 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:48.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.120+0000 7f06014dd640 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5643f8f8c250 0x5643f9429f70 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3270ab3a3c5a6ee server_cookie=b95bda38153a8782 in_seq=0 out_seq=0 2024-09-21T07:16:48.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.125+0000 7f05e0ff9640 1 -- 172.21.15.92:0/3968330096 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5643f9311020 con 0x5643f8f8c250 2024-09-21T07:16:48.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.125+0000 7f05e0ff9640 10 client.16884 handle_command_reply: tid=0 2024-09-21T07:16:48.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.125+0000 7f0609cb5740 1 client.16884 shutdown 2024-09-21T07:16:48.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 1 -- 172.21.15.92:0/3968330096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8ff8520 msgr2=0x5643f93b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:48.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8ff8520 0x5643f93b0640 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f05ec010d00 tx=0x7f05ec009cd0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 1 -- 172.21.15.92:0/3968330096 shutdown_connections 2024-09-21T07:16:48.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5643f8f8c250 0x5643f9429f70 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643f8ff8520 0x5643f93b0640 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643f8fd7840 0x5643f9420780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f05e0ff9640 0 client.16884 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:48.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 1 --2- 172.21.15.92:0/3968330096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5643f8fcf660 0x5643f94201c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 1 -- 172.21.15.92:0/3968330096 >> 172.21.15.92:0/3968330096 conn(0x5643f8fec910 msgr2=0x5643f93b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:48.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 1 -- 172.21.15.92:0/3968330096 shutdown_connections 2024-09-21T07:16:48.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 1 -- 172.21.15.92:0/3968330096 wait complete. 2024-09-21T07:16:48.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.126+0000 7f0609cb5740 20 client.16884 trim_cache size 0 max 16384 2024-09-21T07:16:48.129 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:16:48.129 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-09-21T07:16:48.129 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24649, 2024-09-21T07:16:48.130 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 16, 2024-09-21T07:16:48.130 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-21T07:16:48.130 INFO:teuthology.orchestra.run.smithi092.stdout: "b6b97c80": { 2024-09-21T07:16:48.130 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 16, 2024-09-21T07:16:48.130 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-21T07:16:48.130 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:16:48.130 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-21T07:16:48.130 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:16:48.130 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:48.131 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-21T07:16:48.131 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 147.8, 2024-09-21T07:16:48.131 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-21T07:16:48.131 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-21T07:16:48.131 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-21T07:16:48.131 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-21T07:16:48.131 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-21T07:16:48.131 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-21T07:16:48.131 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:48.132 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:48.132 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:48.132 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:48.132 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:48.132 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 -- 172.21.15.92:0/1867636583 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05e40b6700 msgr2=0x7f05e40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05e40b6700 0x7f05e40b8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5643f939d170 tx=0x7f05f400b390 comp rx=0 tx=0).stop 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 -- 172.21.15.92:0/1867636583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc1083c0 msgr2=0x7f05fc19a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc1083c0 0x7f05fc19a940 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f05f0005940 tx=0x7f05f00042f0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 -- 172.21.15.92:0/1867636583 shutdown_connections 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05e40b6700 0x7f05e40b8c10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05fc108d10 0x7f05fc19fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc1083c0 0x7f05fc19a940 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 --2- 172.21.15.92:0/1867636583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05fc102a80 0x7f05fc19a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 -- 172.21.15.92:0/1867636583 >> 172.21.15.92:0/1867636583 conn(0x7f05fc079740 msgr2=0x7f05fc1044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 -- 172.21.15.92:0/1867636583 shutdown_connections 2024-09-21T07:16:48.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:48.127+0000 7f0603741640 1 -- 172.21.15.92:0/1867636583 wait complete. 2024-09-21T07:16:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:16:49.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:48 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:16:49.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:48 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:49.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:48 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:16:49.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:48 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:49.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:48 smithi092 ceph-mon[30987]: pgmap v451: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T07:16:49.058 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b6b97c80', total seconds elapsed: 32.7 2024-09-21T07:16:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:48 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:16:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:48 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:49.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:48 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:16:49.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:48 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:49.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:48 smithi169 ceph-mon[33705]: pgmap v451: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T07:16:49.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:48 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:16:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:48 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:48 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:16:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:48 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:16:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:48 smithi175 ceph-mon[34064]: pgmap v451: 129 pgs: 129 active+clean; 2.8 GiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T07:16:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.585+0000 7f2d42251640 1 -- 172.21.15.92:0/2664404141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d3c109e20 msgr2=0x7f2d3c110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.585+0000 7f2d42251640 1 --2- 172.21.15.92:0/2664404141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d3c109e20 0x7f2d3c110650 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009ca0 tx=0x7f2d3402a8f0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.585+0000 7f2d42251640 1 -- 172.21.15.92:0/2664404141 shutdown_connections 2024-09-21T07:16:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.585+0000 7f2d42251640 1 --2- 172.21.15.92:0/2664404141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d3c109e20 0x7f2d3c110650 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.585+0000 7f2d42251640 1 --2- 172.21.15.92:0/2664404141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d3c1094d0 0x7f2d3c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.585+0000 7f2d42251640 1 --2- 172.21.15.92:0/2664404141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c103b90 0x7f2d3c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.585+0000 7f2d42251640 1 -- 172.21.15.92:0/2664404141 >> 172.21.15.92:0/2664404141 conn(0x7f2d3c0ff600 msgr2=0x7f2d3c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:49.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.585+0000 7f2d42251640 1 -- 172.21.15.92:0/2664404141 shutdown_connections 2024-09-21T07:16:49.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.585+0000 7f2d42251640 1 -- 172.21.15.92:0/2664404141 wait complete. 2024-09-21T07:16:49.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.586+0000 7f2d42251640 1 Processor -- start 2024-09-21T07:16:49.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.586+0000 7f2d42251640 1 -- start start 2024-09-21T07:16:49.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.587+0000 7f2d42251640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c103b90 0x7f2d3c198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.587+0000 7f2d42251640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d3c1094d0 0x7f2d3c199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.587+0000 7f2d42251640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d3c109e20 0x7f2d3c1a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.587+0000 7f2d42251640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c113a70 con 0x7f2d3c109e20 2024-09-21T07:16:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.587+0000 7f2d42251640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1138f0 con 0x7f2d3c103b90 2024-09-21T07:16:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.587+0000 7f2d42251640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c113bf0 con 0x7f2d3c1094d0 2024-09-21T07:16:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.587+0000 7f2d3bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d3c109e20 0x7f2d3c1a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.587+0000 7f2d3bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d3c109e20 0x7f2d3c1a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36110/0 (socket says 172.21.15.92:36110) 2024-09-21T07:16:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.587+0000 7f2d3bfff640 1 -- 172.21.15.92:0/4191484546 learned_addr learned my addr 172.21.15.92:0/4191484546 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.588+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c103b90 0x7f2d3c198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.588+0000 7f2d3bfff640 1 -- 172.21.15.92:0/4191484546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d3c1094d0 msgr2=0x7f2d3c199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.588+0000 7f2d3bfff640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d3c1094d0 0x7f2d3c199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.588+0000 7f2d3bfff640 1 -- 172.21.15.92:0/4191484546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c103b90 msgr2=0x7f2d3c198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.588+0000 7f2d3bfff640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c103b90 0x7f2d3c198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.588+0000 7f2d3bfff640 1 -- 172.21.15.92:0/4191484546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c1a4500 con 0x7f2d3c109e20 2024-09-21T07:16:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.588+0000 7f2d3bfff640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d3c109e20 0x7f2d3c1a3fc0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2d340097b0 tx=0x7f2d340093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:49.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.589+0000 7f2d38ff9640 1 -- 172.21.15.92:0/4191484546 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d34003ce0 con 0x7f2d3c109e20 2024-09-21T07:16:49.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.589+0000 7f2d38ff9640 1 -- 172.21.15.92:0/4191484546 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d3402d070 con 0x7f2d3c109e20 2024-09-21T07:16:49.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.589+0000 7f2d38ff9640 1 -- 172.21.15.92:0/4191484546 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d340309b0 con 0x7f2d3c109e20 2024-09-21T07:16:49.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.589+0000 7f2d42251640 1 -- 172.21.15.92:0/4191484546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c1a4790 con 0x7f2d3c109e20 2024-09-21T07:16:49.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.589+0000 7f2d42251640 1 -- 172.21.15.92:0/4191484546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3c1a4bc0 con 0x7f2d3c109e20 2024-09-21T07:16:49.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.595+0000 7f2d38ff9640 1 -- 172.21.15.92:0/4191484546 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f2d34030b70 con 0x7f2d3c109e20 2024-09-21T07:16:49.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.595+0000 7f2d487c5740 1 Processor -- start 2024-09-21T07:16:49.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.595+0000 7f2d487c5740 1 -- start start 2024-09-21T07:16:49.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.596+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcbcb070 0x5556fcf72650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.596+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcba21b0 0x5556fcf72b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.596+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbaa390 0x5556fcf730d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.596+0000 7f2d487c5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5556fcee8e50 con 0x5556fcba21b0 2024-09-21T07:16:49.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.596+0000 7f2d487c5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5556fced8280 con 0x5556fcbcb070 2024-09-21T07:16:49.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.596+0000 7f2d487c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5556fcedc090 con 0x5556fcbaa390 2024-09-21T07:16:49.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.597+0000 7f2d3b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcba21b0 0x5556fcf72b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.597+0000 7f2d3b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcba21b0 0x5556fcf72b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36118/0 (socket says 172.21.15.92:36118) 2024-09-21T07:16:49.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.597+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/3477677058 learned_addr learned my addr 172.21.15.92:0/3477677058 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:49.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.597+0000 7f2d38ff9640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d240b6700 0x7f2d240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.598+0000 7f2d3bfff640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d240b6700 0x7f2d240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.598+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/3477677058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbaa390 msgr2=0x5556fcf730d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.598+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/3477677058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbaa390 0x5556fcf730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.598+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/3477677058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcbcb070 msgr2=0x5556fcf72650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:16:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.598+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/3477677058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcbcb070 0x5556fcf72650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.598+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/3477677058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556fcc36650 con 0x5556fcba21b0 2024-09-21T07:16:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.599+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/3477677058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcba21b0 0x5556fcf72b90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00b7f0 tx=0x7f2d2c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc16aa9538167ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.599+0000 7f2d21ffb640 1 -- 172.21.15.92:0/3477677058 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00d950 con 0x5556fcba21b0 2024-09-21T07:16:49.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.599+0000 7f2d38ff9640 1 -- 172.21.15.92:0/4191484546 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2d34109060 con 0x7f2d3c109e20 2024-09-21T07:16:49.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.599+0000 7f2d21ffb640 1 -- 172.21.15.92:0/3477677058 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d2c018070 con 0x5556fcba21b0 2024-09-21T07:16:49.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.599+0000 7f2d21ffb640 1 -- 172.21.15.92:0/3477677058 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c013de0 con 0x5556fcba21b0 2024-09-21T07:16:49.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.601+0000 7f2d3bfff640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d240b6700 0x7f2d240b8c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2d341064c0 tx=0x7f2d340caab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:49.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.601+0000 7f2d487c5740 1 -- 172.21.15.92:0/3477677058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcba21b0 msgr2=0x5556fcf72b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:49.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.601+0000 7f2d487c5740 1 --2- 172.21.15.92:0/3477677058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcba21b0 0x5556fcf72b90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00b7f0 tx=0x7f2d2c00bcb0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.602+0000 7f2d487c5740 1 -- 172.21.15.92:0/3477677058 shutdown_connections 2024-09-21T07:16:49.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.602+0000 7f2d487c5740 1 --2- 172.21.15.92:0/3477677058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbaa390 0x5556fcf730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.602+0000 7f2d487c5740 1 --2- 172.21.15.92:0/3477677058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcba21b0 0x5556fcf72b90 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.602+0000 7f2d487c5740 1 --2- 172.21.15.92:0/3477677058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcbcb070 0x5556fcf72650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.602+0000 7f2d487c5740 1 -- 172.21.15.92:0/3477677058 >> 172.21.15.92:0/3477677058 conn(0x5556fcbbf460 msgr2=0x5556fcf70540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:49.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.602+0000 7f2d487c5740 1 -- 172.21.15.92:0/3477677058 shutdown_connections 2024-09-21T07:16:49.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.602+0000 7f2d487c5740 1 -- 172.21.15.92:0/3477677058 wait complete. 2024-09-21T07:16:49.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.603+0000 7f2d487c5740 1 -- start start 2024-09-21T07:16:49.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.603+0000 7f2d487c5740 1 Processor -- start 2024-09-21T07:16:49.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.604+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcba21b0 0x5556fcf7dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.604+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbaa390 0x5556fcf7e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.604+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbcb070 0x5556fcf8a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.605+0000 7f2d487c5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5556fcd39700 con 0x5556fcbcb070 2024-09-21T07:16:49.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.605+0000 7f2d487c5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5556fce73110 con 0x5556fcba21b0 2024-09-21T07:16:49.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.605+0000 7f2d487c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5556fcf80e30 con 0x5556fcbaa390 2024-09-21T07:16:49.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.605+0000 7f2d487c5740 10 client.0 _ll_register_callbacks cb 0x5556fce8c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:49.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.605+0000 7f2d3affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbcb070 0x5556fcf8a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.605+0000 7f2d3affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbcb070 0x5556fcf8a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36132/0 (socket says 172.21.15.92:36132) 2024-09-21T07:16:49.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.605+0000 7f2d3affd640 1 -- 172.21.15.92:0/3589027670 learned_addr learned my addr 172.21.15.92:0/3589027670 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:49.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d3affd640 1 -- 172.21.15.92:0/3589027670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbaa390 msgr2=0x5556fcf7e230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:16:49.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d3affd640 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbaa390 0x5556fcf7e230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d3affd640 1 -- 172.21.15.92:0/3589027670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcba21b0 msgr2=0x5556fcf7dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:49.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d3affd640 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcba21b0 0x5556fcf7dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d3affd640 1 -- 172.21.15.92:0/3589027670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556fcea0c40 con 0x5556fcbcb070 2024-09-21T07:16:49.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d3affd640 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbcb070 0x5556fcf8a120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2d30001df0 tx=0x7f2d3000e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306152d4498563da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:49.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d1affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:49.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d1affd640 1 -- 172.21.15.92:0/3589027670 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30010070 con 0x5556fcbcb070 2024-09-21T07:16:49.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d1affd640 1 -- 172.21.15.92:0/3589027670 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2d30006ae0 con 0x5556fcbcb070 2024-09-21T07:16:49.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d487c5740 1 -- 172.21.15.92:0/3589027670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d2c018070 con 0x5556fcbcb070 2024-09-21T07:16:49.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.606+0000 7f2d1affd640 1 -- 172.21.15.92:0/3589027670 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d30006d20 con 0x5556fcbcb070 2024-09-21T07:16:49.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.607+0000 7f2d487c5740 10 client.16896 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:49.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.607+0000 7f2d487c5740 1 -- 172.21.15.92:0/3589027670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5556fcf8cb60 con 0x5556fcbcb070 2024-09-21T07:16:49.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.607+0000 7f2d1affd640 1 -- 172.21.15.92:0/3589027670 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d2c018070 con 0x5556fcbcb070 2024-09-21T07:16:49.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.607+0000 7f2d1affd640 1 -- 172.21.15.92:0/3589027670 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2d30003b70 con 0x5556fcbcb070 2024-09-21T07:16:49.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.607+0000 7f2d487c5740 10 client.16896 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:49.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.607+0000 7f2d487c5740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:49.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.607+0000 7f2d487c5740 20 client.16896 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:49.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.607+0000 7f2d487c5740 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5556fcb899f0 0x5556fcf900e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.607+0000 7f2d487c5740 4 client.16896 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:49.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.607+0000 7f2d487c5740 1 -- 172.21.15.92:0/3589027670 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556fceeada0 con 0x5556fcb899f0 2024-09-21T07:16:49.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.610+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5556fcb899f0 0x5556fcf900e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.615+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5556fcb899f0 0x5556fcf900e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fba2b6270055ac3 server_cookie=626f2c26d7bc23d7 in_seq=0 out_seq=0 2024-09-21T07:16:49.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.615+0000 7f2d1affd640 10 client.16896 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:49.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.617+0000 7f2d1affd640 1 -- 172.21.15.92:0/3589027670 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556fceeada0 con 0x5556fcb899f0 2024-09-21T07:16:49.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.617+0000 7f2d1affd640 10 client.16896 handle_command_reply: tid=0 2024-09-21T07:16:49.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.617+0000 7f2d487c5740 1 client.16896 shutdown 2024-09-21T07:16:49.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.617+0000 7f2d487c5740 1 -- 172.21.15.92:0/3589027670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbcb070 msgr2=0x5556fcf8a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:49.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.617+0000 7f2d487c5740 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbcb070 0x5556fcf8a120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2d30001df0 tx=0x7f2d3000e4d0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.617+0000 7f2d487c5740 1 -- 172.21.15.92:0/3589027670 shutdown_connections 2024-09-21T07:16:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.617+0000 7f2d487c5740 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5556fcb899f0 0x5556fcf900e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.617+0000 7f2d487c5740 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbcb070 0x5556fcf8a120 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.617+0000 7f2d487c5740 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbaa390 0x5556fcf7e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.617+0000 7f2d487c5740 1 --2- 172.21.15.92:0/3589027670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcba21b0 0x5556fcf7dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.618+0000 7f2d487c5740 1 -- 172.21.15.92:0/3589027670 >> 172.21.15.92:0/3589027670 conn(0x5556fcbbf460 msgr2=0x5556fcf75830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.618+0000 7f2d1affd640 0 client.16896 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.618+0000 7f2d487c5740 1 -- 172.21.15.92:0/3589027670 shutdown_connections 2024-09-21T07:16:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.618+0000 7f2d487c5740 1 -- 172.21.15.92:0/3589027670 wait complete. 2024-09-21T07:16:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.618+0000 7f2d487c5740 20 client.16896 trim_cache size 0 max 16384 2024-09-21T07:16:49.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.640+0000 7f2d487c5740 1 Processor -- start 2024-09-21T07:16:49.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.640+0000 7f2d487c5740 1 -- start start 2024-09-21T07:16:49.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcba21b0 0x5556fcf73d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf6fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcbcb070 0x5556fcf700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d487c5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1aedb0 con 0x5556fcbaa390 2024-09-21T07:16:49.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d487c5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1b08f0 con 0x5556fcbcb070 2024-09-21T07:16:49.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d487c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1af480 con 0x5556fcba21b0 2024-09-21T07:16:49.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d3b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf6fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d3b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf6fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36142/0 (socket says 172.21.15.92:36142) 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/1338224958 learned_addr learned my addr 172.21.15.92:0/1338224958 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d3affd640 1 --2- 172.21.15.92:0/1338224958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcbcb070 0x5556fcf700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d3affd640 1 --2- 172.21.15.92:0/1338224958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcba21b0 0x5556fcf73d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/1338224958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcba21b0 msgr2=0x5556fcf73d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.641+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/1338224958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcba21b0 0x5556fcf73d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.642+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/1338224958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcbcb070 msgr2=0x5556fcf700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.642+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/1338224958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcbcb070 0x5556fcf700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.642+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/1338224958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556fcf7efb0 con 0x5556fcbaa390 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.642+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/1338224958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf6fb70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c008010 tx=0x7f2d2c006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b655555c62267d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.642+0000 7f2d217fa640 1 -- 172.21.15.92:0/1338224958 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00b300 con 0x5556fcbaa390 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.642+0000 7f2d217fa640 1 -- 172.21.15.92:0/1338224958 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d2c018040 con 0x5556fcbaa390 2024-09-21T07:16:49.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.642+0000 7f2d217fa640 1 -- 172.21.15.92:0/1338224958 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c004040 con 0x5556fcbaa390 2024-09-21T07:16:49.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.643+0000 7f2d487c5740 1 -- 172.21.15.92:0/1338224958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 msgr2=0x5556fcf6fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:49.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.643+0000 7f2d487c5740 1 --2- 172.21.15.92:0/1338224958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf6fb70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c008010 tx=0x7f2d2c006f90 comp rx=0 tx=0).stop 2024-09-21T07:16:49.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.643+0000 7f2d487c5740 1 -- 172.21.15.92:0/1338224958 shutdown_connections 2024-09-21T07:16:49.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.643+0000 7f2d487c5740 1 --2- 172.21.15.92:0/1338224958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcbcb070 0x5556fcf700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.643+0000 7f2d487c5740 1 --2- 172.21.15.92:0/1338224958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf6fb70 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.643+0000 7f2d487c5740 1 --2- 172.21.15.92:0/1338224958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcba21b0 0x5556fcf73d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.643+0000 7f2d487c5740 1 -- 172.21.15.92:0/1338224958 >> 172.21.15.92:0/1338224958 conn(0x5556fcbbf460 msgr2=0x5556fcf73680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:49.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.643+0000 7f2d487c5740 1 -- 172.21.15.92:0/1338224958 shutdown_connections 2024-09-21T07:16:49.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.643+0000 7f2d487c5740 1 -- 172.21.15.92:0/1338224958 wait complete. 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.644+0000 7f2d487c5740 1 -- start start 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.644+0000 7f2d487c5740 1 Processor -- start 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcba21b0 0x5556fcf86890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf81d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d487c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbcb070 0x5556fcf822a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d487c5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1b0220 con 0x5556fcbaa390 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d487c5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1afb50 con 0x5556fcba21b0 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d487c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1acdb0 con 0x5556fcbcb070 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d487c5740 10 client.0 _ll_register_callbacks cb 0x7f2d30007da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d3b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf81d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d3b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf81d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36158/0 (socket says 172.21.15.92:36158) 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/102680136 learned_addr learned my addr 172.21.15.92:0/102680136 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:49.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.645+0000 7f2d3affd640 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcba21b0 0x5556fcf86890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d3affd640 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbcb070 0x5556fcf822a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/102680136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbcb070 msgr2=0x5556fcf822a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:49.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbcb070 0x5556fcf822a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/102680136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcba21b0 msgr2=0x5556fcf86890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:49.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcba21b0 0x5556fcf86890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d3b7fe640 1 -- 172.21.15.92:0/102680136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556fcf82a30 con 0x5556fcbaa390 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d3affd640 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbcb070 0x5556fcf822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d3b7fe640 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf81d40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c013710 tx=0x7f2d2c00b300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92e831534885dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d1affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d1affd640 1 -- 172.21.15.92:0/102680136 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00db60 con 0x5556fcbaa390 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d487c5740 1 -- 172.21.15.92:0/102680136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d2c018040 con 0x5556fcbaa390 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.646+0000 7f2d1affd640 1 -- 172.21.15.92:0/102680136 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2d2c00dd00 con 0x5556fcbaa390 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d1affd640 1 -- 172.21.15.92:0/102680136 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d2c03d050 con 0x5556fcbaa390 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d487c5740 10 client.16902 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d487c5740 1 -- 172.21.15.92:0/102680136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5556fcffaa10 con 0x5556fcbaa390 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d1affd640 1 -- 172.21.15.92:0/102680136 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d2c018040 con 0x5556fcbaa390 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d1affd640 1 -- 172.21.15.92:0/102680136 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2d2c003690 con 0x5556fcbaa390 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d487c5740 10 client.16902 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d487c5740 10 client.16902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:49.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d487c5740 20 client.16902 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d487c5740 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5556fcb5eda0 0x5556fcffcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d487c5740 4 client.16902 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:16:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.647+0000 7f2d487c5740 1 -- 172.21.15.92:0/102680136 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5556fcee6850 con 0x5556fcb5eda0 2024-09-21T07:16:49.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.648+0000 7f2d3affd640 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5556fcb5eda0 0x5556fcffcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.649+0000 7f2d1affd640 10 client.16902 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.649+0000 7f2d3affd640 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5556fcb5eda0 0x5556fcffcf00 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=515ebede811061e1 server_cookie=9d979bb8a2851bac in_seq=0 out_seq=0 2024-09-21T07:16:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.649+0000 7f2d1affd640 1 -- 172.21.15.92:0/102680136 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x5556fcee6850 con 0x5556fcb5eda0 2024-09-21T07:16:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.649+0000 7f2d1affd640 10 client.16902 handle_command_reply: tid=0 2024-09-21T07:16:49.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.649+0000 7f2d487c5740 1 client.16902 shutdown 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 1 -- 172.21.15.92:0/102680136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 msgr2=0x5556fcf81d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf81d40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c013710 tx=0x7f2d2c00b300 comp rx=0 tx=0).stop 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 1 -- 172.21.15.92:0/102680136 shutdown_connections 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5556fcb5eda0 0x5556fcffcf00 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556fcbcb070 0x5556fcf822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556fcbaa390 0x5556fcf81d40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 1 --2- 172.21.15.92:0/102680136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556fcba21b0 0x5556fcf86890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d1affd640 0 client.16902 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 1 -- 172.21.15.92:0/102680136 >> 172.21.15.92:0/102680136 conn(0x5556fcbbf460 msgr2=0x5556fcf7f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 1 -- 172.21.15.92:0/102680136 shutdown_connections 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 1 -- 172.21.15.92:0/102680136 wait complete. 2024-09-21T07:16:49.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.650+0000 7f2d487c5740 20 client.16902 trim_cache size 0 max 16384 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76", 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:16:49.655 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:49.656 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:49.657 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:16:49.658 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:16:49.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 -- 172.21.15.92:0/4191484546 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d240b6700 msgr2=0x7f2d240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:49.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d240b6700 0x7f2d240b8c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2d341064c0 tx=0x7f2d340caab0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 -- 172.21.15.92:0/4191484546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d3c109e20 msgr2=0x7f2d3c1a3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:49.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d3c109e20 0x7f2d3c1a3fc0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2d340097b0 tx=0x7f2d340093e0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 -- 172.21.15.92:0/4191484546 shutdown_connections 2024-09-21T07:16:49.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2d240b6700 0x7f2d240b8c10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d3c109e20 0x7f2d3c1a3fc0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d3c1094d0 0x7f2d3c199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 --2- 172.21.15.92:0/4191484546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c103b90 0x7f2d3c198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:49.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 -- 172.21.15.92:0/4191484546 >> 172.21.15.92:0/4191484546 conn(0x7f2d3c0ff600 msgr2=0x7f2d3c107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:49.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 -- 172.21.15.92:0/4191484546 shutdown_connections 2024-09-21T07:16:49.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:16:49.651+0000 7f2d42251640 1 -- 172.21.15.92:0/4191484546 wait complete. 2024-09-21T07:16:50.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:49 smithi092 ceph-mon[30987]: pgmap v452: 129 pgs: 129 active+clean; 3.0 GiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 MiB/s wr, 14 op/s 2024-09-21T07:16:50.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:49 smithi169 ceph-mon[33705]: pgmap v452: 129 pgs: 129 active+clean; 3.0 GiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 MiB/s wr, 14 op/s 2024-09-21T07:16:50.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:49 smithi175 ceph-mon[34064]: pgmap v452: 129 pgs: 129 active+clean; 3.0 GiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 17 MiB/s wr, 14 op/s 2024-09-21T07:16:50.502 INFO:tasks.cephfs.filesystem:scrub status for tag:3e49e930-1eb4-4d55-a2f4-79d05ccc0f76 - {'path': '/', 'tag': '3e49e930-1eb4-4d55-a2f4-79d05ccc0f76', 'options': 'recursive,force'} 2024-09-21T07:16:51.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:50 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:16:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:50 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:16:51.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:50 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:16:52.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:51 smithi092 ceph-mon[30987]: pgmap v453: 129 pgs: 129 active+clean; 3.3 GiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 39 MiB/s wr, 20 op/s 2024-09-21T07:16:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:51 smithi169 ceph-mon[33705]: pgmap v453: 129 pgs: 129 active+clean; 3.3 GiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 39 MiB/s wr, 20 op/s 2024-09-21T07:16:52.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:51 smithi175 ceph-mon[34064]: pgmap v453: 129 pgs: 129 active+clean; 3.3 GiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 39 MiB/s wr, 20 op/s 2024-09-21T07:16:55.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:54 smithi175 ceph-mon[34064]: pgmap v454: 129 pgs: 129 active+clean; 4.6 GiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 149 MiB/s wr, 50 op/s 2024-09-21T07:16:55.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:54 smithi092 ceph-mon[30987]: pgmap v454: 129 pgs: 129 active+clean; 4.6 GiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 149 MiB/s wr, 50 op/s 2024-09-21T07:16:55.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:54 smithi169 ceph-mon[33705]: pgmap v454: 129 pgs: 129 active+clean; 4.6 GiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 149 MiB/s wr, 50 op/s 2024-09-21T07:16:57.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:56 smithi175 ceph-mon[34064]: pgmap v455: 129 pgs: 129 active+clean; 5.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 252 MiB/s wr, 74 op/s 2024-09-21T07:16:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:56 smithi092 ceph-mon[30987]: pgmap v455: 129 pgs: 129 active+clean; 5.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 252 MiB/s wr, 74 op/s 2024-09-21T07:16:57.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:56 smithi169 ceph-mon[33705]: pgmap v455: 129 pgs: 129 active+clean; 5.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 252 MiB/s wr, 74 op/s 2024-09-21T07:16:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.932+0000 7f4448d89640 1 -- 172.21.15.92:0/1537251484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444107ab0 msgr2=0x7f4444107ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.932+0000 7f4448d89640 1 --2- 172.21.15.92:0/1537251484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444107ab0 0x7f4444107ec0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f442c009900 tx=0x7f442c02a410 comp rx=0 tx=0).stop 2024-09-21T07:16:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.932+0000 7f4448d89640 1 -- 172.21.15.92:0/1537251484 shutdown_connections 2024-09-21T07:16:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.932+0000 7f4448d89640 1 --2- 172.21.15.92:0/1537251484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4444108400 0x7f444410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.932+0000 7f4448d89640 1 --2- 172.21.15.92:0/1537251484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444107ab0 0x7f4444107ec0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.932+0000 7f4448d89640 1 --2- 172.21.15.92:0/1537251484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4444102180 0x7f4444102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.932+0000 7f4448d89640 1 -- 172.21.15.92:0/1537251484 >> 172.21.15.92:0/1537251484 conn(0x7f4444079e90 msgr2=0x7f444407a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:58.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.932+0000 7f4448d89640 1 -- 172.21.15.92:0/1537251484 shutdown_connections 2024-09-21T07:16:58.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.932+0000 7f4448d89640 1 -- 172.21.15.92:0/1537251484 wait complete. 2024-09-21T07:16:58.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.933+0000 7f4448d89640 1 Processor -- start 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.933+0000 7f4448d89640 1 -- start start 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f4448d89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444102180 0x7f4444198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f4448d89640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4444107ab0 0x7f44441987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f4448d89640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4444108400 0x7f444419da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f4448d89640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f44441116f0 con 0x7f4444102180 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f4448d89640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4444111570 con 0x7f4444107ab0 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f4448d89640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4444111870 con 0x7f4444108400 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f444259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444102180 0x7f4444198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f444259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444102180 0x7f4444198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41314/0 (socket says 172.21.15.92:41314) 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f444259c640 1 -- 172.21.15.92:0/706481402 learned_addr learned my addr 172.21.15.92:0/706481402 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f4442d9d640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4444108400 0x7f444419da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f444259c640 1 -- 172.21.15.92:0/706481402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4444108400 msgr2=0x7f444419da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f444259c640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4444108400 0x7f444419da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f444259c640 1 -- 172.21.15.92:0/706481402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4444107ab0 msgr2=0x7f44441987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f443bfff640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4444107ab0 0x7f44441987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f444259c640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4444107ab0 0x7f44441987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f444259c640 1 -- 172.21.15.92:0/706481402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444419e160 con 0x7f4444102180 2024-09-21T07:16:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.934+0000 7f443bfff640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4444107ab0 0x7f44441987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:16:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.935+0000 7f444259c640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444102180 0x7f4444198230 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4434003910 tx=0x7f4434003dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.935+0000 7f443b7fe640 1 -- 172.21.15.92:0/706481402 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443400adf0 con 0x7f4444102180 2024-09-21T07:16:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.935+0000 7f443b7fe640 1 -- 172.21.15.92:0/706481402 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f443401b070 con 0x7f4444102180 2024-09-21T07:16:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.935+0000 7f4448d89640 1 -- 172.21.15.92:0/706481402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444419e450 con 0x7f4444102180 2024-09-21T07:16:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.935+0000 7f443b7fe640 1 -- 172.21.15.92:0/706481402 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44340155e0 con 0x7f4444102180 2024-09-21T07:16:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.935+0000 7f4448d89640 1 -- 172.21.15.92:0/706481402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44441a4be0 con 0x7f4444102180 2024-09-21T07:16:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.938+0000 7f444fdd3740 1 Processor -- start 2024-09-21T07:16:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.939+0000 7f444fdd3740 1 -- start start 2024-09-21T07:16:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.939+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e4e1b0 0x55ded71f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.939+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e252f0 0x55ded71f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.939+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e2d4d0 0x55ded71f4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.939+0000 7f444fdd3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ded71686f0 con 0x55ded6e4e1b0 2024-09-21T07:16:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.939+0000 7f444fdd3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ded7157b20 con 0x55ded6e2d4d0 2024-09-21T07:16:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.939+0000 7f444fdd3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ded715b930 con 0x55ded6e252f0 2024-09-21T07:16:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f4442d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e4e1b0 0x55ded71f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f4442d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e4e1b0 0x55ded71f39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41326/0 (socket says 172.21.15.92:41326) 2024-09-21T07:16:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f4442d9d640 1 -- 172.21.15.92:0/3336212356 learned_addr learned my addr 172.21.15.92:0/3336212356 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f443b7fe640 1 -- 172.21.15.92:0/706481402 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f4434016420 con 0x7f4444102180 2024-09-21T07:16:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f443bfff640 1 --2- 172.21.15.92:0/3336212356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e2d4d0 0x55ded71f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f4442d9d640 1 -- 172.21.15.92:0/3336212356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e252f0 msgr2=0x55ded71f3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f4442d9d640 1 --2- 172.21.15.92:0/3336212356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e252f0 0x55ded71f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f4442d9d640 1 -- 172.21.15.92:0/3336212356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e2d4d0 msgr2=0x55ded71f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f4442d9d640 1 --2- 172.21.15.92:0/3336212356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e2d4d0 0x55ded71f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f4442d9d640 1 -- 172.21.15.92:0/3336212356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded711d530 con 0x55ded6e4e1b0 2024-09-21T07:16:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.940+0000 7f4442d9d640 1 --2- 172.21.15.92:0/3336212356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e4e1b0 0x55ded71f39b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f443c009f40 tx=0x7f443c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bc6c5bfbee287c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.941+0000 7f4438ff9640 1 -- 172.21.15.92:0/3336212356 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c003b70 con 0x55ded6e4e1b0 2024-09-21T07:16:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.941+0000 7f443b7fe640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44300b6680 0x7f44300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.941+0000 7f4438ff9640 1 -- 172.21.15.92:0/3336212356 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f443c003d10 con 0x55ded6e4e1b0 2024-09-21T07:16:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.941+0000 7f4438ff9640 1 -- 172.21.15.92:0/3336212356 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c0118c0 con 0x55ded6e4e1b0 2024-09-21T07:16:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.941+0000 7f443b7fe640 1 -- 172.21.15.92:0/706481402 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f44340e9a00 con 0x7f4444102180 2024-09-21T07:16:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.941+0000 7f444259c640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44300b6680 0x7f44300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.942+0000 7f444fdd3740 1 -- 172.21.15.92:0/3336212356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e4e1b0 msgr2=0x55ded71f39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.942+0000 7f444fdd3740 1 --2- 172.21.15.92:0/3336212356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e4e1b0 0x55ded71f39b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f443c009f40 tx=0x7f443c010860 comp rx=0 tx=0).stop 2024-09-21T07:16:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.942+0000 7f444259c640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44300b6680 0x7f44300b8b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55ded71f2630 tx=0x7f44340abb00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.942+0000 7f444fdd3740 1 -- 172.21.15.92:0/3336212356 shutdown_connections 2024-09-21T07:16:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.942+0000 7f444fdd3740 1 --2- 172.21.15.92:0/3336212356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e2d4d0 0x55ded71f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.942+0000 7f444fdd3740 1 --2- 172.21.15.92:0/3336212356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e252f0 0x55ded71f3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.942+0000 7f444fdd3740 1 --2- 172.21.15.92:0/3336212356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e4e1b0 0x55ded71f39b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.942+0000 7f444fdd3740 1 -- 172.21.15.92:0/3336212356 >> 172.21.15.92:0/3336212356 conn(0x55ded6e42300 msgr2=0x55ded71f18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.942+0000 7f444fdd3740 1 -- 172.21.15.92:0/3336212356 shutdown_connections 2024-09-21T07:16:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.942+0000 7f444fdd3740 1 -- 172.21.15.92:0/3336212356 wait complete. 2024-09-21T07:16:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.943+0000 7f444fdd3740 1 -- start start 2024-09-21T07:16:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.943+0000 7f444fdd3740 1 Processor -- start 2024-09-21T07:16:58.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e252f0 0x55ded71ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded71ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e4e1b0 0x55ded720b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f444fdd3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ded708fab0 con 0x55ded6e2d4d0 2024-09-21T07:16:58.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f444fdd3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ded70fd730 con 0x55ded6e252f0 2024-09-21T07:16:58.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f444fdd3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ded7202130 con 0x55ded6e4e1b0 2024-09-21T07:16:58.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f4442d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e252f0 0x55ded71ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f444fdd3740 10 client.0 _ll_register_callbacks cb 0x55ded71516b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f4442d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e252f0 0x55ded71ff0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:47208/0 (socket says 172.21.15.92:47208) 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f4442d9d640 1 -- 172.21.15.92:0/1787460300 learned_addr learned my addr 172.21.15.92:0/1787460300 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f4442d9d640 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e4e1b0 0x55ded720b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.944+0000 7f443bfff640 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded71ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.945+0000 7f4442d9d640 1 -- 172.21.15.92:0/1787460300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e4e1b0 msgr2=0x55ded720b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.945+0000 7f4442d9d640 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e4e1b0 0x55ded720b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.945+0000 7f4442d9d640 1 -- 172.21.15.92:0/1787460300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 msgr2=0x55ded71ff5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.945+0000 7f4442d9d640 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded71ff5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.945+0000 7f4442d9d640 1 -- 172.21.15.92:0/1787460300 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded6eb9790 con 0x55ded6e252f0 2024-09-21T07:16:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.945+0000 7f443bfff640 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded71ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.946+0000 7f4442d9d640 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e252f0 0x55ded71ff0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f443c009370 tx=0x7f443c009af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36f66f377e264838 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.946+0000 7f4429ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:16:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.946+0000 7f4429ffb640 1 -- 172.21.15.92:0/1787460300 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c020c10 con 0x55ded6e252f0 2024-09-21T07:16:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.947+0000 7f4429ffb640 1 -- 172.21.15.92:0/1787460300 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f443c020db0 con 0x55ded6e252f0 2024-09-21T07:16:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.947+0000 7f444fdd3740 1 -- 172.21.15.92:0/1787460300 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f443c003d10 con 0x55ded6e252f0 2024-09-21T07:16:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.947+0000 7f4429ffb640 1 -- 172.21.15.92:0/1787460300 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f443c003ec0 con 0x55ded6e252f0 2024-09-21T07:16:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.947+0000 7f444fdd3740 10 client.26069 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.947+0000 7f444fdd3740 1 -- 172.21.15.92:0/1787460300 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ded6f32620 con 0x55ded6e252f0 2024-09-21T07:16:58.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.948+0000 7f4429ffb640 1 -- 172.21.15.92:0/1787460300 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f443c003d10 con 0x55ded6e252f0 2024-09-21T07:16:58.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.948+0000 7f4429ffb640 1 -- 172.21.15.92:0/1787460300 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f443c02d030 con 0x55ded6e252f0 2024-09-21T07:16:58.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.948+0000 7f444fdd3740 10 client.26069 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:58.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.948+0000 7f444fdd3740 10 client.26069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:58.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.949+0000 7f444fdd3740 20 client.26069 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:58.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.949+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded6e0cd80 0x55ded7211110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.949+0000 7f444fdd3740 4 client.26069 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:16:58.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.949+0000 7f444fdd3740 1 -- 172.21.15.92:0/1787460300 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ded716a640 con 0x55ded6e0cd80 2024-09-21T07:16:58.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.949+0000 7f443bfff640 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded6e0cd80 0x55ded7211110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.950+0000 7f4429ffb640 10 client.26069 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:58.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.950+0000 7f443bfff640 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded6e0cd80 0x55ded7211110 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcc44aa9c2f60615 server_cookie=2cf90124eb90f520 in_seq=0 out_seq=0 2024-09-21T07:16:58.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f4429ffb640 1 -- 172.21.15.92:0/1787460300 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ded716a640 con 0x55ded6e0cd80 2024-09-21T07:16:58.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f4429ffb640 10 client.26069 handle_command_reply: tid=0 2024-09-21T07:16:58.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 client.26069 shutdown 2024-09-21T07:16:58.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 -- 172.21.15.92:0/1787460300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e252f0 msgr2=0x55ded71ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:58.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e252f0 0x55ded71ff0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f443c009370 tx=0x7f443c009af0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 -- 172.21.15.92:0/1787460300 shutdown_connections 2024-09-21T07:16:58.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded6e0cd80 0x55ded7211110 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e4e1b0 0x55ded720b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded71ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1787460300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e252f0 0x55ded71ff0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 -- 172.21.15.92:0/1787460300 >> 172.21.15.92:0/1787460300 conn(0x55ded6e42300 msgr2=0x55ded71f49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:58.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f4429ffb640 0 client.26069 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:58.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 -- 172.21.15.92:0/1787460300 shutdown_connections 2024-09-21T07:16:58.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 1 -- 172.21.15.92:0/1787460300 wait complete. 2024-09-21T07:16:58.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.951+0000 7f444fdd3740 20 client.26069 trim_cache size 0 max 16384 2024-09-21T07:16:58.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.975+0000 7f444fdd3740 1 Processor -- start 2024-09-21T07:16:58.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.975+0000 7f444fdd3740 1 -- start start 2024-09-21T07:16:58.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.976+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e252f0 0x55ded71ff580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.976+0000 7f4442d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e252f0 0x55ded71ff580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.976+0000 7f4442d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e252f0 0x55ded71ff580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41344/0 (socket says 172.21.15.92:41344) 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.976+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e2d4d0 0x55ded71f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.976+0000 7f4442d9d640 1 -- 172.21.15.92:0/1295133434 learned_addr learned my addr 172.21.15.92:0/1295133434 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.976+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1295133434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e4e1b0 0x55ded720b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.976+0000 7f444fdd3740 1 -- 172.21.15.92:0/1295133434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f44441aed50 con 0x55ded6e252f0 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.976+0000 7f444fdd3740 1 -- 172.21.15.92:0/1295133434 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44441b0890 con 0x55ded6e4e1b0 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.976+0000 7f444fdd3740 1 -- 172.21.15.92:0/1295133434 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f44441af420 con 0x55ded6e2d4d0 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.976+0000 7f443bfff640 1 --2- 172.21.15.92:0/1295133434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e2d4d0 0x55ded71f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.977+0000 7f4442d9d640 1 -- 172.21.15.92:0/1295133434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e2d4d0 msgr2=0x55ded71f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.977+0000 7f4442d9d640 1 --2- 172.21.15.92:0/1295133434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e2d4d0 0x55ded71f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.977+0000 7f4442d9d640 1 -- 172.21.15.92:0/1295133434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e4e1b0 msgr2=0x55ded720b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.977+0000 7f4442d9d640 1 --2- 172.21.15.92:0/1295133434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e4e1b0 0x55ded720b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.977+0000 7f4442d9d640 1 -- 172.21.15.92:0/1295133434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded71f5cb0 con 0x55ded6e252f0 2024-09-21T07:16:58.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.977+0000 7f4442d9d640 1 --2- 172.21.15.92:0/1295133434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e252f0 0x55ded71ff580 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f443c000f80 tx=0x7f443c004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5045c273e6acea78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:58.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.977+0000 7f442bfff640 1 -- 172.21.15.92:0/1295133434 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c003d10 con 0x55ded6e252f0 2024-09-21T07:16:58.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.977+0000 7f442bfff640 1 -- 172.21.15.92:0/1295133434 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f443c02a040 con 0x55ded6e252f0 2024-09-21T07:16:58.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.977+0000 7f442bfff640 1 -- 172.21.15.92:0/1295133434 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c009480 con 0x55ded6e252f0 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.979+0000 7f444fdd3740 1 -- 172.21.15.92:0/1295133434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e252f0 msgr2=0x55ded71ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.979+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1295133434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e252f0 0x55ded71ff580 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f443c000f80 tx=0x7f443c004f10 comp rx=0 tx=0).stop 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.979+0000 7f444fdd3740 1 -- 172.21.15.92:0/1295133434 shutdown_connections 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.979+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1295133434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e4e1b0 0x55ded720b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.979+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1295133434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e2d4d0 0x55ded71f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.979+0000 7f444fdd3740 1 --2- 172.21.15.92:0/1295133434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e252f0 0x55ded71ff580 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.979+0000 7f444fdd3740 1 -- 172.21.15.92:0/1295133434 >> 172.21.15.92:0/1295133434 conn(0x55ded6e42300 msgr2=0x55ded71f10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.979+0000 7f444fdd3740 1 -- 172.21.15.92:0/1295133434 shutdown_connections 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.979+0000 7f444fdd3740 1 -- 172.21.15.92:0/1295133434 wait complete. 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f444fdd3740 1 -- start start 2024-09-21T07:16:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f444fdd3740 1 Processor -- start 2024-09-21T07:16:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e252f0 0x55ded7211100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded7211640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f444fdd3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e4e1b0 0x55ded7211b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f444fdd3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f44441b01c0 con 0x55ded6e2d4d0 2024-09-21T07:16:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f444fdd3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44441afaf0 con 0x55ded6e4e1b0 2024-09-21T07:16:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f444fdd3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f44441acd30 con 0x55ded6e252f0 2024-09-21T07:16:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f444fdd3740 10 client.0 _ll_register_callbacks cb 0x7f443c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:16:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f443bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded7211640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.980+0000 7f443bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded7211640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41354/0 (socket says 172.21.15.92:41354) 2024-09-21T07:16:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f443bfff640 1 -- 172.21.15.92:0/749579105 learned_addr learned my addr 172.21.15.92:0/749579105 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f4442d9d640 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e4e1b0 0x55ded7211b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f4442d9d640 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e252f0 0x55ded7211100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f443bfff640 1 -- 172.21.15.92:0/749579105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e252f0 msgr2=0x55ded7211100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f443bfff640 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e252f0 0x55ded7211100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f443bfff640 1 -- 172.21.15.92:0/749579105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e4e1b0 msgr2=0x55ded7211b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f443bfff640 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e4e1b0 0x55ded7211b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f443bfff640 1 -- 172.21.15.92:0/749579105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded7282090 con 0x55ded6e2d4d0 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f4442d9d640 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e4e1b0 0x55ded7211b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f443bfff640 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded7211640 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f442c0092a0 tx=0x7f442c0041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9529fd209aad3171 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f4429ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f4429ffb640 1 -- 172.21.15.92:0/749579105 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c035040 con 0x55ded6e2d4d0 2024-09-21T07:16:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f4429ffb640 1 -- 172.21.15.92:0/749579105 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f442c005230 con 0x55ded6e2d4d0 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.981+0000 7f444fdd3740 1 -- 172.21.15.92:0/749579105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f443c02a040 con 0x55ded6e2d4d0 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f4429ffb640 1 -- 172.21.15.92:0/749579105 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f442c052050 con 0x55ded6e2d4d0 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f444fdd3740 10 client.16920 fetch_fsmap learned FSMap version 29 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f444fdd3740 1 -- 172.21.15.92:0/749579105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ded7283360 con 0x55ded6e2d4d0 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f4429ffb640 1 -- 172.21.15.92:0/749579105 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f443c02a040 con 0x55ded6e2d4d0 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f4429ffb640 1 -- 172.21.15.92:0/749579105 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f442c0035f0 con 0x55ded6e2d4d0 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f444fdd3740 10 client.16920 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f444fdd3740 10 client.16920 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f444fdd3740 20 client.16920 populate_metadata read hostname 'smithi092' 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f444fdd3740 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded6de21c0 0x55ded7285ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f444fdd3740 4 client.16920 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:16:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.982+0000 7f444fdd3740 1 -- 172.21.15.92:0/749579105 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ded71660f0 con 0x55ded6de21c0 2024-09-21T07:16:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.983+0000 7f4442d9d640 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded6de21c0 0x55ded7285ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:16:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.983+0000 7f4429ffb640 10 client.16920 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.983+0000 7f4442d9d640 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded6de21c0 0x55ded7285ba0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68ca9ffd7a72ab83 server_cookie=9ffccac81ad9a71c in_seq=0 out_seq=0 2024-09-21T07:16:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f4429ffb640 1 -- 172.21.15.92:0/749579105 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ded71660f0 con 0x55ded6de21c0 2024-09-21T07:16:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f4429ffb640 10 client.16920 handle_command_reply: tid=0 2024-09-21T07:16:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 client.16920 shutdown 2024-09-21T07:16:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 -- 172.21.15.92:0/749579105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 msgr2=0x55ded7211640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded7211640 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f442c0092a0 tx=0x7f442c0041f0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 -- 172.21.15.92:0/749579105 shutdown_connections 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded6de21c0 0x55ded7285ba0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded6e4e1b0 0x55ded7211b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded6e2d4d0 0x55ded7211640 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 --2- 172.21.15.92:0/749579105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6e252f0 0x55ded7211100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 -- 172.21.15.92:0/749579105 >> 172.21.15.92:0/749579105 conn(0x55ded6e42300 msgr2=0x55ded71efea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f4429ffb640 0 client.16920 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 -- 172.21.15.92:0/749579105 shutdown_connections 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.994+0000 7f444fdd3740 1 -- 172.21.15.92:0/749579105 wait complete. 2024-09-21T07:16:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.995+0000 7f444fdd3740 20 client.16920 trim_cache size 0 max 16384 2024-09-21T07:16:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:16:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:16:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:16:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:16:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.995+0000 7f4448d89640 1 -- 172.21.15.92:0/706481402 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44300b6680 msgr2=0x7f44300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.995+0000 7f4448d89640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44300b6680 0x7f44300b8b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55ded71f2630 tx=0x7f44340abb00 comp rx=0 tx=0).stop 2024-09-21T07:16:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.996+0000 7f4448d89640 1 -- 172.21.15.92:0/706481402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444102180 msgr2=0x7f4444198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:16:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.996+0000 7f4448d89640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444102180 0x7f4444198230 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4434003910 tx=0x7f4434003dd0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.996+0000 7f4448d89640 1 -- 172.21.15.92:0/706481402 shutdown_connections 2024-09-21T07:16:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.996+0000 7f4448d89640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44300b6680 0x7f44300b8b90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.996+0000 7f4448d89640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4444108400 0x7f444419da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.996+0000 7f4448d89640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4444107ab0 0x7f44441987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.996+0000 7f4448d89640 1 --2- 172.21.15.92:0/706481402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444102180 0x7f4444198230 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:16:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.996+0000 7f4448d89640 1 -- 172.21.15.92:0/706481402 >> 172.21.15.92:0/706481402 conn(0x7f4444079e90 msgr2=0x7f4444103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:16:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.996+0000 7f4448d89640 1 -- 172.21.15.92:0/706481402 shutdown_connections 2024-09-21T07:16:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:16:58.996+0000 7f4448d89640 1 -- 172.21.15.92:0/706481402 wait complete. 2024-09-21T07:16:59.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:58 smithi175 ceph-mon[34064]: pgmap v456: 129 pgs: 129 active+clean; 7.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 361 MiB/s wr, 103 op/s 2024-09-21T07:16:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:58 smithi092 ceph-mon[30987]: pgmap v456: 129 pgs: 129 active+clean; 7.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 361 MiB/s wr, 103 op/s 2024-09-21T07:16:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:58 smithi169 ceph-mon[33705]: pgmap v456: 129 pgs: 129 active+clean; 7.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 361 MiB/s wr, 103 op/s 2024-09-21T07:17:00.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:59 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:17:00.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:59 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:17:00.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:59 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:17:00.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:16:59 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:17:00.043 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:59 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:17:00.044 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:59 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:17:00.044 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:59 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:17:00.044 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:16:59 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:17:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:59 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:17:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:59 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:17:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:59 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:17:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:16:59 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:17:01.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:00 smithi175 ceph-mon[34064]: pgmap v457: 129 pgs: 129 active+clean; 8.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 507 MiB/s wr, 138 op/s 2024-09-21T07:17:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:00 smithi092 ceph-mon[30987]: pgmap v457: 129 pgs: 129 active+clean; 8.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 507 MiB/s wr, 138 op/s 2024-09-21T07:17:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:00 smithi169 ceph-mon[33705]: pgmap v457: 129 pgs: 129 active+clean; 8.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 507 MiB/s wr, 138 op/s 2024-09-21T07:17:02.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:01 smithi092 ceph-mon[30987]: pgmap v458: 129 pgs: 129 active+clean; 9.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 517 MiB/s wr, 139 op/s 2024-09-21T07:17:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:01 smithi169 ceph-mon[33705]: pgmap v458: 129 pgs: 129 active+clean; 9.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 517 MiB/s wr, 139 op/s 2024-09-21T07:17:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:01 smithi175 ceph-mon[34064]: pgmap v458: 129 pgs: 129 active+clean; 9.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 517 MiB/s wr, 139 op/s 2024-09-21T07:17:03.355 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:17:03.355 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 initial writers = 231069.94 kB/sec 2024-09-21T07:17:03.355 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 initial writers = 231068.81 kB/sec 2024-09-21T07:17:03.355 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 231069.94 kB/sec 2024-09-21T07:17:03.355 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 231069.94 kB/sec 2024-09-21T07:17:03.356 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 231069.94 kB/sec 2024-09-21T07:17:03.356 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 10485760.00 kB 2024-09-21T07:17:05.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:04 smithi175 ceph-mon[34064]: pgmap v459: 129 pgs: 129 active+clean; 11 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 637 MiB/s wr, 186 op/s 2024-09-21T07:17:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:04 smithi092 ceph-mon[30987]: pgmap v459: 129 pgs: 129 active+clean; 11 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 637 MiB/s wr, 186 op/s 2024-09-21T07:17:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:04 smithi169 ceph-mon[33705]: pgmap v459: 129 pgs: 129 active+clean; 11 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 637 MiB/s wr, 186 op/s 2024-09-21T07:17:07.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:06 smithi175 ceph-mon[34064]: pgmap v460: 129 pgs: 129 active+clean; 12 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 596 MiB/s wr, 176 op/s 2024-09-21T07:17:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:06 smithi092 ceph-mon[30987]: pgmap v460: 129 pgs: 129 active+clean; 12 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 596 MiB/s wr, 176 op/s 2024-09-21T07:17:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:06 smithi169 ceph-mon[33705]: pgmap v460: 129 pgs: 129 active+clean; 12 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 596 MiB/s wr, 176 op/s 2024-09-21T07:17:09.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:08 smithi175 ceph-mon[34064]: pgmap v461: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 522 MiB/s wr, 159 op/s 2024-09-21T07:17:09.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:08 smithi092 ceph-mon[30987]: pgmap v461: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 522 MiB/s wr, 159 op/s 2024-09-21T07:17:09.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:08 smithi169 ceph-mon[33705]: pgmap v461: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 522 MiB/s wr, 159 op/s 2024-09-21T07:17:11.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:10 smithi092 ceph-mon[30987]: pgmap v462: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 443 MiB/s wr, 138 op/s 2024-09-21T07:17:11.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:10 smithi169 ceph-mon[33705]: pgmap v462: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 443 MiB/s wr, 138 op/s 2024-09-21T07:17:11.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:10 smithi175 ceph-mon[34064]: pgmap v462: 129 pgs: 129 active+clean; 12 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 443 MiB/s wr, 138 op/s 2024-09-21T07:17:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:11 smithi092 ceph-mon[30987]: pgmap v463: 129 pgs: 129 active+clean; 13 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 319 MiB/s wr, 105 op/s 2024-09-21T07:17:12.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:11 smithi169 ceph-mon[33705]: pgmap v463: 129 pgs: 129 active+clean; 13 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 319 MiB/s wr, 105 op/s 2024-09-21T07:17:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.172+0000 7fd1dbfda640 1 -- 172.21.15.92:0/1004460367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d41051f0 msgr2=0x7fd1d410d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.172+0000 7fd1dbfda640 1 --2- 172.21.15.92:0/1004460367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d41051f0 0x7fd1d410d830 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009900 tx=0x7fd1c402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.172+0000 7fd1dbfda640 1 -- 172.21.15.92:0/1004460367 shutdown_connections 2024-09-21T07:17:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.172+0000 7fd1dbfda640 1 --2- 172.21.15.92:0/1004460367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1d410dd70 0x7fd1d4110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.172+0000 7fd1dbfda640 1 --2- 172.21.15.92:0/1004460367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d41051f0 0x7fd1d410d830 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.172+0000 7fd1dbfda640 1 --2- 172.21.15.92:0/1004460367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d41047c0 0x7fd1d4104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.172+0000 7fd1dbfda640 1 -- 172.21.15.92:0/1004460367 >> 172.21.15.92:0/1004460367 conn(0x7fd1d407a740 msgr2=0x7fd1d407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.172+0000 7fd1dbfda640 1 -- 172.21.15.92:0/1004460367 shutdown_connections 2024-09-21T07:17:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.173+0000 7fd1dbfda640 1 -- 172.21.15.92:0/1004460367 wait complete. 2024-09-21T07:17:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.175+0000 7fd1dbfda640 1 Processor -- start 2024-09-21T07:17:12.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.175+0000 7fd1dbfda640 1 -- start start 2024-09-21T07:17:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.175+0000 7fd1dbfda640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1d41047c0 0x7fd1d41981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.175+0000 7fd1dbfda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d41051f0 0x7fd1d4198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.175+0000 7fd1dbfda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d410dd70 0x7fd1d419d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.175+0000 7fd1dbfda640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d41116f0 con 0x7fd1d41051f0 2024-09-21T07:17:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.175+0000 7fd1dbfda640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d4111570 con 0x7fd1d41047c0 2024-09-21T07:17:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.176+0000 7fd1dbfda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d4111870 con 0x7fd1d410dd70 2024-09-21T07:17:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.176+0000 7fd1d9575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d41051f0 0x7fd1d4198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.176+0000 7fd1d9575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d41051f0 0x7fd1d4198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60720/0 (socket says 172.21.15.92:60720) 2024-09-21T07:17:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.176+0000 7fd1d9575640 1 -- 172.21.15.92:0/942162120 learned_addr learned my addr 172.21.15.92:0/942162120 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.176+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1d41047c0 0x7fd1d41981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.177+0000 7fd1da577640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d410dd70 0x7fd1d419d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.177+0000 7fd1d9575640 1 -- 172.21.15.92:0/942162120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d410dd70 msgr2=0x7fd1d419d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.177+0000 7fd1d9575640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d410dd70 0x7fd1d419d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.177+0000 7fd1d9575640 1 -- 172.21.15.92:0/942162120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1d41047c0 msgr2=0x7fd1d41981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.177+0000 7fd1d9575640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1d41047c0 0x7fd1d41981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.177+0000 7fd1d9575640 1 -- 172.21.15.92:0/942162120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d419e0d0 con 0x7fd1d41051f0 2024-09-21T07:17:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.177+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1d41047c0 0x7fd1d41981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.177+0000 7fd1d9575640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d41051f0 0x7fd1d4198740 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd1c402a910 tx=0x7fd1c4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.178+0000 7fd1caffd640 1 -- 172.21.15.92:0/942162120 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c403f070 con 0x7fd1d41051f0 2024-09-21T07:17:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.178+0000 7fd1caffd640 1 -- 172.21.15.92:0/942162120 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1c403baf0 con 0x7fd1d41051f0 2024-09-21T07:17:12.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.178+0000 7fd1dbfda640 1 -- 172.21.15.92:0/942162120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d419e360 con 0x7fd1d41051f0 2024-09-21T07:17:12.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.178+0000 7fd1caffd640 1 -- 172.21.15.92:0/942162120 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4035030 con 0x7fd1d41051f0 2024-09-21T07:17:12.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.178+0000 7fd1dbfda640 1 -- 172.21.15.92:0/942162120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d41a4b50 con 0x7fd1d41051f0 2024-09-21T07:17:12.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.184+0000 7fd1e3024740 1 Processor -- start 2024-09-21T07:17:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.185+0000 7fd1e3024740 1 -- start start 2024-09-21T07:17:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.185+0000 7fd1caffd640 1 -- 172.21.15.92:0/942162120 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fd1c4042070 con 0x7fd1d41051f0 2024-09-21T07:17:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.185+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 0x555efe4ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.185+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1202f0 0x555efe4eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.185+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1284d0 0x555efe4ef430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.185+0000 7fd1e3024740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555efe4636f0 con 0x555efe1202f0 2024-09-21T07:17:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.185+0000 7fd1e3024740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555efe452b20 con 0x555efe1491b0 2024-09-21T07:17:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.185+0000 7fd1e3024740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555efe456930 con 0x555efe1284d0 2024-09-21T07:17:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.186+0000 7fd1da577640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 0x555efe4ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.186+0000 7fd1da577640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 0x555efe4ee9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:44490/0 (socket says 172.21.15.92:44490) 2024-09-21T07:17:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.186+0000 7fd1da577640 1 -- 172.21.15.92:0/886504593 learned_addr learned my addr 172.21.15.92:0/886504593 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.186+0000 7fd1d9575640 1 --2- 172.21.15.92:0/886504593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1284d0 0x555efe4ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.186+0000 7fd1da577640 1 -- 172.21.15.92:0/886504593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1284d0 msgr2=0x555efe4ef430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.186+0000 7fd1da577640 1 --2- 172.21.15.92:0/886504593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1284d0 0x555efe4ef430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.186+0000 7fd1da577640 1 -- 172.21.15.92:0/886504593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1202f0 msgr2=0x555efe4eeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.186+0000 7fd1da577640 1 --2- 172.21.15.92:0/886504593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1202f0 0x555efe4eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.186+0000 7fd1da577640 1 -- 172.21.15.92:0/886504593 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555efe418530 con 0x555efe1491b0 2024-09-21T07:17:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.186+0000 7fd1caffd640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd1c00bab10 0x7fd1c00bd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.187+0000 7fd1caffd640 1 -- 172.21.15.92:0/942162120 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd1c4108200 con 0x7fd1d41051f0 2024-09-21T07:17:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.187+0000 7fd1da577640 1 --2- 172.21.15.92:0/886504593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 0x555efe4ee9b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009e90 tx=0x7fd1cc010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac125f51244c8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.188+0000 7fd1bffff640 1 -- 172.21.15.92:0/886504593 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc016070 con 0x555efe1491b0 2024-09-21T07:17:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.188+0000 7fd1bffff640 1 -- 172.21.15.92:0/886504593 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1cc004d20 con 0x555efe1491b0 2024-09-21T07:17:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.188+0000 7fd1bffff640 1 -- 172.21.15.92:0/886504593 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0126b0 con 0x555efe1491b0 2024-09-21T07:17:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.188+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd1c00bab10 0x7fd1c00bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.189+0000 7fd1e3024740 1 -- 172.21.15.92:0/886504593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 msgr2=0x555efe4ee9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.189+0000 7fd1e3024740 1 --2- 172.21.15.92:0/886504593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 0x555efe4ee9b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009e90 tx=0x7fd1cc010740 comp rx=0 tx=0).stop 2024-09-21T07:17:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.189+0000 7fd1e3024740 1 -- 172.21.15.92:0/886504593 shutdown_connections 2024-09-21T07:17:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.189+0000 7fd1e3024740 1 --2- 172.21.15.92:0/886504593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1284d0 0x555efe4ef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.189+0000 7fd1e3024740 1 --2- 172.21.15.92:0/886504593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1202f0 0x555efe4eeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.189+0000 7fd1e3024740 1 --2- 172.21.15.92:0/886504593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 0x555efe4ee9b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.189+0000 7fd1e3024740 1 -- 172.21.15.92:0/886504593 >> 172.21.15.92:0/886504593 conn(0x555efe13d300 msgr2=0x555efe4ec8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.189+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd1c00bab10 0x7fd1c00bd020 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009460 tx=0x7fd1d00093b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.189+0000 7fd1e3024740 1 -- 172.21.15.92:0/886504593 shutdown_connections 2024-09-21T07:17:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.190+0000 7fd1e3024740 1 -- 172.21.15.92:0/886504593 wait complete. 2024-09-21T07:17:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.190+0000 7fd1e3024740 1 -- start start 2024-09-21T07:17:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.190+0000 7fd1e3024740 1 Processor -- start 2024-09-21T07:17:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.191+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1202f0 0x555efe4fa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.191+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1284d0 0x555efe4fa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.191+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 0x555efe506420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.191+0000 7fd1e3024740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555efe38aab0 con 0x555efe1284d0 2024-09-21T07:17:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.191+0000 7fd1e3024740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555efe3f8730 con 0x555efe1491b0 2024-09-21T07:17:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.191+0000 7fd1e3024740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555efe4fd130 con 0x555efe1202f0 2024-09-21T07:17:12.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.191+0000 7fd1e3024740 10 client.0 _ll_register_callbacks cb 0x555efe44c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:12.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.191+0000 7fd1d9d76640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1202f0 0x555efe4fa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.192+0000 7fd1d9d76640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1202f0 0x555efe4fa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:45000/0 (socket says 172.21.15.92:45000) 2024-09-21T07:17:12.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.192+0000 7fd1d9d76640 1 -- 172.21.15.92:0/236075360 learned_addr learned my addr 172.21.15.92:0/236075360 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:12.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.192+0000 7fd1da577640 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 0x555efe506420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.192+0000 7fd1d9575640 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1284d0 0x555efe4fa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.193+0000 7fd1d9d76640 1 -- 172.21.15.92:0/236075360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 msgr2=0x555efe506420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:12.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.193+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 0x555efe506420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.193+0000 7fd1d9d76640 1 -- 172.21.15.92:0/236075360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1284d0 msgr2=0x555efe4fa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:12.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.193+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1284d0 0x555efe4fa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.193+0000 7fd1d9d76640 1 -- 172.21.15.92:0/236075360 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555efe1b4790 con 0x555efe1202f0 2024-09-21T07:17:12.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.194+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1202f0 0x555efe4fa190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0010fd0 tx=0x7fd1d0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5becd65544251a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:12.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.194+0000 7fd1bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-21T07:17:12.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.195+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/236075360 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0023070 con 0x555efe1202f0 2024-09-21T07:17:12.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.195+0000 7fd1e3024740 1 -- 172.21.15.92:0/236075360 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1cc004d20 con 0x555efe1202f0 2024-09-21T07:17:12.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.195+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/236075360 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd1d001f860 con 0x555efe1202f0 2024-09-21T07:17:12.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.195+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/236075360 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd1d002f050 con 0x555efe1202f0 2024-09-21T07:17:12.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.195+0000 7fd1e3024740 10 client.26203 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:12.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.195+0000 7fd1e3024740 1 -- 172.21.15.92:0/236075360 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555efe22d620 con 0x555efe1202f0 2024-09-21T07:17:12.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.195+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/236075360 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1cc004d20 con 0x555efe1202f0 2024-09-21T07:17:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.196+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/236075360 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd1d000f040 con 0x555efe1202f0 2024-09-21T07:17:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.196+0000 7fd1e3024740 10 client.26203 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.196+0000 7fd1e3024740 10 client.26203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.196+0000 7fd1e3024740 20 client.26203 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.196+0000 7fd1e3024740 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555efe107d80 0x555efe50c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.196+0000 7fd1e3024740 4 client.26203 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.196+0000 7fd1e3024740 1 -- 172.21.15.92:0/236075360 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555efe465640 con 0x555efe107d80 2024-09-21T07:17:12.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.196+0000 7fd1d9575640 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555efe107d80 0x555efe50c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.197+0000 7fd1bd7fa640 10 client.26203 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:12.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.197+0000 7fd1d9575640 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555efe107d80 0x555efe50c7e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a42967b8a430b90 server_cookie=cd648ce8d32f5986 in_seq=0 out_seq=0 2024-09-21T07:17:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.198+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/236075360 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555efe465640 con 0x555efe107d80 2024-09-21T07:17:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.198+0000 7fd1bd7fa640 10 client.26203 handle_command_reply: tid=0 2024-09-21T07:17:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.198+0000 7fd1e3024740 1 client.26203 shutdown 2024-09-21T07:17:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.198+0000 7fd1e3024740 1 -- 172.21.15.92:0/236075360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1202f0 msgr2=0x555efe4fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.198+0000 7fd1e3024740 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1202f0 0x555efe4fa190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0010fd0 tx=0x7fd1d0004730 comp rx=0 tx=0).stop 2024-09-21T07:17:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.199+0000 7fd1e3024740 1 -- 172.21.15.92:0/236075360 shutdown_connections 2024-09-21T07:17:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.199+0000 7fd1e3024740 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555efe107d80 0x555efe50c7e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.199+0000 7fd1e3024740 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1491b0 0x555efe506420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.199+0000 7fd1e3024740 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1284d0 0x555efe4fa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.199+0000 7fd1bd7fa640 0 client.26203 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.199+0000 7fd1e3024740 1 --2- 172.21.15.92:0/236075360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1202f0 0x555efe4fa190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.199+0000 7fd1e3024740 1 -- 172.21.15.92:0/236075360 >> 172.21.15.92:0/236075360 conn(0x555efe13d300 msgr2=0x555efe4ef9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.199+0000 7fd1e3024740 1 -- 172.21.15.92:0/236075360 shutdown_connections 2024-09-21T07:17:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.199+0000 7fd1e3024740 1 -- 172.21.15.92:0/236075360 wait complete. 2024-09-21T07:17:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.199+0000 7fd1e3024740 20 client.26203 trim_cache size 0 max 16384 2024-09-21T07:17:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.223+0000 7fd1e3024740 1 Processor -- start 2024-09-21T07:17:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.223+0000 7fd1e3024740 1 -- start start 2024-09-21T07:17:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.223+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 0x555efe4ec800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.223+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1284d0 0x555efe506320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.223+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1491b0 0x555efe506860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.223+0000 7fd1e3024740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d41aedd0 con 0x555efe1491b0 2024-09-21T07:17:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.223+0000 7fd1e3024740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d41b0910 con 0x555efe1202f0 2024-09-21T07:17:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.223+0000 7fd1e3024740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d41af4a0 con 0x555efe1284d0 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.224+0000 7fd1da577640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1491b0 0x555efe506860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.224+0000 7fd1da577640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1491b0 0x555efe506860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60746/0 (socket says 172.21.15.92:60746) 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.224+0000 7fd1da577640 1 -- 172.21.15.92:0/1978855777 learned_addr learned my addr 172.21.15.92:0/1978855777 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.224+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/1978855777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 0x555efe4ec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.224+0000 7fd1d9575640 1 --2- 172.21.15.92:0/1978855777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1284d0 0x555efe506320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.224+0000 7fd1da577640 1 -- 172.21.15.92:0/1978855777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1284d0 msgr2=0x555efe506320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.224+0000 7fd1da577640 1 --2- 172.21.15.92:0/1978855777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1284d0 0x555efe506320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.224+0000 7fd1da577640 1 -- 172.21.15.92:0/1978855777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 msgr2=0x555efe4ec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.224+0000 7fd1da577640 1 --2- 172.21.15.92:0/1978855777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 0x555efe4ec800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.224+0000 7fd1da577640 1 -- 172.21.15.92:0/1978855777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555efe4ed240 con 0x555efe1491b0 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.225+0000 7fd1da577640 1 --2- 172.21.15.92:0/1978855777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1491b0 0x555efe506860 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009bf0 tx=0x7fd1cc010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe869300706e79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.225+0000 7fd1bf7fe640 1 -- 172.21.15.92:0/1978855777 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc016040 con 0x555efe1491b0 2024-09-21T07:17:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.225+0000 7fd1bf7fe640 1 -- 172.21.15.92:0/1978855777 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1cc028070 con 0x555efe1491b0 2024-09-21T07:17:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.225+0000 7fd1bf7fe640 1 -- 172.21.15.92:0/1978855777 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc01a9a0 con 0x555efe1491b0 2024-09-21T07:17:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.226+0000 7fd1e3024740 1 -- 172.21.15.92:0/1978855777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1491b0 msgr2=0x555efe506860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.226+0000 7fd1e3024740 1 --2- 172.21.15.92:0/1978855777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1491b0 0x555efe506860 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009bf0 tx=0x7fd1cc010fd0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.227+0000 7fd1e3024740 1 -- 172.21.15.92:0/1978855777 shutdown_connections 2024-09-21T07:17:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.227+0000 7fd1e3024740 1 --2- 172.21.15.92:0/1978855777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1491b0 0x555efe506860 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.227+0000 7fd1e3024740 1 --2- 172.21.15.92:0/1978855777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1284d0 0x555efe506320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.227+0000 7fd1e3024740 1 --2- 172.21.15.92:0/1978855777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 0x555efe4ec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.227+0000 7fd1e3024740 1 -- 172.21.15.92:0/1978855777 >> 172.21.15.92:0/1978855777 conn(0x555efe13d300 msgr2=0x555efe4ec0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.227+0000 7fd1e3024740 1 -- 172.21.15.92:0/1978855777 shutdown_connections 2024-09-21T07:17:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.227+0000 7fd1e3024740 1 -- 172.21.15.92:0/1978855777 wait complete. 2024-09-21T07:17:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.228+0000 7fd1e3024740 1 -- start start 2024-09-21T07:17:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.228+0000 7fd1e3024740 1 Processor -- start 2024-09-21T07:17:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.228+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 0x555efe4fd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.228+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1284d0 0x555efe4fda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.229+0000 7fd1e3024740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1491b0 0x555efe4fdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.229+0000 7fd1e3024740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d41b0240 con 0x555efe1284d0 2024-09-21T07:17:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.229+0000 7fd1e3024740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d41afb70 con 0x555efe1202f0 2024-09-21T07:17:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.229+0000 7fd1e3024740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d41acdb0 con 0x555efe1491b0 2024-09-21T07:17:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.229+0000 7fd1e3024740 10 client.0 _ll_register_callbacks cb 0x7fd1d0016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.229+0000 7fd1d9575640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1284d0 0x555efe4fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.229+0000 7fd1d9d76640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 0x555efe4fd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.229+0000 7fd1d9d76640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 0x555efe4fd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:44514/0 (socket says 172.21.15.92:44514) 2024-09-21T07:17:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.229+0000 7fd1d9d76640 1 -- 172.21.15.92:0/3057921997 learned_addr learned my addr 172.21.15.92:0/3057921997 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.229+0000 7fd1da577640 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1491b0 0x555efe4fdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.230+0000 7fd1d9d76640 1 -- 172.21.15.92:0/3057921997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1491b0 msgr2=0x555efe4fdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.230+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1491b0 0x555efe4fdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.230+0000 7fd1d9d76640 1 -- 172.21.15.92:0/3057921997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1284d0 msgr2=0x555efe4fda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.230+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1284d0 0x555efe4fda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.230+0000 7fd1d9d76640 1 -- 172.21.15.92:0/3057921997 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555efe575380 con 0x555efe1202f0 2024-09-21T07:17:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.230+0000 7fd1d9d76640 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 0x555efe4fd4d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x555efe4ed5c0 tx=0x7fd1d0011f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebbbb27130952b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.230+0000 7fd1bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.231+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/3057921997 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0023070 con 0x555efe1202f0 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.231+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/3057921997 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fd1d0004240 con 0x555efe1202f0 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.231+0000 7fd1e3024740 1 -- 172.21.15.92:0/3057921997 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1cc028070 con 0x555efe1202f0 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.231+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/3057921997 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd1d0042050 con 0x555efe1202f0 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.231+0000 7fd1e3024740 10 client.26087 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.231+0000 7fd1e3024740 1 -- 172.21.15.92:0/3057921997 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555efe5765f0 con 0x555efe1202f0 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.231+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/3057921997 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1d0037020 con 0x555efe1202f0 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.232+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/3057921997 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd1d00035f0 con 0x555efe1202f0 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.232+0000 7fd1e3024740 10 client.26087 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.232+0000 7fd1e3024740 10 client.26087 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.232+0000 7fd1e3024740 20 client.26087 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.232+0000 7fd1e3024740 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555efe0dd1c0 0x555efe578e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.232+0000 7fd1e3024740 4 client.26087 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:17:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.232+0000 7fd1e3024740 1 -- 172.21.15.92:0/3057921997 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fd1cc028070 con 0x555efe0dd1c0 2024-09-21T07:17:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.232+0000 7fd1d9575640 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555efe0dd1c0 0x555efe578e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.233+0000 7fd1d9575640 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555efe0dd1c0 0x555efe578e30 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=816db1900b9453ee server_cookie=c23f8288262aab0d in_seq=0 out_seq=0 2024-09-21T07:17:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.233+0000 7fd1bd7fa640 10 client.26087 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1bd7fa640 1 -- 172.21.15.92:0/3057921997 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fd1cc028070 con 0x555efe0dd1c0 2024-09-21T07:17:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1bd7fa640 10 client.26087 handle_command_reply: tid=0 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 client.26087 shutdown 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 -- 172.21.15.92:0/3057921997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 msgr2=0x555efe4fd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 0x555efe4fd4d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x555efe4ed5c0 tx=0x7fd1d0011f50 comp rx=0 tx=0).stop 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 -- 172.21.15.92:0/3057921997 shutdown_connections 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555efe0dd1c0 0x555efe578e30 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555efe1491b0 0x555efe4fdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1bd7fa640 0 client.26087 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555efe1284d0 0x555efe4fda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 --2- 172.21.15.92:0/3057921997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555efe1202f0 0x555efe4fd4d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 -- 172.21.15.92:0/3057921997 >> 172.21.15.92:0/3057921997 conn(0x555efe13d300 msgr2=0x555efe4ef9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 -- 172.21.15.92:0/3057921997 shutdown_connections 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 1 -- 172.21.15.92:0/3057921997 wait complete. 2024-09-21T07:17:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.248+0000 7fd1e3024740 20 client.26087 trim_cache size 0 max 16384 2024-09-21T07:17:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:17:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:17:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:17:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:17:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.249+0000 7fd1dbfda640 1 -- 172.21.15.92:0/942162120 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd1c00bab10 msgr2=0x7fd1c00bd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.249+0000 7fd1dbfda640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd1c00bab10 0x7fd1c00bd020 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009460 tx=0x7fd1d00093b0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.249+0000 7fd1dbfda640 1 -- 172.21.15.92:0/942162120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d41051f0 msgr2=0x7fd1d4198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.249+0000 7fd1dbfda640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d41051f0 0x7fd1d4198740 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd1c402a910 tx=0x7fd1c4003b90 comp rx=0 tx=0).stop 2024-09-21T07:17:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.249+0000 7fd1dbfda640 1 -- 172.21.15.92:0/942162120 shutdown_connections 2024-09-21T07:17:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.249+0000 7fd1dbfda640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd1c00bab10 0x7fd1c00bd020 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.249+0000 7fd1dbfda640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1d410dd70 0x7fd1d419d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.249+0000 7fd1dbfda640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d41051f0 0x7fd1d4198740 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.249+0000 7fd1dbfda640 1 --2- 172.21.15.92:0/942162120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1d41047c0 0x7fd1d41981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.249+0000 7fd1dbfda640 1 -- 172.21.15.92:0/942162120 >> 172.21.15.92:0/942162120 conn(0x7fd1d407a740 msgr2=0x7fd1d4100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.250+0000 7fd1dbfda640 1 -- 172.21.15.92:0/942162120 shutdown_connections 2024-09-21T07:17:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:12.250+0000 7fd1dbfda640 1 -- 172.21.15.92:0/942162120 wait complete. 2024-09-21T07:17:12.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:11 smithi175 ceph-mon[34064]: pgmap v463: 129 pgs: 129 active+clean; 13 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 319 MiB/s wr, 105 op/s 2024-09-21T07:17:15.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:14 smithi175 ceph-mon[34064]: pgmap v464: 129 pgs: 129 active+clean; 14 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 423 MiB/s wr, 134 op/s 2024-09-21T07:17:15.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:14 smithi092 ceph-mon[30987]: pgmap v464: 129 pgs: 129 active+clean; 14 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 423 MiB/s wr, 134 op/s 2024-09-21T07:17:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:14 smithi169 ceph-mon[33705]: pgmap v464: 129 pgs: 129 active+clean; 14 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 423 MiB/s wr, 134 op/s 2024-09-21T07:17:16.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:16 smithi092 ceph-mon[30987]: pgmap v465: 129 pgs: 129 active+clean; 15 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 392 MiB/s wr, 111 op/s 2024-09-21T07:17:17.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:16 smithi169 ceph-mon[33705]: pgmap v465: 129 pgs: 129 active+clean; 15 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 392 MiB/s wr, 111 op/s 2024-09-21T07:17:17.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:16 smithi175 ceph-mon[34064]: pgmap v465: 129 pgs: 129 active+clean; 15 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 392 MiB/s wr, 111 op/s 2024-09-21T07:17:19.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:18 smithi092 ceph-mon[30987]: pgmap v466: 129 pgs: 129 active+clean; 17 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 435 MiB/s wr, 122 op/s 2024-09-21T07:17:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:18 smithi169 ceph-mon[33705]: pgmap v466: 129 pgs: 129 active+clean; 17 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 435 MiB/s wr, 122 op/s 2024-09-21T07:17:19.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:18 smithi175 ceph-mon[34064]: pgmap v466: 129 pgs: 129 active+clean; 17 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 435 MiB/s wr, 122 op/s 2024-09-21T07:17:20.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:19 smithi092 ceph-mon[30987]: pgmap v467: 129 pgs: 129 active+clean; 18 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 559 MiB/s wr, 152 op/s 2024-09-21T07:17:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:19 smithi169 ceph-mon[33705]: pgmap v467: 129 pgs: 129 active+clean; 18 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 559 MiB/s wr, 152 op/s 2024-09-21T07:17:20.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:19 smithi175 ceph-mon[34064]: pgmap v467: 129 pgs: 129 active+clean; 18 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 559 MiB/s wr, 152 op/s 2024-09-21T07:17:20.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:17:20.942 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:21.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.730+0000 7f3e12f91640 1 -- 172.21.15.92:0/3901874077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c108cf0 msgr2=0x7f3e0c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.730+0000 7f3e12f91640 1 --2- 172.21.15.92:0/3901874077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c108cf0 0x7f3e0c10f520 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009ca0 tx=0x7f3e0402a8e0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.731+0000 7f3e12f91640 1 -- 172.21.15.92:0/3901874077 shutdown_connections 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.731+0000 7f3e12f91640 1 --2- 172.21.15.92:0/3901874077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c108cf0 0x7f3e0c10f520 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.731+0000 7f3e12f91640 1 --2- 172.21.15.92:0/3901874077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e0c1083a0 0x7f3e0c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.731+0000 7f3e12f91640 1 --2- 172.21.15.92:0/3901874077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c102a60 0x7f3e0c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.731+0000 7f3e12f91640 1 -- 172.21.15.92:0/3901874077 >> 172.21.15.92:0/3901874077 conn(0x7f3e0c079730 msgr2=0x7f3e0c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.731+0000 7f3e12f91640 1 -- 172.21.15.92:0/3901874077 shutdown_connections 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.731+0000 7f3e12f91640 1 -- 172.21.15.92:0/3901874077 wait complete. 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.731+0000 7f3e12f91640 1 Processor -- start 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e12f91640 1 -- start start 2024-09-21T07:17:21.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e12f91640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c102a60 0x7f3e0c19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e12f91640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c1083a0 0x7f3e0c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e12f91640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e0c108cf0 0x7f3e0c1a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e12f91640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c113a40 con 0x7f3e0c102a60 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e12f91640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1138c0 con 0x7f3e0c108cf0 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e12f91640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c113bc0 con 0x7f3e0c1083a0 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e10d2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c102a60 0x7f3e0c19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e10d2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c102a60 0x7f3e0c19c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50310/0 (socket says 172.21.15.92:50310) 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e10d2d640 1 -- 172.21.15.92:0/201029386 learned_addr learned my addr 172.21.15.92:0/201029386 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.732+0000 7f3e0bfff640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c1083a0 0x7f3e0c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.733+0000 7f3e1152e640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e0c108cf0 0x7f3e0c1a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.733+0000 7f3e10d2d640 1 -- 172.21.15.92:0/201029386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c1083a0 msgr2=0x7f3e0c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.733+0000 7f3e10d2d640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c1083a0 0x7f3e0c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.733+0000 7f3e10d2d640 1 -- 172.21.15.92:0/201029386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e0c108cf0 msgr2=0x7f3e0c1a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:21.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.733+0000 7f3e10d2d640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e0c108cf0 0x7f3e0c1a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.733+0000 7f3e10d2d640 1 -- 172.21.15.92:0/201029386 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c1a26a0 con 0x7f3e0c102a60 2024-09-21T07:17:21.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.733+0000 7f3e10d2d640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c102a60 0x7f3e0c19c730 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000b4a0 tx=0x7f3e0000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:21.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.734+0000 7f3e09ffb640 1 -- 172.21.15.92:0/201029386 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00014070 con 0x7f3e0c102a60 2024-09-21T07:17:21.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.734+0000 7f3e12f91640 1 -- 172.21.15.92:0/201029386 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c1a2990 con 0x7f3e0c102a60 2024-09-21T07:17:21.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.734+0000 7f3e09ffb640 1 -- 172.21.15.92:0/201029386 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e00010aa0 con 0x7f3e0c102a60 2024-09-21T07:17:21.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.734+0000 7f3e09ffb640 1 -- 172.21.15.92:0/201029386 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00017b70 con 0x7f3e0c102a60 2024-09-21T07:17:21.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.734+0000 7f3e12f91640 1 -- 172.21.15.92:0/201029386 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c1a90f0 con 0x7f3e0c102a60 2024-09-21T07:17:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.737+0000 7f3e19505740 1 Processor -- start 2024-09-21T07:17:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.737+0000 7f3e19505740 1 -- start start 2024-09-21T07:17:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.738+0000 7f3e19505740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8de070 0x56270dc85650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.738+0000 7f3e1152e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8de070 0x56270dc85650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.738+0000 7f3e1152e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8de070 0x56270dc85650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50324/0 (socket says 172.21.15.92:50324) 2024-09-21T07:17:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.738+0000 7f3e19505740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8b51b0 0x56270dc85b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.738+0000 7f3e1152e640 1 -- 172.21.15.92:0/793603410 learned_addr learned my addr 172.21.15.92:0/793603410 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.739+0000 7f3e19505740 1 --2- 172.21.15.92:0/793603410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8bd390 0x56270dc860d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.739+0000 7f3e19505740 1 -- 172.21.15.92:0/793603410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56270dbfbe50 con 0x56270d8de070 2024-09-21T07:17:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.739+0000 7f3e19505740 1 -- 172.21.15.92:0/793603410 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56270dbeb280 con 0x56270d8b51b0 2024-09-21T07:17:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.739+0000 7f3e19505740 1 -- 172.21.15.92:0/793603410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56270dbef090 con 0x56270d8bd390 2024-09-21T07:17:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.739+0000 7f3e1152e640 1 -- 172.21.15.92:0/793603410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8bd390 msgr2=0x56270dc860d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.739+0000 7f3e1152e640 1 --2- 172.21.15.92:0/793603410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8bd390 0x56270dc860d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.739+0000 7f3e1152e640 1 -- 172.21.15.92:0/793603410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8b51b0 msgr2=0x56270dc85b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:17:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.739+0000 7f3e1152e640 1 --2- 172.21.15.92:0/793603410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8b51b0 0x56270dc85b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.739+0000 7f3e09ffb640 1 -- 172.21.15.92:0/201029386 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f3e00017070 con 0x7f3e0c102a60 2024-09-21T07:17:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.739+0000 7f3e1152e640 1 -- 172.21.15.92:0/793603410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56270d949650 con 0x56270d8de070 2024-09-21T07:17:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.740+0000 7f3e1152e640 1 --2- 172.21.15.92:0/793603410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8de070 0x56270dc85650 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009ca0 tx=0x7f3e040315b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae1c43eecb1b3af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.740+0000 7f3df6ffd640 1 -- 172.21.15.92:0/793603410 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04031b40 con 0x56270d8de070 2024-09-21T07:17:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.740+0000 7f3df6ffd640 1 -- 172.21.15.92:0/793603410 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e04036040 con 0x56270d8de070 2024-09-21T07:17:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.740+0000 7f3df6ffd640 1 -- 172.21.15.92:0/793603410 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e040046a0 con 0x56270d8de070 2024-09-21T07:17:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.741+0000 7f3e09ffb640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3dfc0b6680 0x7f3dfc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.741+0000 7f3e09ffb640 1 -- 172.21.15.92:0/201029386 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3e000e6ce0 con 0x7f3e0c102a60 2024-09-21T07:17:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.741+0000 7f3e10d2d640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3dfc0b6680 0x7f3dfc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.742+0000 7f3e19505740 1 -- 172.21.15.92:0/793603410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8de070 msgr2=0x56270dc85650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.742+0000 7f3e19505740 1 --2- 172.21.15.92:0/793603410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8de070 0x56270dc85650 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009ca0 tx=0x7f3e040315b0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.742+0000 7f3e19505740 1 -- 172.21.15.92:0/793603410 shutdown_connections 2024-09-21T07:17:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.742+0000 7f3e19505740 1 --2- 172.21.15.92:0/793603410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8bd390 0x56270dc860d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.742+0000 7f3e19505740 1 --2- 172.21.15.92:0/793603410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8b51b0 0x56270dc85b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.742+0000 7f3e19505740 1 --2- 172.21.15.92:0/793603410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8de070 0x56270dc85650 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.742+0000 7f3e19505740 1 -- 172.21.15.92:0/793603410 >> 172.21.15.92:0/793603410 conn(0x56270d8d2460 msgr2=0x56270dc83540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.742+0000 7f3e10d2d640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3dfc0b6680 0x7f3dfc0b8b90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x56270dc842d0 tx=0x7f3e0000bf90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.743+0000 7f3e19505740 1 -- 172.21.15.92:0/793603410 shutdown_connections 2024-09-21T07:17:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.743+0000 7f3e19505740 1 -- 172.21.15.92:0/793603410 wait complete. 2024-09-21T07:17:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.743+0000 7f3e19505740 1 -- start start 2024-09-21T07:17:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.744+0000 7f3e19505740 1 Processor -- start 2024-09-21T07:17:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.744+0000 7f3e19505740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 0x56270dc995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.745+0000 7f3e19505740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 0x56270dc99b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.745+0000 7f3e19505740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8de070 0x56270dca5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.745+0000 7f3e19505740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56270da4c700 con 0x56270d8bd390 2024-09-21T07:17:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.745+0000 7f3e19505740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56270db86110 con 0x56270d8de070 2024-09-21T07:17:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.745+0000 7f3e19505740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56270dc9c500 con 0x56270d8b51b0 2024-09-21T07:17:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.745+0000 7f3e19505740 10 client.0 _ll_register_callbacks cb 0x56270db9f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.745+0000 7f3e0bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 0x56270dc99b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.745+0000 7f3e0bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 0x56270dc99b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50326/0 (socket says 172.21.15.92:50326) 2024-09-21T07:17:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.745+0000 7f3e0bfff640 1 -- 172.21.15.92:0/3714400568 learned_addr learned my addr 172.21.15.92:0/3714400568 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.745+0000 7f3e1152e640 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8de070 0x56270dca5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.746+0000 7f3e0bfff640 1 -- 172.21.15.92:0/3714400568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 msgr2=0x56270dc995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.746+0000 7f3e0bfff640 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 0x56270dc995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.746+0000 7f3e0bfff640 1 -- 172.21.15.92:0/3714400568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8de070 msgr2=0x56270dca5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.746+0000 7f3e0bfff640 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8de070 0x56270dca5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.746+0000 7f3e0bfff640 1 -- 172.21.15.92:0/3714400568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56270dbb3c40 con 0x56270d8bd390 2024-09-21T07:17:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.746+0000 7f3e0bfff640 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 0x56270dc99b10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3df800e480 tx=0x7f3df800e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada7e4be1c98183d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.746+0000 7f3debfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.746+0000 7f3debfff640 1 -- 172.21.15.92:0/3714400568 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8017070 con 0x56270d8bd390 2024-09-21T07:17:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3debfff640 1 -- 172.21.15.92:0/3714400568 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3df8013680 con 0x56270d8bd390 2024-09-21T07:17:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3e19505740 1 -- 172.21.15.92:0/3714400568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e04036040 con 0x56270d8bd390 2024-09-21T07:17:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3debfff640 1 -- 172.21.15.92:0/3714400568 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3df8023050 con 0x56270d8bd390 2024-09-21T07:17:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3e19505740 10 client.16947 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3e19505740 1 -- 172.21.15.92:0/3714400568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56270dca83a0 con 0x56270d8bd390 2024-09-21T07:17:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3debfff640 1 -- 172.21.15.92:0/3714400568 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e04036040 con 0x56270d8bd390 2024-09-21T07:17:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3debfff640 1 -- 172.21.15.92:0/3714400568 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3df8012840 con 0x56270d8bd390 2024-09-21T07:17:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3e19505740 10 client.16947 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3e19505740 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3e19505740 20 client.16947 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.747+0000 7f3e19505740 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56270d89c9f0 0x56270dcab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.748+0000 7f3e19505740 4 client.16947 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.748+0000 7f3e19505740 1 -- 172.21.15.92:0/3714400568 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56270dbfdda0 con 0x56270d89c9f0 2024-09-21T07:17:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.748+0000 7f3e1152e640 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56270d89c9f0 0x56270dcab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.749+0000 7f3e1152e640 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56270d89c9f0 0x56270dcab8e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947eebeadf6bd6cb server_cookie=191dc48a7e2e0af3 in_seq=0 out_seq=0 2024-09-21T07:17:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.749+0000 7f3debfff640 10 client.16947 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.751+0000 7f3debfff640 1 -- 172.21.15.92:0/3714400568 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56270dbfdda0 con 0x56270d89c9f0 2024-09-21T07:17:21.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.751+0000 7f3debfff640 10 client.16947 handle_command_reply: tid=0 2024-09-21T07:17:21.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.751+0000 7f3e19505740 1 client.16947 shutdown 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.751+0000 7f3e19505740 1 -- 172.21.15.92:0/3714400568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 msgr2=0x56270dc99b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.751+0000 7f3e19505740 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 0x56270dc99b10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3df800e480 tx=0x7f3df800e940 comp rx=0 tx=0).stop 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.751+0000 7f3e19505740 1 -- 172.21.15.92:0/3714400568 shutdown_connections 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.752+0000 7f3e19505740 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56270d89c9f0 0x56270dcab8e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.752+0000 7f3e19505740 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8de070 0x56270dca5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.752+0000 7f3e19505740 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 0x56270dc99b10 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.752+0000 7f3e19505740 1 --2- 172.21.15.92:0/3714400568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 0x56270dc995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.752+0000 7f3debfff640 0 client.16947 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.752+0000 7f3e19505740 1 -- 172.21.15.92:0/3714400568 >> 172.21.15.92:0/3714400568 conn(0x56270d8d2460 msgr2=0x56270dc88870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.752+0000 7f3e19505740 1 -- 172.21.15.92:0/3714400568 shutdown_connections 2024-09-21T07:17:21.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.752+0000 7f3e19505740 1 -- 172.21.15.92:0/3714400568 wait complete. 2024-09-21T07:17:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.752+0000 7f3e19505740 20 client.16947 trim_cache size 0 max 16384 2024-09-21T07:17:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.784+0000 7f3e19505740 1 Processor -- start 2024-09-21T07:17:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.784+0000 7f3e19505740 1 -- start start 2024-09-21T07:17:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.785+0000 7f3e19505740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d89c9f0 0x56270dc9b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.785+0000 7f3e19505740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 0x56270dc82b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.785+0000 7f3e1152e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d89c9f0 0x56270dc9b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.785+0000 7f3e1152e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d89c9f0 0x56270dc9b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:36730/0 (socket says 172.21.15.92:36730) 2024-09-21T07:17:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.785+0000 7f3e19505740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 0x56270dc830b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.785+0000 7f3e1152e640 1 -- 172.21.15.92:0/1836891522 learned_addr learned my addr 172.21.15.92:0/1836891522 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.785+0000 7f3e19505740 1 -- 172.21.15.92:0/1836891522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1aec30 con 0x56270d8bd390 2024-09-21T07:17:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.785+0000 7f3e19505740 1 -- 172.21.15.92:0/1836891522 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1b0770 con 0x56270d89c9f0 2024-09-21T07:17:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.785+0000 7f3e19505740 1 -- 172.21.15.92:0/1836891522 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1af300 con 0x56270d8b51b0 2024-09-21T07:17:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.785+0000 7f3e0bfff640 1 --2- 172.21.15.92:0/1836891522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 0x56270dc82b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.786+0000 7f3e1152e640 1 --2- 172.21.15.92:0/1836891522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 0x56270dc830b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.786+0000 7f3e1152e640 1 -- 172.21.15.92:0/1836891522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 msgr2=0x56270dc82b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.786+0000 7f3e1152e640 1 --2- 172.21.15.92:0/1836891522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 0x56270dc82b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.786+0000 7f3e1152e640 1 -- 172.21.15.92:0/1836891522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 msgr2=0x56270dc830b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.786+0000 7f3e1152e640 1 --2- 172.21.15.92:0/1836891522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 0x56270dc830b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.786+0000 7f3e1152e640 1 -- 172.21.15.92:0/1836891522 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56270dc9a670 con 0x56270d89c9f0 2024-09-21T07:17:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.786+0000 7f3e1152e640 1 --2- 172.21.15.92:0/1836891522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d89c9f0 0x56270dc9b200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e0402a920 tx=0x7f3e040317a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc60f64ad2130539 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.786+0000 7f3df67fc640 1 -- 172.21.15.92:0/1836891522 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04031be0 con 0x56270d89c9f0 2024-09-21T07:17:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.787+0000 7f3df67fc640 1 -- 172.21.15.92:0/1836891522 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e04036040 con 0x56270d89c9f0 2024-09-21T07:17:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.787+0000 7f3df67fc640 1 -- 172.21.15.92:0/1836891522 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e040305e0 con 0x56270d89c9f0 2024-09-21T07:17:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.788+0000 7f3e19505740 1 -- 172.21.15.92:0/1836891522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d89c9f0 msgr2=0x56270dc9b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.788+0000 7f3e19505740 1 --2- 172.21.15.92:0/1836891522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d89c9f0 0x56270dc9b200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e0402a920 tx=0x7f3e040317a0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.789+0000 7f3e19505740 1 -- 172.21.15.92:0/1836891522 shutdown_connections 2024-09-21T07:17:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.789+0000 7f3e19505740 1 --2- 172.21.15.92:0/1836891522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d8bd390 0x56270dc830b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.789+0000 7f3e19505740 1 --2- 172.21.15.92:0/1836891522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 0x56270dc82b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.789+0000 7f3e19505740 1 --2- 172.21.15.92:0/1836891522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d89c9f0 0x56270dc9b200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.789+0000 7f3e19505740 1 -- 172.21.15.92:0/1836891522 >> 172.21.15.92:0/1836891522 conn(0x56270d8d2460 msgr2=0x56270dc9aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:21.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.790+0000 7f3e19505740 1 -- 172.21.15.92:0/1836891522 shutdown_connections 2024-09-21T07:17:21.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.790+0000 7f3e19505740 1 -- 172.21.15.92:0/1836891522 wait complete. 2024-09-21T07:17:21.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.790+0000 7f3e19505740 1 -- start start 2024-09-21T07:17:21.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.791+0000 7f3e19505740 1 Processor -- start 2024-09-21T07:17:21.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.791+0000 7f3e19505740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d89c9f0 0x56270dc9d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.791+0000 7f3e19505740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 0x56270dc9dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.791+0000 7f3e19505740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8bd390 0x56270dc9e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.791+0000 7f3e19505740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1b00a0 con 0x56270d89c9f0 2024-09-21T07:17:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.791+0000 7f3e19505740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1af9d0 con 0x56270d8bd390 2024-09-21T07:17:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.791+0000 7f3e19505740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1acc50 con 0x56270d8b51b0 2024-09-21T07:17:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.791+0000 7f3e19505740 10 client.0 _ll_register_callbacks cb 0x7f3df8009390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.792+0000 7f3e1152e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d89c9f0 0x56270dc9d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.792+0000 7f3e1152e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d89c9f0 0x56270dc9d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50348/0 (socket says 172.21.15.92:50348) 2024-09-21T07:17:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.792+0000 7f3e1152e640 1 -- 172.21.15.92:0/2295676405 learned_addr learned my addr 172.21.15.92:0/2295676405 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:21.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.792+0000 7f3e1152e640 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8bd390 0x56270dc9e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.792+0000 7f3e1152e640 1 -- 172.21.15.92:0/2295676405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 msgr2=0x56270dc9dcf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.792+0000 7f3e1152e640 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 0x56270dc9dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.792+0000 7f3e1152e640 1 -- 172.21.15.92:0/2295676405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8bd390 msgr2=0x56270dc9e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.792+0000 7f3e1152e640 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8bd390 0x56270dc9e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.792+0000 7f3e1152e640 1 -- 172.21.15.92:0/2295676405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56270dd15290 con 0x56270d89c9f0 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.793+0000 7f3e1152e640 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d89c9f0 0x56270dc9d7b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f3e04031d20 tx=0x7f3e0402b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a191979a365b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.793+0000 7f3debfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.793+0000 7f3debfff640 1 -- 172.21.15.92:0/2295676405 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04003970 con 0x56270d89c9f0 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.793+0000 7f3debfff640 1 -- 172.21.15.92:0/2295676405 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3e0404a030 con 0x56270d89c9f0 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.793+0000 7f3e19505740 1 -- 172.21.15.92:0/2295676405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e04036040 con 0x56270d89c9f0 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3debfff640 1 -- 172.21.15.92:0/2295676405 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3e04003b10 con 0x56270d89c9f0 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3e19505740 10 client.16953 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3e19505740 1 -- 172.21.15.92:0/2295676405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56270dd16500 con 0x56270d89c9f0 2024-09-21T07:17:21.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3debfff640 1 -- 172.21.15.92:0/2295676405 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e04036040 con 0x56270d89c9f0 2024-09-21T07:17:21.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3debfff640 1 -- 172.21.15.92:0/2295676405 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3e04051040 con 0x56270d89c9f0 2024-09-21T07:17:21.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3e19505740 10 client.16953 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:21.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3e19505740 10 client.16953 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:21.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3e19505740 20 client.16953 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:21.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3e19505740 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56270d8de070 0x56270dd18790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:21.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3e19505740 4 client.16953 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:17:21.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3e19505740 1 -- 172.21.15.92:0/2295676405 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56270dbf9850 con 0x56270d8de070 2024-09-21T07:17:21.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.794+0000 7f3e0bfff640 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56270d8de070 0x56270dd18790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:21.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.797+0000 7f3debfff640 10 client.16953 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:21.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.797+0000 7f3e0bfff640 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56270d8de070 0x56270dd18790 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f70d54153be51e44 server_cookie=bca05baf15481de8 in_seq=0 out_seq=0 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3debfff640 1 -- 172.21.15.92:0/2295676405 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x56270dbf9850 con 0x56270d8de070 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3debfff640 10 client.16953 handle_command_reply: tid=0 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3e19505740 1 client.16953 shutdown 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3e19505740 1 -- 172.21.15.92:0/2295676405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d89c9f0 msgr2=0x56270dc9d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3e19505740 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d89c9f0 0x56270dc9d7b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f3e04031d20 tx=0x7f3e0402b090 comp rx=0 tx=0).stop 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3e19505740 1 -- 172.21.15.92:0/2295676405 shutdown_connections 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3e19505740 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56270d8de070 0x56270dd18790 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3debfff640 0 client.16953 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3e19505740 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56270d8bd390 0x56270dc9e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3e19505740 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56270d8b51b0 0x56270dc9dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3e19505740 1 --2- 172.21.15.92:0/2295676405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56270d89c9f0 0x56270dc9d7b0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.799+0000 7f3e19505740 1 -- 172.21.15.92:0/2295676405 >> 172.21.15.92:0/2295676405 conn(0x56270d8d2460 msgr2=0x56270dc86680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.800+0000 7f3e19505740 1 -- 172.21.15.92:0/2295676405 shutdown_connections 2024-09-21T07:17:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.800+0000 7f3e19505740 1 -- 172.21.15.92:0/2295676405 wait complete. 2024-09-21T07:17:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.800+0000 7f3e19505740 20 client.16953 trim_cache size 0 max 16384 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:17:21.803 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:17:21.804 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:21.805 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:21.806 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:21.806 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:17:21.806 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:17:21.806 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 -- 172.21.15.92:0/201029386 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3dfc0b6680 msgr2=0x7f3dfc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3dfc0b6680 0x7f3dfc0b8b90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x56270dc842d0 tx=0x7f3e0000bf90 comp rx=0 tx=0).stop 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 -- 172.21.15.92:0/201029386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c102a60 msgr2=0x7f3e0c19c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c102a60 0x7f3e0c19c730 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000b4a0 tx=0x7f3e0000b960 comp rx=0 tx=0).stop 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 -- 172.21.15.92:0/201029386 shutdown_connections 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3dfc0b6680 0x7f3dfc0b8b90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e0c108cf0 0x7f3e0c1a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c1083a0 0x7f3e0c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 --2- 172.21.15.92:0/201029386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c102a60 0x7f3e0c19c730 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 -- 172.21.15.92:0/201029386 >> 172.21.15.92:0/201029386 conn(0x7f3e0c079730 msgr2=0x7f3e0c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 -- 172.21.15.92:0/201029386 shutdown_connections 2024-09-21T07:17:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:21.801+0000 7f3e12f91640 1 -- 172.21.15.92:0/201029386 wait complete. 2024-09-21T07:17:22.755 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:17:22.755 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:17:23.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:22 smithi092 ceph-mon[30987]: pgmap v468: 129 pgs: 129 active+clean; 19 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 560 MiB/s wr, 151 op/s 2024-09-21T07:17:23.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:22 smithi169 ceph-mon[33705]: pgmap v468: 129 pgs: 129 active+clean; 19 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 560 MiB/s wr, 151 op/s 2024-09-21T07:17:23.219 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:23.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:22 smithi175 ceph-mon[34064]: pgmap v468: 129 pgs: 129 active+clean; 19 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 560 MiB/s wr, 151 op/s 2024-09-21T07:17:23.310 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:17:23.310 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 rewriters = 683457.94 kB/sec 2024-09-21T07:17:23.310 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 rewriters = 683447.61 kB/sec 2024-09-21T07:17:23.310 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 683457.94 kB/sec 2024-09-21T07:17:23.311 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 683457.94 kB/sec 2024-09-21T07:17:23.311 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 683457.94 kB/sec 2024-09-21T07:17:23.311 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 10485760.00 kB 2024-09-21T07:17:25.035 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:24 smithi092 ceph-mon[30987]: pgmap v469: 129 pgs: 129 active+clean; 20 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 696 MiB/s wr, 187 op/s 2024-09-21T07:17:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:24 smithi169 ceph-mon[33705]: pgmap v469: 129 pgs: 129 active+clean; 20 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 696 MiB/s wr, 187 op/s 2024-09-21T07:17:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:24 smithi175 ceph-mon[34064]: pgmap v469: 129 pgs: 129 active+clean; 20 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 696 MiB/s wr, 187 op/s 2024-09-21T07:17:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.367+0000 7f010dc40640 1 -- 172.21.15.92:0/4026979731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0108108c50 msgr2=0x7f010810f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.367+0000 7f010dc40640 1 --2- 172.21.15.92:0/4026979731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0108108c50 0x7f010810f480 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0100009ca0 tx=0x7f010002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.367+0000 7f010dc40640 1 -- 172.21.15.92:0/4026979731 shutdown_connections 2024-09-21T07:17:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.367+0000 7f010dc40640 1 --2- 172.21.15.92:0/4026979731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0108108c50 0x7f010810f480 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.367+0000 7f010dc40640 1 --2- 172.21.15.92:0/4026979731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0108108300 0x7f0108108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.367+0000 7f010dc40640 1 --2- 172.21.15.92:0/4026979731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01081029d0 0x7f0108102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.367+0000 7f010dc40640 1 -- 172.21.15.92:0/4026979731 >> 172.21.15.92:0/4026979731 conn(0x7f010807a6f0 msgr2=0x7f010807ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.367+0000 7f010dc40640 1 -- 172.21.15.92:0/4026979731 shutdown_connections 2024-09-21T07:17:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.367+0000 7f010dc40640 1 -- 172.21.15.92:0/4026979731 wait complete. 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.368+0000 7f010dc40640 1 Processor -- start 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.368+0000 7f010dc40640 1 -- start start 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.368+0000 7f010dc40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01081029d0 0x7f010819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.368+0000 7f010dc40640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0108108300 0x7f010819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.368+0000 7f010dc40640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0108108c50 0x7f010819bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f010dc40640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0108112810 con 0x7f0108108300 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f010dc40640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0108112690 con 0x7f0108108c50 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f010dc40640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0108112990 con 0x7f01081029d0 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0106ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0108108300 0x7f010819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0106ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0108108300 0x7f010819b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50378/0 (socket says 172.21.15.92:50378) 2024-09-21T07:17:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0106ffd640 1 -- 172.21.15.92:0/2346559570 learned_addr learned my addr 172.21.15.92:0/2346559570 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0107fff640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0108108c50 0x7f010819bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f01077fe640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01081029d0 0x7f010819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0106ffd640 1 -- 172.21.15.92:0/2346559570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01081029d0 msgr2=0x7f010819b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0106ffd640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01081029d0 0x7f010819b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0106ffd640 1 -- 172.21.15.92:0/2346559570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0108108c50 msgr2=0x7f010819bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0106ffd640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0108108c50 0x7f010819bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0106ffd640 1 -- 172.21.15.92:0/2346559570 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01081a63b0 con 0x7f0108108300 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0106ffd640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0108108300 0x7f010819b660 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c970 tx=0x7f00fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0104ff9640 1 -- 172.21.15.92:0/2346559570 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc007bb0 con 0x7f0108108300 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0104ff9640 1 -- 172.21.15.92:0/2346559570 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00fc007d50 con 0x7f0108108300 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f010dc40640 1 -- 172.21.15.92:0/2346559570 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01081a66a0 con 0x7f0108108300 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f0104ff9640 1 -- 172.21.15.92:0/2346559570 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc004da0 con 0x7f0108108300 2024-09-21T07:17:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.369+0000 7f010dc40640 1 -- 172.21.15.92:0/2346559570 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01081a6c40 con 0x7f0108108300 2024-09-21T07:17:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.372+0000 7f0114c88740 1 Processor -- start 2024-09-21T07:17:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.372+0000 7f0114c88740 1 -- start start 2024-09-21T07:17:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0114c88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b441b0 0x55b416ee99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0114c88740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416ee9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0114c88740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 0x55b416eea430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0114c88740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b416e5e6f0 con 0x55b416b1b2f0 2024-09-21T07:17:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0114c88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b416e4db20 con 0x55b416b441b0 2024-09-21T07:17:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0114c88740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b416e51930 con 0x55b416b234d0 2024-09-21T07:17:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0104ff9640 1 -- 172.21.15.92:0/2346559570 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f00fc004f80 con 0x7f0108108300 2024-09-21T07:17:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f01077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416ee9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f01077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416ee9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50388/0 (socket says 172.21.15.92:50388) 2024-09-21T07:17:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f01077fe640 1 -- 172.21.15.92:0/3526376734 learned_addr learned my addr 172.21.15.92:0/3526376734 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0106ffd640 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 0x55b416eea430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0107fff640 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b441b0 0x55b416ee99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f01077fe640 1 -- 172.21.15.92:0/3526376734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 msgr2=0x55b416eea430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f01077fe640 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 0x55b416eea430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f01077fe640 1 -- 172.21.15.92:0/3526376734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b441b0 msgr2=0x55b416ee99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f01077fe640 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b441b0 0x55b416ee99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f01077fe640 1 -- 172.21.15.92:0/3526376734 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b416e13530 con 0x55b416b1b2f0 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0107fff640 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b441b0 0x55b416ee99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.373+0000 7f0106ffd640 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 0x55b416eea430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.374+0000 7f01077fe640 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416ee9ef0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f00f800cbb0 tx=0x7f00f800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c8db54684d670a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.374+0000 7f00edffb640 1 -- 172.21.15.92:0/3526376734 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8010630 con 0x55b416b1b2f0 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.374+0000 7f0104ff9640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00f00b6700 0x7f00f00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.374+0000 7f00edffb640 1 -- 172.21.15.92:0/3526376734 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00f8010c60 con 0x55b416b1b2f0 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.374+0000 7f00edffb640 1 -- 172.21.15.92:0/3526376734 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f801aa60 con 0x55b416b1b2f0 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.374+0000 7f0107fff640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00f00b6700 0x7f00f00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.374+0000 7f0104ff9640 1 -- 172.21.15.92:0/2346559570 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f00fc0e77e0 con 0x7f0108108300 2024-09-21T07:17:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0114c88740 1 -- 172.21.15.92:0/3526376734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 msgr2=0x55b416ee9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0107fff640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00f00b6700 0x7f00f00b8c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0100006010 tx=0x7f0100005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0114c88740 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416ee9ef0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f00f800cbb0 tx=0x7f00f800e720 comp rx=0 tx=0).stop 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0114c88740 1 -- 172.21.15.92:0/3526376734 shutdown_connections 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0114c88740 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 0x55b416eea430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0114c88740 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416ee9ef0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0114c88740 1 --2- 172.21.15.92:0/3526376734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b441b0 0x55b416ee99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0114c88740 1 -- 172.21.15.92:0/3526376734 >> 172.21.15.92:0/3526376734 conn(0x55b416b38300 msgr2=0x55b416ee78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0114c88740 1 -- 172.21.15.92:0/3526376734 shutdown_connections 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0114c88740 1 -- 172.21.15.92:0/3526376734 wait complete. 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.375+0000 7f0114c88740 1 -- start start 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0114c88740 1 Processor -- start 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0114c88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b1b2f0 0x55b416ef5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0114c88740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 0x55b416ef5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0114c88740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b441b0 0x55b416f01450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0114c88740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b416d85ab0 con 0x55b416b441b0 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0114c88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b416df3730 con 0x55b416b1b2f0 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0114c88740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b416ef8130 con 0x55b416b234d0 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0114c88740 10 client.0 _ll_register_callbacks cb 0x55b416e476b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0107fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b441b0 0x55b416f01450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0107fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b441b0 0x55b416f01450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50390/0 (socket says 172.21.15.92:50390) 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0107fff640 1 -- 172.21.15.92:0/2020909146 learned_addr learned my addr 172.21.15.92:0/2020909146 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f01077fe640 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b1b2f0 0x55b416ef5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0106ffd640 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 0x55b416ef5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0107fff640 1 -- 172.21.15.92:0/2020909146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 msgr2=0x55b416ef5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0107fff640 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 0x55b416ef5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0107fff640 1 -- 172.21.15.92:0/2020909146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b1b2f0 msgr2=0x55b416ef5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0107fff640 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b1b2f0 0x55b416ef5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f0107fff640 1 -- 172.21.15.92:0/2020909146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b416baf790 con 0x55b416b441b0 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.376+0000 7f01077fe640 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b1b2f0 0x55b416ef5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f0107fff640 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b441b0 0x55b416f01450 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0100009ca0 tx=0x7f010002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923affea76055ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f00e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f00e6ffd640 1 -- 172.21.15.92:0/2020909146 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100004250 con 0x55b416b441b0 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f00e6ffd640 1 -- 172.21.15.92:0/2020909146 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f01000043f0 con 0x55b416b441b0 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f0114c88740 1 -- 172.21.15.92:0/2020909146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00f8010c60 con 0x55b416b441b0 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f00e6ffd640 1 -- 172.21.15.92:0/2020909146 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f01000045f0 con 0x55b416b441b0 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f0114c88740 10 client.16965 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f0114c88740 1 -- 172.21.15.92:0/2020909146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b416c28620 con 0x55b416b441b0 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f00e6ffd640 1 -- 172.21.15.92:0/2020909146 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00f8010c60 con 0x55b416b441b0 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f00e6ffd640 1 -- 172.21.15.92:0/2020909146 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0100051070 con 0x55b416b441b0 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f0114c88740 10 client.16965 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f0114c88740 10 client.16965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f0114c88740 20 client.16965 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.377+0000 7f0114c88740 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b416b02d80 0x55b416f07330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.378+0000 7f0114c88740 4 client.16965 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.378+0000 7f0114c88740 1 -- 172.21.15.92:0/2020909146 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b416e60640 con 0x55b416b02d80 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.378+0000 7f01077fe640 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b416b02d80 0x55b416f07330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.378+0000 7f00e6ffd640 10 client.16965 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.378+0000 7f01077fe640 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b416b02d80 0x55b416f07330 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f7cc199f12b203 server_cookie=8d61c5e4e689bfc3 in_seq=0 out_seq=0 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f00e6ffd640 1 -- 172.21.15.92:0/2020909146 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b416e60640 con 0x55b416b02d80 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f00e6ffd640 10 client.16965 handle_command_reply: tid=0 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f0114c88740 1 client.16965 shutdown 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f0114c88740 1 -- 172.21.15.92:0/2020909146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b441b0 msgr2=0x55b416f01450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f0114c88740 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b441b0 0x55b416f01450 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0100009ca0 tx=0x7f010002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f0114c88740 1 -- 172.21.15.92:0/2020909146 shutdown_connections 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f0114c88740 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b416b02d80 0x55b416f07330 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f0114c88740 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b441b0 0x55b416f01450 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f0114c88740 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b234d0 0x55b416ef5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f0114c88740 1 --2- 172.21.15.92:0/2020909146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b1b2f0 0x55b416ef5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f00e6ffd640 0 client.16965 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.379+0000 7f0114c88740 1 -- 172.21.15.92:0/2020909146 >> 172.21.15.92:0/2020909146 conn(0x55b416b38300 msgr2=0x55b416eea9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.380+0000 7f0114c88740 1 -- 172.21.15.92:0/2020909146 shutdown_connections 2024-09-21T07:17:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.380+0000 7f0114c88740 1 -- 172.21.15.92:0/2020909146 wait complete. 2024-09-21T07:17:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.380+0000 7f0114c88740 20 client.16965 trim_cache size 0 max 16384 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.394+0000 7f0114c88740 1 Processor -- start 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0114c88740 1 -- start start 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0114c88740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b02d80 0x55b416eeb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0114c88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b1b2f0 0x55b416ee65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0114c88740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b234d0 0x55b416f0caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0114c88740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01081b0e40 con 0x55b416b234d0 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0114c88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01081b2980 con 0x55b416b1b2f0 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0114c88740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01081b1510 con 0x55b416b02d80 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0107fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b234d0 0x55b416f0caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0107fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b234d0 0x55b416f0caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50398/0 (socket says 172.21.15.92:50398) 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0107fff640 1 -- 172.21.15.92:0/168708264 learned_addr learned my addr 172.21.15.92:0/168708264 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f01077fe640 1 --2- 172.21.15.92:0/168708264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b02d80 0x55b416eeb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0107fff640 1 -- 172.21.15.92:0/168708264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b02d80 msgr2=0x55b416eeb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0107fff640 1 --2- 172.21.15.92:0/168708264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b02d80 0x55b416eeb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0107fff640 1 -- 172.21.15.92:0/168708264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b1b2f0 msgr2=0x55b416ee65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0107fff640 1 --2- 172.21.15.92:0/168708264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b1b2f0 0x55b416ee65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0107fff640 1 -- 172.21.15.92:0/168708264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b416ef7c30 con 0x55b416b234d0 2024-09-21T07:17:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.395+0000 7f0107fff640 1 --2- 172.21.15.92:0/168708264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b234d0 0x55b416f0caf0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0100031770 tx=0x7f0100032de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a15a9a5e04ba24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.396+0000 7f00ed7fa640 1 -- 172.21.15.92:0/168708264 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100004250 con 0x55b416b234d0 2024-09-21T07:17:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.396+0000 7f00ed7fa640 1 -- 172.21.15.92:0/168708264 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0100036050 con 0x55b416b234d0 2024-09-21T07:17:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.396+0000 7f00ed7fa640 1 -- 172.21.15.92:0/168708264 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100053810 con 0x55b416b234d0 2024-09-21T07:17:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.396+0000 7f0114c88740 1 -- 172.21.15.92:0/168708264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b234d0 msgr2=0x55b416f0caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.396+0000 7f0114c88740 1 --2- 172.21.15.92:0/168708264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b234d0 0x55b416f0caf0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0100031770 tx=0x7f0100032de0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.396+0000 7f0114c88740 1 -- 172.21.15.92:0/168708264 shutdown_connections 2024-09-21T07:17:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.396+0000 7f0114c88740 1 --2- 172.21.15.92:0/168708264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b234d0 0x55b416f0caf0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.396+0000 7f0114c88740 1 --2- 172.21.15.92:0/168708264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b1b2f0 0x55b416ee65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.396+0000 7f0114c88740 1 --2- 172.21.15.92:0/168708264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b02d80 0x55b416eeb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.396+0000 7f0114c88740 1 -- 172.21.15.92:0/168708264 >> 172.21.15.92:0/168708264 conn(0x55b416b38300 msgr2=0x55b416ee5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 1 -- 172.21.15.92:0/168708264 shutdown_connections 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 1 -- 172.21.15.92:0/168708264 wait complete. 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 1 -- start start 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 1 Processor -- start 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b02d80 0x55b416efcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416efd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b234d0 0x55b416f74110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01081b22b0 con 0x55b416b1b2f0 2024-09-21T07:17:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01081b1be0 con 0x55b416b234d0 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01081aee20 con 0x55b416b02d80 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.397+0000 7f0114c88740 10 client.0 _ll_register_callbacks cb 0x7f01000318a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0106ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416efd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0106ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416efd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50408/0 (socket says 172.21.15.92:50408) 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0106ffd640 1 -- 172.21.15.92:0/1809480238 learned_addr learned my addr 172.21.15.92:0/1809480238 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0107fff640 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b234d0 0x55b416f74110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f01077fe640 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b02d80 0x55b416efcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0106ffd640 1 -- 172.21.15.92:0/1809480238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b02d80 msgr2=0x55b416efcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0106ffd640 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b02d80 0x55b416efcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0106ffd640 1 -- 172.21.15.92:0/1809480238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b234d0 msgr2=0x55b416f74110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0106ffd640 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b234d0 0x55b416f74110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0106ffd640 1 -- 172.21.15.92:0/1809480238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b416f74750 con 0x55b416b1b2f0 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0107fff640 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b234d0 0x55b416f74110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0106ffd640 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416efd140 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0e4bf0 tx=0x7f00fc0acbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dfbd33c48168e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f00e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f00e6ffd640 1 -- 172.21.15.92:0/1809480238 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc01d040 con 0x55b416b1b2f0 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0114c88740 1 -- 172.21.15.92:0/1809480238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0100036050 con 0x55b416b1b2f0 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f00e6ffd640 1 -- 172.21.15.92:0/1809480238 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f00fc0e75e0 con 0x55b416b1b2f0 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f00e6ffd640 1 -- 172.21.15.92:0/1809480238 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f00fc0acda0 con 0x55b416b1b2f0 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0114c88740 10 client.16971 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.398+0000 7f0114c88740 1 -- 172.21.15.92:0/1809480238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b416f75a10 con 0x55b416b1b2f0 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.399+0000 7f00e6ffd640 1 -- 172.21.15.92:0/1809480238 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0100036050 con 0x55b416b1b2f0 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.399+0000 7f00e6ffd640 1 -- 172.21.15.92:0/1809480238 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f00fc0a8c70 con 0x55b416b1b2f0 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.399+0000 7f0114c88740 10 client.16971 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.399+0000 7f0114c88740 10 client.16971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.399+0000 7f0114c88740 20 client.16971 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.399+0000 7f0114c88740 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b416b441b0 0x55b416f78100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.399+0000 7f0114c88740 4 client.16971 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:17:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.399+0000 7f0114c88740 1 -- 172.21.15.92:0/1809480238 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b416e5c0f0 con 0x55b416b441b0 2024-09-21T07:17:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.399+0000 7f01077fe640 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b416b441b0 0x55b416f78100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.400+0000 7f01077fe640 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b416b441b0 0x55b416f78100 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c9e7a73beb7e40 server_cookie=1ce0ad36d195962c in_seq=0 out_seq=0 2024-09-21T07:17:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.400+0000 7f00e6ffd640 10 client.16971 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f00e6ffd640 1 -- 172.21.15.92:0/1809480238 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b416e5c0f0 con 0x55b416b441b0 2024-09-21T07:17:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f00e6ffd640 10 client.16971 handle_command_reply: tid=0 2024-09-21T07:17:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 client.16971 shutdown 2024-09-21T07:17:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 -- 172.21.15.92:0/1809480238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 msgr2=0x55b416efd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416efd140 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0e4bf0 tx=0x7f00fc0acbe0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 -- 172.21.15.92:0/1809480238 shutdown_connections 2024-09-21T07:17:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b416b441b0 0x55b416f78100 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b416b234d0 0x55b416f74110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b416b1b2f0 0x55b416efd140 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f00e6ffd640 0 client.16971 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 --2- 172.21.15.92:0/1809480238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b416b02d80 0x55b416efcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 -- 172.21.15.92:0/1809480238 >> 172.21.15.92:0/1809480238 conn(0x55b416b38300 msgr2=0x55b416eeb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 -- 172.21.15.92:0/1809480238 shutdown_connections 2024-09-21T07:17:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 1 -- 172.21.15.92:0/1809480238 wait complete. 2024-09-21T07:17:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.408+0000 7f0114c88740 20 client.16971 trim_cache size 0 max 16384 2024-09-21T07:17:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:17:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:17:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:17:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:17:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 -- 172.21.15.92:0/2346559570 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00f00b6700 msgr2=0x7f00f00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00f00b6700 0x7f00f00b8c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0100006010 tx=0x7f0100005c30 comp rx=0 tx=0).stop 2024-09-21T07:17:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 -- 172.21.15.92:0/2346559570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0108108300 msgr2=0x7f010819b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0108108300 0x7f010819b660 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c970 tx=0x7f00fc00ce30 comp rx=0 tx=0).stop 2024-09-21T07:17:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 -- 172.21.15.92:0/2346559570 shutdown_connections 2024-09-21T07:17:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00f00b6700 0x7f00f00b8c10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0108108c50 0x7f010819bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0108108300 0x7f010819b660 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 --2- 172.21.15.92:0/2346559570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01081029d0 0x7f010819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 -- 172.21.15.92:0/2346559570 >> 172.21.15.92:0/2346559570 conn(0x7f010807a6f0 msgr2=0x7f0108106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 -- 172.21.15.92:0/2346559570 shutdown_connections 2024-09-21T07:17:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:25.409+0000 7f010dc40640 1 -- 172.21.15.92:0/2346559570 wait complete. 2024-09-21T07:17:27.070 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:26 smithi175 ceph-mon[34064]: pgmap v470: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 641 MiB/s wr, 171 op/s 2024-09-21T07:17:27.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:26 smithi092 ceph-mon[30987]: pgmap v470: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 641 MiB/s wr, 171 op/s 2024-09-21T07:17:27.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:26 smithi169 ceph-mon[33705]: pgmap v470: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 641 MiB/s wr, 171 op/s 2024-09-21T07:17:28.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:27 smithi092 ceph-mon[30987]: pgmap v471: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 559 MiB/s wr, 152 op/s 2024-09-21T07:17:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:27 smithi169 ceph-mon[33705]: pgmap v471: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 559 MiB/s wr, 152 op/s 2024-09-21T07:17:28.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:27 smithi175 ceph-mon[34064]: pgmap v471: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 559 MiB/s wr, 152 op/s 2024-09-21T07:17:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:30 smithi092 ceph-mon[30987]: pgmap v472: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 453 MiB/s wr, 125 op/s 2024-09-21T07:17:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:30 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2362049112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:17:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:30 smithi169 ceph-mon[33705]: pgmap v472: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 453 MiB/s wr, 125 op/s 2024-09-21T07:17:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:30 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2362049112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:17:31.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:30 smithi175 ceph-mon[34064]: pgmap v472: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 453 MiB/s wr, 125 op/s 2024-09-21T07:17:31.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:30 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2362049112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:17:32.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.140+0000 7fe757dcf640 1 -- 172.21.15.92:0/1682119034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750103b60 msgr2=0x7fe750103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:32.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.140+0000 7fe757dcf640 1 --2- 172.21.15.92:0/1682119034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750103b60 0x7fe750103f70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009900 tx=0x7fe74c02a410 comp rx=0 tx=0).stop 2024-09-21T07:17:32.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.140+0000 7fe757dcf640 1 -- 172.21.15.92:0/1682119034 shutdown_connections 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.140+0000 7fe757dcf640 1 --2- 172.21.15.92:0/1682119034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe750109df0 0x7fe750110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.140+0000 7fe757dcf640 1 --2- 172.21.15.92:0/1682119034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7501094a0 0x7fe7501098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.140+0000 7fe757dcf640 1 --2- 172.21.15.92:0/1682119034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750103b60 0x7fe750103f70 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.140+0000 7fe757dcf640 1 -- 172.21.15.92:0/1682119034 >> 172.21.15.92:0/1682119034 conn(0x7fe75007b850 msgr2=0x7fe75007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.140+0000 7fe757dcf640 1 -- 172.21.15.92:0/1682119034 shutdown_connections 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.140+0000 7fe757dcf640 1 -- 172.21.15.92:0/1682119034 wait complete. 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe757dcf640 1 Processor -- start 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe757dcf640 1 -- start start 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe757dcf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750103b60 0x7fe75019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe757dcf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7501094a0 0x7fe75019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe757dcf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe750109df0 0x7fe75019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:32.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe757dcf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe750113960 con 0x7fe750103b60 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe757dcf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7501137e0 con 0x7fe7501094a0 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe757dcf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe750113ae0 con 0x7fe750109df0 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe755b6b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750103b60 0x7fe75019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe755b6b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750103b60 0x7fe75019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54104/0 (socket says 172.21.15.92:54104) 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe755b6b640 1 -- 172.21.15.92:0/2362049112 learned_addr learned my addr 172.21.15.92:0/2362049112 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe75636c640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe750109df0 0x7fe75019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe75536a640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7501094a0 0x7fe75019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe755b6b640 1 -- 172.21.15.92:0/2362049112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe750109df0 msgr2=0x7fe75019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe755b6b640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe750109df0 0x7fe75019fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe755b6b640 1 -- 172.21.15.92:0/2362049112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7501094a0 msgr2=0x7fe75019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe755b6b640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7501094a0 0x7fe75019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe755b6b640 1 -- 172.21.15.92:0/2362049112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7501a03a0 con 0x7fe750103b60 2024-09-21T07:17:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.141+0000 7fe75536a640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7501094a0 0x7fe75019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:32.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.142+0000 7fe755b6b640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750103b60 0x7fe75019a430 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009230 tx=0x7fe74c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:32.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.142+0000 7fe746ffd640 1 -- 172.21.15.92:0/2362049112 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c03f030 con 0x7fe750103b60 2024-09-21T07:17:32.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.142+0000 7fe746ffd640 1 -- 172.21.15.92:0/2362049112 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe74c003a80 con 0x7fe750103b60 2024-09-21T07:17:32.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.142+0000 7fe746ffd640 1 -- 172.21.15.92:0/2362049112 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c035070 con 0x7fe750103b60 2024-09-21T07:17:32.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.142+0000 7fe757dcf640 1 -- 172.21.15.92:0/2362049112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501a0630 con 0x7fe750103b60 2024-09-21T07:17:32.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.142+0000 7fe757dcf640 1 -- 172.21.15.92:0/2362049112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501a6df0 con 0x7fe750103b60 2024-09-21T07:17:32.562 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:17:32.562 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:17:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.143+0000 7fe757dcf640 1 -- 172.21.15.92:0/2362049112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe750103f70 con 0x7fe750103b60 2024-09-21T07:17:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.144+0000 7fe746ffd640 1 -- 172.21.15.92:0/2362049112 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fe74c042030 con 0x7fe750103b60 2024-09-21T07:17:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.145+0000 7fe746ffd640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe73c0b6680 0x7fe73c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.145+0000 7fe75536a640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe73c0b6680 0x7fe73c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.145+0000 7fe746ffd640 1 -- 172.21.15.92:0/2362049112 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe74c1080d0 con 0x7fe750103b60 2024-09-21T07:17:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.146+0000 7fe75536a640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe73c0b6680 0x7fe73c0b8b90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe750106530 tx=0x7fe740005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.150+0000 7fe746ffd640 1 -- 172.21.15.92:0/2362049112 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe74c0ce280 con 0x7fe750103b60 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.367+0000 7fe757dcf640 1 -- 172.21.15.92:0/2362049112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe75002e640 con 0x7fe750103b60 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.367+0000 7fe746ffd640 1 -- 172.21.15.92:0/2362049112 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7fe74c0d2660 con 0x7fe750103b60 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.369+0000 7fe757dcf640 1 -- 172.21.15.92:0/2362049112 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe73c0b6680 msgr2=0x7fe73c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.369+0000 7fe757dcf640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe73c0b6680 0x7fe73c0b8b90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe750106530 tx=0x7fe740005ec0 comp rx=0 tx=0).stop 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.369+0000 7fe757dcf640 1 -- 172.21.15.92:0/2362049112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750103b60 msgr2=0x7fe75019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.369+0000 7fe757dcf640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750103b60 0x7fe75019a430 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009230 tx=0x7fe74c004270 comp rx=0 tx=0).stop 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.370+0000 7fe757dcf640 1 -- 172.21.15.92:0/2362049112 shutdown_connections 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.370+0000 7fe757dcf640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe73c0b6680 0x7fe73c0b8b90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.370+0000 7fe757dcf640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe750109df0 0x7fe75019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.370+0000 7fe757dcf640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7501094a0 0x7fe75019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.370+0000 7fe757dcf640 1 --2- 172.21.15.92:0/2362049112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750103b60 0x7fe75019a430 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.370+0000 7fe757dcf640 1 -- 172.21.15.92:0/2362049112 >> 172.21.15.92:0/2362049112 conn(0x7fe75007b850 msgr2=0x7fe750107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:32.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.370+0000 7fe757dcf640 1 -- 172.21.15.92:0/2362049112 shutdown_connections 2024-09-21T07:17:32.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:30.370+0000 7fe757dcf640 1 -- 172.21.15.92:0/2362049112 wait complete. 2024-09-21T07:17:32.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:32 smithi092 ceph-mon[30987]: pgmap v473: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 300 MiB/s wr, 86 op/s 2024-09-21T07:17:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:32 smithi169 ceph-mon[33705]: pgmap v473: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 300 MiB/s wr, 86 op/s 2024-09-21T07:17:33.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:32 smithi175 ceph-mon[34064]: pgmap v473: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 300 MiB/s wr, 86 op/s 2024-09-21T07:17:34.620 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:17:34.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:34 smithi092 ceph-mon[30987]: pgmap v474: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 270 MiB/s wr, 81 op/s 2024-09-21T07:17:34.874 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:35.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:34 smithi169 ceph-mon[33705]: pgmap v474: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 270 MiB/s wr, 81 op/s 2024-09-21T07:17:35.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:34 smithi175 ceph-mon[34064]: pgmap v474: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 270 MiB/s wr, 81 op/s 2024-09-21T07:17:35.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.390+0000 7f5953b7f640 1 -- 172.21.15.92:0/3353136600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c1094c0 msgr2=0x7f594c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:35.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.390+0000 7f5953b7f640 1 --2- 172.21.15.92:0/3353136600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c1094c0 0x7f594c1098d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f593c009900 tx=0x7f593c02a410 comp rx=0 tx=0).stop 2024-09-21T07:17:35.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.390+0000 7f5953b7f640 1 -- 172.21.15.92:0/3353136600 shutdown_connections 2024-09-21T07:17:35.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.390+0000 7f5953b7f640 1 --2- 172.21.15.92:0/3353136600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f594c109e10 0x7f594c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.390+0000 7f5953b7f640 1 --2- 172.21.15.92:0/3353136600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c1094c0 0x7f594c1098d0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.390+0000 7f5953b7f640 1 --2- 172.21.15.92:0/3353136600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f594c103b80 0x7f594c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.390+0000 7f5953b7f640 1 -- 172.21.15.92:0/3353136600 >> 172.21.15.92:0/3353136600 conn(0x7f594c0ff5d0 msgr2=0x7f594c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.390+0000 7f5953b7f640 1 -- 172.21.15.92:0/3353136600 shutdown_connections 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.390+0000 7f5953b7f640 1 -- 172.21.15.92:0/3353136600 wait complete. 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f5953b7f640 1 Processor -- start 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f5953b7f640 1 -- start start 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f5953b7f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f594c103b80 0x7f594c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f5953b7f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f594c1094c0 0x7f594c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f5953b7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c109e10 0x7f594c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f5953b7f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1139a0 con 0x7f594c109e10 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f5953b7f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f594c113820 con 0x7f594c103b80 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f5953b7f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f594c113b20 con 0x7f594c1094c0 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f595211c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c109e10 0x7f594c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f595211c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c109e10 0x7f594c076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54114/0 (socket says 172.21.15.92:54114) 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f595211c640 1 -- 172.21.15.92:0/968311184 learned_addr learned my addr 172.21.15.92:0/968311184 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f595191b640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f594c103b80 0x7f594c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f595211c640 1 -- 172.21.15.92:0/968311184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f594c1094c0 msgr2=0x7f594c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f595211c640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f594c1094c0 0x7f594c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f595211c640 1 -- 172.21.15.92:0/968311184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f594c103b80 msgr2=0x7f594c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f595211c640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f594c103b80 0x7f594c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f595211c640 1 -- 172.21.15.92:0/968311184 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c1a8730 con 0x7f594c109e10 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.391+0000 7f595191b640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f594c103b80 0x7f594c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.392+0000 7f595211c640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c109e10 0x7f594c076190 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f594400eaa0 tx=0x7f594400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.392+0000 7f5942ffd640 1 -- 172.21.15.92:0/968311184 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594400cdb0 con 0x7f594c109e10 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.392+0000 7f5942ffd640 1 -- 172.21.15.92:0/968311184 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5944005020 con 0x7f594c109e10 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.392+0000 7f5942ffd640 1 -- 172.21.15.92:0/968311184 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440116d0 con 0x7f594c109e10 2024-09-21T07:17:35.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.392+0000 7f5953b7f640 1 -- 172.21.15.92:0/968311184 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594c1a8a20 con 0x7f594c109e10 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.392+0000 7f5953b7f640 1 -- 172.21.15.92:0/968311184 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594c1a8f90 con 0x7f594c109e10 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.394+0000 7f595a0f3740 1 Processor -- start 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f5942ffd640 1 -- 172.21.15.92:0/968311184 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f59440051d0 con 0x7f594c109e10 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595a0f3740 1 -- start start 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8f2070 0x55753cc996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753cc99be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8d1390 0x55753cc9a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595a0f3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55753cc0fea0 con 0x55753c8f2070 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595a0f3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55753cbff2d0 con 0x55753c8d1390 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595a0f3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55753cc030e0 con 0x55753c8c91b0 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595111a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8f2070 0x55753cc996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595111a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8f2070 0x55753cc996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54118/0 (socket says 172.21.15.92:54118) 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595111a640 1 -- 172.21.15.92:0/3585055436 learned_addr learned my addr 172.21.15.92:0/3585055436 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.395+0000 7f595191b640 1 --2- 172.21.15.92:0/3585055436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753cc99be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f595111a640 1 --2- 172.21.15.92:0/3585055436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8d1390 0x55753cc9a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f595111a640 1 -- 172.21.15.92:0/3585055436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 msgr2=0x55753cc99be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f595111a640 1 --2- 172.21.15.92:0/3585055436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753cc99be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f595111a640 1 -- 172.21.15.92:0/3585055436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8d1390 msgr2=0x55753cc9a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f595111a640 1 --2- 172.21.15.92:0/3585055436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8d1390 0x55753cc9a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f595111a640 1 -- 172.21.15.92:0/3585055436 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753c95d650 con 0x55753c8f2070 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f595191b640 1 --2- 172.21.15.92:0/3585055436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753cc99be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f5942ffd640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f59380b6680 0x7f59380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f595191b640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f59380b6680 0x7f59380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f595111a640 1 --2- 172.21.15.92:0/3585055436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8f2070 0x55753cc996a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f593c009230 tx=0x7f593c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7237c2060c68e523 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f5942ffd640 1 -- 172.21.15.92:0/968311184 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f59440e7d60 con 0x7f594c109e10 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f5937fff640 1 -- 172.21.15.92:0/3585055436 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c044070 con 0x55753c8f2070 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f5937fff640 1 -- 172.21.15.92:0/3585055436 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f593c004040 con 0x55753c8f2070 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.396+0000 7f5937fff640 1 -- 172.21.15.92:0/3585055436 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c035040 con 0x55753c8f2070 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.397+0000 7f595a0f3740 1 -- 172.21.15.92:0/3585055436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8f2070 msgr2=0x55753cc996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.397+0000 7f595191b640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f59380b6680 0x7f59380b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55753cc98320 tx=0x7f5948008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:35.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.397+0000 7f595a0f3740 1 --2- 172.21.15.92:0/3585055436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8f2070 0x55753cc996a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f593c009230 tx=0x7f593c005d50 comp rx=0 tx=0).stop 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.397+0000 7f595a0f3740 1 -- 172.21.15.92:0/3585055436 shutdown_connections 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.397+0000 7f595a0f3740 1 --2- 172.21.15.92:0/3585055436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8d1390 0x55753cc9a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.397+0000 7f595a0f3740 1 --2- 172.21.15.92:0/3585055436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753cc99be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.397+0000 7f595a0f3740 1 --2- 172.21.15.92:0/3585055436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8f2070 0x55753cc996a0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.397+0000 7f595a0f3740 1 -- 172.21.15.92:0/3585055436 >> 172.21.15.92:0/3585055436 conn(0x55753c8e6460 msgr2=0x55753cc97590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.397+0000 7f595a0f3740 1 -- 172.21.15.92:0/3585055436 shutdown_connections 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.397+0000 7f595a0f3740 1 -- 172.21.15.92:0/3585055436 wait complete. 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.398+0000 7f595a0f3740 1 -- start start 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.398+0000 7f595a0f3740 1 Processor -- start 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.398+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753cca4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.398+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753cca52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.398+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 0x55753ccb1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.398+0000 7f595a0f3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55753ca60700 con 0x55753c8d1390 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.398+0000 7f595a0f3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55753cb9a160 con 0x55753c8f2070 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.398+0000 7f595a0f3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55753cca7e20 con 0x55753c8c91b0 2024-09-21T07:17:35.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.398+0000 7f595a0f3740 10 client.0 _ll_register_callbacks cb 0x55753cbb39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.398+0000 7f595111a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753cca52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595111a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753cca52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54120/0 (socket says 172.21.15.92:54120) 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595111a640 1 -- 172.21.15.92:0/1885123805 learned_addr learned my addr 172.21.15.92:0/1885123805 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595191b640 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753cca4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595211c640 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 0x55753ccb1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595111a640 1 -- 172.21.15.92:0/1885123805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 msgr2=0x55753cca4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595111a640 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753cca4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595111a640 1 -- 172.21.15.92:0/1885123805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 msgr2=0x55753ccb1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595111a640 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 0x55753ccb1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595111a640 1 -- 172.21.15.92:0/1885123805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753cbc7c90 con 0x55753c8d1390 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595191b640 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753cca4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595111a640 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753cca52d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f593c042040 tx=0x7f593c031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434927f6e299fc5e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f59357fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f59357fa640 1 -- 172.21.15.92:0/1885123805 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c044070 con 0x55753c8d1390 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f59357fa640 1 -- 172.21.15.92:0/1885123805 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f593c031810 con 0x55753c8d1390 2024-09-21T07:17:35.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f595a0f3740 1 -- 172.21.15.92:0/1885123805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f593c004040 con 0x55753c8d1390 2024-09-21T07:17:35.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.399+0000 7f59357fa640 1 -- 172.21.15.92:0/1885123805 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f593c056050 con 0x55753c8d1390 2024-09-21T07:17:35.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f595a0f3740 10 client.16989 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:35.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f595a0f3740 1 -- 172.21.15.92:0/1885123805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55753ccb3b60 con 0x55753c8d1390 2024-09-21T07:17:35.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f59357fa640 1 -- 172.21.15.92:0/1885123805 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f593c004040 con 0x55753c8d1390 2024-09-21T07:17:35.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f59357fa640 1 -- 172.21.15.92:0/1885123805 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f593c051030 con 0x55753c8d1390 2024-09-21T07:17:35.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f595a0f3740 10 client.16989 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:35.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f595a0f3740 10 client.16989 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:17:35.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f595a0f3740 20 client.16989 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:35.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f595a0f3740 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55753c8b09f0 0x55753ccb6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f595a0f3740 4 client.16989 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f595a0f3740 1 -- 172.21.15.92:0/1885123805 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55753cc11df0 con 0x55753c8b09f0 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.400+0000 7f595191b640 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55753c8b09f0 0x55753ccb6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.401+0000 7f595191b640 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55753c8b09f0 0x55753ccb6ec0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d67797fb315b0dae server_cookie=73903e483792d93e in_seq=0 out_seq=0 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.401+0000 7f59357fa640 10 client.16989 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.401+0000 7f59357fa640 1 -- 172.21.15.92:0/1885123805 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55753cc11df0 con 0x55753c8b09f0 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.401+0000 7f59357fa640 10 client.16989 handle_command_reply: tid=0 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.401+0000 7f595a0f3740 1 client.16989 shutdown 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 1 -- 172.21.15.92:0/1885123805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 msgr2=0x55753cca52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753cca52d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f593c042040 tx=0x7f593c031d20 comp rx=0 tx=0).stop 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 1 -- 172.21.15.92:0/1885123805 shutdown_connections 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55753c8b09f0 0x55753ccb6ec0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 0x55753ccb1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753cca52d0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f59357fa640 0 client.16989 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:17:35.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 1 --2- 172.21.15.92:0/1885123805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753cca4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 1 -- 172.21.15.92:0/1885123805 >> 172.21.15.92:0/1885123805 conn(0x55753c8e6460 msgr2=0x55753cc9c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:35.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 1 -- 172.21.15.92:0/1885123805 shutdown_connections 2024-09-21T07:17:35.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 1 -- 172.21.15.92:0/1885123805 wait complete. 2024-09-21T07:17:35.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.402+0000 7f595a0f3740 20 client.16989 trim_cache size 0 max 16384 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595a0f3740 1 Processor -- start 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595a0f3740 1 -- start start 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8c91b0 0x55753cca51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8d1390 0x55753cc9ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8f2070 0x55753cc96bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595a0f3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1b2fc0 con 0x55753c8c91b0 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595a0f3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1b4b00 con 0x55753c8d1390 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595a0f3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1b3690 con 0x55753c8f2070 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595191b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8c91b0 0x55753cca51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595191b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8c91b0 0x55753cca51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54126/0 (socket says 172.21.15.92:54126) 2024-09-21T07:17:35.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.415+0000 7f595191b640 1 -- 172.21.15.92:0/3790984530 learned_addr learned my addr 172.21.15.92:0/3790984530 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:35.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f595211c640 1 --2- 172.21.15.92:0/3790984530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8f2070 0x55753cc96bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f595111a640 1 --2- 172.21.15.92:0/3790984530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8d1390 0x55753cc9ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f595191b640 1 -- 172.21.15.92:0/3790984530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8f2070 msgr2=0x55753cc96bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:35.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f595191b640 1 --2- 172.21.15.92:0/3790984530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8f2070 0x55753cc96bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f595191b640 1 -- 172.21.15.92:0/3790984530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8d1390 msgr2=0x55753cc9ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:35.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f595191b640 1 --2- 172.21.15.92:0/3790984530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8d1390 0x55753cc9ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f595191b640 1 -- 172.21.15.92:0/3790984530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753cc9b990 con 0x55753c8c91b0 2024-09-21T07:17:35.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f595191b640 1 --2- 172.21.15.92:0/3790984530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8c91b0 0x55753cca51b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f594c077160 tx=0x7f5948013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740b71d0e68e98b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:35.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f59377fe640 1 -- 172.21.15.92:0/3790984530 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594802f070 con 0x55753c8c91b0 2024-09-21T07:17:35.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f59377fe640 1 -- 172.21.15.92:0/3790984530 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f594801d040 con 0x55753c8c91b0 2024-09-21T07:17:35.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.416+0000 7f59377fe640 1 -- 172.21.15.92:0/3790984530 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948014690 con 0x55753c8c91b0 2024-09-21T07:17:35.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 -- 172.21.15.92:0/3790984530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8c91b0 msgr2=0x55753cca51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:35.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 --2- 172.21.15.92:0/3790984530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8c91b0 0x55753cca51b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f594c077160 tx=0x7f5948013000 comp rx=0 tx=0).stop 2024-09-21T07:17:35.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 -- 172.21.15.92:0/3790984530 shutdown_connections 2024-09-21T07:17:35.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 --2- 172.21.15.92:0/3790984530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8f2070 0x55753cc96bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 --2- 172.21.15.92:0/3790984530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8d1390 0x55753cc9ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 --2- 172.21.15.92:0/3790984530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8c91b0 0x55753cca51b0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 -- 172.21.15.92:0/3790984530 >> 172.21.15.92:0/3790984530 conn(0x55753c8e6460 msgr2=0x55753cc9a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 -- 172.21.15.92:0/3790984530 shutdown_connections 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 -- 172.21.15.92:0/3790984530 wait complete. 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 -- start start 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.417+0000 7f595a0f3740 1 Processor -- start 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753ccb7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753ccb8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595a0f3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 0x55753ccb8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595a0f3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1b4430 con 0x55753c8d1390 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595a0f3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1b3d60 con 0x55753c8f2070 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595a0f3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1b0fa0 con 0x55753c8c91b0 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595a0f3740 10 client.0 _ll_register_callbacks cb 0x7f593c042070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595111a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753ccb8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595111a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753ccb8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54134/0 (socket says 172.21.15.92:54134) 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595111a640 1 -- 172.21.15.92:0/4208191246 learned_addr learned my addr 172.21.15.92:0/4208191246 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595191b640 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753ccb7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595111a640 1 -- 172.21.15.92:0/4208191246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 msgr2=0x55753ccb7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595111a640 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753ccb7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595111a640 1 -- 172.21.15.92:0/4208191246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 msgr2=0x55753ccb8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595211c640 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 0x55753ccb8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595111a640 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 0x55753ccb8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595111a640 1 -- 172.21.15.92:0/4208191246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753cd20740 con 0x55753c8d1390 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595191b640 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753ccb7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.418+0000 7f595211c640 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 0x55753ccb8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f595111a640 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753ccb8520 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f593c005d90 tx=0x7f593c003660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf7251c8d70bb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f59357fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f59357fa640 1 -- 172.21.15.92:0/4208191246 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c044070 con 0x55753c8d1390 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f59357fa640 1 -- 172.21.15.92:0/4208191246 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f593c0046c0 con 0x55753c8d1390 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f595a0f3740 1 -- 172.21.15.92:0/4208191246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f594801d040 con 0x55753c8d1390 2024-09-21T07:17:35.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f59357fa640 1 -- 172.21.15.92:0/4208191246 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f593c067050 con 0x55753c8d1390 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f595a0f3740 10 client.16995 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f595a0f3740 1 -- 172.21.15.92:0/4208191246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55753cd219c0 con 0x55753c8d1390 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f59357fa640 1 -- 172.21.15.92:0/4208191246 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f594801d040 con 0x55753c8d1390 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f59357fa640 1 -- 172.21.15.92:0/4208191246 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f593c062030 con 0x55753c8d1390 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f595a0f3740 10 client.16995 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f595a0f3740 10 client.16995 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f595a0f3740 20 client.16995 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f595a0f3740 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55753c885da0 0x55753cd241a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f595a0f3740 4 client.16995 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.419+0000 7f595a0f3740 1 -- 172.21.15.92:0/4208191246 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55753cc0d8a0 con 0x55753c885da0 2024-09-21T07:17:35.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.420+0000 7f595191b640 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55753c885da0 0x55753cd241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.420+0000 7f59357fa640 10 client.16995 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:17:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.420+0000 7f595191b640 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55753c885da0 0x55753cd241a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=140d30b70bbe101e server_cookie=1e0e3491f50248af in_seq=0 out_seq=0 2024-09-21T07:17:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f59357fa640 1 -- 172.21.15.92:0/4208191246 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55753cc0d8a0 con 0x55753c885da0 2024-09-21T07:17:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f59357fa640 10 client.16995 handle_command_reply: tid=0 2024-09-21T07:17:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 client.16995 shutdown 2024-09-21T07:17:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 -- 172.21.15.92:0/4208191246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 msgr2=0x55753ccb8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753ccb8520 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f593c005d90 tx=0x7f593c003660 comp rx=0 tx=0).stop 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 -- 172.21.15.92:0/4208191246 shutdown_connections 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55753c885da0 0x55753cd241a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55753c8f2070 0x55753ccb8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55753c8d1390 0x55753ccb8520 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 --2- 172.21.15.92:0/4208191246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55753c8c91b0 0x55753ccb7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f59357fa640 0 client.16995 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 -- 172.21.15.92:0/4208191246 >> 172.21.15.92:0/4208191246 conn(0x55753c8e6460 msgr2=0x55753cca6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 -- 172.21.15.92:0/4208191246 shutdown_connections 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 1 -- 172.21.15.92:0/4208191246 wait complete. 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f595a0f3740 20 client.16995 trim_cache size 0 max 16384 2024-09-21T07:17:35.426 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:17:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f5953b7f640 1 -- 172.21.15.92:0/968311184 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f59380b6680 msgr2=0x7f59380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f5953b7f640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f59380b6680 0x7f59380b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55753cc98320 tx=0x7f5948008040 comp rx=0 tx=0).stop 2024-09-21T07:17:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f5953b7f640 1 -- 172.21.15.92:0/968311184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c109e10 msgr2=0x7f594c076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:35.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.421+0000 7f5953b7f640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c109e10 0x7f594c076190 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f594400eaa0 tx=0x7f594400ef60 comp rx=0 tx=0).stop 2024-09-21T07:17:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.422+0000 7f5953b7f640 1 -- 172.21.15.92:0/968311184 shutdown_connections 2024-09-21T07:17:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.422+0000 7f5953b7f640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f59380b6680 0x7f59380b8b90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.422+0000 7f5953b7f640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594c109e10 0x7f594c076190 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.422+0000 7f5953b7f640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f594c1094c0 0x7f594c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.422+0000 7f5953b7f640 1 --2- 172.21.15.92:0/968311184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f594c103b80 0x7f594c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.422+0000 7f5953b7f640 1 -- 172.21.15.92:0/968311184 >> 172.21.15.92:0/968311184 conn(0x7f594c0ff5d0 msgr2=0x7f594c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.422+0000 7f5953b7f640 1 -- 172.21.15.92:0/968311184 shutdown_connections 2024-09-21T07:17:35.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:35.422+0000 7f5953b7f640 1 -- 172.21.15.92:0/968311184 wait complete. 2024-09-21T07:17:36.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:35 smithi092 ceph-mon[30987]: pgmap v475: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 112 MiB/s wr, 40 op/s 2024-09-21T07:17:36.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:35 smithi169 ceph-mon[33705]: pgmap v475: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 112 MiB/s wr, 40 op/s 2024-09-21T07:17:36.151 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:17:36.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:35 smithi175 ceph-mon[34064]: pgmap v475: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 112 MiB/s wr, 40 op/s 2024-09-21T07:17:36.433 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:36.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.967+0000 7fc41bc2d640 1 -- 172.21.15.92:0/1292221589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc414105380 msgr2=0x7fc41410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.967+0000 7fc41bc2d640 1 --2- 172.21.15.92:0/1292221589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc414105380 0x7fc41410d8d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc404009900 tx=0x7fc40402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.967+0000 7fc41bc2d640 1 -- 172.21.15.92:0/1292221589 shutdown_connections 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.967+0000 7fc41bc2d640 1 --2- 172.21.15.92:0/1292221589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc41410de60 0x7fc414110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.967+0000 7fc41bc2d640 1 --2- 172.21.15.92:0/1292221589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc414105380 0x7fc41410d8d0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.967+0000 7fc41bc2d640 1 --2- 172.21.15.92:0/1292221589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc414104a30 0x7fc414104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.967+0000 7fc41bc2d640 1 -- 172.21.15.92:0/1292221589 >> 172.21.15.92:0/1292221589 conn(0x7fc4140797b0 msgr2=0x7fc414079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.967+0000 7fc41bc2d640 1 -- 172.21.15.92:0/1292221589 shutdown_connections 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.967+0000 7fc41bc2d640 1 -- 172.21.15.92:0/1292221589 wait complete. 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.968+0000 7fc41bc2d640 1 Processor -- start 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.968+0000 7fc41bc2d640 1 -- start start 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.968+0000 7fc41bc2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc414104a30 0x7fc41419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.968+0000 7fc41bc2d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc414105380 0x7fc41419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.968+0000 7fc41bc2d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc41410de60 0x7fc41419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.968+0000 7fc41bc2d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc414113910 con 0x7fc414104a30 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.968+0000 7fc41bc2d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc414113790 con 0x7fc41410de60 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.968+0000 7fc41bc2d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc414113a90 con 0x7fc414105380 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc4199c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc414104a30 0x7fc41419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc4199c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc414104a30 0x7fc41419a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54154/0 (socket says 172.21.15.92:54154) 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc4199c9640 1 -- 172.21.15.92:0/699427251 learned_addr learned my addr 172.21.15.92:0/699427251 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc4191c8640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc414105380 0x7fc41419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc41410de60 0x7fc41419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc4199c9640 1 -- 172.21.15.92:0/699427251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc414105380 msgr2=0x7fc41419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc4199c9640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc414105380 0x7fc41419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc4199c9640 1 -- 172.21.15.92:0/699427251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc41410de60 msgr2=0x7fc41419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc4199c9640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc41410de60 0x7fc41419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc4199c9640 1 -- 172.21.15.92:0/699427251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4141a0250 con 0x7fc414104a30 2024-09-21T07:17:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc4199c9640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc414104a30 0x7fc41419a3a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c920 tx=0x7fc41000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.969+0000 7fc40affd640 1 -- 172.21.15.92:0/699427251 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc410007c70 con 0x7fc414104a30 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.970+0000 7fc40affd640 1 -- 172.21.15.92:0/699427251 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc410007e10 con 0x7fc414104a30 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.970+0000 7fc40affd640 1 -- 172.21.15.92:0/699427251 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc410018710 con 0x7fc414104a30 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.970+0000 7fc41bc2d640 1 -- 172.21.15.92:0/699427251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4141a0540 con 0x7fc414104a30 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.970+0000 7fc41bc2d640 1 -- 172.21.15.92:0/699427251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4141a0a00 con 0x7fc414104a30 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.972+0000 7fc4221a1740 1 Processor -- start 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4221a1740 1 -- start start 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc40affd640 1 -- 172.21.15.92:0/699427251 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fc4100188b0 con 0x7fc414104a30 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 0x559bf50966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cc61b0 0x559bf5096be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cce390 0x559bf5097120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4221a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559bf500cea0 con 0x559bf4cce390 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4221a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559bf4ffc2d0 con 0x559bf4cef070 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4221a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559bf50000e0 con 0x559bf4cc61b0 2024-09-21T07:17:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4191c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cce390 0x559bf5097120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4191c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cce390 0x559bf5097120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54170/0 (socket says 172.21.15.92:54170) 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4191c8640 1 -- 172.21.15.92:0/1621438484 learned_addr learned my addr 172.21.15.92:0/1621438484 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4199c9640 1 --2- 172.21.15.92:0/1621438484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cc61b0 0x559bf5096be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/1621438484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 0x559bf50966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4191c8640 1 -- 172.21.15.92:0/1621438484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cc61b0 msgr2=0x559bf5096be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4191c8640 1 --2- 172.21.15.92:0/1621438484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cc61b0 0x559bf5096be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4191c8640 1 -- 172.21.15.92:0/1621438484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 msgr2=0x559bf50966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4191c8640 1 --2- 172.21.15.92:0/1621438484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 0x559bf50966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.973+0000 7fc4191c8640 1 -- 172.21.15.92:0/1621438484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf4d5a650 con 0x559bf4cce390 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.974+0000 7fc4191c8640 1 --2- 172.21.15.92:0/1621438484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cce390 0x559bf5097120 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc404000c00 tx=0x7fc404031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582bdb76edfcb670 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.974+0000 7fc40affd640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4000b66b0 0x7fc4000b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.974+0000 7fc3fffff640 1 -- 172.21.15.92:0/1621438484 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404035030 con 0x559bf4cce390 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.974+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/1621438484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 0x559bf50966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.974+0000 7fc3fffff640 1 -- 172.21.15.92:0/1621438484 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc404040070 con 0x559bf4cce390 2024-09-21T07:17:36.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.974+0000 7fc3fffff640 1 -- 172.21.15.92:0/1621438484 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404003a80 con 0x559bf4cce390 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.974+0000 7fc40affd640 1 -- 172.21.15.92:0/699427251 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc4100e7bf0 con 0x7fc414104a30 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.974+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4000b66b0 0x7fc4000b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.975+0000 7fc4221a1740 1 -- 172.21.15.92:0/1621438484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cce390 msgr2=0x559bf5097120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.975+0000 7fc4221a1740 1 --2- 172.21.15.92:0/1621438484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cce390 0x559bf5097120 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc404000c00 tx=0x7fc404031dc0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.975+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4000b66b0 0x7fc4000b8bc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc40c007f70 tx=0x7fc40c007520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.975+0000 7fc4221a1740 1 -- 172.21.15.92:0/1621438484 shutdown_connections 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.975+0000 7fc4221a1740 1 --2- 172.21.15.92:0/1621438484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cce390 0x559bf5097120 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.975+0000 7fc4221a1740 1 --2- 172.21.15.92:0/1621438484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cc61b0 0x559bf5096be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.975+0000 7fc4221a1740 1 --2- 172.21.15.92:0/1621438484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 0x559bf50966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.975+0000 7fc4221a1740 1 -- 172.21.15.92:0/1621438484 >> 172.21.15.92:0/1621438484 conn(0x559bf4ce3460 msgr2=0x559bf5094590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.975+0000 7fc4221a1740 1 -- 172.21.15.92:0/1621438484 shutdown_connections 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.975+0000 7fc4221a1740 1 -- 172.21.15.92:0/1621438484 wait complete. 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.976+0000 7fc4221a1740 1 -- start start 2024-09-21T07:17:36.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.976+0000 7fc4221a1740 1 Processor -- start 2024-09-21T07:17:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.976+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cc61b0 0x559bf50a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.976+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cce390 0x559bf50a2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.976+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cef070 0x559bf50ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4221a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559bf4e5d700 con 0x559bf4cef070 2024-09-21T07:17:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4221a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559bf4f97160 con 0x559bf4cc61b0 2024-09-21T07:17:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4221a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559bf50a4e20 con 0x559bf4cce390 2024-09-21T07:17:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4221a1740 10 client.0 _ll_register_callbacks cb 0x559bf4fb09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc41a1ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cef070 0x559bf50ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4199c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cc61b0 0x559bf50a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc41a1ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cef070 0x559bf50ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54176/0 (socket says 172.21.15.92:54176) 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc41a1ca640 1 -- 172.21.15.92:0/739206008 learned_addr learned my addr 172.21.15.92:0/739206008 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4191c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cce390 0x559bf50a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4199c9640 1 -- 172.21.15.92:0/739206008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cce390 msgr2=0x559bf50a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4199c9640 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cce390 0x559bf50a2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4199c9640 1 -- 172.21.15.92:0/739206008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cef070 msgr2=0x559bf50ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4199c9640 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cef070 0x559bf50ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4199c9640 1 -- 172.21.15.92:0/739206008 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf4fc4c90 con 0x559bf4cc61b0 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc4199c9640 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cc61b0 0x559bf50a1d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc4100e4fa0 tx=0x7fc41000a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58600e78b32d7b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc3fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.977+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/739206008 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4100ad470 con 0x559bf4cc61b0 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc4221a1740 1 -- 172.21.15.92:0/739206008 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc404040070 con 0x559bf4cc61b0 2024-09-21T07:17:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/739206008 <== mon.2 v2:172.21.15.169:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc410018da0 con 0x559bf4cc61b0 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/739206008 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc4100ace10 con 0x559bf4cc61b0 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc4221a1740 10 client.26138 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc4221a1740 1 -- 172.21.15.92:0/739206008 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559bf50b0be0 con 0x559bf4cc61b0 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/739206008 <== mon.2 v2:172.21.15.169:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc404040070 con 0x559bf4cc61b0 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/739206008 <== mon.2 v2:172.21.15.169:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc4100a8ff0 con 0x559bf4cc61b0 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc4221a1740 10 client.26138 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc4221a1740 10 client.26138 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc4221a1740 20 client.26138 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc4221a1740 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x559bf4cad9f0 0x559bf50b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc4221a1740 4 client.26138 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.978+0000 7fc4221a1740 1 -- 172.21.15.92:0/739206008 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bf500edf0 con 0x559bf4cad9f0 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.979+0000 7fc4191c8640 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x559bf4cad9f0 0x559bf50b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.979+0000 7fc4191c8640 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x559bf4cad9f0 0x559bf50b4000 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bb533fd6bfbe467d server_cookie=e4de1d56d13b7b66 in_seq=0 out_seq=0 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.979+0000 7fc3fd7fa640 10 client.26138 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:17:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/739206008 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559bf500edf0 con 0x559bf4cad9f0 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc3fd7fa640 10 client.26138 handle_command_reply: tid=0 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 client.26138 shutdown 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 -- 172.21.15.92:0/739206008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cc61b0 msgr2=0x559bf50a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cc61b0 0x559bf50a1d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc4100e4fa0 tx=0x7fc41000a620 comp rx=0 tx=0).stop 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 -- 172.21.15.92:0/739206008 shutdown_connections 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x559bf4cad9f0 0x559bf50b4000 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cef070 0x559bf50ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cce390 0x559bf50a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 --2- 172.21.15.92:0/739206008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cc61b0 0x559bf50a1d50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc3fd7fa640 0 client.26138 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 -- 172.21.15.92:0/739206008 >> 172.21.15.92:0/739206008 conn(0x559bf4ce3460 msgr2=0x559bf5099880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 -- 172.21.15.92:0/739206008 shutdown_connections 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 1 -- 172.21.15.92:0/739206008 wait complete. 2024-09-21T07:17:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.980+0000 7fc4221a1740 20 client.26138 trim_cache size 0 max 16384 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4221a1740 1 Processor -- start 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4221a1740 1 -- start start 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf5098090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cce390 0x559bf50a3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cef070 0x559bf50ae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4221a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141aeaa0 con 0x559bf4cc61b0 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4221a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141b05e0 con 0x559bf4cce390 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4221a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141af170 con 0x559bf4cef070 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4199c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf5098090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4199c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf5098090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54188/0 (socket says 172.21.15.92:54188) 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc4199c9640 1 -- 172.21.15.92:0/2239602995 learned_addr learned my addr 172.21.15.92:0/2239602995 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.994+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cef070 0x559bf50ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc4191c8640 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cce390 0x559bf50a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc41a1ca640 1 -- 172.21.15.92:0/2239602995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cce390 msgr2=0x559bf50a3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cce390 0x559bf50a3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc41a1ca640 1 -- 172.21.15.92:0/2239602995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 msgr2=0x559bf5098090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf5098090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc41a1ca640 1 -- 172.21.15.92:0/2239602995 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf509c9d0 con 0x559bf4cef070 2024-09-21T07:17:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc4191c8640 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cce390 0x559bf50a3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc4199c9640 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf5098090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:17:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cef070 0x559bf50ae010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0077f0 tx=0x7fc40c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10d0f6d94ab8fa46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc3ff7fe640 1 -- 172.21.15.92:0/2239602995 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c004440 con 0x559bf4cef070 2024-09-21T07:17:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc3ff7fe640 1 -- 172.21.15.92:0/2239602995 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc40c0045e0 con 0x559bf4cef070 2024-09-21T07:17:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.995+0000 7fc3ff7fe640 1 -- 172.21.15.92:0/2239602995 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c01d670 con 0x559bf4cef070 2024-09-21T07:17:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.996+0000 7fc4221a1740 1 -- 172.21.15.92:0/2239602995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cef070 msgr2=0x559bf50ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.996+0000 7fc4221a1740 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cef070 0x559bf50ae010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0077f0 tx=0x7fc40c014000 comp rx=0 tx=0).stop 2024-09-21T07:17:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.996+0000 7fc4221a1740 1 -- 172.21.15.92:0/2239602995 shutdown_connections 2024-09-21T07:17:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.996+0000 7fc4221a1740 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cef070 0x559bf50ae010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.996+0000 7fc4221a1740 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cce390 0x559bf50a3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.996+0000 7fc4221a1740 1 --2- 172.21.15.92:0/2239602995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf5098090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.996+0000 7fc4221a1740 1 -- 172.21.15.92:0/2239602995 >> 172.21.15.92:0/2239602995 conn(0x559bf4ce3460 msgr2=0x559bf50a3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.997+0000 7fc4221a1740 1 -- 172.21.15.92:0/2239602995 shutdown_connections 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.997+0000 7fc4221a1740 1 -- 172.21.15.92:0/2239602995 wait complete. 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.997+0000 7fc4221a1740 1 -- start start 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.997+0000 7fc4221a1740 1 Processor -- start 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf50a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cce390 0x559bf50a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4221a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 0x559bf511d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4221a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141aff10 con 0x559bf4cc61b0 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4221a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141af840 con 0x559bf4cef070 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4221a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141aca80 con 0x559bf4cce390 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4199c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf50a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4221a1740 10 client.0 _ll_register_callbacks cb 0x7fc41000cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4199c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf50a64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54204/0 (socket says 172.21.15.92:54204) 2024-09-21T07:17:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4199c9640 1 -- 172.21.15.92:0/2616704243 learned_addr learned my addr 172.21.15.92:0/2616704243 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:37.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 0x559bf511d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:37.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4191c8640 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cce390 0x559bf50a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:37.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4199c9640 1 -- 172.21.15.92:0/2616704243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cce390 msgr2=0x559bf50a6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:37.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4199c9640 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cce390 0x559bf50a6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4199c9640 1 -- 172.21.15.92:0/2616704243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 msgr2=0x559bf511d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:37.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4199c9640 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 0x559bf511d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc4199c9640 1 -- 172.21.15.92:0/2616704243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf511df00 con 0x559bf4cc61b0 2024-09-21T07:17:37.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.998+0000 7fc41a1ca640 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 0x559bf511d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:17:37.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc4199c9640 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf50a64a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc4100e7fe0 tx=0x7fc4100a9ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5095cfe674b26563 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:37.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc3fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:37.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/2616704243 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41005c070 con 0x559bf4cc61b0 2024-09-21T07:17:37.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/2616704243 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc410018da0 con 0x559bf4cc61b0 2024-09-21T07:17:37.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc4221a1740 1 -- 172.21.15.92:0/2616704243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc40c0045e0 con 0x559bf4cc61b0 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/2616704243 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc4100acff0 con 0x559bf4cc61b0 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc4221a1740 10 client.17013 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc4221a1740 1 -- 172.21.15.92:0/2616704243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559bf511f090 con 0x559bf4cc61b0 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/2616704243 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc40c0045e0 con 0x559bf4cc61b0 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/2616704243 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc4100ac370 con 0x559bf4cc61b0 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc4221a1740 10 client.17013 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc4221a1740 10 client.17013 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc4221a1740 20 client.17013 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:36.999+0000 7fc4221a1740 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x559bf4c82da0 0x559bf5121880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.000+0000 7fc4221a1740 4 client.17013 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.000+0000 7fc4221a1740 1 -- 172.21.15.92:0/2616704243 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559bf500a8a0 con 0x559bf4c82da0 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.000+0000 7fc4191c8640 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x559bf4c82da0 0x559bf5121880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.000+0000 7fc3fd7fa640 10 client.17013 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:17:37.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.000+0000 7fc4191c8640 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x559bf4c82da0 0x559bf5121880 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d9909f1ee53e4b9e server_cookie=e5b3b397dadc2e0b in_seq=0 out_seq=0 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc3fd7fa640 1 -- 172.21.15.92:0/2616704243 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559bf500a8a0 con 0x559bf4c82da0 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc3fd7fa640 10 client.17013 handle_command_reply: tid=0 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 client.17013 shutdown 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 -- 172.21.15.92:0/2616704243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 msgr2=0x559bf50a64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf50a64a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc4100e7fe0 tx=0x7fc4100a9ba0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 -- 172.21.15.92:0/2616704243 shutdown_connections 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bf4cef070 0x559bf511d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bf4cce390 0x559bf50a6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x559bf4c82da0 0x559bf5121880 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 --2- 172.21.15.92:0/2616704243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559bf4cc61b0 0x559bf50a64a0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc3fd7fa640 0 client.17013 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 -- 172.21.15.92:0/2616704243 >> 172.21.15.92:0/2616704243 conn(0x559bf4ce3460 msgr2=0x559bf5097e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 -- 172.21.15.92:0/2616704243 shutdown_connections 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 1 -- 172.21.15.92:0/2616704243 wait complete. 2024-09-21T07:17:37.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.001+0000 7fc4221a1740 20 client.17013 trim_cache size 0 max 16384 2024-09-21T07:17:37.007 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:17:37.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 -- 172.21.15.92:0/699427251 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4000b66b0 msgr2=0x7fc4000b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4000b66b0 0x7fc4000b8bc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc40c007f70 tx=0x7fc40c007520 comp rx=0 tx=0).stop 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 -- 172.21.15.92:0/699427251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc414104a30 msgr2=0x7fc41419a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc414104a30 0x7fc41419a3a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c920 tx=0x7fc41000cde0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 -- 172.21.15.92:0/699427251 shutdown_connections 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4000b66b0 0x7fc4000b8bc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc41410de60 0x7fc41419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc414105380 0x7fc41419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 --2- 172.21.15.92:0/699427251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc414104a30 0x7fc41419a3a0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 -- 172.21.15.92:0/699427251 >> 172.21.15.92:0/699427251 conn(0x7fc4140797b0 msgr2=0x7fc414100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 -- 172.21.15.92:0/699427251 shutdown_connections 2024-09-21T07:17:37.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:37.002+0000 7fc41bc2d640 1 -- 172.21.15.92:0/699427251 wait complete. 2024-09-21T07:17:37.195 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:17:37.195 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 readers = 7769969.00 kB/sec 2024-09-21T07:17:37.195 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 readers = 7768576.36 kB/sec 2024-09-21T07:17:37.195 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 7769969.00 kB/sec 2024-09-21T07:17:37.196 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 7769969.00 kB/sec 2024-09-21T07:17:37.196 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 7769969.00 kB/sec 2024-09-21T07:17:37.196 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 10485760.00 kB 2024-09-21T07:17:37.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:17:38.228 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.504+0000 7fa04cbed640 1 -- 172.21.15.92:0/3949303218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa048103ad0 msgr2=0x7fa048103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.504+0000 7fa04cbed640 1 --2- 172.21.15.92:0/3949303218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa048103ad0 0x7fa048103ee0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa038009900 tx=0x7fa03802a410 comp rx=0 tx=0).stop 2024-09-21T07:17:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.504+0000 7fa04cbed640 1 -- 172.21.15.92:0/3949303218 shutdown_connections 2024-09-21T07:17:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.504+0000 7fa04cbed640 1 --2- 172.21.15.92:0/3949303218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048109d50 0x7fa048110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.504+0000 7fa04cbed640 1 --2- 172.21.15.92:0/3949303218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa048109400 0x7fa048109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.504+0000 7fa04cbed640 1 --2- 172.21.15.92:0/3949303218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa048103ad0 0x7fa048103ee0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.504+0000 7fa04cbed640 1 -- 172.21.15.92:0/3949303218 >> 172.21.15.92:0/3949303218 conn(0x7fa0480ff510 msgr2=0x7fa048101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.504+0000 7fa04cbed640 1 -- 172.21.15.92:0/3949303218 shutdown_connections 2024-09-21T07:17:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.504+0000 7fa04cbed640 1 -- 172.21.15.92:0/3949303218 wait complete. 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa04cbed640 1 Processor -- start 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa04cbed640 1 -- start start 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa04cbed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa048103ad0 0x7fa048075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa04cbed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048109400 0x7fa048075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa04cbed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa048109d50 0x7fa048076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa04cbed640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa048113920 con 0x7fa048109d50 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa04cbed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa0481137a0 con 0x7fa048103ad0 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa04cbed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa048113aa0 con 0x7fa048109400 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa046d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa048109d50 0x7fa048076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa046d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa048109d50 0x7fa048076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54226/0 (socket says 172.21.15.92:54226) 2024-09-21T07:17:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa046d9d640 1 -- 172.21.15.92:0/2514946034 learned_addr learned my addr 172.21.15.92:0/2514946034 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa045d9b640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048109400 0x7fa048075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa04659c640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa048103ad0 0x7fa048075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa046d9d640 1 -- 172.21.15.92:0/2514946034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048109400 msgr2=0x7fa048075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa046d9d640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048109400 0x7fa048075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa046d9d640 1 -- 172.21.15.92:0/2514946034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa048103ad0 msgr2=0x7fa048075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa046d9d640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa048103ad0 0x7fa048075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.505+0000 7fa046d9d640 1 -- 172.21.15.92:0/2514946034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0481a8690 con 0x7fa048109d50 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.506+0000 7fa046d9d640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa048109d50 0x7fa048076190 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa04000eaa0 tx=0x7fa04000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.506+0000 7fa0377fe640 1 -- 172.21.15.92:0/2514946034 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040004d20 con 0x7fa048109d50 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.506+0000 7fa04cbed640 1 -- 172.21.15.92:0/2514946034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0481a8980 con 0x7fa048109d50 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.506+0000 7fa0377fe640 1 -- 172.21.15.92:0/2514946034 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa040005020 con 0x7fa048109d50 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.506+0000 7fa0377fe640 1 -- 172.21.15.92:0/2514946034 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0400116d0 con 0x7fa048109d50 2024-09-21T07:17:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.506+0000 7fa04cbed640 1 -- 172.21.15.92:0/2514946034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0481a8fa0 con 0x7fa048109d50 2024-09-21T07:17:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.509+0000 7fa0377fe640 1 -- 172.21.15.92:0/2514946034 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fa04000caf0 con 0x7fa048109d50 2024-09-21T07:17:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.509+0000 7fa053c37740 1 Processor -- start 2024-09-21T07:17:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.509+0000 7fa053c37740 1 -- start start 2024-09-21T07:17:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa053c37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 0x5637f98509b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa053c37740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94822f0 0x5637f9850ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa053c37740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 0x5637f9851430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa053c37740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5637f97c56f0 con 0x5637f948a4d0 2024-09-21T07:17:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa053c37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5637f97b4b20 con 0x5637f94ab1b0 2024-09-21T07:17:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa053c37740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5637f97b8930 con 0x5637f94822f0 2024-09-21T07:17:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa0377fe640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0300b66b0 0x7fa0300b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa045d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 0x5637f9851430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa045d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 0x5637f98509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa045d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 0x5637f98509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:52588/0 (socket says 172.21.15.92:52588) 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa045d9b640 1 -- 172.21.15.92:0/447501766 learned_addr learned my addr 172.21.15.92:0/447501766 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa04659c640 1 --2- 172.21.15.92:0/447501766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94822f0 0x5637f9850ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa046d9d640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0300b66b0 0x7fa0300b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa0377fe640 1 -- 172.21.15.92:0/2514946034 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa0400e7c10 con 0x7fa048109d50 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa045d9b640 1 -- 172.21.15.92:0/447501766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94822f0 msgr2=0x5637f9850ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa045d9b640 1 --2- 172.21.15.92:0/447501766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94822f0 0x5637f9850ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa045d9b640 1 -- 172.21.15.92:0/447501766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 msgr2=0x5637f9851430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa045d9b640 1 --2- 172.21.15.92:0/447501766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 0x5637f9851430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.510+0000 7fa045d9b640 1 -- 172.21.15.92:0/447501766 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f977a530 con 0x5637f94ab1b0 2024-09-21T07:17:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.511+0000 7fa046d9d640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0300b66b0 0x7fa0300b8bc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa0400e5070 tx=0x7fa040009f60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.529+0000 7fa045d9b640 1 --2- 172.21.15.92:0/447501766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 0x5637f98509b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa03c017730 tx=0x7fa03c009110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e28c570fcd21d37f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.529+0000 7fa034ff9640 1 -- 172.21.15.92:0/447501766 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c01c020 con 0x5637f94ab1b0 2024-09-21T07:17:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.529+0000 7fa034ff9640 1 -- 172.21.15.92:0/447501766 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa03c015df0 con 0x5637f94ab1b0 2024-09-21T07:17:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.529+0000 7fa034ff9640 1 -- 172.21.15.92:0/447501766 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c018ac0 con 0x5637f94ab1b0 2024-09-21T07:17:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.530+0000 7fa053c37740 1 -- 172.21.15.92:0/447501766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 msgr2=0x5637f98509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.530+0000 7fa053c37740 1 --2- 172.21.15.92:0/447501766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 0x5637f98509b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa03c017730 tx=0x7fa03c009110 comp rx=0 tx=0).stop 2024-09-21T07:17:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.530+0000 7fa053c37740 1 -- 172.21.15.92:0/447501766 shutdown_connections 2024-09-21T07:17:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.530+0000 7fa053c37740 1 --2- 172.21.15.92:0/447501766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 0x5637f9851430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.530+0000 7fa053c37740 1 --2- 172.21.15.92:0/447501766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94822f0 0x5637f9850ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.530+0000 7fa053c37740 1 --2- 172.21.15.92:0/447501766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 0x5637f98509b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.530+0000 7fa053c37740 1 -- 172.21.15.92:0/447501766 >> 172.21.15.92:0/447501766 conn(0x5637f949f300 msgr2=0x5637f984e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.548+0000 7fa053c37740 1 -- 172.21.15.92:0/447501766 shutdown_connections 2024-09-21T07:17:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.548+0000 7fa053c37740 1 -- 172.21.15.92:0/447501766 wait complete. 2024-09-21T07:17:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa053c37740 1 -- start start 2024-09-21T07:17:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa053c37740 1 Processor -- start 2024-09-21T07:17:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa053c37740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94822f0 0x5637f985c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa053c37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f948a4d0 0x5637f985c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa053c37740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94ab1b0 0x5637f9868420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa053c37740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5637f96ecab0 con 0x5637f94ab1b0 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa053c37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5637f975a730 con 0x5637f948a4d0 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa053c37740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5637f985f130 con 0x5637f94822f0 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa053c37740 10 client.0 _ll_register_callbacks cb 0x5637f97ae6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa045d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94ab1b0 0x5637f9868420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa045d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94ab1b0 0x5637f9868420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54238/0 (socket says 172.21.15.92:54238) 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa045d9b640 1 -- 172.21.15.92:0/2798707540 learned_addr learned my addr 172.21.15.92:0/2798707540 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa04659c640 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f948a4d0 0x5637f985c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa045d9b640 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94822f0 0x5637f985c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa045d9b640 1 -- 172.21.15.92:0/2798707540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94822f0 msgr2=0x5637f985c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa045d9b640 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94822f0 0x5637f985c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa045d9b640 1 -- 172.21.15.92:0/2798707540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f948a4d0 msgr2=0x5637f985c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa045d9b640 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f948a4d0 0x5637f985c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.549+0000 7fa045d9b640 1 -- 172.21.15.92:0/2798707540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f9516790 con 0x5637f94ab1b0 2024-09-21T07:17:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa045d9b640 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94ab1b0 0x5637f9868420 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009320 tx=0x7fa03c009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e4bf3fd5fe1732 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa02dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa02dffb640 1 -- 172.21.15.92:0/2798707540 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c01c040 con 0x5637f94ab1b0 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa02dffb640 1 -- 172.21.15.92:0/2798707540 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa03c015760 con 0x5637f94ab1b0 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa053c37740 1 -- 172.21.15.92:0/2798707540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa03c015df0 con 0x5637f94ab1b0 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa02dffb640 1 -- 172.21.15.92:0/2798707540 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa03c015960 con 0x5637f94ab1b0 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa053c37740 10 client.17025 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa053c37740 1 -- 172.21.15.92:0/2798707540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5637f958f620 con 0x5637f94ab1b0 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa02dffb640 1 -- 172.21.15.92:0/2798707540 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa03c015df0 con 0x5637f94ab1b0 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa02dffb640 1 -- 172.21.15.92:0/2798707540 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa03c0219b0 con 0x5637f94ab1b0 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa053c37740 10 client.17025 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.550+0000 7fa053c37740 10 client.17025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.551+0000 7fa053c37740 20 client.17025 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.551+0000 7fa053c37740 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5637f9469d80 0x5637f986e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.551+0000 7fa053c37740 4 client.17025 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.551+0000 7fa053c37740 1 -- 172.21.15.92:0/2798707540 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637f97c7640 con 0x5637f9469d80 2024-09-21T07:17:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.551+0000 7fa04659c640 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5637f9469d80 0x5637f986e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.551+0000 7fa02dffb640 10 client.17025 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:38.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.551+0000 7fa04659c640 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5637f9469d80 0x5637f986e000 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e3a7026844933e server_cookie=a75290269da41773 in_seq=0 out_seq=0 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa02dffb640 1 -- 172.21.15.92:0/2798707540 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637f97c7640 con 0x5637f9469d80 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa02dffb640 10 client.17025 handle_command_reply: tid=0 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa053c37740 1 client.17025 shutdown 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa053c37740 1 -- 172.21.15.92:0/2798707540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94ab1b0 msgr2=0x5637f9868420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa053c37740 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94ab1b0 0x5637f9868420 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009320 tx=0x7fa03c009f20 comp rx=0 tx=0).stop 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa053c37740 1 -- 172.21.15.92:0/2798707540 shutdown_connections 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa053c37740 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5637f9469d80 0x5637f986e000 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa053c37740 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94ab1b0 0x5637f9868420 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa053c37740 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f948a4d0 0x5637f985c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa053c37740 1 --2- 172.21.15.92:0/2798707540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94822f0 0x5637f985c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa02dffb640 0 client.17025 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.552+0000 7fa053c37740 1 -- 172.21.15.92:0/2798707540 >> 172.21.15.92:0/2798707540 conn(0x5637f949f300 msgr2=0x5637f98519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.553+0000 7fa053c37740 1 -- 172.21.15.92:0/2798707540 shutdown_connections 2024-09-21T07:17:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.553+0000 7fa053c37740 1 -- 172.21.15.92:0/2798707540 wait complete. 2024-09-21T07:17:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.553+0000 7fa053c37740 20 client.17025 trim_cache size 0 max 16384 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa053c37740 1 Processor -- start 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa053c37740 1 -- start start 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa053c37740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94822f0 0x5637f98577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa053c37740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f948a4d0 0x5637f98523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa053c37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 0x5637f985dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa053c37740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa0481b3180 con 0x5637f94822f0 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa053c37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa0481b4cc0 con 0x5637f94ab1b0 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa053c37740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0481b3850 con 0x5637f948a4d0 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa045d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94822f0 0x5637f98577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa045d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94822f0 0x5637f98577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54242/0 (socket says 172.21.15.92:54242) 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa045d9b640 1 -- 172.21.15.92:0/4139725951 learned_addr learned my addr 172.21.15.92:0/4139725951 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa045d9b640 1 -- 172.21.15.92:0/4139725951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f948a4d0 msgr2=0x5637f98523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa045d9b640 1 --2- 172.21.15.92:0/4139725951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f948a4d0 0x5637f98523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa045d9b640 1 -- 172.21.15.92:0/4139725951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 msgr2=0x5637f985dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa045d9b640 1 --2- 172.21.15.92:0/4139725951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 0x5637f985dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa045d9b640 1 -- 172.21.15.92:0/4139725951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f9853250 con 0x5637f94822f0 2024-09-21T07:17:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.567+0000 7fa045d9b640 1 --2- 172.21.15.92:0/4139725951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94822f0 0x5637f98577f0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00a010 tx=0x7fa03c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eada1595fc19c265 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa02ffff640 1 -- 172.21.15.92:0/4139725951 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c01c040 con 0x5637f94822f0 2024-09-21T07:17:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa02ffff640 1 -- 172.21.15.92:0/4139725951 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa03c018660 con 0x5637f94822f0 2024-09-21T07:17:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa02ffff640 1 -- 172.21.15.92:0/4139725951 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c030b10 con 0x5637f94822f0 2024-09-21T07:17:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa053c37740 1 -- 172.21.15.92:0/4139725951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94822f0 msgr2=0x5637f98577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa053c37740 1 --2- 172.21.15.92:0/4139725951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94822f0 0x5637f98577f0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00a010 tx=0x7fa03c009190 comp rx=0 tx=0).stop 2024-09-21T07:17:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa053c37740 1 -- 172.21.15.92:0/4139725951 shutdown_connections 2024-09-21T07:17:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa053c37740 1 --2- 172.21.15.92:0/4139725951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94ab1b0 0x5637f985dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa053c37740 1 --2- 172.21.15.92:0/4139725951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f948a4d0 0x5637f98523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa053c37740 1 --2- 172.21.15.92:0/4139725951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f94822f0 0x5637f98577f0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa053c37740 1 -- 172.21.15.92:0/4139725951 >> 172.21.15.92:0/4139725951 conn(0x5637f949f300 msgr2=0x5637f985d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.568+0000 7fa053c37740 1 -- 172.21.15.92:0/4139725951 shutdown_connections 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa053c37740 1 -- 172.21.15.92:0/4139725951 wait complete. 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa053c37740 1 -- start start 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa053c37740 1 Processor -- start 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa053c37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94822f0 0x5637f986e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa053c37740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 0x5637f986ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa053c37740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94ab1b0 0x5637f98d6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa053c37740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa0481b45f0 con 0x5637f948a4d0 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa053c37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa0481b3f20 con 0x5637f94822f0 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa053c37740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0481b1160 con 0x5637f94ab1b0 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa053c37740 10 client.0 _ll_register_callbacks cb 0x7fa03c009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa04659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 0x5637f986ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa04659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 0x5637f986ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54250/0 (socket says 172.21.15.92:54250) 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa04659c640 1 -- 172.21.15.92:0/576881299 learned_addr learned my addr 172.21.15.92:0/576881299 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa04659c640 1 -- 172.21.15.92:0/576881299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94ab1b0 msgr2=0x5637f98d6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.569+0000 7fa04659c640 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94ab1b0 0x5637f98d6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa04659c640 1 -- 172.21.15.92:0/576881299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94822f0 msgr2=0x5637f986e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa04659c640 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94822f0 0x5637f986e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa04659c640 1 -- 172.21.15.92:0/576881299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f98d6d30 con 0x5637f948a4d0 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa04659c640 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 0x5637f986ed40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa038000c00 tx=0x7fa038004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f33aa7ef530b48e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa02dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa02dffb640 1 -- 172.21.15.92:0/576881299 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038035040 con 0x5637f948a4d0 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa02dffb640 1 -- 172.21.15.92:0/576881299 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa038005240 con 0x5637f948a4d0 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa053c37740 1 -- 172.21.15.92:0/576881299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa03c018660 con 0x5637f948a4d0 2024-09-21T07:17:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa02dffb640 1 -- 172.21.15.92:0/576881299 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa038053050 con 0x5637f948a4d0 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa053c37740 10 client.17031 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa053c37740 1 -- 172.21.15.92:0/576881299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5637f98d8030 con 0x5637f948a4d0 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa02dffb640 1 -- 172.21.15.92:0/576881299 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa03c018660 con 0x5637f948a4d0 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa02dffb640 1 -- 172.21.15.92:0/576881299 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa0380035f0 con 0x5637f948a4d0 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa053c37740 10 client.17031 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa053c37740 10 client.17031 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa053c37740 20 client.17031 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa053c37740 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5637f943f1c0 0x5637f98da840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa053c37740 4 client.17031 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.570+0000 7fa053c37740 1 -- 172.21.15.92:0/576881299 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5637f97c30f0 con 0x5637f943f1c0 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.571+0000 7fa045d9b640 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5637f943f1c0 0x5637f98da840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.571+0000 7fa02dffb640 10 client.17031 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.571+0000 7fa045d9b640 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5637f943f1c0 0x5637f98da840 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccfddbed28ef3c44 server_cookie=f842f12204c1ea9e in_seq=0 out_seq=0 2024-09-21T07:17:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa02dffb640 1 -- 172.21.15.92:0/576881299 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5637f97c30f0 con 0x5637f943f1c0 2024-09-21T07:17:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa02dffb640 10 client.17031 handle_command_reply: tid=0 2024-09-21T07:17:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 client.17031 shutdown 2024-09-21T07:17:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 -- 172.21.15.92:0/576881299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 msgr2=0x5637f986ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 0x5637f986ed40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa038000c00 tx=0x7fa038004160 comp rx=0 tx=0).stop 2024-09-21T07:17:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 -- 172.21.15.92:0/576881299 shutdown_connections 2024-09-21T07:17:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5637f943f1c0 0x5637f98da840 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637f94ab1b0 0x5637f98d6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5637f948a4d0 0x5637f986ed40 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa02dffb640 0 client.17031 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 --2- 172.21.15.92:0/576881299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5637f94822f0 0x5637f986e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 -- 172.21.15.92:0/576881299 >> 172.21.15.92:0/576881299 conn(0x5637f949f300 msgr2=0x5637f985df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 -- 172.21.15.92:0/576881299 shutdown_connections 2024-09-21T07:17:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 1 -- 172.21.15.92:0/576881299 wait complete. 2024-09-21T07:17:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.579+0000 7fa053c37740 20 client.17031 trim_cache size 0 max 16384 2024-09-21T07:17:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:17:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:17:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:17:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:17:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 -- 172.21.15.92:0/2514946034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0300b66b0 msgr2=0x7fa0300b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0300b66b0 0x7fa0300b8bc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa0400e5070 tx=0x7fa040009f60 comp rx=0 tx=0).stop 2024-09-21T07:17:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 -- 172.21.15.92:0/2514946034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa048109d50 msgr2=0x7fa048076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa048109d50 0x7fa048076190 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa04000eaa0 tx=0x7fa04000eea0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 -- 172.21.15.92:0/2514946034 shutdown_connections 2024-09-21T07:17:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0300b66b0 0x7fa0300b8bc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa048109d50 0x7fa048076190 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa048109400 0x7fa048075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 --2- 172.21.15.92:0/2514946034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa048103ad0 0x7fa048075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 -- 172.21.15.92:0/2514946034 >> 172.21.15.92:0/2514946034 conn(0x7fa0480ff510 msgr2=0x7fa048101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 -- 172.21.15.92:0/2514946034 shutdown_connections 2024-09-21T07:17:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:38.580+0000 7fa04cbed640 1 -- 172.21.15.92:0/2514946034 wait complete. 2024-09-21T07:17:38.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.742+0000 7fcf1d21d640 1 -- 172.21.15.92:0/658877933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf18109df0 msgr2=0x7fcf18110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.742+0000 7fcf1d21d640 1 --2- 172.21.15.92:0/658877933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf18109df0 0x7fcf18110620 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009ca0 tx=0x7fcf1002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.742+0000 7fcf1d21d640 1 -- 172.21.15.92:0/658877933 shutdown_connections 2024-09-21T07:17:38.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.742+0000 7fcf1d21d640 1 --2- 172.21.15.92:0/658877933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf18109df0 0x7fcf18110620 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.742+0000 7fcf1d21d640 1 --2- 172.21.15.92:0/658877933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf181094a0 0x7fcf181098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.742+0000 7fcf1d21d640 1 --2- 172.21.15.92:0/658877933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf18103b60 0x7fcf18103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.742+0000 7fcf1d21d640 1 -- 172.21.15.92:0/658877933 >> 172.21.15.92:0/658877933 conn(0x7fcf1807b850 msgr2=0x7fcf1807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.743+0000 7fcf1d21d640 1 -- 172.21.15.92:0/658877933 shutdown_connections 2024-09-21T07:17:38.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.743+0000 7fcf1d21d640 1 -- 172.21.15.92:0/658877933 wait complete. 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.743+0000 7fcf1d21d640 1 Processor -- start 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1d21d640 1 -- start start 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1d21d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf18103b60 0x7fcf1819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1d21d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf181094a0 0x7fcf1819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1d21d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf18109df0 0x7fcf1819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1d21d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18113a10 con 0x7fcf18109df0 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1d21d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18113890 con 0x7fcf181094a0 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1d21d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18113b90 con 0x7fcf18103b60 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf18109df0 0x7fcf1819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf18109df0 0x7fcf1819fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54268/0 (socket says 172.21.15.92:54268) 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1759e640 1 -- 172.21.15.92:0/1159649713 learned_addr learned my addr 172.21.15.92:0/1159649713 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf18103b60 0x7fcf1819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1659c640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf181094a0 0x7fcf1819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1759e640 1 -- 172.21.15.92:0/1159649713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf18103b60 msgr2=0x7fcf1819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1759e640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf18103b60 0x7fcf1819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1759e640 1 -- 172.21.15.92:0/1159649713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf181094a0 msgr2=0x7fcf1819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1759e640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf181094a0 0x7fcf1819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1759e640 1 -- 172.21.15.92:0/1159649713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf181a0490 con 0x7fcf18109df0 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1659c640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf181094a0 0x7fcf1819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.744+0000 7fcf1759e640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf18109df0 0x7fcf1819fd60 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fcf10005cc0 tx=0x7fcf10032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.745+0000 7fcf0ffff640 1 -- 172.21.15.92:0/1159649713 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10032e00 con 0x7fcf18109df0 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.745+0000 7fcf0ffff640 1 -- 172.21.15.92:0/1159649713 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf100044d0 con 0x7fcf18109df0 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.745+0000 7fcf1d21d640 1 -- 172.21.15.92:0/1159649713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf181a0720 con 0x7fcf18109df0 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.745+0000 7fcf0ffff640 1 -- 172.21.15.92:0/1159649713 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10030b70 con 0x7fcf18109df0 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.745+0000 7fcf1d21d640 1 -- 172.21.15.92:0/1159649713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf181a6ee0 con 0x7fcf18109df0 2024-09-21T07:17:38.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.747+0000 7fcf0ffff640 1 -- 172.21.15.92:0/1159649713 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fcf1004e440 con 0x7fcf18109df0 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.747+0000 7fcf23791740 1 Processor -- start 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.747+0000 7fcf23791740 1 -- start start 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf23791740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e85070 0x55d97522c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf23791740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 0x55d97522cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf23791740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e64390 0x55d97522d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf23791740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d9751a2ea0 con 0x55d974e85070 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf23791740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d9751922d0 con 0x55d974e5c1b0 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf23791740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d9751960e0 con 0x55d974e64390 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf1659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e85070 0x55d97522c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf1659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e85070 0x55d97522c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54278/0 (socket says 172.21.15.92:54278) 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf1659c640 1 -- 172.21.15.92:0/1847374605 learned_addr learned my addr 172.21.15.92:0/1847374605 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf0ffff640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcf040b6680 0x7fcf040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/1847374605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 0x55d97522cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf1659c640 1 -- 172.21.15.92:0/1847374605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e64390 msgr2=0x55d97522d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf1659c640 1 --2- 172.21.15.92:0/1847374605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e64390 0x55d97522d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf1659c640 1 -- 172.21.15.92:0/1847374605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 msgr2=0x55d97522cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf1659c640 1 --2- 172.21.15.92:0/1847374605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 0x55d97522cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf1659c640 1 -- 172.21.15.92:0/1847374605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d974ef0650 con 0x55d974e85070 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/1847374605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 0x55d97522cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.748+0000 7fcf1759e640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcf040b6680 0x7fcf040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.749+0000 7fcf0ffff640 1 -- 172.21.15.92:0/1159649713 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fcf10108da0 con 0x7fcf18109df0 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.749+0000 7fcf1659c640 1 --2- 172.21.15.92:0/1847374605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e85070 0x55d97522c6a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcf00005fd0 tx=0x7fcf000106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7d92cb0a6d0bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.749+0000 7fcf0d7fa640 1 -- 172.21.15.92:0/1847374605 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00016070 con 0x55d974e85070 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.749+0000 7fcf0d7fa640 1 -- 172.21.15.92:0/1847374605 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf000128b0 con 0x55d974e85070 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.749+0000 7fcf0d7fa640 1 -- 172.21.15.92:0/1847374605 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf000115c0 con 0x55d974e85070 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 -- 172.21.15.92:0/1847374605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e85070 msgr2=0x55d97522c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf1759e640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcf040b6680 0x7fcf040b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcf10106200 tx=0x7fcf100b6040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 --2- 172.21.15.92:0/1847374605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e85070 0x55d97522c6a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcf00005fd0 tx=0x7fcf000106e0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 -- 172.21.15.92:0/1847374605 shutdown_connections 2024-09-21T07:17:38.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 --2- 172.21.15.92:0/1847374605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e64390 0x55d97522d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 --2- 172.21.15.92:0/1847374605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 0x55d97522cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 --2- 172.21.15.92:0/1847374605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e85070 0x55d97522c6a0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 -- 172.21.15.92:0/1847374605 >> 172.21.15.92:0/1847374605 conn(0x55d974e79460 msgr2=0x55d97522a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 -- 172.21.15.92:0/1847374605 shutdown_connections 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 -- 172.21.15.92:0/1847374605 wait complete. 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 -- start start 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.750+0000 7fcf23791740 1 Processor -- start 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf23791740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d975237da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf23791740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 0x55d9752382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf23791740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 0x55d9752441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf23791740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d974ff3700 con 0x55d974e5c1b0 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf23791740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d97512d160 con 0x55d974e64390 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf23791740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d97523ae80 con 0x55d974e85070 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf1659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d975237da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf23791740 10 client.0 _ll_register_callbacks cb 0x55d9751469e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:38.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf1659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d975237da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54292/0 (socket says 172.21.15.92:54292) 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf1659c640 1 -- 172.21.15.92:0/2345729267 learned_addr learned my addr 172.21.15.92:0/2345729267 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 0x55d9752382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf1659c640 1 -- 172.21.15.92:0/2345729267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 msgr2=0x55d9752441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf1659c640 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 0x55d9752441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf1659c640 1 -- 172.21.15.92:0/2345729267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 msgr2=0x55d9752382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf1659c640 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 0x55d9752382e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.751+0000 7fcf1659c640 1 -- 172.21.15.92:0/2345729267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d97515ac90 con 0x55d974e5c1b0 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcf1659c640 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d975237da0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009f20 tx=0x7fcf00009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4d911f95afb0e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcefe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcefe7fc640 1 -- 172.21.15.92:0/2345729267 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00016070 con 0x55d974e5c1b0 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcefe7fc640 1 -- 172.21.15.92:0/2345729267 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fcf00004020 con 0x55d974e5c1b0 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcf23791740 1 -- 172.21.15.92:0/2345729267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf000128b0 con 0x55d974e5c1b0 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcefe7fc640 1 -- 172.21.15.92:0/2345729267 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcf00004220 con 0x55d974e5c1b0 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcf23791740 10 client.17043 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:38.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcf23791740 1 -- 172.21.15.92:0/2345729267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d975246b40 con 0x55d974e5c1b0 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcefe7fc640 1 -- 172.21.15.92:0/2345729267 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf000128b0 con 0x55d974e5c1b0 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcefe7fc640 1 -- 172.21.15.92:0/2345729267 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcf00004830 con 0x55d974e5c1b0 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcf23791740 10 client.17043 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcf23791740 10 client.17043 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcf23791740 20 client.17043 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcf23791740 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55d974e439f0 0x55d975249f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcf23791740 4 client.17043 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.752+0000 7fcf23791740 1 -- 172.21.15.92:0/2345729267 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9751a4df0 con 0x55d974e439f0 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.753+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55d974e439f0 0x55d975249f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.753+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55d974e439f0 0x55d975249f00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb3460a9ea9dbc5b server_cookie=52fa97aab80db425 in_seq=0 out_seq=0 2024-09-21T07:17:38.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.753+0000 7fcefe7fc640 10 client.17043 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:17:38.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcefe7fc640 1 -- 172.21.15.92:0/2345729267 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9751a4df0 con 0x55d974e439f0 2024-09-21T07:17:38.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcefe7fc640 10 client.17043 handle_command_reply: tid=0 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcf23791740 1 client.17043 shutdown 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcf23791740 1 -- 172.21.15.92:0/2345729267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 msgr2=0x55d975237da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcf23791740 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d975237da0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009f20 tx=0x7fcf00009f50 comp rx=0 tx=0).stop 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcf23791740 1 -- 172.21.15.92:0/2345729267 shutdown_connections 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcf23791740 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55d974e439f0 0x55d975249f00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcf23791740 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 0x55d9752441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcf23791740 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 0x55d9752382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcf23791740 1 --2- 172.21.15.92:0/2345729267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d975237da0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcf23791740 1 -- 172.21.15.92:0/2345729267 >> 172.21.15.92:0/2345729267 conn(0x55d974e79460 msgr2=0x55d97522f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.754+0000 7fcefe7fc640 0 client.17043 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.755+0000 7fcf23791740 1 -- 172.21.15.92:0/2345729267 shutdown_connections 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.755+0000 7fcf23791740 1 -- 172.21.15.92:0/2345729267 wait complete. 2024-09-21T07:17:38.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.755+0000 7fcf23791740 20 client.17043 trim_cache size 0 max 16384 2024-09-21T07:17:38.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf23791740 1 Processor -- start 2024-09-21T07:17:38.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf23791740 1 -- start start 2024-09-21T07:17:38.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf23791740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d97522e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf23791740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 0x55d9752399d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf23791740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 0x55d975229bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf23791740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181aecd0 con 0x55d974e5c1b0 2024-09-21T07:17:38.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf23791740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181b0810 con 0x55d974e64390 2024-09-21T07:17:38.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf23791740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181af3a0 con 0x55d974e85070 2024-09-21T07:17:38.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf1659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d97522e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf1659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d97522e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54296/0 (socket says 172.21.15.92:54296) 2024-09-21T07:17:38.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf1659c640 1 -- 172.21.15.92:0/2233860148 learned_addr learned my addr 172.21.15.92:0/2233860148 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:38.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/2233860148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 0x55d9752399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf1659c640 1 -- 172.21.15.92:0/2233860148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 msgr2=0x55d975229bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf1659c640 1 --2- 172.21.15.92:0/2233860148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 0x55d975229bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf1659c640 1 -- 172.21.15.92:0/2233860148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 msgr2=0x55d9752399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf1659c640 1 --2- 172.21.15.92:0/2233860148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 0x55d9752399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf1659c640 1 -- 172.21.15.92:0/2233860148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d974e43c20 con 0x55d974e5c1b0 2024-09-21T07:17:38.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.768+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/2233860148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 0x55d9752399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:38.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.769+0000 7fcf1659c640 1 --2- 172.21.15.92:0/2233860148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d97522e090 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009510 tx=0x7fcf00004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cec7c6fe009a7b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.769+0000 7fcf0cff9640 1 -- 172.21.15.92:0/2233860148 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00016070 con 0x55d974e5c1b0 2024-09-21T07:17:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.769+0000 7fcf0cff9640 1 -- 172.21.15.92:0/2233860148 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf00027030 con 0x55d974e5c1b0 2024-09-21T07:17:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.769+0000 7fcf0cff9640 1 -- 172.21.15.92:0/2233860148 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00005460 con 0x55d974e5c1b0 2024-09-21T07:17:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 -- 172.21.15.92:0/2233860148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 msgr2=0x55d97522e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 --2- 172.21.15.92:0/2233860148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d97522e090 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009510 tx=0x7fcf00004e70 comp rx=0 tx=0).stop 2024-09-21T07:17:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 -- 172.21.15.92:0/2233860148 shutdown_connections 2024-09-21T07:17:38.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 --2- 172.21.15.92:0/2233860148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 0x55d975229bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 --2- 172.21.15.92:0/2233860148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e64390 0x55d9752399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 --2- 172.21.15.92:0/2233860148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e5c1b0 0x55d97522e090 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 -- 172.21.15.92:0/2233860148 >> 172.21.15.92:0/2233860148 conn(0x55d974e79460 msgr2=0x55d9752392c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 -- 172.21.15.92:0/2233860148 shutdown_connections 2024-09-21T07:17:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 -- 172.21.15.92:0/2233860148 wait complete. 2024-09-21T07:17:38.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 -- start start 2024-09-21T07:17:38.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.770+0000 7fcf23791740 1 Processor -- start 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf23791740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 0x55d97524d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf23791740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e64390 0x55d97524aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf23791740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 0x55d97524af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf23791740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181b0140 con 0x55d974e64390 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf23791740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181afa70 con 0x55d974e5c1b0 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf23791740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181accb0 con 0x55d974e85070 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf23791740 10 client.0 _ll_register_callbacks cb 0x7fcf00009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf16d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e64390 0x55d97524aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf16d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e64390 0x55d97524aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54306/0 (socket says 172.21.15.92:54306) 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf16d9d640 1 -- 172.21.15.92:0/718446408 learned_addr learned my addr 172.21.15.92:0/718446408 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:38.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf1659c640 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 0x55d97524d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf1659c640 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 0x55d97524af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf16d9d640 1 -- 172.21.15.92:0/718446408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 msgr2=0x55d97524af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 0x55d97524af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf16d9d640 1 -- 172.21.15.92:0/718446408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 msgr2=0x55d97524d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 0x55d97524d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf16d9d640 1 -- 172.21.15.92:0/718446408 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d97524b500 con 0x55d974e64390 2024-09-21T07:17:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcf16d9d640 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e64390 0x55d97524aa00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009bf0 tx=0x7fcf08016800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90512f7fc2c89a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:38.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.771+0000 7fcefe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.776+0000 7fcefe7fc640 1 -- 172.21.15.92:0/718446408 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800f040 con 0x55d974e64390 2024-09-21T07:17:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.776+0000 7fcefe7fc640 1 -- 172.21.15.92:0/718446408 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fcf08025680 con 0x55d974e64390 2024-09-21T07:17:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.776+0000 7fcf23791740 1 -- 172.21.15.92:0/718446408 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf00027030 con 0x55d974e64390 2024-09-21T07:17:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.776+0000 7fcefe7fc640 1 -- 172.21.15.92:0/718446408 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcf0802e050 con 0x55d974e64390 2024-09-21T07:17:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.776+0000 7fcf23791740 10 client.17049 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.776+0000 7fcf23791740 1 -- 172.21.15.92:0/718446408 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d9752b4430 con 0x55d974e64390 2024-09-21T07:17:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.776+0000 7fcefe7fc640 1 -- 172.21.15.92:0/718446408 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf00027030 con 0x55d974e64390 2024-09-21T07:17:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.776+0000 7fcefe7fc640 1 -- 172.21.15.92:0/718446408 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcf08023780 con 0x55d974e64390 2024-09-21T07:17:38.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcf23791740 10 client.17049 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcf23791740 10 client.17049 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcf23791740 20 client.17049 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcf23791740 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55d974e18da0 0x55d9752b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcf23791740 4 client.17049 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcf23791740 1 -- 172.21.15.92:0/718446408 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9751a08a0 con 0x55d974e18da0 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcf1659c640 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55d974e18da0 0x55d9752b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcefe7fc640 10 client.17049 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcf1659c640 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55d974e18da0 0x55d9752b6bd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f248910c2b36dc20 server_cookie=3fb0d1b7e46e8bd1 in_seq=0 out_seq=0 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcefe7fc640 1 -- 172.21.15.92:0/718446408 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9751a08a0 con 0x55d974e18da0 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcefe7fc640 10 client.17049 handle_command_reply: tid=0 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.777+0000 7fcf23791740 1 client.17049 shutdown 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 1 -- 172.21.15.92:0/718446408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e64390 msgr2=0x55d97524aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e64390 0x55d97524aa00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009bf0 tx=0x7fcf08016800 comp rx=0 tx=0).stop 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 1 -- 172.21.15.92:0/718446408 shutdown_connections 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55d974e18da0 0x55d9752b6bd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d974e85070 0x55d97524af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d974e64390 0x55d97524aa00 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 1 --2- 172.21.15.92:0/718446408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d974e5c1b0 0x55d97524d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcefe7fc640 0 client.17049 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 1 -- 172.21.15.92:0/718446408 >> 172.21.15.92:0/718446408 conn(0x55d974e79460 msgr2=0x55d97522de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 1 -- 172.21.15.92:0/718446408 shutdown_connections 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 1 -- 172.21.15.92:0/718446408 wait complete. 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf23791740 20 client.17049 trim_cache size 0 max 16384 2024-09-21T07:17:38.783 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:17:38.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf1d21d640 1 -- 172.21.15.92:0/1159649713 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcf040b6680 msgr2=0x7fcf040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf1d21d640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcf040b6680 0x7fcf040b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcf10106200 tx=0x7fcf100b6040 comp rx=0 tx=0).stop 2024-09-21T07:17:38.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf1d21d640 1 -- 172.21.15.92:0/1159649713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf18109df0 msgr2=0x7fcf1819fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:38.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.778+0000 7fcf1d21d640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf18109df0 0x7fcf1819fd60 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fcf10005cc0 tx=0x7fcf10032a10 comp rx=0 tx=0).stop 2024-09-21T07:17:38.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.779+0000 7fcf1d21d640 1 -- 172.21.15.92:0/1159649713 shutdown_connections 2024-09-21T07:17:38.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.779+0000 7fcf1d21d640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcf040b6680 0x7fcf040b8b90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.779+0000 7fcf1d21d640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf18109df0 0x7fcf1819fd60 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.779+0000 7fcf1d21d640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf181094a0 0x7fcf1819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.779+0000 7fcf1d21d640 1 --2- 172.21.15.92:0/1159649713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf18103b60 0x7fcf1819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:38.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.779+0000 7fcf1d21d640 1 -- 172.21.15.92:0/1159649713 >> 172.21.15.92:0/1159649713 conn(0x7fcf1807b850 msgr2=0x7fcf18107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:38.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.779+0000 7fcf1d21d640 1 -- 172.21.15.92:0/1159649713 shutdown_connections 2024-09-21T07:17:38.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:38.779+0000 7fcf1d21d640 1 -- 172.21.15.92:0/1159649713 wait complete. 2024-09-21T07:17:39.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:38 smithi092 ceph-mon[30987]: pgmap v476: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 37 MiB/s wr, 22 op/s 2024-09-21T07:17:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:38 smithi169 ceph-mon[33705]: pgmap v476: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 37 MiB/s wr, 22 op/s 2024-09-21T07:17:39.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:38 smithi175 ceph-mon[34064]: pgmap v476: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 37 MiB/s wr, 22 op/s 2024-09-21T07:17:39.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:17:39.927 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.403+0000 7fc6a212a640 1 -- 172.21.15.92:0/2964740901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c1021f0 msgr2=0x7fc69c102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.403+0000 7fc6a212a640 1 --2- 172.21.15.92:0/2964740901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c1021f0 0x7fc69c102600 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009900 tx=0x7fc68c02a410 comp rx=0 tx=0).stop 2024-09-21T07:17:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.403+0000 7fc6a212a640 1 -- 172.21.15.92:0/2964740901 shutdown_connections 2024-09-21T07:17:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.403+0000 7fc6a212a640 1 --2- 172.21.15.92:0/2964740901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc69c108480 0x7fc69c10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.403+0000 7fc6a212a640 1 --2- 172.21.15.92:0/2964740901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69c107b30 0x7fc69c107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.403+0000 7fc6a212a640 1 --2- 172.21.15.92:0/2964740901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c1021f0 0x7fc69c102600 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.403+0000 7fc6a212a640 1 -- 172.21.15.92:0/2964740901 >> 172.21.15.92:0/2964740901 conn(0x7fc69c077c60 msgr2=0x7fc69c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.403+0000 7fc6a212a640 1 -- 172.21.15.92:0/2964740901 shutdown_connections 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.403+0000 7fc6a212a640 1 -- 172.21.15.92:0/2964740901 wait complete. 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc6a212a640 1 Processor -- start 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc6a212a640 1 -- start start 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc6a212a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69c1021f0 0x7fc69c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc6a212a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c107b30 0x7fc69c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc6a212a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc69c108480 0x7fc69c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc6a212a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c111770 con 0x7fc69c107b30 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc6a212a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c1115f0 con 0x7fc69c1021f0 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc6a212a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c1118f0 con 0x7fc69c108480 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc693fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c107b30 0x7fc69c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc693fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c107b30 0x7fc69c19a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46246/0 (socket says 172.21.15.92:46246) 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc693fff640 1 -- 172.21.15.92:0/2606373990 learned_addr learned my addr 172.21.15.92:0/2606373990 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69c1021f0 0x7fc69c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.404+0000 7fc69bfff640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc69c108480 0x7fc69c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.405+0000 7fc693fff640 1 -- 172.21.15.92:0/2606373990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc69c108480 msgr2=0x7fc69c19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.405+0000 7fc693fff640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc69c108480 0x7fc69c19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.405+0000 7fc693fff640 1 -- 172.21.15.92:0/2606373990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69c1021f0 msgr2=0x7fc69c19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.405+0000 7fc693fff640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69c1021f0 0x7fc69c19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.405+0000 7fc693fff640 1 -- 172.21.15.92:0/2606373990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c1a0340 con 0x7fc69c107b30 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.405+0000 7fc693fff640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c107b30 0x7fc69c19a970 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc68400d740 tx=0x7fc68400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.405+0000 7fc6997fa640 1 -- 172.21.15.92:0/2606373990 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684017070 con 0x7fc69c107b30 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.405+0000 7fc6a212a640 1 -- 172.21.15.92:0/2606373990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c1a0630 con 0x7fc69c107b30 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.405+0000 7fc6a212a640 1 -- 172.21.15.92:0/2606373990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c1a6d90 con 0x7fc69c107b30 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.405+0000 7fc6997fa640 1 -- 172.21.15.92:0/2606373990 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc68400de50 con 0x7fc69c107b30 2024-09-21T07:17:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.406+0000 7fc6997fa640 1 -- 172.21.15.92:0/2606373990 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684021060 con 0x7fc69c107b30 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.408+0000 7fc6997fa640 1 -- 172.21.15.92:0/2606373990 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fc68401a070 con 0x7fc69c107b30 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.409+0000 7fc6997fa640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6880b6680 0x7fc6880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.409+0000 7fc6997fa640 1 -- 172.21.15.92:0/2606373990 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc6840e7320 con 0x7fc69c107b30 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.409+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6880b6680 0x7fc6880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.410+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6880b6680 0x7fc6880b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0057c0 tx=0x7fc68c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.410+0000 7fc6a869e740 1 Processor -- start 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.410+0000 7fc6a869e740 1 -- start start 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.410+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.410+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee021b0 0x555ddf1d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.410+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee0a390 0x555ddf1d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.410+0000 7fc6a869e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555ddf148ea0 con 0x555ddee2b070 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.410+0000 7fc6a869e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ddf1382d0 con 0x555ddee021b0 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.410+0000 7fc6a869e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555ddf13c0e0 con 0x555ddee0a390 2024-09-21T07:17:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1d26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46254/0 (socket says 172.21.15.92:46254) 2024-09-21T07:17:40.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc69b7fe640 1 -- 172.21.15.92:0/3000217371 learned_addr learned my addr 172.21.15.92:0/3000217371 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:40.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc69bfff640 1 --2- 172.21.15.92:0/3000217371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee0a390 0x555ddf1d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc693fff640 1 --2- 172.21.15.92:0/3000217371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee021b0 0x555ddf1d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc69b7fe640 1 -- 172.21.15.92:0/3000217371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee0a390 msgr2=0x555ddf1d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:40.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/3000217371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee0a390 0x555ddf1d3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc69b7fe640 1 -- 172.21.15.92:0/3000217371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee021b0 msgr2=0x555ddf1d2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:40.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/3000217371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee021b0 0x555ddf1d2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc69b7fe640 1 -- 172.21.15.92:0/3000217371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ddee96650 con 0x555ddee2b070 2024-09-21T07:17:40.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.411+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/3000217371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1d26a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009900 tx=0x7fc68c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7201ae9750d5bb7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.412+0000 7fc691ffb640 1 -- 172.21.15.92:0/3000217371 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c035050 con 0x555ddee2b070 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.412+0000 7fc691ffb640 1 -- 172.21.15.92:0/3000217371 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc68c0044d0 con 0x555ddee2b070 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.412+0000 7fc691ffb640 1 -- 172.21.15.92:0/3000217371 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c048440 con 0x555ddee2b070 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 -- 172.21.15.92:0/3000217371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 msgr2=0x555ddf1d26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 --2- 172.21.15.92:0/3000217371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1d26a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009900 tx=0x7fc68c03e000 comp rx=0 tx=0).stop 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 -- 172.21.15.92:0/3000217371 shutdown_connections 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 --2- 172.21.15.92:0/3000217371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee0a390 0x555ddf1d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 --2- 172.21.15.92:0/3000217371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee021b0 0x555ddf1d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 --2- 172.21.15.92:0/3000217371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1d26a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 -- 172.21.15.92:0/3000217371 >> 172.21.15.92:0/3000217371 conn(0x555ddee1f460 msgr2=0x555ddf1d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 -- 172.21.15.92:0/3000217371 shutdown_connections 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 -- 172.21.15.92:0/3000217371 wait complete. 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 -- start start 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.413+0000 7fc6a869e740 1 Processor -- start 2024-09-21T07:17:40.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee021b0 0x555ddf1ddcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 0x555ddf1de200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1de740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc6a869e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555ddef99700 con 0x555ddee2b070 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc6a869e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ddf0d3160 con 0x555ddee0a390 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc6a869e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555ddf1e0e20 con 0x555ddee021b0 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc6a869e740 10 client.0 _ll_register_callbacks cb 0x555ddf0ec9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc69bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1de740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc69bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1de740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46262/0 (socket says 172.21.15.92:46262) 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc69bfff640 1 -- 172.21.15.92:0/2989646471 learned_addr learned my addr 172.21.15.92:0/2989646471 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee021b0 0x555ddf1ddcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc693fff640 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 0x555ddf1de200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc69bfff640 1 -- 172.21.15.92:0/2989646471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee021b0 msgr2=0x555ddf1ddcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:40.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc69bfff640 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee021b0 0x555ddf1ddcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc69bfff640 1 -- 172.21.15.92:0/2989646471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 msgr2=0x555ddf1de200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc69bfff640 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 0x555ddf1de200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.414+0000 7fc69bfff640 1 -- 172.21.15.92:0/2989646471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ddf100c90 con 0x555ddee2b070 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.415+0000 7fc69bfff640 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1de740 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc69400ee70 tx=0x7fc69400d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a237865c4dd09e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.415+0000 7fc67affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.415+0000 7fc67affd640 1 -- 172.21.15.92:0/2989646471 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694003b70 con 0x555ddee2b070 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.415+0000 7fc6a869e740 1 -- 172.21.15.92:0/2989646471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc68c0044d0 con 0x555ddee2b070 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.415+0000 7fc67affd640 1 -- 172.21.15.92:0/2989646471 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc694003d10 con 0x555ddee2b070 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.415+0000 7fc67affd640 1 -- 172.21.15.92:0/2989646471 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc694024050 con 0x555ddee2b070 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.415+0000 7fc6a869e740 10 client.17061 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.415+0000 7fc6a869e740 1 -- 172.21.15.92:0/2989646471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555ddf1ecb60 con 0x555ddee2b070 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.415+0000 7fc67affd640 1 -- 172.21.15.92:0/2989646471 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc68c0044d0 con 0x555ddee2b070 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.416+0000 7fc67affd640 1 -- 172.21.15.92:0/2989646471 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc69400b040 con 0x555ddee2b070 2024-09-21T07:17:40.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.416+0000 7fc6a869e740 10 client.17061 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.416+0000 7fc6a869e740 10 client.17061 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.416+0000 7fc6a869e740 20 client.17061 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.416+0000 7fc6a869e740 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ddede99f0 0x555ddf1f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.416+0000 7fc6a869e740 4 client.17061 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.416+0000 7fc6a869e740 1 -- 172.21.15.92:0/2989646471 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ddf14adf0 con 0x555ddede99f0 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.416+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ddede99f0 0x555ddf1f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.416+0000 7fc67affd640 10 client.17061 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.416+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ddede99f0 0x555ddf1f01b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c892056cb2ff7516 server_cookie=58e1659188223253 in_seq=0 out_seq=0 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc67affd640 1 -- 172.21.15.92:0/2989646471 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ddf14adf0 con 0x555ddede99f0 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc67affd640 10 client.17061 handle_command_reply: tid=0 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc6a869e740 1 client.17061 shutdown 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc6a869e740 1 -- 172.21.15.92:0/2989646471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 msgr2=0x555ddf1de740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc6a869e740 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1de740 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc69400ee70 tx=0x7fc69400d810 comp rx=0 tx=0).stop 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc6a869e740 1 -- 172.21.15.92:0/2989646471 shutdown_connections 2024-09-21T07:17:40.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc6a869e740 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ddede99f0 0x555ddf1f01b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc6a869e740 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee2b070 0x555ddf1de740 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc67affd640 0 client.17061 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:17:40.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc6a869e740 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 0x555ddf1de200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.417+0000 7fc6a869e740 1 --2- 172.21.15.92:0/2989646471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee021b0 0x555ddf1ddcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.418+0000 7fc6a869e740 1 -- 172.21.15.92:0/2989646471 >> 172.21.15.92:0/2989646471 conn(0x555ddee1f460 msgr2=0x555ddf1d5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:40.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.418+0000 7fc6a869e740 1 -- 172.21.15.92:0/2989646471 shutdown_connections 2024-09-21T07:17:40.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.418+0000 7fc6a869e740 1 -- 172.21.15.92:0/2989646471 wait complete. 2024-09-21T07:17:40.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.418+0000 7fc6a869e740 20 client.17061 trim_cache size 0 max 16384 2024-09-21T07:17:40.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.431+0000 7fc6a869e740 1 Processor -- start 2024-09-21T07:17:40.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.431+0000 7fc6a869e740 1 -- start start 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.431+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddede99f0 0x555ddf1df8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.431+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee021b0 0x555ddf1daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.431+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee0a390 0x555ddf1db3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc6a869e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c00ffc0 con 0x555ddee021b0 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc6a869e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c011b00 con 0x555ddede99f0 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc6a869e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c010690 con 0x555ddee0a390 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc693fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee021b0 0x555ddf1daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc693fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee021b0 0x555ddf1daeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46264/0 (socket says 172.21.15.92:46264) 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc693fff640 1 -- 172.21.15.92:0/4132524091 learned_addr learned my addr 172.21.15.92:0/4132524091 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/4132524091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddede99f0 0x555ddf1df8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc69bfff640 1 --2- 172.21.15.92:0/4132524091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee0a390 0x555ddf1db3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc693fff640 1 -- 172.21.15.92:0/4132524091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee0a390 msgr2=0x555ddf1db3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:40.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc693fff640 1 --2- 172.21.15.92:0/4132524091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee0a390 0x555ddf1db3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc693fff640 1 -- 172.21.15.92:0/4132524091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddede99f0 msgr2=0x555ddf1df8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:40.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc693fff640 1 --2- 172.21.15.92:0/4132524091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddede99f0 0x555ddf1df8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc693fff640 1 -- 172.21.15.92:0/4132524091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ddf1d4990 con 0x555ddee021b0 2024-09-21T07:17:40.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc693fff640 1 --2- 172.21.15.92:0/4132524091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee021b0 0x555ddf1daeb0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc684005c20 tx=0x7fc684094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddac1f4727e8b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:40.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.432+0000 7fc6917fa640 1 -- 172.21.15.92:0/4132524091 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684098020 con 0x555ddee021b0 2024-09-21T07:17:40.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.433+0000 7fc6917fa640 1 -- 172.21.15.92:0/4132524091 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6840981c0 con 0x555ddee021b0 2024-09-21T07:17:40.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.433+0000 7fc6917fa640 1 -- 172.21.15.92:0/4132524091 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6840d4350 con 0x555ddee021b0 2024-09-21T07:17:40.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.433+0000 7fc6a869e740 1 -- 172.21.15.92:0/4132524091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee021b0 msgr2=0x555ddf1daeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:40.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.433+0000 7fc6a869e740 1 --2- 172.21.15.92:0/4132524091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee021b0 0x555ddf1daeb0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc684005c20 tx=0x7fc684094040 comp rx=0 tx=0).stop 2024-09-21T07:17:40.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.433+0000 7fc6a869e740 1 -- 172.21.15.92:0/4132524091 shutdown_connections 2024-09-21T07:17:40.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.433+0000 7fc6a869e740 1 --2- 172.21.15.92:0/4132524091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee0a390 0x555ddf1db3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.433+0000 7fc6a869e740 1 --2- 172.21.15.92:0/4132524091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddee021b0 0x555ddf1daeb0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.433+0000 7fc6a869e740 1 --2- 172.21.15.92:0/4132524091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddede99f0 0x555ddf1df8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.433+0000 7fc6a869e740 1 -- 172.21.15.92:0/4132524091 >> 172.21.15.92:0/4132524091 conn(0x555ddee1f460 msgr2=0x555ddf1df1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.434+0000 7fc6a869e740 1 -- 172.21.15.92:0/4132524091 shutdown_connections 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.434+0000 7fc6a869e740 1 -- 172.21.15.92:0/4132524091 wait complete. 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.434+0000 7fc6a869e740 1 -- start start 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.434+0000 7fc6a869e740 1 Processor -- start 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddede99f0 0x555ddf1e2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee021b0 0x555ddf1e29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc6a869e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 0x555ddf259b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc6a869e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c011430 con 0x555ddede99f0 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc6a869e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c010d60 con 0x555ddee0a390 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc6a869e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c00dfa0 con 0x555ddee021b0 2024-09-21T07:17:40.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc6a869e740 10 client.0 _ll_register_callbacks cb 0x7fc69400eab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddede99f0 0x555ddf1e2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddede99f0 0x555ddf1e2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46274/0 (socket says 172.21.15.92:46274) 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc69b7fe640 1 -- 172.21.15.92:0/3523733315 learned_addr learned my addr 172.21.15.92:0/3523733315 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc69bfff640 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 0x555ddf259b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc693fff640 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee021b0 0x555ddf1e29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc69b7fe640 1 -- 172.21.15.92:0/3523733315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee021b0 msgr2=0x555ddf1e29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee021b0 0x555ddf1e29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc69b7fe640 1 -- 172.21.15.92:0/3523733315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 msgr2=0x555ddf259b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 0x555ddf259b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc69b7fe640 1 -- 172.21.15.92:0/3523733315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ddf25a0b0 con 0x555ddede99f0 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.435+0000 7fc69bfff640 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 0x555ddf259b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc69b7fe640 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddede99f0 0x555ddf1e2470 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc68c031420 tx=0x7fc68c031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e132ee1ba8949f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc67affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:40.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc67affd640 1 -- 172.21.15.92:0/3523733315 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c035040 con 0x555ddede99f0 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc67affd640 1 -- 172.21.15.92:0/3523733315 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc68c048a90 con 0x555ddede99f0 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc6a869e740 1 -- 172.21.15.92:0/3523733315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6840981c0 con 0x555ddede99f0 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc67affd640 1 -- 172.21.15.92:0/3523733315 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc68c070050 con 0x555ddede99f0 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc6a869e740 10 client.17067 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc6a869e740 1 -- 172.21.15.92:0/3523733315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555ddf25b1d0 con 0x555ddede99f0 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc67affd640 1 -- 172.21.15.92:0/3523733315 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6840981c0 con 0x555ddede99f0 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc67affd640 1 -- 172.21.15.92:0/3523733315 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc68c062c30 con 0x555ddede99f0 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.436+0000 7fc6a869e740 10 client.17067 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.437+0000 7fc6a869e740 10 client.17067 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.437+0000 7fc6a869e740 20 client.17067 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.437+0000 7fc6a869e740 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ddee2b070 0x555ddf25d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.437+0000 7fc6a869e740 4 client.17067 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.437+0000 7fc6a869e740 1 -- 172.21.15.92:0/3523733315 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ddf1468a0 con 0x555ddee2b070 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.437+0000 7fc693fff640 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ddee2b070 0x555ddf25d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:40.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.437+0000 7fc67affd640 10 client.17067 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.437+0000 7fc693fff640 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ddee2b070 0x555ddf25d5e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e302face2537a48a server_cookie=f6e74a73b9f8b0ee in_seq=0 out_seq=0 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.437+0000 7fc67affd640 1 -- 172.21.15.92:0/3523733315 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ddf1468a0 con 0x555ddee2b070 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc67affd640 10 client.17067 handle_command_reply: tid=0 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 client.17067 shutdown 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 -- 172.21.15.92:0/3523733315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddede99f0 msgr2=0x555ddf1e2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddede99f0 0x555ddf1e2470 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc68c031420 tx=0x7fc68c031860 comp rx=0 tx=0).stop 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 -- 172.21.15.92:0/3523733315 shutdown_connections 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ddee2b070 0x555ddf25d5e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ddee0a390 0x555ddf259b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ddee021b0 0x555ddf1e29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 --2- 172.21.15.92:0/3523733315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ddede99f0 0x555ddf1e2470 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 -- 172.21.15.92:0/3523733315 >> 172.21.15.92:0/3523733315 conn(0x555ddee1f460 msgr2=0x555ddf1df170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc67affd640 0 client.17067 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:17:40.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 -- 172.21.15.92:0/3523733315 shutdown_connections 2024-09-21T07:17:40.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 1 -- 172.21.15.92:0/3523733315 wait complete. 2024-09-21T07:17:40.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.438+0000 7fc6a869e740 20 client.17067 trim_cache size 0 max 16384 2024-09-21T07:17:40.446 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:17:40.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 -- 172.21.15.92:0/2606373990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6880b6680 msgr2=0x7fc6880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6880b6680 0x7fc6880b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0057c0 tx=0x7fc68c0058d0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 -- 172.21.15.92:0/2606373990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c107b30 msgr2=0x7fc69c19a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c107b30 0x7fc69c19a970 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc68400d740 tx=0x7fc68400dc00 comp rx=0 tx=0).stop 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 -- 172.21.15.92:0/2606373990 shutdown_connections 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc6880b6680 0x7fc6880b8b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc69c108480 0x7fc69c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc69c107b30 0x7fc69c19a970 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 --2- 172.21.15.92:0/2606373990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69c1021f0 0x7fc69c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 -- 172.21.15.92:0/2606373990 >> 172.21.15.92:0/2606373990 conn(0x7fc69c077c60 msgr2=0x7fc69c105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 -- 172.21.15.92:0/2606373990 shutdown_connections 2024-09-21T07:17:40.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:40.439+0000 7fc6a212a640 1 -- 172.21.15.92:0/2606373990 wait complete. 2024-09-21T07:17:40.684 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:17:40.684 INFO:tasks.workunit.client.0.smithi092.stdout: Children see throughput for 1 re-readers = 7793421.00 kB/sec 2024-09-21T07:17:40.684 INFO:tasks.workunit.client.0.smithi092.stdout: Parent sees throughput for 1 re-readers = 7791887.35 kB/sec 2024-09-21T07:17:40.684 INFO:tasks.workunit.client.0.smithi092.stdout: Min throughput per process = 7793421.00 kB/sec 2024-09-21T07:17:40.685 INFO:tasks.workunit.client.0.smithi092.stdout: Max throughput per process = 7793421.00 kB/sec 2024-09-21T07:17:40.685 INFO:tasks.workunit.client.0.smithi092.stdout: Avg throughput per process = 7793421.00 kB/sec 2024-09-21T07:17:40.685 INFO:tasks.workunit.client.0.smithi092.stdout: Min xfer = 10485760.00 kB 2024-09-21T07:17:41.062 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:40 smithi092 ceph-mon[30987]: pgmap v477: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.7 MiB/s wr, 13 op/s 2024-09-21T07:17:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:40 smithi169 ceph-mon[33705]: pgmap v477: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.7 MiB/s wr, 13 op/s 2024-09-21T07:17:41.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:40 smithi175 ceph-mon[34064]: pgmap v477: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.7 MiB/s wr, 13 op/s 2024-09-21T07:17:41.506 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:17:41.754 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.264+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/3261044479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc102a60 msgr2=0x7f0dcc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.264+0000 7f0dd0e1b640 1 --2- 172.21.15.92:0/3261044479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc102a60 0x7f0dcc102e70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009900 tx=0x7f0dbc02a410 comp rx=0 tx=0).stop 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.264+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/3261044479 shutdown_connections 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.264+0000 7f0dd0e1b640 1 --2- 172.21.15.92:0/3261044479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dcc108cf0 0x7f0dcc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.264+0000 7f0dd0e1b640 1 --2- 172.21.15.92:0/3261044479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc1083a0 0x7f0dcc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.264+0000 7f0dd0e1b640 1 --2- 172.21.15.92:0/3261044479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc102a60 0x7f0dcc102e70 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.264+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/3261044479 >> 172.21.15.92:0/3261044479 conn(0x7f0dcc079730 msgr2=0x7f0dcc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.264+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/3261044479 shutdown_connections 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.264+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/3261044479 wait complete. 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.265+0000 7f0dd0e1b640 1 Processor -- start 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.265+0000 7f0dd0e1b640 1 -- start start 2024-09-21T07:17:42.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.265+0000 7f0dd0e1b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dcc102a60 0x7f0dcc19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.265+0000 7f0dd0e1b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc1083a0 0x7f0dcc19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.265+0000 7f0dd0e1b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc108cf0 0x7f0dcc19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.265+0000 7f0dd0e1b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1139f0 con 0x7f0dcc108cf0 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.265+0000 7f0dd0e1b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc113870 con 0x7f0dcc102a60 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.265+0000 7f0dd0e1b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc113b70 con 0x7f0dcc1083a0 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dcad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc108cf0 0x7f0dcc19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dcad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc108cf0 0x7f0dcc19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46296/0 (socket says 172.21.15.92:46296) 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dcad9d640 1 -- 172.21.15.92:0/2581891006 learned_addr learned my addr 172.21.15.92:0/2581891006 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc1083a0 0x7f0dcc19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dca59c640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dcc102a60 0x7f0dcc19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dcad9d640 1 -- 172.21.15.92:0/2581891006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc1083a0 msgr2=0x7f0dcc19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dcad9d640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc1083a0 0x7f0dcc19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dcad9d640 1 -- 172.21.15.92:0/2581891006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dcc102a60 msgr2=0x7f0dcc19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dcad9d640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dcc102a60 0x7f0dcc19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dcad9d640 1 -- 172.21.15.92:0/2581891006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc1a0450 con 0x7f0dcc108cf0 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dcad9d640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc108cf0 0x7f0dcc19fd20 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400b970 tx=0x7f0dc400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dc37fe640 1 -- 172.21.15.92:0/2581891006 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4019070 con 0x7f0dcc108cf0 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/2581891006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dcc1a0740 con 0x7f0dcc108cf0 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dc37fe640 1 -- 172.21.15.92:0/2581891006 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0dc4014440 con 0x7f0dcc108cf0 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dc37fe640 1 -- 172.21.15.92:0/2581891006 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40075d0 con 0x7f0dcc108cf0 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.266+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/2581891006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dcc1a6ea0 con 0x7f0dcc108cf0 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.269+0000 7f0dc37fe640 1 -- 172.21.15.92:0/2581891006 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f0dc401c070 con 0x7f0dcc108cf0 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.269+0000 7f0dd738f740 1 Processor -- start 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.269+0000 7f0dd738f740 1 -- start start 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.269+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f2a4070 0x55700f64b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.269+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f64b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.269+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f283390 0x55700f64bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.269+0000 7f0dd738f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55700f5c1ea0 con 0x55700f283390 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.269+0000 7f0dd738f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55700f5b12d0 con 0x55700f27b1b0 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.269+0000 7f0dd738f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55700f5b50e0 con 0x55700f2a4070 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f283390 0x55700f64bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f283390 0x55700f64bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46304/0 (socket says 172.21.15.92:46304) 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/4217037736 learned_addr learned my addr 172.21.15.92:0/4217037736 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/4217037736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f2a4070 0x55700f64b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dca59c640 1 --2- 172.21.15.92:0/4217037736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f64b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc37fe640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0db80b6680 0x7f0db80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/4217037736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f2a4070 msgr2=0x55700f64b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dcad9d640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0db80b6680 0x7f0db80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/4217037736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f2a4070 0x55700f64b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/4217037736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 msgr2=0x55700f64b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/4217037736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f64b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/4217037736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55700f30f650 con 0x55700f283390 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dca59c640 1 --2- 172.21.15.92:0/4217037736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f64b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/4217037736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f283390 0x55700f64bd40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f0db4017700 tx=0x7f0db40094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b61151b9807154 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc37fe640 1 -- 172.21.15.92:0/2581891006 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0dc40e6f80 con 0x7f0dcc108cf0 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.270+0000 7f0dc0ff9640 1 -- 172.21.15.92:0/4217037736 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4015760 con 0x55700f283390 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dc0ff9640 1 -- 172.21.15.92:0/4217037736 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0db401d070 con 0x55700f283390 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dcad9d640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0db80b6680 0x7f0db80b8b90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0dc40e43e0 tx=0x7f0dc4079d10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dc0ff9640 1 -- 172.21.15.92:0/4217037736 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4018840 con 0x55700f283390 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dd738f740 1 -- 172.21.15.92:0/4217037736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f283390 msgr2=0x55700f64bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dd738f740 1 --2- 172.21.15.92:0/4217037736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f283390 0x55700f64bd40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f0db4017700 tx=0x7f0db40094d0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dd738f740 1 -- 172.21.15.92:0/4217037736 shutdown_connections 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dd738f740 1 --2- 172.21.15.92:0/4217037736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f283390 0x55700f64bd40 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dd738f740 1 --2- 172.21.15.92:0/4217037736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f64b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dd738f740 1 --2- 172.21.15.92:0/4217037736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f2a4070 0x55700f64b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dd738f740 1 -- 172.21.15.92:0/4217037736 >> 172.21.15.92:0/4217037736 conn(0x55700f298460 msgr2=0x55700f6491b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.271+0000 7f0dd738f740 1 -- 172.21.15.92:0/4217037736 shutdown_connections 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dd738f740 1 -- 172.21.15.92:0/4217037736 wait complete. 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dd738f740 1 -- start start 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dd738f740 1 Processor -- start 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f656970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f656eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2a4070 0x55700f662d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dd738f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55700f412700 con 0x55700f2a4070 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dd738f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55700f54c160 con 0x55700f27b1b0 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dd738f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55700f659a40 con 0x55700f283390 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dd738f740 10 client.0 _ll_register_callbacks cb 0x55700f5659e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dc9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2a4070 0x55700f662d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dc9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2a4070 0x55700f662d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46318/0 (socket says 172.21.15.92:46318) 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.272+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/4095755828 learned_addr learned my addr 172.21.15.92:0/4095755828 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:42.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dca59c640 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f656eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f656970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/4095755828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 msgr2=0x55700f656eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f656eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/4095755828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 msgr2=0x55700f656970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f656970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/4095755828 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55700f579c90 con 0x55700f2a4070 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2a4070 0x55700f662d30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009fd0 tx=0x7f0db4006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f2b4f294c227da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0db1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0db1ffb640 1 -- 172.21.15.92:0/4095755828 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4027070 con 0x55700f2a4070 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0db1ffb640 1 -- 172.21.15.92:0/4095755828 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0db40185c0 con 0x55700f2a4070 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dd738f740 1 -- 172.21.15.92:0/4095755828 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0db401d070 con 0x55700f2a4070 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0db1ffb640 1 -- 172.21.15.92:0/4095755828 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0db4015e20 con 0x55700f2a4070 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dd738f740 10 client.17079 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:42.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0dd738f740 1 -- 172.21.15.92:0/4095755828 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55700f665750 con 0x55700f2a4070 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.273+0000 7f0db1ffb640 1 -- 172.21.15.92:0/4095755828 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0db401d070 con 0x55700f2a4070 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.274+0000 7f0db1ffb640 1 -- 172.21.15.92:0/4095755828 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0db4023820 con 0x55700f2a4070 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.274+0000 7f0dd738f740 10 client.17079 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.274+0000 7f0dd738f740 10 client.17079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.274+0000 7f0dd738f740 20 client.17079 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.274+0000 7f0dd738f740 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55700f2629f0 0x55700f668ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.274+0000 7f0dd738f740 4 client.17079 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.274+0000 7f0dd738f740 1 -- 172.21.15.92:0/4095755828 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55700f5c3df0 con 0x55700f2629f0 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.274+0000 7f0dca59c640 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55700f2629f0 0x55700f668ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.274+0000 7f0db1ffb640 10 client.17079 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.274+0000 7f0dca59c640 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55700f2629f0 0x55700f668ab0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9ddd2215ca941bd server_cookie=5997e84b21c92ad3 in_seq=0 out_seq=0 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0db1ffb640 1 -- 172.21.15.92:0/4095755828 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55700f5c3df0 con 0x55700f2629f0 2024-09-21T07:17:42.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0db1ffb640 10 client.17079 handle_command_reply: tid=0 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 client.17079 shutdown 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 -- 172.21.15.92:0/4095755828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2a4070 msgr2=0x55700f662d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2a4070 0x55700f662d30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009fd0 tx=0x7f0db4006a30 comp rx=0 tx=0).stop 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 -- 172.21.15.92:0/4095755828 shutdown_connections 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55700f2629f0 0x55700f668ab0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2a4070 0x55700f662d30 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f656eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0db1ffb640 0 client.17079 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 --2- 172.21.15.92:0/4095755828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f656970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 -- 172.21.15.92:0/4095755828 >> 172.21.15.92:0/4095755828 conn(0x55700f298460 msgr2=0x55700f64e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 -- 172.21.15.92:0/4095755828 shutdown_connections 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.275+0000 7f0dd738f740 1 -- 172.21.15.92:0/4095755828 wait complete. 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.276+0000 7f0dd738f740 20 client.17079 trim_cache size 0 max 16384 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dd738f740 1 Processor -- start 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dd738f740 1 -- start start 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f2629f0 0x55700f6585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f27b1b0 0x55700f653b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f6540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dd738f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1b0f50 con 0x55700f27b1b0 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dd738f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1b2a90 con 0x55700f2629f0 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dd738f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1b1620 con 0x55700f283390 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dca59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f27b1b0 0x55700f653b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dca59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f27b1b0 0x55700f653b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46326/0 (socket says 172.21.15.92:46326) 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dca59c640 1 -- 172.21.15.92:0/2106383455 learned_addr learned my addr 172.21.15.92:0/2106383455 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:42.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/2106383455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f2629f0 0x55700f6585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/2106383455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f6540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dca59c640 1 -- 172.21.15.92:0/2106383455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 msgr2=0x55700f6540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dca59c640 1 --2- 172.21.15.92:0/2106383455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f6540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dca59c640 1 -- 172.21.15.92:0/2106383455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f2629f0 msgr2=0x55700f6585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dca59c640 1 --2- 172.21.15.92:0/2106383455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f2629f0 0x55700f6585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dca59c640 1 -- 172.21.15.92:0/2106383455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55700f654e70 con 0x55700f27b1b0 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/2106383455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f6540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0dca59c640 1 --2- 172.21.15.92:0/2106383455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f27b1b0 0x55700f653b60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc005940 tx=0x7f0dbc009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf49c7b56cbcedf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0db3fff640 1 -- 172.21.15.92:0/2106383455 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc035040 con 0x55700f27b1b0 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.289+0000 7f0db3fff640 1 -- 172.21.15.92:0/2106383455 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0dbc0044d0 con 0x55700f27b1b0 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.290+0000 7f0db3fff640 1 -- 172.21.15.92:0/2106383455 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc03c440 con 0x55700f27b1b0 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.290+0000 7f0dd738f740 1 -- 172.21.15.92:0/2106383455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f27b1b0 msgr2=0x55700f653b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:42.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.290+0000 7f0dd738f740 1 --2- 172.21.15.92:0/2106383455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f27b1b0 0x55700f653b60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc005940 tx=0x7f0dbc009640 comp rx=0 tx=0).stop 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.290+0000 7f0dd738f740 1 -- 172.21.15.92:0/2106383455 shutdown_connections 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.290+0000 7f0dd738f740 1 --2- 172.21.15.92:0/2106383455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f6540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.290+0000 7f0dd738f740 1 --2- 172.21.15.92:0/2106383455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f27b1b0 0x55700f653b60 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.290+0000 7f0dd738f740 1 --2- 172.21.15.92:0/2106383455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f2629f0 0x55700f6585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.290+0000 7f0dd738f740 1 -- 172.21.15.92:0/2106383455 >> 172.21.15.92:0/2106383455 conn(0x55700f298460 msgr2=0x55700f657e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.290+0000 7f0dd738f740 1 -- 172.21.15.92:0/2106383455 shutdown_connections 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.290+0000 7f0dd738f740 1 -- 172.21.15.92:0/2106383455 wait complete. 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dd738f740 1 -- start start 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dd738f740 1 Processor -- start 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2629f0 0x55700f6c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f6c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dd738f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f6c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dd738f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1b23c0 con 0x55700f2629f0 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dd738f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1b1cf0 con 0x55700f27b1b0 2024-09-21T07:17:42.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dd738f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1aef30 con 0x55700f283390 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dd738f740 10 client.0 _ll_register_callbacks cb 0x7f0db4009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dc9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2629f0 0x55700f6c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dc9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2629f0 0x55700f6c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46336/0 (socket says 172.21.15.92:46336) 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/1868104039 learned_addr learned my addr 172.21.15.92:0/1868104039 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dca59c640 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f6c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/1868104039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 msgr2=0x55700f6c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f6c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/1868104039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 msgr2=0x55700f6c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.291+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f6c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0dc9d9b640 1 -- 172.21.15.92:0/1868104039 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55700f6d2270 con 0x55700f2629f0 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0dc9d9b640 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2629f0 0x55700f6c71c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009fd0 tx=0x7f0db4023b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7f77a79516602f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0db1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0db1ffb640 1 -- 172.21.15.92:0/1868104039 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4027050 con 0x55700f2629f0 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0db1ffb640 1 -- 172.21.15.92:0/1868104039 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f0db40093a0 con 0x55700f2629f0 2024-09-21T07:17:42.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0dd738f740 1 -- 172.21.15.92:0/1868104039 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dbc0044d0 con 0x55700f2629f0 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0db1ffb640 1 -- 172.21.15.92:0/1868104039 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0db4017e90 con 0x55700f2629f0 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0dd738f740 10 client.17085 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0dd738f740 1 -- 172.21.15.92:0/1868104039 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55700f6d33b0 con 0x55700f2629f0 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0db1ffb640 1 -- 172.21.15.92:0/1868104039 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0dbc0044d0 con 0x55700f2629f0 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0db1ffb640 1 -- 172.21.15.92:0/1868104039 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0db4035070 con 0x55700f2629f0 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.292+0000 7f0dd738f740 10 client.17085 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0dd738f740 10 client.17085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0dd738f740 20 client.17085 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0dd738f740 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55700f2a4070 0x55700f6d5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0dd738f740 4 client.17085 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0dd738f740 1 -- 172.21.15.92:0/1868104039 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55700f5bf8a0 con 0x55700f2a4070 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0dca59c640 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55700f2a4070 0x55700f6d5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0db1ffb640 10 client.17085 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:42.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0dca59c640 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55700f2a4070 0x55700f6d5b70 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbb5301019fb7611 server_cookie=64f0fa12fda1b247 in_seq=0 out_seq=0 2024-09-21T07:17:42.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0db1ffb640 1 -- 172.21.15.92:0/1868104039 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55700f5bf8a0 con 0x55700f2a4070 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0db1ffb640 10 client.17085 handle_command_reply: tid=0 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.293+0000 7f0dd738f740 1 client.17085 shutdown 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 1 -- 172.21.15.92:0/1868104039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2629f0 msgr2=0x55700f6c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2629f0 0x55700f6c71c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009fd0 tx=0x7f0db4023b20 comp rx=0 tx=0).stop 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 1 -- 172.21.15.92:0/1868104039 shutdown_connections 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55700f2a4070 0x55700f6d5b70 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55700f283390 0x55700f6c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55700f27b1b0 0x55700f6c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 1 --2- 172.21.15.92:0/1868104039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55700f2629f0 0x55700f6c71c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0db1ffb640 0 client.17085 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 1 -- 172.21.15.92:0/1868104039 >> 172.21.15.92:0/1868104039 conn(0x55700f298460 msgr2=0x55700f657e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 1 -- 172.21.15.92:0/1868104039 shutdown_connections 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 1 -- 172.21.15.92:0/1868104039 wait complete. 2024-09-21T07:17:42.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd738f740 20 client.17085 trim_cache size 0 max 16384 2024-09-21T07:17:42.312 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:17:42.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/2581891006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0db80b6680 msgr2=0x7f0db80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:42.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd0e1b640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0db80b6680 0x7f0db80b8b90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0dc40e43e0 tx=0x7f0dc4079d10 comp rx=0 tx=0).stop 2024-09-21T07:17:42.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/2581891006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc108cf0 msgr2=0x7f0dcc19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:42.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd0e1b640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc108cf0 0x7f0dcc19fd20 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400b970 tx=0x7f0dc400bd70 comp rx=0 tx=0).stop 2024-09-21T07:17:42.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/2581891006 shutdown_connections 2024-09-21T07:17:42.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd0e1b640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f0db80b6680 0x7f0db80b8b90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd0e1b640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc108cf0 0x7f0dcc19fd20 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd0e1b640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc1083a0 0x7f0dcc19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd0e1b640 1 --2- 172.21.15.92:0/2581891006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0dcc102a60 0x7f0dcc19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:42.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.294+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/2581891006 >> 172.21.15.92:0/2581891006 conn(0x7f0dcc079730 msgr2=0x7f0dcc1016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:42.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.295+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/2581891006 shutdown_connections 2024-09-21T07:17:42.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:42.295+0000 7f0dd0e1b640 1 -- 172.21.15.92:0/2581891006 wait complete. 2024-09-21T07:17:43.032 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:42 smithi092 ceph-mon[30987]: pgmap v478: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T07:17:43.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:42 smithi169 ceph-mon[33705]: pgmap v478: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T07:17:43.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:42 smithi175 ceph-mon[34064]: pgmap v478: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T07:17:44.060 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:17:44.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:17:44.085 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:43 smithi092 ceph-mon[30987]: pgmap v479: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-09-21T07:17:44.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:43 smithi169 ceph-mon[33705]: pgmap v479: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-09-21T07:17:44.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:43 smithi175 ceph-mon[34064]: pgmap v479: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-09-21T07:17:44.321 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:44.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.814+0000 7f6aa68be640 1 -- 172.21.15.92:0/1546013968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aa01083e0 msgr2=0x7f6aa01087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:44.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.814+0000 7f6aa68be640 1 --2- 172.21.15.92:0/1546013968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aa01083e0 0x7f6aa01087f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009900 tx=0x7f6a9402a410 comp rx=0 tx=0).stop 2024-09-21T07:17:44.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.814+0000 7f6aa68be640 1 -- 172.21.15.92:0/1546013968 shutdown_connections 2024-09-21T07:17:44.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.814+0000 7f6aa68be640 1 --2- 172.21.15.92:0/1546013968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6aa0108d30 0x7f6aa010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.814+0000 7f6aa68be640 1 --2- 172.21.15.92:0/1546013968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aa01083e0 0x7f6aa01087f0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.814+0000 7f6aa68be640 1 --2- 172.21.15.92:0/1546013968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa0103240 0x7f6aa0103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.814+0000 7f6aa68be640 1 -- 172.21.15.92:0/1546013968 >> 172.21.15.92:0/1546013968 conn(0x7f6aa0077cc0 msgr2=0x7f6aa0078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.814+0000 7f6aa68be640 1 -- 172.21.15.92:0/1546013968 shutdown_connections 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.814+0000 7f6aa68be640 1 -- 172.21.15.92:0/1546013968 wait complete. 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.815+0000 7f6aa68be640 1 Processor -- start 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.815+0000 7f6aa68be640 1 -- start start 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.815+0000 7f6aa68be640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa0103240 0x7f6aa01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.815+0000 7f6aa68be640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6aa01083e0 0x7f6aa0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.815+0000 7f6aa68be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aa0108d30 0x7f6aa019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.815+0000 7f6aa68be640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa01128a0 con 0x7f6aa0108d30 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.815+0000 7f6aa68be640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa0112720 con 0x7f6aa01083e0 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.815+0000 7f6aa68be640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa0112a20 con 0x7f6aa0103240 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.815+0000 7f6aa4e5b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aa0108d30 0x7f6aa019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6aa4e5b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aa0108d30 0x7f6aa019eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46352/0 (socket says 172.21.15.92:46352) 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6aa4e5b640 1 -- 172.21.15.92:0/1879112318 learned_addr learned my addr 172.21.15.92:0/1879112318 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6aa01083e0 0x7f6aa0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa0103240 0x7f6aa01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6aa4e5b640 1 -- 172.21.15.92:0/1879112318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa0103240 msgr2=0x7f6aa01992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6aa4e5b640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa0103240 0x7f6aa01992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6aa4e5b640 1 -- 172.21.15.92:0/1879112318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6aa01083e0 msgr2=0x7f6aa0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6aa4e5b640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6aa01083e0 0x7f6aa0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6aa4e5b640 1 -- 172.21.15.92:0/1879112318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa019f260 con 0x7f6aa0108d30 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6aa4e5b640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aa0108d30 0x7f6aa019eb30 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800eaa0 tx=0x7f6a9800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6a9d7fa640 1 -- 172.21.15.92:0/1879112318 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9800cdb0 con 0x7f6aa0108d30 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6a9d7fa640 1 -- 172.21.15.92:0/1879112318 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a98005020 con 0x7f6aa0108d30 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6aa68be640 1 -- 172.21.15.92:0/1879112318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa019f550 con 0x7f6aa0108d30 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6a9d7fa640 1 -- 172.21.15.92:0/1879112318 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a980116d0 con 0x7f6aa0108d30 2024-09-21T07:17:44.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.816+0000 7f6aa68be640 1 -- 172.21.15.92:0/1879112318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa01a5cb0 con 0x7f6aa0108d30 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.819+0000 7f6aace32740 1 Processor -- start 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.819+0000 7f6a9d7fa640 1 -- 172.21.15.92:0/1879112318 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f6a98011870 con 0x7f6aa0108d30 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.819+0000 7f6aace32740 1 -- start start 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6aace32740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 0x55dc29203430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6aace32740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29203970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6aace32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e3b670 0x55dc29203eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6aace32740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dc29179e60 con 0x55dc28e33490 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6aace32740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dc29169290 con 0x55dc28e5c350 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6aace32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dc2916d0a0 con 0x55dc28e3b670 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29203970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29203970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46358/0 (socket says 172.21.15.92:46358) 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9ffff640 1 -- 172.21.15.92:0/1143244500 learned_addr learned my addr 172.21.15.92:0/1143244500 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:44.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/1143244500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 0x55dc29203430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/1143244500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e3b670 0x55dc29203eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9ffff640 1 -- 172.21.15.92:0/1143244500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e3b670 msgr2=0x55dc29203eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/1143244500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e3b670 0x55dc29203eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9ffff640 1 -- 172.21.15.92:0/1143244500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 msgr2=0x55dc29203430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/1143244500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 0x55dc29203430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9ffff640 1 -- 172.21.15.92:0/1143244500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc28ec7930 con 0x55dc28e33490 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/1143244500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 0x55dc29203430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9d7fa640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a880b6680 0x7f6a880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/1143244500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29203970 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000b760 tx=0x7f6a9000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc4d4fd93e65b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.820+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a880b6680 0x7f6a880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.821+0000 7f6a9d7fa640 1 -- 172.21.15.92:0/1879112318 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6a980e7bf0 con 0x7f6aa0108d30 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.821+0000 7f6a867fc640 1 -- 172.21.15.92:0/1143244500 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90003dd0 con 0x55dc28e33490 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.821+0000 7f6a867fc640 1 -- 172.21.15.92:0/1143244500 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a90015070 con 0x55dc28e33490 2024-09-21T07:17:44.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.821+0000 7f6a867fc640 1 -- 172.21.15.92:0/1143244500 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90004cc0 con 0x55dc28e33490 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 -- 172.21.15.92:0/1143244500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 msgr2=0x55dc29203970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a880b6680 0x7f6a880b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6a94005940 tx=0x7f6a94005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 --2- 172.21.15.92:0/1143244500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29203970 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000b760 tx=0x7f6a9000bc20 comp rx=0 tx=0).stop 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 -- 172.21.15.92:0/1143244500 shutdown_connections 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 --2- 172.21.15.92:0/1143244500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e3b670 0x55dc29203eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 --2- 172.21.15.92:0/1143244500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29203970 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 --2- 172.21.15.92:0/1143244500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 0x55dc29203430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 -- 172.21.15.92:0/1143244500 >> 172.21.15.92:0/1143244500 conn(0x55dc28e50740 msgr2=0x55dc29201320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 -- 172.21.15.92:0/1143244500 shutdown_connections 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 -- 172.21.15.92:0/1143244500 wait complete. 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 -- start start 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.822+0000 7f6aace32740 1 Processor -- start 2024-09-21T07:17:44.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6aace32740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc2920f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6aace32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e3b670 0x55dc2920f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6aace32740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 0x55dc2921d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6aace32740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dc28fca890 con 0x55dc28e33490 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6aace32740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dc29103d40 con 0x55dc28e5c350 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6aace32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dc29213e20 con 0x55dc28e3b670 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6aace32740 10 client.0 _ll_register_callbacks cb 0x55dc29167c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc2920f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc2920f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46366/0 (socket says 172.21.15.92:46366) 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a9ffff640 1 -- 172.21.15.92:0/4181860367 learned_addr learned my addr 172.21.15.92:0/4181860367 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e3b670 0x55dc2920f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6aa4e5b640 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 0x55dc2921d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a9ffff640 1 -- 172.21.15.92:0/4181860367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e3b670 msgr2=0x55dc2920f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e3b670 0x55dc2920f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a9ffff640 1 -- 172.21.15.92:0/4181860367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 msgr2=0x55dc2921d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 0x55dc2921d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a9ffff640 1 -- 172.21.15.92:0/4181860367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc2921d780 con 0x55dc28e33490 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6aa4e5b640 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 0x55dc2921d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc2920f080 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f6a90006010 tx=0x7f6a90003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec355bc99574350 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.823+0000 7f6a7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/4181860367 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90028060 con 0x55dc28e33490 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6aace32740 1 -- 172.21.15.92:0/4181860367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a90015070 con 0x55dc28e33490 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/4181860367 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6a90011850 con 0x55dc28e33490 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/4181860367 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6a9002f050 con 0x55dc28e33490 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6aace32740 10 client.17097 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6aace32740 1 -- 172.21.15.92:0/4181860367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dc292200b0 con 0x55dc28e33490 2024-09-21T07:17:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/4181860367 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a90015070 con 0x55dc28e33490 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/4181860367 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6a90022070 con 0x55dc28e33490 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6aace32740 10 client.17097 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6aace32740 10 client.17097 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6aace32740 20 client.17097 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6aace32740 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dc28e1acd0 0x55dc29223470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6aace32740 4 client.17097 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.824+0000 7f6aace32740 1 -- 172.21.15.92:0/4181860367 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc2917bdb0 con 0x55dc28e1acd0 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.825+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dc28e1acd0 0x55dc29223470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.825+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dc28e1acd0 0x55dc29223470 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54087d9722b9ef71 server_cookie=59ee829c0bc8f7f0 in_seq=0 out_seq=0 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.825+0000 7f6a7f7fe640 10 client.17097 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/4181860367 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc2917bdb0 con 0x55dc28e1acd0 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6a7f7fe640 10 client.17097 handle_command_reply: tid=0 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 client.17097 shutdown 2024-09-21T07:17:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 -- 172.21.15.92:0/4181860367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 msgr2=0x55dc2920f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc2920f080 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f6a90006010 tx=0x7f6a90003e00 comp rx=0 tx=0).stop 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 -- 172.21.15.92:0/4181860367 shutdown_connections 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dc28e1acd0 0x55dc29223470 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e5c350 0x55dc2921d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e3b670 0x55dc2920f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 --2- 172.21.15.92:0/4181860367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc2920f080 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 -- 172.21.15.92:0/4181860367 >> 172.21.15.92:0/4181860367 conn(0x55dc28e50740 msgr2=0x55dc292065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6a7f7fe640 0 client.17097 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 -- 172.21.15.92:0/4181860367 shutdown_connections 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 1 -- 172.21.15.92:0/4181860367 wait complete. 2024-09-21T07:17:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.826+0000 7f6aace32740 20 client.17097 trim_cache size 0 max 16384 2024-09-21T07:17:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aace32740 1 Processor -- start 2024-09-21T07:17:44.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aace32740 1 -- start start 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aace32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e33490 0x55dc29204e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aace32740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e3b670 0x55dc29206ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aace32740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e5c350 0x55dc2920e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aace32740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa01aebc0 con 0x55dc28e5c350 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aace32740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa01b0700 con 0x55dc28e3b670 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aace32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa01af290 con 0x55dc28e33490 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aa4e5b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e5c350 0x55dc2920e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aa4e5b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e5c350 0x55dc2920e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46370/0 (socket says 172.21.15.92:46370) 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aa4e5b640 1 -- 172.21.15.92:0/1390699824 learned_addr learned my addr 172.21.15.92:0/1390699824 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/1390699824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e33490 0x55dc29204e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/1390699824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e3b670 0x55dc29206ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aa4e5b640 1 -- 172.21.15.92:0/1390699824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e33490 msgr2=0x55dc29204e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:44.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aa4e5b640 1 --2- 172.21.15.92:0/1390699824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e33490 0x55dc29204e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aa4e5b640 1 -- 172.21.15.92:0/1390699824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e3b670 msgr2=0x55dc29206ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aa4e5b640 1 --2- 172.21.15.92:0/1390699824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e3b670 0x55dc29206ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.859+0000 7f6aa4e5b640 1 -- 172.21.15.92:0/1390699824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc29205b60 con 0x55dc28e5c350 2024-09-21T07:17:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.860+0000 7f6aa4e5b640 1 --2- 172.21.15.92:0/1390699824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e5c350 0x55dc2920e710 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6a980a9d20 tx=0x7f6a980ad260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb181d240beadd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.860+0000 7f6a85ffb640 1 -- 172.21.15.92:0/1390699824 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9801f070 con 0x55dc28e5c350 2024-09-21T07:17:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.860+0000 7f6a85ffb640 1 -- 172.21.15.92:0/1390699824 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a9805b030 con 0x55dc28e5c350 2024-09-21T07:17:44.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.860+0000 7f6a85ffb640 1 -- 172.21.15.92:0/1390699824 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a980a90a0 con 0x55dc28e5c350 2024-09-21T07:17:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 -- 172.21.15.92:0/1390699824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e5c350 msgr2=0x55dc2920e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 --2- 172.21.15.92:0/1390699824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e5c350 0x55dc2920e710 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6a980a9d20 tx=0x7f6a980ad260 comp rx=0 tx=0).stop 2024-09-21T07:17:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 -- 172.21.15.92:0/1390699824 shutdown_connections 2024-09-21T07:17:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 --2- 172.21.15.92:0/1390699824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e5c350 0x55dc2920e710 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 --2- 172.21.15.92:0/1390699824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e3b670 0x55dc29206ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 --2- 172.21.15.92:0/1390699824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e33490 0x55dc29204e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 -- 172.21.15.92:0/1390699824 >> 172.21.15.92:0/1390699824 conn(0x55dc28e50740 msgr2=0x55dc2921c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 -- 172.21.15.92:0/1390699824 shutdown_connections 2024-09-21T07:17:44.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 -- 172.21.15.92:0/1390699824 wait complete. 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 -- start start 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.861+0000 7f6aace32740 1 Processor -- start 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6aace32740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29222770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6aace32740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e3b670 0x55dc29222cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6aace32740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e5c350 0x55dc2928efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6aace32740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa01b0030 con 0x55dc28e33490 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6aace32740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa01af960 con 0x55dc28e3b670 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6aace32740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa01acba0 con 0x55dc28e5c350 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6aace32740 10 client.0 _ll_register_callbacks cb 0x7f6a90004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6a9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29222770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6a9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29222770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46382/0 (socket says 172.21.15.92:46382) 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6a9ffff640 1 -- 172.21.15.92:0/2172440625 learned_addr learned my addr 172.21.15.92:0/2172440625 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:44.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e3b670 0x55dc29222cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6aa4e5b640 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e5c350 0x55dc2928efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6a9ffff640 1 -- 172.21.15.92:0/2172440625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e5c350 msgr2=0x55dc2928efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e5c350 0x55dc2928efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6a9ffff640 1 -- 172.21.15.92:0/2172440625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e3b670 msgr2=0x55dc29222cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e3b670 0x55dc29222cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6a9ffff640 1 -- 172.21.15.92:0/2172440625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc29201860 con 0x55dc28e33490 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.862+0000 7f6aa4e5b640 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e5c350 0x55dc2928efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6a9ffff640 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29222770 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6a90001eb0 tx=0x7f6a9000b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd9ce54218c5727 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6a7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/2172440625 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90028040 con 0x55dc28e33490 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/2172440625 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6a90019620 con 0x55dc28e33490 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6aace32740 1 -- 172.21.15.92:0/2172440625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a9805b030 con 0x55dc28e33490 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/2172440625 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6a90019820 con 0x55dc28e33490 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6aace32740 10 client.17103 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:44.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6aace32740 1 -- 172.21.15.92:0/2172440625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dc292903f0 con 0x55dc28e33490 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/2172440625 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a9805b030 con 0x55dc28e33490 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/2172440625 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6a90022040 con 0x55dc28e33490 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6aace32740 10 client.17103 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6aace32740 10 client.17103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6aace32740 20 client.17103 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.863+0000 7f6aace32740 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dc28df0080 0x55dc29292c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.864+0000 7f6aace32740 4 client.17103 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.864+0000 7f6aace32740 1 -- 172.21.15.92:0/2172440625 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dc29177860 con 0x55dc28df0080 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.864+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dc28df0080 0x55dc29292c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.864+0000 7f6a9f7fe640 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dc28df0080 0x55dc29292c30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6192c5064f40b210 server_cookie=5dd4ce520519008c in_seq=0 out_seq=0 2024-09-21T07:17:44.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.864+0000 7f6a7f7fe640 10 client.17103 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:44.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6a7f7fe640 1 -- 172.21.15.92:0/2172440625 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dc29177860 con 0x55dc28df0080 2024-09-21T07:17:44.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6a7f7fe640 10 client.17103 handle_command_reply: tid=0 2024-09-21T07:17:44.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 client.17103 shutdown 2024-09-21T07:17:44.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 -- 172.21.15.92:0/2172440625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 msgr2=0x55dc29222770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:44.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29222770 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6a90001eb0 tx=0x7f6a9000b4c0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 -- 172.21.15.92:0/2172440625 shutdown_connections 2024-09-21T07:17:44.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55dc28df0080 0x55dc29292c30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc28e5c350 0x55dc2928efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dc28e3b670 0x55dc29222cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 --2- 172.21.15.92:0/2172440625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc28e33490 0x55dc29222770 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 -- 172.21.15.92:0/2172440625 >> 172.21.15.92:0/2172440625 conn(0x55dc28e50740 msgr2=0x55dc29204bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6a7f7fe640 0 client.17103 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 -- 172.21.15.92:0/2172440625 shutdown_connections 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.866+0000 7f6aace32740 1 -- 172.21.15.92:0/2172440625 wait complete. 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aace32740 20 client.17103 trim_cache size 0 max 16384 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "292dce6e-19f6-49e4-b6d9-4413b78c9bb9", 2024-09-21T07:17:44.872 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:17:44.873 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:17:44.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 -- 172.21.15.92:0/1879112318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a880b6680 msgr2=0x7f6a880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:44.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a880b6680 0x7f6a880b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6a94005940 tx=0x7f6a94005fd0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 -- 172.21.15.92:0/1879112318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aa0108d30 msgr2=0x7f6aa019eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:44.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aa0108d30 0x7f6aa019eb30 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800eaa0 tx=0x7f6a9800ef60 comp rx=0 tx=0).stop 2024-09-21T07:17:44.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 -- 172.21.15.92:0/1879112318 shutdown_connections 2024-09-21T07:17:44.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6a880b6680 0x7f6a880b8b90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aa0108d30 0x7f6aa019eb30 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6aa01083e0 0x7f6aa0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 --2- 172.21.15.92:0/1879112318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6aa0103240 0x7f6aa01992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:44.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 -- 172.21.15.92:0/1879112318 >> 172.21.15.92:0/1879112318 conn(0x7f6aa0077cc0 msgr2=0x7f6aa01044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:44.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 -- 172.21.15.92:0/1879112318 shutdown_connections 2024-09-21T07:17:44.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:44.867+0000 7f6aa68be640 1 -- 172.21.15.92:0/1879112318 wait complete. 2024-09-21T07:17:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:44 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:17:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:44 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:17:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:44 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:17:45.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:44 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:17:45.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:44 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:17:45.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:44 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:17:45.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:44 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:17:45.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:44 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:17:45.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:44 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:17:45.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:44 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:17:45.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:44 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:17:45.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:44 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:17:45.989 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:17:46.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:45 smithi175 ceph-mon[34064]: pgmap v480: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-21T07:17:46.279 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:46.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:45 smithi092 ceph-mon[30987]: pgmap v480: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-21T07:17:46.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:45 smithi169 ceph-mon[33705]: pgmap v480: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-09-21T07:17:46.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.779+0000 7f471d262640 1 -- 172.21.15.92:0/2722586527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4718109eb0 msgr2=0x7f47181106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.779+0000 7f471d262640 1 --2- 172.21.15.92:0/2722586527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4718109eb0 0x7f47181106e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4710009900 tx=0x7f471002a410 comp rx=0 tx=0).stop 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.779+0000 7f471d262640 1 -- 172.21.15.92:0/2722586527 shutdown_connections 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.779+0000 7f471d262640 1 --2- 172.21.15.92:0/2722586527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4718109eb0 0x7f47181106e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.779+0000 7f471d262640 1 --2- 172.21.15.92:0/2722586527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4718109560 0x7f4718109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.779+0000 7f471d262640 1 --2- 172.21.15.92:0/2722586527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4718102080 0x7f4718102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.779+0000 7f471d262640 1 -- 172.21.15.92:0/2722586527 >> 172.21.15.92:0/2722586527 conn(0x7f4718079ec0 msgr2=0x7f471807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.779+0000 7f471d262640 1 -- 172.21.15.92:0/2722586527 shutdown_connections 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.779+0000 7f471d262640 1 -- 172.21.15.92:0/2722586527 wait complete. 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.780+0000 7f471d262640 1 Processor -- start 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f471d262640 1 -- start start 2024-09-21T07:17:46.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f471d262640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4718102080 0x7f471819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f471d262640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4718109560 0x7f471819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f471d262640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4718109eb0 0x7f471819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f471d262640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4718113a20 con 0x7f4718109eb0 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f471d262640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f47181138a0 con 0x7f4718102080 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f471d262640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4718113ba0 con 0x7f4718109560 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f47177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4718109eb0 0x7f471819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f47177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4718109eb0 0x7f471819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46396/0 (socket says 172.21.15.92:46396) 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f47177fe640 1 -- 172.21.15.92:0/15205379 learned_addr learned my addr 172.21.15.92:0/15205379 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f4716ffd640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4718102080 0x7f471819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f47167fc640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4718109560 0x7f471819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f47177fe640 1 -- 172.21.15.92:0/15205379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4718109560 msgr2=0x7f471819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f47177fe640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4718109560 0x7f471819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f47177fe640 1 -- 172.21.15.92:0/15205379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4718102080 msgr2=0x7f471819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:46.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f47177fe640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4718102080 0x7f471819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.781+0000 7f47177fe640 1 -- 172.21.15.92:0/15205379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47181a0280 con 0x7f4718109eb0 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.782+0000 7f47177fe640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4718109eb0 0x7f471819fc10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f4710005ab0 tx=0x7f47100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.782+0000 7f46fffff640 1 -- 172.21.15.92:0/15205379 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471003f030 con 0x7f4718109eb0 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.782+0000 7f471d262640 1 -- 172.21.15.92:0/15205379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47181a0510 con 0x7f4718109eb0 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.782+0000 7f46fffff640 1 -- 172.21.15.92:0/15205379 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4710003c90 con 0x7f4718109eb0 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.782+0000 7f46fffff640 1 -- 172.21.15.92:0/15205379 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710035070 con 0x7f4718109eb0 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.782+0000 7f471d262640 1 -- 172.21.15.92:0/15205379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47181a09f0 con 0x7f4718109eb0 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f47237d6740 1 Processor -- start 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f46fffff640 1 -- 172.21.15.92:0/15205379 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f4710042030 con 0x7f4718109eb0 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f47237d6740 1 -- start start 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f47237d6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d0107070 0x55b9d04ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f47237d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00de1b0 0x55b9d04ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f47237d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 0x55b9d04aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f47237d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b9d0424e50 con 0x55b9d00de1b0 2024-09-21T07:17:46.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f47237d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b9d0414280 con 0x55b9d00e6390 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f47237d6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b9d0418090 con 0x55b9d0107070 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f4716ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00de1b0 0x55b9d04ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f4716ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00de1b0 0x55b9d04ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46402/0 (socket says 172.21.15.92:46402) 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f4716ffd640 1 -- 172.21.15.92:0/3019408421 learned_addr learned my addr 172.21.15.92:0/3019408421 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f47167fc640 1 --2- 172.21.15.92:0/3019408421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d0107070 0x55b9d04ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f47167fc640 1 --2- 172.21.15.92:0/3019408421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 0x55b9d04aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f4716ffd640 1 -- 172.21.15.92:0/3019408421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d0107070 msgr2=0x55b9d04ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f46fffff640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47000b66b0 0x7f47000b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f4716ffd640 1 --2- 172.21.15.92:0/3019408421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d0107070 0x55b9d04ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f4716ffd640 1 -- 172.21.15.92:0/3019408421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 msgr2=0x55b9d04aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f4716ffd640 1 --2- 172.21.15.92:0/3019408421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 0x55b9d04aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.785+0000 7f4716ffd640 1 -- 172.21.15.92:0/3019408421 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9d0172650 con 0x55b9d00de1b0 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.786+0000 7f47167fc640 1 --2- 172.21.15.92:0/3019408421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 0x55b9d04aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:46.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.786+0000 7f47177fe640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47000b66b0 0x7f47000b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.786+0000 7f4716ffd640 1 --2- 172.21.15.92:0/3019408421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00de1b0 0x55b9d04ae7b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f470800af40 tx=0x7f470800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e055d30b43d15a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.786+0000 7f46fffff640 1 -- 172.21.15.92:0/15205379 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4710107fe0 con 0x7f4718109eb0 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.786+0000 7f46fd7fa640 1 -- 172.21.15.92:0/3019408421 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470801d070 con 0x55b9d00de1b0 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.786+0000 7f46fd7fa640 1 -- 172.21.15.92:0/3019408421 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4708010cd0 con 0x55b9d00de1b0 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.786+0000 7f46fd7fa640 1 -- 172.21.15.92:0/3019408421 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708018c40 con 0x55b9d00de1b0 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 -- 172.21.15.92:0/3019408421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00de1b0 msgr2=0x55b9d04ae7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47177fe640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47000b66b0 0x7f47000b8bc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4710105440 tx=0x7f4710009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 --2- 172.21.15.92:0/3019408421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00de1b0 0x55b9d04ae7b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f470800af40 tx=0x7f470800f850 comp rx=0 tx=0).stop 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 -- 172.21.15.92:0/3019408421 shutdown_connections 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 --2- 172.21.15.92:0/3019408421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 0x55b9d04aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 --2- 172.21.15.92:0/3019408421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00de1b0 0x55b9d04ae7b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 --2- 172.21.15.92:0/3019408421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d0107070 0x55b9d04ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 -- 172.21.15.92:0/3019408421 >> 172.21.15.92:0/3019408421 conn(0x55b9d00fb460 msgr2=0x55b9d04ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 -- 172.21.15.92:0/3019408421 shutdown_connections 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 -- 172.21.15.92:0/3019408421 wait complete. 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 -- start start 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.787+0000 7f47237d6740 1 Processor -- start 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f47237d6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00de1b0 0x55b9d04bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f47237d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00e6390 0x55b9d04be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f47237d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d0107070 0x55b9d04ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f47237d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b9d0275700 con 0x55b9d00e6390 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f47237d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b9d03af110 con 0x55b9d0107070 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f47237d6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b9d04c0db0 con 0x55b9d00de1b0 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f47237d6740 10 client.0 _ll_register_callbacks cb 0x55b9d03c8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f4716ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00e6390 0x55b9d04be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f4716ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00e6390 0x55b9d04be2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46410/0 (socket says 172.21.15.92:46410) 2024-09-21T07:17:46.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f4716ffd640 1 -- 172.21.15.92:0/975004185 learned_addr learned my addr 172.21.15.92:0/975004185 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f47167fc640 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00de1b0 0x55b9d04bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f47167fc640 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d0107070 0x55b9d04ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f4716ffd640 1 -- 172.21.15.92:0/975004185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00de1b0 msgr2=0x55b9d04bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f4716ffd640 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00de1b0 0x55b9d04bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f4716ffd640 1 -- 172.21.15.92:0/975004185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d0107070 msgr2=0x55b9d04ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f4716ffd640 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d0107070 0x55b9d04ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f4716ffd640 1 -- 172.21.15.92:0/975004185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9d03dcc40 con 0x55b9d00e6390 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f47167fc640 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d0107070 0x55b9d04ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f4716ffd640 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00e6390 0x55b9d04be2b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4708005c40 tx=0x7f470800a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa093b7be04f9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f46faff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.788+0000 7f46faff5640 1 -- 172.21.15.92:0/975004185 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708026020 con 0x55b9d00e6390 2024-09-21T07:17:46.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f46faff5640 1 -- 172.21.15.92:0/975004185 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4708018d90 con 0x55b9d00e6390 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f47237d6740 1 -- 172.21.15.92:0/975004185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4708010cd0 con 0x55b9d00e6390 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f46faff5640 1 -- 172.21.15.92:0/975004185 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4708031050 con 0x55b9d00e6390 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f47237d6740 10 client.17115 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f47237d6740 1 -- 172.21.15.92:0/975004185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b9d04ccaa0 con 0x55b9d00e6390 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f46faff5640 1 -- 172.21.15.92:0/975004185 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4708010cd0 con 0x55b9d00e6390 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f46faff5640 1 -- 172.21.15.92:0/975004185 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4708005340 con 0x55b9d00e6390 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f47237d6740 10 client.17115 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f47237d6740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f47237d6740 20 client.17115 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f47237d6740 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b9d00c59f0 0x55b9d04cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f47237d6740 4 client.17115 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.789+0000 7f47237d6740 1 -- 172.21.15.92:0/975004185 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9d0426da0 con 0x55b9d00c59f0 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.790+0000 7f47167fc640 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b9d00c59f0 0x55b9d04cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.790+0000 7f46faff5640 10 client.17115 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.790+0000 7f47167fc640 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b9d00c59f0 0x55b9d04cfeb0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26b9c820431ce445 server_cookie=48f594e5422f8aa1 in_seq=0 out_seq=0 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f46faff5640 1 -- 172.21.15.92:0/975004185 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b9d0426da0 con 0x55b9d00c59f0 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f46faff5640 10 client.17115 handle_command_reply: tid=0 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 client.17115 shutdown 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 -- 172.21.15.92:0/975004185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00e6390 msgr2=0x55b9d04be2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00e6390 0x55b9d04be2b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4708005c40 tx=0x7f470800a3c0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 -- 172.21.15.92:0/975004185 shutdown_connections 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b9d00c59f0 0x55b9d04cfeb0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d0107070 0x55b9d04ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d00e6390 0x55b9d04be2b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f46faff5640 0 client.17115 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 --2- 172.21.15.92:0/975004185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00de1b0 0x55b9d04bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 -- 172.21.15.92:0/975004185 >> 172.21.15.92:0/975004185 conn(0x55b9d00fb460 msgr2=0x55b9d04aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:46.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 -- 172.21.15.92:0/975004185 shutdown_connections 2024-09-21T07:17:46.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 1 -- 172.21.15.92:0/975004185 wait complete. 2024-09-21T07:17:46.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.791+0000 7f47237d6740 20 client.17115 trim_cache size 0 max 16384 2024-09-21T07:17:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.808+0000 7f47237d6740 1 Processor -- start 2024-09-21T07:17:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.808+0000 7f47237d6740 1 -- start start 2024-09-21T07:17:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.808+0000 7f47237d6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00de1b0 0x55b9d04b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.808+0000 7f47237d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 0x55b9d04bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.808+0000 7f47237d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d0107070 0x55b9d04ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.808+0000 7f47237d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47181aebb0 con 0x55b9d0107070 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.808+0000 7f47237d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f47181b06f0 con 0x55b9d00e6390 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.808+0000 7f47237d6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f47181af280 con 0x55b9d00de1b0 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f47167fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d0107070 0x55b9d04ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f47167fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d0107070 0x55b9d04ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46414/0 (socket says 172.21.15.92:46414) 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f47167fc640 1 -- 172.21.15.92:0/3800952153 learned_addr learned my addr 172.21.15.92:0/3800952153 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f4716ffd640 1 --2- 172.21.15.92:0/3800952153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 0x55b9d04bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f47167fc640 1 --2- 172.21.15.92:0/3800952153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00de1b0 0x55b9d04b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f47167fc640 1 -- 172.21.15.92:0/3800952153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00de1b0 msgr2=0x55b9d04b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f47167fc640 1 --2- 172.21.15.92:0/3800952153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00de1b0 0x55b9d04b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f47167fc640 1 -- 172.21.15.92:0/3800952153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 msgr2=0x55b9d04bf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f47167fc640 1 --2- 172.21.15.92:0/3800952153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 0x55b9d04bf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f47167fc640 1 -- 172.21.15.92:0/3800952153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9d04b10a0 con 0x55b9d0107070 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f47167fc640 1 --2- 172.21.15.92:0/3800952153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d0107070 0x55b9d04ca080 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f470c010610 tx=0x7f470c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad12a7129307199 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f46fcff9640 1 -- 172.21.15.92:0/3800952153 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c010e50 con 0x55b9d0107070 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f46fcff9640 1 -- 172.21.15.92:0/3800952153 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f470c00fd80 con 0x55b9d0107070 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.809+0000 7f46fcff9640 1 -- 172.21.15.92:0/3800952153 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c028b00 con 0x55b9d0107070 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.810+0000 7f47237d6740 1 -- 172.21.15.92:0/3800952153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d0107070 msgr2=0x55b9d04ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.810+0000 7f47237d6740 1 --2- 172.21.15.92:0/3800952153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d0107070 0x55b9d04ca080 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f470c010610 tx=0x7f470c00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.810+0000 7f47237d6740 1 -- 172.21.15.92:0/3800952153 shutdown_connections 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.810+0000 7f47237d6740 1 --2- 172.21.15.92:0/3800952153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d0107070 0x55b9d04ca080 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.810+0000 7f47237d6740 1 --2- 172.21.15.92:0/3800952153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00e6390 0x55b9d04bf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.810+0000 7f47237d6740 1 --2- 172.21.15.92:0/3800952153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00de1b0 0x55b9d04b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.810+0000 7f47237d6740 1 -- 172.21.15.92:0/3800952153 >> 172.21.15.92:0/3800952153 conn(0x55b9d00fb460 msgr2=0x55b9d04bf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.810+0000 7f47237d6740 1 -- 172.21.15.92:0/3800952153 shutdown_connections 2024-09-21T07:17:46.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.810+0000 7f47237d6740 1 -- 172.21.15.92:0/3800952153 wait complete. 2024-09-21T07:17:46.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47237d6740 1 -- start start 2024-09-21T07:17:46.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47237d6740 1 Processor -- start 2024-09-21T07:17:46.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47237d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00de1b0 0x55b9d0532910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47237d6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00e6390 0x55b9d0532ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47237d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d009ada0 0x55b9d04d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47237d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47181b0020 con 0x55b9d009ada0 2024-09-21T07:17:46.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47237d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f47181af950 con 0x55b9d00de1b0 2024-09-21T07:17:46.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47237d6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f47181acb90 con 0x55b9d00e6390 2024-09-21T07:17:46.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47237d6740 10 client.0 _ll_register_callbacks cb 0x7f470801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:46.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47167fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d009ada0 0x55b9d04d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47167fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d009ada0 0x55b9d04d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46418/0 (socket says 172.21.15.92:46418) 2024-09-21T07:17:46.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47167fc640 1 -- 172.21.15.92:0/2037219530 learned_addr learned my addr 172.21.15.92:0/2037219530 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:46.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47167fc640 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00de1b0 0x55b9d0532910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f4716ffd640 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00e6390 0x55b9d0532ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47167fc640 1 -- 172.21.15.92:0/2037219530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00e6390 msgr2=0x55b9d0532ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:46.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47167fc640 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00e6390 0x55b9d0532ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47167fc640 1 -- 172.21.15.92:0/2037219530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00de1b0 msgr2=0x55b9d0532910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:46.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.811+0000 7f47167fc640 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00de1b0 0x55b9d0532910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f47167fc640 1 -- 172.21.15.92:0/2037219530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9d04af060 con 0x55b9d009ada0 2024-09-21T07:17:46.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f47167fc640 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d009ada0 0x55b9d04d17a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f470c010fd0 tx=0x7f470c00a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496b44da1d3ec6ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:46.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f46faff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:46.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f46faff5640 1 -- 172.21.15.92:0/2037219530 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c0225d0 con 0x55b9d009ada0 2024-09-21T07:17:46.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f46faff5640 1 -- 172.21.15.92:0/2037219530 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f470c022770 con 0x55b9d009ada0 2024-09-21T07:17:46.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f47237d6740 1 -- 172.21.15.92:0/2037219530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f470c00fd80 con 0x55b9d009ada0 2024-09-21T07:17:46.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f46faff5640 1 -- 172.21.15.92:0/2037219530 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f470c03e050 con 0x55b9d009ada0 2024-09-21T07:17:46.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f47237d6740 10 client.17121 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:46.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f47237d6740 1 -- 172.21.15.92:0/2037219530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b9d053b040 con 0x55b9d009ada0 2024-09-21T07:17:46.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f46faff5640 1 -- 172.21.15.92:0/2037219530 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f470c00fd80 con 0x55b9d009ada0 2024-09-21T07:17:46.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.812+0000 7f46faff5640 1 -- 172.21.15.92:0/2037219530 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f470c036020 con 0x55b9d009ada0 2024-09-21T07:17:46.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f47237d6740 10 client.17121 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:46.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f47237d6740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:46.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f47237d6740 20 client.17121 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:46.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f47237d6740 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b9d053b5c0 0x55b9d053d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:46.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f47237d6740 4 client.17121 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:17:46.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f47237d6740 1 -- 172.21.15.92:0/2037219530 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b9d0422850 con 0x55b9d053b5c0 2024-09-21T07:17:46.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f4716ffd640 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b9d053b5c0 0x55b9d053d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f4716ffd640 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b9d053b5c0 0x55b9d053d9e0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31c418263b0b64fa server_cookie=20784d1c723c42b2 in_seq=0 out_seq=0 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f46faff5640 10 client.17121 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f46faff5640 1 -- 172.21.15.92:0/2037219530 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55b9d0422850 con 0x55b9d053b5c0 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f46faff5640 10 client.17121 handle_command_reply: tid=0 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.813+0000 7f47237d6740 1 client.17121 shutdown 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 1 -- 172.21.15.92:0/2037219530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d009ada0 msgr2=0x55b9d04d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d009ada0 0x55b9d04d17a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f470c010fd0 tx=0x7f470c00a6c0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 1 -- 172.21.15.92:0/2037219530 shutdown_connections 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b9d053b5c0 0x55b9d053d9e0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9d009ada0 0x55b9d04d17a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d00e6390 0x55b9d0532ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 1 --2- 172.21.15.92:0/2037219530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b9d00de1b0 0x55b9d0532910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 1 -- 172.21.15.92:0/2037219530 >> 172.21.15.92:0/2037219530 conn(0x55b9d00fb460 msgr2=0x55b9d04b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:46.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f46faff5640 0 client.17121 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:46.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 1 -- 172.21.15.92:0/2037219530 shutdown_connections 2024-09-21T07:17:46.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 1 -- 172.21.15.92:0/2037219530 wait complete. 2024-09-21T07:17:46.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f47237d6740 20 client.17121 trim_cache size 0 max 16384 2024-09-21T07:17:46.826 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:17:46.827 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:17:46.827 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:17:46.827 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:17:46.827 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:46.827 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "292dce6e-19f6-49e4-b6d9-4413b78c9bb9", 2024-09-21T07:17:46.827 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:17:46.827 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:17:46.827 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:17:46.827 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:46.828 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:17:46.829 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:46.830 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:17:46.831 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:17:46.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f471d262640 1 -- 172.21.15.92:0/15205379 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47000b66b0 msgr2=0x7f47000b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:46.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f471d262640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47000b66b0 0x7f47000b8bc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4710105440 tx=0x7f4710009260 comp rx=0 tx=0).stop 2024-09-21T07:17:46.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f471d262640 1 -- 172.21.15.92:0/15205379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4718109eb0 msgr2=0x7f471819fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:46.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f471d262640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4718109eb0 0x7f471819fc10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f4710005ab0 tx=0x7f47100042f0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f471d262640 1 -- 172.21.15.92:0/15205379 shutdown_connections 2024-09-21T07:17:46.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f471d262640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f47000b66b0 0x7f47000b8bc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f471d262640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4718109eb0 0x7f471819fc10 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f471d262640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4718109560 0x7f471819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f471d262640 1 --2- 172.21.15.92:0/15205379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4718102080 0x7f471819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:46.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.814+0000 7f471d262640 1 -- 172.21.15.92:0/15205379 >> 172.21.15.92:0/15205379 conn(0x7f4718079ec0 msgr2=0x7f47181054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:46.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.815+0000 7f471d262640 1 -- 172.21.15.92:0/15205379 shutdown_connections 2024-09-21T07:17:46.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:46.815+0000 7f471d262640 1 -- 172.21.15.92:0/15205379 wait complete. 2024-09-21T07:17:47.676 INFO:tasks.cephfs.filesystem:scrub status for tag:292dce6e-19f6-49e4-b6d9-4413b78c9bb9 - {'path': '/', 'tag': '292dce6e-19f6-49e4-b6d9-4413b78c9bb9', 'options': 'recursive,force'} 2024-09-21T07:17:47.889 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:17:47.889 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:17:47.889 INFO:tasks.workunit.client.0.smithi092.stdout: 2024-09-21T07:17:47.889 INFO:tasks.workunit.client.0.smithi092.stdout:iozone test complete. 2024-09-21T07:17:47.890 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T07:17:47.890 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T07:17:47.932 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-09-21T07:17:47.932 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T07:17:48.251 DEBUG:teuthology.parallel:result is None 2024-09-21T07:17:48.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T07:17:48.291 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T07:17:48.291 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T07:17:48.309 INFO:tasks.quiescer:joining Quiescers 2024-09-21T07:17:48.309 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T07:17:48.309 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:17:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:48.950 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:48 smithi092 ceph-mon[30987]: pgmap v481: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-21T07:17:49.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.032+0000 7f77971bc640 1 -- 172.21.15.92:0/2324758659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77901049b0 msgr2=0x7f7790104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:49.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.032+0000 7f77971bc640 1 --2- 172.21.15.92:0/2324758659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77901049b0 0x7f7790104dc0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7780009900 tx=0x7f778002a410 comp rx=0 tx=0).stop 2024-09-21T07:17:49.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.032+0000 7f77971bc640 1 -- 172.21.15.92:0/2324758659 shutdown_connections 2024-09-21T07:17:49.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.032+0000 7f77971bc640 1 --2- 172.21.15.92:0/2324758659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f779010de10 0x7f7790110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.032+0000 7f77971bc640 1 --2- 172.21.15.92:0/2324758659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7790105300 0x7f779010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.032+0000 7f77971bc640 1 --2- 172.21.15.92:0/2324758659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77901049b0 0x7f7790104dc0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.032+0000 7f77971bc640 1 -- 172.21.15.92:0/2324758659 >> 172.21.15.92:0/2324758659 conn(0x7f7790079730 msgr2=0x7f7790079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.032+0000 7f77971bc640 1 -- 172.21.15.92:0/2324758659 shutdown_connections 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.032+0000 7f77971bc640 1 -- 172.21.15.92:0/2324758659 wait complete. 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f77971bc640 1 Processor -- start 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f77971bc640 1 -- start start 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f77971bc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77901049b0 0x7f779019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f77971bc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7790105300 0x7f779019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f77971bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f779010de10 0x7f779019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f77971bc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7790113a00 con 0x7f779010de10 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f77971bc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7790113880 con 0x7f7790105300 2024-09-21T07:17:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f77971bc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7790113b80 con 0x7f77901049b0 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f7795759640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f779010de10 0x7f779019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f7795759640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f779010de10 0x7f779019fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46438/0 (socket says 172.21.15.92:46438) 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f7795759640 1 -- 172.21.15.92:0/7162215 learned_addr learned my addr 172.21.15.92:0/7162215 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.033+0000 7f778ffff640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7790105300 0x7f779019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f7794f58640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77901049b0 0x7f779019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f7795759640 1 -- 172.21.15.92:0/7162215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77901049b0 msgr2=0x7f779019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f7795759640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77901049b0 0x7f779019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f7795759640 1 -- 172.21.15.92:0/7162215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7790105300 msgr2=0x7f779019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f7795759640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7790105300 0x7f779019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f7795759640 1 -- 172.21.15.92:0/7162215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77901a0500 con 0x7f779010de10 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f778ffff640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7790105300 0x7f779019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f7795759640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f779010de10 0x7f779019fdd0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f778800b970 tx=0x7f778800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f778dffb640 1 -- 172.21.15.92:0/7162215 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788019070 con 0x7f779010de10 2024-09-21T07:17:49.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f778dffb640 1 -- 172.21.15.92:0/7162215 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7788014440 con 0x7f779010de10 2024-09-21T07:17:49.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f77971bc640 1 -- 172.21.15.92:0/7162215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77901a07f0 con 0x7f779010de10 2024-09-21T07:17:49.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f778dffb640 1 -- 172.21.15.92:0/7162215 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77880075d0 con 0x7f779010de10 2024-09-21T07:17:49.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.034+0000 7f77971bc640 1 -- 172.21.15.92:0/7162215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77901a6f50 con 0x7f779010de10 2024-09-21T07:17:49.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.035+0000 7f77971bc640 1 -- 172.21.15.92:0/7162215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7790104e40 con 0x7f779010de10 2024-09-21T07:17:49.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.037+0000 7f778dffb640 1 -- 172.21.15.92:0/7162215 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f778801c070 con 0x7f779010de10 2024-09-21T07:17:49.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.037+0000 7f778dffb640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77780b6680 0x7f77780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:49.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.037+0000 7f7794f58640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77780b6680 0x7f77780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:49.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.037+0000 7f778dffb640 1 -- 172.21.15.92:0/7162215 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f77880e74c0 con 0x7f779010de10 2024-09-21T07:17:49.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.038+0000 7f7794f58640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77780b6680 0x7f77780b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7780005f70 tx=0x7f7780000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:49.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.041+0000 7f778dffb640 1 -- 172.21.15.92:0/7162215 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77880ad670 con 0x7f779010de10 2024-09-21T07:17:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:48 smithi169 ceph-mon[33705]: pgmap v481: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-21T07:17:49.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.256+0000 7f77971bc640 1 -- 172.21.15.92:0/7162215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f779019b6c0 con 0x7f779010de10 2024-09-21T07:17:49.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.256+0000 7f778dffb640 1 -- 172.21.15.92:0/7162215 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f77880b1a50 con 0x7f779010de10 2024-09-21T07:17:49.259 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:17:49.259 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:17:49.259 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:17:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 -- 172.21.15.92:0/7162215 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77780b6680 msgr2=0x7f77780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77780b6680 0x7f77780b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7780005f70 tx=0x7f7780000bc0 comp rx=0 tx=0).stop 2024-09-21T07:17:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 -- 172.21.15.92:0/7162215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f779010de10 msgr2=0x7f779019fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f779010de10 0x7f779019fdd0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f778800b970 tx=0x7f778800be30 comp rx=0 tx=0).stop 2024-09-21T07:17:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 -- 172.21.15.92:0/7162215 shutdown_connections 2024-09-21T07:17:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f77780b6680 0x7f77780b8b90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f779010de10 0x7f779019fdd0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7790105300 0x7f779019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:49.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 --2- 172.21.15.92:0/7162215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77901049b0 0x7f779019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:49.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 -- 172.21.15.92:0/7162215 >> 172.21.15.92:0/7162215 conn(0x7f7790079730 msgr2=0x7f77900ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:49.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 -- 172.21.15.92:0/7162215 shutdown_connections 2024-09-21T07:17:49.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:49.259+0000 7f77971bc640 1 -- 172.21.15.92:0/7162215 wait complete. 2024-09-21T07:17:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:48 smithi175 ceph-mon[34064]: pgmap v481: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-21T07:17:50.062 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:49 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/7162215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:17:50.113 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24649 quiesce db --cancel --all' 2024-09-21T07:17:50.113 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24649 quiesce db --cancel --all 2024-09-21T07:17:50.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:49 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/7162215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:17:50.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:49 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/7162215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:17:50.559 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:17:51.007 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:50 smithi092 ceph-mon[30987]: pgmap v482: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-21T07:17:51.007 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:50 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:17:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:50 smithi169 ceph-mon[33705]: pgmap v482: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-21T07:17:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:50 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:17:51.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.149+0000 7f8bb55cc640 1 -- 172.21.15.92:0/2564600197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba809a970 msgr2=0x7f8ba809ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.149+0000 7f8bb55cc640 1 --2- 172.21.15.92:0/2564600197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba809a970 0x7f8ba809ad80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009980 tx=0x7f8ba402c620 comp rx=0 tx=0).stop 2024-09-21T07:17:51.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.149+0000 7f8bb55cc640 1 -- 172.21.15.92:0/2564600197 shutdown_connections 2024-09-21T07:17:51.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.149+0000 7f8bb55cc640 1 --2- 172.21.15.92:0/2564600197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba809b2c0 0x7f8ba80a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.149+0000 7f8bb55cc640 1 --2- 172.21.15.92:0/2564600197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba809a970 0x7f8ba809ad80 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.149+0000 7f8bb55cc640 1 --2- 172.21.15.92:0/2564600197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba8095080 0x7f8ba8095490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.149+0000 7f8bb55cc640 1 -- 172.21.15.92:0/2564600197 >> 172.21.15.92:0/2564600197 conn(0x7f8ba800cbe0 msgr2=0x7f8ba800d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.149+0000 7f8bb55cc640 1 -- 172.21.15.92:0/2564600197 shutdown_connections 2024-09-21T07:17:51.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.149+0000 7f8bb55cc640 1 -- 172.21.15.92:0/2564600197 wait complete. 2024-09-21T07:17:51.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.150+0000 7f8bb55cc640 1 Processor -- start 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.150+0000 7f8bb55cc640 1 -- start start 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.150+0000 7f8bb55cc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba8095080 0x7f8ba812a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.150+0000 7f8bb55cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba809a970 0x7f8ba812ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.150+0000 7f8bb55cc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba809b2c0 0x7f8ba812ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.150+0000 7f8bae7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba809a970 0x7f8ba812ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.150+0000 7f8bae7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba809a970 0x7f8ba812ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36876/0 (socket says 172.21.15.92:36876) 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bae7fc640 1 -- 172.21.15.92:0/3639389033 learned_addr learned my addr 172.21.15.92:0/3639389033 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba80a3d30 con 0x7f8ba809a970 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba80a3bb0 con 0x7f8ba8095080 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8baeffd640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba8095080 0x7f8ba812a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba80a3eb0 con 0x7f8ba809b2c0 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8baf7fe640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba809b2c0 0x7f8ba812ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bae7fc640 1 -- 172.21.15.92:0/3639389033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba809b2c0 msgr2=0x7f8ba812ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba809b2c0 0x7f8ba812ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bae7fc640 1 -- 172.21.15.92:0/3639389033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba8095080 msgr2=0x7f8ba812a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba8095080 0x7f8ba812a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bae7fc640 1 -- 172.21.15.92:0/3639389033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba8130710 con 0x7f8ba809a970 2024-09-21T07:17:51.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba809a970 0x7f8ba812ad40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4005940 tx=0x7f8ba40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8b97fff640 1 -- 172.21.15.92:0/3639389033 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4043030 con 0x7f8ba809a970 2024-09-21T07:17:51.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8b97fff640 1 -- 172.21.15.92:0/3639389033 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ba403fbf0 con 0x7f8ba809a970 2024-09-21T07:17:51.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba81309a0 con 0x7f8ba809a970 2024-09-21T07:17:51.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8b97fff640 1 -- 172.21.15.92:0/3639389033 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4037070 con 0x7f8ba809a970 2024-09-21T07:17:51.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.151+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba8137160 con 0x7f8ba809a970 2024-09-21T07:17:51.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.154+0000 7f8bbbb40740 1 Processor -- start 2024-09-21T07:17:51.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8bbbb40740 1 -- start start 2024-09-21T07:17:51.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bf9a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bf9af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56009bf10dd0 con 0x56009bbca410 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56009bf00200 con 0x56009bbd25f0 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56009bf04010 con 0x56009bbf32d0 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8b97fff640 1 -- 172.21.15.92:0/3639389033 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f8ba4046030 con 0x7f8ba809a970 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8baeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8baeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36884/0 (socket says 172.21.15.92:36884) 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8baeffd640 1 -- 172.21.15.92:0/1775898015 learned_addr learned my addr 172.21.15.92:0/1775898015 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8baeffd640 1 -- 172.21.15.92:0/1775898015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 msgr2=0x56009bf9a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8baf7fe640 1 --2- 172.21.15.92:0/1775898015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bf9a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8baeffd640 1 --2- 172.21.15.92:0/1775898015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bf9a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8baeffd640 1 -- 172.21.15.92:0/1775898015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 msgr2=0x56009bf9af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8baeffd640 1 --2- 172.21.15.92:0/1775898015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bf9af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8baeffd640 1 -- 172.21.15.92:0/1775898015 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009bc5e8b0 con 0x56009bbca410 2024-09-21T07:17:51.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.155+0000 7f8baf7fe640 1 --2- 172.21.15.92:0/1775898015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bf9a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.156+0000 7f8baeffd640 1 --2- 172.21.15.92:0/1775898015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9aa50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000ac10 tx=0x7f8ba000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a13208d53323afd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.156+0000 7f8b957fa640 1 -- 172.21.15.92:0/1775898015 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba001d070 con 0x56009bbca410 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.156+0000 7f8b957fa640 1 -- 172.21.15.92:0/1775898015 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ba0018ad0 con 0x56009bbca410 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.156+0000 7f8b957fa640 1 -- 172.21.15.92:0/1775898015 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0010980 con 0x56009bbca410 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.156+0000 7f8b97fff640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8b980b6680 0x7f8b980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.156+0000 7f8b97fff640 1 -- 172.21.15.92:0/3639389033 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f8ba410c0e0 con 0x7f8ba809a970 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.156+0000 7f8baf7fe640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8b980b6680 0x7f8b980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8bbbb40740 1 -- 172.21.15.92:0/1775898015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 msgr2=0x56009bf9aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8baf7fe640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8b980b6680 0x7f8b980b8b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0051230 tx=0x7f8bb0051580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/1775898015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9aa50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000ac10 tx=0x7f8ba000f790 comp rx=0 tx=0).stop 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8bbbb40740 1 -- 172.21.15.92:0/1775898015 shutdown_connections 2024-09-21T07:17:51.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/1775898015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bf9af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/1775898015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9aa50 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/1775898015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bf9a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8bbbb40740 1 -- 172.21.15.92:0/1775898015 >> 172.21.15.92:0/1775898015 conn(0x56009bbe76c0 msgr2=0x56009bf98400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8bbbb40740 1 -- 172.21.15.92:0/1775898015 shutdown_connections 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8bbbb40740 1 -- 172.21.15.92:0/1775898015 wait complete. 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.157+0000 7f8bbbb40740 1 -- start start 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8bbbb40740 1 Processor -- start 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfa6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbd25f0 0x56009bfa66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbf32d0 0x56009bfb2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56009bd61810 con 0x56009bbca410 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56009be9b080 con 0x56009bbf32d0 2024-09-21T07:17:51.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56009bfa8cf0 con 0x56009bbd25f0 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8bbbb40740 10 client.0 _ll_register_callbacks cb 0x56009beab960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfa6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfa6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36900/0 (socket says 172.21.15.92:36900) 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baeffd640 1 -- 172.21.15.92:0/4120084244 learned_addr learned my addr 172.21.15.92:0/4120084244 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baf7fe640 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbf32d0 0x56009bfb2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbd25f0 0x56009bfa66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baeffd640 1 -- 172.21.15.92:0/4120084244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbd25f0 msgr2=0x56009bfa66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baeffd640 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbd25f0 0x56009bfa66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baeffd640 1 -- 172.21.15.92:0/4120084244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbf32d0 msgr2=0x56009bfb2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baeffd640 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbf32d0 0x56009bfb2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baeffd640 1 -- 172.21.15.92:0/4120084244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56009bea5460 con 0x56009bbca410 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baf7fe640 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbf32d0 0x56009bfb2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:51.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8baeffd640 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfa6140 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00105a0 tx=0x7f8ba0018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6cf4f90edd9c21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.158+0000 7f8b92ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:51.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8b92ff5640 1 -- 172.21.15.92:0/4120084244 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0027020 con 0x56009bbca410 2024-09-21T07:17:51.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8bbbb40740 1 -- 172.21.15.92:0/4120084244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ba0018ad0 con 0x56009bbca410 2024-09-21T07:17:51.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8b92ff5640 1 -- 172.21.15.92:0/4120084244 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f8ba0005040 con 0x56009bbca410 2024-09-21T07:17:51.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8b92ff5640 1 -- 172.21.15.92:0/4120084244 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ba0032050 con 0x56009bbca410 2024-09-21T07:17:51.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8bbbb40740 10 client.17139 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:51.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8bbbb40740 1 -- 172.21.15.92:0/4120084244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56009bfb4d20 con 0x56009bbca410 2024-09-21T07:17:51.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8b92ff5640 1 -- 172.21.15.92:0/4120084244 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ba0018ad0 con 0x56009bbca410 2024-09-21T07:17:51.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8b92ff5640 1 -- 172.21.15.92:0/4120084244 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8ba00046c0 con 0x56009bbca410 2024-09-21T07:17:51.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8bbbb40740 10 client.17139 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:51.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8bbbb40740 10 client.17139 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:17:51.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8bbbb40740 20 client.17139 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:51.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56009bbb1c50 0x56009bfb80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8bbbb40740 4 client.17139 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:51.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.159+0000 7f8bbbb40740 1 -- 172.21.15.92:0/4120084244 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56009bf12d20 con 0x56009bbb1c50 2024-09-21T07:17:51.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.160+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56009bbb1c50 0x56009bfb80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.160+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56009bbb1c50 0x56009bfb80e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcb0da210ac0bf47 server_cookie=b20cab3c734c38d0 in_seq=0 out_seq=0 2024-09-21T07:17:51.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.160+0000 7f8b92ff5640 10 client.17139 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:51.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8b92ff5640 1 -- 172.21.15.92:0/4120084244 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56009bf12d20 con 0x56009bbb1c50 2024-09-21T07:17:51.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8b92ff5640 10 client.17139 handle_command_reply: tid=0 2024-09-21T07:17:51.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 client.17139 shutdown 2024-09-21T07:17:51.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 -- 172.21.15.92:0/4120084244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 msgr2=0x56009bfa6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfa6140 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00105a0 tx=0x7f8ba0018670 comp rx=0 tx=0).stop 2024-09-21T07:17:51.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 -- 172.21.15.92:0/4120084244 shutdown_connections 2024-09-21T07:17:51.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56009bbb1c50 0x56009bfb80e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbf32d0 0x56009bfb2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbd25f0 0x56009bfa66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/4120084244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfa6140 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 -- 172.21.15.92:0/4120084244 >> 172.21.15.92:0/4120084244 conn(0x56009bbe76c0 msgr2=0x56009bf9d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8b92ff5640 0 client.17139 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:51.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 -- 172.21.15.92:0/4120084244 shutdown_connections 2024-09-21T07:17:51.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 1 -- 172.21.15.92:0/4120084244 wait complete. 2024-09-21T07:17:51.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.161+0000 7f8bbbb40740 20 client.17139 trim_cache size 0 max 16384 2024-09-21T07:17:51.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8bbbb40740 1 Processor -- start 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8bbbb40740 1 -- start start 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bf9f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bf9fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba81411d0 con 0x56009bbca410 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8142d10 con 0x56009bbd25f0 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba81418a0 con 0x56009bbf32d0 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8baeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8baeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36906/0 (socket says 172.21.15.92:36906) 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8baeffd640 1 -- 172.21.15.92:0/966833200 learned_addr learned my addr 172.21.15.92:0/966833200 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8baf7fe640 1 --2- 172.21.15.92:0/966833200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bf9fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/966833200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bf9f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8baeffd640 1 -- 172.21.15.92:0/966833200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 msgr2=0x56009bf9fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8baeffd640 1 --2- 172.21.15.92:0/966833200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bf9fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8baeffd640 1 -- 172.21.15.92:0/966833200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 msgr2=0x56009bf9f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8baeffd640 1 --2- 172.21.15.92:0/966833200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bf9f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.178+0000 7f8baeffd640 1 -- 172.21.15.92:0/966833200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009bf9c800 con 0x56009bbca410 2024-09-21T07:17:51.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.179+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/966833200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bf9f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:51.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.179+0000 7f8baeffd640 1 --2- 172.21.15.92:0/966833200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9bf00 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000a6b0 tx=0x7f8ba000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b007376a13740464 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.179+0000 7f8b94ff9640 1 -- 172.21.15.92:0/966833200 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba003b070 con 0x56009bbca410 2024-09-21T07:17:51.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.179+0000 7f8b94ff9640 1 -- 172.21.15.92:0/966833200 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ba0004660 con 0x56009bbca410 2024-09-21T07:17:51.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.179+0000 7f8b94ff9640 1 -- 172.21.15.92:0/966833200 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0027040 con 0x56009bbca410 2024-09-21T07:17:51.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 -- 172.21.15.92:0/966833200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 msgr2=0x56009bf9bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/966833200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9bf00 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000a6b0 tx=0x7f8ba000f790 comp rx=0 tx=0).stop 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 -- 172.21.15.92:0/966833200 shutdown_connections 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/966833200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bf9fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/966833200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bf9f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/966833200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bf9bf00 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 -- 172.21.15.92:0/966833200 >> 172.21.15.92:0/966833200 conn(0x56009bbe76c0 msgr2=0x56009bfa1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 -- 172.21.15.92:0/966833200 shutdown_connections 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 -- 172.21.15.92:0/966833200 wait complete. 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 -- start start 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 Processor -- start 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfadfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bfae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bfa8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8142640 con 0x56009bbca410 2024-09-21T07:17:51.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8141f70 con 0x56009bbd25f0 2024-09-21T07:17:51.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba813f1b0 con 0x56009bbf32d0 2024-09-21T07:17:51.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8bbbb40740 10 client.0 _ll_register_callbacks cb 0x7f8ba000af10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:51.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.180+0000 7f8baeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfadfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8baeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfadfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36912/0 (socket says 172.21.15.92:36912) 2024-09-21T07:17:51.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8baeffd640 1 -- 172.21.15.92:0/131475543 learned_addr learned my addr 172.21.15.92:0/131475543 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:51.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8baf7fe640 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bfa8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bfae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8baeffd640 1 -- 172.21.15.92:0/131475543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 msgr2=0x56009bfa8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8baeffd640 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bfa8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8baeffd640 1 -- 172.21.15.92:0/131475543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 msgr2=0x56009bfae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8baeffd640 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bfae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8baeffd640 1 -- 172.21.15.92:0/131475543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56009bfaec30 con 0x56009bbca410 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bfae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8baeffd640 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfadfb0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0039040 tx=0x7f8ba0005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d809a8c1e4297c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8b92ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8b92ff5640 1 -- 172.21.15.92:0/131475543 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba003b070 con 0x56009bbca410 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8b92ff5640 1 -- 172.21.15.92:0/131475543 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f8ba0004220 con 0x56009bbca410 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.181+0000 7f8bbbb40740 1 -- 172.21.15.92:0/131475543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ba0004660 con 0x56009bbca410 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8b92ff5640 1 -- 172.21.15.92:0/131475543 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ba004a050 con 0x56009bbca410 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8bbbb40740 10 client.17145 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8bbbb40740 1 -- 172.21.15.92:0/131475543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56009c022cf0 con 0x56009bbca410 2024-09-21T07:17:51.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8b92ff5640 1 -- 172.21.15.92:0/131475543 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ba0004660 con 0x56009bbca410 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8b92ff5640 1 -- 172.21.15.92:0/131475543 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8ba00105a0 con 0x56009bbca410 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8bbbb40740 10 client.17145 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8bbbb40740 10 client.17145 resolve_mds: validated gid 24649 aka daemon mds.i 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8bbbb40740 20 client.17145 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56009bb87000 0x56009c0254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8bbbb40740 4 client.17145 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.182+0000 7f8bbbb40740 1 -- 172.21.15.92:0/131475543 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x56009bf0e7d0 con 0x56009bb87000 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56009bb87000 0x56009c0254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8b92ff5640 10 client.17145 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bae7fc640 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56009bb87000 0x56009c0254c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7ac64da2f736e32 server_cookie=1170fea8dcfa6b65 in_seq=0 out_seq=0 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8b92ff5640 1 -- 172.21.15.92:0/131475543 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x56009bf0e7d0 con 0x56009bb87000 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8b92ff5640 10 client.17145 handle_command_reply: tid=0 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bbbb40740 1 client.17145 shutdown 2024-09-21T07:17:51.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bbbb40740 1 -- 172.21.15.92:0/131475543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 msgr2=0x56009bfadfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfadfb0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0039040 tx=0x7f8ba0005d40 comp rx=0 tx=0).stop 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bbbb40740 1 -- 172.21.15.92:0/131475543 shutdown_connections 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56009bb87000 0x56009c0254c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009bbf32d0 0x56009bfa8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56009bbd25f0 0x56009bfae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bbbb40740 1 --2- 172.21.15.92:0/131475543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56009bbca410 0x56009bfadfb0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8bbbb40740 1 -- 172.21.15.92:0/131475543 >> 172.21.15.92:0/131475543 conn(0x56009bbe76c0 msgr2=0x56009bfa1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.183+0000 7f8b92ff5640 0 client.17145 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bbbb40740 1 -- 172.21.15.92:0/131475543 shutdown_connections 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bbbb40740 1 -- 172.21.15.92:0/131475543 wait complete. 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bbbb40740 20 client.17145 trim_cache size 0 max 16384 2024-09-21T07:17:51.191 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:17:51.192 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-09-21T07:17:51.192 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24649, 2024-09-21T07:17:51.192 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 16, 2024-09-21T07:17:51.192 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": {} 2024-09-21T07:17:51.192 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:17:51.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8b980b6680 msgr2=0x7f8b980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8b980b6680 0x7f8b980b8b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0051230 tx=0x7f8bb0051580 comp rx=0 tx=0).stop 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba809a970 msgr2=0x7f8ba812ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba809a970 0x7f8ba812ad40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4005940 tx=0x7f8ba40040e0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 shutdown_connections 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8b980b6680 0x7f8b980b8b90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ba809b2c0 0x7f8ba812ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba809a970 0x7f8ba812ad40 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 --2- 172.21.15.92:0/3639389033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ba8095080 0x7f8ba812a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 >> 172.21.15.92:0/3639389033 conn(0x7f8ba800cbe0 msgr2=0x7f8ba8098ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 shutdown_connections 2024-09-21T07:17:51.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:17:51.184+0000 7f8bb55cc640 1 -- 172.21.15.92:0/3639389033 wait complete. 2024-09-21T07:17:51.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:50 smithi175 ceph-mon[34064]: pgmap v482: 129 pgs: 129 active+clean; 20 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-21T07:17:51.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:50 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:17:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.678+0000 7f7cb61a1640 1 -- 172.21.15.92:0/2619772896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cb0108310 msgr2=0x7f7cb0108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.678+0000 7f7cb61a1640 1 --2- 172.21.15.92:0/2619772896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cb0108310 0x7f7cb0108720 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009900 tx=0x7f7ca402a410 comp rx=0 tx=0).stop 2024-09-21T07:17:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.678+0000 7f7cb61a1640 1 -- 172.21.15.92:0/2619772896 shutdown_connections 2024-09-21T07:17:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.678+0000 7f7cb61a1640 1 --2- 172.21.15.92:0/2619772896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb0108c60 0x7f7cb010f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.678+0000 7f7cb61a1640 1 --2- 172.21.15.92:0/2619772896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cb0108310 0x7f7cb0108720 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.678+0000 7f7cb61a1640 1 --2- 172.21.15.92:0/2619772896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb01029e0 0x7f7cb0102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.678+0000 7f7cb61a1640 1 -- 172.21.15.92:0/2619772896 >> 172.21.15.92:0/2619772896 conn(0x7f7cb00fe3e0 msgr2=0x7f7cb0100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.678+0000 7f7cb61a1640 1 -- 172.21.15.92:0/2619772896 shutdown_connections 2024-09-21T07:17:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.678+0000 7f7cb61a1640 1 -- 172.21.15.92:0/2619772896 wait complete. 2024-09-21T07:17:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7cb61a1640 1 Processor -- start 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7cb61a1640 1 -- start start 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7cb61a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb01029e0 0x7f7cb019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7cb61a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cb0108310 0x7f7cb019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7cb61a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb0108c60 0x7f7cb01a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7cb61a1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01127d0 con 0x7f7cb0108310 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7cb61a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb0112650 con 0x7f7cb01029e0 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7cb61a1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb0112950 con 0x7f7cb0108c60 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cb0108310 0x7f7cb019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cb0108310 0x7f7cb019cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36926/0 (socket says 172.21.15.92:36926) 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.679+0000 7f7caeffd640 1 -- 172.21.15.92:0/3411832886 learned_addr learned my addr 172.21.15.92:0/3411832886 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb01029e0 0x7f7cb019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7caffff640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb0108c60 0x7f7cb01a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7caeffd640 1 -- 172.21.15.92:0/3411832886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb0108c60 msgr2=0x7f7cb01a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7caeffd640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb0108c60 0x7f7cb01a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7caeffd640 1 -- 172.21.15.92:0/3411832886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb01029e0 msgr2=0x7f7cb019c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7caeffd640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb01029e0 0x7f7cb019c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7caeffd640 1 -- 172.21.15.92:0/3411832886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb01a2570 con 0x7f7cb0108310 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7caeffd640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cb0108310 0x7f7cb019cbe0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4005940 tx=0x7f7ca40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7cacff9640 1 -- 172.21.15.92:0/3411832886 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca403f030 con 0x7f7cb0108310 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7cb61a1640 1 -- 172.21.15.92:0/3411832886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb01a2800 con 0x7f7cb0108310 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7cacff9640 1 -- 172.21.15.92:0/3411832886 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ca4003a80 con 0x7f7cb0108310 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7cacff9640 1 -- 172.21.15.92:0/3411832886 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4035070 con 0x7f7cb0108310 2024-09-21T07:17:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.680+0000 7f7cb61a1640 1 -- 172.21.15.92:0/3411832886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb01a8ff0 con 0x7f7cb0108310 2024-09-21T07:17:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7cbd1eb740 1 Processor -- start 2024-09-21T07:17:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7cacff9640 1 -- 172.21.15.92:0/3411832886 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f7ca4042030 con 0x7f7cb0108310 2024-09-21T07:17:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7cbd1eb740 1 -- start start 2024-09-21T07:17:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 0x55f4d4def9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a212f0 0x55f4d4defef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4df0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f4d4d646f0 con 0x55f4d4a294d0 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f4d4d53b20 con 0x55f4d4a212f0 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f4d4d57930 con 0x55f4d4a4a1b0 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4df0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4df0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36930/0 (socket says 172.21.15.92:36930) 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7caeffd640 1 -- 172.21.15.92:0/1751235905 learned_addr learned my addr 172.21.15.92:0/1751235905 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.683+0000 7f7caffff640 1 --2- 172.21.15.92:0/1751235905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 0x55f4d4def9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/1751235905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a212f0 0x55f4d4defef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7caeffd640 1 -- 172.21.15.92:0/1751235905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 msgr2=0x55f4d4def9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7caeffd640 1 --2- 172.21.15.92:0/1751235905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 0x55f4d4def9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7caeffd640 1 -- 172.21.15.92:0/1751235905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a212f0 msgr2=0x55f4d4defef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7caeffd640 1 --2- 172.21.15.92:0/1751235905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a212f0 0x55f4d4defef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7caeffd640 1 -- 172.21.15.92:0/1751235905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4d4d19530 con 0x55f4d4a294d0 2024-09-21T07:17:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/1751235905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a212f0 0x55f4d4defef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7cacff9640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7c980b6680 0x7f7c980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7caeffd640 1 --2- 172.21.15.92:0/1751235905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4df0430 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4105300 tx=0x7f7ca4110320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bf55fdf0522d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7caffff640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7c980b6680 0x7f7c980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7c95ffb640 1 -- 172.21.15.92:0/1751235905 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40ca190 con 0x55f4d4a294d0 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7cacff9640 1 -- 172.21.15.92:0/3411832886 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f7ca4107fe0 con 0x7f7cb0108310 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7c95ffb640 1 -- 172.21.15.92:0/1751235905 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ca40c9290 con 0x55f4d4a294d0 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.684+0000 7f7c95ffb640 1 -- 172.21.15.92:0/1751235905 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca408c140 con 0x55f4d4a294d0 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.685+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1751235905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 msgr2=0x55f4d4df0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.685+0000 7f7caffff640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7c980b6680 0x7f7c980b8b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8005fd0 tx=0x7f7ca80096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.685+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1751235905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4df0430 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4105300 tx=0x7f7ca4110320 comp rx=0 tx=0).stop 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.685+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1751235905 shutdown_connections 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.685+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1751235905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4df0430 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.685+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1751235905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a212f0 0x55f4d4defef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.685+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1751235905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 0x55f4d4def9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.685+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1751235905 >> 172.21.15.92:0/1751235905 conn(0x55f4d4a3e300 msgr2=0x55f4d4ded8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.685+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1751235905 shutdown_connections 2024-09-21T07:17:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.685+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1751235905 wait complete. 2024-09-21T07:17:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7cbd1eb740 1 -- start start 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7cbd1eb740 1 Processor -- start 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a212f0 0x55f4d4dfb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a294d0 0x55f4d4dfb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 0x55f4d4e07110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f4d4c8bab0 con 0x55f4d4a212f0 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f4d4cf9730 con 0x55f4d4a294d0 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f4d4dfdef0 con 0x55f4d4a4a1b0 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7cbd1eb740 10 client.0 _ll_register_callbacks cb 0x55f4d4d4d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7caf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a212f0 0x55f4d4dfb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7caf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a212f0 0x55f4d4dfb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36942/0 (socket says 172.21.15.92:36942) 2024-09-21T07:17:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7caf7fe640 1 -- 172.21.15.92:0/1414249181 learned_addr learned my addr 172.21.15.92:0/1414249181 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7caeffd640 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a294d0 0x55f4d4dfb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.686+0000 7f7caffff640 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 0x55f4d4e07110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7caf7fe640 1 -- 172.21.15.92:0/1414249181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 msgr2=0x55f4d4e07110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 0x55f4d4e07110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7caf7fe640 1 -- 172.21.15.92:0/1414249181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a294d0 msgr2=0x55f4d4dfb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a294d0 0x55f4d4dfb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7caf7fe640 1 -- 172.21.15.92:0/1414249181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4d4ab5790 con 0x55f4d4a212f0 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7caffff640 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 0x55f4d4e07110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a212f0 0x55f4d4dfb050 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000b910 tx=0x7f7ca000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9a8e5707857027 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7c8effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7c8effd640 1 -- 172.21.15.92:0/1414249181 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca001b470 con 0x55f4d4a212f0 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7c8effd640 1 -- 172.21.15.92:0/1414249181 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f7ca001b610 con 0x55f4d4a212f0 2024-09-21T07:17:51.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1414249181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f4d4d66640 con 0x55f4d4a212f0 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7c8effd640 1 -- 172.21.15.92:0/1414249181 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ca0024050 con 0x55f4d4a212f0 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7cbd1eb740 10 client.17157 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1414249181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f4d4b2e620 con 0x55f4d4a212f0 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7c8effd640 1 -- 172.21.15.92:0/1414249181 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f4d4d66640 con 0x55f4d4a212f0 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7c8effd640 1 -- 172.21.15.92:0/1414249181 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7ca00129c0 con 0x55f4d4a212f0 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.687+0000 7f7cbd1eb740 10 client.17157 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.688+0000 7f7cbd1eb740 10 client.17157 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.688+0000 7f7cbd1eb740 20 client.17157 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.688+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f4d4a08d80 0x55f4d4e0cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.688+0000 7f7cbd1eb740 4 client.17157 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.688+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1414249181 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4d4d620f0 con 0x55f4d4a08d80 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.688+0000 7f7caeffd640 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f4d4a08d80 0x55f4d4e0cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.688+0000 7f7c8effd640 10 client.17157 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.688+0000 7f7caeffd640 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f4d4a08d80 0x55f4d4e0cee0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5f23f7eeeb09a3 server_cookie=1c3a05c559ba1a32 in_seq=0 out_seq=0 2024-09-21T07:17:51.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7c8effd640 1 -- 172.21.15.92:0/1414249181 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f4d4d620f0 con 0x55f4d4a08d80 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7c8effd640 10 client.17157 handle_command_reply: tid=0 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 client.17157 shutdown 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1414249181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a212f0 msgr2=0x55f4d4dfb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a212f0 0x55f4d4dfb050 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000b910 tx=0x7f7ca000bdd0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1414249181 shutdown_connections 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f4d4a08d80 0x55f4d4e0cee0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a4a1b0 0x55f4d4e07110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a294d0 0x55f4d4dfb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7c8effd640 0 client.17157 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1414249181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a212f0 0x55f4d4dfb050 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1414249181 >> 172.21.15.92:0/1414249181 conn(0x55f4d4a3e300 msgr2=0x55f4d4df09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1414249181 shutdown_connections 2024-09-21T07:17:51.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1414249181 wait complete. 2024-09-21T07:17:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.689+0000 7f7cbd1eb740 20 client.17157 trim_cache size 0 max 16384 2024-09-21T07:17:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.703+0000 7f7cbd1eb740 1 Processor -- start 2024-09-21T07:17:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7cbd1eb740 1 -- start start 2024-09-21T07:17:51.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 0x55f4d4df10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 0x55f4d4e06fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e07500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01b30e0 con 0x55f4d4a294d0 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01b4c20 con 0x55f4d4a08d80 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01b37b0 con 0x55f4d4a212f0 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e07500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e07500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36948/0 (socket says 172.21.15.92:36948) 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caffff640 1 -- 172.21.15.92:0/3783669320 learned_addr learned my addr 172.21.15.92:0/3783669320 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caeffd640 1 --2- 172.21.15.92:0/3783669320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 0x55f4d4e06fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/3783669320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 0x55f4d4df10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caffff640 1 -- 172.21.15.92:0/3783669320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 msgr2=0x55f4d4e06fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caffff640 1 --2- 172.21.15.92:0/3783669320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 0x55f4d4e06fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caffff640 1 -- 172.21.15.92:0/3783669320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 msgr2=0x55f4d4df10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caffff640 1 --2- 172.21.15.92:0/3783669320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 0x55f4d4df10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caffff640 1 -- 172.21.15.92:0/3783669320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4d4df9530 con 0x55f4d4a294d0 2024-09-21T07:17:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/3783669320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 0x55f4d4df10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.704+0000 7f7caffff640 1 --2- 172.21.15.92:0/3783669320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e07500 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80108f0 tx=0x7f7ca8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc185a25753279f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.705+0000 7f7c957fa640 1 -- 172.21.15.92:0/3783669320 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8010e70 con 0x55f4d4a294d0 2024-09-21T07:17:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.705+0000 7f7c957fa640 1 -- 172.21.15.92:0/3783669320 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ca801e0d0 con 0x55f4d4a294d0 2024-09-21T07:17:51.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.705+0000 7f7c957fa640 1 -- 172.21.15.92:0/3783669320 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8005020 con 0x55f4d4a294d0 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.705+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/3783669320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 msgr2=0x55f4d4e07500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.705+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/3783669320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e07500 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80108f0 tx=0x7f7ca8016000 comp rx=0 tx=0).stop 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.705+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/3783669320 shutdown_connections 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.705+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/3783669320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e07500 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.705+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/3783669320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 0x55f4d4e06fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.705+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/3783669320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 0x55f4d4df10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.705+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/3783669320 >> 172.21.15.92:0/3783669320 conn(0x55f4d4a3e300 msgr2=0x55f4d4df09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/3783669320 shutdown_connections 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/3783669320 wait complete. 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 1 -- start start 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 1 Processor -- start 2024-09-21T07:17:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 0x55f4d4e00460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 0x55f4d4e00a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01b4550 con 0x55f4d4a294d0 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01b3e80 con 0x55f4d4a08d80 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01b10c0 con 0x55f4d4a212f0 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7cbd1eb740 10 client.0 _ll_register_callbacks cb 0x7f7ca0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7caffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.706+0000 7f7caffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36956/0 (socket says 172.21.15.92:36956) 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caffff640 1 -- 172.21.15.92:0/1134681245 learned_addr learned my addr 172.21.15.92:0/1134681245 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 0x55f4d4e00460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caeffd640 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 0x55f4d4e00a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caffff640 1 -- 172.21.15.92:0/1134681245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 msgr2=0x55f4d4e00a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caffff640 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 0x55f4d4e00a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caffff640 1 -- 172.21.15.92:0/1134681245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 msgr2=0x55f4d4e00460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caffff640 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 0x55f4d4e00460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caffff640 1 -- 172.21.15.92:0/1134681245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4d4e75de0 con 0x55f4d4a294d0 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caeffd640 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 0x55f4d4e00a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 0x55f4d4e00460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7caffff640 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e758a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8029040 tx=0x7f7ca8010630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1b14c69978a7be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7c8effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7c8effd640 1 -- 172.21.15.92:0/1134681245 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8004a40 con 0x55f4d4a294d0 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7c8effd640 1 -- 172.21.15.92:0/1134681245 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f7ca8024040 con 0x55f4d4a294d0 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1134681245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca801e0d0 con 0x55f4d4a294d0 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7c8effd640 1 -- 172.21.15.92:0/1134681245 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ca803e050 con 0x55f4d4a294d0 2024-09-21T07:17:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7cbd1eb740 10 client.17163 fetch_fsmap learned FSMap version 29 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1134681245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f4d4e76fa0 con 0x55f4d4a294d0 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.707+0000 7f7c8effd640 1 -- 172.21.15.92:0/1134681245 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ca801e0d0 con 0x55f4d4a294d0 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.708+0000 7f7c8effd640 1 -- 172.21.15.92:0/1134681245 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7ca8039030 con 0x55f4d4a294d0 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.708+0000 7f7cbd1eb740 10 client.17163 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.708+0000 7f7cbd1eb740 10 client.17163 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.708+0000 7f7cbd1eb740 20 client.17163 populate_metadata read hostname 'smithi092' 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.708+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f4d4a4a1b0 0x55f4d4e797e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.708+0000 7f7cbd1eb740 4 client.17163 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.708+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1134681245 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f4d4d5f520 con 0x55f4d4a4a1b0 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.708+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f4d4a4a1b0 0x55f4d4e797e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.708+0000 7f7caf7fe640 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f4d4a4a1b0 0x55f4d4e797e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73452524b4006a2e server_cookie=deedf235b3bd1ac5 in_seq=0 out_seq=0 2024-09-21T07:17:51.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.708+0000 7f7c8effd640 10 client.17163 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7c8effd640 1 -- 172.21.15.92:0/1134681245 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f4d4d5f520 con 0x55f4d4a4a1b0 2024-09-21T07:17:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7c8effd640 10 client.17163 handle_command_reply: tid=0 2024-09-21T07:17:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 client.17163 shutdown 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1134681245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 msgr2=0x55f4d4e758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e758a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8029040 tx=0x7f7ca8010630 comp rx=0 tx=0).stop 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1134681245 shutdown_connections 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f4d4a4a1b0 0x55f4d4e797e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4d4a294d0 0x55f4d4e758a0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4d4a212f0 0x55f4d4e00a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7c8effd640 0 client.17163 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 --2- 172.21.15.92:0/1134681245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f4d4a08d80 0x55f4d4e00460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1134681245 >> 172.21.15.92:0/1134681245 conn(0x55f4d4a3e300 msgr2=0x55f4d4ded880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1134681245 shutdown_connections 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.719+0000 7f7cbd1eb740 1 -- 172.21.15.92:0/1134681245 wait complete. 2024-09-21T07:17:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cbd1eb740 20 client.17163 trim_cache size 0 max 16384 2024-09-21T07:17:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-21T07:17:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-21T07:17:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-21T07:17:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-21T07:17:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 -- 172.21.15.92:0/3411832886 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7c980b6680 msgr2=0x7f7c980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7c980b6680 0x7f7c980b8b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8005fd0 tx=0x7f7ca80096a0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 -- 172.21.15.92:0/3411832886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cb0108310 msgr2=0x7f7cb019cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cb0108310 0x7f7cb019cbe0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4005940 tx=0x7f7ca40040e0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 -- 172.21.15.92:0/3411832886 shutdown_connections 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f7c980b6680 0x7f7c980b8b90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb0108c60 0x7f7cb01a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cb0108310 0x7f7cb019cbe0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 --2- 172.21.15.92:0/3411832886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb01029e0 0x7f7cb019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 -- 172.21.15.92:0/3411832886 >> 172.21.15.92:0/3411832886 conn(0x7f7cb00fe3e0 msgr2=0x7f7cb006b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 -- 172.21.15.92:0/3411832886 shutdown_connections 2024-09-21T07:17:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-21T07:17:51.720+0000 7f7cb61a1640 1 -- 172.21.15.92:0/3411832886 wait complete. 2024-09-21T07:17:51.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:51 smithi092 ceph-mon[30987]: pgmap v483: 129 pgs: 129 active+clean; 19 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 35 op/s 2024-09-21T07:17:51.991 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T07:17:51.991 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T07:17:52.008 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T07:17:52.040 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T07:17:52.050 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T07:17:52.050 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T07:17:52.050 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T07:17:52.050 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T07:17:52.107 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T07:17:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:51 smithi169 ceph-mon[33705]: pgmap v483: 129 pgs: 129 active+clean; 19 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 35 op/s 2024-09-21T07:17:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:51 smithi175 ceph-mon[34064]: pgmap v483: 129 pgs: 129 active+clean; 19 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 35 op/s 2024-09-21T07:17:55.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:54 smithi092 ceph-mon[30987]: pgmap v484: 129 pgs: 129 active+clean; 14 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 KiB/s wr, 155 op/s 2024-09-21T07:17:55.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:54 smithi169 ceph-mon[33705]: pgmap v484: 129 pgs: 129 active+clean; 14 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 KiB/s wr, 155 op/s 2024-09-21T07:17:55.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:54 smithi175 ceph-mon[34064]: pgmap v484: 129 pgs: 129 active+clean; 14 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 KiB/s wr, 155 op/s 2024-09-21T07:17:56.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:55 smithi092 ceph-mon[30987]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 229 op/s 2024-09-21T07:17:56.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:55 smithi169 ceph-mon[33705]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 229 op/s 2024-09-21T07:17:56.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:55 smithi175 ceph-mon[34064]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 229 op/s 2024-09-21T07:17:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:58 smithi092 ceph-mon[30987]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 230 op/s 2024-09-21T07:17:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:58 smithi169 ceph-mon[33705]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 230 op/s 2024-09-21T07:17:59.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:58 smithi175 ceph-mon[34064]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 230 op/s 2024-09-21T07:18:00.044 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:59 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:18:00.044 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:17:59 smithi169 ceph-mon[33705]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 228 op/s 2024-09-21T07:18:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:59 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:18:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:17:59 smithi092 ceph-mon[30987]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 228 op/s 2024-09-21T07:18:00.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:59 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:18:00.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:17:59 smithi175 ceph-mon[34064]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 228 op/s 2024-09-21T07:18:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:18:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:18:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:18:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:18:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:18:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:18:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:18:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:18:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:18:02.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:01 smithi092 ceph-mon[30987]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 226 op/s 2024-09-21T07:18:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:01 smithi169 ceph-mon[33705]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 226 op/s 2024-09-21T07:18:02.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:01 smithi175 ceph-mon[34064]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 226 op/s 2024-09-21T07:18:04.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:03 smithi092 ceph-mon[30987]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 218 op/s 2024-09-21T07:18:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:03 smithi169 ceph-mon[33705]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 218 op/s 2024-09-21T07:18:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:03 smithi175 ceph-mon[34064]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 218 op/s 2024-09-21T07:18:06.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:05 smithi092 ceph-mon[30987]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 100 op/s 2024-09-21T07:18:06.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:05 smithi169 ceph-mon[33705]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 100 op/s 2024-09-21T07:18:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:05 smithi175 ceph-mon[34064]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 100 op/s 2024-09-21T07:18:08.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:07 smithi092 ceph-mon[30987]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:18:08.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:07 smithi169 ceph-mon[33705]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:18:08.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:07 smithi175 ceph-mon[34064]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:18:10.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:09 smithi092 ceph-mon[30987]: pgmap v492: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:18:10.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:09 smithi169 ceph-mon[33705]: pgmap v492: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:18:10.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:09 smithi175 ceph-mon[34064]: pgmap v492: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:18:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:11 smithi092 ceph-mon[30987]: pgmap v493: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T07:18:12.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:11 smithi169 ceph-mon[33705]: pgmap v493: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T07:18:12.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:11 smithi175 ceph-mon[34064]: pgmap v493: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T07:18:14.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:13 smithi092 ceph-mon[30987]: pgmap v494: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:18:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:13 smithi169 ceph-mon[33705]: pgmap v494: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:18:14.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:13 smithi175 ceph-mon[34064]: pgmap v494: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:18:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:15 smithi092 ceph-mon[30987]: pgmap v495: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T07:18:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:15 smithi169 ceph-mon[33705]: pgmap v495: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T07:18:16.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:15 smithi175 ceph-mon[34064]: pgmap v495: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T07:18:17.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:18:17.934 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:18:18.055 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:17 smithi092 ceph-mon[30987]: pgmap v496: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T07:18:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:17 smithi169 ceph-mon[33705]: pgmap v496: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T07:18:18.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:17 smithi175 ceph-mon[34064]: pgmap v496: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T07:18:18.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.431+0000 7f0143dd1640 1 -- 172.21.15.92:0/2810472199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f013c1022a0 msgr2=0x7f013c1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:18.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.431+0000 7f0143dd1640 1 --2- 172.21.15.92:0/2810472199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f013c1022a0 0x7f013c1026b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f0138009900 tx=0x7f013802a410 comp rx=0 tx=0).stop 2024-09-21T07:18:18.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.431+0000 7f0143dd1640 1 -- 172.21.15.92:0/2810472199 shutdown_connections 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.431+0000 7f0143dd1640 1 --2- 172.21.15.92:0/2810472199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c108530 0x7f013c10ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.431+0000 7f0143dd1640 1 --2- 172.21.15.92:0/2810472199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f013c107be0 0x7f013c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.431+0000 7f0143dd1640 1 --2- 172.21.15.92:0/2810472199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f013c1022a0 0x7f013c1026b0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.431+0000 7f0143dd1640 1 -- 172.21.15.92:0/2810472199 >> 172.21.15.92:0/2810472199 conn(0x7f013c079ec0 msgr2=0x7f013c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.431+0000 7f0143dd1640 1 -- 172.21.15.92:0/2810472199 shutdown_connections 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.431+0000 7f0143dd1640 1 -- 172.21.15.92:0/2810472199 wait complete. 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.431+0000 7f0143dd1640 1 Processor -- start 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f0143dd1640 1 -- start start 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f0143dd1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f013c1022a0 0x7f013c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f0143dd1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c107be0 0x7f013c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f0143dd1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f013c108530 0x7f013c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f0143dd1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f013c111820 con 0x7f013c108530 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f0143dd1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1116a0 con 0x7f013c1022a0 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f0143dd1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1119a0 con 0x7f013c107be0 2024-09-21T07:18:18.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f014236e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f013c108530 0x7f013c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f014236e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f013c108530 0x7f013c19fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50448/0 (socket says 172.21.15.92:50448) 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f014236e640 1 -- 172.21.15.92:0/1474532258 learned_addr learned my addr 172.21.15.92:0/1474532258 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f0141b6d640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f013c1022a0 0x7f013c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f014136c640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c107be0 0x7f013c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f014236e640 1 -- 172.21.15.92:0/1474532258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c107be0 msgr2=0x7f013c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f014236e640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c107be0 0x7f013c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f014236e640 1 -- 172.21.15.92:0/1474532258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f013c1022a0 msgr2=0x7f013c19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f014236e640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f013c1022a0 0x7f013c19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f014236e640 1 -- 172.21.15.92:0/1474532258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c1a03c0 con 0x7f013c108530 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.432+0000 7f014236e640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f013c108530 0x7f013c19fc90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f013400cad0 tx=0x7f013400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.433+0000 7f0132ffd640 1 -- 172.21.15.92:0/1474532258 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013400ae20 con 0x7f013c108530 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.433+0000 7f0132ffd640 1 -- 172.21.15.92:0/1474532258 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0134005020 con 0x7f013c108530 2024-09-21T07:18:18.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.433+0000 7f0143dd1640 1 -- 172.21.15.92:0/1474532258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013c1a06b0 con 0x7f013c108530 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.433+0000 7f0132ffd640 1 -- 172.21.15.92:0/1474532258 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013400f6b0 con 0x7f013c108530 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.433+0000 7f0143dd1640 1 -- 172.21.15.92:0/1474532258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013c1a6e10 con 0x7f013c108530 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.435+0000 7f014a345740 1 Processor -- start 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.435+0000 7f0132ffd640 1 -- 172.21.15.92:0/1474532258 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f01340051d0 con 0x7f013c108530 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f014a345740 1 -- start start 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f014a345740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84ccf070 0x556d85076650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f014a345740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85076b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f014a345740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 0x556d850770d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f014a345740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556d84fece50 con 0x556d84ca61b0 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f014a345740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556d84fdc280 con 0x556d84ccf070 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f014a345740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556d84fe0090 con 0x556d84cae390 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f0141b6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85076b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f0141b6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85076b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50460/0 (socket says 172.21.15.92:50460) 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f0141b6d640 1 -- 172.21.15.92:0/2231714484 learned_addr learned my addr 172.21.15.92:0/2231714484 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f0132ffd640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f01280b6680 0x7f01280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f014136c640 1 --2- 172.21.15.92:0/2231714484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84ccf070 0x556d85076650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.436+0000 7f014136c640 1 --2- 172.21.15.92:0/2231714484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 0x556d850770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f0141b6d640 1 -- 172.21.15.92:0/2231714484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 msgr2=0x556d850770d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f0141b6d640 1 --2- 172.21.15.92:0/2231714484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 0x556d850770d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f0141b6d640 1 -- 172.21.15.92:0/2231714484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84ccf070 msgr2=0x556d85076650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f0141b6d640 1 --2- 172.21.15.92:0/2231714484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84ccf070 0x556d85076650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f014236e640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f01280b6680 0x7f01280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f0141b6d640 1 -- 172.21.15.92:0/2231714484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d84d3a650 con 0x556d84ca61b0 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f0132ffd640 1 -- 172.21.15.92:0/1474532258 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f01340e7da0 con 0x7f013c108530 2024-09-21T07:18:18.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f0141b6d640 1 --2- 172.21.15.92:0/2231714484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85076b90 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f013802a930 tx=0x7f0138031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1fcc0a049c252e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f0127fff640 1 -- 172.21.15.92:0/2231714484 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138035030 con 0x556d84ca61b0 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f0127fff640 1 -- 172.21.15.92:0/2231714484 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0138040070 con 0x556d84ca61b0 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f0127fff640 1 -- 172.21.15.92:0/2231714484 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138003a20 con 0x556d84ca61b0 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.437+0000 7f014236e640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f01280b6680 0x7f01280b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f01340e5200 tx=0x7f01340d1040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.438+0000 7f014a345740 1 -- 172.21.15.92:0/2231714484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 msgr2=0x556d85076b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.438+0000 7f014a345740 1 --2- 172.21.15.92:0/2231714484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85076b90 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f013802a930 tx=0x7f0138031dc0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.438+0000 7f014a345740 1 -- 172.21.15.92:0/2231714484 shutdown_connections 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.438+0000 7f014a345740 1 --2- 172.21.15.92:0/2231714484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 0x556d850770d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.438+0000 7f014a345740 1 --2- 172.21.15.92:0/2231714484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85076b90 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.438+0000 7f014a345740 1 --2- 172.21.15.92:0/2231714484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84ccf070 0x556d85076650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.438+0000 7f014a345740 1 -- 172.21.15.92:0/2231714484 >> 172.21.15.92:0/2231714484 conn(0x556d84cc3460 msgr2=0x556d85074540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.438+0000 7f014a345740 1 -- 172.21.15.92:0/2231714484 shutdown_connections 2024-09-21T07:18:18.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.438+0000 7f014a345740 1 -- 172.21.15.92:0/2231714484 wait complete. 2024-09-21T07:18:18.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.439+0000 7f014a345740 1 -- start start 2024-09-21T07:18:18.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.439+0000 7f014a345740 1 Processor -- start 2024-09-21T07:18:18.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.439+0000 7f014a345740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d850844f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.439+0000 7f014a345740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84cae390 0x556d85081e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.439+0000 7f014a345740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84ccf070 0x556d85082520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.439+0000 7f014a345740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556d84e3d700 con 0x556d84ca61b0 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.439+0000 7f014a345740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556d84f77110 con 0x556d84cae390 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.439+0000 7f014a345740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556d85084dd0 con 0x556d84ccf070 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.439+0000 7f014a345740 10 client.0 _ll_register_callbacks cb 0x556d84f90990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.439+0000 7f014136c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d850844f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f014136c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d850844f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50462/0 (socket says 172.21.15.92:50462) 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f014136c640 1 -- 172.21.15.92:0/2617635860 learned_addr learned my addr 172.21.15.92:0/2617635860 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f0141b6d640 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84cae390 0x556d85081e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f014136c640 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84ccf070 0x556d85082520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f014136c640 1 -- 172.21.15.92:0/2617635860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84ccf070 msgr2=0x556d85082520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f014136c640 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84ccf070 0x556d85082520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f014136c640 1 -- 172.21.15.92:0/2617635860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84cae390 msgr2=0x556d85081e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:18.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f014136c640 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84cae390 0x556d85081e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f014136c640 1 -- 172.21.15.92:0/2617635860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d84fa4c40 con 0x556d84ca61b0 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f014136c640 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d850844f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f012c005d00 tx=0x7f012c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58b8f68a4bd593d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f01257fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f01257fa640 1 -- 172.21.15.92:0/2617635860 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c013070 con 0x556d84ca61b0 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f01257fa640 1 -- 172.21.15.92:0/2617635860 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f012c00ddd0 con 0x556d84ca61b0 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.440+0000 7f014a345740 1 -- 172.21.15.92:0/2617635860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0138040070 con 0x556d84ca61b0 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f01257fa640 1 -- 172.21.15.92:0/2617635860 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f012c024050 con 0x556d84ca61b0 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f014a345740 10 client.17175 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f014a345740 1 -- 172.21.15.92:0/2617635860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556d850993f0 con 0x556d84ca61b0 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f01257fa640 1 -- 172.21.15.92:0/2617635860 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0138040070 con 0x556d84ca61b0 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f01257fa640 1 -- 172.21.15.92:0/2617635860 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f012c00b040 con 0x556d84ca61b0 2024-09-21T07:18:18.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f014a345740 10 client.17175 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f014a345740 10 client.17175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f014a345740 20 client.17175 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f014a345740 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556d84c8d9f0 0x556d8509c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f014a345740 4 client.17175 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f014a345740 1 -- 172.21.15.92:0/2617635860 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d84feeda0 con 0x556d84c8d9f0 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.441+0000 7f0141b6d640 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556d84c8d9f0 0x556d8509c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.442+0000 7f01257fa640 10 client.17175 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.442+0000 7f0141b6d640 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556d84c8d9f0 0x556d8509c880 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74be3f8e1985c90a server_cookie=471152e7e86ffe8f in_seq=0 out_seq=0 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f01257fa640 1 -- 172.21.15.92:0/2617635860 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556d84feeda0 con 0x556d84c8d9f0 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f01257fa640 10 client.17175 handle_command_reply: tid=0 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 client.17175 shutdown 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 -- 172.21.15.92:0/2617635860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 msgr2=0x556d850844f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d850844f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f012c005d00 tx=0x7f012c004730 comp rx=0 tx=0).stop 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 -- 172.21.15.92:0/2617635860 shutdown_connections 2024-09-21T07:18:18.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556d84c8d9f0 0x556d8509c880 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84ccf070 0x556d85082520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f01257fa640 0 client.17175 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84cae390 0x556d85081e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 --2- 172.21.15.92:0/2617635860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d850844f0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 -- 172.21.15.92:0/2617635860 >> 172.21.15.92:0/2617635860 conn(0x556d84cc3460 msgr2=0x556d850797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 -- 172.21.15.92:0/2617635860 shutdown_connections 2024-09-21T07:18:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 1 -- 172.21.15.92:0/2617635860 wait complete. 2024-09-21T07:18:18.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.443+0000 7f014a345740 20 client.17175 trim_cache size 0 max 16384 2024-09-21T07:18:18.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.460+0000 7f014a345740 1 Processor -- start 2024-09-21T07:18:18.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.460+0000 7f014a345740 1 -- start start 2024-09-21T07:18:18.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f014a345740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84c8d9f0 0x556d85088030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f014a345740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f014a345740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84cae390 0x556d85077d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f014a345740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1aec80 con 0x556d84ca61b0 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f014a345740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1b07c0 con 0x556d84cae390 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f014a345740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1af350 con 0x556d84c8d9f0 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f0141b6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f0141b6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85073ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50468/0 (socket says 172.21.15.92:50468) 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f0141b6d640 1 -- 172.21.15.92:0/2352215365 learned_addr learned my addr 172.21.15.92:0/2352215365 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f014136c640 1 --2- 172.21.15.92:0/2352215365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84cae390 0x556d85077d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f014136c640 1 --2- 172.21.15.92:0/2352215365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84c8d9f0 0x556d85088030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f0141b6d640 1 -- 172.21.15.92:0/2352215365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84c8d9f0 msgr2=0x556d85088030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f0141b6d640 1 --2- 172.21.15.92:0/2352215365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84c8d9f0 0x556d85088030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f0141b6d640 1 -- 172.21.15.92:0/2352215365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84cae390 msgr2=0x556d85077d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f0141b6d640 1 --2- 172.21.15.92:0/2352215365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84cae390 0x556d85077d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f0141b6d640 1 -- 172.21.15.92:0/2352215365 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d85080cf0 con 0x556d84ca61b0 2024-09-21T07:18:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f014136c640 1 --2- 172.21.15.92:0/2352215365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84c8d9f0 0x556d85088030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f0141b6d640 1 --2- 172.21.15.92:0/2352215365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85073ea0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f0138009900 tx=0x7f0138031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e767d7360728971c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f01277fe640 1 -- 172.21.15.92:0/2352215365 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138035040 con 0x556d84ca61b0 2024-09-21T07:18:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f01277fe640 1 -- 172.21.15.92:0/2352215365 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0138040070 con 0x556d84ca61b0 2024-09-21T07:18:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.461+0000 7f01277fe640 1 -- 172.21.15.92:0/2352215365 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013803c730 con 0x556d84ca61b0 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.462+0000 7f014a345740 1 -- 172.21.15.92:0/2352215365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 msgr2=0x556d85073ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.462+0000 7f014a345740 1 --2- 172.21.15.92:0/2352215365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85073ea0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f0138009900 tx=0x7f0138031740 comp rx=0 tx=0).stop 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.462+0000 7f014a345740 1 -- 172.21.15.92:0/2352215365 shutdown_connections 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.462+0000 7f014a345740 1 --2- 172.21.15.92:0/2352215365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84cae390 0x556d85077d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.462+0000 7f014a345740 1 --2- 172.21.15.92:0/2352215365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85073ea0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.462+0000 7f014a345740 1 --2- 172.21.15.92:0/2352215365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84c8d9f0 0x556d85088030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.462+0000 7f014a345740 1 -- 172.21.15.92:0/2352215365 >> 172.21.15.92:0/2352215365 conn(0x556d84cc3460 msgr2=0x556d85077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.462+0000 7f014a345740 1 -- 172.21.15.92:0/2352215365 shutdown_connections 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.462+0000 7f014a345740 1 -- 172.21.15.92:0/2352215365 wait complete. 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f014a345740 1 -- start start 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f014a345740 1 Processor -- start 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f014a345740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84c8d9f0 0x556d85093580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f014a345740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85093b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f014a345740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 0x556d85106240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f014a345740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1b00f0 con 0x556d84ca61b0 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f014a345740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1afa20 con 0x556d84c8d9f0 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f014a345740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1acc60 con 0x556d84cae390 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f014a345740 10 client.0 _ll_register_callbacks cb 0x7f012c00b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f0141b6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85093b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f0141b6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85093b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50474/0 (socket says 172.21.15.92:50474) 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.463+0000 7f0141b6d640 1 -- 172.21.15.92:0/1022452877 learned_addr learned my addr 172.21.15.92:0/1022452877 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f014136c640 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84c8d9f0 0x556d85093580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f014136c640 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 0x556d85106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f0141b6d640 1 -- 172.21.15.92:0/1022452877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 msgr2=0x556d85106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f0141b6d640 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 0x556d85106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f0141b6d640 1 -- 172.21.15.92:0/1022452877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84c8d9f0 msgr2=0x556d85093580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f0141b6d640 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84c8d9f0 0x556d85093580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f0141b6d640 1 -- 172.21.15.92:0/1022452877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d851068b0 con 0x556d84ca61b0 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f014136c640 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 0x556d85106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f0141b6d640 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85093b40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0138006010 tx=0x7f0138031590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c81b9d19f968b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f01257fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f01257fa640 1 -- 172.21.15.92:0/1022452877 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013805d070 con 0x556d84ca61b0 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f01257fa640 1 -- 172.21.15.92:0/1022452877 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f013804e810 con 0x556d84ca61b0 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f014a345740 1 -- 172.21.15.92:0/1022452877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0138040070 con 0x556d84ca61b0 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f01257fa640 1 -- 172.21.15.92:0/1022452877 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0138035070 con 0x556d84ca61b0 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f014a345740 10 client.17181 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.464+0000 7f014a345740 1 -- 172.21.15.92:0/1022452877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556d85107a90 con 0x556d84ca61b0 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f01257fa640 1 -- 172.21.15.92:0/1022452877 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0138040070 con 0x556d84ca61b0 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f01257fa640 1 -- 172.21.15.92:0/1022452877 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0138059430 con 0x556d84ca61b0 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f014a345740 10 client.17181 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f014a345740 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:18:18.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f014a345740 20 client.17181 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f014a345740 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556d84ccf070 0x556d85109d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f014a345740 4 client.17181 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f014a345740 1 -- 172.21.15.92:0/1022452877 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556d84fea850 con 0x556d84ccf070 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f014136c640 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556d84ccf070 0x556d85109d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f01257fa640 10 client.17181 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.465+0000 7f014136c640 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556d84ccf070 0x556d85109d70 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bbf4958c7e80e server_cookie=5c5d79438813fd5a in_seq=0 out_seq=0 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f01257fa640 1 -- 172.21.15.92:0/1022452877 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x556d84fea850 con 0x556d84ccf070 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f01257fa640 10 client.17181 handle_command_reply: tid=0 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 client.17181 shutdown 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 -- 172.21.15.92:0/1022452877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 msgr2=0x556d85093b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85093b40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0138006010 tx=0x7f0138031590 comp rx=0 tx=0).stop 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 -- 172.21.15.92:0/1022452877 shutdown_connections 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x556d84ccf070 0x556d85109d70 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d84cae390 0x556d85106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d84ca61b0 0x556d85093b40 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 --2- 172.21.15.92:0/1022452877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d84c8d9f0 0x556d85093580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f01257fa640 0 client.17181 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 -- 172.21.15.92:0/1022452877 >> 172.21.15.92:0/1022452877 conn(0x556d84cc3460 msgr2=0x556d85083220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 -- 172.21.15.92:0/1022452877 shutdown_connections 2024-09-21T07:18:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 1 -- 172.21.15.92:0/1022452877 wait complete. 2024-09-21T07:18:18.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.466+0000 7f014a345740 20 client.17181 trim_cache size 0 max 16384 2024-09-21T07:18:18.473 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:18:18.473 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:18:18.474 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:18:18.474 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:18:18.474 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:18:18.474 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:18:18.474 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:18.474 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:18.475 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:18.475 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:18.475 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:18.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:18.475 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:18:18.475 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:18:18.475 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:18.475 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:18.476 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:18.476 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:18.476 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:18.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:18.476 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:18:18.476 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:18:18.476 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:18.477 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:18.477 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:18.477 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:18.477 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:18.477 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:18.477 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:18:18.477 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:18:18.477 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:18.477 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:18.478 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:18.478 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:18.478 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:18.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:18.478 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:18:18.478 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:18:18.478 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:18.479 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:18.479 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:18.479 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:18.479 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:18.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:18.479 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:18:18.479 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:18:18.480 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:18.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:18.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:18.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:18.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:18.480 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:18:18.480 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:18:18.480 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:18:18.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 -- 172.21.15.92:0/1474532258 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f01280b6680 msgr2=0x7f01280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:18.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f01280b6680 0x7f01280b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f01340e5200 tx=0x7f01340d1040 comp rx=0 tx=0).stop 2024-09-21T07:18:18.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 -- 172.21.15.92:0/1474532258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f013c108530 msgr2=0x7f013c19fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:18.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f013c108530 0x7f013c19fc90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f013400cad0 tx=0x7f013400cf90 comp rx=0 tx=0).stop 2024-09-21T07:18:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 -- 172.21.15.92:0/1474532258 shutdown_connections 2024-09-21T07:18:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f01280b6680 0x7f01280b8b90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f013c108530 0x7f013c19fc90 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c107be0 0x7f013c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 --2- 172.21.15.92:0/1474532258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f013c1022a0 0x7f013c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 -- 172.21.15.92:0/1474532258 >> 172.21.15.92:0/1474532258 conn(0x7f013c079ec0 msgr2=0x7f013c101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 -- 172.21.15.92:0/1474532258 shutdown_connections 2024-09-21T07:18:18.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:18.467+0000 7f0143dd1640 1 -- 172.21.15.92:0/1474532258 wait complete. 2024-09-21T07:18:19.306 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:18:19.306 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:18:19.559 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:18:19.959 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:19 smithi092 ceph-mon[30987]: pgmap v497: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:18:20.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.047+0000 7f30fd78f640 1 -- 172.21.15.92:0/1154750852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f8102230 msgr2=0x7f30f8102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:20.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.047+0000 7f30fd78f640 1 --2- 172.21.15.92:0/1154750852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f8102230 0x7f30f8102640 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009900 tx=0x7f30e802a410 comp rx=0 tx=0).stop 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.047+0000 7f30fd78f640 1 -- 172.21.15.92:0/1154750852 shutdown_connections 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.047+0000 7f30fd78f640 1 --2- 172.21.15.92:0/1154750852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30f81084c0 0x7f30f810ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.047+0000 7f30fd78f640 1 --2- 172.21.15.92:0/1154750852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30f8107b70 0x7f30f8107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.047+0000 7f30fd78f640 1 --2- 172.21.15.92:0/1154750852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f8102230 0x7f30f8102640 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.047+0000 7f30fd78f640 1 -- 172.21.15.92:0/1154750852 >> 172.21.15.92:0/1154750852 conn(0x7f30f8079e40 msgr2=0x7f30f807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.048+0000 7f30fd78f640 1 -- 172.21.15.92:0/1154750852 shutdown_connections 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.048+0000 7f30fd78f640 1 -- 172.21.15.92:0/1154750852 wait complete. 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.048+0000 7f30fd78f640 1 Processor -- start 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30fd78f640 1 -- start start 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30fd78f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f8102230 0x7f30f8199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30fd78f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30f8107b70 0x7f30f819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:20.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30fd78f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30f81084c0 0x7f30f819b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30fd78f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8112090 con 0x7f30f8102230 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30fd78f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8111f10 con 0x7f30f8107b70 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30fd78f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8112210 con 0x7f30f81084c0 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f8102230 0x7f30f8199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f8102230 0x7f30f8199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55036/0 (socket says 172.21.15.92:55036) 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30f6ffd640 1 -- 172.21.15.92:0/148688519 learned_addr learned my addr 172.21.15.92:0/148688519 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30f67fc640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30f8107b70 0x7f30f819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30f77fe640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30f81084c0 0x7f30f819b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30f6ffd640 1 -- 172.21.15.92:0/148688519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30f81084c0 msgr2=0x7f30f819b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30f6ffd640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30f81084c0 0x7f30f819b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30f6ffd640 1 -- 172.21.15.92:0/148688519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30f8107b70 msgr2=0x7f30f819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30f6ffd640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30f8107b70 0x7f30f819a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.049+0000 7f30f6ffd640 1 -- 172.21.15.92:0/148688519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f819bf90 con 0x7f30f8102230 2024-09-21T07:18:20.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.050+0000 7f30f6ffd640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f8102230 0x7f30f8199ab0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009a20 tx=0x7f30e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:20.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.050+0000 7f30dffff640 1 -- 172.21.15.92:0/148688519 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8035050 con 0x7f30f8102230 2024-09-21T07:18:20.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.050+0000 7f30dffff640 1 -- 172.21.15.92:0/148688519 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30e80035f0 con 0x7f30f8102230 2024-09-21T07:18:20.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.050+0000 7f30fd78f640 1 -- 172.21.15.92:0/148688519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f819c220 con 0x7f30f8102230 2024-09-21T07:18:20.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.050+0000 7f30dffff640 1 -- 172.21.15.92:0/148688519 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8032260 con 0x7f30f8102230 2024-09-21T07:18:20.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.050+0000 7f30fd78f640 1 -- 172.21.15.92:0/148688519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f819c720 con 0x7f30f8102230 2024-09-21T07:18:20.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.051+0000 7f30fd78f640 1 -- 172.21.15.92:0/148688519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f8102640 con 0x7f30f8102230 2024-09-21T07:18:20.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.052+0000 7f30dffff640 1 -- 172.21.15.92:0/148688519 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f30e8003aa0 con 0x7f30f8102230 2024-09-21T07:18:20.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.053+0000 7f30dffff640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30e00b6680 0x7f30e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:20.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.053+0000 7f30f67fc640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30e00b6680 0x7f30e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:20.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.054+0000 7f30dffff640 1 -- 172.21.15.92:0/148688519 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f30e8109920 con 0x7f30f8102230 2024-09-21T07:18:20.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.054+0000 7f30f67fc640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30e00b6680 0x7f30e00b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f30ec005e10 tx=0x7f30ec005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:20.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.058+0000 7f30dffff640 1 -- 172.21.15.92:0/148688519 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30e80cfad0 con 0x7f30f8102230 2024-09-21T07:18:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:19 smithi169 ceph-mon[33705]: pgmap v497: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:18:20.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:19 smithi175 ceph-mon[34064]: pgmap v497: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:18:20.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.272+0000 7f30fd78f640 1 -- 172.21.15.92:0/148688519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30f8109d80 con 0x7f30f8102230 2024-09-21T07:18:20.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.273+0000 7f30dffff640 1 -- 172.21.15.92:0/148688519 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f30e80d3eb0 con 0x7f30f8102230 2024-09-21T07:18:20.275 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:18:20.275 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:18:20.275 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 -- 172.21.15.92:0/148688519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30e00b6680 msgr2=0x7f30e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30e00b6680 0x7f30e00b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f30ec005e10 tx=0x7f30ec005da0 comp rx=0 tx=0).stop 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 -- 172.21.15.92:0/148688519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f8102230 msgr2=0x7f30f8199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f8102230 0x7f30f8199ab0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009a20 tx=0x7f30e8004270 comp rx=0 tx=0).stop 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 -- 172.21.15.92:0/148688519 shutdown_connections 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f30e00b6680 0x7f30e00b8b90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30f81084c0 0x7f30f819b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30f8107b70 0x7f30f819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 --2- 172.21.15.92:0/148688519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f8102230 0x7f30f8199ab0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 -- 172.21.15.92:0/148688519 >> 172.21.15.92:0/148688519 conn(0x7f30f8079e40 msgr2=0x7f30f8105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 -- 172.21.15.92:0/148688519 shutdown_connections 2024-09-21T07:18:20.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:20.275+0000 7f30fd78f640 1 -- 172.21.15.92:0/148688519 wait complete. 2024-09-21T07:18:20.939 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/148688519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:18:20.971 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:18:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/148688519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:18:21.219 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:18:21.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/148688519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:18:21.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.707+0000 7faa1a15a640 1 -- 172.21.15.92:0/2096284771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa14108420 msgr2=0x7faa14108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:21.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.707+0000 7faa1a15a640 1 --2- 172.21.15.92:0/2096284771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa14108420 0x7faa14108830 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7faa08009900 tx=0x7faa0802a410 comp rx=0 tx=0).stop 2024-09-21T07:18:21.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.707+0000 7faa1a15a640 1 -- 172.21.15.92:0/2096284771 shutdown_connections 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.707+0000 7faa1a15a640 1 --2- 172.21.15.92:0/2096284771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa14108d70 0x7faa1410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.707+0000 7faa1a15a640 1 --2- 172.21.15.92:0/2096284771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa14108420 0x7faa14108830 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.707+0000 7faa1a15a640 1 --2- 172.21.15.92:0/2096284771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa14102ae0 0x7faa14102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.707+0000 7faa1a15a640 1 -- 172.21.15.92:0/2096284771 >> 172.21.15.92:0/2096284771 conn(0x7faa14079770 msgr2=0x7faa14079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.707+0000 7faa1a15a640 1 -- 172.21.15.92:0/2096284771 shutdown_connections 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.707+0000 7faa1a15a640 1 -- 172.21.15.92:0/2096284771 wait complete. 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.708+0000 7faa1a15a640 1 Processor -- start 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.708+0000 7faa1a15a640 1 -- start start 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa1a15a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa14102ae0 0x7faa14199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa1a15a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa14108420 0x7faa141998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa1a15a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa14108d70 0x7faa1419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa1a15a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa141128e0 con 0x7faa14108420 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa1a15a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa14112760 con 0x7faa14108d70 2024-09-21T07:18:21.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa1a15a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa14112a60 con 0x7faa14102ae0 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa12ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa14108420 0x7faa141998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa12ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa14108420 0x7faa141998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55042/0 (socket says 172.21.15.92:55042) 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa12ffd640 1 -- 172.21.15.92:0/3204771254 learned_addr learned my addr 172.21.15.92:0/3204771254 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa13fff640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa14108d70 0x7faa1419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa137fe640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa14102ae0 0x7faa14199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa12ffd640 1 -- 172.21.15.92:0/3204771254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa14102ae0 msgr2=0x7faa14199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa12ffd640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa14102ae0 0x7faa14199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa12ffd640 1 -- 172.21.15.92:0/3204771254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa14108d70 msgr2=0x7faa1419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa12ffd640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa14108d70 0x7faa1419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa12ffd640 1 -- 172.21.15.92:0/3204771254 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1419f2a0 con 0x7faa14108420 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa12ffd640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa14108420 0x7faa141998d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7faa08005940 tx=0x7faa080040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa10ff9640 1 -- 172.21.15.92:0/3204771254 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0803f030 con 0x7faa14108420 2024-09-21T07:18:21.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa1a15a640 1 -- 172.21.15.92:0/3204771254 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1419f530 con 0x7faa14108420 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa10ff9640 1 -- 172.21.15.92:0/3204771254 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa08003a80 con 0x7faa14108420 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa10ff9640 1 -- 172.21.15.92:0/3204771254 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08035070 con 0x7faa14108420 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.709+0000 7faa1a15a640 1 -- 172.21.15.92:0/3204771254 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa141a5cf0 con 0x7faa14108420 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa206ce740 1 Processor -- start 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa206ce740 1 -- start start 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa10ff9640 1 -- 172.21.15.92:0/3204771254 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7faa08042030 con 0x7faa14108420 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa206ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960f8070 0x56049649f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa206ce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960cf1b0 0x56049649fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa206ce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960d7390 0x5604964a0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa206ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560496415ea0 con 0x5604960f8070 2024-09-21T07:18:21.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa206ce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604964052d0 con 0x5604960cf1b0 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa206ce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5604964090e0 con 0x5604960d7390 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa13fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960f8070 0x56049649f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa13fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960f8070 0x56049649f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55048/0 (socket says 172.21.15.92:55048) 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.712+0000 7faa13fff640 1 -- 172.21.15.92:0/1264062385 learned_addr learned my addr 172.21.15.92:0/1264062385 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa12ffd640 1 --2- 172.21.15.92:0/1264062385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960d7390 0x5604964a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa137fe640 1 --2- 172.21.15.92:0/1264062385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960cf1b0 0x56049649fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa13fff640 1 -- 172.21.15.92:0/1264062385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960d7390 msgr2=0x5604964a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa13fff640 1 --2- 172.21.15.92:0/1264062385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960d7390 0x5604964a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa13fff640 1 -- 172.21.15.92:0/1264062385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960cf1b0 msgr2=0x56049649fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa13fff640 1 --2- 172.21.15.92:0/1264062385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960cf1b0 0x56049649fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa13fff640 1 -- 172.21.15.92:0/1264062385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560496163650 con 0x5604960f8070 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa137fe640 1 --2- 172.21.15.92:0/1264062385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960cf1b0 0x56049649fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:21.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa10ff9640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b6680 0x7fa9fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa13fff640 1 --2- 172.21.15.92:0/1264062385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960f8070 0x56049649f6a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7faa0c010370 tx=0x7faa0c010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b972c47b566f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa137fe640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b6680 0x7fa9fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7faa10ff9640 1 -- 172.21.15.92:0/3204771254 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7faa08108000 con 0x7faa14108420 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7fa9f9ffb640 1 -- 172.21.15.92:0/1264062385 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c016070 con 0x5604960f8070 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7fa9f9ffb640 1 -- 172.21.15.92:0/1264062385 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa0c004d20 con 0x5604960f8070 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.713+0000 7fa9f9ffb640 1 -- 172.21.15.92:0/1264062385 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c012780 con 0x5604960f8070 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.714+0000 7faa206ce740 1 -- 172.21.15.92:0/1264062385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960f8070 msgr2=0x56049649f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.714+0000 7faa137fe640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b6680 0x7fa9fc0b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa04005fd0 tx=0x7faa04005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.714+0000 7faa206ce740 1 --2- 172.21.15.92:0/1264062385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960f8070 0x56049649f6a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7faa0c010370 tx=0x7faa0c010830 comp rx=0 tx=0).stop 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.714+0000 7faa206ce740 1 -- 172.21.15.92:0/1264062385 shutdown_connections 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.714+0000 7faa206ce740 1 --2- 172.21.15.92:0/1264062385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960d7390 0x5604964a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.714+0000 7faa206ce740 1 --2- 172.21.15.92:0/1264062385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960cf1b0 0x56049649fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.714+0000 7faa206ce740 1 --2- 172.21.15.92:0/1264062385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960f8070 0x56049649f6a0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.714+0000 7faa206ce740 1 -- 172.21.15.92:0/1264062385 >> 172.21.15.92:0/1264062385 conn(0x5604960ec460 msgr2=0x56049649d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.714+0000 7faa206ce740 1 -- 172.21.15.92:0/1264062385 shutdown_connections 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.714+0000 7faa206ce740 1 -- 172.21.15.92:0/1264062385 wait complete. 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa206ce740 1 -- start start 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa206ce740 1 Processor -- start 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa206ce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 0x5604964ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa206ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa206ce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960f8070 0x5604964b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa206ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560496266700 con 0x5604960d7390 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa206ce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604963a0160 con 0x5604960f8070 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa206ce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5604964a5c10 con 0x5604960cf1b0 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa206ce740 10 client.0 _ll_register_callbacks cb 0x5604963b99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa12ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa12ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964aba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55052/0 (socket says 172.21.15.92:55052) 2024-09-21T07:18:21.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa12ffd640 1 -- 172.21.15.92:0/244969112 learned_addr learned my addr 172.21.15.92:0/244969112 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa137fe640 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 0x5604964ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.715+0000 7faa13fff640 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960f8070 0x5604964b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa12ffd640 1 -- 172.21.15.92:0/244969112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 msgr2=0x5604964ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa12ffd640 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 0x5604964ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa12ffd640 1 -- 172.21.15.92:0/244969112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960f8070 msgr2=0x5604964b6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa12ffd640 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960f8070 0x5604964b6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa12ffd640 1 -- 172.21.15.92:0/244969112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604963cdc90 con 0x5604960d7390 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa137fe640 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 0x5604964ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa12ffd640 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964aba50 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7faa080cad20 tx=0x7faa0803b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce255d8035a8eaf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7fa9f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/244969112 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08049070 con 0x5604960d7390 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/244969112 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7faa080d7040 con 0x5604960d7390 2024-09-21T07:18:21.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa206ce740 1 -- 172.21.15.92:0/244969112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa0c004d20 con 0x5604960d7390 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/244969112 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa080c9950 con 0x5604960d7390 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa206ce740 10 client.17199 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa206ce740 1 -- 172.21.15.92:0/244969112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5604964b9ac0 con 0x5604960d7390 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/244969112 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa0c004d20 con 0x5604960d7390 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/244969112 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faa0810a070 con 0x5604960d7390 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa206ce740 10 client.17199 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa206ce740 10 client.17199 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.716+0000 7faa206ce740 20 client.17199 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.717+0000 7faa206ce740 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5604960b69f0 0x5604964bcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.717+0000 7faa206ce740 4 client.17199 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.717+0000 7faa206ce740 1 -- 172.21.15.92:0/244969112 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560496417df0 con 0x5604960b69f0 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.717+0000 7faa137fe640 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5604960b69f0 0x5604964bcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.717+0000 7fa9f2ffd640 10 client.17199 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:18:21.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.717+0000 7faa137fe640 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5604960b69f0 0x5604964bcee0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=419d86c71382146d server_cookie=a0cc467c8320c79e in_seq=0 out_seq=0 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/244969112 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560496417df0 con 0x5604960b69f0 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7fa9f2ffd640 10 client.17199 handle_command_reply: tid=0 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 client.17199 shutdown 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 -- 172.21.15.92:0/244969112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 msgr2=0x5604964aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964aba50 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7faa080cad20 tx=0x7faa0803b520 comp rx=0 tx=0).stop 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 -- 172.21.15.92:0/244969112 shutdown_connections 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5604960b69f0 0x5604964bcee0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960f8070 0x5604964b6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964aba50 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7fa9f2ffd640 0 client.17199 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 --2- 172.21.15.92:0/244969112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 0x5604964ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 -- 172.21.15.92:0/244969112 >> 172.21.15.92:0/244969112 conn(0x5604960ec460 msgr2=0x56049649bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 -- 172.21.15.92:0/244969112 shutdown_connections 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 1 -- 172.21.15.92:0/244969112 wait complete. 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.718+0000 7faa206ce740 20 client.17199 trim_cache size 0 max 16384 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa206ce740 1 Processor -- start 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa206ce740 1 -- start start 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa206ce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 0x5604964a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa206ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa206ce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960f8070 0x5604964a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa206ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa141b2f20 con 0x5604960d7390 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa206ce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa141b4a60 con 0x5604960f8070 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa206ce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa141b35f0 con 0x5604960cf1b0 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa12ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa12ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55056/0 (socket says 172.21.15.92:55056) 2024-09-21T07:18:21.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa12ffd640 1 -- 172.21.15.92:0/476991930 learned_addr learned my addr 172.21.15.92:0/476991930 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa13fff640 1 --2- 172.21.15.92:0/476991930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960f8070 0x5604964a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa137fe640 1 --2- 172.21.15.92:0/476991930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 0x5604964a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa12ffd640 1 -- 172.21.15.92:0/476991930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 msgr2=0x5604964a4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa12ffd640 1 --2- 172.21.15.92:0/476991930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 0x5604964a4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa12ffd640 1 -- 172.21.15.92:0/476991930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960f8070 msgr2=0x5604964a8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa12ffd640 1 --2- 172.21.15.92:0/476991930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960f8070 0x5604964a8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa12ffd640 1 -- 172.21.15.92:0/476991930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604964a0490 con 0x5604960d7390 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.732+0000 7faa12ffd640 1 --2- 172.21.15.92:0/476991930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964a84c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7faa08006010 tx=0x7faa08009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49158875250ea262 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7fa9f97fa640 1 -- 172.21.15.92:0/476991930 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08049070 con 0x5604960d7390 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7fa9f97fa640 1 -- 172.21.15.92:0/476991930 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa080ce1b0 con 0x5604960d7390 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7fa9f97fa640 1 -- 172.21.15.92:0/476991930 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080c9220 con 0x5604960d7390 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7faa206ce740 1 -- 172.21.15.92:0/476991930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 msgr2=0x5604964a84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7faa206ce740 1 --2- 172.21.15.92:0/476991930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964a84c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7faa08006010 tx=0x7faa08009260 comp rx=0 tx=0).stop 2024-09-21T07:18:21.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7faa206ce740 1 -- 172.21.15.92:0/476991930 shutdown_connections 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7faa206ce740 1 --2- 172.21.15.92:0/476991930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960f8070 0x5604964a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7faa206ce740 1 --2- 172.21.15.92:0/476991930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960d7390 0x5604964a84c0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7faa206ce740 1 --2- 172.21.15.92:0/476991930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960cf1b0 0x5604964a4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7faa206ce740 1 -- 172.21.15.92:0/476991930 >> 172.21.15.92:0/476991930 conn(0x5604960ec460 msgr2=0x5604964a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.733+0000 7faa206ce740 1 -- 172.21.15.92:0/476991930 shutdown_connections 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.734+0000 7faa206ce740 1 -- 172.21.15.92:0/476991930 wait complete. 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.734+0000 7faa206ce740 1 -- start start 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.734+0000 7faa206ce740 1 Processor -- start 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.734+0000 7faa206ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960cf1b0 0x5604964b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.734+0000 7faa206ce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960d7390 0x5604964b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.734+0000 7faa206ce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960f8070 0x5604965268a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.734+0000 7faa206ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa141b4390 con 0x5604960cf1b0 2024-09-21T07:18:21.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.734+0000 7faa206ce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa141b3cc0 con 0x5604960d7390 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.734+0000 7faa206ce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa141b0f00 con 0x5604960f8070 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa206ce740 10 client.0 _ll_register_callbacks cb 0x7faa08005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960cf1b0 0x5604964b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960cf1b0 0x5604964b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55066/0 (socket says 172.21.15.92:55066) 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa137fe640 1 -- 172.21.15.92:0/762909632 learned_addr learned my addr 172.21.15.92:0/762909632 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa12ffd640 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960d7390 0x5604964b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa13fff640 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960f8070 0x5604965268a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa137fe640 1 -- 172.21.15.92:0/762909632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960f8070 msgr2=0x5604965268a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa137fe640 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960f8070 0x5604965268a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa137fe640 1 -- 172.21.15.92:0/762909632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960d7390 msgr2=0x5604964b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa137fe640 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960d7390 0x5604964b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa137fe640 1 -- 172.21.15.92:0/762909632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560496526e10 con 0x5604960cf1b0 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa13fff640 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960f8070 0x5604965268a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:21.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa12ffd640 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960d7390 0x5604964b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa137fe640 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960cf1b0 0x5604964b1510 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x5604964bd640 tx=0x7faa040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68610becd5292b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7fa9f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/762909632 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04029070 con 0x5604960cf1b0 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/762909632 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7faa04005520 con 0x5604960cf1b0 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7faa206ce740 1 -- 172.21.15.92:0/762909632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa080ce1b0 con 0x5604960cf1b0 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.735+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/762909632 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa04035050 con 0x5604960cf1b0 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7faa206ce740 10 client.17205 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7faa206ce740 1 -- 172.21.15.92:0/762909632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560496528120 con 0x5604960cf1b0 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/762909632 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa080ce1b0 con 0x5604960cf1b0 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/762909632 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faa0401e650 con 0x5604960cf1b0 2024-09-21T07:18:21.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7faa206ce740 10 client.17205 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:21.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7faa206ce740 10 client.17205 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:18:21.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7faa206ce740 20 client.17205 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:21.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7faa206ce740 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56049608bda0 0x56049652a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:21.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7faa206ce740 4 client.17205 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:18:21.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7faa206ce740 1 -- 172.21.15.92:0/762909632 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604964abde0 con 0x56049608bda0 2024-09-21T07:18:21.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.736+0000 7faa12ffd640 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56049608bda0 0x56049652a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:21.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7fa9f2ffd640 10 client.17205 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:18:21.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa12ffd640 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56049608bda0 0x56049652a910 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=633330efded861ba server_cookie=e689d21faa609a37 in_seq=0 out_seq=0 2024-09-21T07:18:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7fa9f2ffd640 1 -- 172.21.15.92:0/762909632 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604964abde0 con 0x56049608bda0 2024-09-21T07:18:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7fa9f2ffd640 10 client.17205 handle_command_reply: tid=0 2024-09-21T07:18:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 client.17205 shutdown 2024-09-21T07:18:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 -- 172.21.15.92:0/762909632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960cf1b0 msgr2=0x5604964b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960cf1b0 0x5604964b1510 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x5604964bd640 tx=0x7faa040046c0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 -- 172.21.15.92:0/762909632 shutdown_connections 2024-09-21T07:18:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x56049608bda0 0x56049652a910 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604960f8070 0x5604965268a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604960d7390 0x5604964b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7fa9f2ffd640 0 client.17205 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:18:21.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 --2- 172.21.15.92:0/762909632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604960cf1b0 0x5604964b1510 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 -- 172.21.15.92:0/762909632 >> 172.21.15.92:0/762909632 conn(0x5604960ec460 msgr2=0x5604964ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:21.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 -- 172.21.15.92:0/762909632 shutdown_connections 2024-09-21T07:18:21.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.737+0000 7faa206ce740 1 -- 172.21.15.92:0/762909632 wait complete. 2024-09-21T07:18:21.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa206ce740 20 client.17205 trim_cache size 0 max 16384 2024-09-21T07:18:21.756 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:18:21.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 -- 172.21.15.92:0/3204771254 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b6680 msgr2=0x7fa9fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:21.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b6680 0x7fa9fc0b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa04005fd0 tx=0x7faa04005ec0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 -- 172.21.15.92:0/3204771254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa14108420 msgr2=0x7faa141998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:21.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa14108420 0x7faa141998d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7faa08005940 tx=0x7faa080040e0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 -- 172.21.15.92:0/3204771254 shutdown_connections 2024-09-21T07:18:21.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9fc0b6680 0x7fa9fc0b8b90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa14108d70 0x7faa1419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa14108420 0x7faa141998d0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 --2- 172.21.15.92:0/3204771254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa14102ae0 0x7faa14199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:21.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 -- 172.21.15.92:0/3204771254 >> 172.21.15.92:0/3204771254 conn(0x7faa14079770 msgr2=0x7faa14106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:21.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 -- 172.21.15.92:0/3204771254 shutdown_connections 2024-09-21T07:18:21.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:21.738+0000 7faa1a15a640 1 -- 172.21.15.92:0/3204771254 wait complete. 2024-09-21T07:18:22.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:21 smithi092 ceph-mon[30987]: pgmap v498: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T07:18:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:21 smithi169 ceph-mon[33705]: pgmap v498: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T07:18:22.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:21 smithi175 ceph-mon[34064]: pgmap v498: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T07:18:22.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:18:22.878 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:18:23.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.370+0000 7fc80b9e0640 1 -- 172.21.15.92:0/1014649491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc804109df0 msgr2=0x7fc804110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:23.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.370+0000 7fc80b9e0640 1 --2- 172.21.15.92:0/1014649491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc804109df0 0x7fc804110620 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc009900 tx=0x7fc7fc02a410 comp rx=0 tx=0).stop 2024-09-21T07:18:23.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.370+0000 7fc80b9e0640 1 -- 172.21.15.92:0/1014649491 shutdown_connections 2024-09-21T07:18:23.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.370+0000 7fc80b9e0640 1 --2- 172.21.15.92:0/1014649491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc804109df0 0x7fc804110620 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.370+0000 7fc80b9e0640 1 --2- 172.21.15.92:0/1014649491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8041094a0 0x7fc8041098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.370+0000 7fc80b9e0640 1 --2- 172.21.15.92:0/1014649491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc804103b60 0x7fc804103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.370+0000 7fc80b9e0640 1 -- 172.21.15.92:0/1014649491 >> 172.21.15.92:0/1014649491 conn(0x7fc80407b850 msgr2=0x7fc80407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.370+0000 7fc80b9e0640 1 -- 172.21.15.92:0/1014649491 shutdown_connections 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.370+0000 7fc80b9e0640 1 -- 172.21.15.92:0/1014649491 wait complete. 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc80b9e0640 1 Processor -- start 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc80b9e0640 1 -- start start 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc80b9e0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc804103b60 0x7fc80419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc80b9e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8041094a0 0x7fc80419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc80b9e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc804109df0 0x7fc80419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc80b9e0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc804113960 con 0x7fc8041094a0 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc80b9e0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041137e0 con 0x7fc804103b60 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc80b9e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc804113ae0 con 0x7fc804109df0 2024-09-21T07:18:23.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc808f7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8041094a0 0x7fc80419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc808f7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8041094a0 0x7fc80419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55082/0 (socket says 172.21.15.92:55082) 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.371+0000 7fc808f7b640 1 -- 172.21.15.92:0/3831228631 learned_addr learned my addr 172.21.15.92:0/3831228631 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc80977c640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc804103b60 0x7fc80419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc809f7d640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc804109df0 0x7fc80419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc808f7b640 1 -- 172.21.15.92:0/3831228631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc804109df0 msgr2=0x7fc80419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc808f7b640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc804109df0 0x7fc80419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc808f7b640 1 -- 172.21.15.92:0/3831228631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc804103b60 msgr2=0x7fc80419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc808f7b640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc804103b60 0x7fc80419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc808f7b640 1 -- 172.21.15.92:0/3831228631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8041a02e0 con 0x7fc8041094a0 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc808f7b640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8041094a0 0x7fc80419a910 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800c970 tx=0x7fc7f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc8027fc640 1 -- 172.21.15.92:0/3831228631 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8004220 con 0x7fc8041094a0 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc8027fc640 1 -- 172.21.15.92:0/3831228631 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7f8007e40 con 0x7fc8041094a0 2024-09-21T07:18:23.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc80b9e0640 1 -- 172.21.15.92:0/3831228631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8041a05d0 con 0x7fc8041094a0 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc8027fc640 1 -- 172.21.15.92:0/3831228631 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80047a0 con 0x7fc8041094a0 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.372+0000 7fc80b9e0640 1 -- 172.21.15.92:0/3831228631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8041a6d30 con 0x7fc8041094a0 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.375+0000 7fc811f54740 1 Processor -- start 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.375+0000 7fc811f54740 1 -- start start 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.375+0000 7fc8027fc640 1 -- 172.21.15.92:0/3831228631 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fc7f80079b0 con 0x7fc8041094a0 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.375+0000 7fc811f54740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce195866a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.375+0000 7fc811f54740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19586be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.375+0000 7fc811f54740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191be390 0x55ce19587120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.375+0000 7fc811f54740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ce194fcea0 con 0x55ce191df070 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.375+0000 7fc811f54740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ce194ec2d0 con 0x55ce191be390 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.375+0000 7fc811f54740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ce194f00e0 con 0x55ce191b61b0 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc809f7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce195866a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc809f7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce195866a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55084/0 (socket says 172.21.15.92:55084) 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc809f7d640 1 -- 172.21.15.92:0/2532899717 learned_addr learned my addr 172.21.15.92:0/2532899717 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc80977c640 1 --2- 172.21.15.92:0/2532899717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19586be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc808f7b640 1 --2- 172.21.15.92:0/2532899717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191be390 0x55ce19587120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc809f7d640 1 -- 172.21.15.92:0/2532899717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 msgr2=0x55ce19586be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc809f7d640 1 --2- 172.21.15.92:0/2532899717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19586be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc809f7d640 1 -- 172.21.15.92:0/2532899717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191be390 msgr2=0x55ce19587120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc809f7d640 1 --2- 172.21.15.92:0/2532899717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191be390 0x55ce19587120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc809f7d640 1 -- 172.21.15.92:0/2532899717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce1924a650 con 0x55ce191df070 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc809f7d640 1 --2- 172.21.15.92:0/2532899717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce195866a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc033000 tx=0x7fc7fc031db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d0d660d8135a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc7eb7fe640 1 -- 172.21.15.92:0/2532899717 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc035030 con 0x55ce191df070 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc7eb7fe640 1 -- 172.21.15.92:0/2532899717 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7fc040070 con 0x55ce191df070 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc8027fc640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7ec0b6700 0x7fc7ec0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.376+0000 7fc7eb7fe640 1 -- 172.21.15.92:0/2532899717 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc003a50 con 0x55ce191df070 2024-09-21T07:18:23.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc80977c640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7ec0b6700 0x7fc7ec0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc8027fc640 1 -- 172.21.15.92:0/3831228631 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc7f80e76b0 con 0x7fc8041094a0 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc811f54740 1 -- 172.21.15.92:0/2532899717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 msgr2=0x55ce195866a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc80977c640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7ec0b6700 0x7fc7ec0b8c10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55ce19585320 tx=0x7fc7f400a590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc811f54740 1 --2- 172.21.15.92:0/2532899717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce195866a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc033000 tx=0x7fc7fc031db0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc811f54740 1 -- 172.21.15.92:0/2532899717 shutdown_connections 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc811f54740 1 --2- 172.21.15.92:0/2532899717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191be390 0x55ce19587120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc811f54740 1 --2- 172.21.15.92:0/2532899717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19586be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc811f54740 1 --2- 172.21.15.92:0/2532899717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce195866a0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc811f54740 1 -- 172.21.15.92:0/2532899717 >> 172.21.15.92:0/2532899717 conn(0x55ce191d3460 msgr2=0x55ce19584590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc811f54740 1 -- 172.21.15.92:0/2532899717 shutdown_connections 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.377+0000 7fc811f54740 1 -- 172.21.15.92:0/2532899717 wait complete. 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc811f54740 1 -- start start 2024-09-21T07:18:23.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc811f54740 1 Processor -- start 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc811f54740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19591dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc811f54740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191be390 0x55ce19592300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc811f54740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191df070 0x55ce1959e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc811f54740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ce1934d700 con 0x55ce191be390 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc811f54740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ce19487160 con 0x55ce191df070 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc811f54740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ce19594e20 con 0x55ce191b61b0 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc811f54740 10 client.0 _ll_register_callbacks cb 0x55ce194a09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc808f7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191be390 0x55ce19592300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.378+0000 7fc808f7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191be390 0x55ce19592300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55098/0 (socket says 172.21.15.92:55098) 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc808f7b640 1 -- 172.21.15.92:0/419704771 learned_addr learned my addr 172.21.15.92:0/419704771 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc809f7d640 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191df070 0x55ce1959e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc80977c640 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19591dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc808f7b640 1 -- 172.21.15.92:0/419704771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 msgr2=0x55ce19591dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:23.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc808f7b640 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19591dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc808f7b640 1 -- 172.21.15.92:0/419704771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191df070 msgr2=0x55ce1959e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc808f7b640 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191df070 0x55ce1959e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc808f7b640 1 -- 172.21.15.92:0/419704771 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce194b4c90 con 0x55ce191be390 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc808f7b640 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191be390 0x55ce19592300 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80e4ac0 tx=0x7fc7f80ac840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45f7f1d01a95b97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc7e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/419704771 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f801d040 con 0x55ce191be390 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/419704771 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc7f80e72b0 con 0x55ce191be390 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc811f54740 1 -- 172.21.15.92:0/419704771 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7fc040070 con 0x55ce191be390 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/419704771 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc7f80d0040 con 0x55ce191be390 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc811f54740 10 client.17217 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.379+0000 7fc811f54740 1 -- 172.21.15.92:0/419704771 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ce195a0bf0 con 0x55ce191be390 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.380+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/419704771 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7fc040070 con 0x55ce191be390 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.380+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/419704771 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc7f80abee0 con 0x55ce191be390 2024-09-21T07:18:23.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.380+0000 7fc811f54740 10 client.17217 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.380+0000 7fc811f54740 10 client.17217 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.380+0000 7fc811f54740 20 client.17217 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.380+0000 7fc811f54740 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55ce1919d9f0 0x55ce195a3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.380+0000 7fc811f54740 4 client.17217 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.380+0000 7fc811f54740 1 -- 172.21.15.92:0/419704771 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce194fedf0 con 0x55ce1919d9f0 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.380+0000 7fc80977c640 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55ce1919d9f0 0x55ce195a3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.381+0000 7fc7e8ff9640 10 client.17217 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.381+0000 7fc80977c640 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55ce1919d9f0 0x55ce195a3f50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6c41439cb078db6 server_cookie=24cc1fe49753ce98 in_seq=0 out_seq=0 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.381+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/419704771 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce194fedf0 con 0x55ce1919d9f0 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.381+0000 7fc7e8ff9640 10 client.17217 handle_command_reply: tid=0 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.381+0000 7fc811f54740 1 client.17217 shutdown 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.381+0000 7fc811f54740 1 -- 172.21.15.92:0/419704771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191be390 msgr2=0x55ce19592300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:23.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.381+0000 7fc811f54740 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191be390 0x55ce19592300 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80e4ac0 tx=0x7fc7f80ac840 comp rx=0 tx=0).stop 2024-09-21T07:18:23.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.381+0000 7fc811f54740 1 -- 172.21.15.92:0/419704771 shutdown_connections 2024-09-21T07:18:23.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.381+0000 7fc811f54740 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191df070 0x55ce1959e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.381+0000 7fc811f54740 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55ce1919d9f0 0x55ce195a3f50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.382+0000 7fc811f54740 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191be390 0x55ce19592300 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.382+0000 7fc811f54740 1 --2- 172.21.15.92:0/419704771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19591dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.382+0000 7fc7e8ff9640 0 client.17217 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:18:23.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.382+0000 7fc811f54740 1 -- 172.21.15.92:0/419704771 >> 172.21.15.92:0/419704771 conn(0x55ce191d3460 msgr2=0x55ce19589850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:23.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.382+0000 7fc811f54740 1 -- 172.21.15.92:0/419704771 shutdown_connections 2024-09-21T07:18:23.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.382+0000 7fc811f54740 1 -- 172.21.15.92:0/419704771 wait complete. 2024-09-21T07:18:23.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.382+0000 7fc811f54740 20 client.17217 trim_cache size 0 max 16384 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc811f54740 1 Processor -- start 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc811f54740 1 -- start start 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc811f54740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191b61b0 0x55ce195845e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc811f54740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191be390 0x55ce1959e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc811f54740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191df070 0x55ce19591b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc811f54740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b0d50 con 0x55ce191b61b0 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc811f54740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b2890 con 0x55ce191df070 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc811f54740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b1420 con 0x55ce191be390 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc80977c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191b61b0 0x55ce195845e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc80977c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191b61b0 0x55ce195845e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55100/0 (socket says 172.21.15.92:55100) 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.395+0000 7fc80977c640 1 -- 172.21.15.92:0/4070294241 learned_addr learned my addr 172.21.15.92:0/4070294241 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc808f7b640 1 --2- 172.21.15.92:0/4070294241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191be390 0x55ce1959e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc809f7d640 1 --2- 172.21.15.92:0/4070294241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191df070 0x55ce19591b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc80977c640 1 -- 172.21.15.92:0/4070294241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191be390 msgr2=0x55ce1959e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc80977c640 1 --2- 172.21.15.92:0/4070294241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191be390 0x55ce1959e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc80977c640 1 -- 172.21.15.92:0/4070294241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191df070 msgr2=0x55ce19591b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc80977c640 1 --2- 172.21.15.92:0/4070294241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191df070 0x55ce19591b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc80977c640 1 -- 172.21.15.92:0/4070294241 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce19590640 con 0x55ce191b61b0 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc80977c640 1 --2- 172.21.15.92:0/4070294241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191b61b0 0x55ce195845e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x55ce19588ad0 tx=0x7fc7f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954072799f37a842 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc7eaffd640 1 -- 172.21.15.92:0/4070294241 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f402a070 con 0x55ce191b61b0 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc7eaffd640 1 -- 172.21.15.92:0/4070294241 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7f4003e00 con 0x55ce191b61b0 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.396+0000 7fc7eaffd640 1 -- 172.21.15.92:0/4070294241 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4028430 con 0x55ce191b61b0 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.397+0000 7fc811f54740 1 -- 172.21.15.92:0/4070294241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191b61b0 msgr2=0x55ce195845e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.397+0000 7fc811f54740 1 --2- 172.21.15.92:0/4070294241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191b61b0 0x55ce195845e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x55ce19588ad0 tx=0x7fc7f4019000 comp rx=0 tx=0).stop 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.397+0000 7fc811f54740 1 -- 172.21.15.92:0/4070294241 shutdown_connections 2024-09-21T07:18:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.397+0000 7fc811f54740 1 --2- 172.21.15.92:0/4070294241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191df070 0x55ce19591b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.397+0000 7fc811f54740 1 --2- 172.21.15.92:0/4070294241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191be390 0x55ce1959e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.397+0000 7fc811f54740 1 --2- 172.21.15.92:0/4070294241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191b61b0 0x55ce195845e0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.397+0000 7fc811f54740 1 -- 172.21.15.92:0/4070294241 >> 172.21.15.92:0/4070294241 conn(0x55ce191d3460 msgr2=0x55ce19583ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.397+0000 7fc811f54740 1 -- 172.21.15.92:0/4070294241 shutdown_connections 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.397+0000 7fc811f54740 1 -- 172.21.15.92:0/4070294241 wait complete. 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.397+0000 7fc811f54740 1 -- start start 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc811f54740 1 Processor -- start 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc811f54740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19596160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc811f54740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191be390 0x55ce195966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc811f54740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce19596be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc811f54740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b21c0 con 0x55ce191df070 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc811f54740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b1af0 con 0x55ce191be390 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc811f54740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041aed30 con 0x55ce191b61b0 2024-09-21T07:18:23.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc811f54740 10 client.0 _ll_register_callbacks cb 0x7fc7f80046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc809f7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce19596be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc809f7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce19596be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55110/0 (socket says 172.21.15.92:55110) 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc809f7d640 1 -- 172.21.15.92:0/2812576670 learned_addr learned my addr 172.21.15.92:0/2812576670 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc80977c640 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19596160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.398+0000 7fc808f7b640 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191be390 0x55ce195966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc809f7d640 1 -- 172.21.15.92:0/2812576670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 msgr2=0x55ce19596160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc809f7d640 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19596160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc809f7d640 1 -- 172.21.15.92:0/2812576670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191be390 msgr2=0x55ce195966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc809f7d640 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191be390 0x55ce195966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc809f7d640 1 -- 172.21.15.92:0/2812576670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce1960d9e0 con 0x55ce191df070 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc809f7d640 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce19596be0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc033000 tx=0x7fc7fc0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232339cf2ec44a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc7e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/2812576670 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc052060 con 0x55ce191df070 2024-09-21T07:18:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/2812576670 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc7fc04d680 con 0x55ce191df070 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc811f54740 1 -- 172.21.15.92:0/2812576670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7f4003e00 con 0x55ce191df070 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/2812576670 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc7fc059050 con 0x55ce191df070 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc811f54740 10 client.17223 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc811f54740 1 -- 172.21.15.92:0/2812576670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ce1960ec40 con 0x55ce191df070 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/2812576670 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7f4003e00 con 0x55ce191df070 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.399+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/2812576670 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc7fc03c720 con 0x55ce191df070 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc811f54740 10 client.17223 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc811f54740 10 client.17223 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc811f54740 20 client.17223 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc811f54740 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55ce19172da0 0x55ce19610f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc811f54740 4 client.17223 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc811f54740 1 -- 172.21.15.92:0/2812576670 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce194fa8a0 con 0x55ce19172da0 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc80977c640 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55ce19172da0 0x55ce19610f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc7e8ff9640 10 client.17223 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc80977c640 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55ce19172da0 0x55ce19610f80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a71b5ae14d6c20a3 server_cookie=cf51a0f5b2f98c9c in_seq=0 out_seq=0 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc7e8ff9640 1 -- 172.21.15.92:0/2812576670 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce194fa8a0 con 0x55ce19172da0 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc7e8ff9640 10 client.17223 handle_command_reply: tid=0 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.400+0000 7fc811f54740 1 client.17223 shutdown 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 1 -- 172.21.15.92:0/2812576670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 msgr2=0x55ce19596be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce19596be0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc033000 tx=0x7fc7fc0035f0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 1 -- 172.21.15.92:0/2812576670 shutdown_connections 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55ce19172da0 0x55ce19610f80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce191df070 0x55ce19596be0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ce191be390 0x55ce195966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 1 --2- 172.21.15.92:0/2812576670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce191b61b0 0x55ce19596160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 1 -- 172.21.15.92:0/2812576670 >> 172.21.15.92:0/2812576670 conn(0x55ce191d3460 msgr2=0x55ce19591b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc7e8ff9640 0 client.17223 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:18:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 1 -- 172.21.15.92:0/2812576670 shutdown_connections 2024-09-21T07:18:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 1 -- 172.21.15.92:0/2812576670 wait complete. 2024-09-21T07:18:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc811f54740 20 client.17223 trim_cache size 0 max 16384 2024-09-21T07:18:23.410 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc80b9e0640 1 -- 172.21.15.92:0/3831228631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7ec0b6700 msgr2=0x7fc7ec0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc80b9e0640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7ec0b6700 0x7fc7ec0b8c10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55ce19585320 tx=0x7fc7f400a590 comp rx=0 tx=0).stop 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc80b9e0640 1 -- 172.21.15.92:0/3831228631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8041094a0 msgr2=0x7fc80419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc80b9e0640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8041094a0 0x7fc80419a910 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800c970 tx=0x7fc7f800ce30 comp rx=0 tx=0).stop 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc80b9e0640 1 -- 172.21.15.92:0/3831228631 shutdown_connections 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc80b9e0640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7ec0b6700 0x7fc7ec0b8c10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc80b9e0640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc804109df0 0x7fc80419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc80b9e0640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8041094a0 0x7fc80419a910 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc80b9e0640 1 --2- 172.21.15.92:0/3831228631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc804103b60 0x7fc80419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.401+0000 7fc80b9e0640 1 -- 172.21.15.92:0/3831228631 >> 172.21.15.92:0/3831228631 conn(0x7fc80407b850 msgr2=0x7fc804107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.402+0000 7fc80b9e0640 1 -- 172.21.15.92:0/3831228631 shutdown_connections 2024-09-21T07:18:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:23.402+0000 7fc80b9e0640 1 -- 172.21.15.92:0/3831228631 wait complete. 2024-09-21T07:18:24.085 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:23 smithi092 ceph-mon[30987]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:18:24.113 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:18:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:23 smithi169 ceph-mon[33705]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:18:24.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:23 smithi175 ceph-mon[34064]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:18:24.357 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:18:24.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.845+0000 7fb1a5db3640 1 -- 172.21.15.92:0/3929201561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a01083c0 msgr2=0x7fb1a01087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:24.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.845+0000 7fb1a5db3640 1 --2- 172.21.15.92:0/3929201561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a01083c0 0x7fb1a01087d0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb194009ca0 tx=0x7fb19402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.845+0000 7fb1a5db3640 1 -- 172.21.15.92:0/3929201561 shutdown_connections 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.845+0000 7fb1a5db3640 1 --2- 172.21.15.92:0/3929201561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1a0108d10 0x7fb1a010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.845+0000 7fb1a5db3640 1 --2- 172.21.15.92:0/3929201561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a01083c0 0x7fb1a01087d0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.845+0000 7fb1a5db3640 1 --2- 172.21.15.92:0/3929201561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1a0102a80 0x7fb1a0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.845+0000 7fb1a5db3640 1 -- 172.21.15.92:0/3929201561 >> 172.21.15.92:0/3929201561 conn(0x7fb1a0079740 msgr2=0x7fb1a0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.845+0000 7fb1a5db3640 1 -- 172.21.15.92:0/3929201561 shutdown_connections 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.845+0000 7fb1a5db3640 1 -- 172.21.15.92:0/3929201561 wait complete. 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.845+0000 7fb1a5db3640 1 Processor -- start 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb1a5db3640 1 -- start start 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb1a5db3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1a0102a80 0x7fb1a0199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb1a5db3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1a01083c0 0x7fb1a0199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb1a5db3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a0108d10 0x7fb1a019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb1a5db3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0112880 con 0x7fb1a0108d10 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb1a5db3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0112700 con 0x7fb1a01083c0 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb1a5db3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0112a00 con 0x7fb1a0102a80 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb19ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a0108d10 0x7fb1a019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb19ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a0108d10 0x7fb1a019ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55130/0 (socket says 172.21.15.92:55130) 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb19ffff640 1 -- 172.21.15.92:0/2436433316 learned_addr learned my addr 172.21.15.92:0/2436433316 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb19effd640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1a01083c0 0x7fb1a0199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb19f7fe640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1a0102a80 0x7fb1a0199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb19ffff640 1 -- 172.21.15.92:0/2436433316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1a0102a80 msgr2=0x7fb1a0199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb19ffff640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1a0102a80 0x7fb1a0199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb19ffff640 1 -- 172.21.15.92:0/2436433316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1a01083c0 msgr2=0x7fb1a0199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb19ffff640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1a01083c0 0x7fb1a0199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.846+0000 7fb19ffff640 1 -- 172.21.15.92:0/2436433316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a019f2e0 con 0x7fb1a0108d10 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.847+0000 7fb19ffff640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a0108d10 0x7fb1a019ebb0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb19800d750 tx=0x7fb19800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:24.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.847+0000 7fb19cff9640 1 -- 172.21.15.92:0/2436433316 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb198017070 con 0x7fb1a0108d10 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.847+0000 7fb1a5db3640 1 -- 172.21.15.92:0/2436433316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a019f5d0 con 0x7fb1a0108d10 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.847+0000 7fb19cff9640 1 -- 172.21.15.92:0/2436433316 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1980054b0 con 0x7fb1a0108d10 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.847+0000 7fb19cff9640 1 -- 172.21.15.92:0/2436433316 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb198004b90 con 0x7fb1a0108d10 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.847+0000 7fb1a5db3640 1 -- 172.21.15.92:0/2436433316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a006bb40 con 0x7fb1a0108d10 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.849+0000 7fb1ac327740 1 Processor -- start 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.849+0000 7fb19cff9640 1 -- 172.21.15.92:0/2436433316 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fb198004d30 con 0x7fb1a0108d10 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb1ac327740 1 -- start start 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf6142c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf2441b0 0x556caf614800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf24c390 0x556caf614d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb1ac327740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556caf58aea0 con 0x556caf26d070 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb1ac327740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556caf57a2d0 con 0x556caf24c390 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb1ac327740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556caf57e0e0 con 0x556caf2441b0 2024-09-21T07:18:24.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf6142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf6142c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55134/0 (socket says 172.21.15.92:55134) 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19effd640 1 -- 172.21.15.92:0/3511677765 learned_addr learned my addr 172.21.15.92:0/3511677765 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19f7fe640 1 --2- 172.21.15.92:0/3511677765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf2441b0 0x556caf614800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19effd640 1 --2- 172.21.15.92:0/3511677765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf24c390 0x556caf614d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19cff9640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb1880b6680 0x7fb1880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19effd640 1 -- 172.21.15.92:0/3511677765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf2441b0 msgr2=0x556caf614800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19effd640 1 --2- 172.21.15.92:0/3511677765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf2441b0 0x556caf614800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19effd640 1 -- 172.21.15.92:0/3511677765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf24c390 msgr2=0x556caf614d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19effd640 1 --2- 172.21.15.92:0/3511677765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf24c390 0x556caf614d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19effd640 1 -- 172.21.15.92:0/3511677765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556caf2d8650 con 0x556caf26d070 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.850+0000 7fb19ffff640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb1880b6680 0x7fb1880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.851+0000 7fb19effd640 1 --2- 172.21.15.92:0/3511677765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf6142c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb194005cc0 tx=0x7fb194009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1e21485fbf8211 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.851+0000 7fb19cff9640 1 -- 172.21.15.92:0/2436433316 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fb1980e75a0 con 0x7fb1a0108d10 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.851+0000 7fb185ffb640 1 -- 172.21.15.92:0/3511677765 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194031c80 con 0x556caf26d070 2024-09-21T07:18:24.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.851+0000 7fb185ffb640 1 -- 172.21.15.92:0/3511677765 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb194046070 con 0x556caf26d070 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.851+0000 7fb185ffb640 1 -- 172.21.15.92:0/3511677765 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194004630 con 0x556caf26d070 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 -- 172.21.15.92:0/3511677765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 msgr2=0x556caf6142c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb19ffff640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb1880b6680 0x7fb1880b8b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb198021000 tx=0x7fb198071530 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 --2- 172.21.15.92:0/3511677765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf6142c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb194005cc0 tx=0x7fb194009360 comp rx=0 tx=0).stop 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 -- 172.21.15.92:0/3511677765 shutdown_connections 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 --2- 172.21.15.92:0/3511677765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf24c390 0x556caf614d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 --2- 172.21.15.92:0/3511677765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf2441b0 0x556caf614800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 --2- 172.21.15.92:0/3511677765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf6142c0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 -- 172.21.15.92:0/3511677765 >> 172.21.15.92:0/3511677765 conn(0x556caf261460 msgr2=0x556caf6121b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 -- 172.21.15.92:0/3511677765 shutdown_connections 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 -- 172.21.15.92:0/3511677765 wait complete. 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 -- start start 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.852+0000 7fb1ac327740 1 Processor -- start 2024-09-21T07:18:24.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf2441b0 0x556caf61fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf24c390 0x556caf61ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf26d070 0x556caf62bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb1ac327740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556caf3db700 con 0x556caf24c390 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb1ac327740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556caf515160 con 0x556caf26d070 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb1ac327740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556caf622a40 con 0x556caf2441b0 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf24c390 0x556caf61ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb1ac327740 10 client.0 _ll_register_callbacks cb 0x556caf52e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf24c390 0x556caf61ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55142/0 (socket says 172.21.15.92:55142) 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19f7fe640 1 -- 172.21.15.92:0/2148976822 learned_addr learned my addr 172.21.15.92:0/2148976822 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19effd640 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf26d070 0x556caf62bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19effd640 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf2441b0 0x556caf61fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19f7fe640 1 -- 172.21.15.92:0/2148976822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf2441b0 msgr2=0x556caf61fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19f7fe640 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf2441b0 0x556caf61fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19f7fe640 1 -- 172.21.15.92:0/2148976822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf26d070 msgr2=0x556caf62bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19f7fe640 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf26d070 0x556caf62bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19f7fe640 1 -- 172.21.15.92:0/2148976822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556caf542c90 con 0x556caf24c390 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19effd640 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf26d070 0x556caf62bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb19f7fe640 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf24c390 0x556caf61ff80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb19000f6f0 tx=0x7fb19000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df00acf7cedbc07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb17effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb17effd640 1 -- 172.21.15.92:0/2148976822 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190016070 con 0x556caf24c390 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb17effd640 1 -- 172.21.15.92:0/2148976822 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fb19000bb00 con 0x556caf24c390 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.853+0000 7fb1ac327740 1 -- 172.21.15.92:0/2148976822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb194046070 con 0x556caf24c390 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb17effd640 1 -- 172.21.15.92:0/2148976822 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb19000bd00 con 0x556caf24c390 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb1ac327740 10 client.17235 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb1ac327740 1 -- 172.21.15.92:0/2148976822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556caf62e8b0 con 0x556caf24c390 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb17effd640 1 -- 172.21.15.92:0/2148976822 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb194046070 con 0x556caf24c390 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb17effd640 1 -- 172.21.15.92:0/2148976822 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb19001a410 con 0x556caf24c390 2024-09-21T07:18:24.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb1ac327740 10 client.17235 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:24.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb1ac327740 10 client.17235 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:18:24.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb1ac327740 20 client.17235 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:24.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb1ac327740 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556caf22b9f0 0x556caf631e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb1ac327740 4 client.17235 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:18:24.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.854+0000 7fb1ac327740 1 -- 172.21.15.92:0/2148976822 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556caf58cdf0 con 0x556caf22b9f0 2024-09-21T07:18:24.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.855+0000 7fb19effd640 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556caf22b9f0 0x556caf631e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.856+0000 7fb19effd640 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556caf22b9f0 0x556caf631e50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b1d12ee8717b4c4b server_cookie=c52913e303104358 in_seq=0 out_seq=0 2024-09-21T07:18:24.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.856+0000 7fb17effd640 10 client.17235 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:18:24.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.856+0000 7fb17effd640 1 -- 172.21.15.92:0/2148976822 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556caf58cdf0 con 0x556caf22b9f0 2024-09-21T07:18:24.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.856+0000 7fb17effd640 10 client.17235 handle_command_reply: tid=0 2024-09-21T07:18:24.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.856+0000 7fb1ac327740 1 client.17235 shutdown 2024-09-21T07:18:24.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 1 -- 172.21.15.92:0/2148976822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf24c390 msgr2=0x556caf61ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:24.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf24c390 0x556caf61ff80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb19000f6f0 tx=0x7fb19000fbb0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 1 -- 172.21.15.92:0/2148976822 shutdown_connections 2024-09-21T07:18:24.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556caf22b9f0 0x556caf631e50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf26d070 0x556caf62bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf24c390 0x556caf61ff80 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 1 --2- 172.21.15.92:0/2148976822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf2441b0 0x556caf61fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 1 -- 172.21.15.92:0/2148976822 >> 172.21.15.92:0/2148976822 conn(0x556caf261460 msgr2=0x556caf6174a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:24.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb17effd640 0 client.17235 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:18:24.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 1 -- 172.21.15.92:0/2148976822 shutdown_connections 2024-09-21T07:18:24.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 1 -- 172.21.15.92:0/2148976822 wait complete. 2024-09-21T07:18:24.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.857+0000 7fb1ac327740 20 client.17235 trim_cache size 0 max 16384 2024-09-21T07:18:24.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.870+0000 7fb1ac327740 1 Processor -- start 2024-09-21T07:18:24.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.870+0000 7fb1ac327740 1 -- start start 2024-09-21T07:18:24.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.870+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf2441b0 0x556caf617ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.870+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf24c390 0x556caf62bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.870+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf26d070 0x556caf62c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.870+0000 7fb1ac327740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b0d90 con 0x556caf2441b0 2024-09-21T07:18:24.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.870+0000 7fb1ac327740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b28d0 con 0x556caf24c390 2024-09-21T07:18:24.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.870+0000 7fb1ac327740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b1460 con 0x556caf26d070 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf2441b0 0x556caf617ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf2441b0 0x556caf617ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55150/0 (socket says 172.21.15.92:55150) 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19effd640 1 -- 172.21.15.92:0/3270874208 learned_addr learned my addr 172.21.15.92:0/3270874208 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19f7fe640 1 --2- 172.21.15.92:0/3270874208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf24c390 0x556caf62bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19effd640 1 --2- 172.21.15.92:0/3270874208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf26d070 0x556caf62c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19effd640 1 -- 172.21.15.92:0/3270874208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf26d070 msgr2=0x556caf62c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19effd640 1 --2- 172.21.15.92:0/3270874208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf26d070 0x556caf62c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19effd640 1 -- 172.21.15.92:0/3270874208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf24c390 msgr2=0x556caf62bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19effd640 1 --2- 172.21.15.92:0/3270874208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf24c390 0x556caf62bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19effd640 1 -- 172.21.15.92:0/3270874208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556caf612b20 con 0x556caf2441b0 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb19effd640 1 --2- 172.21.15.92:0/3270874208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf2441b0 0x556caf617ad0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb194009ca0 tx=0x7fb194031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdc55c2ed9443a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb1857fa640 1 -- 172.21.15.92:0/3270874208 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194031b40 con 0x556caf2441b0 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb1857fa640 1 -- 172.21.15.92:0/3270874208 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb194046070 con 0x556caf2441b0 2024-09-21T07:18:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.871+0000 7fb1857fa640 1 -- 172.21.15.92:0/3270874208 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194003e00 con 0x556caf2441b0 2024-09-21T07:18:24.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.872+0000 7fb1ac327740 1 -- 172.21.15.92:0/3270874208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf2441b0 msgr2=0x556caf617ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:24.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.872+0000 7fb1ac327740 1 --2- 172.21.15.92:0/3270874208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf2441b0 0x556caf617ad0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb194009ca0 tx=0x7fb194031700 comp rx=0 tx=0).stop 2024-09-21T07:18:24.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.872+0000 7fb1ac327740 1 -- 172.21.15.92:0/3270874208 shutdown_connections 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.872+0000 7fb1ac327740 1 --2- 172.21.15.92:0/3270874208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf26d070 0x556caf62c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.872+0000 7fb1ac327740 1 --2- 172.21.15.92:0/3270874208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf24c390 0x556caf62bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.872+0000 7fb1ac327740 1 --2- 172.21.15.92:0/3270874208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf2441b0 0x556caf617ad0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.872+0000 7fb1ac327740 1 -- 172.21.15.92:0/3270874208 >> 172.21.15.92:0/3270874208 conn(0x556caf261460 msgr2=0x556caf6173c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.872+0000 7fb1ac327740 1 -- 172.21.15.92:0/3270874208 shutdown_connections 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.872+0000 7fb1ac327740 1 -- 172.21.15.92:0/3270874208 wait complete. 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb1ac327740 1 -- start start 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb1ac327740 1 Processor -- start 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf2441b0 0x556caf623660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf24c390 0x556caf623c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb1ac327740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf627b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb1ac327740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b2200 con 0x556caf26d070 2024-09-21T07:18:24.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb1ac327740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b1b30 con 0x556caf2441b0 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb1ac327740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01aed70 con 0x556caf24c390 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb1ac327740 10 client.0 _ll_register_callbacks cb 0x7fb19000de20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb19effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf627b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb19effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf627b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55158/0 (socket says 172.21.15.92:55158) 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb19effd640 1 -- 172.21.15.92:0/1611518019 learned_addr learned my addr 172.21.15.92:0/1611518019 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.873+0000 7fb19f7fe640 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf24c390 0x556caf623c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb19effd640 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf2441b0 0x556caf623660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb19effd640 1 -- 172.21.15.92:0/1611518019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf24c390 msgr2=0x556caf623c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb19effd640 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf24c390 0x556caf623c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb19effd640 1 -- 172.21.15.92:0/1611518019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf2441b0 msgr2=0x556caf623660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb19effd640 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf2441b0 0x556caf623660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb19effd640 1 -- 172.21.15.92:0/1611518019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556caf6281a0 con 0x556caf26d070 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb19effd640 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf627b30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fb194005c90 tx=0x7fb194050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615e752b7b44cd32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:24.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb17effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb17effd640 1 -- 172.21.15.92:0/1611518019 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194003c80 con 0x556caf26d070 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb17effd640 1 -- 172.21.15.92:0/1611518019 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fb194003e20 con 0x556caf26d070 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb1ac327740 1 -- 172.21.15.92:0/1611518019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb194046070 con 0x556caf26d070 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb17effd640 1 -- 172.21.15.92:0/1611518019 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb194031db0 con 0x556caf26d070 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb1ac327740 10 client.17241 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb1ac327740 1 -- 172.21.15.92:0/1611518019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556caf69c280 con 0x556caf26d070 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.874+0000 7fb17effd640 1 -- 172.21.15.92:0/1611518019 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb194046070 con 0x556caf26d070 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.875+0000 7fb17effd640 1 -- 172.21.15.92:0/1611518019 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb1940305c0 con 0x556caf26d070 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.875+0000 7fb1ac327740 10 client.17241 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.875+0000 7fb1ac327740 10 client.17241 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.875+0000 7fb1ac327740 20 client.17241 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.875+0000 7fb1ac327740 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556caf200da0 0x556caf69e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.875+0000 7fb1ac327740 4 client.17241 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:18:24.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.875+0000 7fb1ac327740 1 -- 172.21.15.92:0/1611518019 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556caf5888a0 con 0x556caf200da0 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.875+0000 7fb19f7fe640 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556caf200da0 0x556caf69e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.875+0000 7fb17effd640 10 client.17241 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.875+0000 7fb19f7fe640 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556caf200da0 0x556caf69e5b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5aa77af4e8564d68 server_cookie=c9037988623559a3 in_seq=0 out_seq=0 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb17effd640 1 -- 172.21.15.92:0/1611518019 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556caf5888a0 con 0x556caf200da0 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb17effd640 10 client.17241 handle_command_reply: tid=0 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 client.17241 shutdown 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 -- 172.21.15.92:0/1611518019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 msgr2=0x556caf627b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf627b30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fb194005c90 tx=0x7fb194050040 comp rx=0 tx=0).stop 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 -- 172.21.15.92:0/1611518019 shutdown_connections 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556caf200da0 0x556caf69e5b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556caf26d070 0x556caf627b30 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556caf24c390 0x556caf623c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 --2- 172.21.15.92:0/1611518019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556caf2441b0 0x556caf623660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 -- 172.21.15.92:0/1611518019 >> 172.21.15.92:0/1611518019 conn(0x556caf261460 msgr2=0x556caf611970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:24.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb17effd640 0 client.17241 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:18:24.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 -- 172.21.15.92:0/1611518019 shutdown_connections 2024-09-21T07:18:24.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 1 -- 172.21.15.92:0/1611518019 wait complete. 2024-09-21T07:18:24.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.876+0000 7fb1ac327740 20 client.17241 trim_cache size 0 max 16384 2024-09-21T07:18:24.883 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 -- 172.21.15.92:0/2436433316 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb1880b6680 msgr2=0x7fb1880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb1880b6680 0x7fb1880b8b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb198021000 tx=0x7fb198071530 comp rx=0 tx=0).stop 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 -- 172.21.15.92:0/2436433316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a0108d10 msgr2=0x7fb1a019ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a0108d10 0x7fb1a019ebb0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb19800d750 tx=0x7fb19800dc10 comp rx=0 tx=0).stop 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 -- 172.21.15.92:0/2436433316 shutdown_connections 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fb1880b6680 0x7fb1880b8b90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a0108d10 0x7fb1a019ebb0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1a01083c0 0x7fb1a0199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 --2- 172.21.15.92:0/2436433316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1a0102a80 0x7fb1a0199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 -- 172.21.15.92:0/2436433316 >> 172.21.15.92:0/2436433316 conn(0x7fb1a0079740 msgr2=0x7fb1a0104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 -- 172.21.15.92:0/2436433316 shutdown_connections 2024-09-21T07:18:24.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:24.877+0000 7fb1a5db3640 1 -- 172.21.15.92:0/2436433316 wait complete. 2024-09-21T07:18:25.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:18:26.060 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:18:26.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:25 smithi092 ceph-mon[30987]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:25 smithi169 ceph-mon[33705]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:26.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:25 smithi175 ceph-mon[34064]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:26.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.546+0000 7f4bec5d6640 1 -- 172.21.15.92:0/1960922124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be4102ae0 msgr2=0x7f4be4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:26.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.546+0000 7f4bec5d6640 1 --2- 172.21.15.92:0/1960922124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be4102ae0 0x7f4be4102ef0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4be0009900 tx=0x7f4be002a410 comp rx=0 tx=0).stop 2024-09-21T07:18:26.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.546+0000 7f4bec5d6640 1 -- 172.21.15.92:0/1960922124 shutdown_connections 2024-09-21T07:18:26.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.546+0000 7f4bec5d6640 1 --2- 172.21.15.92:0/1960922124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be4108d70 0x7f4be410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.546+0000 7f4bec5d6640 1 --2- 172.21.15.92:0/1960922124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be4108420 0x7f4be4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.546+0000 7f4bec5d6640 1 --2- 172.21.15.92:0/1960922124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be4102ae0 0x7f4be4102ef0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.546+0000 7f4bec5d6640 1 -- 172.21.15.92:0/1960922124 >> 172.21.15.92:0/1960922124 conn(0x7f4be4079770 msgr2=0x7f4be4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.546+0000 7f4bec5d6640 1 -- 172.21.15.92:0/1960922124 shutdown_connections 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.546+0000 7f4bec5d6640 1 -- 172.21.15.92:0/1960922124 wait complete. 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4bec5d6640 1 Processor -- start 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4bec5d6640 1 -- start start 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4bec5d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be4102ae0 0x7f4be4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4bec5d6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be4108420 0x7f4be41998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4bec5d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be4108d70 0x7f4be419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4bec5d6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41128e0 con 0x7f4be4108420 2024-09-21T07:18:26.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4bec5d6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4be4112760 con 0x7f4be4108d70 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4bec5d6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4be4112a60 con 0x7f4be4102ae0 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4be9b71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be4108420 0x7f4be41998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4be9b71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be4108420 0x7f4be41998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55170/0 (socket says 172.21.15.92:55170) 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.547+0000 7f4be9b71640 1 -- 172.21.15.92:0/2083722856 learned_addr learned my addr 172.21.15.92:0/2083722856 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4beab73640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be4108d70 0x7f4be419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4bea372640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be4102ae0 0x7f4be4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4be9b71640 1 -- 172.21.15.92:0/2083722856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be4102ae0 msgr2=0x7f4be4199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4be9b71640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be4102ae0 0x7f4be4199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4be9b71640 1 -- 172.21.15.92:0/2083722856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be4108d70 msgr2=0x7f4be419eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4be9b71640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be4108d70 0x7f4be419eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4be9b71640 1 -- 172.21.15.92:0/2083722856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be419f2c0 con 0x7f4be4108420 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4bea372640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be4102ae0 0x7f4be4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4beab73640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be4108d70 0x7f4be419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:18:26.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4be9b71640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be4108420 0x7f4be41998f0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400d950 tx=0x7f4bd400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:26.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4bdb7fe640 1 -- 172.21.15.92:0/2083722856 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4017070 con 0x7f4be4108420 2024-09-21T07:18:26.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4bdb7fe640 1 -- 172.21.15.92:0/2083722856 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bd4009c30 con 0x7f4be4108420 2024-09-21T07:18:26.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4bec5d6640 1 -- 172.21.15.92:0/2083722856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be419f5b0 con 0x7f4be4108420 2024-09-21T07:18:26.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4bdb7fe640 1 -- 172.21.15.92:0/2083722856 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd40047a0 con 0x7f4be4108420 2024-09-21T07:18:26.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.548+0000 7f4bec5d6640 1 -- 172.21.15.92:0/2083722856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be41a5d10 con 0x7f4be4108420 2024-09-21T07:18:26.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4bf2b4a740 1 Processor -- start 2024-09-21T07:18:26.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4bf2b4a740 1 -- start start 2024-09-21T07:18:26.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4bdb7fe640 1 -- 172.21.15.92:0/2083722856 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f4bd4004020 con 0x7f4be4108420 2024-09-21T07:18:26.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e0f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e0fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a47390 0x55fb52e10120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fb52d85ea0 con 0x55fb52a68070 2024-09-21T07:18:26.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fb52d752d0 con 0x55fb52a3f1b0 2024-09-21T07:18:26.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fb52d790e0 con 0x55fb52a47390 2024-09-21T07:18:26.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4beab73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e0f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4beab73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e0f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55172/0 (socket says 172.21.15.92:55172) 2024-09-21T07:18:26.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.551+0000 7f4beab73640 1 -- 172.21.15.92:0/4240213904 learned_addr learned my addr 172.21.15.92:0/4240213904 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:26.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4be9b71640 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a47390 0x55fb52e10120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4bea372640 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e0fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4beab73640 1 -- 172.21.15.92:0/4240213904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a47390 msgr2=0x55fb52e10120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:26.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4beab73640 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a47390 0x55fb52e10120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4beab73640 1 -- 172.21.15.92:0/4240213904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 msgr2=0x55fb52e0fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4beab73640 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e0fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4beab73640 1 -- 172.21.15.92:0/4240213904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb52ad3650 con 0x55fb52a68070 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4be9b71640 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a47390 0x55fb52e10120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4bea372640 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e0fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4beab73640 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e0f6a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009fd0 tx=0x7f4bdc010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf027121969c3d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4bdb7fe640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4bd00b6680 0x7f4bd00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4bd8ff9640 1 -- 172.21.15.92:0/4240213904 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc011700 con 0x55fb52a68070 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4bd8ff9640 1 -- 172.21.15.92:0/4240213904 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bdc011d30 con 0x55fb52a68070 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4bd8ff9640 1 -- 172.21.15.92:0/4240213904 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc01be30 con 0x55fb52a68070 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4bea372640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4bd00b6680 0x7f4bd00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.552+0000 7f4bdb7fe640 1 -- 172.21.15.92:0/2083722856 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4bd40e7900 con 0x7f4be4108420 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.553+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/4240213904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 msgr2=0x55fb52e0f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:26.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.553+0000 7f4bea372640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4bd00b6680 0x7f4bd00b8b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4be00096c0 tx=0x7f4be0032d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.553+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e0f6a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009fd0 tx=0x7f4bdc010860 comp rx=0 tx=0).stop 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.553+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/4240213904 shutdown_connections 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.553+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a47390 0x55fb52e10120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.553+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e0fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.553+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/4240213904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e0f6a0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.553+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/4240213904 >> 172.21.15.92:0/4240213904 conn(0x55fb52a5c460 msgr2=0x55fb52e0d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.553+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/4240213904 shutdown_connections 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.553+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/4240213904 wait complete. 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4bf2b4a740 1 -- start start 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4bf2b4a740 1 Processor -- start 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e1cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e1d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a68070 0x55fb52e29370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fb52bd6700 con 0x55fb52a47390 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fb52d10160 con 0x55fb52a3f1b0 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fb52e1ffe0 con 0x55fb52a68070 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4bf2b4a740 10 client.0 _ll_register_callbacks cb 0x55fb52d299e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4be9b71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e1d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4be9b71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e1d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55174/0 (socket says 172.21.15.92:55174) 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.554+0000 7f4be9b71640 1 -- 172.21.15.92:0/3905290147 learned_addr learned my addr 172.21.15.92:0/3905290147 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4beab73640 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a68070 0x55fb52e29370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4bea372640 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e1cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4be9b71640 1 -- 172.21.15.92:0/3905290147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a68070 msgr2=0x55fb52e29370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4be9b71640 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a68070 0x55fb52e29370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4be9b71640 1 -- 172.21.15.92:0/3905290147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 msgr2=0x55fb52e1cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:26.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4be9b71640 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e1cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4be9b71640 1 -- 172.21.15.92:0/3905290147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb52d3dc90 con 0x55fb52a47390 2024-09-21T07:18:26.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4be9b71640 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e1d4b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40aa620 tx=0x7f4bd40045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9eb0727e29c450c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:26.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4bcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:26.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4bcdffb640 1 -- 172.21.15.92:0/3905290147 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd40acb20 con 0x55fb52a47390 2024-09-21T07:18:26.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4bcdffb640 1 -- 172.21.15.92:0/3905290147 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4bd4094cf0 con 0x55fb52a47390 2024-09-21T07:18:26.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3905290147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bdc011d30 con 0x55fb52a47390 2024-09-21T07:18:26.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4bcdffb640 1 -- 172.21.15.92:0/3905290147 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4bd4005680 con 0x55fb52a47390 2024-09-21T07:18:26.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4bf2b4a740 10 client.17253 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:26.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3905290147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fb52e2bd30 con 0x55fb52a47390 2024-09-21T07:18:26.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.555+0000 7f4bcdffb640 1 -- 172.21.15.92:0/3905290147 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bdc011d30 con 0x55fb52a47390 2024-09-21T07:18:26.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.556+0000 7f4bcdffb640 1 -- 172.21.15.92:0/3905290147 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4bd40a7ab0 con 0x55fb52a47390 2024-09-21T07:18:26.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.556+0000 7f4bf2b4a740 10 client.17253 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:26.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.556+0000 7f4bf2b4a740 10 client.17253 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:18:26.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.556+0000 7f4bf2b4a740 20 client.17253 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:26.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.556+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55fb52a269f0 0x55fb52e2f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.556+0000 7f4bf2b4a740 4 client.17253 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:18:26.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.556+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3905290147 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb52d87df0 con 0x55fb52a269f0 2024-09-21T07:18:26.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.556+0000 7f4bea372640 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55fb52a269f0 0x55fb52e2f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.557+0000 7f4bea372640 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55fb52a269f0 0x55fb52e2f090 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=892d3c1bccd7cab3 server_cookie=778206ec9522c8b1 in_seq=0 out_seq=0 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.557+0000 7f4bcdffb640 10 client.17253 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.557+0000 7f4bcdffb640 1 -- 172.21.15.92:0/3905290147 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb52d87df0 con 0x55fb52a269f0 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.557+0000 7f4bcdffb640 10 client.17253 handle_command_reply: tid=0 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.557+0000 7f4bf2b4a740 1 client.17253 shutdown 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.557+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3905290147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 msgr2=0x55fb52e1d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.557+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e1d4b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40aa620 tx=0x7f4bd40045c0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.557+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3905290147 shutdown_connections 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.557+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55fb52a269f0 0x55fb52e2f090 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.558+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a68070 0x55fb52e29370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.558+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e1d4b0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.558+0000 7f4bcdffb640 0 client.17253 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:18:26.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.558+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/3905290147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e1cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.558+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3905290147 >> 172.21.15.92:0/3905290147 conn(0x55fb52a5c460 msgr2=0x55fb52e0bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:26.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.558+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3905290147 shutdown_connections 2024-09-21T07:18:26.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.558+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3905290147 wait complete. 2024-09-21T07:18:26.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.558+0000 7f4bf2b4a740 20 client.17253 trim_cache size 0 max 16384 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4bf2b4a740 1 Processor -- start 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4bf2b4a740 1 -- start start 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a3f1b0 0x55fb52e1ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a47390 0x55fb52e1a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e1a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41aecd0 con 0x55fb52a68070 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41b0810 con 0x55fb52a47390 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41af3a0 con 0x55fb52a3f1b0 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4beab73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e1a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4beab73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e1a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55190/0 (socket says 172.21.15.92:55190) 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.571+0000 7f4beab73640 1 -- 172.21.15.92:0/3745600395 learned_addr learned my addr 172.21.15.92:0/3745600395 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:26.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4bea372640 1 --2- 172.21.15.92:0/3745600395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a3f1b0 0x55fb52e1ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4be9b71640 1 --2- 172.21.15.92:0/3745600395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a47390 0x55fb52e1a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4beab73640 1 -- 172.21.15.92:0/3745600395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a3f1b0 msgr2=0x55fb52e1ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4beab73640 1 --2- 172.21.15.92:0/3745600395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a3f1b0 0x55fb52e1ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4beab73640 1 -- 172.21.15.92:0/3745600395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a47390 msgr2=0x55fb52e1a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4beab73640 1 --2- 172.21.15.92:0/3745600395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a47390 0x55fb52e1a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4beab73640 1 -- 172.21.15.92:0/3745600395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb52e11cf0 con 0x55fb52a68070 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4be9b71640 1 --2- 172.21.15.92:0/3745600395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a47390 0x55fb52e1a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4beab73640 1 --2- 172.21.15.92:0/3745600395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e1a6a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009aa0 tx=0x7f4bdc01b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3941da653ffdd16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4bcffff640 1 -- 172.21.15.92:0/3745600395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc02a070 con 0x55fb52a68070 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4bcffff640 1 -- 172.21.15.92:0/3745600395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bdc004e50 con 0x55fb52a68070 2024-09-21T07:18:26.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.572+0000 7f4bcffff640 1 -- 172.21.15.92:0/3745600395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc011b20 con 0x55fb52a68070 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.573+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3745600395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 msgr2=0x55fb52e1a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.573+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/3745600395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e1a6a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009aa0 tx=0x7f4bdc01b990 comp rx=0 tx=0).stop 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.573+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3745600395 shutdown_connections 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.573+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/3745600395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a68070 0x55fb52e1a6a0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.573+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/3745600395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a47390 0x55fb52e1a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.573+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/3745600395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a3f1b0 0x55fb52e1ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.573+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3745600395 >> 172.21.15.92:0/3745600395 conn(0x55fb52a5c460 msgr2=0x55fb52e14eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.573+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3745600395 shutdown_connections 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.573+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/3745600395 wait complete. 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.573+0000 7f4bf2b4a740 1 -- start start 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bf2b4a740 1 Processor -- start 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e23570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e23ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bf2b4a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a68070 0x55fb52e98a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41b0140 con 0x55fb52a47390 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41afa70 con 0x55fb52a3f1b0 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bf2b4a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41accb0 con 0x55fb52a68070 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bf2b4a740 10 client.0 _ll_register_callbacks cb 0x7f4bd40e5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4be9b71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e23ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4be9b71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e23ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55200/0 (socket says 172.21.15.92:55200) 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4be9b71640 1 -- 172.21.15.92:0/452163113 learned_addr learned my addr 172.21.15.92:0/452163113 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bea372640 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e23570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4beab73640 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a68070 0x55fb52e98a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4be9b71640 1 -- 172.21.15.92:0/452163113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a68070 msgr2=0x55fb52e98a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4be9b71640 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a68070 0x55fb52e98a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4be9b71640 1 -- 172.21.15.92:0/452163113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 msgr2=0x55fb52e23570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4be9b71640 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e23570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4be9b71640 1 -- 172.21.15.92:0/452163113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb52e242e0 con 0x55fb52a47390 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bea372640 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e23570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4be9b71640 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e23ab0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40a9980 tx=0x7f4bd40a8f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0279e32d16ae7b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.574+0000 7f4bcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bcdffb640 1 -- 172.21.15.92:0/452163113 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd40acb20 con 0x55fb52a47390 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bcdffb640 1 -- 172.21.15.92:0/452163113 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f4bd40c8650 con 0x55fb52a47390 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/452163113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bdc004e50 con 0x55fb52a47390 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bcdffb640 1 -- 172.21.15.92:0/452163113 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4bd40acec0 con 0x55fb52a47390 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bf2b4a740 10 client.17259 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/452163113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fb52e99eb0 con 0x55fb52a47390 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bcdffb640 1 -- 172.21.15.92:0/452163113 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bdc004e50 con 0x55fb52a47390 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bcdffb640 1 -- 172.21.15.92:0/452163113 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4bd40c8250 con 0x55fb52a47390 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bf2b4a740 10 client.17259 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bf2b4a740 10 client.17259 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bf2b4a740 20 client.17259 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55fb529fbda0 0x55fb52e9c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bf2b4a740 4 client.17259 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.575+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/452163113 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb52d838a0 con 0x55fb529fbda0 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bea372640 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55fb529fbda0 0x55fb52e9c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bea372640 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55fb529fbda0 0x55fb52e9c4e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b4c9bf417f38fd5 server_cookie=190677118accbae1 in_seq=0 out_seq=0 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bcdffb640 10 client.17259 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bcdffb640 1 -- 172.21.15.92:0/452163113 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb52d838a0 con 0x55fb529fbda0 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bcdffb640 10 client.17259 handle_command_reply: tid=0 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bf2b4a740 1 client.17259 shutdown 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/452163113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 msgr2=0x55fb52e23ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e23ab0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40a9980 tx=0x7f4bd40a8f10 comp rx=0 tx=0).stop 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/452163113 shutdown_connections 2024-09-21T07:18:26.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55fb529fbda0 0x55fb52e9c4e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb52a68070 0x55fb52e98a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb52a47390 0x55fb52e23ab0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bf2b4a740 1 --2- 172.21.15.92:0/452163113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fb52a3f1b0 0x55fb52e23570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bcdffb640 0 client.17259 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:18:26.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.576+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/452163113 >> 172.21.15.92:0/452163113 conn(0x55fb52a5c460 msgr2=0x55fb52e14eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:26.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/452163113 shutdown_connections 2024-09-21T07:18:26.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bf2b4a740 1 -- 172.21.15.92:0/452163113 wait complete. 2024-09-21T07:18:26.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bf2b4a740 20 client.17259 trim_cache size 0 max 16384 2024-09-21T07:18:26.583 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:18:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 -- 172.21.15.92:0/2083722856 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4bd00b6680 msgr2=0x7f4bd00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4bd00b6680 0x7f4bd00b8b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4be00096c0 tx=0x7f4be0032d80 comp rx=0 tx=0).stop 2024-09-21T07:18:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 -- 172.21.15.92:0/2083722856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be4108420 msgr2=0x7f4be41998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be4108420 0x7f4be41998f0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400d950 tx=0x7f4bd400de10 comp rx=0 tx=0).stop 2024-09-21T07:18:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 -- 172.21.15.92:0/2083722856 shutdown_connections 2024-09-21T07:18:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4bd00b6680 0x7f4bd00b8b90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be4108d70 0x7f4be419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4be4108420 0x7f4be41998f0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 --2- 172.21.15.92:0/2083722856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be4102ae0 0x7f4be4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 -- 172.21.15.92:0/2083722856 >> 172.21.15.92:0/2083722856 conn(0x7f4be4079770 msgr2=0x7f4be4106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 -- 172.21.15.92:0/2083722856 shutdown_connections 2024-09-21T07:18:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:26.577+0000 7f4bec5d6640 1 -- 172.21.15.92:0/2083722856 wait complete. 2024-09-21T07:18:27.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:18:27.695 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:18:28.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:27 smithi092 ceph-mon[30987]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:18:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:27 smithi169 ceph-mon[33705]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:18:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.199+0000 7f8425f77640 1 -- 172.21.15.92:0/3457296082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8420102ae0 msgr2=0x7f8420102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.199+0000 7f8425f77640 1 --2- 172.21.15.92:0/3457296082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8420102ae0 0x7f8420102ef0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8410009900 tx=0x7f841002a410 comp rx=0 tx=0).stop 2024-09-21T07:18:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.199+0000 7f8425f77640 1 -- 172.21.15.92:0/3457296082 shutdown_connections 2024-09-21T07:18:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.199+0000 7f8425f77640 1 --2- 172.21.15.92:0/3457296082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8420108d20 0x7f842010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.199+0000 7f8425f77640 1 --2- 172.21.15.92:0/3457296082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84201083d0 0x7f84201087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.199+0000 7f8425f77640 1 --2- 172.21.15.92:0/3457296082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8420102ae0 0x7f8420102ef0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.199+0000 7f8425f77640 1 -- 172.21.15.92:0/3457296082 >> 172.21.15.92:0/3457296082 conn(0x7f8420079760 msgr2=0x7f8420079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.199+0000 7f8425f77640 1 -- 172.21.15.92:0/3457296082 shutdown_connections 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.199+0000 7f8425f77640 1 -- 172.21.15.92:0/3457296082 wait complete. 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.200+0000 7f8425f77640 1 Processor -- start 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.200+0000 7f8425f77640 1 -- start start 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.200+0000 7f8425f77640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8420102ae0 0x7f842019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.200+0000 7f8425f77640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84201083d0 0x7f842019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f8425f77640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8420108d20 0x7f842019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8420102ae0 0x7f842019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f8425f77640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f84201128a0 con 0x7f8420102ae0 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f8425f77640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8420112720 con 0x7f8420108d20 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f8425f77640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8420112a20 con 0x7f84201083d0 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8420102ae0 0x7f842019a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55210/0 (socket says 172.21.15.92:55210) 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841f7fe640 1 -- 172.21.15.92:0/3594884976 learned_addr learned my addr 172.21.15.92:0/3594884976 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841effd640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84201083d0 0x7f842019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841ffff640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8420108d20 0x7f842019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841f7fe640 1 -- 172.21.15.92:0/3594884976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84201083d0 msgr2=0x7f842019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841f7fe640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84201083d0 0x7f842019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841f7fe640 1 -- 172.21.15.92:0/3594884976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8420108d20 msgr2=0x7f842019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841f7fe640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8420108d20 0x7f842019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841f7fe640 1 -- 172.21.15.92:0/3594884976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84201a0270 con 0x7f8420102ae0 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841ffff640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8420108d20 0x7f842019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841effd640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84201083d0 0x7f842019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841f7fe640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8420102ae0 0x7f842019a3c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8410009a20 tx=0x7f8410004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841cff9640 1 -- 172.21.15.92:0/3594884976 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841003f030 con 0x7f8420102ae0 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841cff9640 1 -- 172.21.15.92:0/3594884976 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84100035f0 con 0x7f8420102ae0 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f8425f77640 1 -- 172.21.15.92:0/3594884976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84201a0500 con 0x7f8420102ae0 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f841cff9640 1 -- 172.21.15.92:0/3594884976 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410035070 con 0x7f8420102ae0 2024-09-21T07:18:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.201+0000 7f8425f77640 1 -- 172.21.15.92:0/3594884976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84201a6d80 con 0x7f8420102ae0 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f842c4eb740 1 Processor -- start 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f841cff9640 1 -- 172.21.15.92:0/3594884976 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f8410003aa0 con 0x7f8420102ae0 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f842c4eb740 1 -- start start 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f0d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 0x5567a9f0dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 0x5567a9f0e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f842c4eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5567a9e83ea0 con 0x5567a9b66070 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f842c4eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5567a9e732d0 con 0x5567a9b3d1b0 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f842c4eb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5567a9e770e0 con 0x5567a9b45390 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f841ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f0d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f841ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f0d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55212/0 (socket says 172.21.15.92:55212) 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.204+0000 7f841ffff640 1 -- 172.21.15.92:0/2557552140 learned_addr learned my addr 172.21.15.92:0/2557552140 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841f7fe640 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 0x5567a9f0dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841effd640 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 0x5567a9f0e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841ffff640 1 -- 172.21.15.92:0/2557552140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 msgr2=0x5567a9f0e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841ffff640 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 0x5567a9f0e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841ffff640 1 -- 172.21.15.92:0/2557552140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 msgr2=0x5567a9f0dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841ffff640 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 0x5567a9f0dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841ffff640 1 -- 172.21.15.92:0/2557552140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a9bd1650 con 0x5567a9b66070 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841effd640 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 0x5567a9f0e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841f7fe640 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 0x5567a9f0dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841cff9640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b66b0 0x7f84080b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841ffff640 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f0d6a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8418007f30 tx=0x7f841800c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25de8ca3d480040 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841f7fe640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b66b0 0x7f84080b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f8405ffb640 1 -- 172.21.15.92:0/2557552140 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418014070 con 0x5567a9b66070 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f8405ffb640 1 -- 172.21.15.92:0/2557552140 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f841800fce0 con 0x5567a9b66070 2024-09-21T07:18:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f8405ffb640 1 -- 172.21.15.92:0/2557552140 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841800eba0 con 0x5567a9b66070 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.205+0000 7f841cff9640 1 -- 172.21.15.92:0/3594884976 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f8410108490 con 0x7f8420102ae0 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f842c4eb740 1 -- 172.21.15.92:0/2557552140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 msgr2=0x5567a9f0d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f841f7fe640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b66b0 0x7f84080b8bc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8410105990 tx=0x7f841002a410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f0d6a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8418007f30 tx=0x7f841800c750 comp rx=0 tx=0).stop 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f842c4eb740 1 -- 172.21.15.92:0/2557552140 shutdown_connections 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 0x5567a9f0e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 0x5567a9f0dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2557552140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f0d6a0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f842c4eb740 1 -- 172.21.15.92:0/2557552140 >> 172.21.15.92:0/2557552140 conn(0x5567a9b5a460 msgr2=0x5567a9f0b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f842c4eb740 1 -- 172.21.15.92:0/2557552140 shutdown_connections 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f842c4eb740 1 -- 172.21.15.92:0/2557552140 wait complete. 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.206+0000 7f842c4eb740 1 -- start start 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f842c4eb740 1 Processor -- start 2024-09-21T07:18:28.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b3d1b0 0x5567a9f18d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f192c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 0x5567a9f25170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f842c4eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5567a9cd4700 con 0x5567a9b45390 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f842c4eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5567a9e0e160 con 0x5567a9b66070 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f842c4eb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5567a9f1be80 con 0x5567a9b3d1b0 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f842c4eb740 10 client.0 _ll_register_callbacks cb 0x5567a9e279e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f841effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f192c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f841effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f192c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55222/0 (socket says 172.21.15.92:55222) 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f841effd640 1 -- 172.21.15.92:0/2666454855 learned_addr learned my addr 172.21.15.92:0/2666454855 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f841ffff640 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b3d1b0 0x5567a9f18d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f841ffff640 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 0x5567a9f25170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f841effd640 1 -- 172.21.15.92:0/2666454855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b3d1b0 msgr2=0x5567a9f18d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:28.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f841effd640 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b3d1b0 0x5567a9f18d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f841effd640 1 -- 172.21.15.92:0/2666454855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 msgr2=0x5567a9f25170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.207+0000 7f841effd640 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 0x5567a9f25170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f841effd640 1 -- 172.21.15.92:0/2666454855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a9e3bc90 con 0x5567a9b45390 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f841ffff640 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 0x5567a9f25170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f841effd640 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f192c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f841400f660 tx=0x7f841400fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648fa5181302b055 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f83feffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f83feffd640 1 -- 172.21.15.92:0/2666454855 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841400dac0 con 0x5567a9b45390 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f83feffd640 1 -- 172.21.15.92:0/2666454855 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f841400dc60 con 0x5567a9b45390 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f842c4eb740 1 -- 172.21.15.92:0/2666454855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f841800fce0 con 0x5567a9b45390 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f83feffd640 1 -- 172.21.15.92:0/2666454855 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f841400fe60 con 0x5567a9b45390 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f842c4eb740 10 client.17271 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f842c4eb740 1 -- 172.21.15.92:0/2666454855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5567a9f27b60 con 0x5567a9b45390 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f83feffd640 1 -- 172.21.15.92:0/2666454855 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f841800fce0 con 0x5567a9b45390 2024-09-21T07:18:28.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.208+0000 7f83feffd640 1 -- 172.21.15.92:0/2666454855 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8414019430 con 0x5567a9b45390 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.209+0000 7f842c4eb740 10 client.17271 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.209+0000 7f842c4eb740 10 client.17271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.209+0000 7f842c4eb740 20 client.17271 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.209+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567a9b249f0 0x5567a9f2b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.209+0000 7f842c4eb740 4 client.17271 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.209+0000 7f842c4eb740 1 -- 172.21.15.92:0/2666454855 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567a9e85df0 con 0x5567a9b249f0 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.209+0000 7f841ffff640 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567a9b249f0 0x5567a9f2b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.209+0000 7f83feffd640 10 client.17271 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.209+0000 7f841ffff640 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567a9b249f0 0x5567a9f2b100 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8dbc2c66435b248 server_cookie=9f2fa336e44cc1ba in_seq=0 out_seq=0 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f83feffd640 1 -- 172.21.15.92:0/2666454855 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5567a9e85df0 con 0x5567a9b249f0 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f83feffd640 10 client.17271 handle_command_reply: tid=0 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 client.17271 shutdown 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 -- 172.21.15.92:0/2666454855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 msgr2=0x5567a9f192c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:28.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f192c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f841400f660 tx=0x7f841400fb20 comp rx=0 tx=0).stop 2024-09-21T07:18:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 -- 172.21.15.92:0/2666454855 shutdown_connections 2024-09-21T07:18:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567a9b249f0 0x5567a9f2b100 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 0x5567a9f25170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f192c0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f83feffd640 0 client.17271 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2666454855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b3d1b0 0x5567a9f18d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 -- 172.21.15.92:0/2666454855 >> 172.21.15.92:0/2666454855 conn(0x5567a9b5a460 msgr2=0x5567a9f10880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 -- 172.21.15.92:0/2666454855 shutdown_connections 2024-09-21T07:18:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 1 -- 172.21.15.92:0/2666454855 wait complete. 2024-09-21T07:18:28.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.210+0000 7f842c4eb740 20 client.17271 trim_cache size 0 max 16384 2024-09-21T07:18:28.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f842c4eb740 1 Processor -- start 2024-09-21T07:18:28.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f842c4eb740 1 -- start start 2024-09-21T07:18:28.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b3d1b0 0x5567a9f17c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f1a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 0x5567a9f25070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f842c4eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f84201b0e20 con 0x5567a9b45390 2024-09-21T07:18:28.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f842c4eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84201b2960 con 0x5567a9b66070 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f842c4eb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84201b14f0 con 0x5567a9b3d1b0 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f841effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f1a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f841effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f1a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55228/0 (socket says 172.21.15.92:55228) 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f841effd640 1 -- 172.21.15.92:0/541833951 learned_addr learned my addr 172.21.15.92:0/541833951 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f841ffff640 1 --2- 172.21.15.92:0/541833951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 0x5567a9f25070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f841ffff640 1 --2- 172.21.15.92:0/541833951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b3d1b0 0x5567a9f17c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f841effd640 1 -- 172.21.15.92:0/541833951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b3d1b0 msgr2=0x5567a9f17c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f841effd640 1 --2- 172.21.15.92:0/541833951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b3d1b0 0x5567a9f17c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f841effd640 1 -- 172.21.15.92:0/541833951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 msgr2=0x5567a9f25070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f841effd640 1 --2- 172.21.15.92:0/541833951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 0x5567a9f25070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.225+0000 7f841effd640 1 -- 172.21.15.92:0/541833951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a9f0fee0 con 0x5567a9b45390 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.226+0000 7f841effd640 1 --2- 172.21.15.92:0/541833951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f1a9b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8414001eb0 tx=0x7f841400a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd755c69d239c42b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.226+0000 7f84057fa640 1 -- 172.21.15.92:0/541833951 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414019430 con 0x5567a9b45390 2024-09-21T07:18:28.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.226+0000 7f84057fa640 1 -- 172.21.15.92:0/541833951 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84140195d0 con 0x5567a9b45390 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.226+0000 7f84057fa640 1 -- 172.21.15.92:0/541833951 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414011a40 con 0x5567a9b45390 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.227+0000 7f842c4eb740 1 -- 172.21.15.92:0/541833951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 msgr2=0x5567a9f1a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.227+0000 7f842c4eb740 1 --2- 172.21.15.92:0/541833951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f1a9b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8414001eb0 tx=0x7f841400a7a0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.227+0000 7f842c4eb740 1 -- 172.21.15.92:0/541833951 shutdown_connections 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.227+0000 7f842c4eb740 1 --2- 172.21.15.92:0/541833951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b66070 0x5567a9f25070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.227+0000 7f842c4eb740 1 --2- 172.21.15.92:0/541833951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b45390 0x5567a9f1a9b0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.227+0000 7f842c4eb740 1 --2- 172.21.15.92:0/541833951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b3d1b0 0x5567a9f17c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.227+0000 7f842c4eb740 1 -- 172.21.15.92:0/541833951 >> 172.21.15.92:0/541833951 conn(0x5567a9b5a460 msgr2=0x5567a9f1a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.227+0000 7f842c4eb740 1 -- 172.21.15.92:0/541833951 shutdown_connections 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.227+0000 7f842c4eb740 1 -- 172.21.15.92:0/541833951 wait complete. 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.228+0000 7f842c4eb740 1 -- start start 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.228+0000 7f842c4eb740 1 Processor -- start 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.228+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 0x5567a9f1d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.228+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 0x5567a9f1dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.228+0000 7f842c4eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f94a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.228+0000 7f842c4eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f84201b2290 con 0x5567a9b66070 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.228+0000 7f842c4eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84201b1bc0 con 0x5567a9b3d1b0 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.228+0000 7f842c4eb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84201aee00 con 0x5567a9b45390 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f842c4eb740 10 client.0 _ll_register_callbacks cb 0x7f841400a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f94a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 0x5567a9f1d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f94a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55240/0 (socket says 172.21.15.92:55240) 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841ffff640 1 -- 172.21.15.92:0/2933371452 learned_addr learned my addr 172.21.15.92:0/2933371452 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841effd640 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 0x5567a9f1dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841ffff640 1 -- 172.21.15.92:0/2933371452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 msgr2=0x5567a9f1dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841ffff640 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 0x5567a9f1dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841ffff640 1 -- 172.21.15.92:0/2933371452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 msgr2=0x5567a9f1d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841ffff640 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 0x5567a9f1d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841ffff640 1 -- 172.21.15.92:0/2933371452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a9f94fc0 con 0x5567a9b66070 2024-09-21T07:18:28.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f841ffff640 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f94a80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f8418007e50 tx=0x7f841400aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5850ff1779f4247b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f83feffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f83feffd640 1 -- 172.21.15.92:0/2933371452 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418028040 con 0x5567a9b66070 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f83feffd640 1 -- 172.21.15.92:0/2933371452 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f841800ece0 con 0x5567a9b66070 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.229+0000 7f842c4eb740 1 -- 172.21.15.92:0/2933371452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84140195d0 con 0x5567a9b66070 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f83feffd640 1 -- 172.21.15.92:0/2933371452 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8418014040 con 0x5567a9b66070 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f842c4eb740 10 client.17277 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f842c4eb740 1 -- 172.21.15.92:0/2933371452 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5567a9f96240 con 0x5567a9b66070 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f83feffd640 1 -- 172.21.15.92:0/2933371452 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84140195d0 con 0x5567a9b66070 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f83feffd640 1 -- 172.21.15.92:0/2933371452 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8418019450 con 0x5567a9b66070 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f842c4eb740 10 client.17277 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f842c4eb740 10 client.17277 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f842c4eb740 20 client.17277 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567a9af9da0 0x5567a9f98830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f842c4eb740 4 client.17277 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:18:28.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f842c4eb740 1 -- 172.21.15.92:0/2933371452 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5567a9e818a0 con 0x5567a9af9da0 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.230+0000 7f841effd640 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567a9af9da0 0x5567a9f98830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f841effd640 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567a9af9da0 0x5567a9f98830 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d075b375fcdea86d server_cookie=48265211f7143fcf in_seq=0 out_seq=0 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f83feffd640 10 client.17277 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f83feffd640 1 -- 172.21.15.92:0/2933371452 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5567a9e818a0 con 0x5567a9af9da0 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f83feffd640 10 client.17277 handle_command_reply: tid=0 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f842c4eb740 1 client.17277 shutdown 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f842c4eb740 1 -- 172.21.15.92:0/2933371452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 msgr2=0x5567a9f94a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f94a80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f8418007e50 tx=0x7f841400aaa0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f842c4eb740 1 -- 172.21.15.92:0/2933371452 shutdown_connections 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5567a9af9da0 0x5567a9f98830 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5567a9b66070 0x5567a9f94a80 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567a9b45390 0x5567a9f1dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f83feffd640 0 client.17277 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f842c4eb740 1 --2- 172.21.15.92:0/2933371452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5567a9b3d1b0 0x5567a9f1d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f842c4eb740 1 -- 172.21.15.92:0/2933371452 >> 172.21.15.92:0/2933371452 conn(0x5567a9b5a460 msgr2=0x5567a9f1a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:28.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.231+0000 7f842c4eb740 1 -- 172.21.15.92:0/2933371452 shutdown_connections 2024-09-21T07:18:28.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f842c4eb740 1 -- 172.21.15.92:0/2933371452 wait complete. 2024-09-21T07:18:28.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f842c4eb740 20 client.17277 trim_cache size 0 max 16384 2024-09-21T07:18:28.240 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:18:28.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 -- 172.21.15.92:0/3594884976 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b66b0 msgr2=0x7f84080b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b66b0 0x7f84080b8bc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8410105990 tx=0x7f841002a410 comp rx=0 tx=0).stop 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 -- 172.21.15.92:0/3594884976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8420102ae0 msgr2=0x7f842019a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8420102ae0 0x7f842019a3c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8410009a20 tx=0x7f8410004270 comp rx=0 tx=0).stop 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 -- 172.21.15.92:0/3594884976 shutdown_connections 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84080b66b0 0x7f84080b8bc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8420108d20 0x7f842019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84201083d0 0x7f842019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 --2- 172.21.15.92:0/3594884976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8420102ae0 0x7f842019a3c0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 -- 172.21.15.92:0/3594884976 >> 172.21.15.92:0/3594884976 conn(0x7f8420079760 msgr2=0x7f8420101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 -- 172.21.15.92:0/3594884976 shutdown_connections 2024-09-21T07:18:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:28.232+0000 7f8425f77640 1 -- 172.21.15.92:0/3594884976 wait complete. 2024-09-21T07:18:28.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:27 smithi175 ceph-mon[34064]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:18:30.023 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:18:30.023 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:18:30.282 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:18:30.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:30 smithi169 ceph-mon[33705]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:30.679 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:30 smithi092 ceph-mon[30987]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:30.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:30 smithi175 ceph-mon[34064]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:30.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.772+0000 7fec3291a640 1 -- 172.21.15.92:0/2129892041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec2c108cf0 msgr2=0x7fec2c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:30.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.772+0000 7fec3291a640 1 --2- 172.21.15.92:0/2129892041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec2c108cf0 0x7fec2c10f520 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fec24009ca0 tx=0x7fec2402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.772+0000 7fec3291a640 1 -- 172.21.15.92:0/2129892041 shutdown_connections 2024-09-21T07:18:30.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.772+0000 7fec3291a640 1 --2- 172.21.15.92:0/2129892041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec2c108cf0 0x7fec2c10f520 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.772+0000 7fec3291a640 1 --2- 172.21.15.92:0/2129892041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c1083a0 0x7fec2c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.772+0000 7fec3291a640 1 --2- 172.21.15.92:0/2129892041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec2c102a60 0x7fec2c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.772+0000 7fec3291a640 1 -- 172.21.15.92:0/2129892041 >> 172.21.15.92:0/2129892041 conn(0x7fec2c079730 msgr2=0x7fec2c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.772+0000 7fec3291a640 1 -- 172.21.15.92:0/2129892041 shutdown_connections 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.772+0000 7fec3291a640 1 -- 172.21.15.92:0/2129892041 wait complete. 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec3291a640 1 Processor -- start 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec3291a640 1 -- start start 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec3291a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec2c102a60 0x7fec2c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec3291a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c1083a0 0x7fec2c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec3291a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec2c108cf0 0x7fec2c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec3291a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c112860 con 0x7fec2c108cf0 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec3291a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1126e0 con 0x7fec2c102a60 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec3291a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1129e0 con 0x7fec2c1083a0 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec30eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec2c108cf0 0x7fec2c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec30eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec2c108cf0 0x7fec2c1000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52778/0 (socket says 172.21.15.92:52778) 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec30eb7640 1 -- 172.21.15.92:0/3320787297 learned_addr learned my addr 172.21.15.92:0/3320787297 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c1083a0 0x7fec2c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec2bfff640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec2c102a60 0x7fec2c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec30eb7640 1 -- 172.21.15.92:0/3320787297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c1083a0 msgr2=0x7fec2c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec30eb7640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c1083a0 0x7fec2c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec30eb7640 1 -- 172.21.15.92:0/3320787297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec2c102a60 msgr2=0x7fec2c0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec30eb7640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec2c102a60 0x7fec2c0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.773+0000 7fec30eb7640 1 -- 172.21.15.92:0/3320787297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c1a8660 con 0x7fec2c108cf0 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.774+0000 7fec30eb7640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec2c108cf0 0x7fec2c1000f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fec24005cc0 tx=0x7fec24032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.774+0000 7fec297fa640 1 -- 172.21.15.92:0/3320787297 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24032e00 con 0x7fec2c108cf0 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.774+0000 7fec297fa640 1 -- 172.21.15.92:0/3320787297 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec240044d0 con 0x7fec2c108cf0 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.774+0000 7fec3291a640 1 -- 172.21.15.92:0/3320787297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2c1a88f0 con 0x7fec2c108cf0 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.774+0000 7fec297fa640 1 -- 172.21.15.92:0/3320787297 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24030b70 con 0x7fec2c108cf0 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.774+0000 7fec3291a640 1 -- 172.21.15.92:0/3320787297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2c1a8e30 con 0x7fec2c108cf0 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec38e8e740 1 Processor -- start 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec297fa640 1 -- 172.21.15.92:0/3320787297 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fec24004680 con 0x7fec2c108cf0 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec38e8e740 1 -- start start 2024-09-21T07:18:30.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8d3490 0x56418fca3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fca3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec38e8e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56418fc19e60 con 0x56418f8fc350 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec38e8e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56418fc09290 con 0x56418f8d3490 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec38e8e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56418fc0d0a0 con 0x56418f8db670 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec2b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec2b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52782/0 (socket says 172.21.15.92:52782) 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.777+0000 7fec2b7fe640 1 -- 172.21.15.92:0/4076055113 learned_addr learned my addr 172.21.15.92:0/4076055113 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec2bfff640 1 --2- 172.21.15.92:0/4076055113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8d3490 0x56418fca3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/4076055113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fca3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec2b7fe640 1 -- 172.21.15.92:0/4076055113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 msgr2=0x56418fca3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/4076055113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fca3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec2b7fe640 1 -- 172.21.15.92:0/4076055113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8d3490 msgr2=0x56418fca3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/4076055113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8d3490 0x56418fca3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec2b7fe640 1 -- 172.21.15.92:0/4076055113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56418f967930 con 0x56418f8fc350 2024-09-21T07:18:30.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec297fa640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fec140b6680 0x7fec140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec2bfff640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fec140b6680 0x7fec140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/4076055113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca3430 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fec20013480 tx=0x7fec2000b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc37b0b5a789a8fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:30.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec297fa640 1 -- 172.21.15.92:0/3320787297 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fec24108df0 con 0x7fec2c108cf0 2024-09-21T07:18:30.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec127fc640 1 -- 172.21.15.92:0/4076055113 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20019030 con 0x56418f8fc350 2024-09-21T07:18:30.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec127fc640 1 -- 172.21.15.92:0/4076055113 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec20005bf0 con 0x56418f8fc350 2024-09-21T07:18:30.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.778+0000 7fec127fc640 1 -- 172.21.15.92:0/4076055113 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20011440 con 0x56418f8fc350 2024-09-21T07:18:30.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.779+0000 7fec38e8e740 1 -- 172.21.15.92:0/4076055113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 msgr2=0x56418fca3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.779+0000 7fec2bfff640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fec140b6680 0x7fec140b8b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fec1c005a80 tx=0x7fec1c005a10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.779+0000 7fec38e8e740 1 --2- 172.21.15.92:0/4076055113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca3430 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fec20013480 tx=0x7fec2000b5c0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.779+0000 7fec38e8e740 1 -- 172.21.15.92:0/4076055113 shutdown_connections 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.779+0000 7fec38e8e740 1 --2- 172.21.15.92:0/4076055113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fca3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.779+0000 7fec38e8e740 1 --2- 172.21.15.92:0/4076055113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8d3490 0x56418fca3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.779+0000 7fec38e8e740 1 --2- 172.21.15.92:0/4076055113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca3430 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.779+0000 7fec38e8e740 1 -- 172.21.15.92:0/4076055113 >> 172.21.15.92:0/4076055113 conn(0x56418f8f0740 msgr2=0x56418fca1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.779+0000 7fec38e8e740 1 -- 172.21.15.92:0/4076055113 shutdown_connections 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.779+0000 7fec38e8e740 1 -- 172.21.15.92:0/4076055113 wait complete. 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec38e8e740 1 -- start start 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec38e8e740 1 Processor -- start 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcaefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fcaf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 0x56418fcbaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec38e8e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56418fa6a890 con 0x56418f8d3490 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec38e8e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56418fba3d40 con 0x56418f8fc350 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec38e8e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56418fcb1c10 con 0x56418f8db670 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec38e8e740 10 client.0 _ll_register_callbacks cb 0x56418fc07c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcaefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcaefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52796/0 (socket says 172.21.15.92:52796) 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.780+0000 7fec2bfff640 1 -- 172.21.15.92:0/3570472084 learned_addr learned my addr 172.21.15.92:0/3570472084 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec30eb7640 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 0x56418fcbaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fcaf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec2bfff640 1 -- 172.21.15.92:0/3570472084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 msgr2=0x56418fcaf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec2bfff640 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fcaf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec2bfff640 1 -- 172.21.15.92:0/3570472084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 msgr2=0x56418fcbaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec2bfff640 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 0x56418fcbaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec2bfff640 1 -- 172.21.15.92:0/3570472084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56418fcbb4c0 con 0x56418f8d3490 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fcaf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec30eb7640 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 0x56418fcbaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec2bfff640 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcaefd0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fec1c005e90 tx=0x7fec1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b8649cc4c9c13d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3570472084 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00dd80 con 0x56418f8d3490 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3570472084 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fec1c01d420 con 0x56418f8d3490 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec38e8e740 1 -- 172.21.15.92:0/3570472084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56418fc1bdb0 con 0x56418f8d3490 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3570472084 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fec1c02e050 con 0x56418f8d3490 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec38e8e740 10 client.17289 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.781+0000 7fec38e8e740 1 -- 172.21.15.92:0/3570472084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56418fcbde30 con 0x56418f8d3490 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.782+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3570472084 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56418fc1bdb0 con 0x56418f8d3490 2024-09-21T07:18:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.782+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3570472084 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fec1c025540 con 0x56418f8d3490 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.782+0000 7fec38e8e740 10 client.17289 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.782+0000 7fec38e8e740 10 client.17289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.782+0000 7fec38e8e740 20 client.17289 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.782+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56418f8bacd0 0x56418fcc1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.782+0000 7fec38e8e740 4 client.17289 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.782+0000 7fec38e8e740 1 -- 172.21.15.92:0/3570472084 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56418fc17860 con 0x56418f8bacd0 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.782+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56418f8bacd0 0x56418fcc1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.783+0000 7fec0b7fe640 10 client.17289 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.783+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56418f8bacd0 0x56418fcc1380 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=130803fe9a5cb83d server_cookie=a7148b9fcf68021 in_seq=0 out_seq=0 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.783+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3570472084 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56418fc17860 con 0x56418f8bacd0 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.783+0000 7fec0b7fe640 10 client.17289 handle_command_reply: tid=0 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.783+0000 7fec38e8e740 1 client.17289 shutdown 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 1 -- 172.21.15.92:0/3570472084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 msgr2=0x56418fcaefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcaefd0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fec1c005e90 tx=0x7fec1c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 1 -- 172.21.15.92:0/3570472084 shutdown_connections 2024-09-21T07:18:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56418f8bacd0 0x56418fcc1380 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 0x56418fcbaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fcaf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec0b7fe640 0 client.17289 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3570472084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcaefd0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 1 -- 172.21.15.92:0/3570472084 >> 172.21.15.92:0/3570472084 conn(0x56418f8f0740 msgr2=0x56418fca6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 1 -- 172.21.15.92:0/3570472084 shutdown_connections 2024-09-21T07:18:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 1 -- 172.21.15.92:0/3570472084 wait complete. 2024-09-21T07:18:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.784+0000 7fec38e8e740 20 client.17289 trim_cache size 0 max 16384 2024-09-21T07:18:30.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec38e8e740 1 Processor -- start 2024-09-21T07:18:30.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec38e8e740 1 -- start start 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8d3490 0x56418fcaa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8db670 0x56418fcbae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec38e8e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1b3060 con 0x56418f8fc350 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec38e8e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1b4ba0 con 0x56418f8db670 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec38e8e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1b3730 con 0x56418f8d3490 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec30eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec30eb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52798/0 (socket says 172.21.15.92:52798) 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec30eb7640 1 -- 172.21.15.92:0/2855093666 learned_addr learned my addr 172.21.15.92:0/2855093666 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec2bfff640 1 --2- 172.21.15.92:0/2855093666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8d3490 0x56418fcaa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/2855093666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8db670 0x56418fcbae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec30eb7640 1 -- 172.21.15.92:0/2855093666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8d3490 msgr2=0x56418fcaa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:30.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec30eb7640 1 --2- 172.21.15.92:0/2855093666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8d3490 0x56418fcaa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec30eb7640 1 -- 172.21.15.92:0/2855093666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8db670 msgr2=0x56418fcbae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec30eb7640 1 --2- 172.21.15.92:0/2855093666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8db670 0x56418fcbae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec30eb7640 1 -- 172.21.15.92:0/2855093666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56418fca6290 con 0x56418f8fc350 2024-09-21T07:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/2855093666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8db670 0x56418fcbae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.802+0000 7fec30eb7640 1 --2- 172.21.15.92:0/2855093666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca4b70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fec240cbb10 tx=0x7fec24009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd34be40ee9db52e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.803+0000 7fec11ffb640 1 -- 172.21.15.92:0/2855093666 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec240ce3b0 con 0x56418f8fc350 2024-09-21T07:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.803+0000 7fec11ffb640 1 -- 172.21.15.92:0/2855093666 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec24036070 con 0x56418f8fc350 2024-09-21T07:18:30.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.803+0000 7fec11ffb640 1 -- 172.21.15.92:0/2855093666 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec240cab10 con 0x56418f8fc350 2024-09-21T07:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 -- 172.21.15.92:0/2855093666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 msgr2=0x56418fca4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 --2- 172.21.15.92:0/2855093666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca4b70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fec240cbb10 tx=0x7fec24009640 comp rx=0 tx=0).stop 2024-09-21T07:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 -- 172.21.15.92:0/2855093666 shutdown_connections 2024-09-21T07:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 --2- 172.21.15.92:0/2855093666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8fc350 0x56418fca4b70 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 --2- 172.21.15.92:0/2855093666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8db670 0x56418fcbae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 --2- 172.21.15.92:0/2855093666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8d3490 0x56418fcaa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 -- 172.21.15.92:0/2855093666 >> 172.21.15.92:0/2855093666 conn(0x56418f8f0740 msgr2=0x56418fca4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 -- 172.21.15.92:0/2855093666 shutdown_connections 2024-09-21T07:18:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 -- 172.21.15.92:0/2855093666 wait complete. 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 -- start start 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.804+0000 7fec38e8e740 1 Processor -- start 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcb72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fcb78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec38e8e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 0x56418fcb4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec38e8e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1b44d0 con 0x56418f8d3490 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec38e8e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1b3e00 con 0x56418f8fc350 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec38e8e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1b1040 con 0x56418f8db670 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcb72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcb72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52806/0 (socket says 172.21.15.92:52806) 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2bfff640 1 -- 172.21.15.92:0/3900805432 learned_addr learned my addr 172.21.15.92:0/3900805432 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec38e8e740 10 client.0 _ll_register_callbacks cb 0x7fec1c00b850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec30eb7640 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 0x56418fcb4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fcb78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2bfff640 1 -- 172.21.15.92:0/3900805432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 msgr2=0x56418fcb78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2bfff640 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fcb78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2bfff640 1 -- 172.21.15.92:0/3900805432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 msgr2=0x56418fcb4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2bfff640 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 0x56418fcb4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2bfff640 1 -- 172.21.15.92:0/3900805432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56418fcb47a0 con 0x56418f8d3490 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fcb78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec30eb7640 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 0x56418fcb4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec2bfff640 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcb72f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fec1c005e90 tx=0x7fec1c025db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc877da4d47995dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.805+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3900805432 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c02b040 con 0x56418f8d3490 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3900805432 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fec1c00db80 con 0x56418f8d3490 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec38e8e740 1 -- 172.21.15.92:0/3900805432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec24036070 con 0x56418f8d3490 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3900805432 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fec1c00dd80 con 0x56418f8d3490 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec38e8e740 10 client.17295 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec38e8e740 1 -- 172.21.15.92:0/3900805432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56418fd2c8d0 con 0x56418f8d3490 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3900805432 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec24036070 con 0x56418f8d3490 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3900805432 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fec1c03b070 con 0x56418f8d3490 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec38e8e740 10 client.17295 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec38e8e740 10 client.17295 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec38e8e740 20 client.17295 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56418f890080 0x56418fd2f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec38e8e740 4 client.17295 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.806+0000 7fec38e8e740 1 -- 172.21.15.92:0/3900805432 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56418fc14c90 con 0x56418f890080 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.807+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56418f890080 0x56418fd2f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.807+0000 7fec2b7fe640 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56418f890080 0x56418fd2f0e0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e25094e8a782c5a server_cookie=7f1fba147b661211 in_seq=0 out_seq=0 2024-09-21T07:18:30.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.807+0000 7fec0b7fe640 10 client.17295 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:30.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec0b7fe640 1 -- 172.21.15.92:0/3900805432 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56418fc14c90 con 0x56418f890080 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec0b7fe640 10 client.17295 handle_command_reply: tid=0 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 client.17295 shutdown 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 -- 172.21.15.92:0/3900805432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 msgr2=0x56418fcb72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcb72f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fec1c005e90 tx=0x7fec1c025db0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 -- 172.21.15.92:0/3900805432 shutdown_connections 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56418f890080 0x56418fd2f0e0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56418f8fc350 0x56418fcb4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec0b7fe640 0 client.17295 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56418f8db670 0x56418fcb78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 --2- 172.21.15.92:0/3900805432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418f8d3490 0x56418fcb72f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 -- 172.21.15.92:0/3900805432 >> 172.21.15.92:0/3900805432 conn(0x56418f8f0740 msgr2=0x56418fcb0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 -- 172.21.15.92:0/3900805432 shutdown_connections 2024-09-21T07:18:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 1 -- 172.21.15.92:0/3900805432 wait complete. 2024-09-21T07:18:30.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.809+0000 7fec38e8e740 20 client.17295 trim_cache size 0 max 16384 2024-09-21T07:18:30.815 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:18:30.815 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:18:30.815 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "a7beebc0-d49b-4092-a8c1-d3775fd34626", 2024-09-21T07:18:30.815 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:18:30.815 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 -- 172.21.15.92:0/3320787297 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fec140b6680 msgr2=0x7fec140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fec140b6680 0x7fec140b8b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fec1c005a80 tx=0x7fec1c005a10 comp rx=0 tx=0).stop 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 -- 172.21.15.92:0/3320787297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec2c108cf0 msgr2=0x7fec2c1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec2c108cf0 0x7fec2c1000f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fec24005cc0 tx=0x7fec24032a10 comp rx=0 tx=0).stop 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 -- 172.21.15.92:0/3320787297 shutdown_connections 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fec140b6680 0x7fec140b8b90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec2c108cf0 0x7fec2c1000f0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c1083a0 0x7fec2c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 --2- 172.21.15.92:0/3320787297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec2c102a60 0x7fec2c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 -- 172.21.15.92:0/3320787297 >> 172.21.15.92:0/3320787297 conn(0x7fec2c079730 msgr2=0x7fec2c06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 -- 172.21.15.92:0/3320787297 shutdown_connections 2024-09-21T07:18:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:30.810+0000 7fec3291a640 1 -- 172.21.15.92:0/3320787297 wait complete. 2024-09-21T07:18:31.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:31 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:18:31.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:31 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:18:31.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:31 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:18:31.644 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:31 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:18:31.710 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:31 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:18:31.710 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:31 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:18:31.710 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:31 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:18:31.710 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:31 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:18:31.744 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:18:31.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:31 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:18:31.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:31 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:18:31.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:31 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:18:31.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:31 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:18:31.994 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:18:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.478+0000 7fa328444640 1 -- 172.21.15.92:0/1572042591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa320102a60 msgr2=0x7fa320102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.478+0000 7fa328444640 1 --2- 172.21.15.92:0/1572042591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa320102a60 0x7fa320102e70 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa318009900 tx=0x7fa31802a410 comp rx=0 tx=0).stop 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.478+0000 7fa328444640 1 -- 172.21.15.92:0/1572042591 shutdown_connections 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.478+0000 7fa328444640 1 --2- 172.21.15.92:0/1572042591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa320108cf0 0x7fa32010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.478+0000 7fa328444640 1 --2- 172.21.15.92:0/1572042591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3201083a0 0x7fa3201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.478+0000 7fa328444640 1 --2- 172.21.15.92:0/1572042591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa320102a60 0x7fa320102e70 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.478+0000 7fa328444640 1 -- 172.21.15.92:0/1572042591 >> 172.21.15.92:0/1572042591 conn(0x7fa320079730 msgr2=0x7fa320079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.478+0000 7fa328444640 1 -- 172.21.15.92:0/1572042591 shutdown_connections 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.478+0000 7fa328444640 1 -- 172.21.15.92:0/1572042591 wait complete. 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa328444640 1 Processor -- start 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa328444640 1 -- start start 2024-09-21T07:18:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa328444640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa320102a60 0x7fa320199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa328444640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3201083a0 0x7fa320199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa328444640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa320108cf0 0x7fa32019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa328444640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201128f0 con 0x7fa3201083a0 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa328444640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa320112770 con 0x7fa320102a60 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa328444640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa320112a70 con 0x7fa320108cf0 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa3259df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3201083a0 0x7fa320199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa3259df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3201083a0 0x7fa320199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52816/0 (socket says 172.21.15.92:52816) 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.479+0000 7fa3259df640 1 -- 172.21.15.92:0/354788573 learned_addr learned my addr 172.21.15.92:0/354788573 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3261e0640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa320102a60 0x7fa320199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3269e1640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa320108cf0 0x7fa32019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3259df640 1 -- 172.21.15.92:0/354788573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa320108cf0 msgr2=0x7fa32019eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3259df640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa320108cf0 0x7fa32019eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3259df640 1 -- 172.21.15.92:0/354788573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa320102a60 msgr2=0x7fa320199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3259df640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa320102a60 0x7fa320199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3259df640 1 -- 172.21.15.92:0/354788573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32019f3d0 con 0x7fa3201083a0 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3259df640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3201083a0 0x7fa320199a00 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fa31400b450 tx=0x7fa31400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3137fe640 1 -- 172.21.15.92:0/354788573 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314015020 con 0x7fa3201083a0 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa328444640 1 -- 172.21.15.92:0/354788573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32019f6c0 con 0x7fa3201083a0 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3137fe640 1 -- 172.21.15.92:0/354788573 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa314011d20 con 0x7fa3201083a0 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa3137fe640 1 -- 172.21.15.92:0/354788573 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314010e10 con 0x7fa3201083a0 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.480+0000 7fa328444640 1 -- 172.21.15.92:0/354788573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3201a5e20 con 0x7fa3201083a0 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa32e9b8740 1 Processor -- start 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa32e9b8740 1 -- start start 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa3137fe640 1 -- 172.21.15.92:0/354788573 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fa314018020 con 0x7fa3201083a0 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 0x55e0dfbf3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfbf3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df82b390 0x55e0dfbf40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e0dfb69e50 con 0x55e0df8231b0 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e0dfb59280 con 0x55e0df84c070 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e0dfb5d090 con 0x55e0df82b390 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa3261e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfbf3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa3261e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfbf3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52818/0 (socket says 172.21.15.92:52818) 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.483+0000 7fa3261e0640 1 -- 172.21.15.92:0/1903701037 learned_addr learned my addr 172.21.15.92:0/1903701037 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3269e1640 1 --2- 172.21.15.92:0/1903701037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 0x55e0dfbf3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3261e0640 1 -- 172.21.15.92:0/1903701037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df82b390 msgr2=0x55e0dfbf40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3261e0640 1 --2- 172.21.15.92:0/1903701037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df82b390 0x55e0dfbf40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3261e0640 1 -- 172.21.15.92:0/1903701037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 msgr2=0x55e0dfbf3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3261e0640 1 --2- 172.21.15.92:0/1903701037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 0x55e0dfbf3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3261e0640 1 -- 172.21.15.92:0/1903701037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0df8b7650 con 0x55e0df8231b0 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3269e1640 1 --2- 172.21.15.92:0/1903701037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 0x55e0dfbf3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3261e0640 1 --2- 172.21.15.92:0/1903701037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfbf3b90 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa318000c00 tx=0x7fa318031d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2e39f50d08f4a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa310d9a640 1 -- 172.21.15.92:0/1903701037 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318035030 con 0x55e0df8231b0 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3137fe640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa30c0b6680 0x7fa30c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa310d9a640 1 -- 172.21.15.92:0/1903701037 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa318040070 con 0x55e0df8231b0 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa310d9a640 1 -- 172.21.15.92:0/1903701037 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318003a30 con 0x55e0df8231b0 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3269e1640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa30c0b6680 0x7fa30c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.484+0000 7fa3137fe640 1 -- 172.21.15.92:0/354788573 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa3140e74c0 con 0x7fa3201083a0 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.485+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1903701037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 msgr2=0x55e0dfbf3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.485+0000 7fa3269e1640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa30c0b6680 0x7fa30c0b8b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00af30 tx=0x7fa31c00a550 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.485+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/1903701037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfbf3b90 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa318000c00 tx=0x7fa318031d50 comp rx=0 tx=0).stop 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.485+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1903701037 shutdown_connections 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.485+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/1903701037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df82b390 0x55e0dfbf40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.485+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/1903701037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfbf3b90 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.485+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/1903701037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 0x55e0dfbf3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.485+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1903701037 >> 172.21.15.92:0/1903701037 conn(0x55e0df840460 msgr2=0x55e0dfbf1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.485+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1903701037 shutdown_connections 2024-09-21T07:18:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.485+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1903701037 wait complete. 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa32e9b8740 1 -- start start 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa32e9b8740 1 Processor -- start 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df8231b0 0x55e0dfbfedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfbff330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 0x55e0dfc0b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e0df9ba700 con 0x55e0df82b390 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e0dfaf4110 con 0x55e0df84c070 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e0dfc01dd0 con 0x55e0df8231b0 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa32e9b8740 10 client.0 _ll_register_callbacks cb 0x55e0dfb0d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa3259df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfbff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa3259df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfbff330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52822/0 (socket says 172.21.15.92:52822) 2024-09-21T07:18:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa3259df640 1 -- 172.21.15.92:0/1818766962 learned_addr learned my addr 172.21.15.92:0/1818766962 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa3261e0640 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df8231b0 0x55e0dfbfedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa3269e1640 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 0x55e0dfc0b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa3259df640 1 -- 172.21.15.92:0/1818766962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df8231b0 msgr2=0x55e0dfbfedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa3259df640 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df8231b0 0x55e0dfbfedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa3259df640 1 -- 172.21.15.92:0/1818766962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 msgr2=0x55e0dfc0b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa3259df640 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 0x55e0dfc0b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.486+0000 7fa3259df640 1 -- 172.21.15.92:0/1818766962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0dfb21c40 con 0x55e0df82b390 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa3259df640 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfbff330 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa314000c00 tx=0x7fa3140ac8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c9dbf743eafb0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa309ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa309ffb640 1 -- 172.21.15.92:0/1818766962 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140aca80 con 0x55e0df82b390 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa309ffb640 1 -- 172.21.15.92:0/1818766962 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa3140e7120 con 0x55e0df82b390 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1818766962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa318040070 con 0x55e0df82b390 2024-09-21T07:18:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa309ffb640 1 -- 172.21.15.92:0/1818766962 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa3140e7320 con 0x55e0df82b390 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa32e9b8740 10 client.17307 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1818766962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e0dfc0fdb0 con 0x55e0df82b390 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa309ffb640 1 -- 172.21.15.92:0/1818766962 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa318040070 con 0x55e0df82b390 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa309ffb640 1 -- 172.21.15.92:0/1818766962 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa3140b0080 con 0x55e0df82b390 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa32e9b8740 10 client.17307 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa32e9b8740 10 client.17307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa32e9b8740 20 client.17307 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e0df80a9f0 0x55e0dfc13320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa32e9b8740 4 client.17307 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.487+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1818766962 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0dfb6bda0 con 0x55e0df80a9f0 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.488+0000 7fa3261e0640 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e0df80a9f0 0x55e0dfc13320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.488+0000 7fa3261e0640 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e0df80a9f0 0x55e0dfc13320 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a933a96058a0e45 server_cookie=d96b68104f4ff5c7 in_seq=0 out_seq=0 2024-09-21T07:18:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.488+0000 7fa309ffb640 10 client.17307 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa309ffb640 1 -- 172.21.15.92:0/1818766962 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0dfb6bda0 con 0x55e0df80a9f0 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa309ffb640 10 client.17307 handle_command_reply: tid=0 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 client.17307 shutdown 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1818766962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 msgr2=0x55e0dfbff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfbff330 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa314000c00 tx=0x7fa3140ac8c0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1818766962 shutdown_connections 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e0df80a9f0 0x55e0dfc13320 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df84c070 0x55e0dfc0b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfbff330 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/1818766962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df8231b0 0x55e0dfbfedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa309ffb640 0 client.17307 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1818766962 >> 172.21.15.92:0/1818766962 conn(0x55e0df840460 msgr2=0x55e0dfbf67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1818766962 shutdown_connections 2024-09-21T07:18:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 1 -- 172.21.15.92:0/1818766962 wait complete. 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.489+0000 7fa32e9b8740 20 client.17307 trim_cache size 0 max 16384 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa32e9b8740 1 Processor -- start 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa32e9b8740 1 -- start start 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df80a9f0 0x55e0dfc00cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfc0aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df82b390 0x55e0dfbf4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201aed90 con 0x55e0df8231b0 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201b08d0 con 0x55e0df82b390 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201af460 con 0x55e0df80a9f0 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3259df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfc0aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3259df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfc0aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52826/0 (socket says 172.21.15.92:52826) 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3259df640 1 -- 172.21.15.92:0/4253787471 learned_addr learned my addr 172.21.15.92:0/4253787471 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3269e1640 1 --2- 172.21.15.92:0/4253787471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df82b390 0x55e0dfbf4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3259df640 1 -- 172.21.15.92:0/4253787471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df80a9f0 msgr2=0x55e0dfc00cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3259df640 1 --2- 172.21.15.92:0/4253787471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df80a9f0 0x55e0dfc00cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3259df640 1 -- 172.21.15.92:0/4253787471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df82b390 msgr2=0x55e0dfbf4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3259df640 1 --2- 172.21.15.92:0/4253787471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df82b390 0x55e0dfbf4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3259df640 1 -- 172.21.15.92:0/4253787471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0dfc000b0 con 0x55e0df8231b0 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3269e1640 1 --2- 172.21.15.92:0/4253787471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df82b390 0x55e0dfbf4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.507+0000 7fa3259df640 1 --2- 172.21.15.92:0/4253787471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfc0aff0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fa3140acf00 tx=0x7fa3140ac9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743d1aca5e611d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa30bfff640 1 -- 172.21.15.92:0/4253787471 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140ad670 con 0x55e0df8231b0 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa30bfff640 1 -- 172.21.15.92:0/4253787471 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3140b1a50 con 0x55e0df8231b0 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa30bfff640 1 -- 172.21.15.92:0/4253787471 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140a8c20 con 0x55e0df8231b0 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa32e9b8740 1 -- 172.21.15.92:0/4253787471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 msgr2=0x55e0dfc0aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/4253787471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfc0aff0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fa3140acf00 tx=0x7fa3140ac9f0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa32e9b8740 1 -- 172.21.15.92:0/4253787471 shutdown_connections 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/4253787471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df82b390 0x55e0dfbf4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/4253787471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df8231b0 0x55e0dfc0aff0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/4253787471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df80a9f0 0x55e0dfc00cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa32e9b8740 1 -- 172.21.15.92:0/4253787471 >> 172.21.15.92:0/4253787471 conn(0x55e0df840460 msgr2=0x55e0dfbf4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa32e9b8740 1 -- 172.21.15.92:0/4253787471 shutdown_connections 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.508+0000 7fa32e9b8740 1 -- 172.21.15.92:0/4253787471 wait complete. 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa32e9b8740 1 -- start start 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa32e9b8740 1 Processor -- start 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df80a9f0 0x55e0dfc05790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df8231b0 0x55e0dfc05cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa32e9b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfc7cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201b0200 con 0x55e0df82b390 2024-09-21T07:18:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201afb30 con 0x55e0df8231b0 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa32e9b8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201acd70 con 0x55e0df80a9f0 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa32e9b8740 10 client.0 _ll_register_callbacks cb 0x7fa3140acdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa3269e1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfc7cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa3269e1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfc7cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52830/0 (socket says 172.21.15.92:52830) 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.509+0000 7fa3269e1640 1 -- 172.21.15.92:0/2663031615 learned_addr learned my addr 172.21.15.92:0/2663031615 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa3259df640 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df8231b0 0x55e0dfc05cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa3269e1640 1 -- 172.21.15.92:0/2663031615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df80a9f0 msgr2=0x55e0dfc05790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa3261e0640 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df80a9f0 0x55e0dfc05790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa3269e1640 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df80a9f0 0x55e0dfc05790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa3269e1640 1 -- 172.21.15.92:0/2663031615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df8231b0 msgr2=0x55e0dfc05cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa3269e1640 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df8231b0 0x55e0dfc05cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa3269e1640 1 -- 172.21.15.92:0/2663031615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0dfc7d1a0 con 0x55e0df82b390 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa3259df640 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df8231b0 0x55e0dfc05cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa3261e0640 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df80a9f0 0x55e0dfc05790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:18:32.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa3269e1640 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfc7cc60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fa31c017f80 tx=0x7fa31c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ea7af1eab423a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa309ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa309ffb640 1 -- 172.21.15.92:0/2663031615 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c014770 con 0x55e0df82b390 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa309ffb640 1 -- 172.21.15.92:0/2663031615 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa31c014910 con 0x55e0df82b390 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa32e9b8740 1 -- 172.21.15.92:0/2663031615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3140b1a50 con 0x55e0df82b390 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa309ffb640 1 -- 172.21.15.92:0/2663031615 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa31c014b10 con 0x55e0df82b390 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa32e9b8740 10 client.17313 fetch_fsmap learned FSMap version 29 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa32e9b8740 1 -- 172.21.15.92:0/2663031615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e0dfc7e400 con 0x55e0df82b390 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.510+0000 7fa309ffb640 1 -- 172.21.15.92:0/2663031615 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3140b1a50 con 0x55e0df82b390 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.511+0000 7fa309ffb640 1 -- 172.21.15.92:0/2663031615 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa31c024cb0 con 0x55e0df82b390 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.511+0000 7fa32e9b8740 10 client.17313 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.511+0000 7fa32e9b8740 10 client.17313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.511+0000 7fa32e9b8740 20 client.17313 populate_metadata read hostname 'smithi092' 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.511+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e0df84c070 0x55e0dfc80c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:18:32.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.511+0000 7fa32e9b8740 4 client.17313 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.511+0000 7fa32e9b8740 1 -- 172.21.15.92:0/2663031615 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e0dfb67850 con 0x55e0df84c070 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.511+0000 7fa3261e0640 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e0df84c070 0x55e0dfc80c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.511+0000 7fa309ffb640 10 client.17313 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.511+0000 7fa3261e0640 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e0df84c070 0x55e0dfc80c20 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17d3d5e349af985b server_cookie=45e53b8701ba9851 in_seq=0 out_seq=0 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa309ffb640 1 -- 172.21.15.92:0/2663031615 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x55e0dfb67850 con 0x55e0df84c070 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa309ffb640 10 client.17313 handle_command_reply: tid=0 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 client.17313 shutdown 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 -- 172.21.15.92:0/2663031615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 msgr2=0x55e0dfc7cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfc7cc60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fa31c017f80 tx=0x7fa31c004b50 comp rx=0 tx=0).stop 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 -- 172.21.15.92:0/2663031615 shutdown_connections 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e0df84c070 0x55e0dfc80c20 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa309ffb640 0 client.17313 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:18:32.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e0df82b390 0x55e0dfc7cc60 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e0df8231b0 0x55e0dfc05cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "a7beebc0-d49b-4092-a8c1-d3775fd34626", 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:32.539 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:32.540 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:18:32.541 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:32.542 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:18:32.543 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 --2- 172.21.15.92:0/2663031615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e0df80a9f0 0x55e0dfc05790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 -- 172.21.15.92:0/2663031615 >> 172.21.15.92:0/2663031615 conn(0x55e0df840460 msgr2=0x55e0dfc00a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 -- 172.21.15.92:0/2663031615 shutdown_connections 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 1 -- 172.21.15.92:0/2663031615 wait complete. 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa32e9b8740 20 client.17313 trim_cache size 0 max 16384 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa328444640 1 -- 172.21.15.92:0/354788573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa30c0b6680 msgr2=0x7fa30c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa328444640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa30c0b6680 0x7fa30c0b8b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00af30 tx=0x7fa31c00a550 comp rx=0 tx=0).stop 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa328444640 1 -- 172.21.15.92:0/354788573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3201083a0 msgr2=0x7fa320199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.512+0000 7fa328444640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3201083a0 0x7fa320199a00 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fa31400b450 tx=0x7fa31400b910 comp rx=0 tx=0).stop 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.513+0000 7fa328444640 1 -- 172.21.15.92:0/354788573 shutdown_connections 2024-09-21T07:18:32.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.513+0000 7fa328444640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa30c0b6680 0x7fa30c0b8b90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.513+0000 7fa328444640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa320108cf0 0x7fa32019eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.513+0000 7fa328444640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3201083a0 0x7fa320199a00 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.513+0000 7fa328444640 1 --2- 172.21.15.92:0/354788573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa320102a60 0x7fa320199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:18:32.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.513+0000 7fa328444640 1 -- 172.21.15.92:0/354788573 >> 172.21.15.92:0/354788573 conn(0x7fa320079730 msgr2=0x7fa3201016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:18:32.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.513+0000 7fa328444640 1 -- 172.21.15.92:0/354788573 shutdown_connections 2024-09-21T07:18:32.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:18:32.513+0000 7fa328444640 1 -- 172.21.15.92:0/354788573 wait complete. 2024-09-21T07:18:32.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:32 smithi169 ceph-mon[33705]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-21T07:18:32.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:32 smithi092 ceph-mon[30987]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-21T07:18:32.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:32 smithi175 ceph-mon[34064]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-21T07:18:33.311 INFO:tasks.cephfs.filesystem:scrub status for tag:a7beebc0-d49b-4092-a8c1-d3775fd34626 - {'path': '/', 'tag': 'a7beebc0-d49b-4092-a8c1-d3775fd34626', 'options': 'recursive,force'} 2024-09-21T07:18:34.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:33 smithi092 ceph-mon[30987]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T07:18:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:33 smithi169 ceph-mon[33705]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T07:18:34.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:33 smithi175 ceph-mon[34064]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2024-09-21T07:18:35.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:34 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:18:35.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:34 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:18:35.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:34 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:18:36.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:35 smithi175 ceph-mon[34064]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:18:36.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:35 smithi092 ceph-mon[30987]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:18:36.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:35 smithi169 ceph-mon[33705]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:18:38.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:37 smithi092 ceph-mon[30987]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 op/s 2024-09-21T07:18:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:37 smithi169 ceph-mon[33705]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 op/s 2024-09-21T07:18:38.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:37 smithi175 ceph-mon[34064]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 op/s 2024-09-21T07:18:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:39 smithi092 ceph-mon[30987]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:18:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:39 smithi169 ceph-mon[33705]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:18:40.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:39 smithi175 ceph-mon[34064]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:18:42.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:41 smithi092 ceph-mon[30987]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-21T07:18:42.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:41 smithi169 ceph-mon[33705]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-21T07:18:42.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:41 smithi175 ceph-mon[34064]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-21T07:18:44.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:43 smithi092 ceph-mon[30987]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T07:18:44.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:43 smithi169 ceph-mon[33705]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T07:18:44.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:43 smithi175 ceph-mon[34064]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 op/s 2024-09-21T07:18:46.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:45 smithi092 ceph-mon[30987]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:18:46.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:45 smithi169 ceph-mon[33705]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:18:46.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:45 smithi175 ceph-mon[34064]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:18:48.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:47 smithi092 ceph-mon[30987]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:18:48.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:47 smithi169 ceph-mon[33705]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:18:48.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:47 smithi175 ceph-mon[34064]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:18:50.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:49 smithi092 ceph-mon[30987]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:50.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:49 smithi169 ceph-mon[33705]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:50.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:49 smithi175 ceph-mon[34064]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:52.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:51 smithi092 ceph-mon[30987]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:18:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:51 smithi169 ceph-mon[33705]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:18:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:51 smithi175 ceph-mon[34064]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:18:54.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:53 smithi092 ceph-mon[30987]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:18:54.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:53 smithi169 ceph-mon[33705]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:18:54.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:53 smithi175 ceph-mon[34064]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:18:56.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:55 smithi092 ceph-mon[30987]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:56.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:55 smithi169 ceph-mon[33705]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:56.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:55 smithi175 ceph-mon[34064]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:18:58.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:57 smithi092 ceph-mon[30987]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:18:58.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:57 smithi169 ceph-mon[33705]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:18:58.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:57 smithi175 ceph-mon[34064]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:19:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:18:59 smithi092 ceph-mon[30987]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:00.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:18:59 smithi169 ceph-mon[33705]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:00.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:18:59 smithi175 ceph-mon[34064]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:19:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:19:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:19:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:19:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:19:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:19:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:19:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:19:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:19:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:19:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:19:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:19:02.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:01 smithi092 ceph-mon[30987]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:19:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:01 smithi169 ceph-mon[33705]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:19:02.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:01 smithi175 ceph-mon[34064]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:19:03.313 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:19:03.574 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:03.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:03 smithi092 ceph-mon[30987]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 24 op/s 2024-09-21T07:19:04.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.057+0000 7f656c3b6640 1 -- 172.21.15.92:0/1275487728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65641049c0 msgr2=0x7f6564104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:04.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.057+0000 7f656c3b6640 1 --2- 172.21.15.92:0/1275487728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65641049c0 0x7f6564104dd0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6554009ca0 tx=0x7f655402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.057+0000 7f656c3b6640 1 -- 172.21.15.92:0/1275487728 shutdown_connections 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.057+0000 7f656c3b6640 1 --2- 172.21.15.92:0/1275487728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f656410de20 0x7f6564110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.057+0000 7f656c3b6640 1 --2- 172.21.15.92:0/1275487728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6564105310 0x7f656410d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.057+0000 7f656c3b6640 1 --2- 172.21.15.92:0/1275487728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65641049c0 0x7f6564104dd0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.057+0000 7f656c3b6640 1 -- 172.21.15.92:0/1275487728 >> 172.21.15.92:0/1275487728 conn(0x7f6564079710 msgr2=0x7f6564079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.057+0000 7f656c3b6640 1 -- 172.21.15.92:0/1275487728 shutdown_connections 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.057+0000 7f656c3b6640 1 -- 172.21.15.92:0/1275487728 wait complete. 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.058+0000 7f656c3b6640 1 Processor -- start 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.058+0000 7f656c3b6640 1 -- start start 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.058+0000 7f656c3b6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65641049c0 0x7f656419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.058+0000 7f656c3b6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6564105310 0x7f656419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.058+0000 7f656c3b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f656410de20 0x7f656419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.058+0000 7f656c3b6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6564113a00 con 0x7f65641049c0 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.058+0000 7f656c3b6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6564113880 con 0x7f6564105310 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.058+0000 7f656c3b6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6564113b80 con 0x7f656410de20 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.058+0000 7f656a152640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65641049c0 0x7f656419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656a152640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65641049c0 0x7f656419a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42944/0 (socket says 172.21.15.92:42944) 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656a152640 1 -- 172.21.15.92:0/2346719445 learned_addr learned my addr 172.21.15.92:0/2346719445 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656a953640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f656410de20 0x7f656419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f6569951640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6564105310 0x7f656419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656a152640 1 -- 172.21.15.92:0/2346719445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f656410de20 msgr2=0x7f656419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:04.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656a152640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f656410de20 0x7f656419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656a152640 1 -- 172.21.15.92:0/2346719445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6564105310 msgr2=0x7f656419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656a152640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6564105310 0x7f656419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656a152640 1 -- 172.21.15.92:0/2346719445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65641a02a0 con 0x7f65641049c0 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656a152640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65641049c0 0x7f656419a3f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f6554006010 tx=0x7f6554032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f65637fe640 1 -- 172.21.15.92:0/2346719445 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554004040 con 0x7f65641049c0 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f65637fe640 1 -- 172.21.15.92:0/2346719445 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6554004670 con 0x7f65641049c0 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656c3b6640 1 -- 172.21.15.92:0/2346719445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65641a0530 con 0x7f65641049c0 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f65637fe640 1 -- 172.21.15.92:0/2346719445 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554030ce0 con 0x7f65641049c0 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.059+0000 7f656c3b6640 1 -- 172.21.15.92:0/2346719445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65641a0a70 con 0x7f65641049c0 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.062+0000 7f657292a740 1 Processor -- start 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.062+0000 7f657292a740 1 -- start start 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.062+0000 7f65637fe640 1 -- 172.21.15.92:0/2346719445 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f65540041e0 con 0x7f65641049c0 2024-09-21T07:19:04.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f657292a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf17270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f657292a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf177b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f657292a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf17cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f657292a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ecbe8de50 con 0x563ecbb471b0 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f657292a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563ecbe7d280 con 0x563ecbb70070 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f657292a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563ecbe81090 con 0x563ecbb4f390 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a152640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf177b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a152640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf177b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42950/0 (socket says 172.21.15.92:42950) 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a152640 1 -- 172.21.15.92:0/3496483028 learned_addr learned my addr 172.21.15.92:0/3496483028 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a953640 1 --2- 172.21.15.92:0/3496483028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf17270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f6569951640 1 --2- 172.21.15.92:0/3496483028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf17cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a152640 1 -- 172.21.15.92:0/3496483028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 msgr2=0x563ecbf17cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:04.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a152640 1 --2- 172.21.15.92:0/3496483028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf17cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a152640 1 -- 172.21.15.92:0/3496483028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 msgr2=0x563ecbf17270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a152640 1 --2- 172.21.15.92:0/3496483028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf17270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a152640 1 -- 172.21.15.92:0/3496483028 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ecbbdb650 con 0x563ecbb471b0 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f6569951640 1 --2- 172.21.15.92:0/3496483028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf17cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f65637fe640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f654c0b66b0 0x7f654c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a152640 1 --2- 172.21.15.92:0/3496483028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf177b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f65541061f0 tx=0x7f655410cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d402fe8ad163c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.063+0000 7f656a953640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f654c0b66b0 0x7f654c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.064+0000 7f65637fe640 1 -- 172.21.15.92:0/2346719445 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f6554108ed0 con 0x7f65641049c0 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.064+0000 7f6560d9a640 1 -- 172.21.15.92:0/3496483028 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65540cafd0 con 0x563ecbb471b0 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.064+0000 7f6560d9a640 1 -- 172.21.15.92:0/3496483028 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6554116070 con 0x563ecbb471b0 2024-09-21T07:19:04.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.064+0000 7f6560d9a640 1 -- 172.21.15.92:0/3496483028 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65540044d0 con 0x563ecbb471b0 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 -- 172.21.15.92:0/3496483028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 msgr2=0x563ecbf177b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f656a953640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f654c0b66b0 0x7f654c0b8bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f655c009a70 tx=0x7f655c0090e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 --2- 172.21.15.92:0/3496483028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf177b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f65541061f0 tx=0x7f655410cf80 comp rx=0 tx=0).stop 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 -- 172.21.15.92:0/3496483028 shutdown_connections 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 --2- 172.21.15.92:0/3496483028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf17cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 --2- 172.21.15.92:0/3496483028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf177b0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 --2- 172.21.15.92:0/3496483028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf17270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 -- 172.21.15.92:0/3496483028 >> 172.21.15.92:0/3496483028 conn(0x563ecbb64460 msgr2=0x563ecbf15160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 -- 172.21.15.92:0/3496483028 shutdown_connections 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 -- 172.21.15.92:0/3496483028 wait complete. 2024-09-21T07:19:04.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 -- start start 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.065+0000 7f657292a740 1 Processor -- start 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f657292a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf22980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f657292a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf22ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f657292a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf2e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f657292a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563ecbcde700 con 0x563ecbb471b0 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f657292a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563ecbe18110 con 0x563ecbb70070 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f657292a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563ecbe8de50 con 0x563ecbb4f390 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f657292a740 10 client.0 _ll_register_callbacks cb 0x563ecbe31990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a152640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf22980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a152640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf22980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42956/0 (socket says 172.21.15.92:42956) 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a152640 1 -- 172.21.15.92:0/4078037308 learned_addr learned my addr 172.21.15.92:0/4078037308 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:04.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f6569951640 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf22ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a953640 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf2e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a152640 1 -- 172.21.15.92:0/4078037308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 msgr2=0x563ecbf22ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a152640 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf22ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a152640 1 -- 172.21.15.92:0/4078037308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 msgr2=0x563ecbf2e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a152640 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf2e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a152640 1 -- 172.21.15.92:0/4078037308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ecbe45c40 con 0x563ecbb471b0 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a953640 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf2e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f6569951640 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf22ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f656a152640 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf22980 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f65540ce910 tx=0x7f65541091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81856e18b813b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f6549ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f6549ffb640 1 -- 172.21.15.92:0/4078037308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65540ce0f0 con 0x563ecbb471b0 2024-09-21T07:19:04.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f6549ffb640 1 -- 172.21.15.92:0/4078037308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f65540d8110 con 0x563ecbb471b0 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.066+0000 7f657292a740 1 -- 172.21.15.92:0/4078037308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6554116070 con 0x563ecbb471b0 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f6549ffb640 1 -- 172.21.15.92:0/4078037308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65540ce2d0 con 0x563ecbb471b0 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f657292a740 10 client.17325 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f657292a740 1 -- 172.21.15.92:0/4078037308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ecbf31340 con 0x563ecbb471b0 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f6549ffb640 1 -- 172.21.15.92:0/4078037308 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6554116070 con 0x563ecbb471b0 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f6549ffb640 1 -- 172.21.15.92:0/4078037308 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f65540d3020 con 0x563ecbb471b0 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f657292a740 10 client.17325 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f657292a740 10 client.17325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f657292a740 20 client.17325 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f657292a740 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x563ecbb2e9f0 0x563ecbf346c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f657292a740 4 client.17325 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:04.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f657292a740 1 -- 172.21.15.92:0/4078037308 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ecbe8fda0 con 0x563ecbb2e9f0 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.067+0000 7f6569951640 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x563ecbb2e9f0 0x563ecbf346c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.068+0000 7f6569951640 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x563ecbb2e9f0 0x563ecbf346c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a5612f56896e132 server_cookie=a70ebbe0d468e8f1 in_seq=0 out_seq=0 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.068+0000 7f6549ffb640 10 client.17325 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.068+0000 7f6549ffb640 1 -- 172.21.15.92:0/4078037308 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ecbe8fda0 con 0x563ecbb2e9f0 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.068+0000 7f6549ffb640 10 client.17325 handle_command_reply: tid=0 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 client.17325 shutdown 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 -- 172.21.15.92:0/4078037308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 msgr2=0x563ecbf22980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf22980 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f65540ce910 tx=0x7f65541091d0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 -- 172.21.15.92:0/4078037308 shutdown_connections 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x563ecbb2e9f0 0x563ecbf346c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf2e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf22ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 --2- 172.21.15.92:0/4078037308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf22980 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f6549ffb640 0 client.17325 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:04.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 -- 172.21.15.92:0/4078037308 >> 172.21.15.92:0/4078037308 conn(0x563ecbb64460 msgr2=0x563ecbf1a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:04.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 -- 172.21.15.92:0/4078037308 shutdown_connections 2024-09-21T07:19:04.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 1 -- 172.21.15.92:0/4078037308 wait complete. 2024-09-21T07:19:04.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.069+0000 7f657292a740 20 client.17325 trim_cache size 0 max 16384 2024-09-21T07:19:04.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.086+0000 7f657292a740 1 Processor -- start 2024-09-21T07:19:04.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.086+0000 7f657292a740 1 -- start start 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f657292a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb471b0 0x563ecbf245b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f657292a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb4f390 0x563ecbf14710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f657292a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb70070 0x563ecbf14c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f657292a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65641b0d60 con 0x563ecbb4f390 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f657292a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65641b28a0 con 0x563ecbb471b0 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f657292a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65641b1430 con 0x563ecbb70070 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f6569951640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb4f390 0x563ecbf14710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f6569951640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb4f390 0x563ecbf14710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42972/0 (socket says 172.21.15.92:42972) 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f6569951640 1 -- 172.21.15.92:0/2029416719 learned_addr learned my addr 172.21.15.92:0/2029416719 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f656a152640 1 --2- 172.21.15.92:0/2029416719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb471b0 0x563ecbf245b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f6569951640 1 -- 172.21.15.92:0/2029416719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb70070 msgr2=0x563ecbf14c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:04.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f656a953640 1 --2- 172.21.15.92:0/2029416719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb70070 0x563ecbf14c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f6569951640 1 --2- 172.21.15.92:0/2029416719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb70070 0x563ecbf14c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f6569951640 1 -- 172.21.15.92:0/2029416719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb471b0 msgr2=0x563ecbf245b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:04.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f6569951640 1 --2- 172.21.15.92:0/2029416719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb471b0 0x563ecbf245b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f6569951640 1 -- 172.21.15.92:0/2029416719 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ecbf218e0 con 0x563ecbb4f390 2024-09-21T07:19:04.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f656a152640 1 --2- 172.21.15.92:0/2029416719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb471b0 0x563ecbf245b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:04.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f6569951640 1 --2- 172.21.15.92:0/2029416719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb4f390 0x563ecbf14710 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f656406b6c0 tx=0x7f655800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbff6302a78047f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:04.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.087+0000 7f654bfff640 1 -- 172.21.15.92:0/2029416719 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558005020 con 0x563ecbb4f390 2024-09-21T07:19:04.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f654bfff640 1 -- 172.21.15.92:0/2029416719 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65580047a0 con 0x563ecbb4f390 2024-09-21T07:19:04.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f654bfff640 1 -- 172.21.15.92:0/2029416719 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655801c660 con 0x563ecbb4f390 2024-09-21T07:19:04.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f657292a740 1 -- 172.21.15.92:0/2029416719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb4f390 msgr2=0x563ecbf14710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:04.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f657292a740 1 --2- 172.21.15.92:0/2029416719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb4f390 0x563ecbf14710 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f656406b6c0 tx=0x7f655800f7f0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f657292a740 1 -- 172.21.15.92:0/2029416719 shutdown_connections 2024-09-21T07:19:04.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f657292a740 1 --2- 172.21.15.92:0/2029416719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb70070 0x563ecbf14c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f657292a740 1 --2- 172.21.15.92:0/2029416719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb4f390 0x563ecbf14710 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f657292a740 1 --2- 172.21.15.92:0/2029416719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb471b0 0x563ecbf245b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f657292a740 1 -- 172.21.15.92:0/2029416719 >> 172.21.15.92:0/2029416719 conn(0x563ecbb64460 msgr2=0x563ecbf23ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f657292a740 1 -- 172.21.15.92:0/2029416719 shutdown_connections 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.088+0000 7f657292a740 1 -- 172.21.15.92:0/2029416719 wait complete. 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f657292a740 1 -- start start 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f657292a740 1 Processor -- start 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f657292a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf26ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f657292a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf27240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f657292a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf9e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f657292a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65641b21d0 con 0x563ecbb471b0 2024-09-21T07:19:04.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f657292a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65641b1b00 con 0x563ecbb70070 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f657292a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65641aed20 con 0x563ecbb4f390 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f657292a740 10 client.0 _ll_register_callbacks cb 0x7f65540ca070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f656a152640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf26ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f656a152640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf26ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42974/0 (socket says 172.21.15.92:42974) 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f656a152640 1 -- 172.21.15.92:0/583963057 learned_addr learned my addr 172.21.15.92:0/583963057 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.089+0000 7f656a953640 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf9e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f6569951640 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf27240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f656a152640 1 -- 172.21.15.92:0/583963057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 msgr2=0x563ecbf27240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f656a152640 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf27240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f656a152640 1 -- 172.21.15.92:0/583963057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 msgr2=0x563ecbf9e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f656a152640 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf9e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f656a152640 1 -- 172.21.15.92:0/583963057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ecbf9e590 con 0x563ecbb471b0 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f656a953640 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf9e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f6569951640 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf27240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f656a152640 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf26ca0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f6554031920 tx=0x7f65540cafd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99cec3bd4427d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f6549ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f6549ffb640 1 -- 172.21.15.92:0/583963057 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65540ce750 con 0x563ecbb471b0 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f6549ffb640 1 -- 172.21.15.92:0/583963057 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f655410c7f0 con 0x563ecbb471b0 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f657292a740 1 -- 172.21.15.92:0/583963057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65580047a0 con 0x563ecbb471b0 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f6549ffb640 1 -- 172.21.15.92:0/583963057 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65540ca820 con 0x563ecbb471b0 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f657292a740 10 client.17331 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f657292a740 1 -- 172.21.15.92:0/583963057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ecbf9e590 con 0x563ecbb471b0 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f6549ffb640 1 -- 172.21.15.92:0/583963057 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65580047a0 con 0x563ecbb471b0 2024-09-21T07:19:04.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f6549ffb640 1 -- 172.21.15.92:0/583963057 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f65540cdbe0 con 0x563ecbb471b0 2024-09-21T07:19:04.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.090+0000 7f657292a740 10 client.17331 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:04.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.091+0000 7f657292a740 10 client.17331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:19:04.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.091+0000 7f657292a740 20 client.17331 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:04.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.091+0000 7f657292a740 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x563ecbb03da0 0x563ecbfa1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:04.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.091+0000 7f657292a740 4 client.17331 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:19:04.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.091+0000 7f657292a740 1 -- 172.21.15.92:0/583963057 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ecbe8b850 con 0x563ecbb03da0 2024-09-21T07:19:04.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.091+0000 7f6569951640 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x563ecbb03da0 0x563ecbfa1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:04.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.091+0000 7f6569951640 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x563ecbb03da0 0x563ecbfa1a20 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3684c03930bdb858 server_cookie=4d10440599c19e in_seq=0 out_seq=0 2024-09-21T07:19:04.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.091+0000 7f6549ffb640 10 client.17331 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f6549ffb640 1 -- 172.21.15.92:0/583963057 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x563ecbe8b850 con 0x563ecbb03da0 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f6549ffb640 10 client.17331 handle_command_reply: tid=0 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 client.17331 shutdown 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 -- 172.21.15.92:0/583963057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 msgr2=0x563ecbf26ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf26ca0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f6554031920 tx=0x7f65540cafd0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 -- 172.21.15.92:0/583963057 shutdown_connections 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x563ecbb03da0 0x563ecbfa1a20 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ecbb70070 0x563ecbf9e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecbb4f390 0x563ecbf27240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f6549ffb640 0 client.17331 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 --2- 172.21.15.92:0/583963057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563ecbb471b0 0x563ecbf26ca0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 -- 172.21.15.92:0/583963057 >> 172.21.15.92:0/583963057 conn(0x563ecbb64460 msgr2=0x563ecbf18250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:04.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 -- 172.21.15.92:0/583963057 shutdown_connections 2024-09-21T07:19:04.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 1 -- 172.21.15.92:0/583963057 wait complete. 2024-09-21T07:19:04.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.092+0000 7f657292a740 20 client.17331 trim_cache size 0 max 16384 2024-09-21T07:19:04.101 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:19:04.101 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:19:04.101 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:19:04.101 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:19:04.101 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:19:04.101 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:19:04.102 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:04.102 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:04.102 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:04.102 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:04.102 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:04.102 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:04.102 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:19:04.102 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:19:04.102 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:04.102 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:04.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:19:04.104 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:19:04.106 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:19:04.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 -- 172.21.15.92:0/2346719445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f654c0b66b0 msgr2=0x7f654c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:04.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f654c0b66b0 0x7f654c0b8bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f655c009a70 tx=0x7f655c0090e0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 -- 172.21.15.92:0/2346719445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65641049c0 msgr2=0x7f656419a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:04.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65641049c0 0x7f656419a3f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f6554006010 tx=0x7f6554032bc0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 -- 172.21.15.92:0/2346719445 shutdown_connections 2024-09-21T07:19:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f654c0b66b0 0x7f654c0b8bc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f656410de20 0x7f656419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6564105310 0x7f656419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 --2- 172.21.15.92:0/2346719445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65641049c0 0x7f656419a3f0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 -- 172.21.15.92:0/2346719445 >> 172.21.15.92:0/2346719445 conn(0x7f6564079710 msgr2=0x7f6564105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 -- 172.21.15.92:0/2346719445 shutdown_connections 2024-09-21T07:19:04.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:04.093+0000 7f656c3b6640 1 -- 172.21.15.92:0/2346719445 wait complete. 2024-09-21T07:19:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:03 smithi169 ceph-mon[33705]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 24 op/s 2024-09-21T07:19:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:03 smithi175 ceph-mon[34064]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 24 op/s 2024-09-21T07:19:05.045 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:19:05.045 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:19:05.304 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:05.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.834+0000 7fe2c364a640 1 -- 172.21.15.92:0/3054365791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2bc1083b0 msgr2=0x7fe2bc1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:05.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.834+0000 7fe2c364a640 1 --2- 172.21.15.92:0/3054365791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2bc1083b0 0x7fe2bc1087c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009ca0 tx=0x7fe2b002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:19:05.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.834+0000 7fe2c364a640 1 -- 172.21.15.92:0/3054365791 shutdown_connections 2024-09-21T07:19:05.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.834+0000 7fe2c364a640 1 --2- 172.21.15.92:0/3054365791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc108d00 0x7fe2bc10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:05.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.834+0000 7fe2c364a640 1 --2- 172.21.15.92:0/3054365791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2bc1083b0 0x7fe2bc1087c0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:05.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.834+0000 7fe2c364a640 1 --2- 172.21.15.92:0/3054365791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2bc103180 0x7fe2bc103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:05.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.834+0000 7fe2c364a640 1 -- 172.21.15.92:0/3054365791 >> 172.21.15.92:0/3054365791 conn(0x7fe2bc077c60 msgr2=0x7fe2bc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:05.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.834+0000 7fe2c364a640 1 -- 172.21.15.92:0/3054365791 shutdown_connections 2024-09-21T07:19:05.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.834+0000 7fe2c364a640 1 -- 172.21.15.92:0/3054365791 wait complete. 2024-09-21T07:19:05.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c364a640 1 Processor -- start 2024-09-21T07:19:05.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c364a640 1 -- start start 2024-09-21T07:19:05.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c364a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2bc103180 0x7fe2bc19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:05.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c364a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2bc1083b0 0x7fe2bc19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:05.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c364a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc108d00 0x7fe2bc19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:05.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c364a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1128e0 con 0x7fe2bc1083b0 2024-09-21T07:19:05.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c364a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc112760 con 0x7fe2bc103180 2024-09-21T07:19:05.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c364a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc112a60 con 0x7fe2bc108d00 2024-09-21T07:19:05.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c0be5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2bc1083b0 0x7fe2bc19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:05.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c0be5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2bc1083b0 0x7fe2bc19b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42978/0 (socket says 172.21.15.92:42978) 2024-09-21T07:19:05.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c0be5640 1 -- 172.21.15.92:0/1117458937 learned_addr learned my addr 172.21.15.92:0/1117458937 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:05.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.835+0000 7fe2c13e6640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2bc103180 0x7fe2bc19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:05.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2c1be7640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc108d00 0x7fe2bc19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:05.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2c0be5640 1 -- 172.21.15.92:0/1117458937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc108d00 msgr2=0x7fe2bc19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:05.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2c0be5640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc108d00 0x7fe2bc19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:05.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2c0be5640 1 -- 172.21.15.92:0/1117458937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2bc103180 msgr2=0x7fe2bc19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:05.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2c0be5640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2bc103180 0x7fe2bc19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:05.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2c0be5640 1 -- 172.21.15.92:0/1117458937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc1a6500 con 0x7fe2bc1083b0 2024-09-21T07:19:05.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2c1be7640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc108d00 0x7fe2bc19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:05.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2c0be5640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2bc1083b0 0x7fe2bc19b810 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0032c40 tx=0x7fe2b0032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:05.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2ba7fc640 1 -- 172.21.15.92:0/1117458937 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0004240 con 0x7fe2bc1083b0 2024-09-21T07:19:05.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2ba7fc640 1 -- 172.21.15.92:0/1117458937 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2b0032e90 con 0x7fe2bc1083b0 2024-09-21T07:19:05.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2c364a640 1 -- 172.21.15.92:0/1117458937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc1a6790 con 0x7fe2bc1083b0 2024-09-21T07:19:05.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2ba7fc640 1 -- 172.21.15.92:0/1117458937 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0030d50 con 0x7fe2bc1083b0 2024-09-21T07:19:05.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.836+0000 7fe2c364a640 1 -- 172.21.15.92:0/1117458937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2bc1a6cd0 con 0x7fe2bc1083b0 2024-09-21T07:19:05.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.837+0000 7fe2c364a640 1 -- 172.21.15.92:0/1117458937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2bc103590 con 0x7fe2bc1083b0 2024-09-21T07:19:05.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.839+0000 7fe2ba7fc640 1 -- 172.21.15.92:0/1117458937 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fe2b00305c0 con 0x7fe2bc1083b0 2024-09-21T07:19:05.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.840+0000 7fe2ba7fc640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2a40b6680 0x7fe2a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:05.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.840+0000 7fe2c13e6640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2a40b6680 0x7fe2a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:05.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.840+0000 7fe2ba7fc640 1 -- 172.21.15.92:0/1117458937 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe2b01090a0 con 0x7fe2bc1083b0 2024-09-21T07:19:05.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.840+0000 7fe2c13e6640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2a40b6680 0x7fe2a40b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc102960 tx=0x7fe2b400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:05.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:05.843+0000 7fe2ba7fc640 1 -- 172.21.15.92:0/1117458937 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2b00cf250 con 0x7fe2bc1083b0 2024-09-21T07:19:06.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.060+0000 7fe2c364a640 1 -- 172.21.15.92:0/1117458937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2bc02e640 con 0x7fe2bc1083b0 2024-09-21T07:19:06.063 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:05 smithi092 ceph-mon[30987]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:19:06.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.061+0000 7fe2ba7fc640 1 -- 172.21.15.92:0/1117458937 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7fe2b00d3630 con 0x7fe2bc1083b0 2024-09-21T07:19:06.064 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:19:06.064 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:19:06.064 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:19:06.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.063+0000 7fe2c364a640 1 -- 172.21.15.92:0/1117458937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2a40b6680 msgr2=0x7fe2a40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:06.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.063+0000 7fe2c364a640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2a40b6680 0x7fe2a40b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc102960 tx=0x7fe2b400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:19:06.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.063+0000 7fe2c364a640 1 -- 172.21.15.92:0/1117458937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2bc1083b0 msgr2=0x7fe2bc19b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:06.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.063+0000 7fe2c364a640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2bc1083b0 0x7fe2bc19b810 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0032c40 tx=0x7fe2b0032c70 comp rx=0 tx=0).stop 2024-09-21T07:19:06.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.064+0000 7fe2c364a640 1 -- 172.21.15.92:0/1117458937 shutdown_connections 2024-09-21T07:19:06.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.064+0000 7fe2c364a640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2a40b6680 0x7fe2a40b8b90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:06.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.064+0000 7fe2c364a640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2bc108d00 0x7fe2bc19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:06.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.064+0000 7fe2c364a640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2bc1083b0 0x7fe2bc19b810 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:06.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.064+0000 7fe2c364a640 1 --2- 172.21.15.92:0/1117458937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2bc103180 0x7fe2bc19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:06.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.064+0000 7fe2c364a640 1 -- 172.21.15.92:0/1117458937 >> 172.21.15.92:0/1117458937 conn(0x7fe2bc077c60 msgr2=0x7fe2bc106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:06.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.064+0000 7fe2c364a640 1 -- 172.21.15.92:0/1117458937 shutdown_connections 2024-09-21T07:19:06.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:06.064+0000 7fe2c364a640 1 -- 172.21.15.92:0/1117458937 wait complete. 2024-09-21T07:19:06.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:05 smithi169 ceph-mon[33705]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:19:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:05 smithi175 ceph-mon[34064]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:19:06.891 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:19:07.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:06 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1117458937' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:19:07.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:06 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1117458937' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:19:07.143 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:07.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:06 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1117458937' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:19:07.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.609+0000 7fe61e8e1640 1 -- 172.21.15.92:0/1485039563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe618109560 msgr2=0x7fe618109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:07.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.609+0000 7fe61e8e1640 1 --2- 172.21.15.92:0/1485039563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe618109560 0x7fe618109970 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe600009900 tx=0x7fe60002a410 comp rx=0 tx=0).stop 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.609+0000 7fe61e8e1640 1 -- 172.21.15.92:0/1485039563 shutdown_connections 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.609+0000 7fe61e8e1640 1 --2- 172.21.15.92:0/1485039563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe618109eb0 0x7fe6181106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.609+0000 7fe61e8e1640 1 --2- 172.21.15.92:0/1485039563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe618109560 0x7fe618109970 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.609+0000 7fe61e8e1640 1 --2- 172.21.15.92:0/1485039563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe618102080 0x7fe618102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.609+0000 7fe61e8e1640 1 -- 172.21.15.92:0/1485039563 >> 172.21.15.92:0/1485039563 conn(0x7fe618079ec0 msgr2=0x7fe61807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.610+0000 7fe61e8e1640 1 -- 172.21.15.92:0/1485039563 shutdown_connections 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.610+0000 7fe61e8e1640 1 -- 172.21.15.92:0/1485039563 wait complete. 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.610+0000 7fe61e8e1640 1 Processor -- start 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.610+0000 7fe61e8e1640 1 -- start start 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.610+0000 7fe61e8e1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe618102080 0x7fe618103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.610+0000 7fe61e8e1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe618109560 0x7fe618103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.610+0000 7fe61e8e1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe618109eb0 0x7fe618103aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.610+0000 7fe61e8e1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe618113a60 con 0x7fe618109560 2024-09-21T07:19:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.610+0000 7fe61e8e1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181138e0 con 0x7fe618109eb0 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.610+0000 7fe61e8e1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe618113be0 con 0x7fe618102080 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe60ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe618109560 0x7fe618103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe60ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe618109560 0x7fe618103560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42992/0 (socket says 172.21.15.92:42992) 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe60ffff640 1 -- 172.21.15.92:0/2924337053 learned_addr learned my addr 172.21.15.92:0/2924337053 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe617fff640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe618102080 0x7fe618103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe61ce7e640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe618109eb0 0x7fe618103aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe60ffff640 1 -- 172.21.15.92:0/2924337053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe618102080 msgr2=0x7fe618103020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe60ffff640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe618102080 0x7fe618103020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe60ffff640 1 -- 172.21.15.92:0/2924337053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe618109eb0 msgr2=0x7fe618103aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe60ffff640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe618109eb0 0x7fe618103aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe60ffff640 1 -- 172.21.15.92:0/2924337053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6181a8790 con 0x7fe618109560 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe617fff640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe618102080 0x7fe618103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe60ffff640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe618109560 0x7fe618103560 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe600005940 tx=0x7fe6000040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe615ffb640 1 -- 172.21.15.92:0/2924337053 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60003f030 con 0x7fe618109560 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe615ffb640 1 -- 172.21.15.92:0/2924337053 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe600003a80 con 0x7fe618109560 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe61e8e1640 1 -- 172.21.15.92:0/2924337053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6181a8a20 con 0x7fe618109560 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe615ffb640 1 -- 172.21.15.92:0/2924337053 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600035070 con 0x7fe618109560 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.611+0000 7fe61e8e1640 1 -- 172.21.15.92:0/2924337053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6181a8f00 con 0x7fe618109560 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.614+0000 7fe624e55740 1 Processor -- start 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.614+0000 7fe624e55740 1 -- start start 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.614+0000 7fe615ffb640 1 -- 172.21.15.92:0/2924337053 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fe600042030 con 0x7fe618109560 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.614+0000 7fe624e55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdacc070 0x5564bde732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.614+0000 7fe624e55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaa31b0 0x5564bde73800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.614+0000 7fe624e55740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaab390 0x5564bde73d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.614+0000 7fe624e55740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5564bdde9ea0 con 0x5564bdaab390 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.614+0000 7fe624e55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5564bddd92d0 con 0x5564bdaa31b0 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.614+0000 7fe624e55740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5564bdddd0e0 con 0x5564bdacc070 2024-09-21T07:19:07.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe60ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaab390 0x5564bde73d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe617fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaa31b0 0x5564bde73800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe617fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaa31b0 0x5564bde73800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:39144/0 (socket says 172.21.15.92:39144) 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe60ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaab390 0x5564bde73d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43000/0 (socket says 172.21.15.92:43000) 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe617fff640 1 -- 172.21.15.92:0/2234862616 learned_addr learned my addr 172.21.15.92:0/2234862616 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe61ce7e640 1 --2- 172.21.15.92:0/2234862616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdacc070 0x5564bde732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe617fff640 1 -- 172.21.15.92:0/2234862616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdacc070 msgr2=0x5564bde732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe617fff640 1 --2- 172.21.15.92:0/2234862616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdacc070 0x5564bde732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe617fff640 1 -- 172.21.15.92:0/2234862616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaab390 msgr2=0x5564bde73d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe617fff640 1 --2- 172.21.15.92:0/2234862616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaab390 0x5564bde73d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe617fff640 1 -- 172.21.15.92:0/2234862616 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564bdb37650 con 0x5564bdaa31b0 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe60ffff640 1 --2- 172.21.15.92:0/2234862616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaab390 0x5564bde73d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe615ffb640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6040b6680 0x7fe6040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe61ce7e640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6040b6680 0x7fe6040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe617fff640 1 --2- 172.21.15.92:0/2234862616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaa31b0 0x5564bde73800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe60800bd30 tx=0x7fe60800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a86a6cb0246434d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe615ffb640 1 -- 172.21.15.92:0/2924337053 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe600108140 con 0x7fe618109560 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe60e7fc640 1 -- 172.21.15.92:0/2234862616 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608015070 con 0x5564bdaa31b0 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe60e7fc640 1 -- 172.21.15.92:0/2234862616 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe60800be20 con 0x5564bdaa31b0 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.615+0000 7fe60e7fc640 1 -- 172.21.15.92:0/2234862616 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608011440 con 0x5564bdaa31b0 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.616+0000 7fe624e55740 1 -- 172.21.15.92:0/2234862616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaa31b0 msgr2=0x5564bde73800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.616+0000 7fe61ce7e640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6040b6680 0x7fe6040b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe61000b4d0 tx=0x7fe61000e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.616+0000 7fe624e55740 1 --2- 172.21.15.92:0/2234862616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaa31b0 0x5564bde73800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe60800bd30 tx=0x7fe60800f730 comp rx=0 tx=0).stop 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.616+0000 7fe624e55740 1 -- 172.21.15.92:0/2234862616 shutdown_connections 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.616+0000 7fe624e55740 1 --2- 172.21.15.92:0/2234862616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaab390 0x5564bde73d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.616+0000 7fe624e55740 1 --2- 172.21.15.92:0/2234862616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaa31b0 0x5564bde73800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.616+0000 7fe624e55740 1 --2- 172.21.15.92:0/2234862616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdacc070 0x5564bde732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.616+0000 7fe624e55740 1 -- 172.21.15.92:0/2234862616 >> 172.21.15.92:0/2234862616 conn(0x5564bdac0460 msgr2=0x5564bde711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.616+0000 7fe624e55740 1 -- 172.21.15.92:0/2234862616 shutdown_connections 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.616+0000 7fe624e55740 1 -- 172.21.15.92:0/2234862616 wait complete. 2024-09-21T07:19:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.617+0000 7fe624e55740 1 -- start start 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.617+0000 7fe624e55740 1 Processor -- start 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.617+0000 7fe624e55740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde7e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.617+0000 7fe624e55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 0x5564bde7eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.617+0000 7fe624e55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 0x5564bde8adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.617+0000 7fe624e55740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5564bdc3a700 con 0x5564bdaa31b0 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.617+0000 7fe624e55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5564bdd74160 con 0x5564bdacc070 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.617+0000 7fe624e55740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5564bde81aa0 con 0x5564bdaab390 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.617+0000 7fe624e55740 10 client.0 _ll_register_callbacks cb 0x5564bdd8d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.617+0000 7fe617fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde7e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe617fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde7e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43008/0 (socket says 172.21.15.92:43008) 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe617fff640 1 -- 172.21.15.92:0/1530417713 learned_addr learned my addr 172.21.15.92:0/1530417713 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe61ce7e640 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 0x5564bde8adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe60ffff640 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 0x5564bde7eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe617fff640 1 -- 172.21.15.92:0/1530417713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 msgr2=0x5564bde7eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe617fff640 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 0x5564bde7eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe617fff640 1 -- 172.21.15.92:0/1530417713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 msgr2=0x5564bde8adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe617fff640 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 0x5564bde8adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe617fff640 1 -- 172.21.15.92:0/1530417713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564bdda1c90 con 0x5564bdaa31b0 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe60ffff640 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 0x5564bde7eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe61ce7e640 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 0x5564bde8adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe617fff640 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde7e960 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe6080048f0 tx=0x7fe608004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ce813e2fd5b528 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe5f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe5f77fe640 1 -- 172.21.15.92:0/1530417713 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608028060 con 0x5564bdaa31b0 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe5f77fe640 1 -- 172.21.15.92:0/1530417713 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe608004f90 con 0x5564bdaa31b0 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.618+0000 7fe624e55740 1 -- 172.21.15.92:0/1530417713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe60800be20 con 0x5564bdaa31b0 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe5f77fe640 1 -- 172.21.15.92:0/1530417713 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe608015070 con 0x5564bdaa31b0 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe624e55740 10 client.17349 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe624e55740 1 -- 172.21.15.92:0/1530417713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564bde8d7f0 con 0x5564bdaa31b0 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe5f77fe640 1 -- 172.21.15.92:0/1530417713 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe60800be20 con 0x5564bdaa31b0 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe5f77fe640 1 -- 172.21.15.92:0/1530417713 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe608011920 con 0x5564bdaa31b0 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe624e55740 10 client.17349 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe624e55740 10 client.17349 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe624e55740 20 client.17349 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe624e55740 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564bda8a9f0 0x5564bde90b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe624e55740 4 client.17349 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe624e55740 1 -- 172.21.15.92:0/1530417713 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564bddebdf0 con 0x5564bda8a9f0 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.619+0000 7fe60ffff640 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564bda8a9f0 0x5564bde90b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.620+0000 7fe60ffff640 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564bda8a9f0 0x5564bde90b50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2009c10cc09bd746 server_cookie=8aa92b502612cee6 in_seq=0 out_seq=0 2024-09-21T07:19:07.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.620+0000 7fe5f77fe640 10 client.17349 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:19:07.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe5f77fe640 1 -- 172.21.15.92:0/1530417713 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564bddebdf0 con 0x5564bda8a9f0 2024-09-21T07:19:07.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe5f77fe640 10 client.17349 handle_command_reply: tid=0 2024-09-21T07:19:07.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 client.17349 shutdown 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 -- 172.21.15.92:0/1530417713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 msgr2=0x5564bde7e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde7e960 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe6080048f0 tx=0x7fe608004920 comp rx=0 tx=0).stop 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 -- 172.21.15.92:0/1530417713 shutdown_connections 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564bda8a9f0 0x5564bde90b50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 0x5564bde8adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 0x5564bde7eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 --2- 172.21.15.92:0/1530417713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde7e960 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 -- 172.21.15.92:0/1530417713 >> 172.21.15.92:0/1530417713 conn(0x5564bdac0460 msgr2=0x5564bde76450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe5f77fe640 0 client.17349 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 -- 172.21.15.92:0/1530417713 shutdown_connections 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 1 -- 172.21.15.92:0/1530417713 wait complete. 2024-09-21T07:19:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.621+0000 7fe624e55740 20 client.17349 trim_cache size 0 max 16384 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe624e55740 1 Processor -- start 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe624e55740 1 -- start start 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe624e55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaa31b0 0x5564bde7ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe624e55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaab390 0x5564bde8ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe624e55740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdacc070 0x5564bde7bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe624e55740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181b3090 con 0x5564bdacc070 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe624e55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181b4bd0 con 0x5564bdaab390 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe624e55740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181b3760 con 0x5564bdaa31b0 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe61ce7e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdacc070 0x5564bde7bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe61ce7e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdacc070 0x5564bde7bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43010/0 (socket says 172.21.15.92:43010) 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.634+0000 7fe61ce7e640 1 -- 172.21.15.92:0/1172260603 learned_addr learned my addr 172.21.15.92:0/1172260603 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe617fff640 1 --2- 172.21.15.92:0/1172260603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaa31b0 0x5564bde7ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe60ffff640 1 --2- 172.21.15.92:0/1172260603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaab390 0x5564bde8ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe61ce7e640 1 -- 172.21.15.92:0/1172260603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaa31b0 msgr2=0x5564bde7ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:07.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe61ce7e640 1 --2- 172.21.15.92:0/1172260603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaa31b0 0x5564bde7ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe61ce7e640 1 -- 172.21.15.92:0/1172260603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaab390 msgr2=0x5564bde8ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:07.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe61ce7e640 1 --2- 172.21.15.92:0/1172260603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaab390 0x5564bde8ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe61ce7e640 1 -- 172.21.15.92:0/1172260603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564bde6c5d0 con 0x5564bdacc070 2024-09-21T07:19:07.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe617fff640 1 --2- 172.21.15.92:0/1172260603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaa31b0 0x5564bde7ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:07.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe61ce7e640 1 --2- 172.21.15.92:0/1172260603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdacc070 0x5564bde7bb50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe6100188e0 tx=0x7fe61000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880668fd19962734 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:07.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe60dffb640 1 -- 172.21.15.92:0/1172260603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610029070 con 0x5564bdacc070 2024-09-21T07:19:07.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe60dffb640 1 -- 172.21.15.92:0/1172260603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe610007d00 con 0x5564bdacc070 2024-09-21T07:19:07.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.635+0000 7fe60dffb640 1 -- 172.21.15.92:0/1172260603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610022620 con 0x5564bdacc070 2024-09-21T07:19:07.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.636+0000 7fe624e55740 1 -- 172.21.15.92:0/1172260603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdacc070 msgr2=0x5564bde7bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.636+0000 7fe624e55740 1 --2- 172.21.15.92:0/1172260603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdacc070 0x5564bde7bb50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe6100188e0 tx=0x7fe61000bf90 comp rx=0 tx=0).stop 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.636+0000 7fe624e55740 1 -- 172.21.15.92:0/1172260603 shutdown_connections 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.636+0000 7fe624e55740 1 --2- 172.21.15.92:0/1172260603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdacc070 0x5564bde7bb50 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.636+0000 7fe624e55740 1 --2- 172.21.15.92:0/1172260603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdaab390 0x5564bde8ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.636+0000 7fe624e55740 1 --2- 172.21.15.92:0/1172260603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaa31b0 0x5564bde7ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.636+0000 7fe624e55740 1 -- 172.21.15.92:0/1172260603 >> 172.21.15.92:0/1172260603 conn(0x5564bdac0460 msgr2=0x5564bde7e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.636+0000 7fe624e55740 1 -- 172.21.15.92:0/1172260603 shutdown_connections 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.636+0000 7fe624e55740 1 -- 172.21.15.92:0/1172260603 wait complete. 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.636+0000 7fe624e55740 1 -- start start 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe624e55740 1 Processor -- start 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe624e55740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde91710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe624e55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 0x5564bde91cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe624e55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 0x5564bdef3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe624e55740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181b4500 con 0x5564bdaa31b0 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe624e55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181b3e30 con 0x5564bdacc070 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe624e55740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181b1070 con 0x5564bdaab390 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe624e55740 10 client.0 _ll_register_callbacks cb 0x7fe60010bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe617fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde91710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe617fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde91710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43016/0 (socket says 172.21.15.92:43016) 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe617fff640 1 -- 172.21.15.92:0/2394762720 learned_addr learned my addr 172.21.15.92:0/2394762720 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe61ce7e640 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 0x5564bdef3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe60ffff640 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 0x5564bde91cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe617fff640 1 -- 172.21.15.92:0/2394762720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 msgr2=0x5564bde91cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe617fff640 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 0x5564bde91cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe617fff640 1 -- 172.21.15.92:0/2394762720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 msgr2=0x5564bdef3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe617fff640 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 0x5564bdef3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe617fff640 1 -- 172.21.15.92:0/2394762720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564bdef3af0 con 0x5564bdaa31b0 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe617fff640 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde91710 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe608010010 tx=0x7fe608011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43889f946f5f8cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:07.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.637+0000 7fe5f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe5f77fe640 1 -- 172.21.15.92:0/2394762720 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608028070 con 0x5564bdaa31b0 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe5f77fe640 1 -- 172.21.15.92:0/2394762720 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe608004b80 con 0x5564bdaa31b0 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe624e55740 1 -- 172.21.15.92:0/2394762720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe610007d00 con 0x5564bdaa31b0 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe5f77fe640 1 -- 172.21.15.92:0/2394762720 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe60803c050 con 0x5564bdaa31b0 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe624e55740 10 client.17355 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe624e55740 1 -- 172.21.15.92:0/2394762720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564bdefae50 con 0x5564bdaa31b0 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe5f77fe640 1 -- 172.21.15.92:0/2394762720 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe610007d00 con 0x5564bdaa31b0 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe5f77fe640 1 -- 172.21.15.92:0/2394762720 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe608023710 con 0x5564bdaa31b0 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe624e55740 10 client.17355 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe624e55740 10 client.17355 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe624e55740 20 client.17355 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe624e55740 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564bda5fda0 0x5564bdefd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe624e55740 4 client.17355 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:19:07.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.638+0000 7fe624e55740 1 -- 172.21.15.92:0/2394762720 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5564bdde78a0 con 0x5564bda5fda0 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe60ffff640 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564bda5fda0 0x5564bdefd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe60ffff640 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564bda5fda0 0x5564bdefd5a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9ed5806c2a711355 server_cookie=a3f82d5c64f5e5f9 in_seq=0 out_seq=0 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe5f77fe640 10 client.17355 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe5f77fe640 1 -- 172.21.15.92:0/2394762720 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5564bdde78a0 con 0x5564bda5fda0 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe5f77fe640 10 client.17355 handle_command_reply: tid=0 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe624e55740 1 client.17355 shutdown 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe624e55740 1 -- 172.21.15.92:0/2394762720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 msgr2=0x5564bde91710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe624e55740 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde91710 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe608010010 tx=0x7fe608011bf0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe624e55740 1 -- 172.21.15.92:0/2394762720 shutdown_connections 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe624e55740 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564bda5fda0 0x5564bdefd5a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.639+0000 7fe624e55740 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564bdacc070 0x5564bdef3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe624e55740 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564bdaab390 0x5564bde91cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe5f77fe640 0 client.17355 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:19:07.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe624e55740 1 --2- 172.21.15.92:0/2394762720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564bdaa31b0 0x5564bde91710 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe624e55740 1 -- 172.21.15.92:0/2394762720 >> 172.21.15.92:0/2394762720 conn(0x5564bdac0460 msgr2=0x5564bde742f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:07.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe624e55740 1 -- 172.21.15.92:0/2394762720 shutdown_connections 2024-09-21T07:19:07.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe624e55740 1 -- 172.21.15.92:0/2394762720 wait complete. 2024-09-21T07:19:07.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe624e55740 20 client.17355 trim_cache size 0 max 16384 2024-09-21T07:19:07.646 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:19:07.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 -- 172.21.15.92:0/2924337053 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6040b6680 msgr2=0x7fe6040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:07.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6040b6680 0x7fe6040b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe61000b4d0 tx=0x7fe61000e040 comp rx=0 tx=0).stop 2024-09-21T07:19:07.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 -- 172.21.15.92:0/2924337053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe618109560 msgr2=0x7fe618103560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:07.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe618109560 0x7fe618103560 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe600005940 tx=0x7fe6000040e0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 -- 172.21.15.92:0/2924337053 shutdown_connections 2024-09-21T07:19:07.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6040b6680 0x7fe6040b8b90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe618109eb0 0x7fe618103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe618109560 0x7fe618103560 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 --2- 172.21.15.92:0/2924337053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe618102080 0x7fe618103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:07.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 -- 172.21.15.92:0/2924337053 >> 172.21.15.92:0/2924337053 conn(0x7fe618079ec0 msgr2=0x7fe6181055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:07.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 -- 172.21.15.92:0/2924337053 shutdown_connections 2024-09-21T07:19:07.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:07.640+0000 7fe61e8e1640 1 -- 172.21.15.92:0/2924337053 wait complete. 2024-09-21T07:19:08.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:07 smithi092 ceph-mon[30987]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:19:08.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:07 smithi169 ceph-mon[33705]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:19:08.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:07 smithi175 ceph-mon[34064]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:19:08.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:19:08.722 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:09.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.248+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/3041546133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78109e10 msgr2=0x7f3b78110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:09.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.248+0000 7f3b7c9e1640 1 --2- 172.21.15.92:0/3041546133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78109e10 0x7f3b78110640 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009ca0 tx=0x7f3b7002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.248+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/3041546133 shutdown_connections 2024-09-21T07:19:09.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.248+0000 7f3b7c9e1640 1 --2- 172.21.15.92:0/3041546133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78109e10 0x7f3b78110640 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.248+0000 7f3b7c9e1640 1 --2- 172.21.15.92:0/3041546133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b781094c0 0x7f3b781098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.248+0000 7f3b7c9e1640 1 --2- 172.21.15.92:0/3041546133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b78103b80 0x7f3b78103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.248+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/3041546133 >> 172.21.15.92:0/3041546133 conn(0x7f3b780ff610 msgr2=0x7f3b78101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.248+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/3041546133 shutdown_connections 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.248+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/3041546133 wait complete. 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7c9e1640 1 Processor -- start 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7c9e1640 1 -- start start 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7c9e1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78103b80 0x7f3b7819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7c9e1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b781094c0 0x7f3b7819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7c9e1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b78109e10 0x7f3b7819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7c9e1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781139d0 con 0x7f3b78103b80 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7c9e1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78113850 con 0x7f3b781094c0 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7c9e1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78113b50 con 0x7f3b78109e10 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78103b80 0x7f3b7819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78103b80 0x7f3b7819a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43040/0 (socket says 172.21.15.92:43040) 2024-09-21T07:19:09.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b7659c640 1 -- 172.21.15.92:0/1137535884 learned_addr learned my addr 172.21.15.92:0/1137535884 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b781094c0 0x7f3b7819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.249+0000 7f3b76d9d640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b78109e10 0x7f3b7819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b7659c640 1 -- 172.21.15.92:0/1137535884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b78109e10 msgr2=0x7f3b7819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b7659c640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b78109e10 0x7f3b7819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b7659c640 1 -- 172.21.15.92:0/1137535884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b781094c0 msgr2=0x7f3b7819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b7659c640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b781094c0 0x7f3b7819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b7659c640 1 -- 172.21.15.92:0/1137535884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b781a02f0 con 0x7f3b78103b80 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b781094c0 0x7f3b7819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b7659c640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78103b80 0x7f3b7819a380 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800d950 tx=0x7f3b6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b677fe640 1 -- 172.21.15.92:0/1137535884 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68017070 con 0x7f3b78103b80 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/1137535884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b781a05e0 con 0x7f3b78103b80 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b677fe640 1 -- 172.21.15.92:0/1137535884 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b68009c30 con 0x7f3b78103b80 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b677fe640 1 -- 172.21.15.92:0/1137535884 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6800f620 con 0x7f3b78103b80 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.250+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/1137535884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b781a6d40 con 0x7f3b78103b80 2024-09-21T07:19:09.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b82f55740 1 Processor -- start 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b82f55740 1 -- start start 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b677fe640 1 -- 172.21.15.92:0/1137535884 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f3b6800f7c0 con 0x7f3b78103b80 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 0x5650ec7786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec778be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 0x5650ec779120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b82f55740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5650ec6eeea0 con 0x5650ec3a81b0 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b82f55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5650ec6de2d0 con 0x5650ec3d1070 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b82f55740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5650ec6e20e0 con 0x5650ec3b0390 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec778be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec778be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43054/0 (socket says 172.21.15.92:43054) 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b7659c640 1 -- 172.21.15.92:0/3584825685 learned_addr learned my addr 172.21.15.92:0/3584825685 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.253+0000 7f3b76d9d640 1 --2- 172.21.15.92:0/3584825685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 0x5650ec7786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/3584825685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 0x5650ec779120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b7659c640 1 -- 172.21.15.92:0/3584825685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 msgr2=0x5650ec779120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b7659c640 1 --2- 172.21.15.92:0/3584825685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 0x5650ec779120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b7659c640 1 -- 172.21.15.92:0/3584825685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 msgr2=0x5650ec7786a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b7659c640 1 --2- 172.21.15.92:0/3584825685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 0x5650ec7786a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b7659c640 1 -- 172.21.15.92:0/3584825685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650ec43c650 con 0x5650ec3a81b0 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/3584825685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 0x5650ec779120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b7659c640 1 --2- 172.21.15.92:0/3584825685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec778be0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3b680e4b50 tx=0x7f3b680eddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3b8ed4834f5bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b64ff9640 1 -- 172.21.15.92:0/3584825685 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b680efd00 con 0x5650ec3a81b0 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b64ff9640 1 -- 172.21.15.92:0/3584825685 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b680f4070 con 0x5650ec3a81b0 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b64ff9640 1 -- 172.21.15.92:0/3584825685 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b680f0670 con 0x5650ec3a81b0 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b677fe640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b600b6680 0x7f3b600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.254+0000 7f3b76d9d640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b600b6680 0x7f3b600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b677fe640 1 -- 172.21.15.92:0/1137535884 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3b680e7830 con 0x7f3b78103b80 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b82f55740 1 -- 172.21.15.92:0/3584825685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 msgr2=0x5650ec778be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b76d9d640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b600b6680 0x7f3b600b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3b70006010 tx=0x7f3b70005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:09.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b82f55740 1 --2- 172.21.15.92:0/3584825685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec778be0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3b680e4b50 tx=0x7f3b680eddb0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b82f55740 1 -- 172.21.15.92:0/3584825685 shutdown_connections 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b82f55740 1 --2- 172.21.15.92:0/3584825685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 0x5650ec779120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b82f55740 1 --2- 172.21.15.92:0/3584825685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec778be0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b82f55740 1 --2- 172.21.15.92:0/3584825685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 0x5650ec7786a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b82f55740 1 -- 172.21.15.92:0/3584825685 >> 172.21.15.92:0/3584825685 conn(0x5650ec3c5460 msgr2=0x5650ec776590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b82f55740 1 -- 172.21.15.92:0/3584825685 shutdown_connections 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.255+0000 7f3b82f55740 1 -- 172.21.15.92:0/3584825685 wait complete. 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b82f55740 1 -- start start 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b82f55740 1 Processor -- start 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 0x5650ec788680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 0x5650ec794540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b82f55740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5650ec53f700 con 0x5650ec3a81b0 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b82f55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5650ec679160 con 0x5650ec3d1070 2024-09-21T07:19:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b82f55740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5650ec78b1e0 con 0x5650ec3b0390 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b82f55740 10 client.0 _ll_register_callbacks cb 0x5650ec6929e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43066/0 (socket says 172.21.15.92:43066) 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b7659c640 1 -- 172.21.15.92:0/155191118 learned_addr learned my addr 172.21.15.92:0/155191118 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 0x5650ec788680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b76d9d640 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 0x5650ec794540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b7659c640 1 -- 172.21.15.92:0/155191118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 msgr2=0x5650ec788680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b7659c640 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 0x5650ec788680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.256+0000 7f3b7659c640 1 -- 172.21.15.92:0/155191118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 msgr2=0x5650ec794540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b7659c640 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 0x5650ec794540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b7659c640 1 -- 172.21.15.92:0/155191118 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650ec6a6c90 con 0x5650ec3a81b0 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b76d9d640 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 0x5650ec794540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b7659c640 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788140 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3b680058c0 tx=0x7f3b680e7ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e25ce948fac082 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b5dffb640 1 -- 172.21.15.92:0/155191118 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68020070 con 0x5650ec3a81b0 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b5dffb640 1 -- 172.21.15.92:0/155191118 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3b680e7470 con 0x5650ec3a81b0 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b82f55740 1 -- 172.21.15.92:0/155191118 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b680f4070 con 0x5650ec3a81b0 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b5dffb640 1 -- 172.21.15.92:0/155191118 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3b680a9930 con 0x5650ec3a81b0 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b82f55740 10 client.17367 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b82f55740 1 -- 172.21.15.92:0/155191118 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5650ec796f00 con 0x5650ec3a81b0 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b5dffb640 1 -- 172.21.15.92:0/155191118 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b680f4070 con 0x5650ec3a81b0 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b5dffb640 1 -- 172.21.15.92:0/155191118 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3b680d0040 con 0x5650ec3a81b0 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b82f55740 10 client.17367 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b82f55740 10 client.17367 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.257+0000 7f3b82f55740 20 client.17367 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.258+0000 7f3b82f55740 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5650ec38f9f0 0x5650ec79a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.258+0000 7f3b82f55740 4 client.17367 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.258+0000 7f3b82f55740 1 -- 172.21.15.92:0/155191118 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650ec6f0df0 con 0x5650ec38f9f0 2024-09-21T07:19:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.258+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5650ec38f9f0 0x5650ec79a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.258+0000 7f3b5dffb640 10 client.17367 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.258+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5650ec38f9f0 0x5650ec79a260 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1ad9749b8987a4a4 server_cookie=29ed34b280894167 in_seq=0 out_seq=0 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b5dffb640 1 -- 172.21.15.92:0/155191118 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5650ec6f0df0 con 0x5650ec38f9f0 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b5dffb640 10 client.17367 handle_command_reply: tid=0 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b82f55740 1 client.17367 shutdown 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b82f55740 1 -- 172.21.15.92:0/155191118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 msgr2=0x5650ec788140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b82f55740 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788140 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3b680058c0 tx=0x7f3b680e7ba0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b82f55740 1 -- 172.21.15.92:0/155191118 shutdown_connections 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b82f55740 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3d1070 0x5650ec794540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b82f55740 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3b0390 0x5650ec788680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b82f55740 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5650ec38f9f0 0x5650ec79a260 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b82f55740 1 --2- 172.21.15.92:0/155191118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788140 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b82f55740 1 -- 172.21.15.92:0/155191118 >> 172.21.15.92:0/155191118 conn(0x5650ec3c5460 msgr2=0x5650ec774bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.259+0000 7f3b5dffb640 0 client.17367 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:19:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.260+0000 7f3b82f55740 1 -- 172.21.15.92:0/155191118 shutdown_connections 2024-09-21T07:19:09.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.260+0000 7f3b82f55740 1 -- 172.21.15.92:0/155191118 wait complete. 2024-09-21T07:19:09.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.260+0000 7f3b82f55740 20 client.17367 trim_cache size 0 max 16384 2024-09-21T07:19:09.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b82f55740 1 Processor -- start 2024-09-21T07:19:09.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b82f55740 1 -- start start 2024-09-21T07:19:09.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3b0390 0x5650ec785330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3d1070 0x5650ec785870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b82f55740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781aec90 con 0x5650ec3a81b0 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b82f55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781b07d0 con 0x5650ec3b0390 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b82f55740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781af360 con 0x5650ec3d1070 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43082/0 (socket says 172.21.15.92:43082) 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b7659c640 1 -- 172.21.15.92:0/1970852090 learned_addr learned my addr 172.21.15.92:0/1970852090 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b7659c640 1 -- 172.21.15.92:0/1970852090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3d1070 msgr2=0x5650ec785870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b7659c640 1 --2- 172.21.15.92:0/1970852090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3d1070 0x5650ec785870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b7659c640 1 -- 172.21.15.92:0/1970852090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3b0390 msgr2=0x5650ec785330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b7659c640 1 --2- 172.21.15.92:0/1970852090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3b0390 0x5650ec785330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b7659c640 1 -- 172.21.15.92:0/1970852090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650ec786640 con 0x5650ec3a81b0 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.273+0000 7f3b7659c640 1 --2- 172.21.15.92:0/1970852090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788600 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3b680aa550 tx=0x7f3b680eddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bf667d02c74bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.274+0000 7f3b5ffff640 1 -- 172.21.15.92:0/1970852090 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b680d4070 con 0x5650ec3a81b0 2024-09-21T07:19:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.274+0000 7f3b5ffff640 1 -- 172.21.15.92:0/1970852090 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b680f4070 con 0x5650ec3a81b0 2024-09-21T07:19:09.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.274+0000 7f3b5ffff640 1 -- 172.21.15.92:0/1970852090 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68020030 con 0x5650ec3a81b0 2024-09-21T07:19:09.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.274+0000 7f3b82f55740 1 -- 172.21.15.92:0/1970852090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 msgr2=0x5650ec788600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:09.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.274+0000 7f3b82f55740 1 --2- 172.21.15.92:0/1970852090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788600 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3b680aa550 tx=0x7f3b680eddb0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.274+0000 7f3b82f55740 1 -- 172.21.15.92:0/1970852090 shutdown_connections 2024-09-21T07:19:09.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.274+0000 7f3b82f55740 1 --2- 172.21.15.92:0/1970852090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3d1070 0x5650ec785870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.274+0000 7f3b82f55740 1 --2- 172.21.15.92:0/1970852090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3b0390 0x5650ec785330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.274+0000 7f3b82f55740 1 --2- 172.21.15.92:0/1970852090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec788600 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.274+0000 7f3b82f55740 1 -- 172.21.15.92:0/1970852090 >> 172.21.15.92:0/1970852090 conn(0x5650ec3c5460 msgr2=0x5650ec787ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 1 -- 172.21.15.92:0/1970852090 shutdown_connections 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 1 -- 172.21.15.92:0/1970852090 wait complete. 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 1 -- start start 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 1 Processor -- start 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec79da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3b0390 0x5650ec79afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3d1070 0x5650ec79b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781b0100 con 0x5650ec3a81b0 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781afa30 con 0x5650ec3b0390 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781acc70 con 0x5650ec3d1070 2024-09-21T07:19:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b82f55740 10 client.0 _ll_register_callbacks cb 0x7f3b70009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec79da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec79da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43094/0 (socket says 172.21.15.92:43094) 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.275+0000 7f3b7659c640 1 -- 172.21.15.92:0/583611808 learned_addr learned my addr 172.21.15.92:0/583611808 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3b0390 0x5650ec79afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b76d9d640 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3d1070 0x5650ec79b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b7659c640 1 -- 172.21.15.92:0/583611808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3d1070 msgr2=0x5650ec79b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b7659c640 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3d1070 0x5650ec79b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b7659c640 1 -- 172.21.15.92:0/583611808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3b0390 msgr2=0x5650ec79afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b7659c640 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3b0390 0x5650ec79afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b7659c640 1 -- 172.21.15.92:0/583611808 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650ec79bc60 con 0x5650ec3a81b0 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b76d9d640 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3d1070 0x5650ec79b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3b0390 0x5650ec79afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:09.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b7659c640 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec79da40 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3b680058c0 tx=0x7f3b680e77a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3597f86a4247c21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b5dffb640 1 -- 172.21.15.92:0/583611808 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68020070 con 0x5650ec3a81b0 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b5dffb640 1 -- 172.21.15.92:0/583611808 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3b680ac540 con 0x5650ec3a81b0 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b82f55740 1 -- 172.21.15.92:0/583611808 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b680f4070 con 0x5650ec3a81b0 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b5dffb640 1 -- 172.21.15.92:0/583611808 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3b680d4050 con 0x5650ec3a81b0 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b82f55740 10 client.17373 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b82f55740 1 -- 172.21.15.92:0/583611808 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5650ec79bc60 con 0x5650ec3a81b0 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.276+0000 7f3b5dffb640 1 -- 172.21.15.92:0/583611808 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b680f4070 con 0x5650ec3a81b0 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.277+0000 7f3b5dffb640 1 -- 172.21.15.92:0/583611808 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3b680d0040 con 0x5650ec3a81b0 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.277+0000 7f3b82f55740 10 client.17373 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.277+0000 7f3b82f55740 10 client.17373 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.277+0000 7f3b82f55740 20 client.17373 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.277+0000 7f3b82f55740 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5650ec364da0 0x5650ec806ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:09.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.277+0000 7f3b82f55740 4 client.17373 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.277+0000 7f3b82f55740 1 -- 172.21.15.92:0/583611808 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5650ec6ec8a0 con 0x5650ec364da0 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.277+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5650ec364da0 0x5650ec806ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b5dffb640 10 client.17373 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b75d9b640 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5650ec364da0 0x5650ec806ce0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c7a46d72d98cd99 server_cookie=578d76ceb2b53c6 in_seq=0 out_seq=0 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b5dffb640 1 -- 172.21.15.92:0/583611808 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5650ec6ec8a0 con 0x5650ec364da0 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b5dffb640 10 client.17373 handle_command_reply: tid=0 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 client.17373 shutdown 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 -- 172.21.15.92:0/583611808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 msgr2=0x5650ec79da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec79da40 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3b680058c0 tx=0x7f3b680e77a0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 -- 172.21.15.92:0/583611808 shutdown_connections 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650ec3d1070 0x5650ec79b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5650ec3b0390 0x5650ec79afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5650ec364da0 0x5650ec806ce0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 --2- 172.21.15.92:0/583611808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650ec3a81b0 0x5650ec79da40 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 -- 172.21.15.92:0/583611808 >> 172.21.15.92:0/583611808 conn(0x5650ec3c5460 msgr2=0x5650ec77d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:09.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b5dffb640 0 client.17373 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:19:09.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 -- 172.21.15.92:0/583611808 shutdown_connections 2024-09-21T07:19:09.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 1 -- 172.21.15.92:0/583611808 wait complete. 2024-09-21T07:19:09.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.278+0000 7f3b82f55740 20 client.17373 trim_cache size 0 max 16384 2024-09-21T07:19:09.285 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:19:09.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/1137535884 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b600b6680 msgr2=0x7f3b600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:09.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b600b6680 0x7f3b600b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3b70006010 tx=0x7f3b70005c50 comp rx=0 tx=0).stop 2024-09-21T07:19:09.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/1137535884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78103b80 msgr2=0x7f3b7819a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:09.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78103b80 0x7f3b7819a380 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800d950 tx=0x7f3b6800de10 comp rx=0 tx=0).stop 2024-09-21T07:19:09.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/1137535884 shutdown_connections 2024-09-21T07:19:09.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b600b6680 0x7f3b600b8b90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b78109e10 0x7f3b7819fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b781094c0 0x7f3b7819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 --2- 172.21.15.92:0/1137535884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b78103b80 0x7f3b7819a380 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:09.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/1137535884 >> 172.21.15.92:0/1137535884 conn(0x7f3b780ff610 msgr2=0x7f3b78101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:09.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/1137535884 shutdown_connections 2024-09-21T07:19:09.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:09.279+0000 7f3b7c9e1640 1 -- 172.21.15.92:0/1137535884 wait complete. 2024-09-21T07:19:10.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:09 smithi092 ceph-mon[30987]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:19:10.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:09 smithi169 ceph-mon[33705]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:19:10.156 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:19:10.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:09 smithi175 ceph-mon[34064]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:19:10.403 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:11.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.014+0000 7fc758baf640 1 -- 172.21.15.92:0/3100107101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc754108f60 msgr2=0x7fc75410f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.014+0000 7fc758baf640 1 --2- 172.21.15.92:0/3100107101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc754108f60 0x7fc75410f790 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009ca0 tx=0x7fc74c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.015+0000 7fc758baf640 1 -- 172.21.15.92:0/3100107101 shutdown_connections 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.015+0000 7fc758baf640 1 --2- 172.21.15.92:0/3100107101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc754108f60 0x7fc75410f790 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.015+0000 7fc758baf640 1 --2- 172.21.15.92:0/3100107101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc754108610 0x7fc754108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.015+0000 7fc758baf640 1 --2- 172.21.15.92:0/3100107101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7541031d0 0x7fc7541035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.015+0000 7fc758baf640 1 -- 172.21.15.92:0/3100107101 >> 172.21.15.92:0/3100107101 conn(0x7fc754079e40 msgr2=0x7fc75407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.015+0000 7fc758baf640 1 -- 172.21.15.92:0/3100107101 shutdown_connections 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.015+0000 7fc758baf640 1 -- 172.21.15.92:0/3100107101 wait complete. 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.015+0000 7fc758baf640 1 Processor -- start 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.015+0000 7fc758baf640 1 -- start start 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc758baf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7541031d0 0x7fc75419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc758baf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc754108610 0x7fc75419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc758baf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc754108f60 0x7fc7541a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc758baf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc754112b20 con 0x7fc754108f60 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc758baf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7541129a0 con 0x7fc7541031d0 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc758baf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc754112ca0 con 0x7fc754108610 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc752d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc754108f60 0x7fc7541a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc752d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc754108f60 0x7fc7541a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41676/0 (socket says 172.21.15.92:41676) 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc752d9d640 1 -- 172.21.15.92:0/669458502 learned_addr learned my addr 172.21.15.92:0/669458502 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc75259c640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7541031d0 0x7fc75419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc74bfff640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc754108610 0x7fc75419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc752d9d640 1 -- 172.21.15.92:0/669458502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc754108610 msgr2=0x7fc75419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc752d9d640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc754108610 0x7fc75419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc752d9d640 1 -- 172.21.15.92:0/669458502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7541031d0 msgr2=0x7fc75419c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc752d9d640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7541031d0 0x7fc75419c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc752d9d640 1 -- 172.21.15.92:0/669458502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7541a26d0 con 0x7fc754108f60 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.016+0000 7fc752d9d640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc754108f60 0x7fc7541a1fa0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc74c005cc0 tx=0x7fc74c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:11.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.017+0000 7fc74b7fe640 1 -- 172.21.15.92:0/669458502 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c032c10 con 0x7fc754108f60 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.017+0000 7fc74b7fe640 1 -- 172.21.15.92:0/669458502 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc74c032db0 con 0x7fc754108f60 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.017+0000 7fc758baf640 1 -- 172.21.15.92:0/669458502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7541a2960 con 0x7fc754108f60 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.017+0000 7fc74b7fe640 1 -- 172.21.15.92:0/669458502 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c030a60 con 0x7fc754108f60 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.017+0000 7fc758baf640 1 -- 172.21.15.92:0/669458502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7541a9120 con 0x7fc754108f60 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.019+0000 7fc75f123740 1 Processor -- start 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.019+0000 7fc74b7fe640 1 -- 172.21.15.92:0/669458502 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fc74c030c00 con 0x7fc754108f60 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75f123740 1 -- start start 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75f123740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78da070 0x55c9a7c812c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75f123740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78b11b0 0x55c9a7c81800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75f123740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78b9390 0x55c9a7c81d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75f123740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c9a7bf7ea0 con 0x55c9a78b11b0 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75f123740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c9a7be72d0 con 0x55c9a78da070 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75f123740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c9a7beb0e0 con 0x55c9a78b9390 2024-09-21T07:19:11.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78b11b0 0x55c9a7c81800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78b11b0 0x55c9a7c81800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41684/0 (socket says 172.21.15.92:41684) 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75259c640 1 -- 172.21.15.92:0/1134665546 learned_addr learned my addr 172.21.15.92:0/1134665546 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc74bfff640 1 --2- 172.21.15.92:0/1134665546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78da070 0x55c9a7c812c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc74bfff640 1 --2- 172.21.15.92:0/1134665546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78b9390 0x55c9a7c81d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75259c640 1 -- 172.21.15.92:0/1134665546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78b9390 msgr2=0x55c9a7c81d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75259c640 1 --2- 172.21.15.92:0/1134665546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78b9390 0x55c9a7c81d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75259c640 1 -- 172.21.15.92:0/1134665546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78da070 msgr2=0x55c9a7c812c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75259c640 1 --2- 172.21.15.92:0/1134665546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78da070 0x55c9a7c812c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc75259c640 1 -- 172.21.15.92:0/1134665546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9a7945650 con 0x55c9a78b11b0 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.020+0000 7fc74bfff640 1 --2- 172.21.15.92:0/1134665546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78da070 0x55c9a7c812c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.021+0000 7fc75259c640 1 --2- 172.21.15.92:0/1134665546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78b11b0 0x55c9a7c81800 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc744009cf0 tx=0x7fc744011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ba684e5f42bc98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.021+0000 7fc74b7fe640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7400b6680 0x7fc7400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.021+0000 7fc74bfff640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7400b6680 0x7fc7400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.021+0000 7fc748ff9640 1 -- 172.21.15.92:0/1134665546 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744004230 con 0x55c9a78b11b0 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.021+0000 7fc748ff9640 1 -- 172.21.15.92:0/1134665546 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7440043d0 con 0x55c9a78b11b0 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.021+0000 7fc748ff9640 1 -- 172.21.15.92:0/1134665546 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744019750 con 0x55c9a78b11b0 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.021+0000 7fc74b7fe640 1 -- 172.21.15.92:0/669458502 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc74c108b40 con 0x7fc754108f60 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 -- 172.21.15.92:0/1134665546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78b11b0 msgr2=0x55c9a7c81800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc74bfff640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7400b6680 0x7fc7400b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc754102e00 tx=0x7fc73c004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 --2- 172.21.15.92:0/1134665546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78b11b0 0x55c9a7c81800 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc744009cf0 tx=0x7fc744011810 comp rx=0 tx=0).stop 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 -- 172.21.15.92:0/1134665546 shutdown_connections 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 --2- 172.21.15.92:0/1134665546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78b9390 0x55c9a7c81d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 --2- 172.21.15.92:0/1134665546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78b11b0 0x55c9a7c81800 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 --2- 172.21.15.92:0/1134665546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78da070 0x55c9a7c812c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 -- 172.21.15.92:0/1134665546 >> 172.21.15.92:0/1134665546 conn(0x55c9a78ce460 msgr2=0x55c9a7c7f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 -- 172.21.15.92:0/1134665546 shutdown_connections 2024-09-21T07:19:11.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 -- 172.21.15.92:0/1134665546 wait complete. 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 -- start start 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.022+0000 7fc75f123740 1 Processor -- start 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc75f123740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7c8ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc75f123740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78da070 0x55c9a7c8cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc75f123740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c98df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc75f123740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c9a7a48700 con 0x55c9a78da070 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc75f123740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c9a7b82160 con 0x55c9a78b9390 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc75f123740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c9a7c8faa0 con 0x55c9a78989f0 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc75f123740 10 client.0 _ll_register_callbacks cb 0x55c9a7b9b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc74bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78da070 0x55c9a7c8cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc74bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78da070 0x55c9a7c8cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41700/0 (socket says 172.21.15.92:41700) 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc74bfff640 1 -- 172.21.15.92:0/3631194457 learned_addr learned my addr 172.21.15.92:0/3631194457 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc75259c640 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7c8ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc752d9d640 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c98df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc74bfff640 1 -- 172.21.15.92:0/3631194457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 msgr2=0x55c9a7c98df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc74bfff640 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c98df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc74bfff640 1 -- 172.21.15.92:0/3631194457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 msgr2=0x55c9a7c8ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc74bfff640 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7c8ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc74bfff640 1 -- 172.21.15.92:0/3631194457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9a7bafc90 con 0x55c9a78da070 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.023+0000 7fc752d9d640 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c98df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc74bfff640 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78da070 0x55c9a7c8cf40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009a60 tx=0x7fc73c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b29ca76fcb02b62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc739ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc739ffb640 1 -- 172.21.15.92:0/3631194457 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00fb40 con 0x55c9a78da070 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc739ffb640 1 -- 172.21.15.92:0/3631194457 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc73c00fce0 con 0x55c9a78da070 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc75f123740 1 -- 172.21.15.92:0/3631194457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7440043d0 con 0x55c9a78da070 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc739ffb640 1 -- 172.21.15.92:0/3631194457 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc73c031050 con 0x55c9a78da070 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc75f123740 10 client.17385 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:11.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc75f123740 1 -- 172.21.15.92:0/3631194457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c9a7c9b8d0 con 0x55c9a78da070 2024-09-21T07:19:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc739ffb640 1 -- 172.21.15.92:0/3631194457 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7440043d0 con 0x55c9a78da070 2024-09-21T07:19:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc739ffb640 1 -- 172.21.15.92:0/3631194457 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc73c029400 con 0x55c9a78da070 2024-09-21T07:19:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc75f123740 10 client.17385 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc75f123740 10 client.17385 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:19:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc75f123740 20 client.17385 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc75f123740 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55c9a786dda0 0x55c9a7c9ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc75f123740 4 client.17385 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.024+0000 7fc75f123740 1 -- 172.21.15.92:0/3631194457 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9a7bf9df0 con 0x55c9a786dda0 2024-09-21T07:19:11.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.025+0000 7fc75259c640 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55c9a786dda0 0x55c9a7c9ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.025+0000 7fc739ffb640 10 client.17385 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:19:11.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.025+0000 7fc75259c640 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55c9a786dda0 0x55c9a7c9ef10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39954f580cc3b5cd server_cookie=45a6a8836a694e8e in_seq=0 out_seq=0 2024-09-21T07:19:11.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc739ffb640 1 -- 172.21.15.92:0/3631194457 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c9a7bf9df0 con 0x55c9a786dda0 2024-09-21T07:19:11.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc739ffb640 10 client.17385 handle_command_reply: tid=0 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 client.17385 shutdown 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 -- 172.21.15.92:0/3631194457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78da070 msgr2=0x55c9a7c8cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78da070 0x55c9a7c8cf40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009a60 tx=0x7fc73c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 -- 172.21.15.92:0/3631194457 shutdown_connections 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55c9a786dda0 0x55c9a7c9ef10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc739ffb640 0 client.17385 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c98df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a78da070 0x55c9a7c8cf40 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 --2- 172.21.15.92:0/3631194457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7c8ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 -- 172.21.15.92:0/3631194457 >> 172.21.15.92:0/3631194457 conn(0x55c9a78ce460 msgr2=0x55c9a7c84450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 -- 172.21.15.92:0/3631194457 shutdown_connections 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.026+0000 7fc75f123740 1 -- 172.21.15.92:0/3631194457 wait complete. 2024-09-21T07:19:11.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.027+0000 7fc75f123740 20 client.17385 trim_cache size 0 max 16384 2024-09-21T07:19:11.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.039+0000 7fc75f123740 1 Processor -- start 2024-09-21T07:19:11.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.039+0000 7fc75f123740 1 -- start start 2024-09-21T07:19:11.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75f123740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c84ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75f123740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c98cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75f123740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7c99230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75f123740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc7541b2fa0 con 0x55c9a786dda0 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75f123740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7541b4ae0 con 0x55c9a78b9390 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75f123740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7541b3670 con 0x55c9a78989f0 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c84ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c84ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41706/0 (socket says 172.21.15.92:41706) 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75259c640 1 -- 172.21.15.92:0/1314007544 learned_addr learned my addr 172.21.15.92:0/1314007544 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc752d9d640 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7c99230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc74bfff640 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c98cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75259c640 1 -- 172.21.15.92:0/1314007544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 msgr2=0x55c9a7c98cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75259c640 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c98cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75259c640 1 -- 172.21.15.92:0/1314007544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 msgr2=0x55c9a7c99230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75259c640 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7c99230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75259c640 1 -- 172.21.15.92:0/1314007544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9a7c87610 con 0x55c9a786dda0 2024-09-21T07:19:11.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc74bfff640 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c98cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc752d9d640 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7c99230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc75259c640 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c84ad0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc744001eb0 tx=0x7fc744000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a336398deecdb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc73bfff640 1 -- 172.21.15.92:0/1314007544 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7440035f0 con 0x55c9a786dda0 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.040+0000 7fc73bfff640 1 -- 172.21.15.92:0/1314007544 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc744005040 con 0x55c9a786dda0 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.041+0000 7fc73bfff640 1 -- 172.21.15.92:0/1314007544 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744025420 con 0x55c9a786dda0 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.041+0000 7fc75f123740 1 -- 172.21.15.92:0/1314007544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 msgr2=0x55c9a7c84ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.041+0000 7fc75f123740 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c84ad0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc744001eb0 tx=0x7fc744000bc0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.041+0000 7fc75f123740 1 -- 172.21.15.92:0/1314007544 shutdown_connections 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.041+0000 7fc75f123740 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7c99230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.041+0000 7fc75f123740 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c98cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.041+0000 7fc75f123740 1 --2- 172.21.15.92:0/1314007544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c84ad0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.041+0000 7fc75f123740 1 -- 172.21.15.92:0/1314007544 >> 172.21.15.92:0/1314007544 conn(0x55c9a78ce460 msgr2=0x55c9a7c843c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.041+0000 7fc75f123740 1 -- 172.21.15.92:0/1314007544 shutdown_connections 2024-09-21T07:19:11.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.041+0000 7fc75f123740 1 -- 172.21.15.92:0/1314007544 wait complete. 2024-09-21T07:19:11.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75f123740 1 -- start start 2024-09-21T07:19:11.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75f123740 1 Processor -- start 2024-09-21T07:19:11.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75f123740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c90fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75f123740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c91520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75f123740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7d088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75f123740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc7541b4410 con 0x55c9a786dda0 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75f123740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7541b3d40 con 0x55c9a78b9390 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75f123740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7541b0f80 con 0x55c9a78989f0 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75f123740 10 client.0 _ll_register_callbacks cb 0x7fc73c005d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c90fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c90fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41720/0 (socket says 172.21.15.92:41720) 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75259c640 1 -- 172.21.15.92:0/1778020069 learned_addr learned my addr 172.21.15.92:0/1778020069 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc752d9d640 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7d088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75259c640 1 -- 172.21.15.92:0/1778020069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 msgr2=0x55c9a7c91520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75259c640 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c91520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75259c640 1 -- 172.21.15.92:0/1778020069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 msgr2=0x55c9a7d088d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75259c640 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7d088d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc75259c640 1 -- 172.21.15.92:0/1778020069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9a7c91dc0 con 0x55c9a786dda0 2024-09-21T07:19:11.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.042+0000 7fc752d9d640 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7d088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc75259c640 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c90fe0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc74402f040 tx=0x7fc7440096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03ad2ed8af3431c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc739ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc739ffb640 1 -- 172.21.15.92:0/1778020069 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7440051f0 con 0x55c9a786dda0 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc739ffb640 1 -- 172.21.15.92:0/1778020069 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fc74402b040 con 0x55c9a786dda0 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc75f123740 1 -- 172.21.15.92:0/1778020069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc744005040 con 0x55c9a786dda0 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc739ffb640 1 -- 172.21.15.92:0/1778020069 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc744044050 con 0x55c9a786dda0 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc75f123740 10 client.17391 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc75f123740 1 -- 172.21.15.92:0/1778020069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c9a7d09d70 con 0x55c9a786dda0 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc739ffb640 1 -- 172.21.15.92:0/1778020069 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc744005040 con 0x55c9a786dda0 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc739ffb640 1 -- 172.21.15.92:0/1778020069 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc74403f030 con 0x55c9a786dda0 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc75f123740 10 client.17391 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc75f123740 10 client.17391 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:19:11.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc75f123740 20 client.17391 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc75f123740 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55c9a78da070 0x55c9a7d0c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc75f123740 4 client.17391 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.043+0000 7fc75f123740 1 -- 172.21.15.92:0/1778020069 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c9a7bf58a0 con 0x55c9a78da070 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.044+0000 7fc74bfff640 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55c9a78da070 0x55c9a7d0c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.044+0000 7fc74bfff640 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55c9a78da070 0x55c9a7d0c330 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2f17d2f2ce0f782 server_cookie=7f8dfbdd06eef19d in_seq=0 out_seq=0 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.044+0000 7fc739ffb640 10 client.17391 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.044+0000 7fc739ffb640 1 -- 172.21.15.92:0/1778020069 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c9a7bf58a0 con 0x55c9a78da070 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.044+0000 7fc739ffb640 10 client.17391 handle_command_reply: tid=0 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.044+0000 7fc75f123740 1 client.17391 shutdown 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.044+0000 7fc75f123740 1 -- 172.21.15.92:0/1778020069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 msgr2=0x55c9a7c90fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.044+0000 7fc75f123740 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c90fe0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc74402f040 tx=0x7fc7440096d0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc75f123740 1 -- 172.21.15.92:0/1778020069 shutdown_connections 2024-09-21T07:19:11.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc75f123740 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55c9a78da070 0x55c9a7d0c330 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc75f123740 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9a78b9390 0x55c9a7d088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc75f123740 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9a78989f0 0x55c9a7c91520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc75f123740 1 --2- 172.21.15.92:0/1778020069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c9a786dda0 0x55c9a7c90fe0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc75f123740 1 -- 172.21.15.92:0/1778020069 >> 172.21.15.92:0/1778020069 conn(0x55c9a78ce460 msgr2=0x55c9a7c7eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:11.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc739ffb640 0 client.17391 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:19:11.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc75f123740 1 -- 172.21.15.92:0/1778020069 shutdown_connections 2024-09-21T07:19:11.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc75f123740 1 -- 172.21.15.92:0/1778020069 wait complete. 2024-09-21T07:19:11.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc75f123740 20 client.17391 trim_cache size 0 max 16384 2024-09-21T07:19:11.052 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:19:11.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 -- 172.21.15.92:0/669458502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7400b6680 msgr2=0x7fc7400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:11.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7400b6680 0x7fc7400b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc754102e00 tx=0x7fc73c004730 comp rx=0 tx=0).stop 2024-09-21T07:19:11.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 -- 172.21.15.92:0/669458502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc754108f60 msgr2=0x7fc7541a1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:11.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc754108f60 0x7fc7541a1fa0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc74c005cc0 tx=0x7fc74c003f90 comp rx=0 tx=0).stop 2024-09-21T07:19:11.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 -- 172.21.15.92:0/669458502 shutdown_connections 2024-09-21T07:19:11.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc7400b6680 0x7fc7400b8b90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc754108f60 0x7fc7541a1fa0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc754108610 0x7fc75419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 --2- 172.21.15.92:0/669458502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7541031d0 0x7fc75419c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:11.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 -- 172.21.15.92:0/669458502 >> 172.21.15.92:0/669458502 conn(0x7fc754079e40 msgr2=0x7fc7541064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:11.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.045+0000 7fc758baf640 1 -- 172.21.15.92:0/669458502 shutdown_connections 2024-09-21T07:19:11.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:11.046+0000 7fc758baf640 1 -- 172.21.15.92:0/669458502 wait complete. 2024-09-21T07:19:11.935 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:19:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:11 smithi092 ceph-mon[30987]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T07:19:12.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:11 smithi169 ceph-mon[33705]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T07:19:12.181 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:12.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:11 smithi175 ceph-mon[34064]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.691+0000 7ff5738f2640 1 -- 172.21.15.92:0/1872063434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff56c102a70 msgr2=0x7ff56c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.691+0000 7ff5738f2640 1 --2- 172.21.15.92:0/1872063434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff56c102a70 0x7ff56c102e80 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009ca0 tx=0x7ff55c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.691+0000 7ff5738f2640 1 -- 172.21.15.92:0/1872063434 shutdown_connections 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.691+0000 7ff5738f2640 1 --2- 172.21.15.92:0/1872063434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c108d00 0x7ff56c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.691+0000 7ff5738f2640 1 --2- 172.21.15.92:0/1872063434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff56c1083b0 0x7ff56c1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.691+0000 7ff5738f2640 1 --2- 172.21.15.92:0/1872063434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff56c102a70 0x7ff56c102e80 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.691+0000 7ff5738f2640 1 -- 172.21.15.92:0/1872063434 >> 172.21.15.92:0/1872063434 conn(0x7ff56c079710 msgr2=0x7ff56c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.691+0000 7ff5738f2640 1 -- 172.21.15.92:0/1872063434 shutdown_connections 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.691+0000 7ff5738f2640 1 -- 172.21.15.92:0/1872063434 wait complete. 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff5738f2640 1 Processor -- start 2024-09-21T07:19:12.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff5738f2640 1 -- start start 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff5738f2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff56c102a70 0x7ff56c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff5738f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c1083b0 0x7ff56c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff5738f2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff56c108d00 0x7ff56c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff5738f2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c1128e0 con 0x7ff56c102a70 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff5738f2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c112760 con 0x7ff56c108d00 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff5738f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c112a60 con 0x7ff56c1083b0 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff57168e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff56c102a70 0x7ff56c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff57168e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff56c102a70 0x7ff56c1992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41748/0 (socket says 172.21.15.92:41748) 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff57168e640 1 -- 172.21.15.92:0/3567092972 learned_addr learned my addr 172.21.15.92:0/3567092972 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.692+0000 7ff570e8d640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c1083b0 0x7ff56c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff571e8f640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff56c108d00 0x7ff56c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff57168e640 1 -- 172.21.15.92:0/3567092972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c1083b0 msgr2=0x7ff56c199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff57168e640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c1083b0 0x7ff56c199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff57168e640 1 -- 172.21.15.92:0/3567092972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff56c108d00 msgr2=0x7ff56c19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff57168e640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff56c108d00 0x7ff56c19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff57168e640 1 -- 172.21.15.92:0/3567092972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c19f240 con 0x7ff56c102a70 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff57168e640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff56c102a70 0x7ff56c1992d0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009dc0 tx=0x7ff55c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff56a7fc640 1 -- 172.21.15.92:0/3567092972 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c004040 con 0x7ff56c102a70 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff56a7fc640 1 -- 172.21.15.92:0/3567092972 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff55c004670 con 0x7ff56c102a70 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff5738f2640 1 -- 172.21.15.92:0/3567092972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56c19f4d0 con 0x7ff56c102a70 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff56a7fc640 1 -- 172.21.15.92:0/3567092972 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c030c80 con 0x7ff56c102a70 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.693+0000 7ff5738f2640 1 -- 172.21.15.92:0/3567092972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56c1a5c90 con 0x7ff56c102a70 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff579e66740 1 Processor -- start 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff579e66740 1 -- start start 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff56a7fc640 1 -- 172.21.15.92:0/3567092972 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7ff55c0041e0 con 0x7ff56c102a70 2024-09-21T07:19:12.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff579e66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 0x555b9d3f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff579e66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d0291b0 0x555b9d3f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff579e66740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d031390 0x555b9d3fa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff579e66740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555b9d36fea0 con 0x555b9d031390 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff579e66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555b9d35f2d0 con 0x555b9d052070 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff579e66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555b9d3630e0 con 0x555b9d0291b0 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff570e8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d031390 0x555b9d3fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff570e8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d031390 0x555b9d3fa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41750/0 (socket says 172.21.15.92:41750) 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff570e8d640 1 -- 172.21.15.92:0/415227866 learned_addr learned my addr 172.21.15.92:0/415227866 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff57168e640 1 --2- 172.21.15.92:0/415227866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d0291b0 0x555b9d3f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.696+0000 7ff571e8f640 1 --2- 172.21.15.92:0/415227866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 0x555b9d3f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff570e8d640 1 -- 172.21.15.92:0/415227866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d0291b0 msgr2=0x555b9d3f9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff570e8d640 1 --2- 172.21.15.92:0/415227866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d0291b0 0x555b9d3f9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff570e8d640 1 -- 172.21.15.92:0/415227866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 msgr2=0x555b9d3f96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff570e8d640 1 --2- 172.21.15.92:0/415227866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 0x555b9d3f96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff570e8d640 1 -- 172.21.15.92:0/415227866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b9d0bd650 con 0x555b9d031390 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff56a7fc640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5540b6680 0x7ff5540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff570e8d640 1 --2- 172.21.15.92:0/415227866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d031390 0x555b9d3fa120 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7ff56000cb40 tx=0x7ff56000e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f6a5419be00567 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff571e8f640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5540b6680 0x7ff5540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff56a7fc640 1 -- 172.21.15.92:0/3567092972 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff55c108df0 con 0x7ff56c102a70 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff5537fe640 1 -- 172.21.15.92:0/415227866 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560004020 con 0x555b9d031390 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff5537fe640 1 -- 172.21.15.92:0/415227866 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5600041c0 con 0x555b9d031390 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.697+0000 7ff5537fe640 1 -- 172.21.15.92:0/415227866 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560010690 con 0x555b9d031390 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.698+0000 7ff579e66740 1 -- 172.21.15.92:0/415227866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d031390 msgr2=0x555b9d3fa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.698+0000 7ff571e8f640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5540b6680 0x7ff5540b8b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff56400bca0 tx=0x7ff56400b450 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.698+0000 7ff579e66740 1 --2- 172.21.15.92:0/415227866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d031390 0x555b9d3fa120 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7ff56000cb40 tx=0x7ff56000e350 comp rx=0 tx=0).stop 2024-09-21T07:19:12.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.698+0000 7ff579e66740 1 -- 172.21.15.92:0/415227866 shutdown_connections 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.698+0000 7ff579e66740 1 --2- 172.21.15.92:0/415227866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d031390 0x555b9d3fa120 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.698+0000 7ff579e66740 1 --2- 172.21.15.92:0/415227866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d0291b0 0x555b9d3f9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.698+0000 7ff579e66740 1 --2- 172.21.15.92:0/415227866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 0x555b9d3f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.698+0000 7ff579e66740 1 -- 172.21.15.92:0/415227866 >> 172.21.15.92:0/415227866 conn(0x555b9d046460 msgr2=0x555b9d3f7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.698+0000 7ff579e66740 1 -- 172.21.15.92:0/415227866 shutdown_connections 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.698+0000 7ff579e66740 1 -- 172.21.15.92:0/415227866 wait complete. 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff579e66740 1 -- start start 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff579e66740 1 Processor -- start 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff579e66740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d0291b0 0x555b9d406e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff579e66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d4073c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff579e66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 0x555b9d407900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff579e66740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555b9d1c0700 con 0x555b9d0291b0 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff579e66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555b9d2fa160 con 0x555b9d052070 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff579e66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555b9d409fe0 con 0x555b9d031390 2024-09-21T07:19:12.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff579e66740 10 client.0 _ll_register_callbacks cb 0x555b9d3139e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff57168e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d0291b0 0x555b9d406e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff57168e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d0291b0 0x555b9d406e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41752/0 (socket says 172.21.15.92:41752) 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff57168e640 1 -- 172.21.15.92:0/440085493 learned_addr learned my addr 172.21.15.92:0/440085493 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.699+0000 7ff570e8d640 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d4073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff57168e640 1 -- 172.21.15.92:0/440085493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 msgr2=0x555b9d4073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff57168e640 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d4073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff57168e640 1 -- 172.21.15.92:0/440085493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 msgr2=0x555b9d407900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff571e8f640 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 0x555b9d407900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff57168e640 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 0x555b9d407900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff57168e640 1 -- 172.21.15.92:0/440085493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b9d327c90 con 0x555b9d0291b0 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff570e8d640 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d4073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff571e8f640 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 0x555b9d407900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff57168e640 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d0291b0 0x555b9d406e80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff55c006010 tx=0x7ff55c10c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f152060ebadb2a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff550ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:12.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff550ff9640 1 -- 172.21.15.92:0/440085493 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0caef0 con 0x555b9d0291b0 2024-09-21T07:19:12.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff550ff9640 1 -- 172.21.15.92:0/440085493 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff55c0d8030 con 0x555b9d0291b0 2024-09-21T07:19:12.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff579e66740 1 -- 172.21.15.92:0/440085493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5600041c0 con 0x555b9d0291b0 2024-09-21T07:19:12.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff550ff9640 1 -- 172.21.15.92:0/440085493 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff55c0044d0 con 0x555b9d0291b0 2024-09-21T07:19:12.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff579e66740 10 client.17403 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:12.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff579e66740 1 -- 172.21.15.92:0/440085493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555b9d415c50 con 0x555b9d0291b0 2024-09-21T07:19:12.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.700+0000 7ff550ff9640 1 -- 172.21.15.92:0/440085493 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5600041c0 con 0x555b9d0291b0 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.701+0000 7ff550ff9640 1 -- 172.21.15.92:0/440085493 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff55c0cfbd0 con 0x555b9d0291b0 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.701+0000 7ff579e66740 10 client.17403 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.701+0000 7ff579e66740 10 client.17403 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.701+0000 7ff579e66740 20 client.17403 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.701+0000 7ff579e66740 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555b9d0109f0 0x555b9d419150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.701+0000 7ff579e66740 4 client.17403 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.701+0000 7ff579e66740 1 -- 172.21.15.92:0/440085493 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b9d371df0 con 0x555b9d0109f0 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.701+0000 7ff570e8d640 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555b9d0109f0 0x555b9d419150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.701+0000 7ff550ff9640 10 client.17403 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.701+0000 7ff570e8d640 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555b9d0109f0 0x555b9d419150 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b704217c0467545 server_cookie=ff41c89172aa4686 in_seq=0 out_seq=0 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff550ff9640 1 -- 172.21.15.92:0/440085493 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b9d371df0 con 0x555b9d0109f0 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff550ff9640 10 client.17403 handle_command_reply: tid=0 2024-09-21T07:19:12.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff579e66740 1 client.17403 shutdown 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff579e66740 1 -- 172.21.15.92:0/440085493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d0291b0 msgr2=0x555b9d406e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff579e66740 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d0291b0 0x555b9d406e80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff55c006010 tx=0x7ff55c10c530 comp rx=0 tx=0).stop 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff579e66740 1 -- 172.21.15.92:0/440085493 shutdown_connections 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff579e66740 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555b9d0109f0 0x555b9d419150 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff579e66740 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d052070 0x555b9d407900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff579e66740 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d4073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff550ff9640 0 client.17403 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff579e66740 1 --2- 172.21.15.92:0/440085493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d0291b0 0x555b9d406e80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.702+0000 7ff579e66740 1 -- 172.21.15.92:0/440085493 >> 172.21.15.92:0/440085493 conn(0x555b9d046460 msgr2=0x555b9d3fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.703+0000 7ff579e66740 1 -- 172.21.15.92:0/440085493 shutdown_connections 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.703+0000 7ff579e66740 1 -- 172.21.15.92:0/440085493 wait complete. 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.703+0000 7ff579e66740 20 client.17403 trim_cache size 0 max 16384 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.716+0000 7ff579e66740 1 Processor -- start 2024-09-21T07:19:12.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.716+0000 7ff579e66740 1 -- start start 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.716+0000 7ff579e66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d0291b0 0x555b9d408d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.716+0000 7ff579e66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d3fade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.716+0000 7ff579e66740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d404070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.716+0000 7ff579e66740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c1aeb80 con 0x555b9d052070 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff579e66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c1b06c0 con 0x555b9d0291b0 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff579e66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c1af250 con 0x555b9d031390 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff571e8f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d404070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff571e8f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d404070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41756/0 (socket says 172.21.15.92:41756) 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff571e8f640 1 -- 172.21.15.92:0/473336311 learned_addr learned my addr 172.21.15.92:0/473336311 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff57168e640 1 --2- 172.21.15.92:0/473336311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d0291b0 0x555b9d408d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff570e8d640 1 --2- 172.21.15.92:0/473336311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d3fade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff571e8f640 1 -- 172.21.15.92:0/473336311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 msgr2=0x555b9d3fade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:12.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff571e8f640 1 --2- 172.21.15.92:0/473336311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d3fade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff571e8f640 1 -- 172.21.15.92:0/473336311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d0291b0 msgr2=0x555b9d408d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:12.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff571e8f640 1 --2- 172.21.15.92:0/473336311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d0291b0 0x555b9d408d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff571e8f640 1 -- 172.21.15.92:0/473336311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b9d405380 con 0x555b9d052070 2024-09-21T07:19:12.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff570e8d640 1 --2- 172.21.15.92:0/473336311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d3fade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:12.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff571e8f640 1 --2- 172.21.15.92:0/473336311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d404070 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff564005cc0 tx=0x7ff564015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a209b4fdce6ebd2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:12.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.717+0000 7ff552ffd640 1 -- 172.21.15.92:0/473336311 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56402b070 con 0x555b9d052070 2024-09-21T07:19:12.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.718+0000 7ff552ffd640 1 -- 172.21.15.92:0/473336311 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff56401cab0 con 0x555b9d052070 2024-09-21T07:19:12.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.718+0000 7ff552ffd640 1 -- 172.21.15.92:0/473336311 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564026b50 con 0x555b9d052070 2024-09-21T07:19:12.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.718+0000 7ff579e66740 1 -- 172.21.15.92:0/473336311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 msgr2=0x555b9d404070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:12.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.718+0000 7ff579e66740 1 --2- 172.21.15.92:0/473336311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d404070 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff564005cc0 tx=0x7ff564015000 comp rx=0 tx=0).stop 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.718+0000 7ff579e66740 1 -- 172.21.15.92:0/473336311 shutdown_connections 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.718+0000 7ff579e66740 1 --2- 172.21.15.92:0/473336311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d404070 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.718+0000 7ff579e66740 1 --2- 172.21.15.92:0/473336311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d3fade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.718+0000 7ff579e66740 1 --2- 172.21.15.92:0/473336311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d0291b0 0x555b9d408d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.718+0000 7ff579e66740 1 -- 172.21.15.92:0/473336311 >> 172.21.15.92:0/473336311 conn(0x555b9d046460 msgr2=0x555b9d3fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.719+0000 7ff579e66740 1 -- 172.21.15.92:0/473336311 shutdown_connections 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.719+0000 7ff579e66740 1 -- 172.21.15.92:0/473336311 wait complete. 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.719+0000 7ff579e66740 1 -- start start 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.719+0000 7ff579e66740 1 Processor -- start 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.719+0000 7ff579e66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d0291b0 0x555b9d40b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.719+0000 7ff579e66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d40ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.719+0000 7ff579e66740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d40bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff579e66740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c1afff0 con 0x555b9d052070 2024-09-21T07:19:12.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff579e66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c1af920 con 0x555b9d0291b0 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff579e66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c1acb60 con 0x555b9d031390 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff579e66740 10 client.0 _ll_register_callbacks cb 0x7ff55c10c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff571e8f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d40bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff571e8f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d40bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41768/0 (socket says 172.21.15.92:41768) 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff571e8f640 1 -- 172.21.15.92:0/527357835 learned_addr learned my addr 172.21.15.92:0/527357835 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff570e8d640 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d40ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff57168e640 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d0291b0 0x555b9d40b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff571e8f640 1 -- 172.21.15.92:0/527357835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 msgr2=0x555b9d40ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff571e8f640 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d40ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff571e8f640 1 -- 172.21.15.92:0/527357835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d0291b0 msgr2=0x555b9d40b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff571e8f640 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d0291b0 0x555b9d40b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff571e8f640 1 -- 172.21.15.92:0/527357835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b9d482ce0 con 0x555b9d052070 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff571e8f640 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d40bf50 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff564013fd0 tx=0x7ff56401cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2aa1f96935adfa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:12.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff550ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff550ff9640 1 -- 172.21.15.92:0/527357835 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564033070 con 0x555b9d052070 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff550ff9640 1 -- 172.21.15.92:0/527357835 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff56401c7e0 con 0x555b9d052070 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff579e66740 1 -- 172.21.15.92:0/527357835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff56401cab0 con 0x555b9d052070 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff550ff9640 1 -- 172.21.15.92:0/527357835 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff56403f050 con 0x555b9d052070 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.720+0000 7ff579e66740 10 client.17409 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.721+0000 7ff579e66740 1 -- 172.21.15.92:0/527357835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555b9d483f60 con 0x555b9d052070 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.721+0000 7ff550ff9640 1 -- 172.21.15.92:0/527357835 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff56401cab0 con 0x555b9d052070 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.721+0000 7ff550ff9640 1 -- 172.21.15.92:0/527357835 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff56402e050 con 0x555b9d052070 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.721+0000 7ff579e66740 10 client.17409 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.721+0000 7ff579e66740 10 client.17409 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.721+0000 7ff579e66740 20 client.17409 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.721+0000 7ff579e66740 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555b9cfe5da0 0x555b9d486610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.721+0000 7ff579e66740 4 client.17409 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.721+0000 7ff579e66740 1 -- 172.21.15.92:0/527357835 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b9d36d8a0 con 0x555b9cfe5da0 2024-09-21T07:19:12.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.721+0000 7ff57168e640 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555b9cfe5da0 0x555b9d486610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff550ff9640 10 client.17409 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff57168e640 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555b9cfe5da0 0x555b9d486610 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4aafe51a1915dab9 server_cookie=9dba2c37dc73dd85 in_seq=0 out_seq=0 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff550ff9640 1 -- 172.21.15.92:0/527357835 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b9d36d8a0 con 0x555b9cfe5da0 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff550ff9640 10 client.17409 handle_command_reply: tid=0 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 client.17409 shutdown 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 -- 172.21.15.92:0/527357835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 msgr2=0x555b9d40bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d40bf50 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff564013fd0 tx=0x7ff56401cf10 comp rx=0 tx=0).stop 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 -- 172.21.15.92:0/527357835 shutdown_connections 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555b9cfe5da0 0x555b9d486610 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff550ff9640 0 client.17409 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b9d052070 0x555b9d40bf50 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b9d031390 0x555b9d40ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 --2- 172.21.15.92:0/527357835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b9d0291b0 0x555b9d40b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 -- 172.21.15.92:0/527357835 >> 172.21.15.92:0/527357835 conn(0x555b9d046460 msgr2=0x555b9d408b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:12.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 -- 172.21.15.92:0/527357835 shutdown_connections 2024-09-21T07:19:12.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 1 -- 172.21.15.92:0/527357835 wait complete. 2024-09-21T07:19:12.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.722+0000 7ff579e66740 20 client.17409 trim_cache size 0 max 16384 2024-09-21T07:19:12.731 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 -- 172.21.15.92:0/3567092972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5540b6680 msgr2=0x7ff5540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5540b6680 0x7ff5540b8b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff56400bca0 tx=0x7ff56400b450 comp rx=0 tx=0).stop 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 -- 172.21.15.92:0/3567092972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff56c102a70 msgr2=0x7ff56c1992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff56c102a70 0x7ff56c1992d0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009dc0 tx=0x7ff55c032bc0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 -- 172.21.15.92:0/3567092972 shutdown_connections 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5540b6680 0x7ff5540b8b90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff56c108d00 0x7ff56c19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c1083b0 0x7ff56c199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 --2- 172.21.15.92:0/3567092972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff56c102a70 0x7ff56c1992d0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 -- 172.21.15.92:0/3567092972 >> 172.21.15.92:0/3567092972 conn(0x7ff56c079710 msgr2=0x7ff56c1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 -- 172.21.15.92:0/3567092972 shutdown_connections 2024-09-21T07:19:12.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:12.723+0000 7ff5738f2640 1 -- 172.21.15.92:0/3567092972 wait complete. 2024-09-21T07:19:13.545 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:19:13.791 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:14.123 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:13 smithi092 ceph-mon[30987]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:19:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:13 smithi169 ceph-mon[33705]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:19:14.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:13 smithi175 ceph-mon[34064]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:19:14.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.286+0000 7f9322052640 1 -- 172.21.15.92:0/1307743099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c102a80 msgr2=0x7f931c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:14.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.286+0000 7f9322052640 1 --2- 172.21.15.92:0/1307743099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c102a80 0x7f931c102e90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f930c009900 tx=0x7f930c02a410 comp rx=0 tx=0).stop 2024-09-21T07:19:14.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.286+0000 7f9322052640 1 -- 172.21.15.92:0/1307743099 shutdown_connections 2024-09-21T07:19:14.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.286+0000 7f9322052640 1 --2- 172.21.15.92:0/1307743099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c108d10 0x7f931c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.286+0000 7f9322052640 1 --2- 172.21.15.92:0/1307743099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f931c1083c0 0x7f931c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.286+0000 7f9322052640 1 --2- 172.21.15.92:0/1307743099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c102a80 0x7f931c102e90 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.286+0000 7f9322052640 1 -- 172.21.15.92:0/1307743099 >> 172.21.15.92:0/1307743099 conn(0x7f931c079740 msgr2=0x7f931c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.286+0000 7f9322052640 1 -- 172.21.15.92:0/1307743099 shutdown_connections 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.286+0000 7f9322052640 1 -- 172.21.15.92:0/1307743099 wait complete. 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.287+0000 7f9322052640 1 Processor -- start 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.287+0000 7f9322052640 1 -- start start 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f9322052640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c102a80 0x7f931c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f9322052640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c1083c0 0x7f931c1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f9322052640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f931c108d10 0x7f931c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f9322052640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f931c112830 con 0x7f931c102a80 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f9322052640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f931c1126b0 con 0x7f931c108d10 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f9322052640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f931c1129b0 con 0x7f931c1083c0 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c102a80 0x7f931c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c102a80 0x7f931c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41782/0 (socket says 172.21.15.92:41782) 2024-09-21T07:19:14.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931b7fe640 1 -- 172.21.15.92:0/653165274 learned_addr learned my addr 172.21.15.92:0/653165274 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931affd640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c1083c0 0x7f931c1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931bfff640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f931c108d10 0x7f931c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931b7fe640 1 -- 172.21.15.92:0/653165274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c1083c0 msgr2=0x7f931c1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931b7fe640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c1083c0 0x7f931c1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931b7fe640 1 -- 172.21.15.92:0/653165274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f931c108d10 msgr2=0x7f931c19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931b7fe640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f931c108d10 0x7f931c19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931b7fe640 1 -- 172.21.15.92:0/653165274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c19f1d0 con 0x7f931c102a80 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f931b7fe640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c102a80 0x7f931c199320 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f930c009a20 tx=0x7f930c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f9318ff9640 1 -- 172.21.15.92:0/653165274 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c03f030 con 0x7f931c102a80 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f9318ff9640 1 -- 172.21.15.92:0/653165274 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f930c0035f0 con 0x7f931c102a80 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f9322052640 1 -- 172.21.15.92:0/653165274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c19f460 con 0x7f931c102a80 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.288+0000 7f9318ff9640 1 -- 172.21.15.92:0/653165274 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c035070 con 0x7f931c102a80 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.289+0000 7f9322052640 1 -- 172.21.15.92:0/653165274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c19f940 con 0x7f931c102a80 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.291+0000 7f93285c6740 1 Processor -- start 2024-09-21T07:19:14.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.291+0000 7f9318ff9640 1 -- 172.21.15.92:0/653165274 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f930c003aa0 con 0x7f931c102a80 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.291+0000 7f93285c6740 1 -- start start 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.291+0000 7f93285c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f12f070 0x55712f4d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.291+0000 7f93285c6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f1061b0 0x55712f4d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.291+0000 7f93285c6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 0x55712f4d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.291+0000 7f93285c6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55712f44cea0 con 0x55712f1061b0 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f93285c6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55712f43c2d0 con 0x55712f10e390 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f93285c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55712f4400e0 con 0x55712f12f070 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f1061b0 0x55712f4d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f1061b0 0x55712f4d6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41788/0 (socket says 172.21.15.92:41788) 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931b7fe640 1 -- 172.21.15.92:0/446066494 learned_addr learned my addr 172.21.15.92:0/446066494 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931bfff640 1 --2- 172.21.15.92:0/446066494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f12f070 0x55712f4d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931affd640 1 --2- 172.21.15.92:0/446066494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 0x55712f4d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931b7fe640 1 -- 172.21.15.92:0/446066494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f12f070 msgr2=0x55712f4d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:14.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931b7fe640 1 --2- 172.21.15.92:0/446066494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f12f070 0x55712f4d62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931b7fe640 1 -- 172.21.15.92:0/446066494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 msgr2=0x55712f4d6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931b7fe640 1 --2- 172.21.15.92:0/446066494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 0x55712f4d6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931b7fe640 1 -- 172.21.15.92:0/446066494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55712f19a650 con 0x55712f1061b0 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f9318ff9640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f93040b66b0 0x7f93040b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931bfff640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f93040b66b0 0x7f93040b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f931b7fe640 1 --2- 172.21.15.92:0/446066494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f1061b0 0x55712f4d6800 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f930c105980 tx=0x7f930c10ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364e2e9b3473c674 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f9318ff9640 1 -- 172.21.15.92:0/653165274 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f930c108690 con 0x7f931c102a80 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.292+0000 7f9301ffb640 1 -- 172.21.15.92:0/446066494 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c049020 con 0x55712f1061b0 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.293+0000 7f9301ffb640 1 -- 172.21.15.92:0/446066494 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f930c0cdc50 con 0x55712f1061b0 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.293+0000 7f9301ffb640 1 -- 172.21.15.92:0/446066494 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c0c9fe0 con 0x55712f1061b0 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.293+0000 7f93285c6740 1 -- 172.21.15.92:0/446066494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f1061b0 msgr2=0x55712f4d6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.293+0000 7f931bfff640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f93040b66b0 0x7f93040b8bc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9314007e50 tx=0x7f9314007600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.293+0000 7f93285c6740 1 --2- 172.21.15.92:0/446066494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f1061b0 0x55712f4d6800 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f930c105980 tx=0x7f930c10ecd0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 -- 172.21.15.92:0/446066494 shutdown_connections 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 --2- 172.21.15.92:0/446066494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 0x55712f4d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 --2- 172.21.15.92:0/446066494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f1061b0 0x55712f4d6800 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 --2- 172.21.15.92:0/446066494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f12f070 0x55712f4d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 -- 172.21.15.92:0/446066494 >> 172.21.15.92:0/446066494 conn(0x55712f123460 msgr2=0x55712f4d41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 -- 172.21.15.92:0/446066494 shutdown_connections 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 -- 172.21.15.92:0/446066494 wait complete. 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 -- start start 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 Processor -- start 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f1061b0 0x55712f4e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.294+0000 7f93285c6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f10e390 0x55712f4e4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f93285c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f12f070 0x55712f4e45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f93285c6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55712f29d700 con 0x55712f10e390 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f93285c6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55712f3d7160 con 0x55712f1061b0 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f93285c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55712f44cea0 con 0x55712f12f070 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f93285c6740 10 client.0 _ll_register_callbacks cb 0x55712f3f09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f10e390 0x55712f4e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f10e390 0x55712f4e4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41794/0 (socket says 172.21.15.92:41794) 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931affd640 1 -- 172.21.15.92:0/3251093823 learned_addr learned my addr 172.21.15.92:0/3251093823 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931b7fe640 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f1061b0 0x55712f4e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931bfff640 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f12f070 0x55712f4e45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931affd640 1 -- 172.21.15.92:0/3251093823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f12f070 msgr2=0x55712f4e45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931affd640 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f12f070 0x55712f4e45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931affd640 1 -- 172.21.15.92:0/3251093823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f1061b0 msgr2=0x55712f4e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931affd640 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f1061b0 0x55712f4e3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931affd640 1 -- 172.21.15.92:0/3251093823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55712f404c90 con 0x55712f10e390 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931b7fe640 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f1061b0 0x55712f4e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f931affd640 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f10e390 0x55712f4e4050 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f9310010820 tx=0x7f9310010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba4c9cf90e844f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f92faffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f92faffd640 1 -- 172.21.15.92:0/3251093823 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931000fb90 con 0x55712f10e390 2024-09-21T07:19:14.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f92faffd640 1 -- 172.21.15.92:0/3251093823 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f931000fd30 con 0x55712f10e390 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.295+0000 7f93285c6740 1 -- 172.21.15.92:0/3251093823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f930c0cdc50 con 0x55712f10e390 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f92faffd640 1 -- 172.21.15.92:0/3251093823 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9310024050 con 0x55712f10e390 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f93285c6740 10 client.17421 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f93285c6740 1 -- 172.21.15.92:0/3251093823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55712f4f25b0 con 0x55712f10e390 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f92faffd640 1 -- 172.21.15.92:0/3251093823 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f930c0cdc50 con 0x55712f10e390 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f92faffd640 1 -- 172.21.15.92:0/3251093823 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f931000e440 con 0x55712f10e390 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f93285c6740 10 client.17421 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f93285c6740 10 client.17421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f93285c6740 20 client.17421 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f93285c6740 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55712f0ed9f0 0x55712f4f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f93285c6740 4 client.17421 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f93285c6740 1 -- 172.21.15.92:0/3251093823 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55712f44edf0 con 0x55712f0ed9f0 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.296+0000 7f931b7fe640 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55712f0ed9f0 0x55712f4f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.297+0000 7f931b7fe640 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55712f0ed9f0 0x55712f4f5bd0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4254b1f0038a8a03 server_cookie=99728ad4782947de in_seq=0 out_seq=0 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.297+0000 7f92faffd640 10 client.17421 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:14.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.297+0000 7f92faffd640 1 -- 172.21.15.92:0/3251093823 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55712f44edf0 con 0x55712f0ed9f0 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.297+0000 7f92faffd640 10 client.17421 handle_command_reply: tid=0 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 client.17421 shutdown 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 -- 172.21.15.92:0/3251093823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f10e390 msgr2=0x55712f4e4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f10e390 0x55712f4e4050 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f9310010820 tx=0x7f9310010ce0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 -- 172.21.15.92:0/3251093823 shutdown_connections 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55712f0ed9f0 0x55712f4f5bd0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f12f070 0x55712f4e45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f10e390 0x55712f4e4050 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f92faffd640 0 client.17421 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 --2- 172.21.15.92:0/3251093823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f1061b0 0x55712f4e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 -- 172.21.15.92:0/3251093823 >> 172.21.15.92:0/3251093823 conn(0x55712f123460 msgr2=0x55712f4d9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 -- 172.21.15.92:0/3251093823 shutdown_connections 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 1 -- 172.21.15.92:0/3251093823 wait complete. 2024-09-21T07:19:14.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.298+0000 7f93285c6740 20 client.17421 trim_cache size 0 max 16384 2024-09-21T07:19:14.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.311+0000 7f93285c6740 1 Processor -- start 2024-09-21T07:19:14.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.311+0000 7f93285c6740 1 -- start start 2024-09-21T07:19:14.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.311+0000 7f93285c6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4e5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.311+0000 7f93285c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f1061b0 0x55712f4e3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.311+0000 7f93285c6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 0x55712f4ebee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.311+0000 7f93285c6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f931c1aec60 con 0x55712f0ed9f0 2024-09-21T07:19:14.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.311+0000 7f93285c6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f931c1b07a0 con 0x55712f10e390 2024-09-21T07:19:14.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.311+0000 7f93285c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f931c1af330 con 0x55712f1061b0 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.311+0000 7f931b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4e5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4e5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41796/0 (socket says 172.21.15.92:41796) 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931b7fe640 1 -- 172.21.15.92:0/2320496525 learned_addr learned my addr 172.21.15.92:0/2320496525 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931affd640 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f1061b0 0x55712f4e3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931b7fe640 1 -- 172.21.15.92:0/2320496525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f1061b0 msgr2=0x55712f4e3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931bfff640 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 0x55712f4ebee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931b7fe640 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f1061b0 0x55712f4e3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931b7fe640 1 -- 172.21.15.92:0/2320496525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 msgr2=0x55712f4ebee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931b7fe640 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 0x55712f4ebee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931b7fe640 1 -- 172.21.15.92:0/2320496525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55712f4e4bb0 con 0x55712f0ed9f0 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931affd640 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f1061b0 0x55712f4e3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931bfff640 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 0x55712f4ebee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f931b7fe640 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4e5b00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f930c10e1b0 tx=0x7f930c0ca1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cba859520738e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:14.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f93017fa640 1 -- 172.21.15.92:0/2320496525 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c049040 con 0x55712f0ed9f0 2024-09-21T07:19:14.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f93017fa640 1 -- 172.21.15.92:0/2320496525 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f930c0cdc50 con 0x55712f0ed9f0 2024-09-21T07:19:14.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.312+0000 7f93017fa640 1 -- 172.21.15.92:0/2320496525 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c0cd8b0 con 0x55712f0ed9f0 2024-09-21T07:19:14.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.313+0000 7f93285c6740 1 -- 172.21.15.92:0/2320496525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 msgr2=0x55712f4e5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:14.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.313+0000 7f93285c6740 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4e5b00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f930c10e1b0 tx=0x7f930c0ca1a0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.313+0000 7f93285c6740 1 -- 172.21.15.92:0/2320496525 shutdown_connections 2024-09-21T07:19:14.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.313+0000 7f93285c6740 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f10e390 0x55712f4ebee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.313+0000 7f93285c6740 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f1061b0 0x55712f4e3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.313+0000 7f93285c6740 1 --2- 172.21.15.92:0/2320496525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4e5b00 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.313+0000 7f93285c6740 1 -- 172.21.15.92:0/2320496525 >> 172.21.15.92:0/2320496525 conn(0x55712f123460 msgr2=0x55712f4d7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.313+0000 7f93285c6740 1 -- 172.21.15.92:0/2320496525 shutdown_connections 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.313+0000 7f93285c6740 1 -- 172.21.15.92:0/2320496525 wait complete. 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.313+0000 7f93285c6740 1 -- start start 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f93285c6740 1 Processor -- start 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f93285c6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4dc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f93285c6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f1061b0 0x55712f4dccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f93285c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f10e390 0x55712f5615b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f93285c6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f931c1b00d0 con 0x55712f0ed9f0 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f93285c6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f931c1afa00 con 0x55712f1061b0 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f93285c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f931c1acc40 con 0x55712f10e390 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f931b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4dc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f93285c6740 10 client.0 _ll_register_callbacks cb 0x7f931000a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f931b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4dc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41798/0 (socket says 172.21.15.92:41798) 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f931b7fe640 1 -- 172.21.15.92:0/1818071398 learned_addr learned my addr 172.21.15.92:0/1818071398 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f931bfff640 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f10e390 0x55712f5615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f931b7fe640 1 -- 172.21.15.92:0/1818071398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f10e390 msgr2=0x55712f5615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f931b7fe640 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f10e390 0x55712f5615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f931b7fe640 1 -- 172.21.15.92:0/1818071398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f1061b0 msgr2=0x55712f4dccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f931b7fe640 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f1061b0 0x55712f4dccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.314+0000 7f931b7fe640 1 -- 172.21.15.92:0/1818071398 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55712f561b20 con 0x55712f0ed9f0 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f931b7fe640 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4dc7b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f930c032fd0 tx=0x7f930c0cd8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f622c9acf3497a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f92faffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f92faffd640 1 -- 172.21.15.92:0/1818071398 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c049050 con 0x55712f0ed9f0 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f92faffd640 1 -- 172.21.15.92:0/1818071398 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f930c0037a0 con 0x55712f0ed9f0 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f93285c6740 1 -- 172.21.15.92:0/1818071398 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f930c0cdc50 con 0x55712f0ed9f0 2024-09-21T07:19:14.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f92faffd640 1 -- 172.21.15.92:0/1818071398 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f930c0cda90 con 0x55712f0ed9f0 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f93285c6740 10 client.17427 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f93285c6740 1 -- 172.21.15.92:0/1818071398 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55712f562c80 con 0x55712f0ed9f0 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f92faffd640 1 -- 172.21.15.92:0/1818071398 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f930c0cdc50 con 0x55712f0ed9f0 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f92faffd640 1 -- 172.21.15.92:0/1818071398 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f930c0e5020 con 0x55712f0ed9f0 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f93285c6740 10 client.17427 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f93285c6740 10 client.17427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f93285c6740 20 client.17427 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f93285c6740 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55712f12f070 0x55712f565040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f93285c6740 4 client.17427 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.315+0000 7f93285c6740 1 -- 172.21.15.92:0/1818071398 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55712f44a8a0 con 0x55712f12f070 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f931affd640 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55712f12f070 0x55712f565040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f92faffd640 10 client.17427 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:14.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f931affd640 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55712f12f070 0x55712f565040 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a1bd2da28ff6b0 server_cookie=7bbaea2fe9e00909 in_seq=0 out_seq=0 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f92faffd640 1 -- 172.21.15.92:0/1818071398 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55712f44a8a0 con 0x55712f12f070 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f92faffd640 10 client.17427 handle_command_reply: tid=0 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f93285c6740 1 client.17427 shutdown 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f93285c6740 1 -- 172.21.15.92:0/1818071398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 msgr2=0x55712f4dc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f93285c6740 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4dc7b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f930c032fd0 tx=0x7f930c0cd8b0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f93285c6740 1 -- 172.21.15.92:0/1818071398 shutdown_connections 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f93285c6740 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55712f12f070 0x55712f565040 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f93285c6740 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55712f10e390 0x55712f5615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f93285c6740 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55712f1061b0 0x55712f4dccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.316+0000 7f93285c6740 1 --2- 172.21.15.92:0/1818071398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55712f0ed9f0 0x55712f4dc7b0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f92faffd640 0 client.17427 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f93285c6740 1 -- 172.21.15.92:0/1818071398 >> 172.21.15.92:0/1818071398 conn(0x55712f123460 msgr2=0x55712f4ef450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f93285c6740 1 -- 172.21.15.92:0/1818071398 shutdown_connections 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f93285c6740 1 -- 172.21.15.92:0/1818071398 wait complete. 2024-09-21T07:19:14.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f93285c6740 20 client.17427 trim_cache size 0 max 16384 2024-09-21T07:19:14.324 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:19:14.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 -- 172.21.15.92:0/653165274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f93040b66b0 msgr2=0x7f93040b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:14.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f93040b66b0 0x7f93040b8bc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9314007e50 tx=0x7f9314007600 comp rx=0 tx=0).stop 2024-09-21T07:19:14.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 -- 172.21.15.92:0/653165274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c102a80 msgr2=0x7f931c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:14.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c102a80 0x7f931c199320 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f930c009a20 tx=0x7f930c004270 comp rx=0 tx=0).stop 2024-09-21T07:19:14.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 -- 172.21.15.92:0/653165274 shutdown_connections 2024-09-21T07:19:14.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f93040b66b0 0x7f93040b8bc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f931c108d10 0x7f931c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c1083c0 0x7f931c1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 --2- 172.21.15.92:0/653165274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f931c102a80 0x7f931c199320 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:14.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 -- 172.21.15.92:0/653165274 >> 172.21.15.92:0/653165274 conn(0x7f931c079740 msgr2=0x7f931c1016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:14.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.317+0000 7f9322052640 1 -- 172.21.15.92:0/653165274 shutdown_connections 2024-09-21T07:19:14.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:14.318+0000 7f9322052640 1 -- 172.21.15.92:0/653165274 wait complete. 2024-09-21T07:19:16.088 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:19:16.089 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:19:16.102 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:15 smithi092 ceph-mon[30987]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T07:19:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:15 smithi169 ceph-mon[33705]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T07:19:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:15 smithi175 ceph-mon[34064]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T07:19:16.356 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:16.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.843+0000 7fe70d385640 1 -- 172.21.15.92:0/1933126397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe708108d10 msgr2=0x7fe70810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:16.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.843+0000 7fe70d385640 1 --2- 172.21.15.92:0/1933126397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe708108d10 0x7fe70810f540 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe700009ca0 tx=0x7fe70002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.844+0000 7fe70d385640 1 -- 172.21.15.92:0/1933126397 shutdown_connections 2024-09-21T07:19:16.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.844+0000 7fe70d385640 1 --2- 172.21.15.92:0/1933126397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe708108d10 0x7fe70810f540 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.844+0000 7fe70d385640 1 --2- 172.21.15.92:0/1933126397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7081083c0 0x7fe7081087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.844+0000 7fe70d385640 1 --2- 172.21.15.92:0/1933126397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe708102a80 0x7fe708102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.844+0000 7fe70d385640 1 -- 172.21.15.92:0/1933126397 >> 172.21.15.92:0/1933126397 conn(0x7fe708079740 msgr2=0x7fe708079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.844+0000 7fe70d385640 1 -- 172.21.15.92:0/1933126397 shutdown_connections 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.844+0000 7fe70d385640 1 -- 172.21.15.92:0/1933126397 wait complete. 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.844+0000 7fe70d385640 1 Processor -- start 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.844+0000 7fe70d385640 1 -- start start 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe70d385640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe708102a80 0x7fe70819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe70d385640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7081083c0 0x7fe70819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe70d385640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe708108d10 0x7fe70819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe70d385640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe708112880 con 0x7fe708108d10 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe70d385640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe708112700 con 0x7fe7081083c0 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe70d385640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe708112a00 con 0x7fe708102a80 2024-09-21T07:19:16.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe7077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe708108d10 0x7fe70819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe7077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe708108d10 0x7fe70819bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41818/0 (socket says 172.21.15.92:41818) 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe7077fe640 1 -- 172.21.15.92:0/2939603677 learned_addr learned my addr 172.21.15.92:0/2939603677 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe706ffd640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe708102a80 0x7fe70819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe7067fc640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7081083c0 0x7fe70819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe7077fe640 1 -- 172.21.15.92:0/2939603677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe708102a80 msgr2=0x7fe70819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe7077fe640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe708102a80 0x7fe70819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe7077fe640 1 -- 172.21.15.92:0/2939603677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7081083c0 msgr2=0x7fe70819b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe7077fe640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7081083c0 0x7fe70819b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe7077fe640 1 -- 172.21.15.92:0/2939603677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7081a64f0 con 0x7fe708108d10 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.845+0000 7fe7077fe640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe708108d10 0x7fe70819bcb0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe700005cc0 tx=0x7fe700032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.846+0000 7fe6fffff640 1 -- 172.21.15.92:0/2939603677 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700032e00 con 0x7fe708108d10 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.846+0000 7fe70d385640 1 -- 172.21.15.92:0/2939603677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7081a6780 con 0x7fe708108d10 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.846+0000 7fe6fffff640 1 -- 172.21.15.92:0/2939603677 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7000044d0 con 0x7fe708108d10 2024-09-21T07:19:16.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.846+0000 7fe6fffff640 1 -- 172.21.15.92:0/2939603677 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700030b70 con 0x7fe708108d10 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.846+0000 7fe70d385640 1 -- 172.21.15.92:0/2939603677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7081a6d10 con 0x7fe708108d10 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.848+0000 7fe6fffff640 1 -- 172.21.15.92:0/2939603677 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fe700004680 con 0x7fe708108d10 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe7138f9740 1 Processor -- start 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe7138f9740 1 -- start start 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe6fffff640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6f40b6680 0x7fe6f40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe7067fc640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6f40b6680 0x7fe6f40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe6fffff640 1 -- 172.21.15.92:0/2939603677 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe700108cd0 con 0x7fe708108d10 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae742350 0x5570aeae9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae719490 0x5570aeae9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae721670 0x5570aeae9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe7138f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570aea5fe60 con 0x5570ae721670 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe7138f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5570aea4f290 con 0x5570ae719490 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.849+0000 7fe7138f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5570aea530a0 con 0x5570ae742350 2024-09-21T07:19:16.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae721670 0x5570aeae9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae721670 0x5570aeae9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41820/0 (socket says 172.21.15.92:41820) 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7077fe640 1 -- 172.21.15.92:0/612346643 learned_addr learned my addr 172.21.15.92:0/612346643 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7067fc640 1 --2- 172.21.15.92:0/612346643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae719490 0x5570aeae9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe706ffd640 1 --2- 172.21.15.92:0/612346643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae742350 0x5570aeae9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7067fc640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6f40b6680 0x7fe6f40b8b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe708105ff0 tx=0x7fe6f000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7077fe640 1 -- 172.21.15.92:0/612346643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae742350 msgr2=0x5570aeae9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7077fe640 1 --2- 172.21.15.92:0/612346643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae742350 0x5570aeae9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7077fe640 1 -- 172.21.15.92:0/612346643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae719490 msgr2=0x5570aeae9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7077fe640 1 --2- 172.21.15.92:0/612346643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae719490 0x5570aeae9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7077fe640 1 -- 172.21.15.92:0/612346643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ae7ad930 con 0x5570ae721670 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe706ffd640 1 --2- 172.21.15.92:0/612346643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae742350 0x5570aeae9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe7077fe640 1 --2- 172.21.15.92:0/612346643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae721670 0x5570aeae9eb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe700031040 tx=0x7fe7000ce610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06d334a00d30743 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe6fd7fa640 1 -- 172.21.15.92:0/612346643 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7000cee80 con 0x5570ae721670 2024-09-21T07:19:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe6fd7fa640 1 -- 172.21.15.92:0/612346643 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe700036040 con 0x5570ae721670 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.850+0000 7fe6fd7fa640 1 -- 172.21.15.92:0/612346643 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7000d7d10 con 0x5570ae721670 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.851+0000 7fe7138f9740 1 -- 172.21.15.92:0/612346643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae721670 msgr2=0x5570aeae9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.851+0000 7fe7138f9740 1 --2- 172.21.15.92:0/612346643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae721670 0x5570aeae9eb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe700031040 tx=0x7fe7000ce610 comp rx=0 tx=0).stop 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.851+0000 7fe7138f9740 1 -- 172.21.15.92:0/612346643 shutdown_connections 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.851+0000 7fe7138f9740 1 --2- 172.21.15.92:0/612346643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae721670 0x5570aeae9eb0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.851+0000 7fe7138f9740 1 --2- 172.21.15.92:0/612346643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae719490 0x5570aeae9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.851+0000 7fe7138f9740 1 --2- 172.21.15.92:0/612346643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae742350 0x5570aeae9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.851+0000 7fe7138f9740 1 -- 172.21.15.92:0/612346643 >> 172.21.15.92:0/612346643 conn(0x5570ae736740 msgr2=0x5570aeae7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.851+0000 7fe7138f9740 1 -- 172.21.15.92:0/612346643 shutdown_connections 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.851+0000 7fe7138f9740 1 -- 172.21.15.92:0/612346643 wait complete. 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe7138f9740 1 -- start start 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe7138f9740 1 Processor -- start 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaf93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeaf9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae742350 0x5570aeb04df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe7138f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570ae8b0890 con 0x5570ae719490 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe7138f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5570ae9e9d40 con 0x5570ae742350 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe7138f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5570aea5fe60 con 0x5570ae721670 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe706ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaf93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe7138f9740 10 client.0 _ll_register_callbacks cb 0x5570aea4dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe706ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaf93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41824/0 (socket says 172.21.15.92:41824) 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.852+0000 7fe706ffd640 1 -- 172.21.15.92:0/4225928592 learned_addr learned my addr 172.21.15.92:0/4225928592 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe7067fc640 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeaf9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe7077fe640 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae742350 0x5570aeb04df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe706ffd640 1 -- 172.21.15.92:0/4225928592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 msgr2=0x5570aeaf9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:16.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe706ffd640 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeaf9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe706ffd640 1 -- 172.21.15.92:0/4225928592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae742350 msgr2=0x5570aeb04df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe706ffd640 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae742350 0x5570aeb04df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe706ffd640 1 -- 172.21.15.92:0/4225928592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570aeb05380 con 0x5570ae719490 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe7077fe640 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae742350 0x5570aeb04df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe706ffd640 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaf93d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8012810 tx=0x7fe6f8012cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc2413b6d8bbf9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe6ee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/4225928592 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f801f060 con 0x5570ae719490 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/4225928592 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe6f8010dc0 con 0x5570ae719490 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe7138f9740 1 -- 172.21.15.92:0/4225928592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe700036040 con 0x5570ae719490 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/4225928592 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe6f8026050 con 0x5570ae719490 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe7138f9740 10 client.17439 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.853+0000 7fe7138f9740 1 -- 172.21.15.92:0/4225928592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5570aeb07cf0 con 0x5570ae719490 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.854+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/4225928592 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe700036040 con 0x5570ae719490 2024-09-21T07:19:16.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.854+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/4225928592 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe6f800d460 con 0x5570ae719490 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.854+0000 7fe7138f9740 10 client.17439 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.854+0000 7fe7138f9740 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.854+0000 7fe7138f9740 20 client.17439 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.854+0000 7fe7138f9740 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570ae700cd0 0x5570aeb0b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.854+0000 7fe7138f9740 4 client.17439 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.854+0000 7fe7138f9740 1 -- 172.21.15.92:0/4225928592 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570aea61db0 con 0x5570ae700cd0 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.854+0000 7fe7067fc640 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570ae700cd0 0x5570aeb0b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.855+0000 7fe7067fc640 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570ae700cd0 0x5570aeb0b220 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e03bd43feeeb90ff server_cookie=6e61aec164ab41e7 in_seq=0 out_seq=0 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.855+0000 7fe6ee7fc640 10 client.17439 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/4225928592 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5570aea61db0 con 0x5570ae700cd0 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe6ee7fc640 10 client.17439 handle_command_reply: tid=0 2024-09-21T07:19:16.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 client.17439 shutdown 2024-09-21T07:19:16.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 -- 172.21.15.92:0/4225928592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 msgr2=0x5570aeaf93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:16.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaf93d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8012810 tx=0x7fe6f8012cd0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 -- 172.21.15.92:0/4225928592 shutdown_connections 2024-09-21T07:19:16.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570ae700cd0 0x5570aeb0b220 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae742350 0x5570aeb04df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeaf9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe6ee7fc640 0 client.17439 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:16.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 --2- 172.21.15.92:0/4225928592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaf93d0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 -- 172.21.15.92:0/4225928592 >> 172.21.15.92:0/4225928592 conn(0x5570ae736740 msgr2=0x5570aeaec580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:16.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 -- 172.21.15.92:0/4225928592 shutdown_connections 2024-09-21T07:19:16.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 1 -- 172.21.15.92:0/4225928592 wait complete. 2024-09-21T07:19:16.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.856+0000 7fe7138f9740 20 client.17439 trim_cache size 0 max 16384 2024-09-21T07:19:16.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7138f9740 1 Processor -- start 2024-09-21T07:19:16.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7138f9740 1 -- start start 2024-09-21T07:19:16.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae700cd0 0x5570aeaee720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaeec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeaec530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7138f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe7081aecc0 con 0x5570ae719490 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7138f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7081b0800 con 0x5570ae700cd0 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7138f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7081af390 con 0x5570ae721670 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7067fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaeec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7067fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaeec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41834/0 (socket says 172.21.15.92:41834) 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe7067fc640 1 -- 172.21.15.92:0/567148824 learned_addr learned my addr 172.21.15.92:0/567148824 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.874+0000 7fe706ffd640 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae700cd0 0x5570aeaee720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe7077fe640 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeaec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe7067fc640 1 -- 172.21.15.92:0/567148824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 msgr2=0x5570aeaec530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe7067fc640 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeaec530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe7067fc640 1 -- 172.21.15.92:0/567148824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae700cd0 msgr2=0x5570aeaee720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe7067fc640 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae700cd0 0x5570aeaee720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe7067fc640 1 -- 172.21.15.92:0/567148824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570aeaf9a90 con 0x5570ae719490 2024-09-21T07:19:16.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe7077fe640 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeaec530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:16.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe706ffd640 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae700cd0 0x5570aeaee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:16.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe7067fc640 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaeec60 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000c00 tx=0x7fe6f0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5837b066ff5f13dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:16.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe6fcff9640 1 -- 172.21.15.92:0/567148824 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0005020 con 0x5570ae719490 2024-09-21T07:19:16.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe6fcff9640 1 -- 172.21.15.92:0/567148824 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6f00047a0 con 0x5570ae719490 2024-09-21T07:19:16.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.875+0000 7fe6fcff9640 1 -- 172.21.15.92:0/567148824 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0005650 con 0x5570ae719490 2024-09-21T07:19:16.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.876+0000 7fe7138f9740 1 -- 172.21.15.92:0/567148824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 msgr2=0x5570aeaeec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:16.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.876+0000 7fe7138f9740 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaeec60 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000c00 tx=0x7fe6f0013000 comp rx=0 tx=0).stop 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.876+0000 7fe7138f9740 1 -- 172.21.15.92:0/567148824 shutdown_connections 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.876+0000 7fe7138f9740 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeaec530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.876+0000 7fe7138f9740 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae719490 0x5570aeaeec60 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.876+0000 7fe7138f9740 1 --2- 172.21.15.92:0/567148824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae700cd0 0x5570aeaee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.876+0000 7fe7138f9740 1 -- 172.21.15.92:0/567148824 >> 172.21.15.92:0/567148824 conn(0x5570ae736740 msgr2=0x5570aeaf7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.876+0000 7fe7138f9740 1 -- 172.21.15.92:0/567148824 shutdown_connections 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.876+0000 7fe7138f9740 1 -- 172.21.15.92:0/567148824 wait complete. 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.876+0000 7fe7138f9740 1 -- start start 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe7138f9740 1 Processor -- start 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae700cd0 0x5570aeafd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae719490 0x5570aeafdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe7138f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeb6ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe7138f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe7081b0130 con 0x5570ae700cd0 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe7138f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7081afa60 con 0x5570ae719490 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe7138f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7081acca0 con 0x5570ae721670 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe7138f9740 10 client.0 _ll_register_callbacks cb 0x7fe6f800a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe706ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae700cd0 0x5570aeafd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe706ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae700cd0 0x5570aeafd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41840/0 (socket says 172.21.15.92:41840) 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe706ffd640 1 -- 172.21.15.92:0/767558473 learned_addr learned my addr 172.21.15.92:0/767558473 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe706ffd640 1 -- 172.21.15.92:0/767558473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 msgr2=0x5570aeb6ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe706ffd640 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeb6ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe7067fc640 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae719490 0x5570aeafdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe706ffd640 1 -- 172.21.15.92:0/767558473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae719490 msgr2=0x5570aeafdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe706ffd640 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae719490 0x5570aeafdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe706ffd640 1 -- 172.21.15.92:0/767558473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570aeb6f220 con 0x5570ae700cd0 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe706ffd640 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae700cd0 0x5570aeafd6a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80124b0 tx=0x7fe6f800ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f52a62fb8f4d13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.877+0000 7fe6ee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/767558473 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80107a0 con 0x5570ae700cd0 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/767558473 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe6f800d340 con 0x5570ae700cd0 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe7138f9740 1 -- 172.21.15.92:0/767558473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6f00047a0 con 0x5570ae700cd0 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/767558473 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe6f801f020 con 0x5570ae700cd0 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe7138f9740 10 client.17445 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe7138f9740 1 -- 172.21.15.92:0/767558473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5570aeb76520 con 0x5570ae700cd0 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/767558473 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6f00047a0 con 0x5570ae700cd0 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/767558473 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe6f8004780 con 0x5570ae700cd0 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe7138f9740 10 client.17445 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe7138f9740 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe7138f9740 20 client.17445 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe7138f9740 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570ae742350 0x5570aeb78d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe7138f9740 4 client.17445 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:19:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.878+0000 7fe7138f9740 1 -- 172.21.15.92:0/767558473 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5570aea5d860 con 0x5570ae742350 2024-09-21T07:19:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.879+0000 7fe7067fc640 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570ae742350 0x5570aeb78d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.879+0000 7fe6ee7fc640 10 client.17445 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.879+0000 7fe7067fc640 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570ae742350 0x5570aeb78d30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=327b7dd3491650b8 server_cookie=f3bc7be667e69047 in_seq=0 out_seq=0 2024-09-21T07:19:16.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe6ee7fc640 1 -- 172.21.15.92:0/767558473 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5570aea5d860 con 0x5570ae742350 2024-09-21T07:19:16.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe6ee7fc640 10 client.17445 handle_command_reply: tid=0 2024-09-21T07:19:16.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 client.17445 shutdown 2024-09-21T07:19:16.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 -- 172.21.15.92:0/767558473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae700cd0 msgr2=0x5570aeafd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:16.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae700cd0 0x5570aeafd6a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80124b0 tx=0x7fe6f800ddb0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 -- 172.21.15.92:0/767558473 shutdown_connections 2024-09-21T07:19:16.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5570ae742350 0x5570aeb78d30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe6ee7fc640 0 client.17445 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:16.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570ae721670 0x5570aeb6ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5570ae719490 0x5570aeafdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 --2- 172.21.15.92:0/767558473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570ae700cd0 0x5570aeafd6a0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 -- 172.21.15.92:0/767558473 >> 172.21.15.92:0/767558473 conn(0x5570ae736740 msgr2=0x5570aeaf7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:16.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 -- 172.21.15.92:0/767558473 shutdown_connections 2024-09-21T07:19:16.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.881+0000 7fe7138f9740 1 -- 172.21.15.92:0/767558473 wait complete. 2024-09-21T07:19:16.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe7138f9740 20 client.17445 trim_cache size 0 max 16384 2024-09-21T07:19:16.887 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:19:16.888 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:19:16.888 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "948a50ad-2413-4f45-8f96-803f86b37155", 2024-09-21T07:19:16.888 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:19:16.888 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:19:16.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 -- 172.21.15.92:0/2939603677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6f40b6680 msgr2=0x7fe6f40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:16.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6f40b6680 0x7fe6f40b8b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe708105ff0 tx=0x7fe6f000b390 comp rx=0 tx=0).stop 2024-09-21T07:19:16.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 -- 172.21.15.92:0/2939603677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe708108d10 msgr2=0x7fe70819bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:16.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe708108d10 0x7fe70819bcb0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe700005cc0 tx=0x7fe700032a10 comp rx=0 tx=0).stop 2024-09-21T07:19:16.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 -- 172.21.15.92:0/2939603677 shutdown_connections 2024-09-21T07:19:16.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe6f40b6680 0x7fe6f40b8b90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe708108d10 0x7fe70819bcb0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7081083c0 0x7fe70819b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 --2- 172.21.15.92:0/2939603677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe708102a80 0x7fe70819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:16.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 -- 172.21.15.92:0/2939603677 >> 172.21.15.92:0/2939603677 conn(0x7fe708079740 msgr2=0x7fe708104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:16.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 -- 172.21.15.92:0/2939603677 shutdown_connections 2024-09-21T07:19:16.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:16.882+0000 7fe70d385640 1 -- 172.21.15.92:0/2939603677 wait complete. 2024-09-21T07:19:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:16 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:19:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:16 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:19:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:16 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:19:17.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:16 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:19:17.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:16 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:19:17.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:16 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:19:17.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:16 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:19:17.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:16 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:19:17.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:16 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:19:17.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:16 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:19:17.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:16 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:19:17.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:16 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:19:17.681 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:19:17.971 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:18.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:17 smithi092 ceph-mon[30987]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:19:18.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:17 smithi175 ceph-mon[34064]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:19:18.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:17 smithi169 ceph-mon[33705]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T07:19:18.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.473+0000 7f190f9c2640 1 -- 172.21.15.92:0/3068113410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19081083a0 msgr2=0x7f19081087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:18.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.473+0000 7f190f9c2640 1 --2- 172.21.15.92:0/3068113410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19081083a0 0x7f19081087b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009900 tx=0x7f18f802a410 comp rx=0 tx=0).stop 2024-09-21T07:19:18.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.473+0000 7f190f9c2640 1 -- 172.21.15.92:0/3068113410 shutdown_connections 2024-09-21T07:19:18.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.473+0000 7f190f9c2640 1 --2- 172.21.15.92:0/3068113410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1908108cf0 0x7f190810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.473+0000 7f190f9c2640 1 --2- 172.21.15.92:0/3068113410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19081083a0 0x7f19081087b0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.473+0000 7f190f9c2640 1 --2- 172.21.15.92:0/3068113410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1908102a60 0x7f1908102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.473+0000 7f190f9c2640 1 -- 172.21.15.92:0/3068113410 >> 172.21.15.92:0/3068113410 conn(0x7f1908079760 msgr2=0x7f1908079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.473+0000 7f190f9c2640 1 -- 172.21.15.92:0/3068113410 shutdown_connections 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.473+0000 7f190f9c2640 1 -- 172.21.15.92:0/3068113410 wait complete. 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.473+0000 7f190f9c2640 1 Processor -- start 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190f9c2640 1 -- start start 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190f9c2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908102a60 0x7f190819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190f9c2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19081083a0 0x7f190819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190f9c2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1908108cf0 0x7f19081a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190f9c2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1908112860 con 0x7f1908102a60 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190f9c2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f19081126e0 con 0x7f19081083a0 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190f9c2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f19081129e0 con 0x7f1908108cf0 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190d75e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908102a60 0x7f190819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190d75e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908102a60 0x7f190819c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41860/0 (socket says 172.21.15.92:41860) 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190d75e640 1 -- 172.21.15.92:0/1393952042 learned_addr learned my addr 172.21.15.92:0/1393952042 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190cf5d640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19081083a0 0x7f190819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190df5f640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1908108cf0 0x7f19081a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190d75e640 1 -- 172.21.15.92:0/1393952042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1908108cf0 msgr2=0x7f19081a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190d75e640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1908108cf0 0x7f19081a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190d75e640 1 -- 172.21.15.92:0/1393952042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19081083a0 msgr2=0x7f190819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190d75e640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19081083a0 0x7f190819cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.474+0000 7f190d75e640 1 -- 172.21.15.92:0/1393952042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19081a2550 con 0x7f1908102a60 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.475+0000 7f190d75e640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908102a60 0x7f190819c5e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f190400d950 tx=0x7f190400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.475+0000 7f18fe7fc640 1 -- 172.21.15.92:0/1393952042 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904017030 con 0x7f1908102a60 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.475+0000 7f190f9c2640 1 -- 172.21.15.92:0/1393952042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19081a2840 con 0x7f1908102a60 2024-09-21T07:19:18.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.475+0000 7f18fe7fc640 1 -- 172.21.15.92:0/1393952042 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1904004020 con 0x7f1908102a60 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.475+0000 7f18fe7fc640 1 -- 172.21.15.92:0/1393952042 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040055d0 con 0x7f1908102a60 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.475+0000 7f190f9c2640 1 -- 172.21.15.92:0/1393952042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19081a8fa0 con 0x7f1908102a60 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f18fe7fc640 1 -- 172.21.15.92:0/1393952042 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f19040047a0 con 0x7f1908102a60 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f1915f36740 1 Processor -- start 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f1915f36740 1 -- start start 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f1915f36740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 0x55f19e63d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f1915f36740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e63d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f1915f36740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e275390 0x55f19e63dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f1915f36740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f19e5b3e50 con 0x55f19e26d1b0 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f1915f36740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f19e5a3280 con 0x55f19e296070 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f1915f36740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f19e5a7090 con 0x55f19e275390 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f190d75e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e63d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f18fe7fc640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f18f40b6680 0x7f18f40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f190d75e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e63d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41864/0 (socket says 172.21.15.92:41864) 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.478+0000 7f190d75e640 1 -- 172.21.15.92:0/516977694 learned_addr learned my addr 172.21.15.92:0/516977694 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f190df5f640 1 --2- 172.21.15.92:0/516977694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 0x55f19e63d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f190cf5d640 1 --2- 172.21.15.92:0/516977694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e275390 0x55f19e63dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f190df5f640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f18f40b6680 0x7f18f40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f18fe7fc640 1 -- 172.21.15.92:0/1393952042 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f19040e75c0 con 0x7f1908102a60 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f190d75e640 1 -- 172.21.15.92:0/516977694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e275390 msgr2=0x55f19e63dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f190d75e640 1 --2- 172.21.15.92:0/516977694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e275390 0x55f19e63dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f190d75e640 1 -- 172.21.15.92:0/516977694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 msgr2=0x55f19e63d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f190d75e640 1 --2- 172.21.15.92:0/516977694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 0x55f19e63d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f190d75e640 1 -- 172.21.15.92:0/516977694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f19e301650 con 0x55f19e26d1b0 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f190d75e640 1 --2- 172.21.15.92:0/516977694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e63d7b0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f19040a9640 tx=0x7f1904011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f044ede4b9ac7a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f190df5f640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f18f40b6680 0x7f18f40b8b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1900005c40 tx=0x7f1900005bd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f18f37fe640 1 -- 172.21.15.92:0/516977694 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040ac7e0 con 0x55f19e26d1b0 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f18f37fe640 1 -- 172.21.15.92:0/516977694 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19040acb80 con 0x55f19e26d1b0 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.479+0000 7f18f37fe640 1 -- 172.21.15.92:0/516977694 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040b88e0 con 0x55f19e26d1b0 2024-09-21T07:19:18.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.480+0000 7f1915f36740 1 -- 172.21.15.92:0/516977694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 msgr2=0x55f19e63d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.480+0000 7f1915f36740 1 --2- 172.21.15.92:0/516977694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e63d7b0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f19040a9640 tx=0x7f1904011000 comp rx=0 tx=0).stop 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.480+0000 7f1915f36740 1 -- 172.21.15.92:0/516977694 shutdown_connections 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.480+0000 7f1915f36740 1 --2- 172.21.15.92:0/516977694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e275390 0x55f19e63dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.480+0000 7f1915f36740 1 --2- 172.21.15.92:0/516977694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e63d7b0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.480+0000 7f1915f36740 1 --2- 172.21.15.92:0/516977694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 0x55f19e63d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.480+0000 7f1915f36740 1 -- 172.21.15.92:0/516977694 >> 172.21.15.92:0/516977694 conn(0x55f19e28a460 msgr2=0x55f19e63b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.480+0000 7f1915f36740 1 -- 172.21.15.92:0/516977694 shutdown_connections 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.480+0000 7f1915f36740 1 -- 172.21.15.92:0/516977694 wait complete. 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f1915f36740 1 -- start start 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f1915f36740 1 Processor -- start 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f1915f36740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e648970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f1915f36740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e275390 0x55f19e648eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f1915f36740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 0x55f19e654d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f1915f36740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f19e404700 con 0x55f19e26d1b0 2024-09-21T07:19:18.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f1915f36740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f19e53e110 con 0x55f19e296070 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f1915f36740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f19e64b9f0 con 0x55f19e275390 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f190d75e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e648970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f1915f36740 10 client.0 _ll_register_callbacks cb 0x55f19e557990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f190d75e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e648970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41866/0 (socket says 172.21.15.92:41866) 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.481+0000 7f190d75e640 1 -- 172.21.15.92:0/471686434 learned_addr learned my addr 172.21.15.92:0/471686434 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f190df5f640 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 0x55f19e654d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f190cf5d640 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e275390 0x55f19e648eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f190d75e640 1 -- 172.21.15.92:0/471686434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e275390 msgr2=0x55f19e648eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f190d75e640 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e275390 0x55f19e648eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f190d75e640 1 -- 172.21.15.92:0/471686434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 msgr2=0x55f19e654d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f190d75e640 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 0x55f19e654d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f190d75e640 1 -- 172.21.15.92:0/471686434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f19e56bc40 con 0x55f19e26d1b0 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f190df5f640 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 0x55f19e654d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:18.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f190d75e640 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e648970 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f19040b8010 tx=0x7f1904004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22f8614b35bf2fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f18f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f18f0ff9640 1 -- 172.21.15.92:0/471686434 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040ac7e0 con 0x55f19e26d1b0 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f18f0ff9640 1 -- 172.21.15.92:0/471686434 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f19040b88e0 con 0x55f19e26d1b0 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f1915f36740 1 -- 172.21.15.92:0/471686434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19040acb80 con 0x55f19e26d1b0 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f18f0ff9640 1 -- 172.21.15.92:0/471686434 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f19040ad770 con 0x55f19e26d1b0 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f1915f36740 10 client.17457 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f1915f36740 1 -- 172.21.15.92:0/471686434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f19e657740 con 0x55f19e26d1b0 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.482+0000 7f18f0ff9640 1 -- 172.21.15.92:0/471686434 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19040acb80 con 0x55f19e26d1b0 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.483+0000 7f18f0ff9640 1 -- 172.21.15.92:0/471686434 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f19040b6ce0 con 0x55f19e26d1b0 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.483+0000 7f1915f36740 10 client.17457 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.483+0000 7f1915f36740 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.483+0000 7f1915f36740 20 client.17457 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.483+0000 7f1915f36740 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f19e2549f0 0x55f19e65aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.483+0000 7f1915f36740 4 client.17457 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:18.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.483+0000 7f1915f36740 1 -- 172.21.15.92:0/471686434 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f19e5b5da0 con 0x55f19e2549f0 2024-09-21T07:19:18.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.483+0000 7f190cf5d640 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f19e2549f0 0x55f19e65aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.483+0000 7f18f0ff9640 10 client.17457 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:18.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.483+0000 7f190cf5d640 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f19e2549f0 0x55f19e65aaa0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d83982b0ee83c872 server_cookie=8be6b895812836c3 in_seq=0 out_seq=0 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f18f0ff9640 1 -- 172.21.15.92:0/471686434 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f19e5b5da0 con 0x55f19e2549f0 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f18f0ff9640 10 client.17457 handle_command_reply: tid=0 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f1915f36740 1 client.17457 shutdown 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f1915f36740 1 -- 172.21.15.92:0/471686434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 msgr2=0x55f19e648970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f1915f36740 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e648970 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f19040b8010 tx=0x7f1904004730 comp rx=0 tx=0).stop 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f1915f36740 1 -- 172.21.15.92:0/471686434 shutdown_connections 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f1915f36740 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f19e2549f0 0x55f19e65aaa0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f1915f36740 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e296070 0x55f19e654d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f1915f36740 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e275390 0x55f19e648eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f1915f36740 1 --2- 172.21.15.92:0/471686434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e648970 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f18f0ff9640 0 client.17457 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.484+0000 7f1915f36740 1 -- 172.21.15.92:0/471686434 >> 172.21.15.92:0/471686434 conn(0x55f19e28a460 msgr2=0x55f19e640400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:18.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.485+0000 7f1915f36740 1 -- 172.21.15.92:0/471686434 shutdown_connections 2024-09-21T07:19:18.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.485+0000 7f1915f36740 1 -- 172.21.15.92:0/471686434 wait complete. 2024-09-21T07:19:18.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.485+0000 7f1915f36740 20 client.17457 trim_cache size 0 max 16384 2024-09-21T07:19:18.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.502+0000 7f1915f36740 1 Processor -- start 2024-09-21T07:19:18.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.502+0000 7f1915f36740 1 -- start start 2024-09-21T07:19:18.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.502+0000 7f1915f36740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 0x55f19e640a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.502+0000 7f1915f36740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e645b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.502+0000 7f1915f36740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 0x55f19e6460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.502+0000 7f1915f36740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19081b3080 con 0x55f19e26d1b0 2024-09-21T07:19:18.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.502+0000 7f1915f36740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f19081b4bc0 con 0x55f19e275390 2024-09-21T07:19:18.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.502+0000 7f1915f36740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f19081b3750 con 0x55f19e2549f0 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190cf5d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e645b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190cf5d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e645b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41868/0 (socket says 172.21.15.92:41868) 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190cf5d640 1 -- 172.21.15.92:0/2966841122 learned_addr learned my addr 172.21.15.92:0/2966841122 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190df5f640 1 --2- 172.21.15.92:0/2966841122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 0x55f19e6460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190d75e640 1 --2- 172.21.15.92:0/2966841122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 0x55f19e640a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190cf5d640 1 -- 172.21.15.92:0/2966841122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 msgr2=0x55f19e640a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190cf5d640 1 --2- 172.21.15.92:0/2966841122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 0x55f19e640a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190cf5d640 1 -- 172.21.15.92:0/2966841122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 msgr2=0x55f19e6460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190cf5d640 1 --2- 172.21.15.92:0/2966841122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 0x55f19e6460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190cf5d640 1 -- 172.21.15.92:0/2966841122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f19e643580 con 0x55f19e26d1b0 2024-09-21T07:19:18.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190d75e640 1 --2- 172.21.15.92:0/2966841122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 0x55f19e640a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:18.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f190cf5d640 1 --2- 172.21.15.92:0/2966841122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e645b60 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f18f8005940 tx=0x7f18f80058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23fa22516619851 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:18.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f18f2ffd640 1 -- 172.21.15.92:0/2966841122 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8049020 con 0x55f19e26d1b0 2024-09-21T07:19:18.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f18f2ffd640 1 -- 172.21.15.92:0/2966841122 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18f8031e50 con 0x55f19e26d1b0 2024-09-21T07:19:18.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.503+0000 7f18f2ffd640 1 -- 172.21.15.92:0/2966841122 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8035040 con 0x55f19e26d1b0 2024-09-21T07:19:18.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 -- 172.21.15.92:0/2966841122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 msgr2=0x55f19e645b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 --2- 172.21.15.92:0/2966841122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e645b60 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f18f8005940 tx=0x7f18f80058d0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 -- 172.21.15.92:0/2966841122 shutdown_connections 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 --2- 172.21.15.92:0/2966841122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 0x55f19e6460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 --2- 172.21.15.92:0/2966841122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e645b60 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 --2- 172.21.15.92:0/2966841122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 0x55f19e640a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 -- 172.21.15.92:0/2966841122 >> 172.21.15.92:0/2966841122 conn(0x55f19e28a460 msgr2=0x55f19e640370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 -- 172.21.15.92:0/2966841122 shutdown_connections 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 -- 172.21.15.92:0/2966841122 wait complete. 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 -- start start 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.505+0000 7f1915f36740 1 Processor -- start 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f1915f36740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 0x55f19e65bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f1915f36740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e65c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f1915f36740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 0x55f19e6c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f1915f36740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19081b44f0 con 0x55f19e26d1b0 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f1915f36740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f19081b3e20 con 0x55f19e275390 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f1915f36740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f19081b1060 con 0x55f19e2549f0 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f1915f36740 10 client.0 _ll_register_callbacks cb 0x7f19040d0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190cf5d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e65c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190cf5d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e65c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41872/0 (socket says 172.21.15.92:41872) 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190cf5d640 1 -- 172.21.15.92:0/3438221453 learned_addr learned my addr 172.21.15.92:0/3438221453 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190d75e640 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 0x55f19e65bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190df5f640 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 0x55f19e6c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190cf5d640 1 -- 172.21.15.92:0/3438221453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 msgr2=0x55f19e65bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190cf5d640 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 0x55f19e65bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190cf5d640 1 -- 172.21.15.92:0/3438221453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 msgr2=0x55f19e6c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:18.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190cf5d640 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 0x55f19e6c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190cf5d640 1 -- 172.21.15.92:0/3438221453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f19e65cac0 con 0x55f19e26d1b0 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190d75e640 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 0x55f19e65bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.506+0000 7f190df5f640 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 0x55f19e6c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f190cf5d640 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e65c2a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009230 tx=0x7f18f8003750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d8c6b56659b3b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f18f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f18f0ff9640 1 -- 172.21.15.92:0/3438221453 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8035040 con 0x55f19e26d1b0 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f18f0ff9640 1 -- 172.21.15.92:0/3438221453 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f18f8031600 con 0x55f19e26d1b0 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f1915f36740 1 -- 172.21.15.92:0/3438221453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18f8031e50 con 0x55f19e26d1b0 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f18f0ff9640 1 -- 172.21.15.92:0/3438221453 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f18f8061050 con 0x55f19e26d1b0 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f1915f36740 10 client.17463 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f1915f36740 1 -- 172.21.15.92:0/3438221453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f19e6c5740 con 0x55f19e26d1b0 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f18f0ff9640 1 -- 172.21.15.92:0/3438221453 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18f8031e50 con 0x55f19e26d1b0 2024-09-21T07:19:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f18f0ff9640 1 -- 172.21.15.92:0/3438221453 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f18f803c740 con 0x55f19e26d1b0 2024-09-21T07:19:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f1915f36740 10 client.17463 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.507+0000 7f1915f36740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:19:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.508+0000 7f1915f36740 20 client.17463 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.508+0000 7f1915f36740 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f19e296070 0x55f19e6c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.508+0000 7f1915f36740 4 client.17463 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:19:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.508+0000 7f1915f36740 1 -- 172.21.15.92:0/3438221453 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f19e5b1850 con 0x55f19e296070 2024-09-21T07:19:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.508+0000 7f190d75e640 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f19e296070 0x55f19e6c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.508+0000 7f18f0ff9640 10 client.17463 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.508+0000 7f190d75e640 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f19e296070 0x55f19e6c7e00 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee7100453fd129a9 server_cookie=d9ae10e4fef980f8 in_seq=0 out_seq=0 2024-09-21T07:19:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f18f0ff9640 1 -- 172.21.15.92:0/3438221453 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x55f19e5b1850 con 0x55f19e296070 2024-09-21T07:19:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f18f0ff9640 10 client.17463 handle_command_reply: tid=0 2024-09-21T07:19:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 client.17463 shutdown 2024-09-21T07:19:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 -- 172.21.15.92:0/3438221453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 msgr2=0x55f19e65c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e65c2a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009230 tx=0x7f18f8003750 comp rx=0 tx=0).stop 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 -- 172.21.15.92:0/3438221453 shutdown_connections 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f19e296070 0x55f19e6c7e00 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f19e275390 0x55f19e6c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f19e26d1b0 0x55f19e65c2a0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f18f0ff9640 0 client.17463 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 --2- 172.21.15.92:0/3438221453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19e2549f0 0x55f19e65bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 -- 172.21.15.92:0/3438221453 >> 172.21.15.92:0/3438221453 conn(0x55f19e28a460 msgr2=0x55f19e648720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 -- 172.21.15.92:0/3438221453 shutdown_connections 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 1 -- 172.21.15.92:0/3438221453 wait complete. 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.509+0000 7f1915f36740 20 client.17463 trim_cache size 0 max 16384 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:19:18.515 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "948a50ad-2413-4f45-8f96-803f86b37155", 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:18.516 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:19:18.517 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:18.518 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:18.519 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:18.520 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:18.521 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:18.521 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:18.521 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:19:18.521 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:19:18.521 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:19:18.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 -- 172.21.15.92:0/1393952042 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f18f40b6680 msgr2=0x7f18f40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:18.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f18f40b6680 0x7f18f40b8b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1900005c40 tx=0x7f1900005bd0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 -- 172.21.15.92:0/1393952042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908102a60 msgr2=0x7f190819c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908102a60 0x7f190819c5e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f190400d950 tx=0x7f190400de10 comp rx=0 tx=0).stop 2024-09-21T07:19:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 -- 172.21.15.92:0/1393952042 shutdown_connections 2024-09-21T07:19:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f18f40b6680 0x7f18f40b8b90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1908108cf0 0x7f19081a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19081083a0 0x7f190819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 --2- 172.21.15.92:0/1393952042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908102a60 0x7f190819c5e0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 -- 172.21.15.92:0/1393952042 >> 172.21.15.92:0/1393952042 conn(0x7f1908079760 msgr2=0x7f1908106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 -- 172.21.15.92:0/1393952042 shutdown_connections 2024-09-21T07:19:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:18.510+0000 7f190f9c2640 1 -- 172.21.15.92:0/1393952042 wait complete. 2024-09-21T07:19:19.465 INFO:tasks.cephfs.filesystem:scrub status for tag:948a50ad-2413-4f45-8f96-803f86b37155 - {'path': '/', 'tag': '948a50ad-2413-4f45-8f96-803f86b37155', 'options': 'recursive,force'} 2024-09-21T07:19:20.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:19 smithi092 ceph-mon[30987]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:19:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:19 smithi169 ceph-mon[33705]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:19:20.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:19 smithi175 ceph-mon[34064]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:19:21.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:20 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:19:21.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:20 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:19:21.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:20 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:19:22.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:21 smithi092 ceph-mon[30987]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T07:19:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:21 smithi169 ceph-mon[33705]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T07:19:22.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:21 smithi175 ceph-mon[34064]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T07:19:24.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:23 smithi092 ceph-mon[30987]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-21T07:19:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:23 smithi169 ceph-mon[33705]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-21T07:19:24.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:23 smithi175 ceph-mon[34064]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-21T07:19:26.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:25 smithi092 ceph-mon[30987]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:19:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:25 smithi169 ceph-mon[33705]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:19:26.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:25 smithi175 ceph-mon[34064]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:19:28.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:27 smithi092 ceph-mon[30987]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 op/s 2024-09-21T07:19:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:27 smithi169 ceph-mon[33705]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 op/s 2024-09-21T07:19:28.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:27 smithi175 ceph-mon[34064]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 op/s 2024-09-21T07:19:30.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:29 smithi092 ceph-mon[30987]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-21T07:19:30.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:29 smithi169 ceph-mon[33705]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-21T07:19:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:29 smithi175 ceph-mon[34064]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-21T07:19:32.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:31 smithi092 ceph-mon[30987]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T07:19:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:31 smithi169 ceph-mon[33705]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T07:19:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:31 smithi175 ceph-mon[34064]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-09-21T07:19:34.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:33 smithi092 ceph-mon[30987]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-21T07:19:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:33 smithi169 ceph-mon[33705]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-21T07:19:34.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:33 smithi175 ceph-mon[34064]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-21T07:19:36.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:35 smithi092 ceph-mon[30987]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:36.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:35 smithi169 ceph-mon[33705]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:36.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:35 smithi175 ceph-mon[34064]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:38.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:37 smithi092 ceph-mon[30987]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:19:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:37 smithi169 ceph-mon[33705]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:19:38.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:37 smithi175 ceph-mon[34064]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:19:40.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:39 smithi092 ceph-mon[30987]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:39 smithi169 ceph-mon[33705]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:40.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:39 smithi175 ceph-mon[34064]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:42.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:41 smithi092 ceph-mon[30987]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:19:42.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:41 smithi169 ceph-mon[33705]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:19:42.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:41 smithi175 ceph-mon[34064]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:19:44.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:43 smithi092 ceph-mon[30987]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:19:44.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:43 smithi169 ceph-mon[33705]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:19:44.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:43 smithi175 ceph-mon[34064]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:19:46.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:45 smithi092 ceph-mon[30987]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:46.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:45 smithi169 ceph-mon[33705]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:46.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:45 smithi175 ceph-mon[34064]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:48.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:47 smithi092 ceph-mon[30987]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:19:48.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:47 smithi169 ceph-mon[33705]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:19:48.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:47 smithi175 ceph-mon[34064]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:19:49.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:19:49.743 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:50.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:49 smithi092 ceph-mon[30987]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:50.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:49 smithi169 ceph-mon[33705]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.233+0000 7fa4138ab640 1 -- 172.21.15.92:0/1023155567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa40c103b80 msgr2=0x7fa40c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.233+0000 7fa4138ab640 1 --2- 172.21.15.92:0/1023155567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa40c103b80 0x7fa40c103f90 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa408009900 tx=0x7fa40802a410 comp rx=0 tx=0).stop 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.233+0000 7fa4138ab640 1 -- 172.21.15.92:0/1023155567 shutdown_connections 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.233+0000 7fa4138ab640 1 --2- 172.21.15.92:0/1023155567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa40c109e10 0x7fa40c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.233+0000 7fa4138ab640 1 --2- 172.21.15.92:0/1023155567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa40c1094c0 0x7fa40c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.233+0000 7fa4138ab640 1 --2- 172.21.15.92:0/1023155567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa40c103b80 0x7fa40c103f90 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.233+0000 7fa4138ab640 1 -- 172.21.15.92:0/1023155567 >> 172.21.15.92:0/1023155567 conn(0x7fa40c0ff5d0 msgr2=0x7fa40c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.233+0000 7fa4138ab640 1 -- 172.21.15.92:0/1023155567 shutdown_connections 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.233+0000 7fa4138ab640 1 -- 172.21.15.92:0/1023155567 wait complete. 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa4138ab640 1 Processor -- start 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa4138ab640 1 -- start start 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa4138ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa40c103b80 0x7fa40c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa4138ab640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa40c1094c0 0x7fa40c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa4138ab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa40c109e10 0x7fa40c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa4138ab640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c113980 con 0x7fa40c103b80 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa4138ab640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c113800 con 0x7fa40c1094c0 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa4138ab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c113b00 con 0x7fa40c109e10 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa411647640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa40c103b80 0x7fa40c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa411647640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa40c103b80 0x7fa40c19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58060/0 (socket says 172.21.15.92:58060) 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa411647640 1 -- 172.21.15.92:0/2749213716 learned_addr learned my addr 172.21.15.92:0/2749213716 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa410e46640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa40c1094c0 0x7fa40c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa411e48640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa40c109e10 0x7fa40c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa411647640 1 -- 172.21.15.92:0/2749213716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa40c109e10 msgr2=0x7fa40c19fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa411647640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa40c109e10 0x7fa40c19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa411647640 1 -- 172.21.15.92:0/2749213716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa40c1094c0 msgr2=0x7fa40c19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa411647640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa40c1094c0 0x7fa40c19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.234+0000 7fa411647640 1 -- 172.21.15.92:0/2749213716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40c1a0360 con 0x7fa40c103b80 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.235+0000 7fa411647640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa40c103b80 0x7fa40c19a3f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa408009230 tx=0x7fa408004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.235+0000 7fa4027fc640 1 -- 172.21.15.92:0/2749213716 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40803f030 con 0x7fa40c103b80 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.235+0000 7fa4027fc640 1 -- 172.21.15.92:0/2749213716 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa408003a80 con 0x7fa40c103b80 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.235+0000 7fa4138ab640 1 -- 172.21.15.92:0/2749213716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa40c1a05f0 con 0x7fa40c103b80 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.235+0000 7fa4027fc640 1 -- 172.21.15.92:0/2749213716 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408035070 con 0x7fa40c103b80 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.235+0000 7fa4138ab640 1 -- 172.21.15.92:0/2749213716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa40c1a6db0 con 0x7fa40c103b80 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.237+0000 7fa419e1f740 1 Processor -- start 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.237+0000 7fa419e1f740 1 -- start start 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa4027fc640 1 -- 172.21.15.92:0/2749213716 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fa408042030 con 0x7fa40c103b80 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f9a070 0x55ded8341650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f711b0 0x55ded8341b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f79390 0x55ded83420d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa419e1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ded82b7e50 con 0x55ded7f79390 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa419e1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ded82a7280 con 0x55ded7f711b0 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa419e1f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ded82ab090 con 0x55ded7f9a070 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa410e46640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f79390 0x55ded83420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa410e46640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f79390 0x55ded83420d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58066/0 (socket says 172.21.15.92:58066) 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa410e46640 1 -- 172.21.15.92:0/3890079883 learned_addr learned my addr 172.21.15.92:0/3890079883 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa411e48640 1 --2- 172.21.15.92:0/3890079883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f9a070 0x55ded8341650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa411647640 1 --2- 172.21.15.92:0/3890079883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f711b0 0x55ded8341b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa410e46640 1 -- 172.21.15.92:0/3890079883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f9a070 msgr2=0x55ded8341650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa410e46640 1 --2- 172.21.15.92:0/3890079883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f9a070 0x55ded8341650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa410e46640 1 -- 172.21.15.92:0/3890079883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f711b0 msgr2=0x55ded8341b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa410e46640 1 --2- 172.21.15.92:0/3890079883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f711b0 0x55ded8341b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa410e46640 1 -- 172.21.15.92:0/3890079883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded8005650 con 0x55ded7f79390 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.238+0000 7fa410e46640 1 --2- 172.21.15.92:0/3890079883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f79390 0x55ded83420d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b690 tx=0x7fa3fc00bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78727f48683ca840 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.239+0000 7fa4027fc640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa3f80b6680 0x7fa3f80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.239+0000 7fa3f77fe640 1 -- 172.21.15.92:0/3890079883 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc003bd0 con 0x55ded7f79390 2024-09-21T07:19:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.239+0000 7fa411e48640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa3f80b6680 0x7fa3f80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.239+0000 7fa3f77fe640 1 -- 172.21.15.92:0/3890079883 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3fc015070 con 0x55ded7f79390 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.239+0000 7fa3f77fe640 1 -- 172.21.15.92:0/3890079883 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc004c40 con 0x55ded7f79390 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.239+0000 7fa4027fc640 1 -- 172.21.15.92:0/2749213716 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa408108060 con 0x7fa40c103b80 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa411e48640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa3f80b6680 0x7fa3f80b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa404005fd0 tx=0x7fa4040096c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 -- 172.21.15.92:0/3890079883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f79390 msgr2=0x55ded83420d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 --2- 172.21.15.92:0/3890079883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f79390 0x55ded83420d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b690 tx=0x7fa3fc00bb50 comp rx=0 tx=0).stop 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 -- 172.21.15.92:0/3890079883 shutdown_connections 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 --2- 172.21.15.92:0/3890079883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f79390 0x55ded83420d0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 --2- 172.21.15.92:0/3890079883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f711b0 0x55ded8341b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 --2- 172.21.15.92:0/3890079883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f9a070 0x55ded8341650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 -- 172.21.15.92:0/3890079883 >> 172.21.15.92:0/3890079883 conn(0x55ded7f8e460 msgr2=0x55ded833f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 -- 172.21.15.92:0/3890079883 shutdown_connections 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 -- 172.21.15.92:0/3890079883 wait complete. 2024-09-21T07:19:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 -- start start 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.240+0000 7fa419e1f740 1 Processor -- start 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f711b0 0x55ded834cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f79390 0x55ded834d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f9a070 0x55ded8359120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa419e1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ded8108700 con 0x55ded7f9a070 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa419e1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ded8242110 con 0x55ded7f711b0 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa419e1f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ded834fe30 con 0x55ded7f79390 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa419e1f740 10 client.0 _ll_register_callbacks cb 0x55ded825b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa411e48640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f9a070 0x55ded8359120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa411e48640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f9a070 0x55ded8359120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58080/0 (socket says 172.21.15.92:58080) 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa411e48640 1 -- 172.21.15.92:0/2344657430 learned_addr learned my addr 172.21.15.92:0/2344657430 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa411647640 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f711b0 0x55ded834cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa410e46640 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f79390 0x55ded834d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa411e48640 1 -- 172.21.15.92:0/2344657430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f79390 msgr2=0x55ded834d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa411e48640 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f79390 0x55ded834d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa411e48640 1 -- 172.21.15.92:0/2344657430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f711b0 msgr2=0x55ded834cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa411e48640 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f711b0 0x55ded834cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.241+0000 7fa411e48640 1 -- 172.21.15.92:0/2344657430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded826fc40 con 0x55ded7f9a070 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa411e48640 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f9a070 0x55ded8359120 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa404012010 tx=0x7fa404004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0453f8da3b800d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa3f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/2344657430 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40400ece0 con 0x55ded7f9a070 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/2344657430 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa40401f420 con 0x55ded7f9a070 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa419e1f740 1 -- 172.21.15.92:0/2344657430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3fc015070 con 0x55ded7f9a070 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/2344657430 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa404030050 con 0x55ded7f9a070 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa419e1f740 10 client.17475 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa419e1f740 1 -- 172.21.15.92:0/2344657430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ded835bbd0 con 0x55ded7f9a070 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/2344657430 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3fc015070 con 0x55ded7f9a070 2024-09-21T07:19:50.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/2344657430 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa40400f040 con 0x55ded7f9a070 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa419e1f740 10 client.17475 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.242+0000 7fa419e1f740 10 client.17475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.243+0000 7fa419e1f740 20 client.17475 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.243+0000 7fa419e1f740 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded7f589f0 0x55ded835f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.243+0000 7fa419e1f740 4 client.17475 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.243+0000 7fa419e1f740 1 -- 172.21.15.92:0/2344657430 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ded82b9da0 con 0x55ded7f589f0 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.243+0000 7fa411647640 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded7f589f0 0x55ded835f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.243+0000 7fa3f4ff9640 10 client.17475 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.243+0000 7fa411647640 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded7f589f0 0x55ded835f170 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=def60724d8c974e3 server_cookie=eba5e76903636334 in_seq=0 out_seq=0 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/2344657430 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ded82b9da0 con 0x55ded7f589f0 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa3f4ff9640 10 client.17475 handle_command_reply: tid=0 2024-09-21T07:19:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa419e1f740 1 client.17475 shutdown 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa419e1f740 1 -- 172.21.15.92:0/2344657430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f9a070 msgr2=0x55ded8359120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa419e1f740 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f9a070 0x55ded8359120 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa404012010 tx=0x7fa404004a40 comp rx=0 tx=0).stop 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa419e1f740 1 -- 172.21.15.92:0/2344657430 shutdown_connections 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa419e1f740 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded7f589f0 0x55ded835f170 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa3f4ff9640 0 client.17475 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa419e1f740 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f9a070 0x55ded8359120 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa419e1f740 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f79390 0x55ded834d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa419e1f740 1 --2- 172.21.15.92:0/2344657430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f711b0 0x55ded834cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.244+0000 7fa419e1f740 1 -- 172.21.15.92:0/2344657430 >> 172.21.15.92:0/2344657430 conn(0x55ded7f8e460 msgr2=0x55ded83447e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.245+0000 7fa419e1f740 1 -- 172.21.15.92:0/2344657430 shutdown_connections 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.245+0000 7fa419e1f740 1 -- 172.21.15.92:0/2344657430 wait complete. 2024-09-21T07:19:50.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.245+0000 7fa419e1f740 20 client.17475 trim_cache size 0 max 16384 2024-09-21T07:19:50.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa419e1f740 1 Processor -- start 2024-09-21T07:19:50.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa419e1f740 1 -- start start 2024-09-21T07:19:50.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f589f0 0x55ded834d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f711b0 0x55ded833eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f79390 0x55ded833f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa419e1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c1b0e10 con 0x55ded7f711b0 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa419e1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c1b2950 con 0x55ded7f79390 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa419e1f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c1b14e0 con 0x55ded7f589f0 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa410e46640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f711b0 0x55ded833eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa410e46640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f711b0 0x55ded833eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58092/0 (socket says 172.21.15.92:58092) 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa410e46640 1 -- 172.21.15.92:0/2859039818 learned_addr learned my addr 172.21.15.92:0/2859039818 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa411647640 1 --2- 172.21.15.92:0/2859039818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f589f0 0x55ded834d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa410e46640 1 -- 172.21.15.92:0/2859039818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f589f0 msgr2=0x55ded834d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa410e46640 1 --2- 172.21.15.92:0/2859039818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f589f0 0x55ded834d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa410e46640 1 -- 172.21.15.92:0/2859039818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f79390 msgr2=0x55ded833f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa410e46640 1 --2- 172.21.15.92:0/2859039818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f79390 0x55ded833f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.262+0000 7fa410e46640 1 -- 172.21.15.92:0/2859039818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded834bc20 con 0x55ded7f711b0 2024-09-21T07:19:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa410e46640 1 --2- 172.21.15.92:0/2859039818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f711b0 0x55ded833eb70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0039c0 tx=0x7fa3fc005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ef63289ef4254d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa3f6ffd640 1 -- 172.21.15.92:0/2859039818 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc003bd0 con 0x55ded7f711b0 2024-09-21T07:19:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa3f6ffd640 1 -- 172.21.15.92:0/2859039818 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3fc015050 con 0x55ded7f711b0 2024-09-21T07:19:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa3f6ffd640 1 -- 172.21.15.92:0/2859039818 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc011440 con 0x55ded7f711b0 2024-09-21T07:19:50.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa419e1f740 1 -- 172.21.15.92:0/2859039818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f711b0 msgr2=0x55ded833eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:50.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa419e1f740 1 --2- 172.21.15.92:0/2859039818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f711b0 0x55ded833eb70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0039c0 tx=0x7fa3fc005f70 comp rx=0 tx=0).stop 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa419e1f740 1 -- 172.21.15.92:0/2859039818 shutdown_connections 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa419e1f740 1 --2- 172.21.15.92:0/2859039818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f79390 0x55ded833f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa419e1f740 1 --2- 172.21.15.92:0/2859039818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f711b0 0x55ded833eb70 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa419e1f740 1 --2- 172.21.15.92:0/2859039818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f589f0 0x55ded834d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.263+0000 7fa419e1f740 1 -- 172.21.15.92:0/2859039818 >> 172.21.15.92:0/2859039818 conn(0x55ded7f8e460 msgr2=0x55ded834cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.264+0000 7fa419e1f740 1 -- 172.21.15.92:0/2859039818 shutdown_connections 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.264+0000 7fa419e1f740 1 -- 172.21.15.92:0/2859039818 wait complete. 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.264+0000 7fa419e1f740 1 -- start start 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.264+0000 7fa419e1f740 1 Processor -- start 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.264+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f589f0 0x55ded8351280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.264+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f711b0 0x55ded83517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.264+0000 7fa419e1f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f79390 0x55ded8351d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.264+0000 7fa419e1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c1b2280 con 0x55ded7f589f0 2024-09-21T07:19:50.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.264+0000 7fa419e1f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c1b1bb0 con 0x55ded7f79390 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.264+0000 7fa419e1f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c1aedf0 con 0x55ded7f711b0 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa419e1f740 10 client.0 _ll_register_callbacks cb 0x7fa404009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411647640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f589f0 0x55ded8351280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411647640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f589f0 0x55ded8351280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58100/0 (socket says 172.21.15.92:58100) 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411647640 1 -- 172.21.15.92:0/1248768597 learned_addr learned my addr 172.21.15.92:0/1248768597 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa410e46640 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f711b0 0x55ded83517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411e48640 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f79390 0x55ded8351d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411647640 1 -- 172.21.15.92:0/1248768597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f711b0 msgr2=0x55ded83517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411647640 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f711b0 0x55ded83517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411647640 1 -- 172.21.15.92:0/1248768597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f79390 msgr2=0x55ded8351d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:50.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411647640 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f79390 0x55ded8351d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411647640 1 -- 172.21.15.92:0/1248768597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded83c8d30 con 0x55ded7f589f0 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411e48640 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f79390 0x55ded8351d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa410e46640 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f711b0 0x55ded83517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa411647640 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f589f0 0x55ded8351280 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa408105470 tx=0x7fa40810bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661d1efdeb48a069 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa3f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/1248768597 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408049040 con 0x55ded7f589f0 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/1248768597 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa4080c9d80 con 0x55ded7f589f0 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa419e1f740 1 -- 172.21.15.92:0/1248768597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3fc015050 con 0x55ded7f589f0 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/1248768597 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa4080cd460 con 0x55ded7f589f0 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa419e1f740 10 client.17481 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.265+0000 7fa419e1f740 1 -- 172.21.15.92:0/1248768597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ded83ca000 con 0x55ded7f589f0 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.266+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/1248768597 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3fc015050 con 0x55ded7f589f0 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.266+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/1248768597 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa4080d21b0 con 0x55ded7f589f0 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.266+0000 7fa419e1f740 10 client.17481 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:50.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.266+0000 7fa419e1f740 10 client.17481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.266+0000 7fa419e1f740 20 client.17481 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.266+0000 7fa419e1f740 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded7f9a070 0x55ded83cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.266+0000 7fa419e1f740 4 client.17481 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.266+0000 7fa419e1f740 1 -- 172.21.15.92:0/1248768597 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ded83598d0 con 0x55ded7f9a070 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.266+0000 7fa410e46640 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded7f9a070 0x55ded83cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa3f4ff9640 10 client.17481 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa410e46640 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded7f9a070 0x55ded83cc790 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b93334823caec062 server_cookie=c92b7d9f67de4d72 in_seq=0 out_seq=0 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa3f4ff9640 1 -- 172.21.15.92:0/1248768597 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55ded83598d0 con 0x55ded7f9a070 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa3f4ff9640 10 client.17481 handle_command_reply: tid=0 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 client.17481 shutdown 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 -- 172.21.15.92:0/1248768597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f589f0 msgr2=0x55ded8351280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:50.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f589f0 0x55ded8351280 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa408105470 tx=0x7fa40810bdc0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 -- 172.21.15.92:0/1248768597 shutdown_connections 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55ded7f9a070 0x55ded83cc790 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded7f79390 0x55ded8351d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded7f711b0 0x55ded83517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 --2- 172.21.15.92:0/1248768597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ded7f589f0 0x55ded8351280 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 -- 172.21.15.92:0/1248768597 >> 172.21.15.92:0/1248768597 conn(0x55ded7f8e460 msgr2=0x55ded8342680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa3f4ff9640 0 client.17481 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 -- 172.21.15.92:0/1248768597 shutdown_connections 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 1 -- 172.21.15.92:0/1248768597 wait complete. 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.267+0000 7fa419e1f740 20 client.17481 trim_cache size 0 max 16384 2024-09-21T07:19:50.274 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:50.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:50.276 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:19:50.277 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:50.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:19:50.279 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:19:50.280 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:19:50.280 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:19:50.280 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:19:50.280 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:19:50.280 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 -- 172.21.15.92:0/2749213716 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa3f80b6680 msgr2=0x7fa3f80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa3f80b6680 0x7fa3f80b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa404005fd0 tx=0x7fa4040096c0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 -- 172.21.15.92:0/2749213716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa40c103b80 msgr2=0x7fa40c19a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa40c103b80 0x7fa40c19a3f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa408009230 tx=0x7fa408004270 comp rx=0 tx=0).stop 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 -- 172.21.15.92:0/2749213716 shutdown_connections 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa3f80b6680 0x7fa3f80b8b90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa40c109e10 0x7fa40c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa40c1094c0 0x7fa40c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 --2- 172.21.15.92:0/2749213716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa40c103b80 0x7fa40c19a3f0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 -- 172.21.15.92:0/2749213716 >> 172.21.15.92:0/2749213716 conn(0x7fa40c0ff5d0 msgr2=0x7fa40c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:50.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 -- 172.21.15.92:0/2749213716 shutdown_connections 2024-09-21T07:19:50.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:50.268+0000 7fa4138ab640 1 -- 172.21.15.92:0/2749213716 wait complete. 2024-09-21T07:19:50.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:49 smithi175 ceph-mon[34064]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:51.153 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:19:51.153 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:19:51.401 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:51.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.894+0000 7f218745a640 1 -- 172.21.15.92:0/2504476638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2180106bf0 msgr2=0x7f2180110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:51.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.894+0000 7f218745a640 1 --2- 172.21.15.92:0/2504476638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2180106bf0 0x7f2180110660 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2178009ca0 tx=0x7f217802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:19:51.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.894+0000 7f218745a640 1 -- 172.21.15.92:0/2504476638 shutdown_connections 2024-09-21T07:19:51.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.894+0000 7f218745a640 1 --2- 172.21.15.92:0/2504476638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2180106bf0 0x7f2180110660 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:51.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.894+0000 7f218745a640 1 --2- 172.21.15.92:0/2504476638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21801062a0 0x7f21801066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:51.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.894+0000 7f218745a640 1 --2- 172.21.15.92:0/2504476638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2180102050 0x7f2180102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.894+0000 7f218745a640 1 -- 172.21.15.92:0/2504476638 >> 172.21.15.92:0/2504476638 conn(0x7f2180077c60 msgr2=0x7f21800780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.894+0000 7f218745a640 1 -- 172.21.15.92:0/2504476638 shutdown_connections 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.894+0000 7f218745a640 1 -- 172.21.15.92:0/2504476638 wait complete. 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f218745a640 1 Processor -- start 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f218745a640 1 -- start start 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f218745a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2180102050 0x7f218019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f218745a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21801062a0 0x7f218019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f218745a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2180106bf0 0x7f218019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f218745a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2180113970 con 0x7f21801062a0 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f218745a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f21801137f0 con 0x7f2180106bf0 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f218745a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2180113af0 con 0x7f2180102050 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f21849f5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21801062a0 0x7f218019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f21849f5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21801062a0 0x7f218019a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58120/0 (socket says 172.21.15.92:58120) 2024-09-21T07:19:51.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.895+0000 7f21849f5640 1 -- 172.21.15.92:0/3643606189 learned_addr learned my addr 172.21.15.92:0/3643606189 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21851f6640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2180102050 0x7f218019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21859f7640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2180106bf0 0x7f218019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21849f5640 1 -- 172.21.15.92:0/3643606189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2180102050 msgr2=0x7f218019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21849f5640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2180102050 0x7f218019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21849f5640 1 -- 172.21.15.92:0/3643606189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2180106bf0 msgr2=0x7f218019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21849f5640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2180106bf0 0x7f218019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21849f5640 1 -- 172.21.15.92:0/3643606189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21801a0310 con 0x7f21801062a0 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21849f5640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21801062a0 0x7f218019a940 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f217400c970 tx=0x7f217400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21727fc640 1 -- 172.21.15.92:0/3643606189 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174007bb0 con 0x7f21801062a0 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21727fc640 1 -- 172.21.15.92:0/3643606189 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2174007d50 con 0x7f21801062a0 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f218745a640 1 -- 172.21.15.92:0/3643606189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21801a0600 con 0x7f21801062a0 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f21727fc640 1 -- 172.21.15.92:0/3643606189 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174004da0 con 0x7f21801062a0 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.896+0000 7f218745a640 1 -- 172.21.15.92:0/3643606189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21801a6d60 con 0x7f21801062a0 2024-09-21T07:19:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.897+0000 7f218745a640 1 -- 172.21.15.92:0/3643606189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2180102460 con 0x7f21801062a0 2024-09-21T07:19:51.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.899+0000 7f21727fc640 1 -- 172.21.15.92:0/3643606189 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f2174004f60 con 0x7f21801062a0 2024-09-21T07:19:51.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.900+0000 7f21727fc640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f216c0b6680 0x7f216c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:51.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.900+0000 7f21851f6640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f216c0b6680 0x7f216c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:51.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.900+0000 7f21727fc640 1 -- 172.21.15.92:0/3643606189 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f21740e7cb0 con 0x7f21801062a0 2024-09-21T07:19:51.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.900+0000 7f21851f6640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f216c0b6680 0x7f216c0b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f217c005fd0 tx=0x7f217c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:51.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:51.903+0000 7f21727fc640 1 -- 172.21.15.92:0/3643606189 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2174014030 con 0x7f21801062a0 2024-09-21T07:19:52.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:51 smithi092 ceph-mon[30987]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:19:52.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.118+0000 7f218745a640 1 -- 172.21.15.92:0/3643606189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f218019b4d0 con 0x7f21801062a0 2024-09-21T07:19:52.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.119+0000 7f21727fc640 1 -- 172.21.15.92:0/3643606189 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f218019b4d0 con 0x7f21801062a0 2024-09-21T07:19:52.121 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:19:52.121 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:19:52.122 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:19:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.121+0000 7f218745a640 1 -- 172.21.15.92:0/3643606189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f216c0b6680 msgr2=0x7f216c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.121+0000 7f218745a640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f216c0b6680 0x7f216c0b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f217c005fd0 tx=0x7f217c005850 comp rx=0 tx=0).stop 2024-09-21T07:19:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.121+0000 7f218745a640 1 -- 172.21.15.92:0/3643606189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21801062a0 msgr2=0x7f218019a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.121+0000 7f218745a640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21801062a0 0x7f218019a940 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f217400c970 tx=0x7f217400ce30 comp rx=0 tx=0).stop 2024-09-21T07:19:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.121+0000 7f218745a640 1 -- 172.21.15.92:0/3643606189 shutdown_connections 2024-09-21T07:19:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.121+0000 7f218745a640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f216c0b6680 0x7f216c0b8b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.121+0000 7f218745a640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2180106bf0 0x7f218019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.121+0000 7f218745a640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21801062a0 0x7f218019a940 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:52.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.121+0000 7f218745a640 1 --2- 172.21.15.92:0/3643606189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2180102050 0x7f218019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:52.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.121+0000 7f218745a640 1 -- 172.21.15.92:0/3643606189 >> 172.21.15.92:0/3643606189 conn(0x7f2180077c60 msgr2=0x7f2180105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:52.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.122+0000 7f218745a640 1 -- 172.21.15.92:0/3643606189 shutdown_connections 2024-09-21T07:19:52.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:52.122+0000 7f218745a640 1 -- 172.21.15.92:0/3643606189 wait complete. 2024-09-21T07:19:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:51 smithi169 ceph-mon[33705]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:19:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:51 smithi175 ceph-mon[34064]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:19:52.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:19:53.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:52 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3643606189' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:19:53.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:52 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3643606189' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:19:53.158 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:53.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:52 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3643606189' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:19:53.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.661+0000 7fe2b1942640 1 -- 172.21.15.92:0/3670667853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2ac102a60 msgr2=0x7fe2ac102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:53.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.661+0000 7fe2b1942640 1 --2- 172.21.15.92:0/3670667853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2ac102a60 0x7fe2ac102e70 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009900 tx=0x7fe29c02a410 comp rx=0 tx=0).stop 2024-09-21T07:19:53.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.661+0000 7fe2b1942640 1 -- 172.21.15.92:0/3670667853 shutdown_connections 2024-09-21T07:19:53.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.661+0000 7fe2b1942640 1 --2- 172.21.15.92:0/3670667853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2ac108cf0 0x7fe2ac10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.661+0000 7fe2b1942640 1 --2- 172.21.15.92:0/3670667853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac1083a0 0x7fe2ac1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.661+0000 7fe2b1942640 1 --2- 172.21.15.92:0/3670667853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2ac102a60 0x7fe2ac102e70 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.661+0000 7fe2b1942640 1 -- 172.21.15.92:0/3670667853 >> 172.21.15.92:0/3670667853 conn(0x7fe2ac079730 msgr2=0x7fe2ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.661+0000 7fe2b1942640 1 -- 172.21.15.92:0/3670667853 shutdown_connections 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.661+0000 7fe2b1942640 1 -- 172.21.15.92:0/3670667853 wait complete. 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.662+0000 7fe2b1942640 1 Processor -- start 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.662+0000 7fe2b1942640 1 -- start start 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2b1942640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2ac102a60 0x7fe2ac199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2b1942640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac1083a0 0x7fe2ac1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2b1942640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2ac108cf0 0x7fe2ac19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2b1942640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac112810 con 0x7fe2ac108cf0 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2b1942640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac112690 con 0x7fe2ac102a60 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2b1942640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac112990 con 0x7fe2ac1083a0 2024-09-21T07:19:53.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2ab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2ac108cf0 0x7fe2ac19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2ab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2ac108cf0 0x7fe2ac19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58140/0 (socket says 172.21.15.92:58140) 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2ab7fe640 1 -- 172.21.15.92:0/2940763077 learned_addr learned my addr 172.21.15.92:0/2940763077 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2aaffd640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2ac102a60 0x7fe2ac199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac1083a0 0x7fe2ac1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2ab7fe640 1 -- 172.21.15.92:0/2940763077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac1083a0 msgr2=0x7fe2ac1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2ab7fe640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac1083a0 0x7fe2ac1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2ab7fe640 1 -- 172.21.15.92:0/2940763077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2ac102a60 msgr2=0x7fe2ac199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2ab7fe640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2ac102a60 0x7fe2ac199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2ab7fe640 1 -- 172.21.15.92:0/2940763077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac19f2b0 con 0x7fe2ac108cf0 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac1083a0 0x7fe2ac1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.663+0000 7fe2ab7fe640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2ac108cf0 0x7fe2ac19eb80 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400cad0 tx=0x7fe2a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.664+0000 7fe2b0940640 1 -- 172.21.15.92:0/2940763077 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a400ae20 con 0x7fe2ac108cf0 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.664+0000 7fe2b1942640 1 -- 172.21.15.92:0/2940763077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ac19f5a0 con 0x7fe2ac108cf0 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.664+0000 7fe2b0940640 1 -- 172.21.15.92:0/2940763077 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2a4005020 con 0x7fe2ac108cf0 2024-09-21T07:19:53.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.664+0000 7fe2b0940640 1 -- 172.21.15.92:0/2940763077 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a400f6b0 con 0x7fe2ac108cf0 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.664+0000 7fe2b1942640 1 -- 172.21.15.92:0/2940763077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ac1a5d00 con 0x7fe2ac108cf0 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.666+0000 7fe2b0940640 1 -- 172.21.15.92:0/2940763077 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fe2a40051d0 con 0x7fe2ac108cf0 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.666+0000 7fe2b7eb6740 1 Processor -- start 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2b7eb6740 1 -- start start 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d56070 0x560bc30fd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d2d1b0 0x560bc30fdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560bc3073ea0 con 0x560bc2d35390 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560bc30632d0 con 0x560bc2d2d1b0 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560bc30670e0 con 0x560bc2d56070 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fe120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58156/0 (socket says 172.21.15.92:58156) 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2a27fc640 1 -- 172.21.15.92:0/390311145 learned_addr learned my addr 172.21.15.92:0/390311145 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/390311145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d56070 0x560bc30fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2aaffd640 1 --2- 172.21.15.92:0/390311145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d2d1b0 0x560bc30fdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2a27fc640 1 -- 172.21.15.92:0/390311145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d56070 msgr2=0x560bc30fd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2b0940640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2980b6680 0x7fe2980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/390311145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d56070 0x560bc30fd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2a27fc640 1 -- 172.21.15.92:0/390311145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d2d1b0 msgr2=0x560bc30fdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/390311145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d2d1b0 0x560bc30fdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2a27fc640 1 -- 172.21.15.92:0/390311145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bc2dc1650 con 0x560bc2d35390 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.667+0000 7fe2ab7fe640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2980b6680 0x7fe2980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.668+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/390311145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fe120 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe294013860 tx=0x7fe29400b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12d2fc31683fe6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.668+0000 7fe2b0940640 1 -- 172.21.15.92:0/2940763077 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe2a40e7df0 con 0x7fe2ac108cf0 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.668+0000 7fe2a1ffb640 1 -- 172.21.15.92:0/390311145 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294005220 con 0x560bc2d35390 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.668+0000 7fe2a1ffb640 1 -- 172.21.15.92:0/390311145 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe294004c30 con 0x560bc2d35390 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.668+0000 7fe2a1ffb640 1 -- 172.21.15.92:0/390311145 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29400e8f0 con 0x560bc2d35390 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/390311145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 msgr2=0x560bc30fe120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:53.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2ab7fe640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2980b6680 0x7fe2980b8b90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40ad5a0 tx=0x7fe2a407a550 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/390311145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fe120 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe294013860 tx=0x7fe29400b400 comp rx=0 tx=0).stop 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/390311145 shutdown_connections 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/390311145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fe120 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/390311145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d2d1b0 0x560bc30fdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/390311145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d56070 0x560bc30fd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/390311145 >> 172.21.15.92:0/390311145 conn(0x560bc2d4a460 msgr2=0x560bc30fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/390311145 shutdown_connections 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/390311145 wait complete. 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 -- start start 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.669+0000 7fe2b7eb6740 1 Processor -- start 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d2d1b0 0x560bc3108d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d35390 0x560bc3109260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d56070 0x560bc3115170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560bc2ec4700 con 0x560bc2d2d1b0 2024-09-21T07:19:53.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560bc2ffe160 con 0x560bc2d56070 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560bc310be80 con 0x560bc2d35390 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2b7eb6740 10 client.0 _ll_register_callbacks cb 0x560bc30179e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d2d1b0 0x560bc3108d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d2d1b0 0x560bc3108d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58164/0 (socket says 172.21.15.92:58164) 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2a27fc640 1 -- 172.21.15.92:0/4070690169 learned_addr learned my addr 172.21.15.92:0/4070690169 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2aaffd640 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d35390 0x560bc3109260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2a27fc640 1 -- 172.21.15.92:0/4070690169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d35390 msgr2=0x560bc3109260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d35390 0x560bc3109260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2a27fc640 1 -- 172.21.15.92:0/4070690169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d56070 msgr2=0x560bc3115170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d56070 0x560bc3115170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2a27fc640 1 -- 172.21.15.92:0/4070690169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bc302bc90 con 0x560bc2d2d1b0 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d2d1b0 0x560bc3108d20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe294013f50 tx=0x7fe29400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fa8a7c994c865e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.670+0000 7fe28affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe28affd640 1 -- 172.21.15.92:0/4070690169 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2940048c0 con 0x560bc2d2d1b0 2024-09-21T07:19:53.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe28affd640 1 -- 172.21.15.92:0/4070690169 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe294004020 con 0x560bc2d2d1b0 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/4070690169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe294004c30 con 0x560bc2d2d1b0 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe28affd640 1 -- 172.21.15.92:0/4070690169 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe294032050 con 0x560bc2d2d1b0 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe2b7eb6740 10 client.17499 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/4070690169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560bc3117b50 con 0x560bc2d2d1b0 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe28affd640 1 -- 172.21.15.92:0/4070690169 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe294004c30 con 0x560bc2d2d1b0 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe28affd640 1 -- 172.21.15.92:0/4070690169 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe29400f040 con 0x560bc2d2d1b0 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe2b7eb6740 10 client.17499 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe2b7eb6740 10 client.17499 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe2b7eb6740 20 client.17499 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x560bc2d149f0 0x560bc311af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe2b7eb6740 4 client.17499 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/4070690169 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bc3075df0 con 0x560bc2d149f0 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.671+0000 7fe2aaffd640 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x560bc2d149f0 0x560bc311af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.672+0000 7fe2aaffd640 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x560bc2d149f0 0x560bc311af60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c9eb2984343bebc3 server_cookie=a76062a034571b20 in_seq=0 out_seq=0 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.672+0000 7fe28affd640 10 client.17499 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe28affd640 1 -- 172.21.15.92:0/4070690169 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560bc3075df0 con 0x560bc2d149f0 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe28affd640 10 client.17499 handle_command_reply: tid=0 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 client.17499 shutdown 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/4070690169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d2d1b0 msgr2=0x560bc3108d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d2d1b0 0x560bc3108d20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe294013f50 tx=0x7fe29400bbb0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/4070690169 shutdown_connections 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x560bc2d149f0 0x560bc311af60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe28affd640 0 client.17499 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d56070 0x560bc3115170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d35390 0x560bc3109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/4070690169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d2d1b0 0x560bc3108d20 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/4070690169 >> 172.21.15.92:0/4070690169 conn(0x560bc2d4a460 msgr2=0x560bc3100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:53.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/4070690169 shutdown_connections 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/4070690169 wait complete. 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.673+0000 7fe2b7eb6740 20 client.17499 trim_cache size 0 max 16384 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.686+0000 7fe2b7eb6740 1 Processor -- start 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.687+0000 7fe2b7eb6740 1 -- start start 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.687+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d149f0 0x560bc30fed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.687+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d2d1b0 0x560bc30fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.687+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.687+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac1b0f40 con 0x560bc2d35390 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.687+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac1b2a80 con 0x560bc2d149f0 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.687+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac1b1610 con 0x560bc2d2d1b0 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.687+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.687+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58166/0 (socket says 172.21.15.92:58166) 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.687+0000 7fe2a27fc640 1 -- 172.21.15.92:0/1414239704 learned_addr learned my addr 172.21.15.92:0/1414239704 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/1414239704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d149f0 0x560bc30fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2aaffd640 1 --2- 172.21.15.92:0/1414239704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d2d1b0 0x560bc30fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2a27fc640 1 -- 172.21.15.92:0/1414239704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d2d1b0 msgr2=0x560bc30fabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:53.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/1414239704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d2d1b0 0x560bc30fabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2a27fc640 1 -- 172.21.15.92:0/1414239704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d149f0 msgr2=0x560bc30fed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:53.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/1414239704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d149f0 0x560bc30fed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2a27fc640 1 -- 172.21.15.92:0/1414239704 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bc3107220 con 0x560bc2d35390 2024-09-21T07:19:53.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/1414239704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fb100 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe294013860 tx=0x7fe294014f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2454f5d1fa8dfa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:53.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2a17fa640 1 -- 172.21.15.92:0/1414239704 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29402f040 con 0x560bc2d35390 2024-09-21T07:19:53.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2a17fa640 1 -- 172.21.15.92:0/1414239704 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe294025070 con 0x560bc2d35390 2024-09-21T07:19:53.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.688+0000 7fe2a17fa640 1 -- 172.21.15.92:0/1414239704 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294004bf0 con 0x560bc2d35390 2024-09-21T07:19:53.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.689+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1414239704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 msgr2=0x560bc30fb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:53.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.689+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/1414239704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fb100 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe294013860 tx=0x7fe294014f90 comp rx=0 tx=0).stop 2024-09-21T07:19:53.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.689+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1414239704 shutdown_connections 2024-09-21T07:19:53.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.689+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/1414239704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d35390 0x560bc30fb100 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.689+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/1414239704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d2d1b0 0x560bc30fabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.689+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/1414239704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d149f0 0x560bc30fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.689+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1414239704 >> 172.21.15.92:0/1414239704 conn(0x560bc2d4a460 msgr2=0x560bc30fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:53.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.689+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1414239704 shutdown_connections 2024-09-21T07:19:53.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.689+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1414239704 wait complete. 2024-09-21T07:19:53.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.689+0000 7fe2b7eb6740 1 -- start start 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2b7eb6740 1 Processor -- start 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d149f0 0x560bc311e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d2d1b0 0x560bc311bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2b7eb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d35390 0x560bc311c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac1b23b0 con 0x560bc2d149f0 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac1b1ce0 con 0x560bc2d35390 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2b7eb6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac1aef20 con 0x560bc2d2d1b0 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2b7eb6740 10 client.0 _ll_register_callbacks cb 0x7fe29400be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d149f0 0x560bc311e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2a27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d149f0 0x560bc311e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58182/0 (socket says 172.21.15.92:58182) 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2a27fc640 1 -- 172.21.15.92:0/1301196179 learned_addr learned my addr 172.21.15.92:0/1301196179 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2aaffd640 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d2d1b0 0x560bc311bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.690+0000 7fe2a27fc640 1 -- 172.21.15.92:0/1301196179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d2d1b0 msgr2=0x560bc311bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:53.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d2d1b0 0x560bc311bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe2a27fc640 1 -- 172.21.15.92:0/1301196179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d35390 msgr2=0x560bc311c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d35390 0x560bc311c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe2a27fc640 1 -- 172.21.15.92:0/1301196179 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bc311c710 con 0x560bc2d149f0 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe2a27fc640 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d149f0 0x560bc311e640 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe29400eae0 tx=0x7fe29400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a950938d2cde6ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe28affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe28affd640 1 -- 172.21.15.92:0/1301196179 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2940048f0 con 0x560bc2d149f0 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe28affd640 1 -- 172.21.15.92:0/1301196179 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fe294004a90 con 0x560bc2d149f0 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1301196179 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe294025070 con 0x560bc2d149f0 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe28affd640 1 -- 172.21.15.92:0/1301196179 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe29404b050 con 0x560bc2d149f0 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe2b7eb6740 10 client.17505 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1301196179 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560bc31854e0 con 0x560bc2d149f0 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe28affd640 1 -- 172.21.15.92:0/1301196179 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe294025070 con 0x560bc2d149f0 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.691+0000 7fe28affd640 1 -- 172.21.15.92:0/1301196179 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe294045500 con 0x560bc2d149f0 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.692+0000 7fe2b7eb6740 10 client.17505 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:53.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.692+0000 7fe2b7eb6740 10 client.17505 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.692+0000 7fe2b7eb6740 20 client.17505 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.692+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x560bc2d56070 0x560bc3187c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.692+0000 7fe2b7eb6740 4 client.17505 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.692+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1301196179 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560bc30718a0 con 0x560bc2d56070 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.692+0000 7fe2aaffd640 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x560bc2d56070 0x560bc3187c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.692+0000 7fe28affd640 10 client.17505 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.692+0000 7fe2aaffd640 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x560bc2d56070 0x560bc3187c10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e2835e3d33362f1d server_cookie=e4ae44cb47978062 in_seq=0 out_seq=0 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe28affd640 1 -- 172.21.15.92:0/1301196179 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560bc30718a0 con 0x560bc2d56070 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe28affd640 10 client.17505 handle_command_reply: tid=0 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 client.17505 shutdown 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1301196179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d149f0 msgr2=0x560bc311e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d149f0 0x560bc311e640 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe29400eae0 tx=0x7fe29400ecc0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1301196179 shutdown_connections 2024-09-21T07:19:53.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x560bc2d56070 0x560bc3187c10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560bc2d35390 0x560bc311c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bc2d2d1b0 0x560bc311bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 --2- 172.21.15.92:0/1301196179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560bc2d149f0 0x560bc311e640 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1301196179 >> 172.21.15.92:0/1301196179 conn(0x560bc2d4a460 msgr2=0x560bc30feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:53.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe28affd640 0 client.17505 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:19:53.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1301196179 shutdown_connections 2024-09-21T07:19:53.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 1 -- 172.21.15.92:0/1301196179 wait complete. 2024-09-21T07:19:53.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.693+0000 7fe2b7eb6740 20 client.17505 trim_cache size 0 max 16384 2024-09-21T07:19:53.708 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:19:53.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 -- 172.21.15.92:0/2940763077 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2980b6680 msgr2=0x7fe2980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:53.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2980b6680 0x7fe2980b8b90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40ad5a0 tx=0x7fe2a407a550 comp rx=0 tx=0).stop 2024-09-21T07:19:53.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 -- 172.21.15.92:0/2940763077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2ac108cf0 msgr2=0x7fe2ac19eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:53.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2ac108cf0 0x7fe2ac19eb80 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400cad0 tx=0x7fe2a400cf90 comp rx=0 tx=0).stop 2024-09-21T07:19:53.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 -- 172.21.15.92:0/2940763077 shutdown_connections 2024-09-21T07:19:53.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe2980b6680 0x7fe2980b8b90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2ac108cf0 0x7fe2ac19eb80 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2ac1083a0 0x7fe2ac1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 --2- 172.21.15.92:0/2940763077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2ac102a60 0x7fe2ac199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:53.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 -- 172.21.15.92:0/2940763077 >> 172.21.15.92:0/2940763077 conn(0x7fe2ac079730 msgr2=0x7fe2ac101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:53.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 -- 172.21.15.92:0/2940763077 shutdown_connections 2024-09-21T07:19:53.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:53.694+0000 7fe2b1942640 1 -- 172.21.15.92:0/2940763077 wait complete. 2024-09-21T07:19:54.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:53 smithi092 ceph-mon[30987]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:19:54.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:53 smithi169 ceph-mon[33705]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:19:54.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:53 smithi175 ceph-mon[34064]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:19:54.523 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:19:54.774 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.253+0000 7f3f20cd6640 1 -- 172.21.15.92:0/2772301469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f1c103b60 msgr2=0x7f3f1c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.253+0000 7f3f20cd6640 1 --2- 172.21.15.92:0/2772301469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f1c103b60 0x7f3f1c103f70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009ca0 tx=0x7f3f0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.253+0000 7f3f20cd6640 1 -- 172.21.15.92:0/2772301469 shutdown_connections 2024-09-21T07:19:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.253+0000 7f3f20cd6640 1 --2- 172.21.15.92:0/2772301469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f1c109df0 0x7f3f1c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.253+0000 7f3f20cd6640 1 --2- 172.21.15.92:0/2772301469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f1c1094a0 0x7f3f1c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.253+0000 7f3f20cd6640 1 --2- 172.21.15.92:0/2772301469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f1c103b60 0x7f3f1c103f70 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.253+0000 7f3f20cd6640 1 -- 172.21.15.92:0/2772301469 >> 172.21.15.92:0/2772301469 conn(0x7f3f1c07b850 msgr2=0x7f3f1c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.253+0000 7f3f20cd6640 1 -- 172.21.15.92:0/2772301469 shutdown_connections 2024-09-21T07:19:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.254+0000 7f3f20cd6640 1 -- 172.21.15.92:0/2772301469 wait complete. 2024-09-21T07:19:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.254+0000 7f3f20cd6640 1 Processor -- start 2024-09-21T07:19:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.254+0000 7f3f20cd6640 1 -- start start 2024-09-21T07:19:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f20cd6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f1c103b60 0x7f3f1c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f20cd6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f1c1094a0 0x7f3f1c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f20cd6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f1c109df0 0x7f3f1c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f20cd6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c113a10 con 0x7f3f1c103b60 2024-09-21T07:19:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f20cd6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c113890 con 0x7f3f1c109df0 2024-09-21T07:19:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f20cd6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c113b90 con 0x7f3f1c1094a0 2024-09-21T07:19:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f1a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f1c103b60 0x7f3f1c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f1a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f1c103b60 0x7f3f1c19a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58202/0 (socket says 172.21.15.92:58202) 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f1a59c640 1 -- 172.21.15.92:0/1978519484 learned_addr learned my addr 172.21.15.92:0/1978519484 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f1c109df0 0x7f3f1c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f1c1094a0 0x7f3f1c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f1a59c640 1 -- 172.21.15.92:0/1978519484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f1c1094a0 msgr2=0x7f3f1c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f1a59c640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f1c1094a0 0x7f3f1c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f1a59c640 1 -- 172.21.15.92:0/1978519484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f1c109df0 msgr2=0x7f3f1c19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f1a59c640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f1c109df0 0x7f3f1c19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f1a59c640 1 -- 172.21.15.92:0/1978519484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c1a03d0 con 0x7f3f1c103b60 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f1c1094a0 0x7f3f1c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.255+0000 7f3f1a59c640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f1c103b60 0x7f3f1c19a460 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c006010 tx=0x7f3f0c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.256+0000 7f3f137fe640 1 -- 172.21.15.92:0/1978519484 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c004040 con 0x7f3f1c103b60 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.256+0000 7f3f20cd6640 1 -- 172.21.15.92:0/1978519484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1c1a0660 con 0x7f3f1c103b60 2024-09-21T07:19:55.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.256+0000 7f3f137fe640 1 -- 172.21.15.92:0/1978519484 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f0c004670 con 0x7f3f1c103b60 2024-09-21T07:19:55.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.256+0000 7f3f20cd6640 1 -- 172.21.15.92:0/1978519484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1c1a6e20 con 0x7f3f1c103b60 2024-09-21T07:19:55.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.256+0000 7f3f137fe640 1 -- 172.21.15.92:0/1978519484 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c030da0 con 0x7f3f1c103b60 2024-09-21T07:19:55.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.258+0000 7f3f2724a740 1 Processor -- start 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.258+0000 7f3f2724a740 1 -- start start 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.258+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 0x557d4e82e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 0x557d4e82ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e82f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f2724a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557d4e7a4ea0 con 0x557d4e45e1b0 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f2724a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557d4e7942d0 con 0x557d4e466390 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f2724a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d4e7980e0 con 0x557d4e487070 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f137fe640 1 -- 172.21.15.92:0/1978519484 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f3f0c0041e0 con 0x7f3f1c103b60 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f1ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 0x557d4e82e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f1ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 0x557d4e82e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.92:53470/0 (socket says 172.21.15.92:53470) 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/3063874821 learned_addr learned my addr 172.21.15.92:0/3063874821 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/3063874821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e82f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f1a59c640 1 --2- 172.21.15.92:0/3063874821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 0x557d4e82ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/3063874821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 msgr2=0x557d4e82f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/3063874821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e82f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/3063874821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 msgr2=0x557d4e82ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/3063874821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 0x557d4e82ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/3063874821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4e4f2650 con 0x557d4e487070 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.259+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/3063874821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 0x557d4e82e6a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f140099e0 tx=0x7f3f14009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ed7ab6b2749936 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.260+0000 7f3f137fe640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f080b6680 0x7f3f080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.260+0000 7f3f10ff9640 1 -- 172.21.15.92:0/3063874821 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14017070 con 0x557d4e487070 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.260+0000 7f3f10ff9640 1 -- 172.21.15.92:0/3063874821 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f14013470 con 0x557d4e487070 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.260+0000 7f3f1a59c640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f080b6680 0x7f3f080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.260+0000 7f3f10ff9640 1 -- 172.21.15.92:0/3063874821 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14012630 con 0x557d4e487070 2024-09-21T07:19:55.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.260+0000 7f3f137fe640 1 -- 172.21.15.92:0/1978519484 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3f0c109230 con 0x7f3f1c103b60 2024-09-21T07:19:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 -- 172.21.15.92:0/3063874821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 msgr2=0x557d4e82e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 --2- 172.21.15.92:0/3063874821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 0x557d4e82e6a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f140099e0 tx=0x7f3f14009ea0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f1a59c640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f080b6680 0x7f3f080b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c106690 tx=0x7f3f0c0b6040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 -- 172.21.15.92:0/3063874821 shutdown_connections 2024-09-21T07:19:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 --2- 172.21.15.92:0/3063874821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e82f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 --2- 172.21.15.92:0/3063874821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 0x557d4e82ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 --2- 172.21.15.92:0/3063874821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 0x557d4e82e6a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 -- 172.21.15.92:0/3063874821 >> 172.21.15.92:0/3063874821 conn(0x557d4e47b460 msgr2=0x557d4e82c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 -- 172.21.15.92:0/3063874821 shutdown_connections 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 -- 172.21.15.92:0/3063874821 wait complete. 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 -- start start 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.261+0000 7f3f2724a740 1 Processor -- start 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 0x557d4e839d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e83a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 0x557d4e846170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f2724a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557d4e5f5700 con 0x557d4e45e1b0 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f2724a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557d4e72f160 con 0x557d4e466390 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f2724a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d4e83ce80 con 0x557d4e487070 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f2724a740 10 client.0 _ll_register_callbacks cb 0x557d4e7489e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:55.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f1ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 0x557d4e839d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f1ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 0x557d4e839d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58216/0 (socket says 172.21.15.92:58216) 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/3355599456 learned_addr learned my addr 172.21.15.92:0/3355599456 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e83a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/3355599456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 msgr2=0x557d4e846170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 0x557d4e846170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/3355599456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 msgr2=0x557d4e83a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e83a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/3355599456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d4e75cc90 con 0x557d4e45e1b0 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e83a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 0x557d4e839d00 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f3f14004810 tx=0x7f3f1400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f694301e1b7911bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.262+0000 7f3f01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f01ffb640 1 -- 172.21.15.92:0/3355599456 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14017040 con 0x557d4e45e1b0 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f01ffb640 1 -- 172.21.15.92:0/3355599456 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3f1401c450 con 0x557d4e45e1b0 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f2724a740 1 -- 172.21.15.92:0/3355599456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f14013470 con 0x557d4e45e1b0 2024-09-21T07:19:55.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f01ffb640 1 -- 172.21.15.92:0/3355599456 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3f1402f050 con 0x557d4e45e1b0 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f2724a740 10 client.17517 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f2724a740 1 -- 172.21.15.92:0/3355599456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d4e848b30 con 0x557d4e45e1b0 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f01ffb640 1 -- 172.21.15.92:0/3355599456 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f14013470 con 0x557d4e45e1b0 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f01ffb640 1 -- 172.21.15.92:0/3355599456 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3f140246b0 con 0x557d4e45e1b0 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f2724a740 10 client.17517 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f2724a740 10 client.17517 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f2724a740 20 client.17517 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f2724a740 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x557d4e4459f0 0x557d4e84bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f2724a740 4 client.17517 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.263+0000 7f3f2724a740 1 -- 172.21.15.92:0/3355599456 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d4e7a6df0 con 0x557d4e4459f0 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.264+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x557d4e4459f0 0x557d4e84bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.264+0000 7f3f01ffb640 10 client.17517 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.264+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x557d4e4459f0 0x557d4e84bf40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9245fd2198c5b1c4 server_cookie=fe3c7ea0724c92d0 in_seq=0 out_seq=0 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f01ffb640 1 -- 172.21.15.92:0/3355599456 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d4e7a6df0 con 0x557d4e4459f0 2024-09-21T07:19:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f01ffb640 10 client.17517 handle_command_reply: tid=0 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 client.17517 shutdown 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 -- 172.21.15.92:0/3355599456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 msgr2=0x557d4e839d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 0x557d4e839d00 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f3f14004810 tx=0x7f3f1400ee50 comp rx=0 tx=0).stop 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 -- 172.21.15.92:0/3355599456 shutdown_connections 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e487070 0x557d4e846170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e83a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x557d4e4459f0 0x557d4e84bf40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 --2- 172.21.15.92:0/3355599456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e45e1b0 0x557d4e839d00 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 -- 172.21.15.92:0/3355599456 >> 172.21.15.92:0/3355599456 conn(0x557d4e47b460 msgr2=0x557d4e831830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f01ffb640 0 client.17517 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 -- 172.21.15.92:0/3355599456 shutdown_connections 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 1 -- 172.21.15.92:0/3355599456 wait complete. 2024-09-21T07:19:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.265+0000 7f3f2724a740 20 client.17517 trim_cache size 0 max 16384 2024-09-21T07:19:55.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.278+0000 7f3f2724a740 1 Processor -- start 2024-09-21T07:19:55.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f2724a740 1 -- start start 2024-09-21T07:19:55.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e45e1b0 0x557d4e8301b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e83b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e82bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f2724a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c1b0ed0 con 0x557d4e487070 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f2724a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c1b2a10 con 0x557d4e466390 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f2724a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c1b15a0 con 0x557d4e45e1b0 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f1ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e82bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f1ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e82bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58220/0 (socket says 172.21.15.92:58220) 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/1807198245 learned_addr learned my addr 172.21.15.92:0/1807198245 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/1807198245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e45e1b0 0x557d4e8301b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/1807198245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e83b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/1807198245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e45e1b0 msgr2=0x557d4e8301b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/1807198245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e45e1b0 0x557d4e8301b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/1807198245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 msgr2=0x557d4e83b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/1807198245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e83b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/1807198245 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4e445c20 con 0x557d4e487070 2024-09-21T07:19:55.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/1807198245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e83b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:55.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.279+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/1807198245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e82bbc0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f3f14024a50 tx=0x7f3f14009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9675a96bb515ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:55.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f03fff640 1 -- 172.21.15.92:0/1807198245 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f140134f0 con 0x557d4e487070 2024-09-21T07:19:55.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f03fff640 1 -- 172.21.15.92:0/1807198245 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f1401c450 con 0x557d4e487070 2024-09-21T07:19:55.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f03fff640 1 -- 172.21.15.92:0/1807198245 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14033690 con 0x557d4e487070 2024-09-21T07:19:55.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f2724a740 1 -- 172.21.15.92:0/1807198245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 msgr2=0x557d4e82bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:55.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f2724a740 1 --2- 172.21.15.92:0/1807198245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e82bbc0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f3f14024a50 tx=0x7f3f14009ea0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f2724a740 1 -- 172.21.15.92:0/1807198245 shutdown_connections 2024-09-21T07:19:55.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f2724a740 1 --2- 172.21.15.92:0/1807198245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e82bbc0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f2724a740 1 --2- 172.21.15.92:0/1807198245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e466390 0x557d4e83b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f2724a740 1 --2- 172.21.15.92:0/1807198245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e45e1b0 0x557d4e8301b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f2724a740 1 -- 172.21.15.92:0/1807198245 >> 172.21.15.92:0/1807198245 conn(0x557d4e47b460 msgr2=0x557d4e83b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:55.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f2724a740 1 -- 172.21.15.92:0/1807198245 shutdown_connections 2024-09-21T07:19:55.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.280+0000 7f3f2724a740 1 -- 172.21.15.92:0/1807198245 wait complete. 2024-09-21T07:19:55.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f2724a740 1 -- start start 2024-09-21T07:19:55.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f2724a740 1 Processor -- start 2024-09-21T07:19:55.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e45e1b0 0x557d4e84c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e466390 0x557d4e84ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f2724a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e8b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f2724a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c1b2340 con 0x557d4e487070 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f2724a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c1b1c70 con 0x557d4e45e1b0 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f2724a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c1aeeb0 con 0x557d4e466390 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f2724a740 10 client.0 _ll_register_callbacks cb 0x7f3f0c10cc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f1ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e8b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f1ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e8b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58230/0 (socket says 172.21.15.92:58230) 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/4019799599 learned_addr learned my addr 172.21.15.92:0/4019799599 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.281+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e466390 0x557d4e84ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/4019799599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e466390 msgr2=0x557d4e84ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e466390 0x557d4e84ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/4019799599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e45e1b0 msgr2=0x557d4e84c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e45e1b0 0x557d4e84c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f1ad9d640 1 -- 172.21.15.92:0/4019799599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d4e8b4cc0 con 0x557d4e487070 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f1ad9d640 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e8b46b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f3f14004700 tx=0x7f3f14013610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c20a5db76881d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f01ffb640 1 -- 172.21.15.92:0/4019799599 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14024800 con 0x557d4e487070 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f01ffb640 1 -- 172.21.15.92:0/4019799599 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f3f1401c600 con 0x557d4e487070 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f2724a740 1 -- 172.21.15.92:0/4019799599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f1401c450 con 0x557d4e487070 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f01ffb640 1 -- 172.21.15.92:0/4019799599 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3f1401c820 con 0x557d4e487070 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f2724a740 10 client.17523 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f2724a740 1 -- 172.21.15.92:0/4019799599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d4e8b5eb0 con 0x557d4e487070 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f01ffb640 1 -- 172.21.15.92:0/4019799599 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f1401c450 con 0x557d4e487070 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.282+0000 7f3f01ffb640 1 -- 172.21.15.92:0/4019799599 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3f1403d070 con 0x557d4e487070 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f2724a740 10 client.17523 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f2724a740 10 client.17523 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f2724a740 20 client.17523 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:55.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f2724a740 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x557d4e41ada0 0x557d4e8b8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f2724a740 4 client.17523 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f2724a740 1 -- 172.21.15.92:0/4019799599 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d4e7a28a0 con 0x557d4e41ada0 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x557d4e41ada0 0x557d4e8b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f19d9b640 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x557d4e41ada0 0x557d4e8b8580 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4761d3cd31aa7013 server_cookie=ef23137a131ed6b2 in_seq=0 out_seq=0 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f01ffb640 10 client.17523 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f01ffb640 1 -- 172.21.15.92:0/4019799599 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d4e7a28a0 con 0x557d4e41ada0 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f01ffb640 10 client.17523 handle_command_reply: tid=0 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.283+0000 7f3f2724a740 1 client.17523 shutdown 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 1 -- 172.21.15.92:0/4019799599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 msgr2=0x557d4e8b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e8b46b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f3f14004700 tx=0x7f3f14013610 comp rx=0 tx=0).stop 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 1 -- 172.21.15.92:0/4019799599 shutdown_connections 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x557d4e41ada0 0x557d4e8b8580 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f01ffb640 0 client.17523 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:19:55.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d4e487070 0x557d4e8b46b0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d4e466390 0x557d4e84ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 1 --2- 172.21.15.92:0/4019799599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d4e45e1b0 0x557d4e84c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 1 -- 172.21.15.92:0/4019799599 >> 172.21.15.92:0/4019799599 conn(0x557d4e47b460 msgr2=0x557d4e83b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:55.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 1 -- 172.21.15.92:0/4019799599 shutdown_connections 2024-09-21T07:19:55.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 1 -- 172.21.15.92:0/4019799599 wait complete. 2024-09-21T07:19:55.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f2724a740 20 client.17523 trim_cache size 0 max 16384 2024-09-21T07:19:55.293 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:19:55.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f20cd6640 1 -- 172.21.15.92:0/1978519484 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f080b6680 msgr2=0x7f3f080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:55.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f20cd6640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f080b6680 0x7f3f080b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c106690 tx=0x7f3f0c0b6040 comp rx=0 tx=0).stop 2024-09-21T07:19:55.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f20cd6640 1 -- 172.21.15.92:0/1978519484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f1c103b60 msgr2=0x7f3f1c19a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:55.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.284+0000 7f3f20cd6640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f1c103b60 0x7f3f1c19a460 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c006010 tx=0x7f3f0c032bc0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.285+0000 7f3f20cd6640 1 -- 172.21.15.92:0/1978519484 shutdown_connections 2024-09-21T07:19:55.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.285+0000 7f3f20cd6640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3f080b6680 0x7f3f080b8b90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.285+0000 7f3f20cd6640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3f1c109df0 0x7f3f1c19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.285+0000 7f3f20cd6640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f1c1094a0 0x7f3f1c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.285+0000 7f3f20cd6640 1 --2- 172.21.15.92:0/1978519484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f1c103b60 0x7f3f1c19a460 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:55.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.285+0000 7f3f20cd6640 1 -- 172.21.15.92:0/1978519484 >> 172.21.15.92:0/1978519484 conn(0x7f3f1c07b850 msgr2=0x7f3f1c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:55.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.285+0000 7f3f20cd6640 1 -- 172.21.15.92:0/1978519484 shutdown_connections 2024-09-21T07:19:55.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:55.285+0000 7f3f20cd6640 1 -- 172.21.15.92:0/1978519484 wait complete. 2024-09-21T07:19:56.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:55 smithi092 ceph-mon[30987]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:56.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:55 smithi169 ceph-mon[33705]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:56.183 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:19:56.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:55 smithi175 ceph-mon[34064]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:19:56.429 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:56.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.954+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2478023179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0c41083d0 msgr2=0x7fa0c41087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:56.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.954+0000 7fa0c9ac6640 1 --2- 172.21.15.92:0/2478023179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0c41083d0 0x7fa0c41087e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009900 tx=0x7fa0b802a410 comp rx=0 tx=0).stop 2024-09-21T07:19:56.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.954+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2478023179 shutdown_connections 2024-09-21T07:19:56.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.954+0000 7fa0c9ac6640 1 --2- 172.21.15.92:0/2478023179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c4108d20 0x7fa0c410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.954+0000 7fa0c9ac6640 1 --2- 172.21.15.92:0/2478023179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0c41083d0 0x7fa0c41087e0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.954+0000 7fa0c9ac6640 1 --2- 172.21.15.92:0/2478023179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0c4102ae0 0x7fa0c4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.954+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2478023179 >> 172.21.15.92:0/2478023179 conn(0x7fa0c4079790 msgr2=0x7fa0c4079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:56.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.954+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2478023179 shutdown_connections 2024-09-21T07:19:56.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.954+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2478023179 wait complete. 2024-09-21T07:19:56.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c9ac6640 1 Processor -- start 2024-09-21T07:19:56.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c9ac6640 1 -- start start 2024-09-21T07:19:56.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c9ac6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0c4102ae0 0x7fa0c40ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c9ac6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c41083d0 0x7fa0c40ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c9ac6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0c4108d20 0x7fa0c41000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c9ac6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c41128d0 con 0x7fa0c4102ae0 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c9ac6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c4112750 con 0x7fa0c4108d20 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c9ac6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c4112a50 con 0x7fa0c41083d0 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0c4102ae0 0x7fa0c40ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0c4102ae0 0x7fa0c40ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58242/0 (socket says 172.21.15.92:58242) 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c37fe640 1 -- 172.21.15.92:0/2188290725 learned_addr learned my addr 172.21.15.92:0/2188290725 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c41083d0 0x7fa0c40ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c3fff640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0c4108d20 0x7fa0c41000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c37fe640 1 -- 172.21.15.92:0/2188290725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c41083d0 msgr2=0x7fa0c40ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.955+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c41083d0 0x7fa0c40ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.956+0000 7fa0c37fe640 1 -- 172.21.15.92:0/2188290725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0c4108d20 msgr2=0x7fa0c41000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:56.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.956+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0c4108d20 0x7fa0c41000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.956+0000 7fa0c37fe640 1 -- 172.21.15.92:0/2188290725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c41a87b0 con 0x7fa0c4102ae0 2024-09-21T07:19:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.956+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0c4102ae0 0x7fa0c40ff670 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400b4a0 tx=0x7fa0b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.956+0000 7fa0c0ff9640 1 -- 172.21.15.92:0/2188290725 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4014070 con 0x7fa0c4102ae0 2024-09-21T07:19:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.956+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2188290725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c41a8aa0 con 0x7fa0c4102ae0 2024-09-21T07:19:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.956+0000 7fa0c0ff9640 1 -- 172.21.15.92:0/2188290725 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0b4010aa0 con 0x7fa0c4102ae0 2024-09-21T07:19:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.956+0000 7fa0c0ff9640 1 -- 172.21.15.92:0/2188290725 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4017b70 con 0x7fa0c4102ae0 2024-09-21T07:19:56.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.956+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2188290725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c41a8fe0 con 0x7fa0c4102ae0 2024-09-21T07:19:56.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0d003a740 1 Processor -- start 2024-09-21T07:19:56.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0d003a740 1 -- start start 2024-09-21T07:19:56.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0c0ff9640 1 -- 172.21.15.92:0/2188290725 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fa0b4017070 con 0x7fa0c4102ae0 2024-09-21T07:19:56.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c73497070 0x557c7383e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c7346e1b0 0x557c7383ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7383f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0d003a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557c737b4ea0 con 0x557c73476390 2024-09-21T07:19:56.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0d003a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557c737a42d0 con 0x557c73497070 2024-09-21T07:19:56.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0d003a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557c737a80e0 con 0x557c7346e1b0 2024-09-21T07:19:56.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7383f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7383f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58256/0 (socket says 172.21.15.92:58256) 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/759213266 learned_addr learned my addr 172.21.15.92:0/759213266 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0c3fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c73497070 0x557c7383e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.959+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/759213266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c7346e1b0 0x557c7383ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/759213266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c7346e1b0 msgr2=0x557c7383ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/759213266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c7346e1b0 0x557c7383ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/759213266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c73497070 msgr2=0x557c7383e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/759213266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c73497070 0x557c7383e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/759213266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c73502650 con 0x557c73476390 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0c0ff9640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0ac0b6680 0x7fa0ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/759213266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7383f120 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8005940 tx=0x7fa0b8032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bde0c058e58a51a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0c3fff640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0ac0b6680 0x7fa0ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0c0ff9640 1 -- 172.21.15.92:0/2188290725 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa0b40e7190 con 0x7fa0c4102ae0 2024-09-21T07:19:56.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0a9ffb640 1 -- 172.21.15.92:0/759213266 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b803f070 con 0x557c73476390 2024-09-21T07:19:56.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0a9ffb640 1 -- 172.21.15.92:0/759213266 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0b80044b0 con 0x557c73476390 2024-09-21T07:19:56.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.960+0000 7fa0a9ffb640 1 -- 172.21.15.92:0/759213266 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8035070 con 0x557c73476390 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.961+0000 7fa0d003a740 1 -- 172.21.15.92:0/759213266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 msgr2=0x557c7383f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.961+0000 7fa0c3fff640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0ac0b6680 0x7fa0ac0b8b90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00be30 tx=0x7fa0bc00b580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.961+0000 7fa0d003a740 1 --2- 172.21.15.92:0/759213266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7383f120 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8005940 tx=0x7fa0b8032e10 comp rx=0 tx=0).stop 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.961+0000 7fa0d003a740 1 -- 172.21.15.92:0/759213266 shutdown_connections 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.961+0000 7fa0d003a740 1 --2- 172.21.15.92:0/759213266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7383f120 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.961+0000 7fa0d003a740 1 --2- 172.21.15.92:0/759213266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c7346e1b0 0x557c7383ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.961+0000 7fa0d003a740 1 --2- 172.21.15.92:0/759213266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c73497070 0x557c7383e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.961+0000 7fa0d003a740 1 -- 172.21.15.92:0/759213266 >> 172.21.15.92:0/759213266 conn(0x557c7348b460 msgr2=0x557c7383c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.961+0000 7fa0d003a740 1 -- 172.21.15.92:0/759213266 shutdown_connections 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.961+0000 7fa0d003a740 1 -- 172.21.15.92:0/759213266 wait complete. 2024-09-21T07:19:56.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0d003a740 1 -- start start 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0d003a740 1 Processor -- start 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 0x557c73849cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7384a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73497070 0x557c7384a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0d003a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557c73605700 con 0x557c73476390 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0d003a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557c7373f160 con 0x557c7346e1b0 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0d003a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557c7384ce20 con 0x557c73497070 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7384a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7384a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58262/0 (socket says 172.21.15.92:58262) 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0d003a740 10 client.0 _ll_register_callbacks cb 0x557c737589e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/3867023521 learned_addr learned my addr 172.21.15.92:0/3867023521 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:56.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0c3fff640 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73497070 0x557c7384a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.962+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 0x557c73849cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/3867023521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73497070 msgr2=0x557c7384a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73497070 0x557c7384a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/3867023521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 msgr2=0x557c73849cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 0x557c73849cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/3867023521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c7376cc90 con 0x557c73476390 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 0x557c73849cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7384a200 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8000c00 tx=0x7fa0b80055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbcb829eace908c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/3867023521 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b804b060 con 0x557c73476390 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/3867023521 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa0b8031400 con 0x557c73476390 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0d003a740 1 -- 172.21.15.92:0/3867023521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0b80044b0 con 0x557c73476390 2024-09-21T07:19:56.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/3867023521 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0b8052050 con 0x557c73476390 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0d003a740 10 client.17535 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.963+0000 7fa0d003a740 1 -- 172.21.15.92:0/3867023521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557c73858aa0 con 0x557c73476390 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.964+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/3867023521 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0b80044b0 con 0x557c73476390 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.964+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/3867023521 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa0b803b460 con 0x557c73476390 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.964+0000 7fa0d003a740 10 client.17535 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.964+0000 7fa0d003a740 10 client.17535 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.964+0000 7fa0d003a740 20 client.17535 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.964+0000 7fa0d003a740 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557c734559f0 0x557c7385be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.964+0000 7fa0d003a740 4 client.17535 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.964+0000 7fa0d003a740 1 -- 172.21.15.92:0/3867023521 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c737b6df0 con 0x557c734559f0 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.964+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557c734559f0 0x557c7385be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.965+0000 7fa0a2ffd640 10 client.17535 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.965+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557c734559f0 0x557c7385be00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=217f154db6a3768f server_cookie=b2168700819b0b82 in_seq=0 out_seq=0 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.965+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/3867023521 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c737b6df0 con 0x557c734559f0 2024-09-21T07:19:56.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.965+0000 7fa0a2ffd640 10 client.17535 handle_command_reply: tid=0 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.965+0000 7fa0d003a740 1 client.17535 shutdown 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 1 -- 172.21.15.92:0/3867023521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 msgr2=0x557c7384a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7384a200 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8000c00 tx=0x7fa0b80055d0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 1 -- 172.21.15.92:0/3867023521 shutdown_connections 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557c734559f0 0x557c7385be00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0a2ffd640 0 client.17535 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73497070 0x557c7384a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c73476390 0x557c7384a200 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 1 --2- 172.21.15.92:0/3867023521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 0x557c73849cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 1 -- 172.21.15.92:0/3867023521 >> 172.21.15.92:0/3867023521 conn(0x557c7348b460 msgr2=0x557c73841880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 1 -- 172.21.15.92:0/3867023521 shutdown_connections 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 1 -- 172.21.15.92:0/3867023521 wait complete. 2024-09-21T07:19:56.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.966+0000 7fa0d003a740 20 client.17535 trim_cache size 0 max 16384 2024-09-21T07:19:56.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0d003a740 1 Processor -- start 2024-09-21T07:19:56.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0d003a740 1 -- start start 2024-09-21T07:19:56.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c734559f0 0x557c73849a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c7346e1b0 0x557c73849fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73476390 0x557c73846eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0d003a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c41b3140 con 0x557c7346e1b0 2024-09-21T07:19:56.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0d003a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c41b4c80 con 0x557c734559f0 2024-09-21T07:19:56.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0d003a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c41b3810 con 0x557c73476390 2024-09-21T07:19:56.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c7346e1b0 0x557c73849fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c7346e1b0 0x557c73849fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58272/0 (socket says 172.21.15.92:58272) 2024-09-21T07:19:56.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/401358266 learned_addr learned my addr 172.21.15.92:0/401358266 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:56.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c3fff640 1 --2- 172.21.15.92:0/401358266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73476390 0x557c73846eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/401358266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c734559f0 0x557c73849a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/401358266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73476390 msgr2=0x557c73846eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:56.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/401358266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73476390 0x557c73846eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/401358266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c734559f0 msgr2=0x557c73849a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:56.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/401358266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c734559f0 0x557c73849a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c2ffd640 1 -- 172.21.15.92:0/401358266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c7384af80 con 0x557c7346e1b0 2024-09-21T07:19:56.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.979+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/401358266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c734559f0 0x557c73849a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:19:56.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.980+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/401358266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c7346e1b0 0x557c73849fb0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fa0b802a450 tx=0x7fa0b803cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf436e9e2b560c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:56.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.980+0000 7fa0a97fa640 1 -- 172.21.15.92:0/401358266 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b805a020 con 0x557c7346e1b0 2024-09-21T07:19:56.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.980+0000 7fa0a97fa640 1 -- 172.21.15.92:0/401358266 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0b8056430 con 0x557c7346e1b0 2024-09-21T07:19:56.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.980+0000 7fa0a97fa640 1 -- 172.21.15.92:0/401358266 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b804b040 con 0x557c7346e1b0 2024-09-21T07:19:56.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 -- 172.21.15.92:0/401358266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c7346e1b0 msgr2=0x557c73849fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:56.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 --2- 172.21.15.92:0/401358266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c7346e1b0 0x557c73849fb0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fa0b802a450 tx=0x7fa0b803cfb0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 -- 172.21.15.92:0/401358266 shutdown_connections 2024-09-21T07:19:56.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 --2- 172.21.15.92:0/401358266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73476390 0x557c73846eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 --2- 172.21.15.92:0/401358266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c7346e1b0 0x557c73849fb0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 --2- 172.21.15.92:0/401358266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c734559f0 0x557c73849a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 -- 172.21.15.92:0/401358266 >> 172.21.15.92:0/401358266 conn(0x557c7348b460 msgr2=0x557c73848540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:56.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 -- 172.21.15.92:0/401358266 shutdown_connections 2024-09-21T07:19:56.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 -- 172.21.15.92:0/401358266 wait complete. 2024-09-21T07:19:56.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 -- start start 2024-09-21T07:19:56.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.981+0000 7fa0d003a740 1 Processor -- start 2024-09-21T07:19:56.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c734559f0 0x557c7385f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 0x557c7385cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0d003a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73476390 0x557c7385d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0d003a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c41b45b0 con 0x557c734559f0 2024-09-21T07:19:56.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0d003a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c41b3ee0 con 0x557c7346e1b0 2024-09-21T07:19:56.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0d003a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c41b1120 con 0x557c73476390 2024-09-21T07:19:56.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0d003a740 10 client.0 _ll_register_callbacks cb 0x7fa0bc00b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:56.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c734559f0 0x557c7385f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c734559f0 0x557c7385f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58282/0 (socket says 172.21.15.92:58282) 2024-09-21T07:19:56.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c37fe640 1 -- 172.21.15.92:0/827552601 learned_addr learned my addr 172.21.15.92:0/827552601 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:56.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c3fff640 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73476390 0x557c7385d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 0x557c7385cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c37fe640 1 -- 172.21.15.92:0/827552601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73476390 msgr2=0x557c7385d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:56.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73476390 0x557c7385d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c37fe640 1 -- 172.21.15.92:0/827552601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 msgr2=0x557c7385cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:56.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 0x557c7385cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c37fe640 1 -- 172.21.15.92:0/827552601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c7385d880 con 0x557c734559f0 2024-09-21T07:19:56.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0c37fe640 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c734559f0 0x557c7385f680 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40ac940 tx=0x7fa0b4010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809a162e85e68466 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/827552601 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b401e040 con 0x557c734559f0 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/827552601 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7fa0b40e47c0 con 0x557c734559f0 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.982+0000 7fa0d003a740 1 -- 172.21.15.92:0/827552601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0b8056430 con 0x557c734559f0 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/827552601 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0b40ad340 con 0x557c734559f0 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0d003a740 10 client.17541 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0d003a740 1 -- 172.21.15.92:0/827552601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557c738c6500 con 0x557c734559f0 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/827552601 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0b8056430 con 0x557c734559f0 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/827552601 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa0b40a8eb0 con 0x557c734559f0 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0d003a740 10 client.17541 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0d003a740 10 client.17541 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0d003a740 20 client.17541 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0d003a740 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557c73497070 0x557c738c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:56.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0d003a740 4 client.17541 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0d003a740 1 -- 172.21.15.92:0/827552601 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c737b28a0 con 0x557c73497070 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.983+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557c73497070 0x557c738c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0c2ffd640 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557c73497070 0x557c738c8c70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a84aa4f6d84920 server_cookie=72b26b71748fe134 in_seq=0 out_seq=0 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0a2ffd640 10 client.17541 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0a2ffd640 1 -- 172.21.15.92:0/827552601 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c737b28a0 con 0x557c73497070 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0a2ffd640 10 client.17541 handle_command_reply: tid=0 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 client.17541 shutdown 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 -- 172.21.15.92:0/827552601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c734559f0 msgr2=0x557c7385f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c734559f0 0x557c7385f680 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40ac940 tx=0x7fa0b4010f70 comp rx=0 tx=0).stop 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 -- 172.21.15.92:0/827552601 shutdown_connections 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x557c73497070 0x557c738c8c70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c73476390 0x557c7385d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c7346e1b0 0x557c7385cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 --2- 172.21.15.92:0/827552601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c734559f0 0x557c7385f680 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:56.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0a2ffd640 0 client.17541 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:19:56.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 -- 172.21.15.92:0/827552601 >> 172.21.15.92:0/827552601 conn(0x557c7348b460 msgr2=0x557c7384b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:56.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 -- 172.21.15.92:0/827552601 shutdown_connections 2024-09-21T07:19:56.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 1 -- 172.21.15.92:0/827552601 wait complete. 2024-09-21T07:19:56.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.984+0000 7fa0d003a740 20 client.17541 trim_cache size 0 max 16384 2024-09-21T07:19:56.999 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:19:57.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2188290725 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0ac0b6680 msgr2=0x7fa0ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:57.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0ac0b6680 0x7fa0ac0b8b90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00be30 tx=0x7fa0bc00b580 comp rx=0 tx=0).stop 2024-09-21T07:19:57.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2188290725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0c4102ae0 msgr2=0x7fa0c40ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:57.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0c4102ae0 0x7fa0c40ff670 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400b4a0 tx=0x7fa0b400b960 comp rx=0 tx=0).stop 2024-09-21T07:19:57.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2188290725 shutdown_connections 2024-09-21T07:19:57.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa0ac0b6680 0x7fa0ac0b8b90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:57.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0c4108d20 0x7fa0c41000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:57.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c41083d0 0x7fa0c40ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:57.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 --2- 172.21.15.92:0/2188290725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0c4102ae0 0x7fa0c40ff670 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:57.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2188290725 >> 172.21.15.92:0/2188290725 conn(0x7fa0c4079790 msgr2=0x7fa0c4101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:57.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2188290725 shutdown_connections 2024-09-21T07:19:57.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:56.985+0000 7fa0c9ac6640 1 -- 172.21.15.92:0/2188290725 wait complete. 2024-09-21T07:19:57.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:19:58.074 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:19:58.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:57 smithi092 ceph-mon[30987]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:19:58.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:57 smithi169 ceph-mon[33705]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:19:58.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:57 smithi175 ceph-mon[34064]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:19:58.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.564+0000 7ff7484bb640 1 -- 172.21.15.92:0/969301468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff740108cf0 msgr2=0x7ff74010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:58.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.564+0000 7ff7484bb640 1 --2- 172.21.15.92:0/969301468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff740108cf0 0x7ff74010f520 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ff738009ca0 tx=0x7ff73802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.564+0000 7ff7484bb640 1 -- 172.21.15.92:0/969301468 shutdown_connections 2024-09-21T07:19:58.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.564+0000 7ff7484bb640 1 --2- 172.21.15.92:0/969301468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff740108cf0 0x7ff74010f520 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.564+0000 7ff7484bb640 1 --2- 172.21.15.92:0/969301468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7401083a0 0x7ff7401087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.564+0000 7ff7484bb640 1 --2- 172.21.15.92:0/969301468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff740102a60 0x7ff740102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.564+0000 7ff7484bb640 1 -- 172.21.15.92:0/969301468 >> 172.21.15.92:0/969301468 conn(0x7ff740079730 msgr2=0x7ff740079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.564+0000 7ff7484bb640 1 -- 172.21.15.92:0/969301468 shutdown_connections 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.564+0000 7ff7484bb640 1 -- 172.21.15.92:0/969301468 wait complete. 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff7484bb640 1 Processor -- start 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff7484bb640 1 -- start start 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff7484bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff740102a60 0x7ff74019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff7484bb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7401083a0 0x7ff74019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff7484bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff740108cf0 0x7ff74019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff7484bb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401128c0 con 0x7ff7401083a0 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff7484bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff740112740 con 0x7ff740108cf0 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff7484bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff740112a40 con 0x7ff740102a60 2024-09-21T07:19:58.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff745a56640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7401083a0 0x7ff74019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff745a56640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7401083a0 0x7ff74019a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58294/0 (socket says 172.21.15.92:58294) 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff745a56640 1 -- 172.21.15.92:0/3791259389 learned_addr learned my addr 172.21.15.92:0/3791259389 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff746257640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff740102a60 0x7ff74019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff746a58640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff740108cf0 0x7ff74019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff745a56640 1 -- 172.21.15.92:0/3791259389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff740102a60 msgr2=0x7ff74019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff745a56640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff740102a60 0x7ff74019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff745a56640 1 -- 172.21.15.92:0/3791259389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff740108cf0 msgr2=0x7ff74019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff745a56640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff740108cf0 0x7ff74019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff745a56640 1 -- 172.21.15.92:0/3791259389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7401a0290 con 0x7ff7401083a0 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.565+0000 7ff746a58640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff740108cf0 0x7ff74019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.566+0000 7ff745a56640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7401083a0 0x7ff74019a980 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c970 tx=0x7ff73c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.566+0000 7ff7337fe640 1 -- 172.21.15.92:0/3791259389 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c014070 con 0x7ff7401083a0 2024-09-21T07:19:58.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.566+0000 7ff7337fe640 1 -- 172.21.15.92:0/3791259389 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff73c004440 con 0x7ff7401083a0 2024-09-21T07:19:58.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.566+0000 7ff7484bb640 1 -- 172.21.15.92:0/3791259389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7401a0580 con 0x7ff7401083a0 2024-09-21T07:19:58.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.566+0000 7ff7337fe640 1 -- 172.21.15.92:0/3791259389 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c003cd0 con 0x7ff7401083a0 2024-09-21T07:19:58.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.566+0000 7ff7484bb640 1 -- 172.21.15.92:0/3791259389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7401a6da0 con 0x7ff7401083a0 2024-09-21T07:19:58.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff74ea2f740 1 Processor -- start 2024-09-21T07:19:58.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff74ea2f740 1 -- start start 2024-09-21T07:19:58.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff7337fe640 1 -- 172.21.15.92:0/3791259389 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7ff73c017070 con 0x7ff7401083a0 2024-09-21T07:19:58.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f58be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f59120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562fb8eceea0 con 0x562fb8bb1070 2024-09-21T07:19:58.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562fb8ebe2d0 con 0x562fb8b881b0 2024-09-21T07:19:58.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562fb8ec20e0 con 0x562fb8b90390 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff746a58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff746a58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58300/0 (socket says 172.21.15.92:58300) 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.569+0000 7ff746a58640 1 -- 172.21.15.92:0/430014356 learned_addr learned my addr 172.21.15.92:0/430014356 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff746257640 1 --2- 172.21.15.92:0/430014356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f58be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff745a56640 1 --2- 172.21.15.92:0/430014356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f59120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff746a58640 1 -- 172.21.15.92:0/430014356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 msgr2=0x562fb8f59120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff746a58640 1 --2- 172.21.15.92:0/430014356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f59120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff746a58640 1 -- 172.21.15.92:0/430014356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 msgr2=0x562fb8f58be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff746a58640 1 --2- 172.21.15.92:0/430014356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f58be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff746a58640 1 -- 172.21.15.92:0/430014356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fb8c1c650 con 0x562fb8bb1070 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff7337fe640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff72c0b66b0 0x7ff72c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff746257640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff72c0b66b0 0x7ff72c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff746a58640 1 --2- 172.21.15.92:0/430014356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f586a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff738031610 tx=0x7ff738031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880b429f965b37b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff7337fe640 1 -- 172.21.15.92:0/3791259389 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff73c0e7570 con 0x7ff7401083a0 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff730d9a640 1 -- 172.21.15.92:0/430014356 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738031b80 con 0x562fb8bb1070 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff730d9a640 1 -- 172.21.15.92:0/430014356 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff738036040 con 0x562fb8bb1070 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.570+0000 7ff730d9a640 1 -- 172.21.15.92:0/430014356 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738004540 con 0x562fb8bb1070 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.571+0000 7ff74ea2f740 1 -- 172.21.15.92:0/430014356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 msgr2=0x562fb8f586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.571+0000 7ff746257640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff72c0b66b0 0x7ff72c0b8bc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x562fb8f57320 tx=0x7ff734008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.571+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/430014356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f586a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff738031610 tx=0x7ff738031640 comp rx=0 tx=0).stop 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.571+0000 7ff74ea2f740 1 -- 172.21.15.92:0/430014356 shutdown_connections 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.571+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/430014356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f59120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.571+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/430014356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f58be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.571+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/430014356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f586a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.571+0000 7ff74ea2f740 1 -- 172.21.15.92:0/430014356 >> 172.21.15.92:0/430014356 conn(0x562fb8ba5460 msgr2=0x562fb8f56590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.571+0000 7ff74ea2f740 1 -- 172.21.15.92:0/430014356 shutdown_connections 2024-09-21T07:19:58.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.571+0000 7ff74ea2f740 1 -- 172.21.15.92:0/430014356 wait complete. 2024-09-21T07:19:58.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff74ea2f740 1 -- start start 2024-09-21T07:19:58.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff74ea2f740 1 Processor -- start 2024-09-21T07:19:58.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f63cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f64230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f64790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562fb8d1f700 con 0x562fb8bb1070 2024-09-21T07:19:58.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562fb8e59160 con 0x562fb8b881b0 2024-09-21T07:19:58.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562fb8f66e20 con 0x562fb8b90390 2024-09-21T07:19:58.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff74ea2f740 10 client.0 _ll_register_callbacks cb 0x562fb8e729e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:58.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff746a58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f64790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff746a58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f64790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58312/0 (socket says 172.21.15.92:58312) 2024-09-21T07:19:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff746a58640 1 -- 172.21.15.92:0/2557654175 learned_addr learned my addr 172.21.15.92:0/2557654175 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff746257640 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f63cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.572+0000 7ff745a56640 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f64230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff746a58640 1 -- 172.21.15.92:0/2557654175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 msgr2=0x562fb8f64230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff746a58640 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f64230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff746a58640 1 -- 172.21.15.92:0/2557654175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 msgr2=0x562fb8f63cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff746a58640 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f63cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff746a58640 1 -- 172.21.15.92:0/2557654175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fb8e86c90 con 0x562fb8bb1070 2024-09-21T07:19:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff746a58640 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f64790 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ff738006010 tx=0x7ff738031ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daadd83d2beb6b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff729ffb640 1 -- 172.21.15.92:0/2557654175 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738052020 con 0x562fb8bb1070 2024-09-21T07:19:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff729ffb640 1 -- 172.21.15.92:0/2557654175 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff7380042c0 con 0x562fb8bb1070 2024-09-21T07:19:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff74ea2f740 1 -- 172.21.15.92:0/2557654175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff738036040 con 0x562fb8bb1070 2024-09-21T07:19:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff729ffb640 1 -- 172.21.15.92:0/2557654175 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff73805d050 con 0x562fb8bb1070 2024-09-21T07:19:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff74ea2f740 10 client.17553 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:58.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff74ea2f740 1 -- 172.21.15.92:0/2557654175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562fb8f72aa0 con 0x562fb8bb1070 2024-09-21T07:19:58.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.573+0000 7ff729ffb640 1 -- 172.21.15.92:0/2557654175 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff738036040 con 0x562fb8bb1070 2024-09-21T07:19:58.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.574+0000 7ff729ffb640 1 -- 172.21.15.92:0/2557654175 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff73804d030 con 0x562fb8bb1070 2024-09-21T07:19:58.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.574+0000 7ff74ea2f740 10 client.17553 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:58.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.574+0000 7ff74ea2f740 10 client.17553 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:19:58.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.574+0000 7ff74ea2f740 20 client.17553 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:58.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.574+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x562fb8b6f9f0 0x562fb8f75e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.574+0000 7ff74ea2f740 4 client.17553 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:19:58.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.574+0000 7ff74ea2f740 1 -- 172.21.15.92:0/2557654175 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fb8ed0df0 con 0x562fb8b6f9f0 2024-09-21T07:19:58.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.574+0000 7ff746257640 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x562fb8b6f9f0 0x562fb8f75e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.574+0000 7ff729ffb640 10 client.17553 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:19:58.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.574+0000 7ff746257640 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x562fb8b6f9f0 0x562fb8f75e00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ffd557ec1fd12f4 server_cookie=ee3deebe8f164514 in_seq=0 out_seq=0 2024-09-21T07:19:58.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff729ffb640 1 -- 172.21.15.92:0/2557654175 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562fb8ed0df0 con 0x562fb8b6f9f0 2024-09-21T07:19:58.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff729ffb640 10 client.17553 handle_command_reply: tid=0 2024-09-21T07:19:58.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff74ea2f740 1 client.17553 shutdown 2024-09-21T07:19:58.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff74ea2f740 1 -- 172.21.15.92:0/2557654175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 msgr2=0x562fb8f64790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:58.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f64790 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ff738006010 tx=0x7ff738031ae0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff74ea2f740 1 -- 172.21.15.92:0/2557654175 shutdown_connections 2024-09-21T07:19:58.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x562fb8b6f9f0 0x562fb8f75e00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f64790 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f64230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/2557654175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f63cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff74ea2f740 1 -- 172.21.15.92:0/2557654175 >> 172.21.15.92:0/2557654175 conn(0x562fb8ba5460 msgr2=0x562fb8f5b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:58.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.575+0000 7ff729ffb640 0 client.17553 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:19:58.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.576+0000 7ff74ea2f740 1 -- 172.21.15.92:0/2557654175 shutdown_connections 2024-09-21T07:19:58.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.576+0000 7ff74ea2f740 1 -- 172.21.15.92:0/2557654175 wait complete. 2024-09-21T07:19:58.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.576+0000 7ff74ea2f740 20 client.17553 trim_cache size 0 max 16384 2024-09-21T07:19:58.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff74ea2f740 1 Processor -- start 2024-09-21T07:19:58.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff74ea2f740 1 -- start start 2024-09-21T07:19:58.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f62be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f59de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f60ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401b0e60 con 0x562fb8bb1070 2024-09-21T07:19:58.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401b29a0 con 0x562fb8b881b0 2024-09-21T07:19:58.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401b1530 con 0x562fb8b90390 2024-09-21T07:19:58.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff746a58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f60ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff746a58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f60ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58324/0 (socket says 172.21.15.92:58324) 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff746a58640 1 -- 172.21.15.92:0/1401637569 learned_addr learned my addr 172.21.15.92:0/1401637569 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff745a56640 1 --2- 172.21.15.92:0/1401637569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f59de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff746257640 1 --2- 172.21.15.92:0/1401637569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f62be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff746a58640 1 -- 172.21.15.92:0/1401637569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 msgr2=0x562fb8f59de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff746a58640 1 --2- 172.21.15.92:0/1401637569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f59de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff746a58640 1 -- 172.21.15.92:0/1401637569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 msgr2=0x562fb8f62be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff746a58640 1 --2- 172.21.15.92:0/1401637569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f62be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff746a58640 1 -- 172.21.15.92:0/1401637569 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fb8f64d90 con 0x562fb8bb1070 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.589+0000 7ff746a58640 1 --2- 172.21.15.92:0/1401637569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f60ee0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff73802a900 tx=0x7ff738000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696a522b60c9b773 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff72bfff640 1 -- 172.21.15.92:0/1401637569 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738052040 con 0x562fb8bb1070 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff72bfff640 1 -- 172.21.15.92:0/1401637569 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff738036040 con 0x562fb8bb1070 2024-09-21T07:19:58.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff72bfff640 1 -- 172.21.15.92:0/1401637569 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73804a040 con 0x562fb8bb1070 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1401637569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 msgr2=0x562fb8f60ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/1401637569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f60ee0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff73802a900 tx=0x7ff738000f40 comp rx=0 tx=0).stop 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1401637569 shutdown_connections 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/1401637569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8f60ee0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/1401637569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f59de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/1401637569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f62be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1401637569 >> 172.21.15.92:0/1401637569 conn(0x562fb8ba5460 msgr2=0x562fb8f596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1401637569 shutdown_connections 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.590+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1401637569 wait complete. 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff74ea2f740 1 -- start start 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff74ea2f740 1 Processor -- start 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f76920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f76f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff74ea2f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8fd75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401b22d0 con 0x562fb8bb1070 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401b1c00 con 0x562fb8b881b0 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff74ea2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401aee40 con 0x562fb8b90390 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff74ea2f740 10 client.0 _ll_register_callbacks cb 0x7ff7380314e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff746a58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8fd75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff746a58640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8fd75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58334/0 (socket says 172.21.15.92:58334) 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff746a58640 1 -- 172.21.15.92:0/1413242144 learned_addr learned my addr 172.21.15.92:0/1413242144 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff746257640 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f76920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.591+0000 7ff745a56640 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f76f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff746a58640 1 -- 172.21.15.92:0/1413242144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 msgr2=0x562fb8f76f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff746a58640 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f76f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff746a58640 1 -- 172.21.15.92:0/1413242144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 msgr2=0x562fb8f76920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff746a58640 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f76920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff746a58640 1 -- 172.21.15.92:0/1413242144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fb8fd7c10 con 0x562fb8bb1070 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff745a56640 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f76f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff746257640 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f76920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff746a58640 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8fd75a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff738009620 tx=0x7ff738031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48435bff5b8d656e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff729ffb640 1 -- 172.21.15.92:0/1413242144 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738052040 con 0x562fb8bb1070 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff729ffb640 1 -- 172.21.15.92:0/1413242144 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7ff738003b70 con 0x562fb8bb1070 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1413242144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff738036040 con 0x562fb8bb1070 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff729ffb640 1 -- 172.21.15.92:0/1413242144 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff738003d70 con 0x562fb8bb1070 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff74ea2f740 10 client.17559 fetch_fsmap learned FSMap version 29 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1413242144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562fb8fe00f0 con 0x562fb8bb1070 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.592+0000 7ff729ffb640 1 -- 172.21.15.92:0/1413242144 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff738036040 con 0x562fb8bb1070 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.593+0000 7ff729ffb640 1 -- 172.21.15.92:0/1413242144 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff73804d040 con 0x562fb8bb1070 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.593+0000 7ff74ea2f740 10 client.17559 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:19:58.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.593+0000 7ff74ea2f740 10 client.17559 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.593+0000 7ff74ea2f740 20 client.17559 populate_metadata read hostname 'smithi092' 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.593+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x562fb8b44da0 0x562fb8fe2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.593+0000 7ff74ea2f740 4 client.17559 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.593+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1413242144 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562fb8ecc8a0 con 0x562fb8b44da0 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.593+0000 7ff746257640 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x562fb8b44da0 0x562fb8fe2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.593+0000 7ff729ffb640 10 client.17559 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.593+0000 7ff746257640 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x562fb8b44da0 0x562fb8fe2550 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c047485b8ea512ab server_cookie=310b65798239373a in_seq=0 out_seq=0 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff729ffb640 1 -- 172.21.15.92:0/1413242144 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562fb8ecc8a0 con 0x562fb8b44da0 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff729ffb640 10 client.17559 handle_command_reply: tid=0 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 client.17559 shutdown 2024-09-21T07:19:58.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1413242144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 msgr2=0x562fb8fd75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8fd75a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff738009620 tx=0x7ff738031840 comp rx=0 tx=0).stop 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1413242144 shutdown_connections 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x562fb8b44da0 0x562fb8fe2550 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562fb8bb1070 0x562fb8fd75a0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562fb8b90390 0x562fb8f76f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 --2- 172.21.15.92:0/1413242144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fb8b881b0 0x562fb8f76920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff729ffb640 0 client.17559 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1413242144 >> 172.21.15.92:0/1413242144 conn(0x562fb8ba5460 msgr2=0x562fb8f59f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1413242144 shutdown_connections 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 1 -- 172.21.15.92:0/1413242144 wait complete. 2024-09-21T07:19:58.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff74ea2f740 20 client.17559 trim_cache size 0 max 16384 2024-09-21T07:19:58.604 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:19:58.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff7484bb640 1 -- 172.21.15.92:0/3791259389 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff72c0b66b0 msgr2=0x7ff72c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff7484bb640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff72c0b66b0 0x7ff72c0b8bc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x562fb8f57320 tx=0x7ff734008040 comp rx=0 tx=0).stop 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff7484bb640 1 -- 172.21.15.92:0/3791259389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7401083a0 msgr2=0x7ff74019a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff7484bb640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7401083a0 0x7ff74019a980 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c970 tx=0x7ff73c00cd70 comp rx=0 tx=0).stop 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff7484bb640 1 -- 172.21.15.92:0/3791259389 shutdown_connections 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff7484bb640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff72c0b66b0 0x7ff72c0b8bc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff7484bb640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff740108cf0 0x7ff74019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff7484bb640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7401083a0 0x7ff74019a980 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff7484bb640 1 --2- 172.21.15.92:0/3791259389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff740102a60 0x7ff74019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.594+0000 7ff7484bb640 1 -- 172.21.15.92:0/3791259389 >> 172.21.15.92:0/3791259389 conn(0x7ff740079730 msgr2=0x7ff7401041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.595+0000 7ff7484bb640 1 -- 172.21.15.92:0/3791259389 shutdown_connections 2024-09-21T07:19:58.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:19:58.595+0000 7ff7484bb640 1 -- 172.21.15.92:0/3791259389 wait complete. 2024-09-21T07:19:59.468 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:19:59.724 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:00.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:19:59 smithi092 ceph-mon[30987]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:00.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:19:59 smithi169 ceph-mon[33705]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:00.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:19:59 smithi175 ceph-mon[34064]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 -- 172.21.15.92:0/3714163347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7934103b60 msgr2=0x7f7934103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 --2- 172.21.15.92:0/3714163347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7934103b60 0x7f7934103f70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7928009900 tx=0x7f792802a410 comp rx=0 tx=0).stop 2024-09-21T07:20:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 -- 172.21.15.92:0/3714163347 shutdown_connections 2024-09-21T07:20:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 --2- 172.21.15.92:0/3714163347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7934109df0 0x7f7934110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 --2- 172.21.15.92:0/3714163347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79341094a0 0x7f79341098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 --2- 172.21.15.92:0/3714163347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7934103b60 0x7f7934103f70 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 -- 172.21.15.92:0/3714163347 >> 172.21.15.92:0/3714163347 conn(0x7f793407b850 msgr2=0x7f793407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 -- 172.21.15.92:0/3714163347 shutdown_connections 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 -- 172.21.15.92:0/3714163347 wait complete. 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 Processor -- start 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.285+0000 7f793ae6b640 1 -- start start 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f793ae6b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7934103b60 0x7f793419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f793ae6b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79341094a0 0x7f793419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f793ae6b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7934109df0 0x7f793419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f793ae6b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7934113960 con 0x7f79341094a0 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f793ae6b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f79341137e0 con 0x7f7934103b60 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f793ae6b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7934113ae0 con 0x7f7934109df0 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7933fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79341094a0 0x7f793419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7933fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79341094a0 0x7f793419a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33894/0 (socket says 172.21.15.92:33894) 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7933fff640 1 -- 172.21.15.92:0/2589179693 learned_addr learned my addr 172.21.15.92:0/2589179693 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7939408640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7934109df0 0x7f793419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7938c07640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7934103b60 0x7f793419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7933fff640 1 -- 172.21.15.92:0/2589179693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7934109df0 msgr2=0x7f793419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7933fff640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7934109df0 0x7f793419fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7933fff640 1 -- 172.21.15.92:0/2589179693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7934103b60 msgr2=0x7f793419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7933fff640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7934103b60 0x7f793419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7933fff640 1 -- 172.21.15.92:0/2589179693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79341a03a0 con 0x7f79341094a0 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.286+0000 7f7933fff640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79341094a0 0x7f793419a9d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f792000d750 tx=0x7f792000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.287+0000 7f7931ffb640 1 -- 172.21.15.92:0/2589179693 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920017070 con 0x7f79341094a0 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.287+0000 7f7931ffb640 1 -- 172.21.15.92:0/2589179693 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79200054b0 con 0x7f79341094a0 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.287+0000 7f793ae6b640 1 -- 172.21.15.92:0/2589179693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79341a0690 con 0x7f79341094a0 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.287+0000 7f7931ffb640 1 -- 172.21.15.92:0/2589179693 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920004bc0 con 0x7f79341094a0 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.287+0000 7f793ae6b640 1 -- 172.21.15.92:0/2589179693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79341a6df0 con 0x7f79341094a0 2024-09-21T07:20:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.289+0000 7f7931ffb640 1 -- 172.21.15.92:0/2589179693 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f7920009c30 con 0x7f79341094a0 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.289+0000 7f79413df740 1 Processor -- start 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.289+0000 7f79413df740 1 -- start start 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f79413df740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058fe070 0x557d05ca52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f79413df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058d51b0 0x557d05ca5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f79413df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05ca5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f79413df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557d05c1bea0 con 0x557d058dd390 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f79413df740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557d05c0b2d0 con 0x557d058fe070 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f79413df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d05c0f0e0 con 0x557d058d51b0 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7933fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05ca5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7933fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05ca5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33908/0 (socket says 172.21.15.92:33908) 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7933fff640 1 -- 172.21.15.92:0/3581440737 learned_addr learned my addr 172.21.15.92:0/3581440737 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7938c07640 1 --2- 172.21.15.92:0/3581440737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058d51b0 0x557d05ca5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7939408640 1 --2- 172.21.15.92:0/3581440737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058fe070 0x557d05ca52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7933fff640 1 -- 172.21.15.92:0/3581440737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058d51b0 msgr2=0x557d05ca5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7933fff640 1 --2- 172.21.15.92:0/3581440737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058d51b0 0x557d05ca5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7933fff640 1 -- 172.21.15.92:0/3581440737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058fe070 msgr2=0x557d05ca52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7933fff640 1 --2- 172.21.15.92:0/3581440737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058fe070 0x557d05ca52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7933fff640 1 -- 172.21.15.92:0/3581440737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d05969650 con 0x557d058dd390 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7933fff640 1 --2- 172.21.15.92:0/3581440737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05ca5d40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f79200e46c0 tx=0x7f79200eda10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a8dd2129f87b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.290+0000 7f7931ffb640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79240b6700 0x7f79240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.291+0000 7f7939408640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79240b6700 0x7f79240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.291+0000 7f791effd640 1 -- 172.21.15.92:0/3581440737 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79200fa070 con 0x557d058dd390 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.291+0000 7f791effd640 1 -- 172.21.15.92:0/3581440737 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79200aca10 con 0x557d058dd390 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.291+0000 7f791effd640 1 -- 172.21.15.92:0/3581440737 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79200ac670 con 0x557d058dd390 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.291+0000 7f7931ffb640 1 -- 172.21.15.92:0/2589179693 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f79200e73a0 con 0x7f79341094a0 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 -- 172.21.15.92:0/3581440737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 msgr2=0x557d05ca5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:00.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 --2- 172.21.15.92:0/3581440737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05ca5d40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f79200e46c0 tx=0x7f79200eda10 comp rx=0 tx=0).stop 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f7939408640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79240b6700 0x7f79240b8c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f792c005fd0 tx=0x7f792c0096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 -- 172.21.15.92:0/3581440737 shutdown_connections 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 --2- 172.21.15.92:0/3581440737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05ca5d40 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 --2- 172.21.15.92:0/3581440737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058d51b0 0x557d05ca5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 --2- 172.21.15.92:0/3581440737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058fe070 0x557d05ca52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 -- 172.21.15.92:0/3581440737 >> 172.21.15.92:0/3581440737 conn(0x557d058f2460 msgr2=0x557d05ca31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 -- 172.21.15.92:0/3581440737 shutdown_connections 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 -- 172.21.15.92:0/3581440737 wait complete. 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 -- start start 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.292+0000 7f79413df740 1 Processor -- start 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f79413df740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 0x557d05cb08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f79413df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05cb0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f79413df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058fe070 0x557d05cb1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f79413df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557d05a6c700 con 0x557d058dd390 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f79413df740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557d05ba6160 con 0x557d058d51b0 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f79413df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d05cb3aa0 con 0x557d058fe070 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f79413df740 10 client.0 _ll_register_callbacks cb 0x557d05bbf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f7933fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05cb0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f7933fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05cb0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33920/0 (socket says 172.21.15.92:33920) 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f7933fff640 1 -- 172.21.15.92:0/2058276499 learned_addr learned my addr 172.21.15.92:0/2058276499 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f7938c07640 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 0x557d05cb08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f7933fff640 1 -- 172.21.15.92:0/2058276499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058fe070 msgr2=0x557d05cb1380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f7933fff640 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058fe070 0x557d05cb1380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f7933fff640 1 -- 172.21.15.92:0/2058276499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 msgr2=0x557d05cb08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f7933fff640 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 0x557d05cb08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f7933fff640 1 -- 172.21.15.92:0/2058276499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d05bd3c90 con 0x557d058dd390 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.293+0000 7f7938c07640 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 0x557d05cb08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.294+0000 7f7933fff640 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05cb0e20 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f79200ace90 tx=0x7f7920004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7feed45531b2ecb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.294+0000 7f7913fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.294+0000 7f7913fff640 1 -- 172.21.15.92:0/2058276499 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79200970e0 con 0x557d058dd390 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.294+0000 7f7913fff640 1 -- 172.21.15.92:0/2058276499 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f79200940e0 con 0x557d058dd390 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.294+0000 7f79413df740 1 -- 172.21.15.92:0/2058276499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79200aca10 con 0x557d058dd390 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.294+0000 7f7913fff640 1 -- 172.21.15.92:0/2058276499 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7920020020 con 0x557d058dd390 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.294+0000 7f79413df740 10 client.17571 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.294+0000 7f79413df740 1 -- 172.21.15.92:0/2058276499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d05cbf720 con 0x557d058dd390 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.295+0000 7f7913fff640 1 -- 172.21.15.92:0/2058276499 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79200aca10 con 0x557d058dd390 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.295+0000 7f7913fff640 1 -- 172.21.15.92:0/2058276499 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f79200b63e0 con 0x557d058dd390 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.295+0000 7f79413df740 10 client.17571 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.295+0000 7f79413df740 10 client.17571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.295+0000 7f79413df740 20 client.17571 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.295+0000 7f79413df740 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d058bc9f0 0x557d05cc2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.295+0000 7f79413df740 4 client.17571 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:00.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.295+0000 7f79413df740 1 -- 172.21.15.92:0/2058276499 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d05c1ddf0 con 0x557d058bc9f0 2024-09-21T07:20:00.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.295+0000 7f7938c07640 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d058bc9f0 0x557d05cc2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.296+0000 7f7913fff640 10 client.17571 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.296+0000 7f7938c07640 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d058bc9f0 0x557d05cc2a80 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ff9f8546855cad9 server_cookie=96e0d07d27aee316 in_seq=0 out_seq=0 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f7913fff640 1 -- 172.21.15.92:0/2058276499 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d05c1ddf0 con 0x557d058bc9f0 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f7913fff640 10 client.17571 handle_command_reply: tid=0 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 client.17571 shutdown 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 -- 172.21.15.92:0/2058276499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 msgr2=0x557d05cb0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05cb0e20 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f79200ace90 tx=0x7f7920004730 comp rx=0 tx=0).stop 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 -- 172.21.15.92:0/2058276499 shutdown_connections 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d058bc9f0 0x557d05cc2a80 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058fe070 0x557d05cb1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058dd390 0x557d05cb0e20 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f7913fff640 0 client.17571 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 --2- 172.21.15.92:0/2058276499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 0x557d05cb08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 -- 172.21.15.92:0/2058276499 >> 172.21.15.92:0/2058276499 conn(0x557d058f2460 msgr2=0x557d05ca84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 -- 172.21.15.92:0/2058276499 shutdown_connections 2024-09-21T07:20:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.297+0000 7f79413df740 1 -- 172.21.15.92:0/2058276499 wait complete. 2024-09-21T07:20:00.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.298+0000 7f79413df740 20 client.17571 trim_cache size 0 max 16384 2024-09-21T07:20:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f79413df740 1 Processor -- start 2024-09-21T07:20:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f79413df740 1 -- start start 2024-09-21T07:20:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f79413df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058d51b0 0x557d05cb0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f79413df740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058dd390 0x557d05ca2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f79413df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05ca2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f79413df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f79341aec10 con 0x557d058fe070 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f79413df740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f79341b0750 con 0x557d058dd390 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f79413df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79341af2e0 con 0x557d058d51b0 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7939408640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05ca2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7939408640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05ca2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33930/0 (socket says 172.21.15.92:33930) 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7939408640 1 -- 172.21.15.92:0/4089072429 learned_addr learned my addr 172.21.15.92:0/4089072429 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7938c07640 1 --2- 172.21.15.92:0/4089072429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058d51b0 0x557d05cb0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7933fff640 1 --2- 172.21.15.92:0/4089072429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058dd390 0x557d05ca2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7939408640 1 -- 172.21.15.92:0/4089072429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058d51b0 msgr2=0x557d05cb0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7939408640 1 --2- 172.21.15.92:0/4089072429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058d51b0 0x557d05cb0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7939408640 1 -- 172.21.15.92:0/4089072429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058dd390 msgr2=0x557d05ca2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7939408640 1 --2- 172.21.15.92:0/4089072429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058dd390 0x557d05ca2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7939408640 1 -- 172.21.15.92:0/4089072429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d05caede0 con 0x557d058fe070 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f7939408640 1 --2- 172.21.15.92:0/4089072429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05ca2ca0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f792c004010 tx=0x7f792c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f6ba93f8cf19d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:00.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.311+0000 7f791e7fc640 1 -- 172.21.15.92:0/4089072429 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c004d20 con 0x557d058fe070 2024-09-21T07:20:00.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f791e7fc640 1 -- 172.21.15.92:0/4089072429 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f792c012e30 con 0x557d058fe070 2024-09-21T07:20:00.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f791e7fc640 1 -- 172.21.15.92:0/4089072429 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c01b750 con 0x557d058fe070 2024-09-21T07:20:00.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f79413df740 1 -- 172.21.15.92:0/4089072429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 msgr2=0x557d05ca2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:00.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f79413df740 1 --2- 172.21.15.92:0/4089072429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05ca2ca0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f792c004010 tx=0x7f792c015000 comp rx=0 tx=0).stop 2024-09-21T07:20:00.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f79413df740 1 -- 172.21.15.92:0/4089072429 shutdown_connections 2024-09-21T07:20:00.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f79413df740 1 --2- 172.21.15.92:0/4089072429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05ca2ca0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f79413df740 1 --2- 172.21.15.92:0/4089072429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058dd390 0x557d05ca2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f79413df740 1 --2- 172.21.15.92:0/4089072429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058d51b0 0x557d05cb0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f79413df740 1 -- 172.21.15.92:0/4089072429 >> 172.21.15.92:0/4089072429 conn(0x557d058f2460 msgr2=0x557d05cb0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f79413df740 1 -- 172.21.15.92:0/4089072429 shutdown_connections 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.312+0000 7f79413df740 1 -- 172.21.15.92:0/4089072429 wait complete. 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f79413df740 1 -- start start 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f79413df740 1 Processor -- start 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f79413df740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 0x557d05cc3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f79413df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058dd390 0x557d05cc40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f79413df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05cc45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f79413df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f79341b0080 con 0x557d058fe070 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f79413df740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f79341af9b0 con 0x557d058d51b0 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f79413df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79341acbf0 con 0x557d058dd390 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f79413df740 10 client.0 _ll_register_callbacks cb 0x7f79200f8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f7939408640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05cc45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f7939408640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05cc45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33940/0 (socket says 172.21.15.92:33940) 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f7939408640 1 -- 172.21.15.92:0/4137247867 learned_addr learned my addr 172.21.15.92:0/4137247867 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.313+0000 7f7933fff640 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058dd390 0x557d05cc40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7938c07640 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 0x557d05cc3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7939408640 1 -- 172.21.15.92:0/4137247867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058dd390 msgr2=0x557d05cc40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7939408640 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058dd390 0x557d05cc40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7939408640 1 -- 172.21.15.92:0/4137247867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 msgr2=0x557d05cc3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7939408640 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 0x557d05cc3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7939408640 1 -- 172.21.15.92:0/4137247867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d05d2c2d0 con 0x557d058fe070 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7939408640 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05cc45f0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f792c004920 tx=0x7f792c004ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bfa8bcc6c1f438 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7913fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7913fff640 1 -- 172.21.15.92:0/4137247867 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c032030 con 0x557d058fe070 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7913fff640 1 -- 172.21.15.92:0/4137247867 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f792c02a050 con 0x557d058fe070 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f79413df740 1 -- 172.21.15.92:0/4137247867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f792c012e30 con 0x557d058fe070 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f7913fff640 1 -- 172.21.15.92:0/4137247867 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f792c004fd0 con 0x557d058fe070 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f79413df740 10 client.17577 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.314+0000 7f79413df740 1 -- 172.21.15.92:0/4137247867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d05d2d550 con 0x557d058fe070 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f7913fff640 1 -- 172.21.15.92:0/4137247867 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f792c012e30 con 0x557d058fe070 2024-09-21T07:20:00.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f7913fff640 1 -- 172.21.15.92:0/4137247867 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f792c024070 con 0x557d058fe070 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f79413df740 10 client.17577 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f79413df740 10 client.17577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f79413df740 20 client.17577 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f79413df740 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d05891da0 0x557d05d2fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f79413df740 4 client.17577 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f79413df740 1 -- 172.21.15.92:0/4137247867 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d05c198a0 con 0x557d05891da0 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f7938c07640 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d05891da0 0x557d05d2fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f7913fff640 10 client.17577 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.315+0000 7f7938c07640 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d05891da0 0x557d05d2fca0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1afe6ebc00e6d server_cookie=cedf86dc2ea2f448 in_seq=0 out_seq=0 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f7913fff640 1 -- 172.21.15.92:0/4137247867 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d05c198a0 con 0x557d05891da0 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f7913fff640 10 client.17577 handle_command_reply: tid=0 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 client.17577 shutdown 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 -- 172.21.15.92:0/4137247867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 msgr2=0x557d05cc45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:00.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05cc45f0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f792c004920 tx=0x7f792c004ba0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 -- 172.21.15.92:0/4137247867 shutdown_connections 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x557d05891da0 0x557d05d2fca0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d058fe070 0x557d05cc45f0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d058dd390 0x557d05cc40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 --2- 172.21.15.92:0/4137247867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d058d51b0 0x557d05cc3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 -- 172.21.15.92:0/4137247867 >> 172.21.15.92:0/4137247867 conn(0x557d058f2460 msgr2=0x557d05ca62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f7913fff640 0 client.17577 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 -- 172.21.15.92:0/4137247867 shutdown_connections 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 1 -- 172.21.15.92:0/4137247867 wait complete. 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.316+0000 7f79413df740 20 client.17577 trim_cache size 0 max 16384 2024-09-21T07:20:00.323 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:20:00.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 -- 172.21.15.92:0/2589179693 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79240b6700 msgr2=0x7f79240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:00.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79240b6700 0x7f79240b8c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f792c005fd0 tx=0x7f792c0096a0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 -- 172.21.15.92:0/2589179693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79341094a0 msgr2=0x7f793419a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:00.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79341094a0 0x7f793419a9d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f792000d750 tx=0x7f792000dc10 comp rx=0 tx=0).stop 2024-09-21T07:20:00.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 -- 172.21.15.92:0/2589179693 shutdown_connections 2024-09-21T07:20:00.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f79240b6700 0x7f79240b8c10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7934109df0 0x7f793419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79341094a0 0x7f793419a9d0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 --2- 172.21.15.92:0/2589179693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7934103b60 0x7f793419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:00.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 -- 172.21.15.92:0/2589179693 >> 172.21.15.92:0/2589179693 conn(0x7f793407b850 msgr2=0x7f7934107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:00.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 -- 172.21.15.92:0/2589179693 shutdown_connections 2024-09-21T07:20:00.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:00.317+0000 7f793ae6b640 1 -- 172.21.15.92:0/2589179693 wait complete. 2024-09-21T07:20:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: overall HEALTH_OK 2024-09-21T07:20:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:20:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-21T07:20:01.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-21T07:20:01.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: Unable to set osd_memory_target on smithi175 to 184563097: error parsing value: Value '184563097' is below minimum 939524096 2024-09-21T07:20:01.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:00 smithi092 ceph-mon[30987]: Unable to set osd_memory_target on smithi169 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-21T07:20:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: overall HEALTH_OK 2024-09-21T07:20:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: Unable to set osd_memory_target on smithi175 to 184563097: error parsing value: Value '184563097' is below minimum 939524096 2024-09-21T07:20:01.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:00 smithi169 ceph-mon[33705]: Unable to set osd_memory_target on smithi169 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-21T07:20:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: overall HEALTH_OK 2024-09-21T07:20:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:20:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:01.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-21T07:20:01.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-21T07:20:01.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: Unable to set osd_memory_target on smithi175 to 184563097: error parsing value: Value '184563097' is below minimum 939524096 2024-09-21T07:20:01.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:00 smithi175 ceph-mon[34064]: Unable to set osd_memory_target on smithi169 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-21T07:20:02.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:01 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:01 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:01 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:01 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:01 smithi092 ceph-mon[30987]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-21T07:20:02.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:01 smithi092 ceph-mon[30987]: Unable to set osd_memory_target on smithi092 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T07:20:02.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:01 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:20:02.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:01 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:20:02.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:01 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:20:02.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:01 smithi092 ceph-mon[30987]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:20:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:01 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:01 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:01 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:01 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:01 smithi169 ceph-mon[33705]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-21T07:20:02.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:01 smithi169 ceph-mon[33705]: Unable to set osd_memory_target on smithi092 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T07:20:02.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:01 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:20:02.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:01 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:20:02.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:01 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:20:02.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:01 smithi169 ceph-mon[33705]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:20:02.197 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:20:02.198 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:20:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:01 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:01 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:01 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:01 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:20:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:01 smithi175 ceph-mon[34064]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-21T07:20:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:01 smithi175 ceph-mon[34064]: Unable to set osd_memory_target on smithi092 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T07:20:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:01 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:20:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:01 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:20:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:01 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:20:02.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:01 smithi175 ceph-mon[34064]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:20:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:02.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.950+0000 7f7288e95640 1 -- 172.21.15.92:0/4178913300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7284108cf0 msgr2=0x7f728410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:02.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.950+0000 7f7288e95640 1 --2- 172.21.15.92:0/4178913300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7284108cf0 0x7f728410f520 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f727c009900 tx=0x7f727c02a410 comp rx=0 tx=0).stop 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.950+0000 7f7288e95640 1 -- 172.21.15.92:0/4178913300 shutdown_connections 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.950+0000 7f7288e95640 1 --2- 172.21.15.92:0/4178913300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7284108cf0 0x7f728410f520 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.950+0000 7f7288e95640 1 --2- 172.21.15.92:0/4178913300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72841083a0 0x7f72841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.950+0000 7f7288e95640 1 --2- 172.21.15.92:0/4178913300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7284102a60 0x7f7284102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.950+0000 7f7288e95640 1 -- 172.21.15.92:0/4178913300 >> 172.21.15.92:0/4178913300 conn(0x7f7284079730 msgr2=0x7f7284079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.950+0000 7f7288e95640 1 -- 172.21.15.92:0/4178913300 shutdown_connections 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.950+0000 7f7288e95640 1 -- 172.21.15.92:0/4178913300 wait complete. 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7288e95640 1 Processor -- start 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7288e95640 1 -- start start 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7288e95640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7284102a60 0x7f728419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7288e95640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72841083a0 0x7f728419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7288e95640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7284108cf0 0x7f728419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7288e95640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7284113930 con 0x7f7284108cf0 2024-09-21T07:20:02.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7288e95640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f72841137b0 con 0x7f72841083a0 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7288e95640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7284113ab0 con 0x7f7284102a60 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7282d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7284108cf0 0x7f728419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7282d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7284108cf0 0x7f728419fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33956/0 (socket says 172.21.15.92:33956) 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.951+0000 7f7282d9d640 1 -- 172.21.15.92:0/3015809395 learned_addr learned my addr 172.21.15.92:0/3015809395 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f728259c640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7284102a60 0x7f728419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f7281d9b640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72841083a0 0x7f728419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f7282d9d640 1 -- 172.21.15.92:0/3015809395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7284102a60 msgr2=0x7f728419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f7282d9d640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7284102a60 0x7f728419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f7282d9d640 1 -- 172.21.15.92:0/3015809395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72841083a0 msgr2=0x7f728419a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f7282d9d640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72841083a0 0x7f728419a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f7282d9d640 1 -- 172.21.15.92:0/3015809395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72841a02b0 con 0x7f7284108cf0 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f7282d9d640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7284108cf0 0x7f728419fb80 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f727c005ab0 tx=0x7f727c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f727b7fe640 1 -- 172.21.15.92:0/3015809395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c03f030 con 0x7f7284108cf0 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f727b7fe640 1 -- 172.21.15.92:0/3015809395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f727c003a80 con 0x7f7284108cf0 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f7288e95640 1 -- 172.21.15.92:0/3015809395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72841a0540 con 0x7f7284108cf0 2024-09-21T07:20:02.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f727b7fe640 1 -- 172.21.15.92:0/3015809395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c035070 con 0x7f7284108cf0 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.952+0000 7f7288e95640 1 -- 172.21.15.92:0/3015809395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72841a6d00 con 0x7f7284108cf0 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.955+0000 7f728f409740 1 Processor -- start 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.955+0000 7f727b7fe640 1 -- 172.21.15.92:0/3015809395 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f727c042030 con 0x7f7284108cf0 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.955+0000 7f728f409740 1 -- start start 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f728f409740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834cc4350 0x55d83506b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f728f409740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d83506b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f728f409740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834ca3670 0x55d83506beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f728f409740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d834fe1e60 con 0x55d834ca3670 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f728f409740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d834fd1290 con 0x55d834c9b490 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f728f409740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d834fd50a0 con 0x55d834cc4350 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f7281d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834ca3670 0x55d83506beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f7281d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834ca3670 0x55d83506beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33968/0 (socket says 172.21.15.92:33968) 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f7281d9b640 1 -- 172.21.15.92:0/1094962464 learned_addr learned my addr 172.21.15.92:0/1094962464 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f728259c640 1 --2- 172.21.15.92:0/1094962464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d83506b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f7281d9b640 1 --2- 172.21.15.92:0/1094962464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834cc4350 0x55d83506b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f7281d9b640 1 -- 172.21.15.92:0/1094962464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834cc4350 msgr2=0x55d83506b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f7281d9b640 1 --2- 172.21.15.92:0/1094962464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834cc4350 0x55d83506b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f7281d9b640 1 -- 172.21.15.92:0/1094962464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 msgr2=0x55d83506b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f7281d9b640 1 --2- 172.21.15.92:0/1094962464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d83506b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f727b7fe640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72700b6700 0x7f72700b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f7281d9b640 1 -- 172.21.15.92:0/1094962464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d834d2f930 con 0x55d834ca3670 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f728259c640 1 --2- 172.21.15.92:0/1094962464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d83506b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f727b7fe640 1 -- 172.21.15.92:0/3015809395 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f727c108050 con 0x7f7284108cf0 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.956+0000 7f7281d9b640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72700b6700 0x7f72700b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.957+0000 7f7281d9b640 1 --2- 172.21.15.92:0/1094962464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834ca3670 0x55d83506beb0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f726c014990 tx=0x7f726c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935c20fdbd85e61f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.957+0000 7f7278ff9640 1 -- 172.21.15.92:0/1094962464 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c0142d0 con 0x55d834ca3670 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.957+0000 7f7278ff9640 1 -- 172.21.15.92:0/1094962464 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f726c0129a0 con 0x55d834ca3670 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.957+0000 7f7278ff9640 1 -- 172.21.15.92:0/1094962464 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c028070 con 0x55d834ca3670 2024-09-21T07:20:02.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 -- 172.21.15.92:0/1094962464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834ca3670 msgr2=0x55d83506beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 --2- 172.21.15.92:0/1094962464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834ca3670 0x55d83506beb0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f726c014990 tx=0x7f726c00c490 comp rx=0 tx=0).stop 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f7281d9b640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72700b6700 0x7f72700b8c10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f726c014fd0 tx=0x7f726c022000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 -- 172.21.15.92:0/1094962464 shutdown_connections 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 --2- 172.21.15.92:0/1094962464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834ca3670 0x55d83506beb0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 --2- 172.21.15.92:0/1094962464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d83506b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 --2- 172.21.15.92:0/1094962464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834cc4350 0x55d83506b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 -- 172.21.15.92:0/1094962464 >> 172.21.15.92:0/1094962464 conn(0x55d834cb8740 msgr2=0x55d835069320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 -- 172.21.15.92:0/1094962464 shutdown_connections 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 -- 172.21.15.92:0/1094962464 wait complete. 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 -- start start 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.958+0000 7f728f409740 1 Processor -- start 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f728f409740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d835077090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f728f409740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 0x55d835077690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f728f409740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835082f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f728f409740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d834e32890 con 0x55d834cc4350 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f728f409740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d834f6bd40 con 0x55d834c9b490 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f728f409740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d835079c10 con 0x55d834ca3670 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f728f409740 10 client.0 _ll_register_callbacks cb 0x55d834fcfc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7282d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835082f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7282d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835082f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33976/0 (socket says 172.21.15.92:33976) 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7282d9d640 1 -- 172.21.15.92:0/2293743692 learned_addr learned my addr 172.21.15.92:0/2293743692 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f728259c640 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d835077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7281d9b640 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 0x55d835077690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7282d9d640 1 -- 172.21.15.92:0/2293743692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 msgr2=0x55d835077690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7282d9d640 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 0x55d835077690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7282d9d640 1 -- 172.21.15.92:0/2293743692 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 msgr2=0x55d835077090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7282d9d640 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d835077090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7282d9d640 1 -- 172.21.15.92:0/2293743692 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8350835f0 con 0x55d834cc4350 2024-09-21T07:20:02.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7281d9b640 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 0x55d835077690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7282d9d640 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835082f80 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f727c0cda90 tx=0x7f727c0cd990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ab7b155b8ff5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.959+0000 7f7269ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f7269ffb640 1 -- 172.21.15.92:0/2293743692 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c049070 con 0x55d834cc4350 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f7269ffb640 1 -- 172.21.15.92:0/2293743692 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f727c0c9d70 con 0x55d834cc4350 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f728f409740 1 -- 172.21.15.92:0/2293743692 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f726c0129a0 con 0x55d834cc4350 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f7269ffb640 1 -- 172.21.15.92:0/2293743692 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f727c0cd610 con 0x55d834cc4350 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f728f409740 10 client.17589 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f728f409740 1 -- 172.21.15.92:0/2293743692 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d835085f20 con 0x55d834cc4350 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f7269ffb640 1 -- 172.21.15.92:0/2293743692 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f726c0129a0 con 0x55d834cc4350 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f7269ffb640 1 -- 172.21.15.92:0/2293743692 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f727c0d21c0 con 0x55d834cc4350 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f728f409740 10 client.17589 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f728f409740 10 client.17589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f728f409740 20 client.17589 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f728f409740 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d834c82cd0 0x55d835089370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f728f409740 4 client.17589 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:02.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.960+0000 7f728f409740 1 -- 172.21.15.92:0/2293743692 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d834fe3db0 con 0x55d834c82cd0 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.961+0000 7f728259c640 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d834c82cd0 0x55d835089370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.961+0000 7f728259c640 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d834c82cd0 0x55d835089370 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ab56e8f100685fa server_cookie=714000cd7ceb2050 in_seq=0 out_seq=0 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.961+0000 7f7269ffb640 10 client.17589 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f7269ffb640 1 -- 172.21.15.92:0/2293743692 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d834fe3db0 con 0x55d834c82cd0 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f7269ffb640 10 client.17589 handle_command_reply: tid=0 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 client.17589 shutdown 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 -- 172.21.15.92:0/2293743692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 msgr2=0x55d835082f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835082f80 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f727c0cda90 tx=0x7f727c0cd990 comp rx=0 tx=0).stop 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 -- 172.21.15.92:0/2293743692 shutdown_connections 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d834c82cd0 0x55d835089370 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835082f80 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 0x55d835077690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 --2- 172.21.15.92:0/2293743692 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d835077090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f7269ffb640 0 client.17589 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:02.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 -- 172.21.15.92:0/2293743692 >> 172.21.15.92:0/2293743692 conn(0x55d834cb8740 msgr2=0x55d83506e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:02.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 -- 172.21.15.92:0/2293743692 shutdown_connections 2024-09-21T07:20:02.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 1 -- 172.21.15.92:0/2293743692 wait complete. 2024-09-21T07:20:02.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.962+0000 7f728f409740 20 client.17589 trim_cache size 0 max 16384 2024-09-21T07:20:02.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f728f409740 1 Processor -- start 2024-09-21T07:20:02.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f728f409740 1 -- start start 2024-09-21T07:20:02.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f728f409740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d835082e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f728f409740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 0x55d8350704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f728f409740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f728f409740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72841b0d20 con 0x55d834cc4350 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f728f409740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f72841b2860 con 0x55d834c9b490 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f728f409740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f72841b13f0 con 0x55d834ca3670 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f7282d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f7282d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33984/0 (socket says 172.21.15.92:33984) 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f7282d9d640 1 -- 172.21.15.92:0/4064871136 learned_addr learned my addr 172.21.15.92:0/4064871136 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f728259c640 1 --2- 172.21.15.92:0/4064871136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d835082e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f7281d9b640 1 --2- 172.21.15.92:0/4064871136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 0x55d8350704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f7282d9d640 1 -- 172.21.15.92:0/4064871136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 msgr2=0x55d8350704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f7282d9d640 1 --2- 172.21.15.92:0/4064871136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 0x55d8350704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f7282d9d640 1 -- 172.21.15.92:0/4064871136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 msgr2=0x55d835082e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f7282d9d640 1 --2- 172.21.15.92:0/4064871136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d835082e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f7282d9d640 1 -- 172.21.15.92:0/4064871136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d835075df0 con 0x55d834cc4350 2024-09-21T07:20:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.980+0000 7f7281d9b640 1 --2- 172.21.15.92:0/4064871136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 0x55d8350704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.981+0000 7f7282d9d640 1 --2- 172.21.15.92:0/4064871136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835070a00 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f727c0ca0d0 tx=0x7f727c0cda00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5346c57849831a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.981+0000 7f726bfff640 1 -- 172.21.15.92:0/4064871136 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c049070 con 0x55d834cc4350 2024-09-21T07:20:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.981+0000 7f726bfff640 1 -- 172.21.15.92:0/4064871136 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f727c0ce200 con 0x55d834cc4350 2024-09-21T07:20:02.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.981+0000 7f726bfff640 1 -- 172.21.15.92:0/4064871136 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c105680 con 0x55d834cc4350 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.981+0000 7f728f409740 1 -- 172.21.15.92:0/4064871136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 msgr2=0x55d835070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.981+0000 7f728f409740 1 --2- 172.21.15.92:0/4064871136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835070a00 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f727c0ca0d0 tx=0x7f727c0cda00 comp rx=0 tx=0).stop 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.981+0000 7f728f409740 1 -- 172.21.15.92:0/4064871136 shutdown_connections 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.981+0000 7f728f409740 1 --2- 172.21.15.92:0/4064871136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834cc4350 0x55d835070a00 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 --2- 172.21.15.92:0/4064871136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834ca3670 0x55d8350704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 --2- 172.21.15.92:0/4064871136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834c9b490 0x55d835082e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 -- 172.21.15.92:0/4064871136 >> 172.21.15.92:0/4064871136 conn(0x55d834cb8740 msgr2=0x55d835072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 -- 172.21.15.92:0/4064871136 shutdown_connections 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 -- 172.21.15.92:0/4064871136 wait complete. 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 -- start start 2024-09-21T07:20:02.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 Processor -- start 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834c9b490 0x55d83507f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834ca3670 0x55d835079ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834cc4350 0x55d83507a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72841b2190 con 0x55d834c9b490 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f72841b1ac0 con 0x55d834ca3670 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f72841aed00 con 0x55d834cc4350 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728f409740 10 client.0 _ll_register_callbacks cb 0x7f727c005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834c9b490 0x55d83507f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.982+0000 7f728259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834c9b490 0x55d83507f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33988/0 (socket says 172.21.15.92:33988) 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f728259c640 1 -- 172.21.15.92:0/2430424856 learned_addr learned my addr 172.21.15.92:0/2430424856 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f7281d9b640 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834ca3670 0x55d835079ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f7282d9d640 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834cc4350 0x55d83507a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f728259c640 1 -- 172.21.15.92:0/2430424856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834cc4350 msgr2=0x55d83507a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:02.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f728259c640 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834cc4350 0x55d83507a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f728259c640 1 -- 172.21.15.92:0/2430424856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834ca3670 msgr2=0x55d835079ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f728259c640 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834ca3670 0x55d835079ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f728259c640 1 -- 172.21.15.92:0/2430424856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d83507a920 con 0x55d834c9b490 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f7281d9b640 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834ca3670 0x55d835079ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f728259c640 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834c9b490 0x55d83507f350 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7274005cc0 tx=0x7f72740043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99f35b62085bc71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f7269ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f7269ffb640 1 -- 172.21.15.92:0/2430424856 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274004b20 con 0x55d834c9b490 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f7269ffb640 1 -- 172.21.15.92:0/2430424856 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f7274020040 con 0x55d834c9b490 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f728f409740 1 -- 172.21.15.92:0/2430424856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f727c0ce200 con 0x55d834c9b490 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f7269ffb640 1 -- 172.21.15.92:0/2430424856 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7274030050 con 0x55d834c9b490 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f728f409740 10 client.17595 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.983+0000 7f728f409740 1 -- 172.21.15.92:0/2430424856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8350f8da0 con 0x55d834c9b490 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.984+0000 7f7269ffb640 1 -- 172.21.15.92:0/2430424856 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f727c0ce200 con 0x55d834c9b490 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.984+0000 7f7269ffb640 1 -- 172.21.15.92:0/2430424856 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f72740124e0 con 0x55d834c9b490 2024-09-21T07:20:02.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.984+0000 7f728f409740 10 client.17595 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:02.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.984+0000 7f728f409740 10 client.17595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:02.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.984+0000 7f728f409740 20 client.17595 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:02.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.984+0000 7f728f409740 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d834c58080 0x55d8350fb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:02.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.984+0000 7f728f409740 4 client.17595 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:20:02.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.984+0000 7f728f409740 1 -- 172.21.15.92:0/2430424856 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d834fdf860 con 0x55d834c58080 2024-09-21T07:20:02.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.984+0000 7f7281d9b640 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d834c58080 0x55d8350fb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:02.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.985+0000 7f7269ffb640 10 client.17595 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:02.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.985+0000 7f7281d9b640 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d834c58080 0x55d8350fb580 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df2e179f19908d3 server_cookie=aa0ef356ceda5621 in_seq=0 out_seq=0 2024-09-21T07:20:02.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.986+0000 7f7269ffb640 1 -- 172.21.15.92:0/2430424856 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d834fdf860 con 0x55d834c58080 2024-09-21T07:20:02.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.986+0000 7f7269ffb640 10 client.17595 handle_command_reply: tid=0 2024-09-21T07:20:02.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.986+0000 7f728f409740 1 client.17595 shutdown 2024-09-21T07:20:02.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 1 -- 172.21.15.92:0/2430424856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834c9b490 msgr2=0x55d83507f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:02.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834c9b490 0x55d83507f350 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7274005cc0 tx=0x7f72740043d0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 1 -- 172.21.15.92:0/2430424856 shutdown_connections 2024-09-21T07:20:02.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d834c58080 0x55d8350fb580 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d834cc4350 0x55d83507a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d834ca3670 0x55d835079ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 1 --2- 172.21.15.92:0/2430424856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d834c9b490 0x55d83507f350 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 1 -- 172.21.15.92:0/2430424856 >> 172.21.15.92:0/2430424856 conn(0x55d834cb8740 msgr2=0x55d835068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:02.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f7269ffb640 0 client.17595 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:02.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 1 -- 172.21.15.92:0/2430424856 shutdown_connections 2024-09-21T07:20:02.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 1 -- 172.21.15.92:0/2430424856 wait complete. 2024-09-21T07:20:02.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.987+0000 7f728f409740 20 client.17595 trim_cache size 0 max 16384 2024-09-21T07:20:02.992 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:20:02.993 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:20:02.993 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd", 2024-09-21T07:20:02.993 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:20:02.993 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:20:02.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 -- 172.21.15.92:0/3015809395 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72700b6700 msgr2=0x7f72700b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72700b6700 0x7f72700b8c10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f726c014fd0 tx=0x7f726c022000 comp rx=0 tx=0).stop 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 -- 172.21.15.92:0/3015809395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7284108cf0 msgr2=0x7f728419fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7284108cf0 0x7f728419fb80 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f727c005ab0 tx=0x7f727c0040e0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 -- 172.21.15.92:0/3015809395 shutdown_connections 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f72700b6700 0x7f72700b8c10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7284108cf0 0x7f728419fb80 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72841083a0 0x7f728419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 --2- 172.21.15.92:0/3015809395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7284102a60 0x7f728419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 -- 172.21.15.92:0/3015809395 >> 172.21.15.92:0/3015809395 conn(0x7f7284079730 msgr2=0x7f7284104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 -- 172.21.15.92:0/3015809395 shutdown_connections 2024-09-21T07:20:02.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:02.988+0000 7f7288e95640 1 -- 172.21.15.92:0/3015809395 wait complete. 2024-09-21T07:20:03.851 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:20:04.097 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:04.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:03 smithi092 ceph-mon[30987]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:20:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:03 smithi169 ceph-mon[33705]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:20:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:03 smithi175 ceph-mon[34064]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:20:04.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.592+0000 7f2f2948f640 1 -- 172.21.15.92:0/606055603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f241083a0 msgr2=0x7f2f241087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.592+0000 7f2f2948f640 1 --2- 172.21.15.92:0/606055603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f241083a0 0x7f2f241087b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009900 tx=0x7f2f1802a410 comp rx=0 tx=0).stop 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.592+0000 7f2f2948f640 1 -- 172.21.15.92:0/606055603 shutdown_connections 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.592+0000 7f2f2948f640 1 --2- 172.21.15.92:0/606055603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f24108cf0 0x7f2f2410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.592+0000 7f2f2948f640 1 --2- 172.21.15.92:0/606055603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f241083a0 0x7f2f241087b0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.592+0000 7f2f2948f640 1 --2- 172.21.15.92:0/606055603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f24102a60 0x7f2f24102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.592+0000 7f2f2948f640 1 -- 172.21.15.92:0/606055603 >> 172.21.15.92:0/606055603 conn(0x7f2f24079730 msgr2=0x7f2f24079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.592+0000 7f2f2948f640 1 -- 172.21.15.92:0/606055603 shutdown_connections 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.592+0000 7f2f2948f640 1 -- 172.21.15.92:0/606055603 wait complete. 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f2948f640 1 Processor -- start 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f2948f640 1 -- start start 2024-09-21T07:20:04.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f2948f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f24102a60 0x7f2f24199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f2948f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f241083a0 0x7f2f241998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f2948f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f24108cf0 0x7f2f2419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f2948f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24112810 con 0x7f2f24108cf0 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f2948f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24112690 con 0x7f2f24102a60 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f2948f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24112990 con 0x7f2f241083a0 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f24108cf0 0x7f2f2419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f24108cf0 0x7f2f2419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34002/0 (socket says 172.21.15.92:34002) 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f237fe640 1 -- 172.21.15.92:0/864367091 learned_addr learned my addr 172.21.15.92:0/864367091 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f24102a60 0x7f2f24199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.593+0000 7f2f227fc640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f241083a0 0x7f2f241998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f237fe640 1 -- 172.21.15.92:0/864367091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f241083a0 msgr2=0x7f2f241998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f237fe640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f241083a0 0x7f2f241998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f237fe640 1 -- 172.21.15.92:0/864367091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f24102a60 msgr2=0x7f2f24199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:04.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f237fe640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f24102a60 0x7f2f24199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f237fe640 1 -- 172.21.15.92:0/864367091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2419f290 con 0x7f2f24108cf0 2024-09-21T07:20:04.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f237fe640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f24108cf0 0x7f2f2419eb60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00eaa0 tx=0x7f2f1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:04.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f0bfff640 1 -- 172.21.15.92:0/864367091 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00cdb0 con 0x7f2f24108cf0 2024-09-21T07:20:04.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f0bfff640 1 -- 172.21.15.92:0/864367091 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f1c005020 con 0x7f2f24108cf0 2024-09-21T07:20:04.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f2948f640 1 -- 172.21.15.92:0/864367091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2419f580 con 0x7f2f24108cf0 2024-09-21T07:20:04.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f0bfff640 1 -- 172.21.15.92:0/864367091 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0116d0 con 0x7f2f24108cf0 2024-09-21T07:20:04.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.594+0000 7f2f2948f640 1 -- 172.21.15.92:0/864367091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f241a5ce0 con 0x7f2f24108cf0 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.597+0000 7f2f0bfff640 1 -- 172.21.15.92:0/864367091 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f2f1c0051d0 con 0x7f2f24108cf0 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.597+0000 7f2f2fa03740 1 Processor -- start 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.597+0000 7f2f2fa03740 1 -- start start 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.597+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592352070 0x5615926f9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.597+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x5615926f97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.597+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592331390 0x5615926f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.597+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56159266fe50 con 0x561592331390 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.597+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56159265f280 con 0x561592352070 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.597+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561592663090 con 0x5615923291b0 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592331390 0x5615926f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592331390 0x5615926f9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34012/0 (socket says 172.21.15.92:34012) 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f227fc640 1 -- 172.21.15.92:0/1875176682 learned_addr learned my addr 172.21.15.92:0/1875176682 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/1875176682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x5615926f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f227fc640 1 --2- 172.21.15.92:0/1875176682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592352070 0x5615926f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f0bfff640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2f0c0b6680 0x7f2f0c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f227fc640 1 -- 172.21.15.92:0/1875176682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 msgr2=0x5615926f97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f227fc640 1 --2- 172.21.15.92:0/1875176682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x5615926f97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f227fc640 1 -- 172.21.15.92:0/1875176682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592352070 msgr2=0x5615926f9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f227fc640 1 --2- 172.21.15.92:0/1875176682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592352070 0x5615926f9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f227fc640 1 -- 172.21.15.92:0/1875176682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615923bd650 con 0x561592331390 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f237fe640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2f0c0b6680 0x7f2f0c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f227fc640 1 --2- 172.21.15.92:0/1875176682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592331390 0x5615926f9cf0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2f180057c0 tx=0x7f2f18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a08cd1c07a8ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:04.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f0bfff640 1 -- 172.21.15.92:0/864367091 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2f1c0e7bf0 con 0x7f2f24108cf0 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f097fa640 1 -- 172.21.15.92:0/1875176682 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18035070 con 0x561592331390 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f097fa640 1 -- 172.21.15.92:0/1875176682 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f180044c0 con 0x561592331390 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.598+0000 7f2f097fa640 1 -- 172.21.15.92:0/1875176682 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18003cb0 con 0x561592331390 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.599+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1875176682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592331390 msgr2=0x5615926f9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.599+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/1875176682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592331390 0x5615926f9cf0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2f180057c0 tx=0x7f2f18000bc0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.599+0000 7f2f237fe640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2f0c0b6680 0x7f2f0c0b8b90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0ad450 tx=0x7f2f1c07aa30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.599+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1875176682 shutdown_connections 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.599+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/1875176682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592331390 0x5615926f9cf0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.599+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/1875176682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x5615926f97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.599+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/1875176682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592352070 0x5615926f9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.599+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1875176682 >> 172.21.15.92:0/1875176682 conn(0x561592346460 msgr2=0x5615926f7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:04.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.599+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1875176682 shutdown_connections 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.599+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1875176682 wait complete. 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f2fa03740 1 -- start start 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f2fa03740 1 Processor -- start 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x561592707cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 0x561592708230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592352070 0x561592712d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5615924c0700 con 0x561592352070 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5615925fa110 con 0x561592331390 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615927079f0 con 0x5615923291b0 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f2fa03740 10 client.0 _ll_register_callbacks cb 0x561592613990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592352070 0x561592712d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592352070 0x561592712d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34018/0 (socket says 172.21.15.92:34018) 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f227fc640 1 -- 172.21.15.92:0/2999495324 learned_addr learned my addr 172.21.15.92:0/2999495324 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:04.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f227fc640 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x561592707cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.601+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 0x561592708230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f227fc640 1 -- 172.21.15.92:0/2999495324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 msgr2=0x561592707cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f227fc640 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x561592707cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f227fc640 1 -- 172.21.15.92:0/2999495324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 msgr2=0x561592708230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f227fc640 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 0x561592708230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f227fc640 1 -- 172.21.15.92:0/2999495324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561592627c40 con 0x561592352070 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 0x561592708230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f227fc640 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592352070 0x561592712d30 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009330 tx=0x7f2f18005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43fc1045a3630f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f06ff5640 1 -- 172.21.15.92:0/2999495324 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18035040 con 0x561592352070 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f06ff5640 1 -- 172.21.15.92:0/2999495324 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2f18003a30 con 0x561592352070 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f2fa03740 1 -- 172.21.15.92:0/2999495324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561592671da0 con 0x561592352070 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f06ff5640 1 -- 172.21.15.92:0/2999495324 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2f18003c30 con 0x561592352070 2024-09-21T07:20:04.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f2fa03740 10 client.17607 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f2fa03740 1 -- 172.21.15.92:0/2999495324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5615927158a0 con 0x561592352070 2024-09-21T07:20:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.602+0000 7f2f06ff5640 1 -- 172.21.15.92:0/2999495324 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561592671da0 con 0x561592352070 2024-09-21T07:20:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.603+0000 7f2f06ff5640 1 -- 172.21.15.92:0/2999495324 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2f1803d880 con 0x561592352070 2024-09-21T07:20:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.603+0000 7f2f2fa03740 10 client.17607 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.603+0000 7f2f2fa03740 10 client.17607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.603+0000 7f2f2fa03740 20 client.17607 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.603+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5615923109f0 0x561592718c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.603+0000 7f2f2fa03740 4 client.17607 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.603+0000 7f2f2fa03740 1 -- 172.21.15.92:0/2999495324 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56159266d850 con 0x5615923109f0 2024-09-21T07:20:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.603+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5615923109f0 0x561592718c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.603+0000 7f2f06ff5640 10 client.17607 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.603+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5615923109f0 0x561592718c00 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c18b08321786a1d server_cookie=d85dd3390e38a7e7 in_seq=0 out_seq=0 2024-09-21T07:20:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f06ff5640 1 -- 172.21.15.92:0/2999495324 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56159266d850 con 0x5615923109f0 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f06ff5640 10 client.17607 handle_command_reply: tid=0 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f2fa03740 1 client.17607 shutdown 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f2fa03740 1 -- 172.21.15.92:0/2999495324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592352070 msgr2=0x561592712d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592352070 0x561592712d30 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009330 tx=0x7f2f18005f30 comp rx=0 tx=0).stop 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f2fa03740 1 -- 172.21.15.92:0/2999495324 shutdown_connections 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5615923109f0 0x561592718c00 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561592352070 0x561592712d30 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f06ff5640 0 client.17607 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 0x561592708230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/2999495324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x561592707cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.604+0000 7f2f2fa03740 1 -- 172.21.15.92:0/2999495324 >> 172.21.15.92:0/2999495324 conn(0x561592346460 msgr2=0x5615926fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.605+0000 7f2f2fa03740 1 -- 172.21.15.92:0/2999495324 shutdown_connections 2024-09-21T07:20:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.605+0000 7f2f2fa03740 1 -- 172.21.15.92:0/2999495324 wait complete. 2024-09-21T07:20:04.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.605+0000 7f2f2fa03740 20 client.17607 trim_cache size 0 max 16384 2024-09-21T07:20:04.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f2fa03740 1 Processor -- start 2024-09-21T07:20:04.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f2fa03740 1 -- start start 2024-09-21T07:20:04.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x5615926fac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615923291b0 0x5615926fca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561592331390 0x5615926fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241aec00 con 0x5615923109f0 2024-09-21T07:20:04.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241b0740 con 0x5615923291b0 2024-09-21T07:20:04.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241af2d0 con 0x561592331390 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x5615926fac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x5615926fac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34020/0 (socket says 172.21.15.92:34020) 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.622+0000 7f2f227fc640 1 -- 172.21.15.92:0/959280131 learned_addr learned my addr 172.21.15.92:0/959280131 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.623+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/959280131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615923291b0 0x5615926fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.623+0000 7f2f227fc640 1 -- 172.21.15.92:0/959280131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561592331390 msgr2=0x5615926fcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.623+0000 7f2f227fc640 1 --2- 172.21.15.92:0/959280131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561592331390 0x5615926fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.623+0000 7f2f227fc640 1 -- 172.21.15.92:0/959280131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615923291b0 msgr2=0x5615926fca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.623+0000 7f2f227fc640 1 --2- 172.21.15.92:0/959280131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615923291b0 0x5615926fca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.623+0000 7f2f227fc640 1 -- 172.21.15.92:0/959280131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561592713bc0 con 0x5615923109f0 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.623+0000 7f2f227fc640 1 --2- 172.21.15.92:0/959280131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x5615926fac60 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009850 tx=0x7f2f18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5663f1719d723e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.623+0000 7f2f08ff9640 1 -- 172.21.15.92:0/959280131 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18035070 con 0x5615923109f0 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.623+0000 7f2f08ff9640 1 -- 172.21.15.92:0/959280131 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f18005850 con 0x5615923109f0 2024-09-21T07:20:04.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.623+0000 7f2f08ff9640 1 -- 172.21.15.92:0/959280131 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1803d6b0 con 0x5615923109f0 2024-09-21T07:20:04.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 -- 172.21.15.92:0/959280131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 msgr2=0x5615926fac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:04.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/959280131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x5615926fac60 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009850 tx=0x7f2f18000bc0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 -- 172.21.15.92:0/959280131 shutdown_connections 2024-09-21T07:20:04.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/959280131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561592331390 0x5615926fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/959280131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615923291b0 0x5615926fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/959280131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x5615926fac60 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 -- 172.21.15.92:0/959280131 >> 172.21.15.92:0/959280131 conn(0x561592346460 msgr2=0x5615926fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:04.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 -- 172.21.15.92:0/959280131 shutdown_connections 2024-09-21T07:20:04.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 -- 172.21.15.92:0/959280131 wait complete. 2024-09-21T07:20:04.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 -- start start 2024-09-21T07:20:04.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.624+0000 7f2f2fa03740 1 Processor -- start 2024-09-21T07:20:04.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x561592777510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x561592777a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f2fa03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 0x561592782390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241b0070 con 0x5615923109f0 2024-09-21T07:20:04.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241af9a0 con 0x561592331390 2024-09-21T07:20:04.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f2fa03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241acbe0 con 0x5615923291b0 2024-09-21T07:20:04.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f2fa03740 10 client.0 _ll_register_callbacks cb 0x7f2f1400a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:04.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x561592777510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x561592777510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34026/0 (socket says 172.21.15.92:34026) 2024-09-21T07:20:04.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f227fc640 1 -- 172.21.15.92:0/1892092380 learned_addr learned my addr 172.21.15.92:0/1892092380 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:04.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x561592777a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f227fc640 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 0x561592782390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f227fc640 1 -- 172.21.15.92:0/1892092380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 msgr2=0x561592777a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:04.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f227fc640 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x561592777a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f227fc640 1 -- 172.21.15.92:0/1892092380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 msgr2=0x561592782390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:04.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f227fc640 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 0x561592782390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f227fc640 1 -- 172.21.15.92:0/1892092380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615927828d0 con 0x5615923109f0 2024-09-21T07:20:04.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x561592777a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:04.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f227fc640 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x561592777510 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f2f18003bf0 tx=0x7f2f18005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7507a602be58a9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:04.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:04.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f06ff5640 1 -- 172.21.15.92:0/1892092380 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18066060 con 0x5615923109f0 2024-09-21T07:20:04.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f06ff5640 1 -- 172.21.15.92:0/1892092380 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9452+0+0 (secure 0 0 0) 0x7f2f18004110 con 0x5615923109f0 2024-09-21T07:20:04.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.625+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1892092380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f18005850 con 0x5615923109f0 2024-09-21T07:20:04.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f06ff5640 1 -- 172.21.15.92:0/1892092380 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2f18035030 con 0x5615923109f0 2024-09-21T07:20:04.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f2fa03740 10 client.17613 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:04.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1892092380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561592783ac0 con 0x5615923109f0 2024-09-21T07:20:04.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f06ff5640 1 -- 172.21.15.92:0/1892092380 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f18005850 con 0x5615923109f0 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f06ff5640 1 -- 172.21.15.92:0/1892092380 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2f1804aa40 con 0x5615923109f0 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f2fa03740 10 client.17613 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f2fa03740 10 client.17613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f2fa03740 20 client.17613 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561592352070 0x561592785fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f2fa03740 4 client.17613 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1892092380 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56159266ac80 con 0x561592352070 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.626+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561592352070 0x561592785fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f06ff5640 10 client.17613 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f22ffd640 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561592352070 0x561592785fe0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21890ce253360506 server_cookie=1644904e05a9f90a in_seq=0 out_seq=0 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f06ff5640 1 -- 172.21.15.92:0/1892092380 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x56159266ac80 con 0x561592352070 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f06ff5640 10 client.17613 handle_command_reply: tid=0 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 client.17613 shutdown 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1892092380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 msgr2=0x561592777510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:04.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x561592777510 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f2f18003bf0 tx=0x7f2f18005a20 comp rx=0 tx=0).stop 2024-09-21T07:20:04.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1892092380 shutdown_connections 2024-09-21T07:20:04.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561592352070 0x561592785fe0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561592331390 0x561592782390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615923291b0 0x561592777a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 --2- 172.21.15.92:0/1892092380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615923109f0 0x561592777510 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1892092380 >> 172.21.15.92:0/1892092380 conn(0x561592346460 msgr2=0x5615926faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:04.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f06ff5640 0 client.17613 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:04.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1892092380 shutdown_connections 2024-09-21T07:20:04.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 1 -- 172.21.15.92:0/1892092380 wait complete. 2024-09-21T07:20:04.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.627+0000 7f2f2fa03740 20 client.17613 trim_cache size 0 max 16384 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd", 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:20:04.637 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:04.638 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:04.639 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:02.985669+0000", 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:04.640 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:04.641 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:20:04.642 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:20:04.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 -- 172.21.15.92:0/864367091 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2f0c0b6680 msgr2=0x7f2f0c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:04.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2f0c0b6680 0x7f2f0c0b8b90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0ad450 tx=0x7f2f1c07aa30 comp rx=0 tx=0).stop 2024-09-21T07:20:04.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 -- 172.21.15.92:0/864367091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f24108cf0 msgr2=0x7f2f2419eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:04.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f24108cf0 0x7f2f2419eb60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00eaa0 tx=0x7f2f1c00ef60 comp rx=0 tx=0).stop 2024-09-21T07:20:04.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 -- 172.21.15.92:0/864367091 shutdown_connections 2024-09-21T07:20:04.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2f0c0b6680 0x7f2f0c0b8b90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f24108cf0 0x7f2f2419eb60 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f241083a0 0x7f2f241998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 --2- 172.21.15.92:0/864367091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f24102a60 0x7f2f24199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:04.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 -- 172.21.15.92:0/864367091 >> 172.21.15.92:0/864367091 conn(0x7f2f24079730 msgr2=0x7f2f24104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:04.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 -- 172.21.15.92:0/864367091 shutdown_connections 2024-09-21T07:20:04.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:04.628+0000 7f2f2948f640 1 -- 172.21.15.92:0/864367091 wait complete. 2024-09-21T07:20:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:04 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:20:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:04 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:04 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:20:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:04 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:04 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:20:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:04 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:04 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:20:05.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:04 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:05.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:04 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:20:05.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:04 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:05.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:04 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:20:05.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:04 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:05.436 INFO:tasks.cephfs.filesystem:scrub status for tag:8c7a4c62-4362-4a71-98c9-de1f7a97d8cd - {'path': '/', 'tag': '8c7a4c62-4362-4a71-98c9-de1f7a97d8cd', 'options': 'recursive,force'} 2024-09-21T07:20:06.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:05 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:20:06.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:05 smithi092 ceph-mon[30987]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T07:20:06.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:05 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:20:06.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:05 smithi169 ceph-mon[33705]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T07:20:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:05 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:20:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:05 smithi175 ceph-mon[34064]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T07:20:08.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:07 smithi092 ceph-mon[30987]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-21T07:20:08.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:07 smithi169 ceph-mon[33705]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-21T07:20:08.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:07 smithi175 ceph-mon[34064]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-21T07:20:10.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:09 smithi092 ceph-mon[30987]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T07:20:10.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:09 smithi169 ceph-mon[33705]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T07:20:10.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:09 smithi175 ceph-mon[34064]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T07:20:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:11 smithi092 ceph-mon[30987]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T07:20:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:11 smithi092 ceph-mon[30987]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-21T07:20:12.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:11 smithi169 ceph-mon[33705]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T07:20:12.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:11 smithi169 ceph-mon[33705]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-21T07:20:12.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:11 smithi175 ceph-mon[34064]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T07:20:12.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:11 smithi175 ceph-mon[34064]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-21T07:20:14.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:13 smithi092 ceph-mon[30987]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T07:20:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:13 smithi169 ceph-mon[33705]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T07:20:14.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:13 smithi175 ceph-mon[34064]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T07:20:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:15 smithi092 ceph-mon[30987]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T07:20:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:15 smithi169 ceph-mon[33705]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T07:20:16.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:15 smithi175 ceph-mon[34064]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T07:20:18.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:17 smithi092 ceph-mon[30987]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:20:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:17 smithi169 ceph-mon[33705]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:20:18.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:17 smithi175 ceph-mon[34064]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:20:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:20 smithi175 ceph-mon[34064]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T07:20:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:20 smithi175 ceph-mon[34064]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2024-09-21T07:20:20.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:20 smithi092 ceph-mon[30987]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T07:20:20.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:20 smithi092 ceph-mon[30987]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2024-09-21T07:20:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:20 smithi169 ceph-mon[33705]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T07:20:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:20 smithi169 ceph-mon[33705]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2024-09-21T07:20:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:21 smithi092 ceph-mon[30987]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:20:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:21 smithi169 ceph-mon[33705]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:20:22.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:21 smithi175 ceph-mon[34064]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:20:24.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:23 smithi092 ceph-mon[30987]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:20:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:23 smithi169 ceph-mon[33705]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:20:24.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:23 smithi175 ceph-mon[34064]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:20:26.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:25 smithi092 ceph-mon[30987]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:20:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:25 smithi169 ceph-mon[33705]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:20:26.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:25 smithi175 ceph-mon[34064]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:20:28.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:27 smithi092 ceph-mon[30987]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:20:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:27 smithi169 ceph-mon[33705]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:20:28.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:27 smithi175 ceph-mon[34064]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:20:30.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:29 smithi092 ceph-mon[30987]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T07:20:30.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:29 smithi169 ceph-mon[33705]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T07:20:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:29 smithi175 ceph-mon[34064]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T07:20:32.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:31 smithi092 ceph-mon[30987]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:20:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:31 smithi169 ceph-mon[33705]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:20:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:31 smithi175 ceph-mon[34064]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:20:34.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:33 smithi092 ceph-mon[30987]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:20:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:33 smithi169 ceph-mon[33705]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:20:34.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:33 smithi175 ceph-mon[34064]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:20:35.438 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:20:35.711 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:36.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:35 smithi092 ceph-mon[30987]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:36.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:35 smithi169 ceph-mon[33705]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:36.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.203+0000 7fd782886640 1 -- 172.21.15.92:0/929071454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd77c1083d0 msgr2=0x7fd77c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:36.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.203+0000 7fd782886640 1 --2- 172.21.15.92:0/929071454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd77c1083d0 0x7fd77c1087e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd770009900 tx=0x7fd77002a410 comp rx=0 tx=0).stop 2024-09-21T07:20:36.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.204+0000 7fd782886640 1 -- 172.21.15.92:0/929071454 shutdown_connections 2024-09-21T07:20:36.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.204+0000 7fd782886640 1 --2- 172.21.15.92:0/929071454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd77c108d20 0x7fd77c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.204+0000 7fd782886640 1 --2- 172.21.15.92:0/929071454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd77c1083d0 0x7fd77c1087e0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.204+0000 7fd782886640 1 --2- 172.21.15.92:0/929071454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c102a90 0x7fd77c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.204+0000 7fd782886640 1 -- 172.21.15.92:0/929071454 >> 172.21.15.92:0/929071454 conn(0x7fd77c079730 msgr2=0x7fd77c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:36.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.204+0000 7fd782886640 1 -- 172.21.15.92:0/929071454 shutdown_connections 2024-09-21T07:20:36.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.204+0000 7fd782886640 1 -- 172.21.15.92:0/929071454 wait complete. 2024-09-21T07:20:36.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.204+0000 7fd782886640 1 Processor -- start 2024-09-21T07:20:36.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.204+0000 7fd782886640 1 -- start start 2024-09-21T07:20:36.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd782886640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c102a90 0x7fd77c199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd782886640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd77c1083d0 0x7fd77c199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd782886640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd77c108d20 0x7fd77c199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd782886640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c112890 con 0x7fd77c1083d0 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd782886640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c112710 con 0x7fd77c102a90 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd782886640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c112a10 con 0x7fd77c108d20 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd77c1083d0 0x7fd77c199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd77c1083d0 0x7fd77c199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43472/0 (socket says 172.21.15.92:43472) 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd77b7fe640 1 -- 172.21.15.92:0/3883178857 learned_addr learned my addr 172.21.15.92:0/3883178857 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd77bfff640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c102a90 0x7fd77c199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd780e23640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd77c108d20 0x7fd77c199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd77b7fe640 1 -- 172.21.15.92:0/3883178857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd77c108d20 msgr2=0x7fd77c199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd77c108d20 0x7fd77c199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd77b7fe640 1 -- 172.21.15.92:0/3883178857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c102a90 msgr2=0x7fd77c199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c102a90 0x7fd77c199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.205+0000 7fd77b7fe640 1 -- 172.21.15.92:0/3883178857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c1a87c0 con 0x7fd77c1083d0 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.206+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd77c1083d0 0x7fd77c199650 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fd770004770 tx=0x7fd770004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.206+0000 7fd7797fa640 1 -- 172.21.15.92:0/3883178857 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77003f030 con 0x7fd77c1083d0 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.206+0000 7fd7797fa640 1 -- 172.21.15.92:0/3883178857 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd770004440 con 0x7fd77c1083d0 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.206+0000 7fd782886640 1 -- 172.21.15.92:0/3883178857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77c1a8a50 con 0x7fd77c1083d0 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.206+0000 7fd7797fa640 1 -- 172.21.15.92:0/3883178857 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770035070 con 0x7fd77c1083d0 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.206+0000 7fd782886640 1 -- 172.21.15.92:0/3883178857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77c1a8f30 con 0x7fd77c1083d0 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.209+0000 7fd7797fa640 1 -- 172.21.15.92:0/3883178857 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fd770042030 con 0x7fd77c1083d0 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.209+0000 7fd7797fa640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7640b6680 0x7fd7640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd788dfa740 1 Processor -- start 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd77bfff640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7640b6680 0x7fd7640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd7797fa640 1 -- 172.21.15.92:0/3883178857 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fd770107e50 con 0x7fd77c1083d0 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd788dfa740 1 -- start start 2024-09-21T07:20:36.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b084435270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0840651b0 0x55b0844357b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b084435cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd788dfa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b0843abe50 con 0x55b08406d390 2024-09-21T07:20:36.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd788dfa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b08439b280 con 0x55b0840651b0 2024-09-21T07:20:36.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd788dfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b08439f090 con 0x55b08408e070 2024-09-21T07:20:36.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd77bfff640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7640b6680 0x7fd7640b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd77c1079c0 tx=0x7fd76c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:36.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd780e23640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b084435cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd780e23640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b084435cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43484/0 (socket says 172.21.15.92:43484) 2024-09-21T07:20:36.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd780e23640 1 -- 172.21.15.92:0/603533475 learned_addr learned my addr 172.21.15.92:0/603533475 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:36.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/603533475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0840651b0 0x55b0844357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.210+0000 7fd77bfff640 1 --2- 172.21.15.92:0/603533475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b084435270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.211+0000 7fd780e23640 1 -- 172.21.15.92:0/603533475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 msgr2=0x55b084435270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:36.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.211+0000 7fd780e23640 1 --2- 172.21.15.92:0/603533475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b084435270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.211+0000 7fd780e23640 1 -- 172.21.15.92:0/603533475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0840651b0 msgr2=0x55b0844357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:36.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.211+0000 7fd780e23640 1 --2- 172.21.15.92:0/603533475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0840651b0 0x55b0844357b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.211+0000 7fd780e23640 1 -- 172.21.15.92:0/603533475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0840f9650 con 0x55b08406d390 2024-09-21T07:20:36.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.211+0000 7fd77bfff640 1 --2- 172.21.15.92:0/603533475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b084435270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:36.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.211+0000 7fd780e23640 1 --2- 172.21.15.92:0/603533475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b084435cf0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fd774009f90 tx=0x7fd774010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb20baa2d6fb2fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:36.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.211+0000 7fd7627fc640 1 -- 172.21.15.92:0/603533475 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774011700 con 0x55b08406d390 2024-09-21T07:20:36.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.211+0000 7fd7627fc640 1 -- 172.21.15.92:0/603533475 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd774011d30 con 0x55b08406d390 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.211+0000 7fd7627fc640 1 -- 172.21.15.92:0/603533475 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774019cd0 con 0x55b08406d390 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.212+0000 7fd788dfa740 1 -- 172.21.15.92:0/603533475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 msgr2=0x55b084435cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.212+0000 7fd788dfa740 1 --2- 172.21.15.92:0/603533475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b084435cf0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fd774009f90 tx=0x7fd774010860 comp rx=0 tx=0).stop 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.212+0000 7fd788dfa740 1 -- 172.21.15.92:0/603533475 shutdown_connections 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.212+0000 7fd788dfa740 1 --2- 172.21.15.92:0/603533475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b084435cf0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.212+0000 7fd788dfa740 1 --2- 172.21.15.92:0/603533475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b0840651b0 0x55b0844357b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.212+0000 7fd788dfa740 1 --2- 172.21.15.92:0/603533475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b084435270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.212+0000 7fd788dfa740 1 -- 172.21.15.92:0/603533475 >> 172.21.15.92:0/603533475 conn(0x55b084082460 msgr2=0x55b084433160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.212+0000 7fd788dfa740 1 -- 172.21.15.92:0/603533475 shutdown_connections 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.212+0000 7fd788dfa740 1 -- 172.21.15.92:0/603533475 wait complete. 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.213+0000 7fd788dfa740 1 -- start start 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.213+0000 7fd788dfa740 1 Processor -- start 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.213+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b084440930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.213+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 0x55b084440e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.213+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b08444cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.213+0000 7fd788dfa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b0841fc700 con 0x55b0840651b0 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.213+0000 7fd788dfa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b084336110 con 0x55b08406d390 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.213+0000 7fd788dfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b084443a50 con 0x55b08408e070 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.213+0000 7fd788dfa740 10 client.0 _ll_register_callbacks cb 0x55b08434f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.213+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b084440930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b084440930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43494/0 (socket says 172.21.15.92:43494) 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd77bfff640 1 -- 172.21.15.92:0/1215576824 learned_addr learned my addr 172.21.15.92:0/1215576824 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 0x55b084440e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd780e23640 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b08444cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd77bfff640 1 -- 172.21.15.92:0/1215576824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 msgr2=0x55b08444cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd77bfff640 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b08444cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd77bfff640 1 -- 172.21.15.92:0/1215576824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 msgr2=0x55b084440e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd77bfff640 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 0x55b084440e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd77bfff640 1 -- 172.21.15.92:0/1215576824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b084363c40 con 0x55b0840651b0 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd77bfff640 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b084440930 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fd76c01ece0 tx=0x7fd76c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9faed88ea15e35ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd75b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd75b7fe640 1 -- 172.21.15.92:0/1215576824 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00e930 con 0x55b0840651b0 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd75b7fe640 1 -- 172.21.15.92:0/1215576824 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fd76c00ead0 con 0x55b0840651b0 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.214+0000 7fd788dfa740 1 -- 172.21.15.92:0/1215576824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd774011d30 con 0x55b0840651b0 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd75b7fe640 1 -- 172.21.15.92:0/1215576824 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd76c00ecd0 con 0x55b0840651b0 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd788dfa740 10 client.17625 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd788dfa740 1 -- 172.21.15.92:0/1215576824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b08444f7c0 con 0x55b0840651b0 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd75b7fe640 1 -- 172.21.15.92:0/1215576824 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd774011d30 con 0x55b0840651b0 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd75b7fe640 1 -- 172.21.15.92:0/1215576824 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd76c025020 con 0x55b0840651b0 2024-09-21T07:20:36.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd788dfa740 10 client.17625 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd788dfa740 10 client.17625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd788dfa740 20 client.17625 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd788dfa740 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b08404c9f0 0x55b084452db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd788dfa740 4 client.17625 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd788dfa740 1 -- 172.21.15.92:0/1215576824 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0843adda0 con 0x55b08404c9f0 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.215+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b08404c9f0 0x55b084452db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.216+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b08404c9f0 0x55b084452db0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e443cc00ae5ebf server_cookie=1a03f0dd09651338 in_seq=0 out_seq=0 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.216+0000 7fd75b7fe640 10 client.17625 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.216+0000 7fd75b7fe640 1 -- 172.21.15.92:0/1215576824 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0843adda0 con 0x55b08404c9f0 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd75b7fe640 10 client.17625 handle_command_reply: tid=0 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 client.17625 shutdown 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 -- 172.21.15.92:0/1215576824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 msgr2=0x55b084440930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:36.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b084440930 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fd76c01ece0 tx=0x7fd76c004730 comp rx=0 tx=0).stop 2024-09-21T07:20:36.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 -- 172.21.15.92:0/1215576824 shutdown_connections 2024-09-21T07:20:36.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b08404c9f0 0x55b084452db0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b08444cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 0x55b084440e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 --2- 172.21.15.92:0/1215576824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b084440930 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 -- 172.21.15.92:0/1215576824 >> 172.21.15.92:0/1215576824 conn(0x55b084082460 msgr2=0x55b084438400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:36.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd75b7fe640 0 client.17625 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:36.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 -- 172.21.15.92:0/1215576824 shutdown_connections 2024-09-21T07:20:36.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 1 -- 172.21.15.92:0/1215576824 wait complete. 2024-09-21T07:20:36.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.217+0000 7fd788dfa740 20 client.17625 trim_cache size 0 max 16384 2024-09-21T07:20:36.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.234+0000 7fd788dfa740 1 Processor -- start 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.234+0000 7fd788dfa740 1 -- start start 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0840651b0 0x55b084440df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b08443db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08408e070 0x55b08443e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd788dfa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1b3290 con 0x55b08406d390 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd788dfa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1b4dd0 con 0x55b08408e070 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd788dfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1b3960 con 0x55b0840651b0 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b08443db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b08443db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43508/0 (socket says 172.21.15.92:43508) 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd77b7fe640 1 -- 172.21.15.92:0/2042014940 learned_addr learned my addr 172.21.15.92:0/2042014940 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd77bfff640 1 --2- 172.21.15.92:0/2042014940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0840651b0 0x55b084440df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd780e23640 1 --2- 172.21.15.92:0/2042014940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08408e070 0x55b08443e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd77b7fe640 1 -- 172.21.15.92:0/2042014940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0840651b0 msgr2=0x55b084440df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/2042014940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0840651b0 0x55b084440df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd77b7fe640 1 -- 172.21.15.92:0/2042014940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08408e070 msgr2=0x55b08443e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/2042014940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08408e070 0x55b08443e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.235+0000 7fd77b7fe640 1 -- 172.21.15.92:0/2042014940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b08443f890 con 0x55b08406d390 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.236+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/2042014940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b08443db20 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd770105200 tx=0x7fd770107040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65d1661795fb8a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.236+0000 7fd761ffb640 1 -- 172.21.15.92:0/2042014940 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770049040 con 0x55b08406d390 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.236+0000 7fd761ffb640 1 -- 172.21.15.92:0/2042014940 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd770105420 con 0x55b08406d390 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.236+0000 7fd761ffb640 1 -- 172.21.15.92:0/2042014940 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7700cebd0 con 0x55b08406d390 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.237+0000 7fd788dfa740 1 -- 172.21.15.92:0/2042014940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 msgr2=0x55b08443db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.237+0000 7fd788dfa740 1 --2- 172.21.15.92:0/2042014940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b08443db20 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd770105200 tx=0x7fd770107040 comp rx=0 tx=0).stop 2024-09-21T07:20:36.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.237+0000 7fd788dfa740 1 -- 172.21.15.92:0/2042014940 shutdown_connections 2024-09-21T07:20:36.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.237+0000 7fd788dfa740 1 --2- 172.21.15.92:0/2042014940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08408e070 0x55b08443e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.237+0000 7fd788dfa740 1 --2- 172.21.15.92:0/2042014940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b08406d390 0x55b08443db20 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.237+0000 7fd788dfa740 1 --2- 172.21.15.92:0/2042014940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0840651b0 0x55b084440df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.237+0000 7fd788dfa740 1 -- 172.21.15.92:0/2042014940 >> 172.21.15.92:0/2042014940 conn(0x55b084082460 msgr2=0x55b0844406e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:36.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.237+0000 7fd788dfa740 1 -- 172.21.15.92:0/2042014940 shutdown_connections 2024-09-21T07:20:36.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.237+0000 7fd788dfa740 1 -- 172.21.15.92:0/2042014940 wait complete. 2024-09-21T07:20:36.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.237+0000 7fd788dfa740 1 -- start start 2024-09-21T07:20:36.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd788dfa740 1 Processor -- start 2024-09-21T07:20:36.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b0844494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 0x55b0844469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd788dfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b084446f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd788dfa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1b4700 con 0x55b0840651b0 2024-09-21T07:20:36.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd788dfa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1b4030 con 0x55b08406d390 2024-09-21T07:20:36.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd788dfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1b1290 con 0x55b08408e070 2024-09-21T07:20:36.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd788dfa740 10 client.0 _ll_register_callbacks cb 0x7fd76c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:36.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b0844494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b0844494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43512/0 (socket says 172.21.15.92:43512) 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd77bfff640 1 -- 172.21.15.92:0/2859785963 learned_addr learned my addr 172.21.15.92:0/2859785963 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 0x55b0844469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.238+0000 7fd780e23640 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b084446f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd77bfff640 1 -- 172.21.15.92:0/2859785963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 msgr2=0x55b084446f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd77bfff640 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b084446f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd77bfff640 1 -- 172.21.15.92:0/2859785963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 msgr2=0x55b0844469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd77bfff640 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 0x55b0844469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd77bfff640 1 -- 172.21.15.92:0/2859785963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0844476f0 con 0x55b0840651b0 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 0x55b0844469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd77bfff640 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b0844494f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fd76c004c90 tx=0x7fd76c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96145539c9b75c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:36.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd75b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd75b7fe640 1 -- 172.21.15.92:0/2859785963 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c038070 con 0x55b0840651b0 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd75b7fe640 1 -- 172.21.15.92:0/2859785963 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fd76c005000 con 0x55b0840651b0 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd788dfa740 1 -- 172.21.15.92:0/2859785963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd770105420 con 0x55b0840651b0 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd75b7fe640 1 -- 172.21.15.92:0/2859785963 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd76c01e820 con 0x55b0840651b0 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd788dfa740 10 client.17631 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd788dfa740 1 -- 172.21.15.92:0/2859785963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b0844bd7b0 con 0x55b0840651b0 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.239+0000 7fd75b7fe640 1 -- 172.21.15.92:0/2859785963 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd770105420 con 0x55b0840651b0 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.240+0000 7fd75b7fe640 1 -- 172.21.15.92:0/2859785963 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd76c025040 con 0x55b0840651b0 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.240+0000 7fd788dfa740 10 client.17631 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.240+0000 7fd788dfa740 10 client.17631 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.240+0000 7fd788dfa740 20 client.17631 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.240+0000 7fd788dfa740 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b084021da0 0x55b0844bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:36.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.240+0000 7fd788dfa740 4 client.17631 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.240+0000 7fd788dfa740 1 -- 172.21.15.92:0/2859785963 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b0843a9850 con 0x55b084021da0 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.240+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b084021da0 0x55b0844bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd75b7fe640 10 client.17631 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd77b7fe640 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b084021da0 0x55b0844bffa0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=957fd1429f09e99d server_cookie=452ac7296248da65 in_seq=0 out_seq=0 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd75b7fe640 1 -- 172.21.15.92:0/2859785963 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55b0843a9850 con 0x55b084021da0 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd75b7fe640 10 client.17631 handle_command_reply: tid=0 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 client.17631 shutdown 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 -- 172.21.15.92:0/2859785963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 msgr2=0x55b0844494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b0844494f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fd76c004c90 tx=0x7fd76c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 -- 172.21.15.92:0/2859785963 shutdown_connections 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55b084021da0 0x55b0844bffa0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b08408e070 0x55b084446f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b08406d390 0x55b0844469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 --2- 172.21.15.92:0/2859785963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0840651b0 0x55b0844494f0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 -- 172.21.15.92:0/2859785963 >> 172.21.15.92:0/2859785963 conn(0x55b084082460 msgr2=0x55b084438370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:36.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd75b7fe640 0 client.17631 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:36.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 -- 172.21.15.92:0/2859785963 shutdown_connections 2024-09-21T07:20:36.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 1 -- 172.21.15.92:0/2859785963 wait complete. 2024-09-21T07:20:36.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.241+0000 7fd788dfa740 20 client.17631 trim_cache size 0 max 16384 2024-09-21T07:20:36.249 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:20:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:20:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:20:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:02.985669+0000", 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:20:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:20:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:20:36.256 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 -- 172.21.15.92:0/3883178857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7640b6680 msgr2=0x7fd7640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7640b6680 0x7fd7640b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd77c1079c0 tx=0x7fd76c005f90 comp rx=0 tx=0).stop 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 -- 172.21.15.92:0/3883178857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd77c1083d0 msgr2=0x7fd77c199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd77c1083d0 0x7fd77c199650 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fd770004770 tx=0x7fd770004040 comp rx=0 tx=0).stop 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 -- 172.21.15.92:0/3883178857 shutdown_connections 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd7640b6680 0x7fd7640b8b90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd77c108d20 0x7fd77c199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd77c1083d0 0x7fd77c199650 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 --2- 172.21.15.92:0/3883178857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd77c102a90 0x7fd77c199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 -- 172.21.15.92:0/3883178857 >> 172.21.15.92:0/3883178857 conn(0x7fd77c079730 msgr2=0x7fd77c104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:36.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 -- 172.21.15.92:0/3883178857 shutdown_connections 2024-09-21T07:20:36.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:36.242+0000 7fd782886640 1 -- 172.21.15.92:0/3883178857 wait complete. 2024-09-21T07:20:36.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:35 smithi175 ceph-mon[34064]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:37.161 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:20:37.161 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:20:37.419 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:37.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:37 smithi092 ceph-mon[30987]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:20:37.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.919+0000 7fcb9607d640 1 -- 172.21.15.92:0/4148539610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb90108d20 msgr2=0x7fcb9010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.919+0000 7fcb9607d640 1 --2- 172.21.15.92:0/4148539610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb90108d20 0x7fcb9010f550 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009900 tx=0x7fcb8802a410 comp rx=0 tx=0).stop 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.919+0000 7fcb9607d640 1 -- 172.21.15.92:0/4148539610 shutdown_connections 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.919+0000 7fcb9607d640 1 --2- 172.21.15.92:0/4148539610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb90108d20 0x7fcb9010f550 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.919+0000 7fcb9607d640 1 --2- 172.21.15.92:0/4148539610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb901083d0 0x7fcb901087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.919+0000 7fcb9607d640 1 --2- 172.21.15.92:0/4148539610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb90102a90 0x7fcb90102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.919+0000 7fcb9607d640 1 -- 172.21.15.92:0/4148539610 >> 172.21.15.92:0/4148539610 conn(0x7fcb90079750 msgr2=0x7fcb90079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.919+0000 7fcb9607d640 1 -- 172.21.15.92:0/4148539610 shutdown_connections 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.919+0000 7fcb9607d640 1 -- 172.21.15.92:0/4148539610 wait complete. 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.920+0000 7fcb9607d640 1 Processor -- start 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.920+0000 7fcb9607d640 1 -- start start 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.920+0000 7fcb9607d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb90102a90 0x7fcb9019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.920+0000 7fcb9607d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb901083d0 0x7fcb9019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:37.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.920+0000 7fcb9607d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb90108d20 0x7fcb9019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.920+0000 7fcb9607d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb90112840 con 0x7fcb90108d20 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.920+0000 7fcb9607d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb901126c0 con 0x7fcb90102a90 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.920+0000 7fcb9607d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb901129c0 con 0x7fcb901083d0 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb90108d20 0x7fcb9019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb90108d20 0x7fcb9019fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43522/0 (socket says 172.21.15.92:43522) 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8ffff640 1 -- 172.21.15.92:0/1353958809 learned_addr learned my addr 172.21.15.92:0/1353958809 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8f7fe640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb90102a90 0x7fcb9019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8effd640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb901083d0 0x7fcb9019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8ffff640 1 -- 172.21.15.92:0/1353958809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb901083d0 msgr2=0x7fcb9019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8ffff640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb901083d0 0x7fcb9019a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8ffff640 1 -- 172.21.15.92:0/1353958809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb90102a90 msgr2=0x7fcb9019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8ffff640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb90102a90 0x7fcb9019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8ffff640 1 -- 172.21.15.92:0/1353958809 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb901a02d0 con 0x7fcb90108d20 2024-09-21T07:20:37.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8ffff640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb90108d20 0x7fcb9019fba0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fcb88005ab0 tx=0x7fcb880040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8cff9640 1 -- 172.21.15.92:0/1353958809 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8803f030 con 0x7fcb90108d20 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8cff9640 1 -- 172.21.15.92:0/1353958809 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb88003a80 con 0x7fcb90108d20 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb9607d640 1 -- 172.21.15.92:0/1353958809 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb901a0560 con 0x7fcb90108d20 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb8cff9640 1 -- 172.21.15.92:0/1353958809 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88035070 con 0x7fcb90108d20 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.921+0000 7fcb9607d640 1 -- 172.21.15.92:0/1353958809 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb901a6d20 con 0x7fcb90108d20 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.922+0000 7fcb9607d640 1 -- 172.21.15.92:0/1353958809 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb90103d10 con 0x7fcb90108d20 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.924+0000 7fcb8cff9640 1 -- 172.21.15.92:0/1353958809 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fcb88042030 con 0x7fcb90108d20 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.924+0000 7fcb8cff9640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb780b6680 0x7fcb780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.925+0000 7fcb8f7fe640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb780b6680 0x7fcb780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.925+0000 7fcb8cff9640 1 -- 172.21.15.92:0/1353958809 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fcb88108380 con 0x7fcb90108d20 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.925+0000 7fcb8f7fe640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb780b6680 0x7fcb780b8b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcb800058c0 tx=0x7fcb8000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:37.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:37.928+0000 7fcb8cff9640 1 -- 172.21.15.92:0/1353958809 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb880d28b0 con 0x7fcb90108d20 2024-09-21T07:20:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:37 smithi169 ceph-mon[33705]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:20:38.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.143+0000 7fcb9607d640 1 -- 172.21.15.92:0/1353958809 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb9010bb80 con 0x7fcb90108d20 2024-09-21T07:20:38.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.143+0000 7fcb8cff9640 1 -- 172.21.15.92:0/1353958809 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7fcb880d77f0 con 0x7fcb90108d20 2024-09-21T07:20:38.145 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:20:38.145 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:20:38.146 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:20:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.145+0000 7fcb9607d640 1 -- 172.21.15.92:0/1353958809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb780b6680 msgr2=0x7fcb780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.145+0000 7fcb9607d640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb780b6680 0x7fcb780b8b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcb800058c0 tx=0x7fcb8000a2d0 comp rx=0 tx=0).stop 2024-09-21T07:20:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.145+0000 7fcb9607d640 1 -- 172.21.15.92:0/1353958809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb90108d20 msgr2=0x7fcb9019fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.145+0000 7fcb9607d640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb90108d20 0x7fcb9019fba0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fcb88005ab0 tx=0x7fcb880040e0 comp rx=0 tx=0).stop 2024-09-21T07:20:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.146+0000 7fcb9607d640 1 -- 172.21.15.92:0/1353958809 shutdown_connections 2024-09-21T07:20:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.146+0000 7fcb9607d640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcb780b6680 0x7fcb780b8b90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.146+0000 7fcb9607d640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb90108d20 0x7fcb9019fba0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.146+0000 7fcb9607d640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb901083d0 0x7fcb9019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.146+0000 7fcb9607d640 1 --2- 172.21.15.92:0/1353958809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb90102a90 0x7fcb9019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.146+0000 7fcb9607d640 1 -- 172.21.15.92:0/1353958809 >> 172.21.15.92:0/1353958809 conn(0x7fcb90079750 msgr2=0x7fcb90101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.146+0000 7fcb9607d640 1 -- 172.21.15.92:0/1353958809 shutdown_connections 2024-09-21T07:20:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:38.146+0000 7fcb9607d640 1 -- 172.21.15.92:0/1353958809 wait complete. 2024-09-21T07:20:38.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:37 smithi175 ceph-mon[34064]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:20:38.873 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:20:39.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:38 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1353958809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:20:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:38 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1353958809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:20:39.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:38 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1353958809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:20:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.627+0000 7f0598673640 1 -- 172.21.15.92:0/321029133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05901049f0 msgr2=0x7f0590104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.627+0000 7f0598673640 1 --2- 172.21.15.92:0/321029133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05901049f0 0x7f0590104e00 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f0580009ca0 tx=0x7f058002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.627+0000 7f0598673640 1 -- 172.21.15.92:0/321029133 shutdown_connections 2024-09-21T07:20:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.627+0000 7f0598673640 1 --2- 172.21.15.92:0/321029133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f059010de50 0x7f0590110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.627+0000 7f0598673640 1 --2- 172.21.15.92:0/321029133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0590105340 0x7f059010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.627+0000 7f0598673640 1 --2- 172.21.15.92:0/321029133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05901049f0 0x7f0590104e00 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.627+0000 7f0598673640 1 -- 172.21.15.92:0/321029133 >> 172.21.15.92:0/321029133 conn(0x7f05900797e0 msgr2=0x7f0590079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.627+0000 7f0598673640 1 -- 172.21.15.92:0/321029133 shutdown_connections 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.627+0000 7f0598673640 1 -- 172.21.15.92:0/321029133 wait complete. 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0598673640 1 Processor -- start 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0598673640 1 -- start start 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0598673640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05901049f0 0x7f059019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0598673640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0590105340 0x7f059019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0598673640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f059010de50 0x7f059019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0598673640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05901139d0 con 0x7f059010de50 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0598673640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0590113850 con 0x7f05901049f0 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0598673640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0590113b50 con 0x7f0590105340 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0596c10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f059010de50 0x7f059019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0596c10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f059010de50 0x7f059019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43536/0 (socket says 172.21.15.92:43536) 2024-09-21T07:20:39.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f059640f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05901049f0 0x7f059019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0596c10640 1 -- 172.21.15.92:0/2020406821 learned_addr learned my addr 172.21.15.92:0/2020406821 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.628+0000 7f0595c0e640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0590105340 0x7f059019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f0596c10640 1 -- 172.21.15.92:0/2020406821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0590105340 msgr2=0x7f059019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f0596c10640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0590105340 0x7f059019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f0596c10640 1 -- 172.21.15.92:0/2020406821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05901049f0 msgr2=0x7f059019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f0596c10640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05901049f0 0x7f059019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f0596c10640 1 -- 172.21.15.92:0/2020406821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05901a0430 con 0x7f059010de50 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f0596c10640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f059010de50 0x7f059019fd00 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f058800c970 tx=0x7f058800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f058f7fe640 1 -- 172.21.15.92:0/2020406821 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588007bb0 con 0x7f059010de50 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f058f7fe640 1 -- 172.21.15.92:0/2020406821 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0588007d50 con 0x7f059010de50 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f0598673640 1 -- 172.21.15.92:0/2020406821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05901a0720 con 0x7f059010de50 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f058f7fe640 1 -- 172.21.15.92:0/2020406821 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588004d50 con 0x7f059010de50 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.629+0000 7f0598673640 1 -- 172.21.15.92:0/2020406821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05901a6e80 con 0x7f059010de50 2024-09-21T07:20:39.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.632+0000 7f059ebe7740 1 Processor -- start 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.632+0000 7f058f7fe640 1 -- 172.21.15.92:0/2020406821 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f0588005020 con 0x7f059010de50 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.632+0000 7f059ebe7740 1 -- start start 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.632+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8e1070 0x558c4cc886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.632+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc88be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.632+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 0x558c4cc89120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.632+0000 7f059ebe7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c4cbfeea0 con 0x558c4c8b81b0 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.632+0000 7f059ebe7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c4cbee2d0 con 0x558c4c8e1070 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.632+0000 7f059ebe7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c4cbf20e0 con 0x558c4c8c0390 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f059640f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc88be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f059640f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc88be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43538/0 (socket says 172.21.15.92:43538) 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f059640f640 1 -- 172.21.15.92:0/2873239218 learned_addr learned my addr 172.21.15.92:0/2873239218 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f0595c0e640 1 --2- 172.21.15.92:0/2873239218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8e1070 0x558c4cc886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f0595c0e640 1 --2- 172.21.15.92:0/2873239218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 0x558c4cc89120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f059640f640 1 -- 172.21.15.92:0/2873239218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 msgr2=0x558c4cc89120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f059640f640 1 --2- 172.21.15.92:0/2873239218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 0x558c4cc89120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f059640f640 1 -- 172.21.15.92:0/2873239218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8e1070 msgr2=0x558c4cc886a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f059640f640 1 --2- 172.21.15.92:0/2873239218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8e1070 0x558c4cc886a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f059640f640 1 -- 172.21.15.92:0/2873239218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4c94c650 con 0x558c4c8b81b0 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f0595c0e640 1 --2- 172.21.15.92:0/2873239218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 0x558c4cc89120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f058f7fe640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05780b6700 0x7f05780b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f0595c0e640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05780b6700 0x7f05780b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f059640f640 1 --2- 172.21.15.92:0/2873239218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc88be0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f0580009ca0 tx=0x7f0580009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b18c15bc01bbf1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f058f7fe640 1 -- 172.21.15.92:0/2020406821 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f05880e79e0 con 0x7f059010de50 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f058cff9640 1 -- 172.21.15.92:0/2873239218 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580031b80 con 0x558c4c8b81b0 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f058cff9640 1 -- 172.21.15.92:0/2873239218 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0580036030 con 0x558c4c8b81b0 2024-09-21T07:20:39.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.633+0000 7f058cff9640 1 -- 172.21.15.92:0/2873239218 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580004410 con 0x558c4c8b81b0 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.634+0000 7f059ebe7740 1 -- 172.21.15.92:0/2873239218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 msgr2=0x558c4cc88be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.634+0000 7f0595c0e640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05780b6700 0x7f05780b8c10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f059007a160 tx=0x7f0584004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.634+0000 7f059ebe7740 1 --2- 172.21.15.92:0/2873239218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc88be0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f0580009ca0 tx=0x7f0580009a20 comp rx=0 tx=0).stop 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.634+0000 7f059ebe7740 1 -- 172.21.15.92:0/2873239218 shutdown_connections 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.634+0000 7f059ebe7740 1 --2- 172.21.15.92:0/2873239218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 0x558c4cc89120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.634+0000 7f059ebe7740 1 --2- 172.21.15.92:0/2873239218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc88be0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.634+0000 7f059ebe7740 1 --2- 172.21.15.92:0/2873239218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8e1070 0x558c4cc886a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.634+0000 7f059ebe7740 1 -- 172.21.15.92:0/2873239218 >> 172.21.15.92:0/2873239218 conn(0x558c4c8d5460 msgr2=0x558c4cc86590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.634+0000 7f059ebe7740 1 -- 172.21.15.92:0/2873239218 shutdown_connections 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.634+0000 7f059ebe7740 1 -- 172.21.15.92:0/2873239218 wait complete. 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059ebe7740 1 -- start start 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059ebe7740 1 Processor -- start 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc93d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 0x558c4cc94260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8e1070 0x558c4cc9ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059ebe7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558c4ca4f700 con 0x558c4c8b81b0 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059ebe7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c4cb89160 con 0x558c4c8e1070 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059ebe7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c4cc96ca0 con 0x558c4c8c0390 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059ebe7740 10 client.0 _ll_register_callbacks cb 0x558c4cba29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059640f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc93d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059640f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc93d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43552/0 (socket says 172.21.15.92:43552) 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.635+0000 7f059640f640 1 -- 172.21.15.92:0/1703983923 learned_addr learned my addr 172.21.15.92:0/1703983923 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f0595c0e640 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 0x558c4cc94260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f0596c10640 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8e1070 0x558c4cc9ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f059640f640 1 -- 172.21.15.92:0/1703983923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 msgr2=0x558c4cc94260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f059640f640 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 0x558c4cc94260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f059640f640 1 -- 172.21.15.92:0/1703983923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8e1070 msgr2=0x558c4cc9ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:39.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f059640f640 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8e1070 0x558c4cc9ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f059640f640 1 -- 172.21.15.92:0/1703983923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c4cbb6c90 con 0x558c4c8b81b0 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f0595c0e640 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 0x558c4cc94260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f059640f640 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc93d20 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f058002ade0 tx=0x7f0580003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792c8cacd2def58c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f0575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f0575ffb640 1 -- 172.21.15.92:0/1703983923 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058004a040 con 0x558c4c8b81b0 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f0575ffb640 1 -- 172.21.15.92:0/1703983923 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f0580004190 con 0x558c4c8b81b0 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f059ebe7740 1 -- 172.21.15.92:0/1703983923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0580036030 con 0x558c4c8b81b0 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f0575ffb640 1 -- 172.21.15.92:0/1703983923 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0580031e60 con 0x558c4c8b81b0 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f059ebe7740 10 client.17649 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.636+0000 7f059ebe7740 1 -- 172.21.15.92:0/1703983923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558c4cca28f0 con 0x558c4c8b81b0 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.637+0000 7f0575ffb640 1 -- 172.21.15.92:0/1703983923 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0580036030 con 0x558c4c8b81b0 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.637+0000 7f0575ffb640 1 -- 172.21.15.92:0/1703983923 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f058004d030 con 0x558c4c8b81b0 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.637+0000 7f059ebe7740 10 client.17649 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:39.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.637+0000 7f059ebe7740 10 client.17649 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:20:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.637+0000 7f059ebe7740 20 client.17649 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.637+0000 7f059ebe7740 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c4c89f9f0 0x558c4cca5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.637+0000 7f059ebe7740 4 client.17649 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.637+0000 7f059ebe7740 1 -- 172.21.15.92:0/1703983923 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c4cc00df0 con 0x558c4c89f9f0 2024-09-21T07:20:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.637+0000 7f0595c0e640 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c4c89f9f0 0x558c4cca5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.638+0000 7f0595c0e640 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c4c89f9f0 0x558c4cca5c50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e5a57eb811b286e2 server_cookie=fbcac4470b10e5ef in_seq=0 out_seq=0 2024-09-21T07:20:39.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.638+0000 7f0575ffb640 10 client.17649 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:20:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.638+0000 7f0575ffb640 1 -- 172.21.15.92:0/1703983923 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c4cc00df0 con 0x558c4c89f9f0 2024-09-21T07:20:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.638+0000 7f0575ffb640 10 client.17649 handle_command_reply: tid=0 2024-09-21T07:20:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.638+0000 7f059ebe7740 1 client.17649 shutdown 2024-09-21T07:20:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 1 -- 172.21.15.92:0/1703983923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 msgr2=0x558c4cc93d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:39.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc93d20 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f058002ade0 tx=0x7f0580003c20 comp rx=0 tx=0).stop 2024-09-21T07:20:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 1 -- 172.21.15.92:0/1703983923 shutdown_connections 2024-09-21T07:20:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c4c89f9f0 0x558c4cca5c50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f0575ffb640 0 client.17649 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:20:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8e1070 0x558c4cc9ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c8c0390 0x558c4cc94260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 1 --2- 172.21.15.92:0/1703983923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc93d20 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 1 -- 172.21.15.92:0/1703983923 >> 172.21.15.92:0/1703983923 conn(0x558c4c8d5460 msgr2=0x558c4cc8b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 1 -- 172.21.15.92:0/1703983923 shutdown_connections 2024-09-21T07:20:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 1 -- 172.21.15.92:0/1703983923 wait complete. 2024-09-21T07:20:39.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.639+0000 7f059ebe7740 20 client.17649 trim_cache size 0 max 16384 2024-09-21T07:20:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f059ebe7740 1 Processor -- start 2024-09-21T07:20:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f059ebe7740 1 -- start start 2024-09-21T07:20:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c89f9f0 0x558c4cc89de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc9c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8c0390 0x558c4cc9c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f059ebe7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05901b1010 con 0x558c4c8b81b0 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f059ebe7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05901b2b50 con 0x558c4c8c0390 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f059ebe7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05901b16e0 con 0x558c4c89f9f0 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f0595c0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc9c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f0595c0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc9c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43554/0 (socket says 172.21.15.92:43554) 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f0595c0e640 1 -- 172.21.15.92:0/3526943497 learned_addr learned my addr 172.21.15.92:0/3526943497 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f059640f640 1 --2- 172.21.15.92:0/3526943497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c89f9f0 0x558c4cc89de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f0595c0e640 1 -- 172.21.15.92:0/3526943497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c89f9f0 msgr2=0x558c4cc89de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f0595c0e640 1 --2- 172.21.15.92:0/3526943497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c89f9f0 0x558c4cc89de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f0595c0e640 1 -- 172.21.15.92:0/3526943497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8c0390 msgr2=0x558c4cc9c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f0595c0e640 1 --2- 172.21.15.92:0/3526943497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8c0390 0x558c4cc9c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f0595c0e640 1 -- 172.21.15.92:0/3526943497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4cc873c0 con 0x558c4c8b81b0 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.652+0000 7f0595c0e640 1 --2- 172.21.15.92:0/3526943497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc9c300 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f059006ad30 tx=0x7f0584014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101206aedea1cdb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f0577fff640 1 -- 172.21.15.92:0/3526943497 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058401d880 con 0x558c4c8b81b0 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f0577fff640 1 -- 172.21.15.92:0/3526943497 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f058401c3f0 con 0x558c4c8b81b0 2024-09-21T07:20:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f0577fff640 1 -- 172.21.15.92:0/3526943497 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584010630 con 0x558c4c8b81b0 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f059ebe7740 1 -- 172.21.15.92:0/3526943497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 msgr2=0x558c4cc9c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f059ebe7740 1 --2- 172.21.15.92:0/3526943497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc9c300 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f059006ad30 tx=0x7f0584014040 comp rx=0 tx=0).stop 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f059ebe7740 1 -- 172.21.15.92:0/3526943497 shutdown_connections 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f059ebe7740 1 --2- 172.21.15.92:0/3526943497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8c0390 0x558c4cc9c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f059ebe7740 1 --2- 172.21.15.92:0/3526943497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cc9c300 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f059ebe7740 1 --2- 172.21.15.92:0/3526943497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c89f9f0 0x558c4cc89de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f059ebe7740 1 -- 172.21.15.92:0/3526943497 >> 172.21.15.92:0/3526943497 conn(0x558c4c8d5460 msgr2=0x558c4cc896d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f059ebe7740 1 -- 172.21.15.92:0/3526943497 shutdown_connections 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.653+0000 7f059ebe7740 1 -- 172.21.15.92:0/3526943497 wait complete. 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f059ebe7740 1 -- start start 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f059ebe7740 1 Processor -- start 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c89f9f0 0x558c4cd08470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cd08a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f059ebe7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8c0390 0x558c4cd134f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f059ebe7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05901b2480 con 0x558c4c8b81b0 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f059ebe7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05901b1db0 con 0x558c4c8c0390 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f059ebe7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05901af010 con 0x558c4c89f9f0 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f059ebe7740 10 client.0 _ll_register_callbacks cb 0x7f058400c640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f0595c0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cd08a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f0595c0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cd08a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43562/0 (socket says 172.21.15.92:43562) 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f0595c0e640 1 -- 172.21.15.92:0/3990688170 learned_addr learned my addr 172.21.15.92:0/3990688170 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f059640f640 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c89f9f0 0x558c4cd08470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.654+0000 7f0596c10640 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8c0390 0x558c4cd134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0595c0e640 1 -- 172.21.15.92:0/3990688170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c89f9f0 msgr2=0x558c4cd08470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0595c0e640 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c89f9f0 0x558c4cd08470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0595c0e640 1 -- 172.21.15.92:0/3990688170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8c0390 msgr2=0x558c4cd134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0595c0e640 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8c0390 0x558c4cd134f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0595c0e640 1 -- 172.21.15.92:0/3990688170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c4cd13a30 con 0x558c4c8b81b0 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0595c0e640 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cd08a10 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f058401cee0 tx=0x7f058401cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f052b9d7cd18bae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0575ffb640 1 -- 172.21.15.92:0/3990688170 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058401c5a0 con 0x558c4c8b81b0 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0575ffb640 1 -- 172.21.15.92:0/3990688170 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f058401c740 con 0x558c4c8b81b0 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f059ebe7740 1 -- 172.21.15.92:0/3990688170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f058401c3f0 con 0x558c4c8b81b0 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0575ffb640 1 -- 172.21.15.92:0/3990688170 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f058401d880 con 0x558c4c8b81b0 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f059ebe7740 10 client.17655 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f059ebe7740 1 -- 172.21.15.92:0/3990688170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558c4cd14bb0 con 0x558c4c8b81b0 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0575ffb640 1 -- 172.21.15.92:0/3990688170 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f058401c3f0 con 0x558c4c8b81b0 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f0575ffb640 1 -- 172.21.15.92:0/3990688170 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0584037a10 con 0x558c4c8b81b0 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f059ebe7740 10 client.17655 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.655+0000 7f059ebe7740 10 client.17655 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:20:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f059ebe7740 20 client.17655 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f059ebe7740 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c4c8e1070 0x558c4cd171d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f059ebe7740 4 client.17655 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f059ebe7740 1 -- 172.21.15.92:0/3990688170 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c4cbfc8a0 con 0x558c4c8e1070 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f059640f640 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c4c8e1070 0x558c4cd171d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f0575ffb640 10 client.17655 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f059640f640 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c4c8e1070 0x558c4cd171d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f340980ede7f6cfd server_cookie=ba146337b8ad2240 in_seq=0 out_seq=0 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f0575ffb640 1 -- 172.21.15.92:0/3990688170 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c4cbfc8a0 con 0x558c4c8e1070 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f0575ffb640 10 client.17655 handle_command_reply: tid=0 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f059ebe7740 1 client.17655 shutdown 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f059ebe7740 1 -- 172.21.15.92:0/3990688170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 msgr2=0x558c4cd08a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.656+0000 7f059ebe7740 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cd08a10 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f058401cee0 tx=0x7f058401cf10 comp rx=0 tx=0).stop 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f059ebe7740 1 -- 172.21.15.92:0/3990688170 shutdown_connections 2024-09-21T07:20:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f059ebe7740 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x558c4c8e1070 0x558c4cd171d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f059ebe7740 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4c8c0390 0x558c4cd134f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f059ebe7740 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558c4c8b81b0 0x558c4cd08a10 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f059ebe7740 1 --2- 172.21.15.92:0/3990688170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c4c89f9f0 0x558c4cd08470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f059ebe7740 1 -- 172.21.15.92:0/3990688170 >> 172.21.15.92:0/3990688170 conn(0x558c4c8d5460 msgr2=0x558c4cc95110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0575ffb640 0 client.17655 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:20:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f059ebe7740 1 -- 172.21.15.92:0/3990688170 shutdown_connections 2024-09-21T07:20:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f059ebe7740 1 -- 172.21.15.92:0/3990688170 wait complete. 2024-09-21T07:20:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f059ebe7740 20 client.17655 trim_cache size 0 max 16384 2024-09-21T07:20:39.663 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:20:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 -- 172.21.15.92:0/2020406821 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05780b6700 msgr2=0x7f05780b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05780b6700 0x7f05780b8c10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f059007a160 tx=0x7f0584004730 comp rx=0 tx=0).stop 2024-09-21T07:20:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 -- 172.21.15.92:0/2020406821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f059010de50 msgr2=0x7f059019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f059010de50 0x7f059019fd00 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f058800c970 tx=0x7f058800ce30 comp rx=0 tx=0).stop 2024-09-21T07:20:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 -- 172.21.15.92:0/2020406821 shutdown_connections 2024-09-21T07:20:39.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05780b6700 0x7f05780b8c10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f059010de50 0x7f059019fd00 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0590105340 0x7f059019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 --2- 172.21.15.92:0/2020406821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05901049f0 0x7f059019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 -- 172.21.15.92:0/2020406821 >> 172.21.15.92:0/2020406821 conn(0x7f05900797e0 msgr2=0x7f0590100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 -- 172.21.15.92:0/2020406821 shutdown_connections 2024-09-21T07:20:39.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:39.657+0000 7f0598673640 1 -- 172.21.15.92:0/2020406821 wait complete. 2024-09-21T07:20:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:39 smithi169 ceph-mon[33705]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:40.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:39 smithi092 ceph-mon[30987]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:40.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:39 smithi175 ceph-mon[34064]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:40.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:20:40.578 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:41.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.144+0000 7f4516bbc640 1 -- 172.21.15.92:0/2677642767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45101083a0 msgr2=0x7f45101087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:41.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.144+0000 7f4516bbc640 1 --2- 172.21.15.92:0/2677642767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45101083a0 0x7f45101087b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f4500009900 tx=0x7f450002a410 comp rx=0 tx=0).stop 2024-09-21T07:20:41.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.144+0000 7f4516bbc640 1 -- 172.21.15.92:0/2677642767 shutdown_connections 2024-09-21T07:20:41.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.144+0000 7f4516bbc640 1 --2- 172.21.15.92:0/2677642767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4510108cf0 0x7f451010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.144+0000 7f4516bbc640 1 --2- 172.21.15.92:0/2677642767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45101083a0 0x7f45101087b0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.144+0000 7f4516bbc640 1 --2- 172.21.15.92:0/2677642767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4510102a60 0x7f4510102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.144+0000 7f4516bbc640 1 -- 172.21.15.92:0/2677642767 >> 172.21.15.92:0/2677642767 conn(0x7f4510079730 msgr2=0x7f4510079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:41.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.144+0000 7f4516bbc640 1 -- 172.21.15.92:0/2677642767 shutdown_connections 2024-09-21T07:20:41.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.144+0000 7f4516bbc640 1 -- 172.21.15.92:0/2677642767 wait complete. 2024-09-21T07:20:41.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4516bbc640 1 Processor -- start 2024-09-21T07:20:41.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4516bbc640 1 -- start start 2024-09-21T07:20:41.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4516bbc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4510102a60 0x7f451019b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4516bbc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45101083a0 0x7f451019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4516bbc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4510108cf0 0x7f451019bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4516bbc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4510112850 con 0x7f4510108cf0 2024-09-21T07:20:41.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4516bbc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45101126d0 con 0x7f4510102a60 2024-09-21T07:20:41.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4516bbc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45101129d0 con 0x7f45101083a0 2024-09-21T07:20:41.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4515159640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4510108cf0 0x7f451019bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4515159640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4510108cf0 0x7f451019bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34112/0 (socket says 172.21.15.92:34112) 2024-09-21T07:20:41.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4515159640 1 -- 172.21.15.92:0/222824566 learned_addr learned my addr 172.21.15.92:0/222824566 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:41.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f4514958640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4510102a60 0x7f451019b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.145+0000 7f450ffff640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45101083a0 0x7f451019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f4515159640 1 -- 172.21.15.92:0/222824566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45101083a0 msgr2=0x7f451019b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:41.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f4515159640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45101083a0 0x7f451019b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f4515159640 1 -- 172.21.15.92:0/222824566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4510102a60 msgr2=0x7f451019b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:41.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f4515159640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4510102a60 0x7f451019b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f4515159640 1 -- 172.21.15.92:0/222824566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45101a6530 con 0x7f4510108cf0 2024-09-21T07:20:41.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f4515159640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4510108cf0 0x7f451019bca0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f44f800d750 tx=0x7f44f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:41.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f450dffb640 1 -- 172.21.15.92:0/222824566 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8017070 con 0x7f4510108cf0 2024-09-21T07:20:41.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f450dffb640 1 -- 172.21.15.92:0/222824566 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f80054b0 con 0x7f4510108cf0 2024-09-21T07:20:41.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f4516bbc640 1 -- 172.21.15.92:0/222824566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45101a6820 con 0x7f4510108cf0 2024-09-21T07:20:41.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f450dffb640 1 -- 172.21.15.92:0/222824566 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8004b90 con 0x7f4510108cf0 2024-09-21T07:20:41.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.146+0000 7f4516bbc640 1 -- 172.21.15.92:0/222824566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45101a6ce0 con 0x7f4510108cf0 2024-09-21T07:20:41.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f451d130740 1 Processor -- start 2024-09-21T07:20:41.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f450dffb640 1 -- 172.21.15.92:0/222824566 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f44f8004d30 con 0x7f4510108cf0 2024-09-21T07:20:41.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f451d130740 1 -- start start 2024-09-21T07:20:41.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f451d130740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 0x5566ffb892c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f451d130740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 0x5566ffb89800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f451d130740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffb89d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f451d130740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5566ffaffea0 con 0x5566ff7c1390 2024-09-21T07:20:41.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f451d130740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5566ffaef2d0 con 0x5566ff7e2070 2024-09-21T07:20:41.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f451d130740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5566ffaf30e0 con 0x5566ff7b91b0 2024-09-21T07:20:41.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f450ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffb89d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f450ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffb89d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34114/0 (socket says 172.21.15.92:34114) 2024-09-21T07:20:41.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f450ffff640 1 -- 172.21.15.92:0/2497065842 learned_addr learned my addr 172.21.15.92:0/2497065842 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:41.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f450ffff640 1 --2- 172.21.15.92:0/2497065842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 0x5566ffb892c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.149+0000 7f4514958640 1 --2- 172.21.15.92:0/2497065842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 0x5566ffb89800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f450ffff640 1 -- 172.21.15.92:0/2497065842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 msgr2=0x5566ffb89800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:41.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f450ffff640 1 --2- 172.21.15.92:0/2497065842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 0x5566ffb89800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f450ffff640 1 -- 172.21.15.92:0/2497065842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 msgr2=0x5566ffb892c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:41.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f450ffff640 1 --2- 172.21.15.92:0/2497065842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 0x5566ffb892c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f450ffff640 1 -- 172.21.15.92:0/2497065842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566ff84d650 con 0x5566ff7c1390 2024-09-21T07:20:41.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f450dffb640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44fc0b6680 0x7f44fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f450ffff640 1 --2- 172.21.15.92:0/2497065842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffb89d40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f45000096c0 tx=0x7f4500005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb649487234be6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:41.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f4514958640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44fc0b6680 0x7f44fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f450dffb640 1 -- 172.21.15.92:0/222824566 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f44f80e74f0 con 0x7f4510108cf0 2024-09-21T07:20:41.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f4506ffd640 1 -- 172.21.15.92:0/2497065842 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500035040 con 0x5566ff7c1390 2024-09-21T07:20:41.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f4506ffd640 1 -- 172.21.15.92:0/2497065842 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45000044c0 con 0x5566ff7c1390 2024-09-21T07:20:41.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.150+0000 7f4506ffd640 1 -- 172.21.15.92:0/2497065842 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500003c60 con 0x5566ff7c1390 2024-09-21T07:20:41.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f451d130740 1 -- 172.21.15.92:0/2497065842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 msgr2=0x5566ffb89d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:41.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f451d130740 1 --2- 172.21.15.92:0/2497065842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffb89d40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f45000096c0 tx=0x7f4500005fd0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f4514958640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44fc0b6680 0x7f44fc0b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x5566ffb87f40 tx=0x7f450800d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:41.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f451d130740 1 -- 172.21.15.92:0/2497065842 shutdown_connections 2024-09-21T07:20:41.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f451d130740 1 --2- 172.21.15.92:0/2497065842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffb89d40 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f451d130740 1 --2- 172.21.15.92:0/2497065842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 0x5566ffb89800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f451d130740 1 --2- 172.21.15.92:0/2497065842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 0x5566ffb892c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f451d130740 1 -- 172.21.15.92:0/2497065842 >> 172.21.15.92:0/2497065842 conn(0x5566ff7d6460 msgr2=0x5566ffb871b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:41.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f451d130740 1 -- 172.21.15.92:0/2497065842 shutdown_connections 2024-09-21T07:20:41.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f451d130740 1 -- 172.21.15.92:0/2497065842 wait complete. 2024-09-21T07:20:41.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.151+0000 7f451d130740 1 -- start start 2024-09-21T07:20:41.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f451d130740 1 Processor -- start 2024-09-21T07:20:41.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f451d130740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7b91b0 0x5566ffb94a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f451d130740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7c1390 0x5566ffb94f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f451d130740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 0x5566ffba0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f451d130740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5566ff950700 con 0x5566ff7b91b0 2024-09-21T07:20:41.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f451d130740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5566ffa8a160 con 0x5566ff7e2070 2024-09-21T07:20:41.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f451d130740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5566ffb97a40 con 0x5566ff7c1390 2024-09-21T07:20:41.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f451d130740 10 client.0 _ll_register_callbacks cb 0x5566ffaa39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:41.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f4514958640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7b91b0 0x5566ffb94a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f4514958640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7b91b0 0x5566ffb94a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34130/0 (socket says 172.21.15.92:34130) 2024-09-21T07:20:41.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f4514958640 1 -- 172.21.15.92:0/4189654402 learned_addr learned my addr 172.21.15.92:0/4189654402 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:41.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f450ffff640 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7c1390 0x5566ffb94f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f4515159640 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 0x5566ffba0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f4514958640 1 -- 172.21.15.92:0/4189654402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7c1390 msgr2=0x5566ffb94f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:41.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f4514958640 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7c1390 0x5566ffb94f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f4514958640 1 -- 172.21.15.92:0/4189654402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 msgr2=0x5566ffba0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:41.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f4514958640 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 0x5566ffba0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.152+0000 7f4514958640 1 -- 172.21.15.92:0/4189654402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566ffab7c90 con 0x5566ff7b91b0 2024-09-21T07:20:41.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.153+0000 7f4515159640 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 0x5566ffba0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:41.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.153+0000 7f4514958640 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7b91b0 0x5566ffb94a40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4508018b20 tx=0x7f4508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d812658edf4cf676 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:41.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.153+0000 7f44effff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:41.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.153+0000 7f44effff640 1 -- 172.21.15.92:0/4189654402 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508028060 con 0x5566ff7b91b0 2024-09-21T07:20:41.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.153+0000 7f44effff640 1 -- 172.21.15.92:0/4189654402 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f4508016e00 con 0x5566ff7b91b0 2024-09-21T07:20:41.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.153+0000 7f451d130740 1 -- 172.21.15.92:0/4189654402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5566ffb01df0 con 0x5566ff7b91b0 2024-09-21T07:20:41.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f44effff640 1 -- 172.21.15.92:0/4189654402 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4508023440 con 0x5566ff7b91b0 2024-09-21T07:20:41.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f451d130740 10 client.17667 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:41.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f451d130740 1 -- 172.21.15.92:0/4189654402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566ffba7c90 con 0x5566ff7b91b0 2024-09-21T07:20:41.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f44effff640 1 -- 172.21.15.92:0/4189654402 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5566ffb01df0 con 0x5566ff7b91b0 2024-09-21T07:20:41.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f44effff640 1 -- 172.21.15.92:0/4189654402 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4508022470 con 0x5566ff7b91b0 2024-09-21T07:20:41.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f451d130740 10 client.17667 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:41.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f451d130740 10 client.17667 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:20:41.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f451d130740 20 client.17667 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:41.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f451d130740 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5566ff7a09f0 0x5566ffbab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f451d130740 4 client.17667 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:41.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.154+0000 7f451d130740 1 -- 172.21.15.92:0/4189654402 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566ffafd8a0 con 0x5566ff7a09f0 2024-09-21T07:20:41.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.155+0000 7f450ffff640 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5566ff7a09f0 0x5566ffbab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.155+0000 7f450ffff640 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5566ff7a09f0 0x5566ffbab1a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ba34705c28aa9c6e server_cookie=6426b3b84128ca29 in_seq=0 out_seq=0 2024-09-21T07:20:41.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.155+0000 7f44effff640 10 client.17667 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:20:41.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f44effff640 1 -- 172.21.15.92:0/4189654402 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5566ffafd8a0 con 0x5566ff7a09f0 2024-09-21T07:20:41.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f44effff640 10 client.17667 handle_command_reply: tid=0 2024-09-21T07:20:41.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 client.17667 shutdown 2024-09-21T07:20:41.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 -- 172.21.15.92:0/4189654402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7b91b0 msgr2=0x5566ffb94a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:41.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7b91b0 0x5566ffb94a40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4508018b20 tx=0x7f4508004a40 comp rx=0 tx=0).stop 2024-09-21T07:20:41.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 -- 172.21.15.92:0/4189654402 shutdown_connections 2024-09-21T07:20:41.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7e2070 0x5566ffba0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7c1390 0x5566ffb94f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5566ff7a09f0 0x5566ffbab1a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 --2- 172.21.15.92:0/4189654402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7b91b0 0x5566ffb94a40 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f44effff640 0 client.17667 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:20:41.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 -- 172.21.15.92:0/4189654402 >> 172.21.15.92:0/4189654402 conn(0x5566ff7d6460 msgr2=0x5566ffb8c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:41.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 -- 172.21.15.92:0/4189654402 shutdown_connections 2024-09-21T07:20:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 1 -- 172.21.15.92:0/4189654402 wait complete. 2024-09-21T07:20:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.156+0000 7f451d130740 20 client.17667 trim_cache size 0 max 16384 2024-09-21T07:20:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.169+0000 7f451d130740 1 Processor -- start 2024-09-21T07:20:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.169+0000 7f451d130740 1 -- start start 2024-09-21T07:20:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f451d130740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7a09f0 0x5566ffb8cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f451d130740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7b91b0 0x5566ffb91c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f451d130740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7c1390 0x5566ffb92170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f451d130740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45101aeee0 con 0x5566ff7a09f0 2024-09-21T07:20:41.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f451d130740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45101b0a20 con 0x5566ff7b91b0 2024-09-21T07:20:41.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f451d130740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45101af5b0 con 0x5566ff7c1390 2024-09-21T07:20:41.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f4514958640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7a09f0 0x5566ffb8cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f4514958640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7a09f0 0x5566ffb8cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34144/0 (socket says 172.21.15.92:34144) 2024-09-21T07:20:41.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f4514958640 1 -- 172.21.15.92:0/584735161 learned_addr learned my addr 172.21.15.92:0/584735161 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:41.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f4514958640 1 -- 172.21.15.92:0/584735161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7c1390 msgr2=0x5566ffb92170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:41.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f4514958640 1 --2- 172.21.15.92:0/584735161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7c1390 0x5566ffb92170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f4514958640 1 -- 172.21.15.92:0/584735161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7b91b0 msgr2=0x5566ffb91c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:41.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f4514958640 1 --2- 172.21.15.92:0/584735161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7b91b0 0x5566ffb91c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f4514958640 1 -- 172.21.15.92:0/584735161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566ffb8d010 con 0x5566ff7a09f0 2024-09-21T07:20:41.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f4514958640 1 --2- 172.21.15.92:0/584735161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7a09f0 0x5566ffb8cad0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f45080098e0 tx=0x7f4508022bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a6fc029d3c26e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f45067fc640 1 -- 172.21.15.92:0/584735161 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450802f030 con 0x5566ff7a09f0 2024-09-21T07:20:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f45067fc640 1 -- 172.21.15.92:0/584735161 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4508022c60 con 0x5566ff7a09f0 2024-09-21T07:20:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.170+0000 7f45067fc640 1 -- 172.21.15.92:0/584735161 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45080223a0 con 0x5566ff7a09f0 2024-09-21T07:20:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.171+0000 7f451d130740 1 -- 172.21.15.92:0/584735161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7a09f0 msgr2=0x5566ffb8cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.171+0000 7f451d130740 1 --2- 172.21.15.92:0/584735161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7a09f0 0x5566ffb8cad0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f45080098e0 tx=0x7f4508022bf0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.171+0000 7f451d130740 1 -- 172.21.15.92:0/584735161 shutdown_connections 2024-09-21T07:20:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.171+0000 7f451d130740 1 --2- 172.21.15.92:0/584735161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7c1390 0x5566ffb92170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.171+0000 7f451d130740 1 --2- 172.21.15.92:0/584735161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7b91b0 0x5566ffb91c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.171+0000 7f451d130740 1 --2- 172.21.15.92:0/584735161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7a09f0 0x5566ffb8cad0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.171+0000 7f451d130740 1 -- 172.21.15.92:0/584735161 >> 172.21.15.92:0/584735161 conn(0x5566ff7d6460 msgr2=0x5566ffb8c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.171+0000 7f451d130740 1 -- 172.21.15.92:0/584735161 shutdown_connections 2024-09-21T07:20:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.171+0000 7f451d130740 1 -- 172.21.15.92:0/584735161 wait complete. 2024-09-21T07:20:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f451d130740 1 -- start start 2024-09-21T07:20:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f451d130740 1 Processor -- start 2024-09-21T07:20:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f451d130740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7a09f0 0x5566ffb99360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f451d130740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 0x5566ffb998a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f451d130740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffc14bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f451d130740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45101b0350 con 0x5566ff7c1390 2024-09-21T07:20:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f451d130740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45101afc80 con 0x5566ff7a09f0 2024-09-21T07:20:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f451d130740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45101acee0 con 0x5566ff7b91b0 2024-09-21T07:20:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f451d130740 10 client.0 _ll_register_callbacks cb 0x7f4508009dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f4515159640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffc14bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f4515159640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffc14bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34154/0 (socket says 172.21.15.92:34154) 2024-09-21T07:20:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.172+0000 7f4515159640 1 -- 172.21.15.92:0/2560955199 learned_addr learned my addr 172.21.15.92:0/2560955199 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:41.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f4514958640 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7a09f0 0x5566ffb99360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f450ffff640 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 0x5566ffb998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f4515159640 1 -- 172.21.15.92:0/2560955199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 msgr2=0x5566ffb998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f4515159640 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 0x5566ffb998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f4515159640 1 -- 172.21.15.92:0/2560955199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7a09f0 msgr2=0x5566ffb99360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f4515159640 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7a09f0 0x5566ffb99360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f4515159640 1 -- 172.21.15.92:0/2560955199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566ffc150f0 con 0x5566ff7c1390 2024-09-21T07:20:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f4514958640 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7a09f0 0x5566ffb99360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f450ffff640 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 0x5566ffb998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f4515159640 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffc14bb0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f44f80accf0 tx=0x7f44f80aca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fb72fa1e85e0d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f44effff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f44effff640 1 -- 172.21.15.92:0/2560955199 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8020070 con 0x5566ff7c1390 2024-09-21T07:20:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f44effff640 1 -- 172.21.15.92:0/2560955199 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f44f80ac250 con 0x5566ff7c1390 2024-09-21T07:20:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f451d130740 1 -- 172.21.15.92:0/2560955199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4508022c60 con 0x5566ff7c1390 2024-09-21T07:20:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f44effff640 1 -- 172.21.15.92:0/2560955199 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44f80b1a20 con 0x5566ff7c1390 2024-09-21T07:20:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f451d130740 10 client.17673 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f451d130740 1 -- 172.21.15.92:0/2560955199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566ffc16380 con 0x5566ff7c1390 2024-09-21T07:20:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.173+0000 7f44effff640 1 -- 172.21.15.92:0/2560955199 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4508022c60 con 0x5566ff7c1390 2024-09-21T07:20:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.174+0000 7f44effff640 1 -- 172.21.15.92:0/2560955199 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f44f80abcc0 con 0x5566ff7c1390 2024-09-21T07:20:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.174+0000 7f451d130740 10 client.17673 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:41.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.174+0000 7f451d130740 10 client.17673 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:20:41.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.174+0000 7f451d130740 20 client.17673 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:41.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.174+0000 7f451d130740 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5566ff7e2070 0x5566ffc18ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:41.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.174+0000 7f451d130740 4 client.17673 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:20:41.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.174+0000 7f451d130740 1 -- 172.21.15.92:0/2560955199 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5566ffafacd0 con 0x5566ff7e2070 2024-09-21T07:20:41.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.174+0000 7f4514958640 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5566ff7e2070 0x5566ffc18ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:41.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.174+0000 7f4514958640 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5566ff7e2070 0x5566ffc18ab0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e3b9a0aa50e32add server_cookie=1b8de47492ec46bd in_seq=0 out_seq=0 2024-09-21T07:20:41.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.174+0000 7f44effff640 10 client.17673 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:20:41.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f44effff640 1 -- 172.21.15.92:0/2560955199 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5566ffafacd0 con 0x5566ff7e2070 2024-09-21T07:20:41.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f44effff640 10 client.17673 handle_command_reply: tid=0 2024-09-21T07:20:41.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 client.17673 shutdown 2024-09-21T07:20:41.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 -- 172.21.15.92:0/2560955199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 msgr2=0x5566ffc14bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:41.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffc14bb0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f44f80accf0 tx=0x7f44f80aca70 comp rx=0 tx=0).stop 2024-09-21T07:20:41.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 -- 172.21.15.92:0/2560955199 shutdown_connections 2024-09-21T07:20:41.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x5566ff7e2070 0x5566ffc18ab0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5566ff7c1390 0x5566ffc14bb0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566ff7b91b0 0x5566ffb998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 --2- 172.21.15.92:0/2560955199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566ff7a09f0 0x5566ffb99360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 -- 172.21.15.92:0/2560955199 >> 172.21.15.92:0/2560955199 conn(0x5566ff7d6460 msgr2=0x5566ffb8a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:41.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f44effff640 0 client.17673 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:20:41.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 -- 172.21.15.92:0/2560955199 shutdown_connections 2024-09-21T07:20:41.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 1 -- 172.21.15.92:0/2560955199 wait complete. 2024-09-21T07:20:41.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.175+0000 7f451d130740 20 client.17673 trim_cache size 0 max 16384 2024-09-21T07:20:41.196 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:20:41.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 -- 172.21.15.92:0/222824566 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44fc0b6680 msgr2=0x7f44fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44fc0b6680 0x7f44fc0b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x5566ffb87f40 tx=0x7f450800d040 comp rx=0 tx=0).stop 2024-09-21T07:20:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 -- 172.21.15.92:0/222824566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4510108cf0 msgr2=0x7f451019bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4510108cf0 0x7f451019bca0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f44f800d750 tx=0x7f44f800dc10 comp rx=0 tx=0).stop 2024-09-21T07:20:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 -- 172.21.15.92:0/222824566 shutdown_connections 2024-09-21T07:20:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44fc0b6680 0x7f44fc0b8b90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4510108cf0 0x7f451019bca0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45101083a0 0x7f451019b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 --2- 172.21.15.92:0/222824566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4510102a60 0x7f451019b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:41.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 -- 172.21.15.92:0/222824566 >> 172.21.15.92:0/222824566 conn(0x7f4510079730 msgr2=0x7f45101053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:41.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 -- 172.21.15.92:0/222824566 shutdown_connections 2024-09-21T07:20:41.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:41.176+0000 7f4516bbc640 1 -- 172.21.15.92:0/222824566 wait complete. 2024-09-21T07:20:41.872 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:20:42.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:41 smithi092 ceph-mon[30987]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:20:42.121 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:42.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:41 smithi169 ceph-mon[33705]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:20:42.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:41 smithi175 ceph-mon[34064]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.628+0000 7f6c02209640 1 -- 172.21.15.92:0/1355594429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bfc1094a0 msgr2=0x7f6bfc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.628+0000 7f6c02209640 1 --2- 172.21.15.92:0/1355594429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bfc1094a0 0x7f6bfc1098b0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009900 tx=0x7f6bf002a410 comp rx=0 tx=0).stop 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.628+0000 7f6c02209640 1 -- 172.21.15.92:0/1355594429 shutdown_connections 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.628+0000 7f6c02209640 1 --2- 172.21.15.92:0/1355594429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bfc109df0 0x7f6bfc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.628+0000 7f6c02209640 1 --2- 172.21.15.92:0/1355594429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bfc1094a0 0x7f6bfc1098b0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.628+0000 7f6c02209640 1 --2- 172.21.15.92:0/1355594429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc103b60 0x7f6bfc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.628+0000 7f6c02209640 1 -- 172.21.15.92:0/1355594429 >> 172.21.15.92:0/1355594429 conn(0x7f6bfc07b850 msgr2=0x7f6bfc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.628+0000 7f6c02209640 1 -- 172.21.15.92:0/1355594429 shutdown_connections 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.628+0000 7f6c02209640 1 -- 172.21.15.92:0/1355594429 wait complete. 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.629+0000 7f6c02209640 1 Processor -- start 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.629+0000 7f6c02209640 1 -- start start 2024-09-21T07:20:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.629+0000 7f6c02209640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bfc103b60 0x7f6bfc19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.629+0000 7f6c02209640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bfc1094a0 0x7f6bfc19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.629+0000 7f6c02209640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc109df0 0x7f6bfc19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.629+0000 7f6c02209640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc113960 con 0x7f6bfc1094a0 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.629+0000 7f6c02209640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc1137e0 con 0x7f6bfc103b60 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.629+0000 7f6c02209640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc113ae0 con 0x7f6bfc109df0 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bfc1094a0 0x7f6bfc19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bfc1094a0 0x7f6bfc19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34172/0 (socket says 172.21.15.92:34172) 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfaffd640 1 -- 172.21.15.92:0/2197994895 learned_addr learned my addr 172.21.15.92:0/2197994895 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bfc103b60 0x7f6bfc19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc109df0 0x7f6bfc19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfaffd640 1 -- 172.21.15.92:0/2197994895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc109df0 msgr2=0x7f6bfc19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfaffd640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc109df0 0x7f6bfc19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfaffd640 1 -- 172.21.15.92:0/2197994895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bfc103b60 msgr2=0x7f6bfc19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfaffd640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bfc103b60 0x7f6bfc19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfaffd640 1 -- 172.21.15.92:0/2197994895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bfc1a02e0 con 0x7f6bfc1094a0 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bfaffd640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bfc1094a0 0x7f6bfc19a9d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0005940 tx=0x7f6bf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bf8ff9640 1 -- 172.21.15.92:0/2197994895 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf003f030 con 0x7f6bfc1094a0 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bf8ff9640 1 -- 172.21.15.92:0/2197994895 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bf0003c90 con 0x7f6bfc1094a0 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6bf8ff9640 1 -- 172.21.15.92:0/2197994895 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0035070 con 0x7f6bfc1094a0 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6c02209640 1 -- 172.21.15.92:0/2197994895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bfc1a0570 con 0x7f6bfc1094a0 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.630+0000 7f6c02209640 1 -- 172.21.15.92:0/2197994895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bfc1a0a50 con 0x7f6bfc1094a0 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.633+0000 7f6c0877d740 1 Processor -- start 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.633+0000 7f6bf8ff9640 1 -- 172.21.15.92:0/2197994895 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f6bf0042030 con 0x7f6bfc1094a0 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.633+0000 7f6c0877d740 1 -- start start 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.633+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c348f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.633+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c345251b0 0x559c348f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.633+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3452d390 0x559c348f6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.633+0000 7f6c0877d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559c3486bea0 con 0x559c3454e070 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.633+0000 7f6c0877d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559c3485b2d0 con 0x559c345251b0 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.633+0000 7f6c0877d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559c3485f0e0 con 0x559c3452d390 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c348f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c348f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34186/0 (socket says 172.21.15.92:34186) 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfbfff640 1 -- 172.21.15.92:0/1384765788 learned_addr learned my addr 172.21.15.92:0/1384765788 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/1384765788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c345251b0 0x559c348f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfaffd640 1 --2- 172.21.15.92:0/1384765788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3452d390 0x559c348f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfbfff640 1 -- 172.21.15.92:0/1384765788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3452d390 msgr2=0x559c348f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/1384765788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3452d390 0x559c348f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfbfff640 1 -- 172.21.15.92:0/1384765788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c345251b0 msgr2=0x559c348f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/1384765788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c345251b0 0x559c348f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfbfff640 1 -- 172.21.15.92:0/1384765788 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c345b9650 con 0x559c3454e070 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bf8ff9640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6be40b66b0 0x7f6be40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6be40b66b0 0x7f6be40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/1384765788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c348f56a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4007ec0 tx=0x7f6bf400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24fb318d3b25452 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6bf8ff9640 1 -- 172.21.15.92:0/2197994895 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f6bf0108040 con 0x7f6bfc1094a0 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6be1ffb640 1 -- 172.21.15.92:0/1384765788 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4010840 con 0x559c3454e070 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6be1ffb640 1 -- 172.21.15.92:0/1384765788 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bf40183f0 con 0x559c3454e070 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.634+0000 7f6be1ffb640 1 -- 172.21.15.92:0/1384765788 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4017600 con 0x559c3454e070 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.635+0000 7f6c0877d740 1 -- 172.21.15.92:0/1384765788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 msgr2=0x559c348f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.635+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6be40b66b0 0x7f6be40b8bc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x559c348f4320 tx=0x7f6bec00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.635+0000 7f6c0877d740 1 --2- 172.21.15.92:0/1384765788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c348f56a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4007ec0 tx=0x7f6bf400f790 comp rx=0 tx=0).stop 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.635+0000 7f6c0877d740 1 -- 172.21.15.92:0/1384765788 shutdown_connections 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.635+0000 7f6c0877d740 1 --2- 172.21.15.92:0/1384765788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3452d390 0x559c348f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.635+0000 7f6c0877d740 1 --2- 172.21.15.92:0/1384765788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c345251b0 0x559c348f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.635+0000 7f6c0877d740 1 --2- 172.21.15.92:0/1384765788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c348f56a0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.635+0000 7f6c0877d740 1 -- 172.21.15.92:0/1384765788 >> 172.21.15.92:0/1384765788 conn(0x559c34542460 msgr2=0x559c348f3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.635+0000 7f6c0877d740 1 -- 172.21.15.92:0/1384765788 shutdown_connections 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.635+0000 7f6c0877d740 1 -- 172.21.15.92:0/1384765788 wait complete. 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.636+0000 7f6c0877d740 1 -- start start 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.636+0000 7f6c0877d740 1 Processor -- start 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.636+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c345251b0 0x559c34900d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.636+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3452d390 0x559c349012d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.636+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c3490d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6c0877d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559c346bc700 con 0x559c3454e070 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6c0877d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559c347f6160 con 0x559c3452d390 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6c0877d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559c34903e80 con 0x559c345251b0 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6c0877d740 10 client.0 _ll_register_callbacks cb 0x559c3480f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c3490d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c3490d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34194/0 (socket says 172.21.15.92:34194) 2024-09-21T07:20:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfbfff640 1 -- 172.21.15.92:0/3496903244 learned_addr learned my addr 172.21.15.92:0/3496903244 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3452d390 0x559c349012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c345251b0 0x559c34900d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfbfff640 1 -- 172.21.15.92:0/3496903244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c345251b0 msgr2=0x559c34900d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c345251b0 0x559c34900d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfbfff640 1 -- 172.21.15.92:0/3496903244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3452d390 msgr2=0x559c349012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3452d390 0x559c349012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfbfff640 1 -- 172.21.15.92:0/3496903244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c34823c90 con 0x559c3454e070 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c345251b0 0x559c34900d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c3490d1d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4007e90 tx=0x7f6bf4018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2839c53f30cf095 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bdaffd640 1 -- 172.21.15.92:0/3496903244 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4026020 con 0x559c3454e070 2024-09-21T07:20:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6bdaffd640 1 -- 172.21.15.92:0/3496903244 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f6bf4003b80 con 0x559c3454e070 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.637+0000 7f6c0877d740 1 -- 172.21.15.92:0/3496903244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bf40183f0 con 0x559c3454e070 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6bdaffd640 1 -- 172.21.15.92:0/3496903244 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6bf4031050 con 0x559c3454e070 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6c0877d740 10 client.17685 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6c0877d740 1 -- 172.21.15.92:0/3496903244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559c3490fbf0 con 0x559c3454e070 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6bdaffd640 1 -- 172.21.15.92:0/3496903244 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bf40183f0 con 0x559c3454e070 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6bdaffd640 1 -- 172.21.15.92:0/3496903244 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6bf4004040 con 0x559c3454e070 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6c0877d740 10 client.17685 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6c0877d740 10 client.17685 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6c0877d740 20 client.17685 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6c0877d740 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x559c3450c9f0 0x559c34913060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6c0877d740 4 client.17685 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:42.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6c0877d740 1 -- 172.21.15.92:0/3496903244 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c3486ddf0 con 0x559c3450c9f0 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.638+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x559c3450c9f0 0x559c34913060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.639+0000 7f6bdaffd640 10 client.17685 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.639+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x559c3450c9f0 0x559c34913060 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3671f9a80fb3ddb5 server_cookie=56be347c69a4a in_seq=0 out_seq=0 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6bdaffd640 1 -- 172.21.15.92:0/3496903244 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c3486ddf0 con 0x559c3450c9f0 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6bdaffd640 10 client.17685 handle_command_reply: tid=0 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 client.17685 shutdown 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 -- 172.21.15.92:0/3496903244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 msgr2=0x559c3490d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c3490d1d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4007e90 tx=0x7f6bf4018a60 comp rx=0 tx=0).stop 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 -- 172.21.15.92:0/3496903244 shutdown_connections 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x559c3450c9f0 0x559c34913060 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3454e070 0x559c3490d1d0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6bdaffd640 0 client.17685 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:20:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3452d390 0x559c349012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 --2- 172.21.15.92:0/3496903244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c345251b0 0x559c34900d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 -- 172.21.15.92:0/3496903244 >> 172.21.15.92:0/3496903244 conn(0x559c34542460 msgr2=0x559c348f8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 -- 172.21.15.92:0/3496903244 shutdown_connections 2024-09-21T07:20:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 1 -- 172.21.15.92:0/3496903244 wait complete. 2024-09-21T07:20:42.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.640+0000 7f6c0877d740 20 client.17685 trim_cache size 0 max 16384 2024-09-21T07:20:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.653+0000 7f6c0877d740 1 Processor -- start 2024-09-21T07:20:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.653+0000 7f6c0877d740 1 -- start start 2024-09-21T07:20:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c345251b0 0x559c349029c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3452d390 0x559c348f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3454e070 0x559c348f3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6c0877d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc1b0e80 con 0x559c345251b0 2024-09-21T07:20:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6c0877d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc1b29c0 con 0x559c3454e070 2024-09-21T07:20:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6c0877d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc1b1550 con 0x559c3452d390 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c345251b0 0x559c349029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c345251b0 0x559c349029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34206/0 (socket says 172.21.15.92:34206) 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfb7fe640 1 -- 172.21.15.92:0/2363651351 learned_addr learned my addr 172.21.15.92:0/2363651351 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/2363651351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3454e070 0x559c348f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfaffd640 1 --2- 172.21.15.92:0/2363651351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3452d390 0x559c348f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfb7fe640 1 -- 172.21.15.92:0/2363651351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3452d390 msgr2=0x559c348f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/2363651351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3452d390 0x559c348f2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfb7fe640 1 -- 172.21.15.92:0/2363651351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3454e070 msgr2=0x559c348f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/2363651351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3454e070 0x559c348f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfb7fe640 1 -- 172.21.15.92:0/2363651351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c348fb9d0 con 0x559c345251b0 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/2363651351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3454e070 0x559c348f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/2363651351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c345251b0 0x559c349029c0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0058c0 tx=0x7f6bec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f986cf041ceaf6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.654+0000 7f6be17fa640 1 -- 172.21.15.92:0/2363651351 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec02a070 con 0x559c345251b0 2024-09-21T07:20:42.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6be17fa640 1 -- 172.21.15.92:0/2363651351 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bec01bd10 con 0x559c345251b0 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6be17fa640 1 -- 172.21.15.92:0/2363651351 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00f710 con 0x559c345251b0 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6c0877d740 1 -- 172.21.15.92:0/2363651351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c345251b0 msgr2=0x559c349029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6c0877d740 1 --2- 172.21.15.92:0/2363651351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c345251b0 0x559c349029c0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0058c0 tx=0x7f6bec019000 comp rx=0 tx=0).stop 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6c0877d740 1 -- 172.21.15.92:0/2363651351 shutdown_connections 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6c0877d740 1 --2- 172.21.15.92:0/2363651351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c3454e070 0x559c348f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6c0877d740 1 --2- 172.21.15.92:0/2363651351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3452d390 0x559c348f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6c0877d740 1 --2- 172.21.15.92:0/2363651351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c345251b0 0x559c349029c0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6c0877d740 1 -- 172.21.15.92:0/2363651351 >> 172.21.15.92:0/2363651351 conn(0x559c34542460 msgr2=0x559c349022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6c0877d740 1 -- 172.21.15.92:0/2363651351 shutdown_connections 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.655+0000 7f6c0877d740 1 -- 172.21.15.92:0/2363651351 wait complete. 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.656+0000 7f6c0877d740 1 -- start start 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.656+0000 7f6c0877d740 1 Processor -- start 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.656+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c345251b0 0x559c34909ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.656+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3452d390 0x559c34904f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.656+0000 7f6c0877d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3454e070 0x559c34905660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.656+0000 7f6c0877d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc1b22f0 con 0x559c3452d390 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.656+0000 7f6c0877d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc1b1c20 con 0x559c345251b0 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.656+0000 7f6c0877d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc1aee80 con 0x559c3454e070 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.656+0000 7f6c0877d740 10 client.0 _ll_register_callbacks cb 0x7f6bec00a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.656+0000 7f6bfaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3452d390 0x559c34904f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3452d390 0x559c34904f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34220/0 (socket says 172.21.15.92:34220) 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfaffd640 1 -- 172.21.15.92:0/1325796093 learned_addr learned my addr 172.21.15.92:0/1325796093 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c345251b0 0x559c34909ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3454e070 0x559c34905660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfaffd640 1 -- 172.21.15.92:0/1325796093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3454e070 msgr2=0x559c34905660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfaffd640 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3454e070 0x559c34905660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfaffd640 1 -- 172.21.15.92:0/1325796093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c345251b0 msgr2=0x559c34909ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:42.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfaffd640 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c345251b0 0x559c34909ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfaffd640 1 -- 172.21.15.92:0/1325796093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c3497c800 con 0x559c3452d390 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfbfff640 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3454e070 0x559c34905660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bfaffd640 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3452d390 0x559c34904f70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00ca110 tx=0x7f6bf010b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aecd801fb01e109 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bdaffd640 1 -- 172.21.15.92:0/1325796093 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0049040 con 0x559c3452d390 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bdaffd640 1 -- 172.21.15.92:0/1325796093 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f6bf00c9db0 con 0x559c3452d390 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6c0877d740 1 -- 172.21.15.92:0/1325796093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bec01bd10 con 0x559c3452d390 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6bdaffd640 1 -- 172.21.15.92:0/1325796093 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6bf00ca190 con 0x559c3452d390 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6c0877d740 10 client.17691 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.657+0000 7f6c0877d740 1 -- 172.21.15.92:0/1325796093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559c3497d860 con 0x559c3452d390 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.658+0000 7f6bdaffd640 1 -- 172.21.15.92:0/1325796093 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bec01bd10 con 0x559c3452d390 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.658+0000 7f6bdaffd640 1 -- 172.21.15.92:0/1325796093 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6bf010a0b0 con 0x559c3452d390 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.658+0000 7f6c0877d740 10 client.17691 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.658+0000 7f6c0877d740 10 client.17691 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.658+0000 7f6c0877d740 20 client.17691 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.658+0000 7f6c0877d740 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x559c344e1da0 0x559c3497ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.658+0000 7f6c0877d740 4 client.17691 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.658+0000 7f6c0877d740 1 -- 172.21.15.92:0/1325796093 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c348698a0 con 0x559c344e1da0 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.658+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x559c344e1da0 0x559c3497ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6bdaffd640 10 client.17691 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6bfb7fe640 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x559c344e1da0 0x559c3497ffd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a67f1de6ad0e501a server_cookie=d8b9e682c6b519aa in_seq=0 out_seq=0 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6bdaffd640 1 -- 172.21.15.92:0/1325796093 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c348698a0 con 0x559c344e1da0 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6bdaffd640 10 client.17691 handle_command_reply: tid=0 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 client.17691 shutdown 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 -- 172.21.15.92:0/1325796093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3452d390 msgr2=0x559c34904f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3452d390 0x559c34904f70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00ca110 tx=0x7f6bf010b760 comp rx=0 tx=0).stop 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 -- 172.21.15.92:0/1325796093 shutdown_connections 2024-09-21T07:20:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x559c344e1da0 0x559c3497ffd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c3454e070 0x559c34905660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c3452d390 0x559c34904f70 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6bdaffd640 0 client.17691 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:20:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 --2- 172.21.15.92:0/1325796093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559c345251b0 0x559c34909ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 -- 172.21.15.92:0/1325796093 >> 172.21.15.92:0/1325796093 conn(0x559c34542460 msgr2=0x559c349012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 -- 172.21.15.92:0/1325796093 shutdown_connections 2024-09-21T07:20:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 1 -- 172.21.15.92:0/1325796093 wait complete. 2024-09-21T07:20:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.659+0000 7f6c0877d740 20 client.17691 trim_cache size 0 max 16384 2024-09-21T07:20:42.668 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:20:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 -- 172.21.15.92:0/2197994895 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6be40b66b0 msgr2=0x7f6be40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6be40b66b0 0x7f6be40b8bc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x559c348f4320 tx=0x7f6bec00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 -- 172.21.15.92:0/2197994895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bfc1094a0 msgr2=0x7f6bfc19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bfc1094a0 0x7f6bfc19a9d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0005940 tx=0x7f6bf00042f0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 -- 172.21.15.92:0/2197994895 shutdown_connections 2024-09-21T07:20:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f6be40b66b0 0x7f6be40b8bc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc109df0 0x7f6bfc19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bfc1094a0 0x7f6bfc19a9d0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 --2- 172.21.15.92:0/2197994895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bfc103b60 0x7f6bfc19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 -- 172.21.15.92:0/2197994895 >> 172.21.15.92:0/2197994895 conn(0x7f6bfc07b850 msgr2=0x7f6bfc1055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 -- 172.21.15.92:0/2197994895 shutdown_connections 2024-09-21T07:20:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:42.660+0000 7f6c02209640 1 -- 172.21.15.92:0/2197994895 wait complete. 2024-09-21T07:20:43.367 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:20:43.619 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:44.040 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:43 smithi092 ceph-mon[30987]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:20:44.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.130+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/1825541344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd29c105ac0 msgr2=0x7fd29c10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:44.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.130+0000 7fd2a3e4e640 1 --2- 172.21.15.92:0/1825541344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd29c105ac0 0x7fd29c10f530 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd294009900 tx=0x7fd29402a410 comp rx=0 tx=0).stop 2024-09-21T07:20:44.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.130+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/1825541344 shutdown_connections 2024-09-21T07:20:44.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.130+0000 7fd2a3e4e640 1 --2- 172.21.15.92:0/1825541344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd29c105ac0 0x7fd29c10f530 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.130+0000 7fd2a3e4e640 1 --2- 172.21.15.92:0/1825541344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c105170 0x7fd29c105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.130+0000 7fd2a3e4e640 1 --2- 172.21.15.92:0/1825541344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd29c103160 0x7fd29c103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.130+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/1825541344 >> 172.21.15.92:0/1825541344 conn(0x7fd29c077c60 msgr2=0x7fd29c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.130+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/1825541344 shutdown_connections 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.130+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/1825541344 wait complete. 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a3e4e640 1 Processor -- start 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a3e4e640 1 -- start start 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a3e4e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c103160 0x7fd29c19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a3e4e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd29c105170 0x7fd29c19b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a3e4e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd29c105ac0 0x7fd29c19bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a3e4e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c112870 con 0x7fd29c105ac0 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a3e4e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c1126f0 con 0x7fd29c105170 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a3e4e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c1129f0 con 0x7fd29c103160 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a23eb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd29c105ac0 0x7fd29c19bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a23eb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd29c105ac0 0x7fd29c19bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34230/0 (socket says 172.21.15.92:34230) 2024-09-21T07:20:44.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.131+0000 7fd2a23eb640 1 -- 172.21.15.92:0/2503616233 learned_addr learned my addr 172.21.15.92:0/2503616233 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:44.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd29c105170 0x7fd29c19b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c103160 0x7fd29c19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a23eb640 1 -- 172.21.15.92:0/2503616233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c103160 msgr2=0x7fd29c19b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:44.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a23eb640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c103160 0x7fd29c19b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a23eb640 1 -- 172.21.15.92:0/2503616233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd29c105170 msgr2=0x7fd29c19b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:44.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a23eb640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd29c105170 0x7fd29c19b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a23eb640 1 -- 172.21.15.92:0/2503616233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29c1a6480 con 0x7fd29c105ac0 2024-09-21T07:20:44.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd29c105170 0x7fd29c19b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:44.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c103160 0x7fd29c19b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a23eb640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd29c105ac0 0x7fd29c19bc40 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fd294005ab0 tx=0x7fd2940040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd29affd640 1 -- 172.21.15.92:0/2503616233 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29403f030 con 0x7fd29c105ac0 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd29affd640 1 -- 172.21.15.92:0/2503616233 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd294003a80 con 0x7fd29c105ac0 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/2503616233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd29c1a6710 con 0x7fd29c105ac0 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd29affd640 1 -- 172.21.15.92:0/2503616233 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294035070 con 0x7fd29c105ac0 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.132+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/2503616233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd29c1a6c40 con 0x7fd29c105ac0 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.135+0000 7fd2aa3c2740 1 Processor -- start 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.135+0000 7fd29affd640 1 -- 172.21.15.92:0/2503616233 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fd294042030 con 0x7fd29c105ac0 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2aa3c2740 1 -- start start 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3649f070 0x559f368462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36846800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3647e390 0x559f36846d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559f367bcea0 con 0x559f364761b0 2024-09-21T07:20:44.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f367ac2d0 con 0x559f3649f070 2024-09-21T07:20:44.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559f367b00e0 con 0x559f3647e390 2024-09-21T07:20:44.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2a1bea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36846800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2a1bea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36846800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34246/0 (socket says 172.21.15.92:34246) 2024-09-21T07:20:44.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2a1bea640 1 -- 172.21.15.92:0/2452514077 learned_addr learned my addr 172.21.15.92:0/2452514077 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:44.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/2452514077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3649f070 0x559f368462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd29affd640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2840b6700 0x7fd2840b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/2452514077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3647e390 0x559f36846d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2a23eb640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2840b6700 0x7fd2840b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2a1bea640 1 -- 172.21.15.92:0/2452514077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3647e390 msgr2=0x559f36846d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/2452514077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3647e390 0x559f36846d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2a1bea640 1 -- 172.21.15.92:0/2452514077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3649f070 msgr2=0x559f368462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.136+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/2452514077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3649f070 0x559f368462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.137+0000 7fd2a1bea640 1 -- 172.21.15.92:0/2452514077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f3650a650 con 0x559f364761b0 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.137+0000 7fd29affd640 1 -- 172.21.15.92:0/2503616233 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fd2941080b0 con 0x7fd29c105ac0 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.137+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/2452514077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36846800 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00af00 tx=0x7fd28c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d437cf35e740ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.137+0000 7fd2a23eb640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2840b6700 0x7fd2840b8c10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd2940ca0d0 tx=0x7fd29409a7b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.137+0000 7fd283fff640 1 -- 172.21.15.92:0/2452514077 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c003b70 con 0x559f364761b0 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.137+0000 7fd283fff640 1 -- 172.21.15.92:0/2452514077 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd28c003d10 con 0x559f364761b0 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.137+0000 7fd283fff640 1 -- 172.21.15.92:0/2452514077 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c011940 con 0x559f364761b0 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/2452514077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 msgr2=0x559f36846800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/2452514077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36846800 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00af00 tx=0x7fd28c00f730 comp rx=0 tx=0).stop 2024-09-21T07:20:44.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/2452514077 shutdown_connections 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/2452514077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3647e390 0x559f36846d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/2452514077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36846800 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/2452514077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3649f070 0x559f368462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/2452514077 >> 172.21.15.92:0/2452514077 conn(0x559f36493460 msgr2=0x559f368441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/2452514077 shutdown_connections 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/2452514077 wait complete. 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 -- start start 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.138+0000 7fd2aa3c2740 1 Processor -- start 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36855d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 0x559f368562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3649f070 0x559f36862130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559f3660d700 con 0x559f364761b0 2024-09-21T07:20:44.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f36747160 con 0x559f3647e390 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559f36858e00 con 0x559f3649f070 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2aa3c2740 10 client.0 _ll_register_callbacks cb 0x559f367609e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2a13e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36855d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2a13e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36855d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34250/0 (socket says 172.21.15.92:34250) 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2a13e9640 1 -- 172.21.15.92:0/1730458638 learned_addr learned my addr 172.21.15.92:0/1730458638 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2a13e9640 1 -- 172.21.15.92:0/1730458638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3649f070 msgr2=0x559f36862130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 0x559f368562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3649f070 0x559f36862130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2a13e9640 1 -- 172.21.15.92:0/1730458638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 msgr2=0x559f368562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 0x559f368562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2a13e9640 1 -- 172.21.15.92:0/1730458638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f36774c90 con 0x559f364761b0 2024-09-21T07:20:44.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.139+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 0x559f368562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:44.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36855d80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd29000ce00 tx=0x7fd290014f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f45be883aa94eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:44.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2817fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:44.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2817fa640 1 -- 172.21.15.92:0/1730458638 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290011ac0 con 0x559f364761b0 2024-09-21T07:20:44.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/1730458638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd28c003d10 con 0x559f364761b0 2024-09-21T07:20:44.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2817fa640 1 -- 172.21.15.92:0/1730458638 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fd290011c60 con 0x559f364761b0 2024-09-21T07:20:44.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2817fa640 1 -- 172.21.15.92:0/1730458638 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd290011e60 con 0x559f364761b0 2024-09-21T07:20:44.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2aa3c2740 10 client.17703 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:44.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/1730458638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559f36864b70 con 0x559f364761b0 2024-09-21T07:20:44.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2817fa640 1 -- 172.21.15.92:0/1730458638 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd28c003d10 con 0x559f364761b0 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2817fa640 1 -- 172.21.15.92:0/1730458638 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd2900124e0 con 0x559f364761b0 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2aa3c2740 10 client.17703 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2aa3c2740 10 client.17703 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2aa3c2740 20 client.17703 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x559f3645d9f0 0x559f36868040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2aa3c2740 4 client.17703 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.140+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/1730458638 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f367bedf0 con 0x559f3645d9f0 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.141+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x559f3645d9f0 0x559f36868040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.141+0000 7fd2817fa640 10 client.17703 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.141+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x559f3645d9f0 0x559f36868040 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b409da9f15bb54d3 server_cookie=1a77bf776d97dbd8 in_seq=0 out_seq=0 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2817fa640 1 -- 172.21.15.92:0/1730458638 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f367bedf0 con 0x559f3645d9f0 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2817fa640 10 client.17703 handle_command_reply: tid=0 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 client.17703 shutdown 2024-09-21T07:20:44.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/1730458638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 msgr2=0x559f36855d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36855d80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd29000ce00 tx=0x7fd290014f70 comp rx=0 tx=0).stop 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/1730458638 shutdown_connections 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x559f3645d9f0 0x559f36868040 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3649f070 0x559f36862130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 0x559f368562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/1730458638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36855d80 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2817fa640 0 client.17703 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/1730458638 >> 172.21.15.92:0/1730458638 conn(0x559f36493460 msgr2=0x559f36842750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/1730458638 shutdown_connections 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/1730458638 wait complete. 2024-09-21T07:20:44.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.142+0000 7fd2aa3c2740 20 client.17703 trim_cache size 0 max 16384 2024-09-21T07:20:44.155 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:43 smithi169 ceph-mon[33705]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:20:44.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.155+0000 7fd2aa3c2740 1 Processor -- start 2024-09-21T07:20:44.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.155+0000 7fd2aa3c2740 1 -- start start 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36856240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3647e390 0x559f36862030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3649f070 0x559f36843b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c1aedc0 con 0x559f364761b0 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c1b0900 con 0x559f3649f070 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c1af490 con 0x559f3647e390 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a13e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36856240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a13e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36856240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34258/0 (socket says 172.21.15.92:34258) 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a13e9640 1 -- 172.21.15.92:0/3101723175 learned_addr learned my addr 172.21.15.92:0/3101723175 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/3101723175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3649f070 0x559f36843b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/3101723175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3647e390 0x559f36862030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a13e9640 1 -- 172.21.15.92:0/3101723175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3647e390 msgr2=0x559f36862030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:44.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/3101723175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3647e390 0x559f36862030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a13e9640 1 -- 172.21.15.92:0/3101723175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3649f070 msgr2=0x559f36843b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:44.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/3101723175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3649f070 0x559f36843b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a13e9640 1 -- 172.21.15.92:0/3101723175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f36844aa0 con 0x559f364761b0 2024-09-21T07:20:44.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.156+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/3101723175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36856240 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd290012880 tx=0x7fd290014780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccc7367d22af6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:44.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2837fe640 1 -- 172.21.15.92:0/3101723175 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290036070 con 0x559f364761b0 2024-09-21T07:20:44.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2837fe640 1 -- 172.21.15.92:0/3101723175 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd290011ca0 con 0x559f364761b0 2024-09-21T07:20:44.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2837fe640 1 -- 172.21.15.92:0/3101723175 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29002eb40 con 0x559f364761b0 2024-09-21T07:20:44.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3101723175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 msgr2=0x559f36856240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:44.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/3101723175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36856240 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd290012880 tx=0x7fd290014780 comp rx=0 tx=0).stop 2024-09-21T07:20:44.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3101723175 shutdown_connections 2024-09-21T07:20:44.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/3101723175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3649f070 0x559f36843b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/3101723175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3647e390 0x559f36862030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/3101723175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f36856240 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3101723175 >> 172.21.15.92:0/3101723175 conn(0x559f36493460 msgr2=0x559f36855b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3101723175 shutdown_connections 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.157+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3101723175 wait complete. 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2aa3c2740 1 -- start start 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2aa3c2740 1 Processor -- start 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f3685e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 0x559f3685e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2aa3c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3649f070 0x559f36859050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c1b0230 con 0x559f364761b0 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c1afb60 con 0x559f3647e390 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2aa3c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c1acdc0 con 0x559f3649f070 2024-09-21T07:20:44.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2aa3c2740 10 client.0 _ll_register_callbacks cb 0x7fd290014850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2a13e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f3685e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2a13e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f3685e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34270/0 (socket says 172.21.15.92:34270) 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.158+0000 7fd2a13e9640 1 -- 172.21.15.92:0/3637875717 learned_addr learned my addr 172.21.15.92:0/3637875717 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 0x559f3685e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3649f070 0x559f36859050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2a13e9640 1 -- 172.21.15.92:0/3637875717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3649f070 msgr2=0x559f36859050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3649f070 0x559f36859050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2a13e9640 1 -- 172.21.15.92:0/3637875717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 msgr2=0x559f3685e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 0x559f3685e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2a13e9640 1 -- 172.21.15.92:0/3637875717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f3685ed20 con 0x559f364761b0 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 0x559f3685e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2a13e9640 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f3685e0a0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd29000ce00 tx=0x7fd290014b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76ab0047cebe7b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2817fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:44.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2817fa640 1 -- 172.21.15.92:0/3637875717 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290036030 con 0x559f364761b0 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2817fa640 1 -- 172.21.15.92:0/3637875717 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fd29002e930 con 0x559f364761b0 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3637875717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f367ba8a0 con 0x559f364761b0 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2817fa640 1 -- 172.21.15.92:0/3637875717 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd290046050 con 0x559f364761b0 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2aa3c2740 10 client.17709 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3637875717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559f368d2f50 con 0x559f364761b0 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.159+0000 7fd2817fa640 1 -- 172.21.15.92:0/3637875717 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559f367ba8a0 con 0x559f364761b0 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.160+0000 7fd2817fa640 1 -- 172.21.15.92:0/3637875717 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd29001e8a0 con 0x559f364761b0 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.160+0000 7fd2aa3c2740 10 client.17709 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.160+0000 7fd2aa3c2740 10 client.17709 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.160+0000 7fd2aa3c2740 20 client.17709 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.160+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x559f36432da0 0x559f368d5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.160+0000 7fd2aa3c2740 4 client.17709 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.160+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3637875717 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f367b7cd0 con 0x559f36432da0 2024-09-21T07:20:44.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.160+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x559f36432da0 0x559f368d5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.160+0000 7fd2817fa640 10 client.17709 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.160+0000 7fd2a1bea640 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x559f36432da0 0x559f368d5640 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2dce9559f424ec4d server_cookie=96edb73ec57e9b92 in_seq=0 out_seq=0 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2817fa640 1 -- 172.21.15.92:0/3637875717 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f367b7cd0 con 0x559f36432da0 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2817fa640 10 client.17709 handle_command_reply: tid=0 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 client.17709 shutdown 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3637875717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 msgr2=0x559f3685e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f3685e0a0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd29000ce00 tx=0x7fd290014b30 comp rx=0 tx=0).stop 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3637875717 shutdown_connections 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x559f36432da0 0x559f368d5640 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3649f070 0x559f36859050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2817fa640 0 client.17709 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f3647e390 0x559f3685e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 --2- 172.21.15.92:0/3637875717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f364761b0 0x559f3685e0a0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3637875717 >> 172.21.15.92:0/3637875717 conn(0x559f36493460 msgr2=0x559f368439c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:44.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3637875717 shutdown_connections 2024-09-21T07:20:44.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 1 -- 172.21.15.92:0/3637875717 wait complete. 2024-09-21T07:20:44.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2aa3c2740 20 client.17709 trim_cache size 0 max 16384 2024-09-21T07:20:44.168 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:20:44.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/2503616233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2840b6700 msgr2=0x7fd2840b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:44.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.161+0000 7fd2a3e4e640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2840b6700 0x7fd2840b8c10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd2940ca0d0 tx=0x7fd29409a7b0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.162+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/2503616233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd29c105ac0 msgr2=0x7fd29c19bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:44.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.162+0000 7fd2a3e4e640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd29c105ac0 0x7fd29c19bc40 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fd294005ab0 tx=0x7fd2940040e0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.162+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/2503616233 shutdown_connections 2024-09-21T07:20:44.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.162+0000 7fd2a3e4e640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2840b6700 0x7fd2840b8c10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.162+0000 7fd2a3e4e640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd29c105ac0 0x7fd29c19bc40 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.162+0000 7fd2a3e4e640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd29c105170 0x7fd29c19b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.162+0000 7fd2a3e4e640 1 --2- 172.21.15.92:0/2503616233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd29c103160 0x7fd29c19b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:44.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.162+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/2503616233 >> 172.21.15.92:0/2503616233 conn(0x7fd29c077c60 msgr2=0x7fd29c1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:44.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.162+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/2503616233 shutdown_connections 2024-09-21T07:20:44.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:44.162+0000 7fd2a3e4e640 1 -- 172.21.15.92:0/2503616233 wait complete. 2024-09-21T07:20:44.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:43 smithi175 ceph-mon[34064]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:20:44.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:20:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:45.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.600+0000 7ff46ccfb640 1 -- 172.21.15.92:0/1084167375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff468102a60 msgr2=0x7ff468102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:45.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.600+0000 7ff46ccfb640 1 --2- 172.21.15.92:0/1084167375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff468102a60 0x7ff468102e70 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7ff458009900 tx=0x7ff45802a410 comp rx=0 tx=0).stop 2024-09-21T07:20:45.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.601+0000 7ff46ccfb640 1 -- 172.21.15.92:0/1084167375 shutdown_connections 2024-09-21T07:20:45.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.601+0000 7ff46ccfb640 1 --2- 172.21.15.92:0/1084167375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff468108cf0 0x7ff46810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.601+0000 7ff46ccfb640 1 --2- 172.21.15.92:0/1084167375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4681083a0 0x7ff4681087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.601+0000 7ff46ccfb640 1 --2- 172.21.15.92:0/1084167375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff468102a60 0x7ff468102e70 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.601+0000 7ff46ccfb640 1 -- 172.21.15.92:0/1084167375 >> 172.21.15.92:0/1084167375 conn(0x7ff468079730 msgr2=0x7ff468079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.601+0000 7ff46ccfb640 1 -- 172.21.15.92:0/1084167375 shutdown_connections 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.601+0000 7ff46ccfb640 1 -- 172.21.15.92:0/1084167375 wait complete. 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.601+0000 7ff46ccfb640 1 Processor -- start 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff46ccfb640 1 -- start start 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff46ccfb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff468102a60 0x7ff46819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff46ccfb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681083a0 0x7ff46819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff46ccfb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff468108cf0 0x7ff46819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff46ccfb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff468112870 con 0x7ff468108cf0 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff46ccfb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681126f0 con 0x7ff468102a60 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff46ccfb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681129f0 con 0x7ff4681083a0 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff466d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff468108cf0 0x7ff46819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff466d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff468108cf0 0x7ff46819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34290/0 (socket says 172.21.15.92:34290) 2024-09-21T07:20:45.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff466d9d640 1 -- 172.21.15.92:0/160094634 learned_addr learned my addr 172.21.15.92:0/160094634 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff46659c640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff468102a60 0x7ff46819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681083a0 0x7ff46819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff466d9d640 1 -- 172.21.15.92:0/160094634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681083a0 msgr2=0x7ff46819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff466d9d640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681083a0 0x7ff46819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff466d9d640 1 -- 172.21.15.92:0/160094634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff468102a60 msgr2=0x7ff46819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff466d9d640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff468102a60 0x7ff46819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff466d9d640 1 -- 172.21.15.92:0/160094634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4681a0340 con 0x7ff468108cf0 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.602+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681083a0 0x7ff46819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.603+0000 7ff466d9d640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff468108cf0 0x7ff46819fc10 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff46000b970 tx=0x7ff46000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.603+0000 7ff45ffff640 1 -- 172.21.15.92:0/160094634 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460019070 con 0x7ff468108cf0 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.603+0000 7ff45ffff640 1 -- 172.21.15.92:0/160094634 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff460014440 con 0x7ff468108cf0 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.603+0000 7ff46ccfb640 1 -- 172.21.15.92:0/160094634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4681a0630 con 0x7ff468108cf0 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.603+0000 7ff45ffff640 1 -- 172.21.15.92:0/160094634 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4600075d0 con 0x7ff468108cf0 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.603+0000 7ff46ccfb640 1 -- 172.21.15.92:0/160094634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4681a6d90 con 0x7ff468108cf0 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.605+0000 7ff47326f740 1 Processor -- start 2024-09-21T07:20:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.605+0000 7ff45ffff640 1 -- 172.21.15.92:0/160094634 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7ff46001c070 con 0x7ff468108cf0 2024-09-21T07:20:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff47326f740 1 -- start start 2024-09-21T07:20:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff47326f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 0x557394c0e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff47326f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739483e1b0 0x557394c0e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff47326f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394846390 0x557394c0ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff47326f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557394b84ea0 con 0x557394846390 2024-09-21T07:20:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff47326f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557394b742d0 con 0x55739483e1b0 2024-09-21T07:20:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff47326f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557394b780e0 con 0x557394867070 2024-09-21T07:20:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff45dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394846390 0x557394c0ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff45dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394846390 0x557394c0ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34292/0 (socket says 172.21.15.92:34292) 2024-09-21T07:20:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff45dd9b640 1 -- 172.21.15.92:0/426541187 learned_addr learned my addr 172.21.15.92:0/426541187 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/426541187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 0x557394c0e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff46659c640 1 --2- 172.21.15.92:0/426541187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739483e1b0 0x557394c0e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff45dd9b640 1 -- 172.21.15.92:0/426541187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 msgr2=0x557394c0e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/426541187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 0x557394c0e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff45dd9b640 1 -- 172.21.15.92:0/426541187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739483e1b0 msgr2=0x557394c0e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/426541187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739483e1b0 0x557394c0e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff45dd9b640 1 -- 172.21.15.92:0/426541187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573948d2650 con 0x557394846390 2024-09-21T07:20:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.606+0000 7ff46659c640 1 --2- 172.21.15.92:0/426541187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739483e1b0 0x557394c0e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.607+0000 7ff45ffff640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4540b6680 0x7ff4540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.607+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/426541187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394846390 0x557394c0ed40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff450013590 tx=0x7ff45000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d81df7ddcf4b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.607+0000 7ff46659c640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4540b6680 0x7ff4540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.607+0000 7ff45ffff640 1 -- 172.21.15.92:0/160094634 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7ff4600e6fd0 con 0x7ff468108cf0 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.607+0000 7ff45cd99640 1 -- 172.21.15.92:0/426541187 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450004030 con 0x557394846390 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.607+0000 7ff45cd99640 1 -- 172.21.15.92:0/426541187 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4500035f0 con 0x557394846390 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.607+0000 7ff45cd99640 1 -- 172.21.15.92:0/426541187 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4500117a0 con 0x557394846390 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 -- 172.21.15.92:0/426541187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394846390 msgr2=0x557394c0ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff46659c640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4540b6680 0x7ff4540b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff4580057c0 tx=0x7ff4580058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 --2- 172.21.15.92:0/426541187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394846390 0x557394c0ed40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff450013590 tx=0x7ff45000b6f0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 -- 172.21.15.92:0/426541187 shutdown_connections 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 --2- 172.21.15.92:0/426541187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394846390 0x557394c0ed40 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 --2- 172.21.15.92:0/426541187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739483e1b0 0x557394c0e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 --2- 172.21.15.92:0/426541187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 0x557394c0e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 -- 172.21.15.92:0/426541187 >> 172.21.15.92:0/426541187 conn(0x55739485b460 msgr2=0x557394c0c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 -- 172.21.15.92:0/426541187 shutdown_connections 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 -- 172.21.15.92:0/426541187 wait complete. 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 -- start start 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.608+0000 7ff47326f740 1 Processor -- start 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff47326f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c19930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff47326f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394846390 0x557394c19e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff47326f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394867070 0x557394c25d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff47326f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5573949d5700 con 0x55739483e1b0 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff47326f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557394b0f160 con 0x557394867070 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff47326f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557394c1caa0 con 0x557394846390 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff47326f740 10 client.0 _ll_register_callbacks cb 0x557394b289e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff46659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c19930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff46659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c19930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34296/0 (socket says 172.21.15.92:34296) 2024-09-21T07:20:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff46659c640 1 -- 172.21.15.92:0/2742297097 learned_addr learned my addr 172.21.15.92:0/2742297097 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394846390 0x557394c19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff466d9d640 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394867070 0x557394c25d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff46659c640 1 -- 172.21.15.92:0/2742297097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394846390 msgr2=0x557394c19e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff46659c640 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394846390 0x557394c19e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff46659c640 1 -- 172.21.15.92:0/2742297097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394867070 msgr2=0x557394c25d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff46659c640 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394867070 0x557394c25d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff46659c640 1 -- 172.21.15.92:0/2742297097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557394b3cc90 con 0x55739483e1b0 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff466d9d640 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394867070 0x557394c25d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff46659c640 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c19930 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff458009900 tx=0x7ff458009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d105880440ebd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.609+0000 7ff44dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff44dffb640 1 -- 172.21.15.92:0/2742297097 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45804c030 con 0x55739483e1b0 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff44dffb640 1 -- 172.21.15.92:0/2742297097 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7ff4580043d0 con 0x55739483e1b0 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff47326f740 1 -- 172.21.15.92:0/2742297097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4500035f0 con 0x55739483e1b0 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff44dffb640 1 -- 172.21.15.92:0/2742297097 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff458059050 con 0x55739483e1b0 2024-09-21T07:20:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff47326f740 10 client.17721 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff47326f740 1 -- 172.21.15.92:0/2742297097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557394c286e0 con 0x55739483e1b0 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff44dffb640 1 -- 172.21.15.92:0/2742297097 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4500035f0 con 0x55739483e1b0 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff44dffb640 1 -- 172.21.15.92:0/2742297097 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff4580485d0 con 0x55739483e1b0 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff47326f740 10 client.17721 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff47326f740 10 client.17721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff47326f740 20 client.17721 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff47326f740 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5573948259f0 0x557394c2bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff47326f740 4 client.17721 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.610+0000 7ff47326f740 1 -- 172.21.15.92:0/2742297097 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557394b86df0 con 0x5573948259f0 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.611+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5573948259f0 0x557394c2bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.611+0000 7ff44dffb640 10 client.17721 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.611+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5573948259f0 0x557394c2bc90 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dc58f88138f6baf server_cookie=13140d6246a59b32 in_seq=0 out_seq=0 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff44dffb640 1 -- 172.21.15.92:0/2742297097 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557394b86df0 con 0x5573948259f0 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff44dffb640 10 client.17721 handle_command_reply: tid=0 2024-09-21T07:20:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff47326f740 1 client.17721 shutdown 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff47326f740 1 -- 172.21.15.92:0/2742297097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 msgr2=0x557394c19930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff47326f740 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c19930 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff458009900 tx=0x7ff458009260 comp rx=0 tx=0).stop 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff47326f740 1 -- 172.21.15.92:0/2742297097 shutdown_connections 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff47326f740 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5573948259f0 0x557394c2bc90 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff47326f740 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394867070 0x557394c25d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff47326f740 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394846390 0x557394c19e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff47326f740 1 --2- 172.21.15.92:0/2742297097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c19930 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff44dffb640 0 client.17721 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.612+0000 7ff47326f740 1 -- 172.21.15.92:0/2742297097 >> 172.21.15.92:0/2742297097 conn(0x55739485b460 msgr2=0x557394c11450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.613+0000 7ff47326f740 1 -- 172.21.15.92:0/2742297097 shutdown_connections 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.613+0000 7ff47326f740 1 -- 172.21.15.92:0/2742297097 wait complete. 2024-09-21T07:20:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.613+0000 7ff47326f740 20 client.17721 trim_cache size 0 max 16384 2024-09-21T07:20:45.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff47326f740 1 Processor -- start 2024-09-21T07:20:45.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff47326f740 1 -- start start 2024-09-21T07:20:45.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff47326f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c1b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff47326f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 0x557394c0f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff47326f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 0x557394c25c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff47326f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681b0fc0 con 0x55739483e1b0 2024-09-21T07:20:45.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff47326f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681b2b00 con 0x557394846390 2024-09-21T07:20:45.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff47326f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681b1690 con 0x557394867070 2024-09-21T07:20:45.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff46659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c1b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff46659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c1b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34298/0 (socket says 172.21.15.92:34298) 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff46659c640 1 -- 172.21.15.92:0/2194682425 learned_addr learned my addr 172.21.15.92:0/2194682425 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 0x557394c0f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff46659c640 1 -- 172.21.15.92:0/2194682425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 msgr2=0x557394c25c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff466d9d640 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 0x557394c25c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff46659c640 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 0x557394c25c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff46659c640 1 -- 172.21.15.92:0/2194682425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 msgr2=0x557394c0f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff46659c640 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 0x557394c0f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff46659c640 1 -- 172.21.15.92:0/2194682425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557394c0f100 con 0x55739483e1b0 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 0x557394c0f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.627+0000 7ff466d9d640 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 0x557394c25c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.628+0000 7ff46659c640 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c1b810 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7ff458009230 tx=0x7ff458004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcab0ac6cff8655d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.628+0000 7ff44ffff640 1 -- 172.21.15.92:0/2194682425 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458062070 con 0x55739483e1b0 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.628+0000 7ff44ffff640 1 -- 172.21.15.92:0/2194682425 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff458048640 con 0x55739483e1b0 2024-09-21T07:20:45.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.628+0000 7ff44ffff640 1 -- 172.21.15.92:0/2194682425 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45804c070 con 0x55739483e1b0 2024-09-21T07:20:45.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 -- 172.21.15.92:0/2194682425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 msgr2=0x557394c1b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:45.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c1b810 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7ff458009230 tx=0x7ff458004560 comp rx=0 tx=0).stop 2024-09-21T07:20:45.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 -- 172.21.15.92:0/2194682425 shutdown_connections 2024-09-21T07:20:45.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557394867070 0x557394c25c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 0x557394c0f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 --2- 172.21.15.92:0/2194682425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739483e1b0 0x557394c1b810 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 -- 172.21.15.92:0/2194682425 >> 172.21.15.92:0/2194682425 conn(0x55739485b460 msgr2=0x557394c133d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 -- 172.21.15.92:0/2194682425 shutdown_connections 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 -- 172.21.15.92:0/2194682425 wait complete. 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 -- start start 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.629+0000 7ff47326f740 1 Processor -- start 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff47326f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55739483e1b0 0x557394c1e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff47326f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 0x557394c1ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff47326f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394867070 0x557394c8f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff47326f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681b2430 con 0x557394867070 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff47326f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681b1d60 con 0x557394846390 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff47326f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681aefc0 con 0x55739483e1b0 2024-09-21T07:20:45.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff47326f740 10 client.0 _ll_register_callbacks cb 0x7ff458032eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff466d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394867070 0x557394c8f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff466d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394867070 0x557394c8f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34314/0 (socket says 172.21.15.92:34314) 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff466d9d640 1 -- 172.21.15.92:0/3416830923 learned_addr learned my addr 172.21.15.92:0/3416830923 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff46659c640 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55739483e1b0 0x557394c1e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff45dd9b640 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 0x557394c1ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff466d9d640 1 -- 172.21.15.92:0/3416830923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55739483e1b0 msgr2=0x557394c1e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff466d9d640 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55739483e1b0 0x557394c1e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff466d9d640 1 -- 172.21.15.92:0/3416830923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 msgr2=0x557394c1ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff466d9d640 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 0x557394c1ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff466d9d640 1 -- 172.21.15.92:0/3416830923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557394c075d0 con 0x557394867070 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff466d9d640 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394867070 0x557394c8f660 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7ff4600e4920 tx=0x7ff4600ac300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e54759efc9ccae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff44dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff44dffb640 1 -- 172.21.15.92:0/3416830923 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4600d00d0 con 0x557394867070 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff44dffb640 1 -- 172.21.15.92:0/3416830923 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7ff4600b11d0 con 0x557394867070 2024-09-21T07:20:45.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.630+0000 7ff47326f740 1 -- 172.21.15.92:0/3416830923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff458048640 con 0x557394867070 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff44dffb640 1 -- 172.21.15.92:0/3416830923 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff4600b6440 con 0x557394867070 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff47326f740 10 client.17727 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff47326f740 1 -- 172.21.15.92:0/3416830923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557394c96e50 con 0x557394867070 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff44dffb640 1 -- 172.21.15.92:0/3416830923 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff458048640 con 0x557394867070 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff44dffb640 1 -- 172.21.15.92:0/3416830923 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff4600abd30 con 0x557394867070 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff47326f740 10 client.17727 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff47326f740 10 client.17727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff47326f740 20 client.17727 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff47326f740 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5573947fada0 0x557394c99660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff47326f740 4 client.17727 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff47326f740 1 -- 172.21.15.92:0/3416830923 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557394b828a0 con 0x5573947fada0 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.631+0000 7ff46659c640 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5573947fada0 0x557394c99660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:45.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff46659c640 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5573947fada0 0x557394c99660 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deb62ecf9aa2f70 server_cookie=a52d475eea9eb36f in_seq=0 out_seq=0 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff44dffb640 10 client.17727 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff44dffb640 1 -- 172.21.15.92:0/3416830923 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557394b828a0 con 0x5573947fada0 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff44dffb640 10 client.17727 handle_command_reply: tid=0 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 client.17727 shutdown 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 -- 172.21.15.92:0/3416830923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394867070 msgr2=0x557394c8f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394867070 0x557394c8f660 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7ff4600e4920 tx=0x7ff4600ac300 comp rx=0 tx=0).stop 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 -- 172.21.15.92:0/3416830923 shutdown_connections 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5573947fada0 0x557394c99660 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557394867070 0x557394c8f660 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557394846390 0x557394c1ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff44dffb640 0 client.17727 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 --2- 172.21.15.92:0/3416830923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55739483e1b0 0x557394c1e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 -- 172.21.15.92:0/3416830923 >> 172.21.15.92:0/3416830923 conn(0x55739485b460 msgr2=0x557394c1b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 -- 172.21.15.92:0/3416830923 shutdown_connections 2024-09-21T07:20:45.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 1 -- 172.21.15.92:0/3416830923 wait complete. 2024-09-21T07:20:45.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.632+0000 7ff47326f740 20 client.17727 trim_cache size 0 max 16384 2024-09-21T07:20:45.640 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:20:45.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 -- 172.21.15.92:0/160094634 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4540b6680 msgr2=0x7ff4540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4540b6680 0x7ff4540b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff4580057c0 tx=0x7ff4580058d0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 -- 172.21.15.92:0/160094634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff468108cf0 msgr2=0x7ff46819fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff468108cf0 0x7ff46819fc10 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff46000b970 tx=0x7ff46000be30 comp rx=0 tx=0).stop 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 -- 172.21.15.92:0/160094634 shutdown_connections 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff4540b6680 0x7ff4540b8b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff468108cf0 0x7ff46819fc10 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681083a0 0x7ff46819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 --2- 172.21.15.92:0/160094634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff468102a60 0x7ff46819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 -- 172.21.15.92:0/160094634 >> 172.21.15.92:0/160094634 conn(0x7ff468079730 msgr2=0x7ff468101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 -- 172.21.15.92:0/160094634 shutdown_connections 2024-09-21T07:20:45.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:45.633+0000 7ff46ccfb640 1 -- 172.21.15.92:0/160094634 wait complete. 2024-09-21T07:20:45.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:45 smithi092 ceph-mon[30987]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:46.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:45 smithi169 ceph-mon[33705]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:46.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:45 smithi175 ceph-mon[34064]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:20:47.431 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:20:47.431 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:20:47.689 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:48.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:47 smithi092 ceph-mon[30987]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:20:48.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:47 smithi169 ceph-mon[33705]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:20:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.257+0000 7f20e5eb2640 1 -- 172.21.15.92:0/3661729016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e01094a0 msgr2=0x7f20e01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.257+0000 7f20e5eb2640 1 --2- 172.21.15.92:0/3661729016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e01094a0 0x7f20e01098b0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009900 tx=0x7f20c802a410 comp rx=0 tx=0).stop 2024-09-21T07:20:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.257+0000 7f20e5eb2640 1 -- 172.21.15.92:0/3661729016 shutdown_connections 2024-09-21T07:20:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.257+0000 7f20e5eb2640 1 --2- 172.21.15.92:0/3661729016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20e0109df0 0x7f20e0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.257+0000 7f20e5eb2640 1 --2- 172.21.15.92:0/3661729016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e01094a0 0x7f20e01098b0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.257+0000 7f20e5eb2640 1 --2- 172.21.15.92:0/3661729016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20e0103b60 0x7f20e0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.257+0000 7f20e5eb2640 1 -- 172.21.15.92:0/3661729016 >> 172.21.15.92:0/3661729016 conn(0x7f20e007b850 msgr2=0x7f20e007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.257+0000 7f20e5eb2640 1 -- 172.21.15.92:0/3661729016 shutdown_connections 2024-09-21T07:20:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.257+0000 7f20e5eb2640 1 -- 172.21.15.92:0/3661729016 wait complete. 2024-09-21T07:20:48.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20e5eb2640 1 Processor -- start 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20e5eb2640 1 -- start start 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20e5eb2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0103b60 0x7f20e019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20e5eb2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20e01094a0 0x7f20e019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20e5eb2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20e0109df0 0x7f20e019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20e5eb2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20e0113960 con 0x7f20e0103b60 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20e5eb2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20e01137e0 con 0x7f20e0109df0 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20e5eb2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f20e0113ae0 con 0x7f20e01094a0 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20df7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0103b60 0x7f20e019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20df7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0103b60 0x7f20e019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34336/0 (socket says 172.21.15.92:34336) 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20df7fe640 1 -- 172.21.15.92:0/4000356162 learned_addr learned my addr 172.21.15.92:0/4000356162 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:48.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20d7fff640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20e01094a0 0x7f20e019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20dffff640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20e0109df0 0x7f20e019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20df7fe640 1 -- 172.21.15.92:0/4000356162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20e01094a0 msgr2=0x7f20e019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20df7fe640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20e01094a0 0x7f20e019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20df7fe640 1 -- 172.21.15.92:0/4000356162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20e0109df0 msgr2=0x7f20e019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20df7fe640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20e0109df0 0x7f20e019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20df7fe640 1 -- 172.21.15.92:0/4000356162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e01a0380 con 0x7f20e0103b60 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.258+0000 7f20dffff640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20e0109df0 0x7f20e019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.259+0000 7f20df7fe640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0103b60 0x7f20e019a410 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f20d000d950 tx=0x7f20d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.259+0000 7f20dd7fa640 1 -- 172.21.15.92:0/4000356162 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0017070 con 0x7f20e0103b60 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.259+0000 7f20dd7fa640 1 -- 172.21.15.92:0/4000356162 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20d0009c30 con 0x7f20e0103b60 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.259+0000 7f20e5eb2640 1 -- 172.21.15.92:0/4000356162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e01a0670 con 0x7f20e0103b60 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.259+0000 7f20dd7fa640 1 -- 172.21.15.92:0/4000356162 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d000f620 con 0x7f20e0103b60 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.259+0000 7f20e5eb2640 1 -- 172.21.15.92:0/4000356162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e01a6dd0 con 0x7f20e0103b60 2024-09-21T07:20:48.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.261+0000 7f20ec426740 1 Processor -- start 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20dd7fa640 1 -- 172.21.15.92:0/4000356162 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f20d0010460 con 0x7f20e0103b60 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20ec426740 1 -- start start 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20ec426740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8f2350 0x562c2dc99430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20ec426740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 0x562c2dc99970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20ec426740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8d1670 0x562c2dc99eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20ec426740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c2dc0fe60 con 0x562c2d8f2350 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20ec426740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562c2dbff290 con 0x562c2d8c9490 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20ec426740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c2dc030a0 con 0x562c2d8d1670 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20dffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8f2350 0x562c2dc99430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20dffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8f2350 0x562c2dc99430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34350/0 (socket says 172.21.15.92:34350) 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20dffff640 1 -- 172.21.15.92:0/2584197138 learned_addr learned my addr 172.21.15.92:0/2584197138 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20d7fff640 1 --2- 172.21.15.92:0/2584197138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8d1670 0x562c2dc99eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20df7fe640 1 --2- 172.21.15.92:0/2584197138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 0x562c2dc99970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20dffff640 1 -- 172.21.15.92:0/2584197138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8d1670 msgr2=0x562c2dc99eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:48.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20dffff640 1 --2- 172.21.15.92:0/2584197138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8d1670 0x562c2dc99eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20dffff640 1 -- 172.21.15.92:0/2584197138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 msgr2=0x562c2dc99970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:48.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20dffff640 1 --2- 172.21.15.92:0/2584197138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 0x562c2dc99970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.262+0000 7f20dffff640 1 -- 172.21.15.92:0/2584197138 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2d95d930 con 0x562c2d8f2350 2024-09-21T07:20:48.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.263+0000 7f20dffff640 1 --2- 172.21.15.92:0/2584197138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8f2350 0x562c2dc99430 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009fb0 tx=0x7f20d8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2c506127f525c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:48.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.263+0000 7f20dd7fa640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20cc0b6680 0x7f20cc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.263+0000 7f20d5ffb640 1 -- 172.21.15.92:0/2584197138 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8016070 con 0x562c2d8f2350 2024-09-21T07:20:48.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.263+0000 7f20df7fe640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20cc0b6680 0x7f20cc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.263+0000 7f20d5ffb640 1 -- 172.21.15.92:0/2584197138 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20d8012ba0 con 0x562c2d8f2350 2024-09-21T07:20:48.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.263+0000 7f20d5ffb640 1 -- 172.21.15.92:0/2584197138 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8011ae0 con 0x562c2d8f2350 2024-09-21T07:20:48.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.263+0000 7f20dd7fa640 1 -- 172.21.15.92:0/4000356162 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f20d00e7740 con 0x7f20e0103b60 2024-09-21T07:20:48.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:47 smithi175 ceph-mon[34064]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-21T07:20:48.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20ec426740 1 -- 172.21.15.92:0/2584197138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8f2350 msgr2=0x562c2dc99430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:48.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20df7fe640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20cc0b6680 0x7f20cc0b8b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f20d00e4b40 tx=0x7f20d000bf60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:48.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20ec426740 1 --2- 172.21.15.92:0/2584197138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8f2350 0x562c2dc99430 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009fb0 tx=0x7f20d8010800 comp rx=0 tx=0).stop 2024-09-21T07:20:48.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20ec426740 1 -- 172.21.15.92:0/2584197138 shutdown_connections 2024-09-21T07:20:48.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20ec426740 1 --2- 172.21.15.92:0/2584197138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8d1670 0x562c2dc99eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20ec426740 1 --2- 172.21.15.92:0/2584197138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 0x562c2dc99970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20ec426740 1 --2- 172.21.15.92:0/2584197138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8f2350 0x562c2dc99430 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20ec426740 1 -- 172.21.15.92:0/2584197138 >> 172.21.15.92:0/2584197138 conn(0x562c2d8e6740 msgr2=0x562c2dc97320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:48.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20ec426740 1 -- 172.21.15.92:0/2584197138 shutdown_connections 2024-09-21T07:20:48.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20ec426740 1 -- 172.21.15.92:0/2584197138 wait complete. 2024-09-21T07:20:48.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.264+0000 7f20ec426740 1 -- start start 2024-09-21T07:20:48.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20ec426740 1 Processor -- start 2024-09-21T07:20:48.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20ec426740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 0x562c2dca5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20ec426740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20ec426740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8f2350 0x562c2dcb0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20ec426740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562c2da60890 con 0x562c2d8d1670 2024-09-21T07:20:48.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20ec426740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562c2db99d40 con 0x562c2d8c9490 2024-09-21T07:20:48.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20ec426740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c2dca7c10 con 0x562c2d8f2350 2024-09-21T07:20:48.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20ec426740 10 client.0 _ll_register_callbacks cb 0x562c2dbfdc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:48.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34356/0 (socket says 172.21.15.92:34356) 2024-09-21T07:20:48.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20d7fff640 1 -- 172.21.15.92:0/3611966365 learned_addr learned my addr 172.21.15.92:0/3611966365 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:48.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20dffff640 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 0x562c2dca5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20dffff640 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8f2350 0x562c2dcb0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20d7fff640 1 -- 172.21.15.92:0/3611966365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8f2350 msgr2=0x562c2dcb0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:48.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20d7fff640 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8f2350 0x562c2dcb0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20d7fff640 1 -- 172.21.15.92:0/3611966365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 msgr2=0x562c2dca5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:48.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20d7fff640 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 0x562c2dca5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20d7fff640 1 -- 172.21.15.92:0/3611966365 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2dcb1540 con 0x562c2d8d1670 2024-09-21T07:20:48.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.265+0000 7f20dffff640 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 0x562c2dca5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:48.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.266+0000 7f20d7fff640 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca5620 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f20c8000c00 tx=0x7f20c8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab757132a90a0cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:48.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.266+0000 7f20beffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:48.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.266+0000 7f20beffd640 1 -- 172.21.15.92:0/3611966365 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8035040 con 0x562c2d8d1670 2024-09-21T07:20:48.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.266+0000 7f20beffd640 1 -- 172.21.15.92:0/3611966365 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f20c8004040 con 0x562c2d8d1670 2024-09-21T07:20:48.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.266+0000 7f20ec426740 1 -- 172.21.15.92:0/3611966365 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20d8012ba0 con 0x562c2d8d1670 2024-09-21T07:20:48.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.266+0000 7f20beffd640 1 -- 172.21.15.92:0/3611966365 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f20c804f050 con 0x562c2d8d1670 2024-09-21T07:20:48.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.266+0000 7f20ec426740 10 client.17739 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:48.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.266+0000 7f20ec426740 1 -- 172.21.15.92:0/3611966365 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c2dcb3e70 con 0x562c2d8d1670 2024-09-21T07:20:48.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.266+0000 7f20beffd640 1 -- 172.21.15.92:0/3611966365 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20d8012ba0 con 0x562c2d8d1670 2024-09-21T07:20:48.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.266+0000 7f20beffd640 1 -- 172.21.15.92:0/3611966365 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f20c8046480 con 0x562c2d8d1670 2024-09-21T07:20:48.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.267+0000 7f20ec426740 10 client.17739 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:48.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.267+0000 7f20ec426740 10 client.17739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:48.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.267+0000 7f20ec426740 20 client.17739 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:48.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.267+0000 7f20ec426740 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c2d8b0cd0 0x562c2dcb7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.267+0000 7f20ec426740 4 client.17739 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:48.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.267+0000 7f20ec426740 1 -- 172.21.15.92:0/3611966365 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c2dc11db0 con 0x562c2d8b0cd0 2024-09-21T07:20:48.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.267+0000 7f20dffff640 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c2d8b0cd0 0x562c2dcb7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.267+0000 7f20beffd640 10 client.17739 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:48.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.267+0000 7f20dffff640 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c2d8b0cd0 0x562c2dcb7360 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fda44e47e5914f1f server_cookie=e3902bcb0e19453d in_seq=0 out_seq=0 2024-09-21T07:20:48.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20beffd640 1 -- 172.21.15.92:0/3611966365 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c2dc11db0 con 0x562c2d8b0cd0 2024-09-21T07:20:48.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20beffd640 10 client.17739 handle_command_reply: tid=0 2024-09-21T07:20:48.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 client.17739 shutdown 2024-09-21T07:20:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 -- 172.21.15.92:0/3611966365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 msgr2=0x562c2dca5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca5620 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f20c8000c00 tx=0x7f20c8031400 comp rx=0 tx=0).stop 2024-09-21T07:20:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 -- 172.21.15.92:0/3611966365 shutdown_connections 2024-09-21T07:20:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c2d8b0cd0 0x562c2dcb7360 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8f2350 0x562c2dcb0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca5620 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 --2- 172.21.15.92:0/3611966365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8c9490 0x562c2dca5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20beffd640 0 client.17739 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:48.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 -- 172.21.15.92:0/3611966365 >> 172.21.15.92:0/3611966365 conn(0x562c2d8e6740 msgr2=0x562c2dc9c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:48.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 -- 172.21.15.92:0/3611966365 shutdown_connections 2024-09-21T07:20:48.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.268+0000 7f20ec426740 1 -- 172.21.15.92:0/3611966365 wait complete. 2024-09-21T07:20:48.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.269+0000 7f20ec426740 20 client.17739 trim_cache size 0 max 16384 2024-09-21T07:20:48.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20ec426740 1 Processor -- start 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20ec426740 1 -- start start 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20ec426740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8c9490 0x562c2dc9e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20ec426740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dc9ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20ec426740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8f2350 0x562c2dc9c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20ec426740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20e01b0fe0 con 0x562c2d8d1670 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20ec426740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20e01b2b20 con 0x562c2d8f2350 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20ec426740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f20e01b16b0 con 0x562c2d8c9490 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dc9ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dc9ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34362/0 (socket says 172.21.15.92:34362) 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20d7fff640 1 -- 172.21.15.92:0/4114974078 learned_addr learned my addr 172.21.15.92:0/4114974078 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20d7fff640 1 -- 172.21.15.92:0/4114974078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8c9490 msgr2=0x562c2dc9e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20d7fff640 1 --2- 172.21.15.92:0/4114974078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8c9490 0x562c2dc9e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20d7fff640 1 -- 172.21.15.92:0/4114974078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8f2350 msgr2=0x562c2dc9c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20d7fff640 1 --2- 172.21.15.92:0/4114974078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8f2350 0x562c2dc9c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.286+0000 7f20d7fff640 1 -- 172.21.15.92:0/4114974078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2dc9b720 con 0x562c2d8d1670 2024-09-21T07:20:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.287+0000 7f20d7fff640 1 --2- 172.21.15.92:0/4114974078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dc9ea50 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f20c802a930 tx=0x7f20c802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b350df62b7b300be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.287+0000 7f20d57fa640 1 -- 172.21.15.92:0/4114974078 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8058070 con 0x562c2d8d1670 2024-09-21T07:20:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.287+0000 7f20d57fa640 1 -- 172.21.15.92:0/4114974078 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20c804c040 con 0x562c2d8d1670 2024-09-21T07:20:48.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.287+0000 7f20d57fa640 1 -- 172.21.15.92:0/4114974078 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8035070 con 0x562c2d8d1670 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.287+0000 7f20ec426740 1 -- 172.21.15.92:0/4114974078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 msgr2=0x562c2dc9ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.287+0000 7f20ec426740 1 --2- 172.21.15.92:0/4114974078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dc9ea50 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f20c802a930 tx=0x7f20c802a410 comp rx=0 tx=0).stop 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 -- 172.21.15.92:0/4114974078 shutdown_connections 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 --2- 172.21.15.92:0/4114974078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8f2350 0x562c2dc9c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 --2- 172.21.15.92:0/4114974078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dc9ea50 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 --2- 172.21.15.92:0/4114974078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8c9490 0x562c2dc9e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 -- 172.21.15.92:0/4114974078 >> 172.21.15.92:0/4114974078 conn(0x562c2d8e6740 msgr2=0x562c2dca3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 -- 172.21.15.92:0/4114974078 shutdown_connections 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 -- 172.21.15.92:0/4114974078 wait complete. 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 -- start start 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 Processor -- start 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8c9490 0x562c2dca9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8f2350 0x562c2dd1add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20e01b2450 con 0x562c2d8d1670 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20e01b1d80 con 0x562c2d8f2350 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.288+0000 7f20ec426740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f20e01aefe0 con 0x562c2d8c9490 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20ec426740 10 client.0 _ll_register_callbacks cb 0x7f20c8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34372/0 (socket says 172.21.15.92:34372) 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20d7fff640 1 -- 172.21.15.92:0/3644966868 learned_addr learned my addr 172.21.15.92:0/3644966868 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20dffff640 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8f2350 0x562c2dd1add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20dffff640 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8c9490 0x562c2dca9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20d7fff640 1 -- 172.21.15.92:0/3644966868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8c9490 msgr2=0x562c2dca9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20d7fff640 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8c9490 0x562c2dca9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20d7fff640 1 -- 172.21.15.92:0/3644966868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8f2350 msgr2=0x562c2dd1add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:48.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20d7fff640 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8f2350 0x562c2dd1add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20d7fff640 1 -- 172.21.15.92:0/3644966868 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2dd1b440 con 0x562c2d8d1670 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20d7fff640 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca9f50 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f20c80469f0 tx=0x7f20c8046730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d19899a7ace42d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20beffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20beffd640 1 -- 172.21.15.92:0/3644966868 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8035070 con 0x562c2d8d1670 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20beffd640 1 -- 172.21.15.92:0/3644966868 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f20c8004230 con 0x562c2d8d1670 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20ec426740 1 -- 172.21.15.92:0/3644966868 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20c804c040 con 0x562c2d8d1670 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.289+0000 7f20beffd640 1 -- 172.21.15.92:0/3644966868 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f20c8066050 con 0x562c2d8d1670 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20ec426740 10 client.17745 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20ec426740 1 -- 172.21.15.92:0/3644966868 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c2dd22870 con 0x562c2d8d1670 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20beffd640 1 -- 172.21.15.92:0/3644966868 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20c804c040 con 0x562c2d8d1670 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20beffd640 1 -- 172.21.15.92:0/3644966868 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f20c8003af0 con 0x562c2d8d1670 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20ec426740 10 client.17745 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20ec426740 10 client.17745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20ec426740 20 client.17745 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:48.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20ec426740 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c2d886080 0x562c2dd24f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:48.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20ec426740 4 client.17745 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:20:48.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20ec426740 1 -- 172.21.15.92:0/3644966868 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562c2dc0d860 con 0x562c2d886080 2024-09-21T07:20:48.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.290+0000 7f20dffff640 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c2d886080 0x562c2dd24f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:48.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.291+0000 7f20beffd640 10 client.17745 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:48.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.291+0000 7f20dffff640 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c2d886080 0x562c2dd24f30 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d53d80f31cc70a76 server_cookie=f0a365fd2c6fbb1a in_seq=0 out_seq=0 2024-09-21T07:20:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.292+0000 7f20beffd640 1 -- 172.21.15.92:0/3644966868 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562c2dc0d860 con 0x562c2d886080 2024-09-21T07:20:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.292+0000 7f20beffd640 10 client.17745 handle_command_reply: tid=0 2024-09-21T07:20:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.292+0000 7f20ec426740 1 client.17745 shutdown 2024-09-21T07:20:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 1 -- 172.21.15.92:0/3644966868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 msgr2=0x562c2dca9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca9f50 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f20c80469f0 tx=0x7f20c8046730 comp rx=0 tx=0).stop 2024-09-21T07:20:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 1 -- 172.21.15.92:0/3644966868 shutdown_connections 2024-09-21T07:20:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562c2d886080 0x562c2dd24f30 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c2d8f2350 0x562c2dd1add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562c2d8d1670 0x562c2dca9f50 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 1 --2- 172.21.15.92:0/3644966868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c2d8c9490 0x562c2dca9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20beffd640 0 client.17745 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:48.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 1 -- 172.21.15.92:0/3644966868 >> 172.21.15.92:0/3644966868 conn(0x562c2d8e6740 msgr2=0x562c2dc9c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:48.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 1 -- 172.21.15.92:0/3644966868 shutdown_connections 2024-09-21T07:20:48.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 1 -- 172.21.15.92:0/3644966868 wait complete. 2024-09-21T07:20:48.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20ec426740 20 client.17745 trim_cache size 0 max 16384 2024-09-21T07:20:48.298 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:20:48.298 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:20:48.298 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "3b742b30-fd49-4ec5-844d-6cfbec3bbf45", 2024-09-21T07:20:48.298 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:20:48.298 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:20:48.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20e5eb2640 1 -- 172.21.15.92:0/4000356162 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20cc0b6680 msgr2=0x7f20cc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:48.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20e5eb2640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20cc0b6680 0x7f20cc0b8b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f20d00e4b40 tx=0x7f20d000bf60 comp rx=0 tx=0).stop 2024-09-21T07:20:48.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20e5eb2640 1 -- 172.21.15.92:0/4000356162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0103b60 msgr2=0x7f20e019a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:48.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20e5eb2640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0103b60 0x7f20e019a410 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f20d000d950 tx=0x7f20d000de10 comp rx=0 tx=0).stop 2024-09-21T07:20:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20e5eb2640 1 -- 172.21.15.92:0/4000356162 shutdown_connections 2024-09-21T07:20:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20e5eb2640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f20cc0b6680 0x7f20cc0b8b90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20e5eb2640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20e0109df0 0x7f20e019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20e5eb2640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20e01094a0 0x7f20e019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20e5eb2640 1 --2- 172.21.15.92:0/4000356162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20e0103b60 0x7f20e019a410 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.293+0000 7f20e5eb2640 1 -- 172.21.15.92:0/4000356162 >> 172.21.15.92:0/4000356162 conn(0x7f20e007b850 msgr2=0x7f20e01075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.294+0000 7f20e5eb2640 1 -- 172.21.15.92:0/4000356162 shutdown_connections 2024-09-21T07:20:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:48.294+0000 7f20e5eb2640 1 -- 172.21.15.92:0/4000356162 wait complete. 2024-09-21T07:20:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:48 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:20:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:48 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:48 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:20:49.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:48 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:49.177 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:20:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:48 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:20:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:48 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:48 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:20:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:48 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:49.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:48 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:20:49.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:48 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:49.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:48 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:20:49.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:48 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:20:49.424 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:49.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.921+0000 7f69d31de640 1 -- 172.21.15.92:0/2046045714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69cc1094b0 msgr2=0x7f69cc1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.921+0000 7f69d31de640 1 --2- 172.21.15.92:0/2046045714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69cc1094b0 0x7f69cc1098c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009900 tx=0x7f69b402a410 comp rx=0 tx=0).stop 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.921+0000 7f69d31de640 1 -- 172.21.15.92:0/2046045714 shutdown_connections 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.921+0000 7f69d31de640 1 --2- 172.21.15.92:0/2046045714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69cc109e00 0x7f69cc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.921+0000 7f69d31de640 1 --2- 172.21.15.92:0/2046045714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69cc1094b0 0x7f69cc1098c0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.921+0000 7f69d31de640 1 --2- 172.21.15.92:0/2046045714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69cc103bc0 0x7f69cc103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.921+0000 7f69d31de640 1 -- 172.21.15.92:0/2046045714 >> 172.21.15.92:0/2046045714 conn(0x7f69cc07b910 msgr2=0x7f69cc07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.921+0000 7f69d31de640 1 -- 172.21.15.92:0/2046045714 shutdown_connections 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.921+0000 7f69d31de640 1 -- 172.21.15.92:0/2046045714 wait complete. 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d31de640 1 Processor -- start 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d31de640 1 -- start start 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d31de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69cc103bc0 0x7f69cc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d31de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69cc1094b0 0x7f69cc19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d31de640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69cc109e00 0x7f69cc19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d31de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc113a10 con 0x7f69cc1094b0 2024-09-21T07:20:49.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d31de640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc113890 con 0x7f69cc109e00 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d31de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc113b90 con 0x7f69cc103bc0 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69cc1094b0 0x7f69cc19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69cc1094b0 0x7f69cc19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45362/0 (socket says 172.21.15.92:45362) 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69cbfff640 1 -- 172.21.15.92:0/1473003789 learned_addr learned my addr 172.21.15.92:0/1473003789 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d177b640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69cc109e00 0x7f69cc19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69cc103bc0 0x7f69cc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69cbfff640 1 -- 172.21.15.92:0/1473003789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69cc103bc0 msgr2=0x7f69cc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69cbfff640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69cc103bc0 0x7f69cc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69cbfff640 1 -- 172.21.15.92:0/1473003789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69cc109e00 msgr2=0x7f69cc19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69cbfff640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69cc109e00 0x7f69cc19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69cbfff640 1 -- 172.21.15.92:0/1473003789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc1a0570 con 0x7f69cc1094b0 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d177b640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69cc109e00 0x7f69cc19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:49.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.922+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69cc103bc0 0x7f69cc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.923+0000 7f69cbfff640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69cc1094b0 0x7f69cc19aba0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f69b4005940 tx=0x7f69b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.923+0000 7f69c9ffb640 1 -- 172.21.15.92:0/1473003789 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b403f030 con 0x7f69cc1094b0 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.923+0000 7f69d31de640 1 -- 172.21.15.92:0/1473003789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69cc1a0800 con 0x7f69cc1094b0 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.923+0000 7f69c9ffb640 1 -- 172.21.15.92:0/1473003789 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69b4003c90 con 0x7f69cc1094b0 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.923+0000 7f69c9ffb640 1 -- 172.21.15.92:0/1473003789 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4035070 con 0x7f69cc1094b0 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.923+0000 7f69d31de640 1 -- 172.21.15.92:0/1473003789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69cc1a6fc0 con 0x7f69cc1094b0 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d9752740 1 Processor -- start 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d9752740 1 -- start start 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d9752740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88cb8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d9752740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888e81b0 0x560c88cb87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d9752740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888f0390 0x560c88cb8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d9752740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560c88c2ee50 con 0x560c888e81b0 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d9752740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560c88c1e280 con 0x560c88911070 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69c9ffb640 1 -- 172.21.15.92:0/1473003789 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f69b4042030 con 0x7f69cc1094b0 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d9752740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560c88c22090 con 0x560c888f0390 2024-09-21T07:20:49.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d0f7a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888e81b0 0x560c88cb87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d0f7a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888e81b0 0x560c88cb87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45368/0 (socket says 172.21.15.92:45368) 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d0f7a640 1 -- 172.21.15.92:0/4248290683 learned_addr learned my addr 172.21.15.92:0/4248290683 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69d177b640 1 --2- 172.21.15.92:0/4248290683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88cb8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.926+0000 7f69cbfff640 1 --2- 172.21.15.92:0/4248290683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888f0390 0x560c88cb8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69d0f7a640 1 -- 172.21.15.92:0/4248290683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888f0390 msgr2=0x560c88cb8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/4248290683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888f0390 0x560c88cb8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69d0f7a640 1 -- 172.21.15.92:0/4248290683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 msgr2=0x560c88cb8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/4248290683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88cb8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69d0f7a640 1 -- 172.21.15.92:0/4248290683 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8897c650 con 0x560c888e81b0 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/4248290683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888e81b0 0x560c88cb87b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f69bc007fb0 tx=0x7f69bc00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d87cdc227b7456 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69c9ffb640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69b80b6680 0x7f69b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69c2ffd640 1 -- 172.21.15.92:0/4248290683 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc014070 con 0x560c888e81b0 2024-09-21T07:20:49.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69c2ffd640 1 -- 172.21.15.92:0/4248290683 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69bc00fce0 con 0x560c888e81b0 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69c2ffd640 1 -- 172.21.15.92:0/4248290683 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00eb70 con 0x560c888e81b0 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69d177b640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69b80b6680 0x7f69b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.927+0000 7f69c9ffb640 1 -- 172.21.15.92:0/1473003789 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f69b4108530 con 0x7f69cc1094b0 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d9752740 1 -- 172.21.15.92:0/4248290683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888e81b0 msgr2=0x560c88cb87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d9752740 1 --2- 172.21.15.92:0/4248290683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888e81b0 0x560c88cb87b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f69bc007fb0 tx=0x7f69bc00c750 comp rx=0 tx=0).stop 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d177b640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69b80b6680 0x7f69b80b8b90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f69c400bad0 tx=0x7f69c4008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d9752740 1 -- 172.21.15.92:0/4248290683 shutdown_connections 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d9752740 1 --2- 172.21.15.92:0/4248290683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888f0390 0x560c88cb8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d9752740 1 --2- 172.21.15.92:0/4248290683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888e81b0 0x560c88cb87b0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d9752740 1 --2- 172.21.15.92:0/4248290683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88cb8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d9752740 1 -- 172.21.15.92:0/4248290683 >> 172.21.15.92:0/4248290683 conn(0x560c88905460 msgr2=0x560c88cb6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d9752740 1 -- 172.21.15.92:0/4248290683 shutdown_connections 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d9752740 1 -- 172.21.15.92:0/4248290683 wait complete. 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.928+0000 7f69d9752740 1 -- start start 2024-09-21T07:20:49.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69d9752740 1 Processor -- start 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69d9752740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888e81b0 0x560c88cc7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69d9752740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cc81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69d9752740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88cc8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69d9752740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560c88a7f700 con 0x560c888f0390 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69d9752740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560c88bb9110 con 0x560c88911070 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69d9752740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560c88ccadb0 con 0x560c888e81b0 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69d9752740 10 client.0 _ll_register_callbacks cb 0x560c88bd2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cc81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cc81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45374/0 (socket says 172.21.15.92:45374) 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69cbfff640 1 -- 172.21.15.92:0/4235466837 learned_addr learned my addr 172.21.15.92:0/4235466837 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69d177b640 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88cc8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888e81b0 0x560c88cc7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69cbfff640 1 -- 172.21.15.92:0/4235466837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888e81b0 msgr2=0x560c88cc7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69cbfff640 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888e81b0 0x560c88cc7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69cbfff640 1 -- 172.21.15.92:0/4235466837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 msgr2=0x560c88cc8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69cbfff640 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88cc8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.929+0000 7f69cbfff640 1 -- 172.21.15.92:0/4235466837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c88be6c40 con 0x560c888f0390 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69cbfff640 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cc81f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f69b40cdeb0 tx=0x7f69b410bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b99a8075b923e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69abfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69abfff640 1 -- 172.21.15.92:0/4235466837 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4049070 con 0x560c888f0390 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69d9752740 1 -- 172.21.15.92:0/4235466837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69bc00fce0 con 0x560c888f0390 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69abfff640 1 -- 172.21.15.92:0/4235466837 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f69b4108120 con 0x560c888f0390 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69abfff640 1 -- 172.21.15.92:0/4235466837 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f69b40cd870 con 0x560c888f0390 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69d9752740 10 client.17757 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69d9752740 1 -- 172.21.15.92:0/4235466837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560c88cd6a70 con 0x560c888f0390 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69abfff640 1 -- 172.21.15.92:0/4235466837 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69bc00fce0 con 0x560c888f0390 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69abfff640 1 -- 172.21.15.92:0/4235466837 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f69b40d1050 con 0x560c888f0390 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69d9752740 10 client.17757 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69d9752740 10 client.17757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69d9752740 20 client.17757 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69d9752740 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560c888cf9f0 0x560c88cd9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69d9752740 4 client.17757 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.930+0000 7f69d9752740 1 -- 172.21.15.92:0/4235466837 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c88c30da0 con 0x560c888cf9f0 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.931+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560c888cf9f0 0x560c88cd9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.931+0000 7f69abfff640 10 client.17757 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.931+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560c888cf9f0 0x560c88cd9f80 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffb117ec887309ec server_cookie=94a8812c32d18065 in_seq=0 out_seq=0 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69abfff640 1 -- 172.21.15.92:0/4235466837 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c88c30da0 con 0x560c888cf9f0 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69abfff640 10 client.17757 handle_command_reply: tid=0 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 client.17757 shutdown 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 -- 172.21.15.92:0/4235466837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 msgr2=0x560c88cc81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cc81f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f69b40cdeb0 tx=0x7f69b410bf90 comp rx=0 tx=0).stop 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 -- 172.21.15.92:0/4235466837 shutdown_connections 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560c888cf9f0 0x560c88cd9f80 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88cc8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69abfff640 0 client.17757 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cc81f0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 --2- 172.21.15.92:0/4235466837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888e81b0 0x560c88cc7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 -- 172.21.15.92:0/4235466837 >> 172.21.15.92:0/4235466837 conn(0x560c88905460 msgr2=0x560c88cb4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 -- 172.21.15.92:0/4235466837 shutdown_connections 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 1 -- 172.21.15.92:0/4235466837 wait complete. 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.932+0000 7f69d9752740 20 client.17757 trim_cache size 0 max 16384 2024-09-21T07:20:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.949+0000 7f69d9752740 1 Processor -- start 2024-09-21T07:20:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.949+0000 7f69d9752740 1 -- start start 2024-09-21T07:20:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d9752740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c888e81b0 0x560c88cb9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d9752740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888f0390 0x560c88cc98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d9752740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c88911070 0x560c88cc4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d9752740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc1aedc0 con 0x560c88911070 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d9752740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc1b0900 con 0x560c888e81b0 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d9752740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc1af490 con 0x560c888f0390 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d177b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c88911070 0x560c88cc4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d177b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c88911070 0x560c88cc4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45386/0 (socket says 172.21.15.92:45386) 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d177b640 1 -- 172.21.15.92:0/4188665597 learned_addr learned my addr 172.21.15.92:0/4188665597 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69cbfff640 1 --2- 172.21.15.92:0/4188665597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888f0390 0x560c88cc98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/4188665597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c888e81b0 0x560c88cb9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d177b640 1 -- 172.21.15.92:0/4188665597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888f0390 msgr2=0x560c88cc98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d177b640 1 --2- 172.21.15.92:0/4188665597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888f0390 0x560c88cc98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d177b640 1 -- 172.21.15.92:0/4188665597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c888e81b0 msgr2=0x560c88cb9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d177b640 1 --2- 172.21.15.92:0/4188665597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c888e81b0 0x560c88cb9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d177b640 1 -- 172.21.15.92:0/4188665597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c88cb9060 con 0x560c88911070 2024-09-21T07:20:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.950+0000 7f69d177b640 1 --2- 172.21.15.92:0/4188665597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c88911070 0x560c88cc4ea0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f69c4010b20 tx=0x7f69c400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d579d2f88c2f90cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.951+0000 7f69c27fc640 1 -- 172.21.15.92:0/4188665597 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c401c030 con 0x560c88911070 2024-09-21T07:20:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.951+0000 7f69c27fc640 1 -- 172.21.15.92:0/4188665597 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69c4027070 con 0x560c88911070 2024-09-21T07:20:49.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.951+0000 7f69c27fc640 1 -- 172.21.15.92:0/4188665597 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4022420 con 0x560c88911070 2024-09-21T07:20:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.951+0000 7f69d9752740 1 -- 172.21.15.92:0/4188665597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c88911070 msgr2=0x560c88cc4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.951+0000 7f69d9752740 1 --2- 172.21.15.92:0/4188665597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c88911070 0x560c88cc4ea0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f69c4010b20 tx=0x7f69c400bf90 comp rx=0 tx=0).stop 2024-09-21T07:20:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 -- 172.21.15.92:0/4188665597 shutdown_connections 2024-09-21T07:20:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 --2- 172.21.15.92:0/4188665597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c88911070 0x560c88cc4ea0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 --2- 172.21.15.92:0/4188665597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888f0390 0x560c88cc98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 --2- 172.21.15.92:0/4188665597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c888e81b0 0x560c88cb9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 -- 172.21.15.92:0/4188665597 >> 172.21.15.92:0/4188665597 conn(0x560c88905460 msgr2=0x560c88cc91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 -- 172.21.15.92:0/4188665597 shutdown_connections 2024-09-21T07:20:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 -- 172.21.15.92:0/4188665597 wait complete. 2024-09-21T07:20:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 -- start start 2024-09-21T07:20:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 Processor -- start 2024-09-21T07:20:49.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888e81b0 0x560c88ccc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.952+0000 7f69d9752740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88d43980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69d9752740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc1b0230 con 0x560c888f0390 2024-09-21T07:20:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69d9752740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc1afb60 con 0x560c88911070 2024-09-21T07:20:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69d9752740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc1acdc0 con 0x560c888e81b0 2024-09-21T07:20:49.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69d9752740 10 client.0 _ll_register_callbacks cb 0x7f69b4005ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45400/0 (socket says 172.21.15.92:45400) 2024-09-21T07:20:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69cbfff640 1 -- 172.21.15.92:0/1549667660 learned_addr learned my addr 172.21.15.92:0/1549667660 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888e81b0 0x560c88ccc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69d177b640 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88d43980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69cbfff640 1 -- 172.21.15.92:0/1549667660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888e81b0 msgr2=0x560c88ccc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:49.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69cbfff640 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888e81b0 0x560c88ccc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69cbfff640 1 -- 172.21.15.92:0/1549667660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 msgr2=0x560c88d43980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:49.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69cbfff640 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88d43980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69cbfff640 1 -- 172.21.15.92:0/1549667660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c88d43f70 con 0x560c888f0390 2024-09-21T07:20:49.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69cbfff640 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cccd50 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f69b403d040 tx=0x7f69b410bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2813abd9a7665d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:49.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69abfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:49.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69abfff640 1 -- 172.21.15.92:0/1549667660 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b40b9030 con 0x560c888f0390 2024-09-21T07:20:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69abfff640 1 -- 172.21.15.92:0/1549667660 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f69b4108120 con 0x560c888f0390 2024-09-21T07:20:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.953+0000 7f69d9752740 1 -- 172.21.15.92:0/1549667660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69c4027070 con 0x560c888f0390 2024-09-21T07:20:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69abfff640 1 -- 172.21.15.92:0/1549667660 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f69b4049040 con 0x560c888f0390 2024-09-21T07:20:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69d9752740 10 client.17763 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69d9752740 1 -- 172.21.15.92:0/1549667660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560c88d451e0 con 0x560c888f0390 2024-09-21T07:20:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69abfff640 1 -- 172.21.15.92:0/1549667660 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69c4027070 con 0x560c888f0390 2024-09-21T07:20:49.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69abfff640 1 -- 172.21.15.92:0/1549667660 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f69b40d1070 con 0x560c888f0390 2024-09-21T07:20:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69d9752740 10 client.17763 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69d9752740 10 client.17763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:20:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69d9752740 20 client.17763 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69d9752740 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560c888a4da0 0x560c88d47800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69d9752740 4 client.17763 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:20:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69d9752740 1 -- 172.21.15.92:0/1549667660 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560c88cba8d0 con 0x560c888a4da0 2024-09-21T07:20:49.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.954+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560c888a4da0 0x560c88d47800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d0f7a640 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560c888a4da0 0x560c88d47800 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c42262ca4e024d server_cookie=c34574357c8e50c1 in_seq=0 out_seq=0 2024-09-21T07:20:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69abfff640 10 client.17763 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69abfff640 1 -- 172.21.15.92:0/1549667660 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x560c88cba8d0 con 0x560c888a4da0 2024-09-21T07:20:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69abfff640 10 client.17763 handle_command_reply: tid=0 2024-09-21T07:20:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 client.17763 shutdown 2024-09-21T07:20:49.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 -- 172.21.15.92:0/1549667660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 msgr2=0x560c88cccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cccd50 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f69b403d040 tx=0x7f69b410bbe0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 -- 172.21.15.92:0/1549667660 shutdown_connections 2024-09-21T07:20:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x560c888a4da0 0x560c88d47800 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69abfff640 0 client.17763 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:20:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c88911070 0x560c88d43980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560c888f0390 0x560c88cccd50 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 --2- 172.21.15.92:0/1549667660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c888e81b0 0x560c88ccc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 -- 172.21.15.92:0/1549667660 >> 172.21.15.92:0/1549667660 conn(0x560c88905460 msgr2=0x560c88cb9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 -- 172.21.15.92:0/1549667660 shutdown_connections 2024-09-21T07:20:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 1 -- 172.21.15.92:0/1549667660 wait complete. 2024-09-21T07:20:49.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.955+0000 7f69d9752740 20 client.17763 trim_cache size 0 max 16384 2024-09-21T07:20:49.969 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:20:49.969 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:20:49.969 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:20:49.969 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:20:49.969 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:20:49.969 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:20:49.970 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:49.970 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:49.970 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:49.970 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:49.970 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:49.970 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:49.970 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:20:49.971 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:20:49.971 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:49.971 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:49.971 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:49.971 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:49.971 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:49.972 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:49.972 INFO:teuthology.orchestra.run.smithi092.stdout: "3b742b30-fd49-4ec5-844d-6cfbec3bbf45": { 2024-09-21T07:20:49.972 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:48.290915+0000", 2024-09-21T07:20:49.972 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:49.972 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:49.972 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:49.972 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:49.972 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:49.972 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:49.972 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:49.973 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:02.985669+0000", 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:49.974 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:20:49.975 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:20:49.976 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:20:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 -- 172.21.15.92:0/1473003789 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69b80b6680 msgr2=0x7f69b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69b80b6680 0x7f69b80b8b90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f69c400bad0 tx=0x7f69c4008040 comp rx=0 tx=0).stop 2024-09-21T07:20:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 -- 172.21.15.92:0/1473003789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69cc1094b0 msgr2=0x7f69cc19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69cc1094b0 0x7f69cc19aba0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f69b4005940 tx=0x7f69b40042f0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 -- 172.21.15.92:0/1473003789 shutdown_connections 2024-09-21T07:20:49.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69b80b6680 0x7f69b80b8b90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69cc109e00 0x7f69cc19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69cc1094b0 0x7f69cc19aba0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 --2- 172.21.15.92:0/1473003789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69cc103bc0 0x7f69cc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 -- 172.21.15.92:0/1473003789 >> 172.21.15.92:0/1473003789 conn(0x7f69cc07b910 msgr2=0x7f69cc107740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 -- 172.21.15.92:0/1473003789 shutdown_connections 2024-09-21T07:20:49.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:49.956+0000 7f69d31de640 1 -- 172.21.15.92:0/1473003789 wait complete. 2024-09-21T07:20:50.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:49 smithi092 ceph-mon[30987]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-21T07:20:50.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:49 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:20:50.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:49 smithi175 ceph-mon[34064]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-21T07:20:50.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:49 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:20:50.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:49 smithi169 ceph-mon[33705]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-21T07:20:50.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:49 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:20:50.844 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:20:50.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:20:51.092 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.598+0000 7fabaceeb640 1 -- 172.21.15.92:0/2825592678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba81083d0 msgr2=0x7faba81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.598+0000 7fabaceeb640 1 --2- 172.21.15.92:0/2825592678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba81083d0 0x7faba81087e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009900 tx=0x7fab9c02a410 comp rx=0 tx=0).stop 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.598+0000 7fabaceeb640 1 -- 172.21.15.92:0/2825592678 shutdown_connections 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.598+0000 7fabaceeb640 1 --2- 172.21.15.92:0/2825592678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba8108d20 0x7faba810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.598+0000 7fabaceeb640 1 --2- 172.21.15.92:0/2825592678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba81083d0 0x7faba81087e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.598+0000 7fabaceeb640 1 --2- 172.21.15.92:0/2825592678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba8102a90 0x7faba8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.598+0000 7fabaceeb640 1 -- 172.21.15.92:0/2825592678 >> 172.21.15.92:0/2825592678 conn(0x7faba8079750 msgr2=0x7faba8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.598+0000 7fabaceeb640 1 -- 172.21.15.92:0/2825592678 shutdown_connections 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.598+0000 7fabaceeb640 1 -- 172.21.15.92:0/2825592678 wait complete. 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.599+0000 7fabaceeb640 1 Processor -- start 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.599+0000 7fabaceeb640 1 -- start start 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7fabaceeb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba8102a90 0x7faba8199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7fabaceeb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba81083d0 0x7faba81997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7fabaceeb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba8108d20 0x7faba819ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7fabaceeb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faba8112840 con 0x7faba81083d0 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7fabaceeb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faba81126c0 con 0x7faba8102a90 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7fabaceeb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faba81129c0 con 0x7faba8108d20 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba81083d0 0x7faba81997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba81083d0 0x7faba81997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45416/0 (socket says 172.21.15.92:45416) 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba5d9b640 1 -- 172.21.15.92:0/4109230572 learned_addr learned my addr 172.21.15.92:0/4109230572 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba6d9d640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba8108d20 0x7faba819ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba659c640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba8102a90 0x7faba8199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba5d9b640 1 -- 172.21.15.92:0/4109230572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba8108d20 msgr2=0x7faba819ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba5d9b640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba8108d20 0x7faba819ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba5d9b640 1 -- 172.21.15.92:0/4109230572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba8102a90 msgr2=0x7faba8199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba5d9b640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba8102a90 0x7faba8199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba5d9b640 1 -- 172.21.15.92:0/4109230572 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba819f1c0 con 0x7faba81083d0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba659c640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba8102a90 0x7faba8199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.600+0000 7faba5d9b640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba81083d0 0x7faba81997f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fab9c005940 tx=0x7fab9c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.601+0000 7fab977fe640 1 -- 172.21.15.92:0/4109230572 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c03f030 con 0x7faba81083d0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.601+0000 7fabaceeb640 1 -- 172.21.15.92:0/4109230572 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba819f450 con 0x7faba81083d0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.601+0000 7fab977fe640 1 -- 172.21.15.92:0/4109230572 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab9c003c90 con 0x7faba81083d0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.601+0000 7fab977fe640 1 -- 172.21.15.92:0/4109230572 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c035070 con 0x7faba81083d0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.601+0000 7fabaceeb640 1 -- 172.21.15.92:0/4109230572 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba81a5c10 con 0x7faba81083d0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.602+0000 7fabaceeb640 1 -- 172.21.15.92:0/4109230572 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba8103d10 con 0x7faba81083d0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.603+0000 7fab977fe640 1 -- 172.21.15.92:0/4109230572 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fab9c042030 con 0x7faba81083d0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.604+0000 7fab977fe640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab900b6680 0x7fab900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.604+0000 7faba659c640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab900b6680 0x7fab900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.604+0000 7fab977fe640 1 -- 172.21.15.92:0/4109230572 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fab9c108480 con 0x7faba81083d0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.605+0000 7faba659c640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab900b6680 0x7fab900b8b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fab980058c0 tx=0x7fab98005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.607+0000 7fab977fe640 1 -- 172.21.15.92:0/4109230572 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab9c0ce5d0 con 0x7faba81083d0 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.822+0000 7fabaceeb640 1 -- 172.21.15.92:0/4109230572 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faba8102ea0 con 0x7faba81083d0 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.823+0000 7fab977fe640 1 -- 172.21.15.92:0/4109230572 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7fab9c0d29b0 con 0x7faba81083d0 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 -- 172.21.15.92:0/4109230572 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab900b6680 msgr2=0x7fab900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab900b6680 0x7fab900b8b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fab980058c0 tx=0x7fab98005850 comp rx=0 tx=0).stop 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 -- 172.21.15.92:0/4109230572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba81083d0 msgr2=0x7faba81997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba81083d0 0x7faba81997f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fab9c005940 tx=0x7fab9c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 -- 172.21.15.92:0/4109230572 shutdown_connections 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fab900b6680 0x7fab900b8b90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faba8108d20 0x7faba819ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faba81083d0 0x7faba81997f0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 --2- 172.21.15.92:0/4109230572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba8102a90 0x7faba8199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 -- 172.21.15.92:0/4109230572 >> 172.21.15.92:0/4109230572 conn(0x7faba8079750 msgr2=0x7faba81015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.825+0000 7fabaceeb640 1 -- 172.21.15.92:0/4109230572 shutdown_connections 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:51.826+0000 7fabaceeb640 1 -- 172.21.15.92:0/4109230572 wait complete. 2024-09-21T07:20:52.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:51 smithi092 ceph-mon[30987]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-09-21T07:20:52.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:51 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4109230572' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:20:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:51 smithi169 ceph-mon[33705]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-09-21T07:20:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:51 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/4109230572' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:20:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:51 smithi175 ceph-mon[34064]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-09-21T07:20:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:51 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/4109230572' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:20:52.579 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:53.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.428+0000 7f2937d4d640 1 -- 172.21.15.92:0/2271429138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2930105310 msgr2=0x7f293010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:53.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.428+0000 7f2937d4d640 1 --2- 172.21.15.92:0/2271429138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2930105310 0x7f293010d950 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f2920009900 tx=0x7f292002a410 comp rx=0 tx=0).stop 2024-09-21T07:20:53.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.428+0000 7f2937d4d640 1 -- 172.21.15.92:0/2271429138 shutdown_connections 2024-09-21T07:20:53.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.428+0000 7f2937d4d640 1 --2- 172.21.15.92:0/2271429138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f293010de90 0x7f2930110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.428+0000 7f2937d4d640 1 --2- 172.21.15.92:0/2271429138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2930105310 0x7f293010d950 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.428+0000 7f2937d4d640 1 --2- 172.21.15.92:0/2271429138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29301048e0 0x7f2930104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.428+0000 7f2937d4d640 1 -- 172.21.15.92:0/2271429138 >> 172.21.15.92:0/2271429138 conn(0x7f2930079770 msgr2=0x7f2930079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:53.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.429+0000 7f2937d4d640 1 -- 172.21.15.92:0/2271429138 shutdown_connections 2024-09-21T07:20:53.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.429+0000 7f2937d4d640 1 -- 172.21.15.92:0/2271429138 wait complete. 2024-09-21T07:20:53.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.429+0000 7f2937d4d640 1 Processor -- start 2024-09-21T07:20:53.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.429+0000 7f2937d4d640 1 -- start start 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.429+0000 7f2937d4d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29301048e0 0x7f29301027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.429+0000 7f2937d4d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930105310 0x7f2930102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.429+0000 7f2937d4d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f293010de90 0x7f2930103270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.429+0000 7f2937d4d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29301139a0 con 0x7f293010de90 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.429+0000 7f2937d4d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2930113820 con 0x7f2930105310 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.429+0000 7f2937d4d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2930113b20 con 0x7f29301048e0 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29362ea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f293010de90 0x7f2930103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29362ea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f293010de90 0x7f2930103270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45428/0 (socket says 172.21.15.92:45428) 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29362ea640 1 -- 172.21.15.92:0/2944250677 learned_addr learned my addr 172.21.15.92:0/2944250677 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29352e8640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930105310 0x7f2930102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f2935ae9640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29301048e0 0x7f29301027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29362ea640 1 -- 172.21.15.92:0/2944250677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29301048e0 msgr2=0x7f29301027f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:53.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29362ea640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29301048e0 0x7f29301027f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29362ea640 1 -- 172.21.15.92:0/2944250677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930105310 msgr2=0x7f2930102d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29362ea640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930105310 0x7f2930102d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29362ea640 1 -- 172.21.15.92:0/2944250677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29301a8730 con 0x7f293010de90 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29352e8640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930105310 0x7f2930102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f2935ae9640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29301048e0 0x7f29301027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f29362ea640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f293010de90 0x7f2930103270 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f292800cad0 tx=0x7f292800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f2926ffd640 1 -- 172.21.15.92:0/2944250677 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292800ae20 con 0x7f293010de90 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f2937d4d640 1 -- 172.21.15.92:0/2944250677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29301a8a20 con 0x7f293010de90 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f2926ffd640 1 -- 172.21.15.92:0/2944250677 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2928005020 con 0x7f293010de90 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f2926ffd640 1 -- 172.21.15.92:0/2944250677 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292800f6b0 con 0x7f293010de90 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.430+0000 7f2937d4d640 1 -- 172.21.15.92:0/2944250677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29301a8f30 con 0x7f293010de90 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.433+0000 7f293e2c1740 1 Processor -- start 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.433+0000 7f2926ffd640 1 -- 172.21.15.92:0/2944250677 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f29280051d0 con 0x7f293010de90 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.433+0000 7f293e2c1740 1 -- start start 2024-09-21T07:20:53.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.433+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84329d070 0x55e8436446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.433+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8432741b0 0x55e843644be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.433+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84327c390 0x55e843645120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.433+0000 7f293e2c1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e8435baea0 con 0x55e84327c390 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.433+0000 7f293e2c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e8435aa2d0 con 0x55e84329d070 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.433+0000 7f293e2c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e8435ae0e0 con 0x55e8432741b0 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29352e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84327c390 0x55e843645120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29352e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84327c390 0x55e843645120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45438/0 (socket says 172.21.15.92:45438) 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29352e8640 1 -- 172.21.15.92:0/1705040021 learned_addr learned my addr 172.21.15.92:0/1705040021 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29352e8640 1 --2- 172.21.15.92:0/1705040021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84329d070 0x55e8436446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f2935ae9640 1 --2- 172.21.15.92:0/1705040021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8432741b0 0x55e843644be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29352e8640 1 -- 172.21.15.92:0/1705040021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8432741b0 msgr2=0x55e843644be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29352e8640 1 --2- 172.21.15.92:0/1705040021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8432741b0 0x55e843644be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f2926ffd640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f291c0b6680 0x7f291c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29352e8640 1 -- 172.21.15.92:0/1705040021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84329d070 msgr2=0x55e8436446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29352e8640 1 --2- 172.21.15.92:0/1705040021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84329d070 0x55e8436446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29352e8640 1 -- 172.21.15.92:0/1705040021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e843308650 con 0x55e84327c390 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29362ea640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f291c0b6680 0x7f291c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f29352e8640 1 --2- 172.21.15.92:0/1705040021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84327c390 0x55e843645120 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2920000c00 tx=0x7f2920005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8159007f6efd71ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f2926ffd640 1 -- 172.21.15.92:0/2944250677 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f29280e7f20 con 0x7f293010de90 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f291bfff640 1 -- 172.21.15.92:0/1705040021 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920035050 con 0x55e84327c390 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f291bfff640 1 -- 172.21.15.92:0/1705040021 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29200316e0 con 0x55e84327c390 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.434+0000 7f291bfff640 1 -- 172.21.15.92:0/1705040021 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920005240 con 0x55e84327c390 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.435+0000 7f293e2c1740 1 -- 172.21.15.92:0/1705040021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84327c390 msgr2=0x55e843645120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.435+0000 7f293e2c1740 1 --2- 172.21.15.92:0/1705040021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84327c390 0x55e843645120 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2920000c00 tx=0x7f2920005d50 comp rx=0 tx=0).stop 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.435+0000 7f29362ea640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f291c0b6680 0x7f291c0b8b90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f29280e5870 tx=0x7f2928079040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.435+0000 7f293e2c1740 1 -- 172.21.15.92:0/1705040021 shutdown_connections 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.435+0000 7f293e2c1740 1 --2- 172.21.15.92:0/1705040021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84327c390 0x55e843645120 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.435+0000 7f293e2c1740 1 --2- 172.21.15.92:0/1705040021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8432741b0 0x55e843644be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.435+0000 7f293e2c1740 1 --2- 172.21.15.92:0/1705040021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84329d070 0x55e8436446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.435+0000 7f293e2c1740 1 -- 172.21.15.92:0/1705040021 >> 172.21.15.92:0/1705040021 conn(0x55e843291460 msgr2=0x55e843642590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.435+0000 7f293e2c1740 1 -- 172.21.15.92:0/1705040021 shutdown_connections 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.435+0000 7f293e2c1740 1 -- 172.21.15.92:0/1705040021 wait complete. 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.436+0000 7f293e2c1740 1 -- start start 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.436+0000 7f293e2c1740 1 Processor -- start 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8432741b0 0x55e84364fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84327c390 0x55e843650280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e84365c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f293e2c1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e84340b700 con 0x55e84329d070 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f293e2c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e843545160 con 0x55e8432741b0 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f293e2c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e843652e20 con 0x55e84327c390 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f293e2c1740 10 client.0 _ll_register_callbacks cb 0x55e84355e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29352e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e84365c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29352e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e84365c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45448/0 (socket says 172.21.15.92:45448) 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29352e8640 1 -- 172.21.15.92:0/191236408 learned_addr learned my addr 172.21.15.92:0/191236408 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29352e8640 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8432741b0 0x55e84364fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f2935ae9640 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84327c390 0x55e843650280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29352e8640 1 -- 172.21.15.92:0/191236408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84327c390 msgr2=0x55e843650280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29352e8640 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84327c390 0x55e843650280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29352e8640 1 -- 172.21.15.92:0/191236408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8432741b0 msgr2=0x55e84364fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29352e8640 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8432741b0 0x55e84364fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29352e8640 1 -- 172.21.15.92:0/191236408 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e843572c90 con 0x55e84329d070 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29352e8640 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e84365c170 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x55e843634740 tx=0x7f2920005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2022b4130ed15e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29197fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.437+0000 7f29197fa640 1 -- 172.21.15.92:0/191236408 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920035040 con 0x55e84329d070 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f29197fa640 1 -- 172.21.15.92:0/191236408 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f2920005480 con 0x55e84329d070 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f293e2c1740 1 -- 172.21.15.92:0/191236408 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29200316e0 con 0x55e84329d070 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f29197fa640 1 -- 172.21.15.92:0/191236408 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29200046c0 con 0x55e84329d070 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f293e2c1740 10 client.17781 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f293e2c1740 1 -- 172.21.15.92:0/191236408 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e84365eb50 con 0x55e84329d070 2024-09-21T07:20:53.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f29197fa640 1 -- 172.21.15.92:0/191236408 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29200316e0 con 0x55e84329d070 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f29197fa640 1 -- 172.21.15.92:0/191236408 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f29200321c0 con 0x55e84329d070 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f293e2c1740 10 client.17781 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f293e2c1740 10 client.17781 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f293e2c1740 20 client.17781 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f293e2c1740 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55e84325b9f0 0x55e843661eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f293e2c1740 4 client.17781 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.438+0000 7f293e2c1740 1 -- 172.21.15.92:0/191236408 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8435bcdf0 con 0x55e84325b9f0 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.439+0000 7f2935ae9640 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55e84325b9f0 0x55e843661eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.439+0000 7f2935ae9640 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55e84325b9f0 0x55e843661eb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=33fd1bbd8c5cb5e7 server_cookie=6a72bcb37bbc1bd2 in_seq=0 out_seq=0 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.439+0000 7f29197fa640 10 client.17781 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f29197fa640 1 -- 172.21.15.92:0/191236408 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8435bcdf0 con 0x55e84325b9f0 2024-09-21T07:20:53.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f29197fa640 10 client.17781 handle_command_reply: tid=0 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 client.17781 shutdown 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 -- 172.21.15.92:0/191236408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 msgr2=0x55e84365c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e84365c170 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x55e843634740 tx=0x7f2920005a20 comp rx=0 tx=0).stop 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 -- 172.21.15.92:0/191236408 shutdown_connections 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55e84325b9f0 0x55e843661eb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e84365c170 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84327c390 0x55e843650280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 --2- 172.21.15.92:0/191236408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8432741b0 0x55e84364fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f29197fa640 0 client.17781 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 -- 172.21.15.92:0/191236408 >> 172.21.15.92:0/191236408 conn(0x55e843291460 msgr2=0x55e843647830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 -- 172.21.15.92:0/191236408 shutdown_connections 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.440+0000 7f293e2c1740 1 -- 172.21.15.92:0/191236408 wait complete. 2024-09-21T07:20:53.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.441+0000 7f293e2c1740 20 client.17781 trim_cache size 0 max 16384 2024-09-21T07:20:53.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f293e2c1740 1 Processor -- start 2024-09-21T07:20:53.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f293e2c1740 1 -- start start 2024-09-21T07:20:53.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8432741b0 0x55e843651970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84327c390 0x55e843641bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84329d070 0x55e843642100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f293e2c1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29301b31b0 con 0x55e8432741b0 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f293e2c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29301b4cf0 con 0x55e84327c390 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f293e2c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29301b3880 con 0x55e84329d070 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f29352e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8432741b0 0x55e843651970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f29352e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8432741b0 0x55e843651970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45452/0 (socket says 172.21.15.92:45452) 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f29352e8640 1 -- 172.21.15.92:0/795862361 learned_addr learned my addr 172.21.15.92:0/795862361 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f2935ae9640 1 --2- 172.21.15.92:0/795862361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84327c390 0x55e843641bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f29352e8640 1 --2- 172.21.15.92:0/795862361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84329d070 0x55e843642100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f29352e8640 1 -- 172.21.15.92:0/795862361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84329d070 msgr2=0x55e843642100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f29352e8640 1 --2- 172.21.15.92:0/795862361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84329d070 0x55e843642100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f29352e8640 1 -- 172.21.15.92:0/795862361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84327c390 msgr2=0x55e843641bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:53.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f29352e8640 1 --2- 172.21.15.92:0/795862361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84327c390 0x55e843641bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f29352e8640 1 -- 172.21.15.92:0/795862361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e843646990 con 0x55e8432741b0 2024-09-21T07:20:53.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.454+0000 7f29352e8640 1 --2- 172.21.15.92:0/795862361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8432741b0 0x55e843651970 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2920005ab0 tx=0x7f292002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692b33b181f279ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:53.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.455+0000 7f291b7fe640 1 -- 172.21.15.92:0/795862361 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920035070 con 0x55e8432741b0 2024-09-21T07:20:53.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.455+0000 7f291b7fe640 1 -- 172.21.15.92:0/795862361 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2920005d50 con 0x55e8432741b0 2024-09-21T07:20:53.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.455+0000 7f291b7fe640 1 -- 172.21.15.92:0/795862361 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920004860 con 0x55e8432741b0 2024-09-21T07:20:53.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.455+0000 7f293e2c1740 1 -- 172.21.15.92:0/795862361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8432741b0 msgr2=0x55e843651970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:53.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.455+0000 7f293e2c1740 1 --2- 172.21.15.92:0/795862361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8432741b0 0x55e843651970 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2920005ab0 tx=0x7f292002a410 comp rx=0 tx=0).stop 2024-09-21T07:20:53.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.455+0000 7f293e2c1740 1 -- 172.21.15.92:0/795862361 shutdown_connections 2024-09-21T07:20:53.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.455+0000 7f293e2c1740 1 --2- 172.21.15.92:0/795862361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e84329d070 0x55e843642100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.455+0000 7f293e2c1740 1 --2- 172.21.15.92:0/795862361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84327c390 0x55e843641bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.455+0000 7f293e2c1740 1 --2- 172.21.15.92:0/795862361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8432741b0 0x55e843651970 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.455+0000 7f293e2c1740 1 -- 172.21.15.92:0/795862361 >> 172.21.15.92:0/795862361 conn(0x55e843291460 msgr2=0x55e843651260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:53.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.456+0000 7f293e2c1740 1 -- 172.21.15.92:0/795862361 shutdown_connections 2024-09-21T07:20:53.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.456+0000 7f293e2c1740 1 -- 172.21.15.92:0/795862361 wait complete. 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.456+0000 7f293e2c1740 1 -- start start 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.456+0000 7f293e2c1740 1 Processor -- start 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.456+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8432741b0 0x55e843665920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.456+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84327c390 0x55e843662e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.456+0000 7f293e2c1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e843663580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.456+0000 7f293e2c1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29301b4620 con 0x55e84329d070 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.456+0000 7f293e2c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29301b3f50 con 0x55e84327c390 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.456+0000 7f293e2c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29301b11b0 con 0x55e8432741b0 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f293e2c1740 10 client.0 _ll_register_callbacks cb 0x7f2920031490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29352e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e843663580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29352e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e843663580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45458/0 (socket says 172.21.15.92:45458) 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29352e8640 1 -- 172.21.15.92:0/1897163636 learned_addr learned my addr 172.21.15.92:0/1897163636 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f2935ae9640 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84327c390 0x55e843662e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29352e8640 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8432741b0 0x55e843665920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29352e8640 1 -- 172.21.15.92:0/1897163636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8432741b0 msgr2=0x55e843665920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29352e8640 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8432741b0 0x55e843665920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29352e8640 1 -- 172.21.15.92:0/1897163636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84327c390 msgr2=0x55e843662e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29352e8640 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84327c390 0x55e843662e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29352e8640 1 -- 172.21.15.92:0/1897163636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8436cb630 con 0x55e84329d070 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29352e8640 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e843663580 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f2920031460 tx=0x7f2920009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd17d6ce9bd3781d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29197fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29197fa640 1 -- 172.21.15.92:0/1897163636 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920064060 con 0x55e84329d070 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29197fa640 1 -- 172.21.15.92:0/1897163636 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f2920031e10 con 0x55e84329d070 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f293e2c1740 1 -- 172.21.15.92:0/1897163636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2920005d50 con 0x55e84329d070 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f29197fa640 1 -- 172.21.15.92:0/1897163636 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2920035070 con 0x55e84329d070 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f293e2c1740 10 client.17787 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.457+0000 7f293e2c1740 1 -- 172.21.15.92:0/1897163636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e8436cc7c0 con 0x55e84329d070 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.458+0000 7f29197fa640 1 -- 172.21.15.92:0/1897163636 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2920005d50 con 0x55e84329d070 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.458+0000 7f29197fa640 1 -- 172.21.15.92:0/1897163636 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2920067080 con 0x55e84329d070 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.458+0000 7f293e2c1740 10 client.17787 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:53.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.458+0000 7f293e2c1740 10 client.17787 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.458+0000 7f293e2c1740 20 client.17787 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.458+0000 7f293e2c1740 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55e843230da0 0x55e8436cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.458+0000 7f293e2c1740 4 client.17787 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.458+0000 7f293e2c1740 1 -- 172.21.15.92:0/1897163636 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e8435b88a0 con 0x55e843230da0 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.458+0000 7f2935ae9640 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55e843230da0 0x55e8436cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f29197fa640 10 client.17787 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f2935ae9640 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55e843230da0 0x55e8436cebf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cb7a90ae097a3d81 server_cookie=88950b934003e922 in_seq=0 out_seq=0 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f29197fa640 1 -- 172.21.15.92:0/1897163636 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e8435b88a0 con 0x55e843230da0 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f29197fa640 10 client.17787 handle_command_reply: tid=0 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 client.17787 shutdown 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 -- 172.21.15.92:0/1897163636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 msgr2=0x55e843663580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e843663580 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f2920031460 tx=0x7f2920009800 comp rx=0 tx=0).stop 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 -- 172.21.15.92:0/1897163636 shutdown_connections 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55e843230da0 0x55e8436cebf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e84329d070 0x55e843663580 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e84327c390 0x55e843662e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f29197fa640 0 client.17787 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:20:53.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 --2- 172.21.15.92:0/1897163636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8432741b0 0x55e843665920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 -- 172.21.15.92:0/1897163636 >> 172.21.15.92:0/1897163636 conn(0x55e843291460 msgr2=0x55e8436511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:53.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 -- 172.21.15.92:0/1897163636 shutdown_connections 2024-09-21T07:20:53.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 1 -- 172.21.15.92:0/1897163636 wait complete. 2024-09-21T07:20:53.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.459+0000 7f293e2c1740 20 client.17787 trim_cache size 0 max 16384 2024-09-21T07:20:53.466 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:20:53.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 -- 172.21.15.92:0/2944250677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f291c0b6680 msgr2=0x7f291c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:53.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f291c0b6680 0x7f291c0b8b90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f29280e5870 tx=0x7f2928079040 comp rx=0 tx=0).stop 2024-09-21T07:20:53.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 -- 172.21.15.92:0/2944250677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f293010de90 msgr2=0x7f2930103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:53.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f293010de90 0x7f2930103270 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f292800cad0 tx=0x7f292800cf90 comp rx=0 tx=0).stop 2024-09-21T07:20:53.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 -- 172.21.15.92:0/2944250677 shutdown_connections 2024-09-21T07:20:53.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f291c0b6680 0x7f291c0b8b90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f293010de90 0x7f2930103270 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2930105310 0x7f2930102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 --2- 172.21.15.92:0/2944250677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29301048e0 0x7f29301027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:53.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 -- 172.21.15.92:0/2944250677 >> 172.21.15.92:0/2944250677 conn(0x7f2930079770 msgr2=0x7f29300ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:53.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 -- 172.21.15.92:0/2944250677 shutdown_connections 2024-09-21T07:20:53.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:53.460+0000 7f2937d4d640 1 -- 172.21.15.92:0/2944250677 wait complete. 2024-09-21T07:20:54.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:53 smithi092 ceph-mon[30987]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 11 op/s 2024-09-21T07:20:54.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:53 smithi169 ceph-mon[33705]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 11 op/s 2024-09-21T07:20:54.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:53 smithi175 ceph-mon[34064]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 11 op/s 2024-09-21T07:20:54.297 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:20:54.544 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:55.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 -- 172.21.15.92:0/589992000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f427410de10 msgr2=0x7f4274110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 --2- 172.21.15.92:0/589992000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f427410de10 0x7f4274110300 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f426c009ca0 tx=0x7f426c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 -- 172.21.15.92:0/589992000 shutdown_connections 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 --2- 172.21.15.92:0/589992000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f427410de10 0x7f4274110300 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 --2- 172.21.15.92:0/589992000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4274105300 0x7f427410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 --2- 172.21.15.92:0/589992000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42741049b0 0x7f4274104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 -- 172.21.15.92:0/589992000 >> 172.21.15.92:0/589992000 conn(0x7f4274079720 msgr2=0x7f4274079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 -- 172.21.15.92:0/589992000 shutdown_connections 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 -- 172.21.15.92:0/589992000 wait complete. 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 Processor -- start 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.038+0000 7f427bdbf640 1 -- start start 2024-09-21T07:20:55.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427bdbf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42741049b0 0x7f427419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427bdbf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4274105300 0x7f427419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427bdbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f427410de10 0x7f427419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427bdbf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4274113990 con 0x7f427410de10 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427bdbf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4274113810 con 0x7f42741049b0 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427bdbf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4274113b10 con 0x7f4274105300 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427a35c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f427410de10 0x7f427419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427a35c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f427410de10 0x7f427419fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45476/0 (socket says 172.21.15.92:45476) 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427a35c640 1 -- 172.21.15.92:0/4264206920 learned_addr learned my addr 172.21.15.92:0/4264206920 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427935a640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4274105300 0x7f427419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f4279b5b640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42741049b0 0x7f427419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427a35c640 1 -- 172.21.15.92:0/4264206920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4274105300 msgr2=0x7f427419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427a35c640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4274105300 0x7f427419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427a35c640 1 -- 172.21.15.92:0/4264206920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42741049b0 msgr2=0x7f427419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:55.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427a35c640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42741049b0 0x7f427419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427a35c640 1 -- 172.21.15.92:0/4264206920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42741a02f0 con 0x7f427410de10 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f4279b5b640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42741049b0 0x7f427419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427a35c640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f427410de10 0x7f427419fbc0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f426c005cc0 tx=0x7f426c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f426affd640 1 -- 172.21.15.92:0/4264206920 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c032c10 con 0x7f427410de10 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f426affd640 1 -- 172.21.15.92:0/4264206920 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f426c032db0 con 0x7f427410de10 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f427bdbf640 1 -- 172.21.15.92:0/4264206920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42741a0580 con 0x7f427410de10 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.039+0000 7f426affd640 1 -- 172.21.15.92:0/4264206920 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c030a60 con 0x7f427410de10 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.040+0000 7f427bdbf640 1 -- 172.21.15.92:0/4264206920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42741a6d40 con 0x7f427410de10 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.042+0000 7f4282333740 1 Processor -- start 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.042+0000 7f426affd640 1 -- 172.21.15.92:0/4264206920 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f426c030c20 con 0x7f427410de10 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.042+0000 7f4282333740 1 -- start start 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4282333740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341dba070 0x5583421612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4282333740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x558342161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4282333740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x558342161d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4282333740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5583420d7ea0 con 0x558341d99390 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4282333740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5583420c72d0 con 0x558341d911b0 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4282333740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5583420cb0e0 con 0x558341dba070 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f427935a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x558342161d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4279b5b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x558342161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f427935a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x558342161d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45478/0 (socket says 172.21.15.92:45478) 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f427935a640 1 -- 172.21.15.92:0/2811485013 learned_addr learned my addr 172.21.15.92:0/2811485013 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f427935a640 1 --2- 172.21.15.92:0/2811485013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341dba070 0x5583421612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f426affd640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f42600b6680 0x7f42600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f427a35c640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f42600b6680 0x7f42600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4279b5b640 1 -- 172.21.15.92:0/2811485013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341dba070 msgr2=0x5583421612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4279b5b640 1 --2- 172.21.15.92:0/2811485013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341dba070 0x5583421612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4279b5b640 1 -- 172.21.15.92:0/2811485013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 msgr2=0x558342161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:55.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4279b5b640 1 --2- 172.21.15.92:0/2811485013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x558342161d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4279b5b640 1 -- 172.21.15.92:0/2811485013 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558341e25650 con 0x558341d911b0 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f427935a640 1 --2- 172.21.15.92:0/2811485013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x558342161d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f426affd640 1 -- 172.21.15.92:0/4264206920 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f426c108c80 con 0x7f427410de10 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.043+0000 7f4279b5b640 1 --2- 172.21.15.92:0/2811485013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x558342161800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4270009c00 tx=0x7f42700117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd47fa7d0c3443c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.044+0000 7f427a35c640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f42600b6680 0x7f42600b8b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f426c106080 tx=0x7f426c09a390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.044+0000 7f425ffff640 1 -- 172.21.15.92:0/2811485013 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270012450 con 0x558341d911b0 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.044+0000 7f425ffff640 1 -- 172.21.15.92:0/2811485013 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4270012a80 con 0x558341d911b0 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.044+0000 7f425ffff640 1 -- 172.21.15.92:0/2811485013 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427000f8f0 con 0x558341d911b0 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 -- 172.21.15.92:0/2811485013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 msgr2=0x558342161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 --2- 172.21.15.92:0/2811485013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x558342161800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4270009c00 tx=0x7f42700117b0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 -- 172.21.15.92:0/2811485013 shutdown_connections 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 --2- 172.21.15.92:0/2811485013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x558342161d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 --2- 172.21.15.92:0/2811485013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x558342161800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 --2- 172.21.15.92:0/2811485013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341dba070 0x5583421612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 -- 172.21.15.92:0/2811485013 >> 172.21.15.92:0/2811485013 conn(0x558341dae460 msgr2=0x55834215f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 -- 172.21.15.92:0/2811485013 shutdown_connections 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 -- 172.21.15.92:0/2811485013 wait complete. 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 -- start start 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.045+0000 7f4282333740 1 Processor -- start 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f4282333740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d911b0 0x55834216c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f4282333740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341d99390 0x55834216ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f4282333740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341dba070 0x55834216d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f4282333740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558341f28700 con 0x558341d911b0 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f4282333740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558342062160 con 0x558341dba070 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f4282333740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55834216faa0 con 0x558341d99390 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f4282333740 10 client.0 _ll_register_callbacks cb 0x55834207b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f427935a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d911b0 0x55834216c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f427935a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d911b0 0x55834216c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45494/0 (socket says 172.21.15.92:45494) 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f427935a640 1 -- 172.21.15.92:0/3924647097 learned_addr learned my addr 172.21.15.92:0/3924647097 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f4279b5b640 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341d99390 0x55834216ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f427935a640 1 -- 172.21.15.92:0/3924647097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341d99390 msgr2=0x55834216ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f427935a640 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341d99390 0x55834216ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f427935a640 1 -- 172.21.15.92:0/3924647097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341dba070 msgr2=0x55834216d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f427935a640 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341dba070 0x55834216d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f427935a640 1 -- 172.21.15.92:0/3924647097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55834208fc90 con 0x558341d911b0 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f427935a640 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d911b0 0x55834216c910 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f4264004630 tx=0x7f4264003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e00cc2cd4f49c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f425d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.046+0000 7f425d7fa640 1 -- 172.21.15.92:0/3924647097 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264011770 con 0x558341d911b0 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f4282333740 1 -- 172.21.15.92:0/3924647097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4270012a80 con 0x558341d911b0 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f425d7fa640 1 -- 172.21.15.92:0/3924647097 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f4264011910 con 0x558341d911b0 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f425d7fa640 1 -- 172.21.15.92:0/3924647097 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4264011b10 con 0x558341d911b0 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f4282333740 10 client.17799 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f4282333740 1 -- 172.21.15.92:0/3924647097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55834217b800 con 0x558341d911b0 2024-09-21T07:20:55.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f425d7fa640 1 -- 172.21.15.92:0/3924647097 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4270012a80 con 0x558341d911b0 2024-09-21T07:20:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f425d7fa640 1 -- 172.21.15.92:0/3924647097 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f426401d020 con 0x558341d911b0 2024-09-21T07:20:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f4282333740 10 client.17799 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f4282333740 10 client.17799 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:20:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f4282333740 20 client.17799 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f4282333740 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558341d789f0 0x55834217ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f4282333740 4 client.17799 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.047+0000 7f4282333740 1 -- 172.21.15.92:0/3924647097 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583420d9df0 con 0x558341d789f0 2024-09-21T07:20:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.048+0000 7f4279b5b640 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558341d789f0 0x55834217ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.048+0000 7f425d7fa640 10 client.17799 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:20:55.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.048+0000 7f4279b5b640 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558341d789f0 0x55834217ec60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f29d0fd500845d91 server_cookie=e5960efca70f481f in_seq=0 out_seq=0 2024-09-21T07:20:55.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f425d7fa640 1 -- 172.21.15.92:0/3924647097 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583420d9df0 con 0x558341d789f0 2024-09-21T07:20:55.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f425d7fa640 10 client.17799 handle_command_reply: tid=0 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 client.17799 shutdown 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 -- 172.21.15.92:0/3924647097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d911b0 msgr2=0x55834216c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d911b0 0x55834216c910 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f4264004630 tx=0x7f4264003a80 comp rx=0 tx=0).stop 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 -- 172.21.15.92:0/3924647097 shutdown_connections 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341dba070 0x55834216d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341d99390 0x55834216ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558341d789f0 0x55834217ec60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 --2- 172.21.15.92:0/3924647097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d911b0 0x55834216c910 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 -- 172.21.15.92:0/3924647097 >> 172.21.15.92:0/3924647097 conn(0x558341dae460 msgr2=0x558342164450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f425d7fa640 0 client.17799 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 -- 172.21.15.92:0/3924647097 shutdown_connections 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 1 -- 172.21.15.92:0/3924647097 wait complete. 2024-09-21T07:20:55.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.049+0000 7f4282333740 20 client.17799 trim_cache size 0 max 16384 2024-09-21T07:20:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.062+0000 7f4282333740 1 Processor -- start 2024-09-21T07:20:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.062+0000 7f4282333740 1 -- start start 2024-09-21T07:20:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f4282333740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x55834216e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f4282333740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341d99390 0x55834215e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f4282333740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341dba070 0x55834215eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f4282333740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42741b0e90 con 0x558341dba070 2024-09-21T07:20:55.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f4282333740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42741b29d0 con 0x558341d911b0 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f4282333740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f42741b1560 con 0x558341d99390 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f427935a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341dba070 0x55834215eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f427935a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341dba070 0x55834215eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45500/0 (socket says 172.21.15.92:45500) 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f427935a640 1 -- 172.21.15.92:0/2498002283 learned_addr learned my addr 172.21.15.92:0/2498002283 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f4279b5b640 1 --2- 172.21.15.92:0/2498002283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341d99390 0x55834215e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f427935a640 1 --2- 172.21.15.92:0/2498002283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x55834216e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f427935a640 1 -- 172.21.15.92:0/2498002283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341d99390 msgr2=0x55834215e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f427935a640 1 --2- 172.21.15.92:0/2498002283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341d99390 0x55834215e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f427935a640 1 -- 172.21.15.92:0/2498002283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 msgr2=0x55834216e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f427935a640 1 --2- 172.21.15.92:0/2498002283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x55834216e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f427935a640 1 -- 172.21.15.92:0/2498002283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583421635b0 con 0x558341dba070 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f427935a640 1 --2- 172.21.15.92:0/2498002283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341dba070 0x55834215eca0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f42640097c0 tx=0x7f4264000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3604e3141dd060f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f425f7fe640 1 -- 172.21.15.92:0/2498002283 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264011770 con 0x558341dba070 2024-09-21T07:20:55.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f425f7fe640 1 -- 172.21.15.92:0/2498002283 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4264011910 con 0x558341dba070 2024-09-21T07:20:55.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.063+0000 7f425f7fe640 1 -- 172.21.15.92:0/2498002283 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426400fd90 con 0x558341dba070 2024-09-21T07:20:55.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.064+0000 7f4282333740 1 -- 172.21.15.92:0/2498002283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341dba070 msgr2=0x55834215eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:55.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.064+0000 7f4282333740 1 --2- 172.21.15.92:0/2498002283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341dba070 0x55834215eca0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f42640097c0 tx=0x7f4264000bc0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.064+0000 7f4282333740 1 -- 172.21.15.92:0/2498002283 shutdown_connections 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.064+0000 7f4282333740 1 --2- 172.21.15.92:0/2498002283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341dba070 0x55834215eca0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.064+0000 7f4282333740 1 --2- 172.21.15.92:0/2498002283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341d99390 0x55834215e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.064+0000 7f4282333740 1 --2- 172.21.15.92:0/2498002283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x55834216e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.064+0000 7f4282333740 1 -- 172.21.15.92:0/2498002283 >> 172.21.15.92:0/2498002283 conn(0x558341dae460 msgr2=0x55834216de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.064+0000 7f4282333740 1 -- 172.21.15.92:0/2498002283 shutdown_connections 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.064+0000 7f4282333740 1 -- 172.21.15.92:0/2498002283 wait complete. 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4282333740 1 -- start start 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4282333740 1 Processor -- start 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4282333740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x558342170e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4282333740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x5583421713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4282333740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341dba070 0x558342171900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4282333740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42741b2300 con 0x558341d99390 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4282333740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42741b1c30 con 0x558341d911b0 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4282333740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f42741aee90 con 0x558341dba070 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4282333740 10 client.0 _ll_register_callbacks cb 0x7f4264004480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4279b5b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x5583421713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4279b5b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x5583421713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45508/0 (socket says 172.21.15.92:45508) 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f4279b5b640 1 -- 172.21.15.92:0/3058827321 learned_addr learned my addr 172.21.15.92:0/3058827321 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f427935a640 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x558342170e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.065+0000 7f427935a640 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341dba070 0x558342171900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f4279b5b640 1 -- 172.21.15.92:0/3058827321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341dba070 msgr2=0x558342171900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f4279b5b640 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341dba070 0x558342171900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f4279b5b640 1 -- 172.21.15.92:0/3058827321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 msgr2=0x558342170e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f4279b5b640 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x558342170e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f4279b5b640 1 -- 172.21.15.92:0/3058827321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583421e87a0 con 0x558341d99390 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f427935a640 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x558342170e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f4279b5b640 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x5583421713c0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4270009b70 tx=0x7f4270009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afd1a06d17b785c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f425d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f425d7fa640 1 -- 172.21.15.92:0/3058827321 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270031020 con 0x558341d99390 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f425d7fa640 1 -- 172.21.15.92:0/3058827321 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f4270005450 con 0x558341d99390 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f4282333740 1 -- 172.21.15.92:0/3058827321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4264011910 con 0x558341d99390 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f425d7fa640 1 -- 172.21.15.92:0/3058827321 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f427003c050 con 0x558341d99390 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f4282333740 10 client.17805 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f4282333740 1 -- 172.21.15.92:0/3058827321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5583421e9a20 con 0x558341d99390 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f425d7fa640 1 -- 172.21.15.92:0/3058827321 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4264011910 con 0x558341d99390 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f425d7fa640 1 -- 172.21.15.92:0/3058827321 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4270003820 con 0x558341d99390 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.066+0000 7f4282333740 10 client.17805 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:55.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f4282333740 10 client.17805 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f4282333740 20 client.17805 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f4282333740 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558341d4dda0 0x5583421ebe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f4282333740 4 client.17805 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f4282333740 1 -- 172.21.15.92:0/3058827321 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583421684c0 con 0x558341d4dda0 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f427935a640 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558341d4dda0 0x5583421ebe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f425d7fa640 10 client.17805 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f427935a640 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558341d4dda0 0x5583421ebe70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8d6929efb0de0a53 server_cookie=d6300e7e81525842 in_seq=0 out_seq=0 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f425d7fa640 1 -- 172.21.15.92:0/3058827321 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583421684c0 con 0x558341d4dda0 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f425d7fa640 10 client.17805 handle_command_reply: tid=0 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.067+0000 7f4282333740 1 client.17805 shutdown 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 1 -- 172.21.15.92:0/3058827321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 msgr2=0x5583421713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x5583421713c0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4270009b70 tx=0x7f4270009cf0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 1 -- 172.21.15.92:0/3058827321 shutdown_connections 2024-09-21T07:20:55.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558341dba070 0x558342171900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x558341d4dda0 0x5583421ebe70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558341d99390 0x5583421713c0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 1 --2- 172.21.15.92:0/3058827321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558341d911b0 0x558342170e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f425d7fa640 0 client.17805 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:20:55.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 1 -- 172.21.15.92:0/3058827321 >> 172.21.15.92:0/3058827321 conn(0x558341dae460 msgr2=0x55834216ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:55.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 1 -- 172.21.15.92:0/3058827321 shutdown_connections 2024-09-21T07:20:55.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 1 -- 172.21.15.92:0/3058827321 wait complete. 2024-09-21T07:20:55.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f4282333740 20 client.17805 trim_cache size 0 max 16384 2024-09-21T07:20:55.075 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:20:55.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f427bdbf640 1 -- 172.21.15.92:0/4264206920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f42600b6680 msgr2=0x7f42600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:55.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f427bdbf640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f42600b6680 0x7f42600b8b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f426c106080 tx=0x7f426c09a390 comp rx=0 tx=0).stop 2024-09-21T07:20:55.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f427bdbf640 1 -- 172.21.15.92:0/4264206920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f427410de10 msgr2=0x7f427419fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:55.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f427bdbf640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f427410de10 0x7f427419fbc0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f426c005cc0 tx=0x7f426c003f90 comp rx=0 tx=0).stop 2024-09-21T07:20:55.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f427bdbf640 1 -- 172.21.15.92:0/4264206920 shutdown_connections 2024-09-21T07:20:55.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f427bdbf640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f42600b6680 0x7f42600b8b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f427bdbf640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f427410de10 0x7f427419fbc0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f427bdbf640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4274105300 0x7f427419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f427bdbf640 1 --2- 172.21.15.92:0/4264206920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42741049b0 0x7f427419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:55.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.068+0000 7f427bdbf640 1 -- 172.21.15.92:0/4264206920 >> 172.21.15.92:0/4264206920 conn(0x7f4274079720 msgr2=0x7f4274100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:55.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.069+0000 7f427bdbf640 1 -- 172.21.15.92:0/4264206920 shutdown_connections 2024-09-21T07:20:55.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:55.069+0000 7f427bdbf640 1 -- 172.21.15.92:0/4264206920 wait complete. 2024-09-21T07:20:55.950 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:20:56.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:55 smithi092 ceph-mon[30987]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:20:56.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:55 smithi169 ceph-mon[33705]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:20:56.195 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:56.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:55 smithi175 ceph-mon[34064]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:20:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 -- 172.21.15.92:0/4024101694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d70 msgr2=0x7f450810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 --2- 172.21.15.92:0/4024101694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d70 0x7f450810f5a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f4500009ca0 tx=0x7f450002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 -- 172.21.15.92:0/4024101694 shutdown_connections 2024-09-21T07:20:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 --2- 172.21.15.92:0/4024101694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d70 0x7f450810f5a0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 --2- 172.21.15.92:0/4024101694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4508108420 0x7f4508108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 --2- 172.21.15.92:0/4024101694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4508102ae0 0x7f4508102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 -- 172.21.15.92:0/4024101694 >> 172.21.15.92:0/4024101694 conn(0x7f4508079770 msgr2=0x7f4508079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 -- 172.21.15.92:0/4024101694 shutdown_connections 2024-09-21T07:20:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 -- 172.21.15.92:0/4024101694 wait complete. 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 Processor -- start 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.708+0000 7f4510748640 1 -- start start 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f4510748640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508102ae0 0x7f450819b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f4510748640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4508108420 0x7f450819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f4510748640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4508108d70 0x7f450819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f4510748640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4508112930 con 0x7f4508102ae0 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f4510748640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45081127b0 con 0x7f4508108d70 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f4510748640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4508112ab0 con 0x7f4508108420 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450e4e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508102ae0 0x7f450819b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450e4e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508102ae0 0x7f450819b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45540/0 (socket says 172.21.15.92:45540) 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450e4e4640 1 -- 172.21.15.92:0/4189233485 learned_addr learned my addr 172.21.15.92:0/4189233485 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450dce3640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4508108420 0x7f450819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450ece5640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4508108d70 0x7f450819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450e4e4640 1 -- 172.21.15.92:0/4189233485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4508108420 msgr2=0x7f450819b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450e4e4640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4508108420 0x7f450819b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450e4e4640 1 -- 172.21.15.92:0/4189233485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4508108d70 msgr2=0x7f450819bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450e4e4640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4508108d70 0x7f450819bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450e4e4640 1 -- 172.21.15.92:0/4189233485 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45081a6400 con 0x7f4508102ae0 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.709+0000 7f450e4e4640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508102ae0 0x7f450819b180 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c920 tx=0x7f44f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.710+0000 7f44ff7fe640 1 -- 172.21.15.92:0/4189233485 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8007c70 con 0x7f4508102ae0 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.710+0000 7f4510748640 1 -- 172.21.15.92:0/4189233485 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45081a66f0 con 0x7f4508102ae0 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.710+0000 7f44ff7fe640 1 -- 172.21.15.92:0/4189233485 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f8007e10 con 0x7f4508102ae0 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.710+0000 7f44ff7fe640 1 -- 172.21.15.92:0/4189233485 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f80186f0 con 0x7f4508102ae0 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.710+0000 7f4510748640 1 -- 172.21.15.92:0/4189233485 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45081a6c80 con 0x7f4508102ae0 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.712+0000 7f4516cbc740 1 Processor -- start 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f4516cbc740 1 -- start start 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a457b1070 0x556a45b586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b58be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a45790390 0x556a45b59120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f4516cbc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556a45aceea0 con 0x556a457881b0 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f4516cbc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556a45abe2d0 con 0x556a457b1070 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f4516cbc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556a45ac20e0 con 0x556a45790390 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f44ff7fe640 1 -- 172.21.15.92:0/4189233485 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f44f800f450 con 0x7f4508102ae0 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f450e4e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b58be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f450dce3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a45790390 0x556a45b59120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f450e4e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b58be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45548/0 (socket says 172.21.15.92:45548) 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f450e4e4640 1 -- 172.21.15.92:0/931206329 learned_addr learned my addr 172.21.15.92:0/931206329 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f450ece5640 1 --2- 172.21.15.92:0/931206329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a457b1070 0x556a45b586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f450e4e4640 1 -- 172.21.15.92:0/931206329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a45790390 msgr2=0x556a45b59120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f450e4e4640 1 --2- 172.21.15.92:0/931206329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a45790390 0x556a45b59120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f450e4e4640 1 -- 172.21.15.92:0/931206329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a457b1070 msgr2=0x556a45b586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f450e4e4640 1 --2- 172.21.15.92:0/931206329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a457b1070 0x556a45b586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.713+0000 7f450e4e4640 1 -- 172.21.15.92:0/931206329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4581c650 con 0x556a457881b0 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.714+0000 7f450e4e4640 1 --2- 172.21.15.92:0/931206329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b58be0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f44f80e5050 tx=0x7f44f80f00e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f718f597b2e79589 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.714+0000 7f44ff7fe640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44f40b6680 0x7f44f40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.714+0000 7f450ece5640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44f40b6680 0x7f44f40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.714+0000 7f44fcff9640 1 -- 172.21.15.92:0/931206329 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f80fb070 con 0x556a457881b0 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.714+0000 7f44fcff9640 1 -- 172.21.15.92:0/931206329 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f80ad320 con 0x556a457881b0 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.714+0000 7f44fcff9640 1 -- 172.21.15.92:0/931206329 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f80ad5e0 con 0x556a457881b0 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.714+0000 7f44ff7fe640 1 -- 172.21.15.92:0/4189233485 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f44f80e7e20 con 0x7f4508102ae0 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f4516cbc740 1 -- 172.21.15.92:0/931206329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 msgr2=0x556a45b58be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f450ece5640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44f40b6680 0x7f44f40b8b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4500006010 tx=0x7f4500009940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f4516cbc740 1 --2- 172.21.15.92:0/931206329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b58be0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f44f80e5050 tx=0x7f44f80f00e0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f4516cbc740 1 -- 172.21.15.92:0/931206329 shutdown_connections 2024-09-21T07:20:56.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f4516cbc740 1 --2- 172.21.15.92:0/931206329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a45790390 0x556a45b59120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f4516cbc740 1 --2- 172.21.15.92:0/931206329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b58be0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f4516cbc740 1 --2- 172.21.15.92:0/931206329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a457b1070 0x556a45b586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f4516cbc740 1 -- 172.21.15.92:0/931206329 >> 172.21.15.92:0/931206329 conn(0x556a457a5460 msgr2=0x556a45b56590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f4516cbc740 1 -- 172.21.15.92:0/931206329 shutdown_connections 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f4516cbc740 1 -- 172.21.15.92:0/931206329 wait complete. 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.715+0000 7f4516cbc740 1 -- start start 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f4516cbc740 1 Processor -- start 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b63dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 0x556a45b64300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a457b1070 0x556a45b701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f4516cbc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556a4591f700 con 0x556a457881b0 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f4516cbc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556a45a59160 con 0x556a45790390 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f4516cbc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556a45b66e80 con 0x556a457b1070 2024-09-21T07:20:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f4516cbc740 10 client.0 _ll_register_callbacks cb 0x556a45a729e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450e4e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b63dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450e4e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b63dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45556/0 (socket says 172.21.15.92:45556) 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450e4e4640 1 -- 172.21.15.92:0/3646525795 learned_addr learned my addr 172.21.15.92:0/3646525795 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450dce3640 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 0x556a45b64300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450e4e4640 1 -- 172.21.15.92:0/3646525795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a457b1070 msgr2=0x556a45b701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450ece5640 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a457b1070 0x556a45b701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450e4e4640 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a457b1070 0x556a45b701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450e4e4640 1 -- 172.21.15.92:0/3646525795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 msgr2=0x556a45b64300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450e4e4640 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 0x556a45b64300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450e4e4640 1 -- 172.21.15.92:0/3646525795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a45a86c90 con 0x556a457881b0 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.716+0000 7f450dce3640 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 0x556a45b64300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f450e4e4640 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b63dc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f44f80ad7a0 tx=0x7f44f80a9720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe73b34342313327 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f44f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f44f1ffb640 1 -- 172.21.15.92:0/3646525795 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8061fb0 con 0x556a457881b0 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f44f1ffb640 1 -- 172.21.15.92:0/3646525795 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f44f80e5390 con 0x556a457881b0 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f4516cbc740 1 -- 172.21.15.92:0/3646525795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f80ad320 con 0x556a457881b0 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f44f1ffb640 1 -- 172.21.15.92:0/3646525795 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44f805f0f0 con 0x556a457881b0 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f4516cbc740 10 client.17817 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f4516cbc740 1 -- 172.21.15.92:0/3646525795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556a45b72bf0 con 0x556a457881b0 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f44f1ffb640 1 -- 172.21.15.92:0/3646525795 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f80ad320 con 0x556a457881b0 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f44f1ffb640 1 -- 172.21.15.92:0/3646525795 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f44f801f300 con 0x556a457881b0 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f4516cbc740 10 client.17817 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f4516cbc740 10 client.17817 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f4516cbc740 20 client.17817 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f4516cbc740 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556a4576f9f0 0x556a45b75f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f4516cbc740 4 client.17817 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:56.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.717+0000 7f4516cbc740 1 -- 172.21.15.92:0/3646525795 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a45ad0df0 con 0x556a4576f9f0 2024-09-21T07:20:56.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.718+0000 7f450dce3640 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556a4576f9f0 0x556a45b75f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.718+0000 7f450dce3640 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556a4576f9f0 0x556a45b75f50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f94699802ef8f27a server_cookie=759412a9c25c23fe in_seq=0 out_seq=0 2024-09-21T07:20:56.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.718+0000 7f44f1ffb640 10 client.17817 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f44f1ffb640 1 -- 172.21.15.92:0/3646525795 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a45ad0df0 con 0x556a4576f9f0 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f44f1ffb640 10 client.17817 handle_command_reply: tid=0 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 client.17817 shutdown 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 -- 172.21.15.92:0/3646525795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 msgr2=0x556a45b63dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b63dc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f44f80ad7a0 tx=0x7f44f80a9720 comp rx=0 tx=0).stop 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 -- 172.21.15.92:0/3646525795 shutdown_connections 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556a4576f9f0 0x556a45b75f50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a457b1070 0x556a45b701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 0x556a45b64300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 --2- 172.21.15.92:0/3646525795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b63dc0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 -- 172.21.15.92:0/3646525795 >> 172.21.15.92:0/3646525795 conn(0x556a457a5460 msgr2=0x556a45b5b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:56.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f44f1ffb640 0 client.17817 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:20:56.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 -- 172.21.15.92:0/3646525795 shutdown_connections 2024-09-21T07:20:56.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 1 -- 172.21.15.92:0/3646525795 wait complete. 2024-09-21T07:20:56.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.719+0000 7f4516cbc740 20 client.17817 trim_cache size 0 max 16384 2024-09-21T07:20:56.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.732+0000 7f4516cbc740 1 Processor -- start 2024-09-21T07:20:56.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.732+0000 7f4516cbc740 1 -- start start 2024-09-21T07:20:56.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a457881b0 0x556a45b64280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 0x556a45b70110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457b1070 0x556a45b55ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f4516cbc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45081b0de0 con 0x556a457b1070 2024-09-21T07:20:56.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f4516cbc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45081b2920 con 0x556a45790390 2024-09-21T07:20:56.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f4516cbc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45081b14b0 con 0x556a457881b0 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450ece5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457b1070 0x556a45b55ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450ece5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457b1070 0x556a45b55ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45558/0 (socket says 172.21.15.92:45558) 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450ece5640 1 -- 172.21.15.92:0/4105593911 learned_addr learned my addr 172.21.15.92:0/4105593911 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450e4e4640 1 --2- 172.21.15.92:0/4105593911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a457881b0 0x556a45b64280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450dce3640 1 --2- 172.21.15.92:0/4105593911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 0x556a45b70110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450ece5640 1 -- 172.21.15.92:0/4105593911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a457881b0 msgr2=0x556a45b64280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450ece5640 1 --2- 172.21.15.92:0/4105593911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a457881b0 0x556a45b64280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450ece5640 1 -- 172.21.15.92:0/4105593911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 msgr2=0x556a45b70110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450ece5640 1 --2- 172.21.15.92:0/4105593911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 0x556a45b70110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450ece5640 1 -- 172.21.15.92:0/4105593911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a45b56e80 con 0x556a457b1070 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450dce3640 1 --2- 172.21.15.92:0/4105593911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 0x556a45b70110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f450ece5640 1 --2- 172.21.15.92:0/4105593911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457b1070 0x556a45b55ef0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f4500031910 tx=0x7f4500041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0830c9615562e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:56.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f44f3fff640 1 -- 172.21.15.92:0/4105593911 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500031980 con 0x556a457b1070 2024-09-21T07:20:56.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.733+0000 7f44f3fff640 1 -- 172.21.15.92:0/4105593911 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4500036040 con 0x556a457b1070 2024-09-21T07:20:56.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.734+0000 7f44f3fff640 1 -- 172.21.15.92:0/4105593911 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45000047f0 con 0x556a457b1070 2024-09-21T07:20:56.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.734+0000 7f4516cbc740 1 -- 172.21.15.92:0/4105593911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457b1070 msgr2=0x556a45b55ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:56.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.734+0000 7f4516cbc740 1 --2- 172.21.15.92:0/4105593911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457b1070 0x556a45b55ef0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f4500031910 tx=0x7f4500041000 comp rx=0 tx=0).stop 2024-09-21T07:20:56.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.734+0000 7f4516cbc740 1 -- 172.21.15.92:0/4105593911 shutdown_connections 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.734+0000 7f4516cbc740 1 --2- 172.21.15.92:0/4105593911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457b1070 0x556a45b55ef0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.734+0000 7f4516cbc740 1 --2- 172.21.15.92:0/4105593911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a45790390 0x556a45b70110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.734+0000 7f4516cbc740 1 --2- 172.21.15.92:0/4105593911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a457881b0 0x556a45b64280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.734+0000 7f4516cbc740 1 -- 172.21.15.92:0/4105593911 >> 172.21.15.92:0/4105593911 conn(0x556a457a5460 msgr2=0x556a45b63b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.734+0000 7f4516cbc740 1 -- 172.21.15.92:0/4105593911 shutdown_connections 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.734+0000 7f4516cbc740 1 -- 172.21.15.92:0/4105593911 wait complete. 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f4516cbc740 1 -- start start 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f4516cbc740 1 Processor -- start 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b76b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a45790390 0x556a45b770e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f4516cbc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a457b1070 0x556a45bd8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f4516cbc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45081b2250 con 0x556a457881b0 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f4516cbc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45081b1b80 con 0x556a457b1070 2024-09-21T07:20:56.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f4516cbc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45081aede0 con 0x556a45790390 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f4516cbc740 10 client.0 _ll_register_callbacks cb 0x7f44f80f9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f450e4e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b76b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f450e4e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b76b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45564/0 (socket says 172.21.15.92:45564) 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f450e4e4640 1 -- 172.21.15.92:0/1264957508 learned_addr learned my addr 172.21.15.92:0/1264957508 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f450dce3640 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a45790390 0x556a45b770e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f450e4e4640 1 -- 172.21.15.92:0/1264957508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a45790390 msgr2=0x556a45b770e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f450e4e4640 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a45790390 0x556a45b770e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f450e4e4640 1 -- 172.21.15.92:0/1264957508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a457b1070 msgr2=0x556a45bd8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.735+0000 7f450e4e4640 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a457b1070 0x556a45bd8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f450e4e4640 1 -- 172.21.15.92:0/1264957508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a45bd8ef0 con 0x556a457881b0 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f450e4e4640 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b76b20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f44f80ebe50 tx=0x7f44f80e5210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7567d25c10d683c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f44f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f44f1ffb640 1 -- 172.21.15.92:0/1264957508 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f805e290 con 0x556a457881b0 2024-09-21T07:20:56.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f44f1ffb640 1 -- 172.21.15.92:0/1264957508 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f44f80e5390 con 0x556a457881b0 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f4516cbc740 1 -- 172.21.15.92:0/1264957508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4500036040 con 0x556a457881b0 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f44f1ffb640 1 -- 172.21.15.92:0/1264957508 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44f805ef10 con 0x556a457881b0 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f4516cbc740 10 client.17823 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f4516cbc740 1 -- 172.21.15.92:0/1264957508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556a45be0250 con 0x556a457881b0 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f44f1ffb640 1 -- 172.21.15.92:0/1264957508 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4500036040 con 0x556a457881b0 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f44f1ffb640 1 -- 172.21.15.92:0/1264957508 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f44f80b6da0 con 0x556a457881b0 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f4516cbc740 10 client.17823 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f4516cbc740 10 client.17823 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f4516cbc740 20 client.17823 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f4516cbc740 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556a45744da0 0x556a45be2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f4516cbc740 4 client.17823 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.736+0000 7f4516cbc740 1 -- 172.21.15.92:0/1264957508 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556a45acc8a0 con 0x556a45744da0 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f450dce3640 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556a45744da0 0x556a45be2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f450dce3640 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556a45744da0 0x556a45be2840 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3722d1474128d106 server_cookie=c93700ad4f4217e4 in_seq=0 out_seq=0 2024-09-21T07:20:56.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f44f1ffb640 10 client.17823 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f44f1ffb640 1 -- 172.21.15.92:0/1264957508 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a45acc8a0 con 0x556a45744da0 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f44f1ffb640 10 client.17823 handle_command_reply: tid=0 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f4516cbc740 1 client.17823 shutdown 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f4516cbc740 1 -- 172.21.15.92:0/1264957508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 msgr2=0x556a45b76b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f4516cbc740 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b76b20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f44f80ebe50 tx=0x7f44f80e5210 comp rx=0 tx=0).stop 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f4516cbc740 1 -- 172.21.15.92:0/1264957508 shutdown_connections 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f4516cbc740 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x556a45744da0 0x556a45be2840 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f4516cbc740 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556a457b1070 0x556a45bd8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f4516cbc740 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556a45790390 0x556a45b770e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f4516cbc740 1 --2- 172.21.15.92:0/1264957508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556a457881b0 0x556a45b76b20 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.737+0000 7f4516cbc740 1 -- 172.21.15.92:0/1264957508 >> 172.21.15.92:0/1264957508 conn(0x556a457a5460 msgr2=0x556a45b55dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f44f1ffb640 0 client.17823 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4516cbc740 1 -- 172.21.15.92:0/1264957508 shutdown_connections 2024-09-21T07:20:56.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4516cbc740 1 -- 172.21.15.92:0/1264957508 wait complete. 2024-09-21T07:20:56.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4516cbc740 20 client.17823 trim_cache size 0 max 16384 2024-09-21T07:20:56.745 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:20:56.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 -- 172.21.15.92:0/4189233485 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44f40b6680 msgr2=0x7f44f40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44f40b6680 0x7f44f40b8b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4500006010 tx=0x7f4500009940 comp rx=0 tx=0).stop 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 -- 172.21.15.92:0/4189233485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508102ae0 msgr2=0x7f450819b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508102ae0 0x7f450819b180 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c920 tx=0x7f44f800cde0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 -- 172.21.15.92:0/4189233485 shutdown_connections 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f44f40b6680 0x7f44f40b8b90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4508108d70 0x7f450819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4508108420 0x7f450819b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 --2- 172.21.15.92:0/4189233485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508102ae0 0x7f450819b180 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 -- 172.21.15.92:0/4189233485 >> 172.21.15.92:0/4189233485 conn(0x7f4508079770 msgr2=0x7f45081064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 -- 172.21.15.92:0/4189233485 shutdown_connections 2024-09-21T07:20:56.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:56.738+0000 7f4510748640 1 -- 172.21.15.92:0/4189233485 wait complete. 2024-09-21T07:20:57.663 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:20:57.913 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:58.033 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:20:57 smithi092 ceph-mon[30987]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 op/s 2024-09-21T07:20:58.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:20:57 smithi169 ceph-mon[33705]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 op/s 2024-09-21T07:20:58.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:20:57 smithi175 ceph-mon[34064]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 11 op/s 2024-09-21T07:20:58.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.427+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/1043009786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb41094a0 msgr2=0x7fbfb41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:58.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.427+0000 7fbfb9e2d640 1 --2- 172.21.15.92:0/1043009786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb41094a0 0x7fbfb41098b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009900 tx=0x7fbfa802a410 comp rx=0 tx=0).stop 2024-09-21T07:20:58.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.427+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/1043009786 shutdown_connections 2024-09-21T07:20:58.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.427+0000 7fbfb9e2d640 1 --2- 172.21.15.92:0/1043009786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfb4109df0 0x7fbfb4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.427+0000 7fbfb9e2d640 1 --2- 172.21.15.92:0/1043009786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb41094a0 0x7fbfb41098b0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.427+0000 7fbfb9e2d640 1 --2- 172.21.15.92:0/1043009786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfb4103b60 0x7fbfb4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.427+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/1043009786 >> 172.21.15.92:0/1043009786 conn(0x7fbfb407b850 msgr2=0x7fbfb407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.427+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/1043009786 shutdown_connections 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.427+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/1043009786 wait complete. 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb9e2d640 1 Processor -- start 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb9e2d640 1 -- start start 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb9e2d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfb4103b60 0x7fbfb419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb9e2d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfb41094a0 0x7fbfb419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb9e2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4109df0 0x7fbfb419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb9e2d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4113980 con 0x7fbfb4109df0 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb9e2d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4113800 con 0x7fbfb4103b60 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb9e2d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4113b00 con 0x7fbfb41094a0 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4109df0 0x7fbfb419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4109df0 0x7fbfb419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45578/0 (socket says 172.21.15.92:45578) 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb3fff640 1 -- 172.21.15.92:0/2047422598 learned_addr learned my addr 172.21.15.92:0/2047422598 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb37fe640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfb4103b60 0x7fbfb419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfb41094a0 0x7fbfb419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb3fff640 1 -- 172.21.15.92:0/2047422598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfb41094a0 msgr2=0x7fbfb419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb3fff640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfb41094a0 0x7fbfb419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb3fff640 1 -- 172.21.15.92:0/2047422598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfb4103b60 msgr2=0x7fbfb419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.428+0000 7fbfb3fff640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfb4103b60 0x7fbfb419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.429+0000 7fbfb3fff640 1 -- 172.21.15.92:0/2047422598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb41a03a0 con 0x7fbfb4109df0 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.429+0000 7fbfb3fff640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4109df0 0x7fbfb419fd30 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009fd0 tx=0x7fbfac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.429+0000 7fbfb0ff9640 1 -- 172.21.15.92:0/2047422598 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac011830 con 0x7fbfb4109df0 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.429+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/2047422598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb41a0690 con 0x7fbfb4109df0 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.429+0000 7fbfb0ff9640 1 -- 172.21.15.92:0/2047422598 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfac016070 con 0x7fbfb4109df0 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.429+0000 7fbfb0ff9640 1 -- 172.21.15.92:0/2047422598 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac010d20 con 0x7fbfb4109df0 2024-09-21T07:20:58.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.429+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/2047422598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb41a6eb0 con 0x7fbfb4109df0 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfc03a1740 1 Processor -- start 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfb0ff9640 1 -- 172.21.15.92:0/2047422598 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fbfac01b460 con 0x7fbfb4109df0 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfc03a1740 1 -- start start 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7976a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3c71b0 0x56303d797be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3cf390 0x56303d798120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56303d70dea0 con 0x56303d3f0070 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56303d6fd2d0 con 0x56303d3c71b0 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56303d7010e0 con 0x56303d3cf390 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45594/0 (socket says 172.21.15.92:45594) 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/1577061066 learned_addr learned my addr 172.21.15.92:0/1577061066 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/1577061066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3cf390 0x56303d798120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.432+0000 7fbfb37fe640 1 --2- 172.21.15.92:0/1577061066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3c71b0 0x56303d797be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/1577061066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3cf390 msgr2=0x56303d798120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbfb0ff9640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf9c0b66b0 0x7fbf9c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/1577061066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3cf390 0x56303d798120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/1577061066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3c71b0 msgr2=0x56303d797be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/1577061066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3c71b0 0x56303d797be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/1577061066 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303d45b650 con 0x56303d3f0070 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbfb3fff640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf9c0b66b0 0x7fbf9c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/1577061066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7976a0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8006010 tx=0x7fbfa8009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4868ff52a9025638 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbfb0ff9640 1 -- 172.21.15.92:0/2047422598 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fbfac0e70f0 con 0x7fbfb4109df0 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbf99ffb640 1 -- 172.21.15.92:0/1577061066 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8045070 con 0x56303d3f0070 2024-09-21T07:20:58.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbf99ffb640 1 -- 172.21.15.92:0/1577061066 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfa80044c0 con 0x56303d3f0070 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.433+0000 7fbf99ffb640 1 -- 172.21.15.92:0/1577061066 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8035050 con 0x56303d3f0070 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfc03a1740 1 -- 172.21.15.92:0/1577061066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 msgr2=0x56303d7976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfb3fff640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf9c0b66b0 0x7fbf9c0b8bc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0e44f0 tx=0x7fbfac0797f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/1577061066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7976a0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8006010 tx=0x7fbfa8009640 comp rx=0 tx=0).stop 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfc03a1740 1 -- 172.21.15.92:0/1577061066 shutdown_connections 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/1577061066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3cf390 0x56303d798120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/1577061066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3c71b0 0x56303d797be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/1577061066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7976a0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfc03a1740 1 -- 172.21.15.92:0/1577061066 >> 172.21.15.92:0/1577061066 conn(0x56303d3e4460 msgr2=0x56303d795590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfc03a1740 1 -- 172.21.15.92:0/1577061066 shutdown_connections 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfc03a1740 1 -- 172.21.15.92:0/1577061066 wait complete. 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.434+0000 7fbfc03a1740 1 -- start start 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfc03a1740 1 Processor -- start 2024-09-21T07:20:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3c71b0 0x56303d7a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3cf390 0x56303d7a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56303d55e700 con 0x56303d3f0070 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56303d698160 con 0x56303d3cf390 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56303d7a5e20 con 0x56303d3c71b0 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfc03a1740 10 client.0 _ll_register_callbacks cb 0x56303d6b19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45608/0 (socket says 172.21.15.92:45608) 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/2877884376 learned_addr learned my addr 172.21.15.92:0/2877884376 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3c71b0 0x56303d7a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfb37fe640 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3cf390 0x56303d7a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/2877884376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3c71b0 msgr2=0x56303d7a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3c71b0 0x56303d7a2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/2877884376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3cf390 msgr2=0x56303d7a32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3cf390 0x56303d7a32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.435+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/2877884376 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56303d6c5c90 con 0x56303d3f0070 2024-09-21T07:20:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.436+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7af140 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8005760 tx=0x7fbfa80058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e5eb61c7ea3aed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.436+0000 7fbf92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.436+0000 7fbf92ffd640 1 -- 172.21.15.92:0/2877884376 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8035070 con 0x56303d3f0070 2024-09-21T07:20:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.436+0000 7fbf92ffd640 1 -- 172.21.15.92:0/2877884376 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fbfa80046c0 con 0x56303d3f0070 2024-09-21T07:20:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.436+0000 7fbfc03a1740 1 -- 172.21.15.92:0/2877884376 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56303d70fdf0 con 0x56303d3f0070 2024-09-21T07:20:58.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbf92ffd640 1 -- 172.21.15.92:0/2877884376 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbfa8045070 con 0x56303d3f0070 2024-09-21T07:20:58.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbfc03a1740 10 client.17835 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:58.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbfc03a1740 1 -- 172.21.15.92:0/2877884376 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56303d7b1b20 con 0x56303d3f0070 2024-09-21T07:20:58.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbf92ffd640 1 -- 172.21.15.92:0/2877884376 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56303d70fdf0 con 0x56303d3f0070 2024-09-21T07:20:58.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbf92ffd640 1 -- 172.21.15.92:0/2877884376 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbfa80037f0 con 0x56303d3f0070 2024-09-21T07:20:58.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbfc03a1740 10 client.17835 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:58.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbfc03a1740 10 client.17835 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:20:58.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbfc03a1740 20 client.17835 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:58.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x56303d3ae9f0 0x56303d7b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbfc03a1740 4 client.17835 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:20:58.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.437+0000 7fbfc03a1740 1 -- 172.21.15.92:0/2877884376 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56303d70b8a0 con 0x56303d3ae9f0 2024-09-21T07:20:58.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.438+0000 7fbfb37fe640 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x56303d3ae9f0 0x56303d7b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.438+0000 7fbf92ffd640 10 client.17835 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:20:58.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.438+0000 7fbfb37fe640 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x56303d3ae9f0 0x56303d7b4e80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81be7396f635bda1 server_cookie=89356277fad436f9 in_seq=0 out_seq=0 2024-09-21T07:20:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbf92ffd640 1 -- 172.21.15.92:0/2877884376 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56303d70b8a0 con 0x56303d3ae9f0 2024-09-21T07:20:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbf92ffd640 10 client.17835 handle_command_reply: tid=0 2024-09-21T07:20:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 client.17835 shutdown 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 -- 172.21.15.92:0/2877884376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 msgr2=0x56303d7af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7af140 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8005760 tx=0x7fbfa80058d0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 -- 172.21.15.92:0/2877884376 shutdown_connections 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x56303d3ae9f0 0x56303d7b4e80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7af140 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3cf390 0x56303d7a32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbf92ffd640 0 client.17835 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/2877884376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3c71b0 0x56303d7a2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 -- 172.21.15.92:0/2877884376 >> 172.21.15.92:0/2877884376 conn(0x56303d3e4460 msgr2=0x56303d79a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 -- 172.21.15.92:0/2877884376 shutdown_connections 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 1 -- 172.21.15.92:0/2877884376 wait complete. 2024-09-21T07:20:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.439+0000 7fbfc03a1740 20 client.17835 trim_cache size 0 max 16384 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.452+0000 7fbfc03a1740 1 Processor -- start 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.452+0000 7fbfc03a1740 1 -- start start 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3c71b0 0x56303d799090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3cf390 0x56303d7a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d794bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41b0eb0 con 0x56303d3f0070 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41b29f0 con 0x56303d3cf390 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41b1580 con 0x56303d3c71b0 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d794bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d794bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45614/0 (socket says 172.21.15.92:45614) 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/1313141003 learned_addr learned my addr 172.21.15.92:0/1313141003 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:58.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb37fe640 1 --2- 172.21.15.92:0/1313141003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3cf390 0x56303d7a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/1313141003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3c71b0 0x56303d799090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/1313141003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3c71b0 msgr2=0x56303d799090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/1313141003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3c71b0 0x56303d799090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/1313141003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3cf390 msgr2=0x56303d7a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/1313141003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3cf390 0x56303d7a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/1313141003 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303d79d9d0 con 0x56303d3f0070 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/1313141003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d794bc0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009900 tx=0x7fbfa8041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7f850311ed9e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.453+0000 7fbf997fa640 1 -- 172.21.15.92:0/1313141003 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8060070 con 0x56303d3f0070 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbf997fa640 1 -- 172.21.15.92:0/1313141003 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfa8046040 con 0x56303d3f0070 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbf997fa640 1 -- 172.21.15.92:0/1313141003 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8035040 con 0x56303d3f0070 2024-09-21T07:20:58.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbfc03a1740 1 -- 172.21.15.92:0/1313141003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 msgr2=0x56303d794bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/1313141003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d794bc0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009900 tx=0x7fbfa8041040 comp rx=0 tx=0).stop 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbfc03a1740 1 -- 172.21.15.92:0/1313141003 shutdown_connections 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/1313141003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d794bc0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/1313141003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3cf390 0x56303d7a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/1313141003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3c71b0 0x56303d799090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbfc03a1740 1 -- 172.21.15.92:0/1313141003 >> 172.21.15.92:0/1313141003 conn(0x56303d3e4460 msgr2=0x56303d7a4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbfc03a1740 1 -- 172.21.15.92:0/1313141003 shutdown_connections 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.454+0000 7fbfc03a1740 1 -- 172.21.15.92:0/1313141003 wait complete. 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.455+0000 7fbfc03a1740 1 -- start start 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.455+0000 7fbfc03a1740 1 Processor -- start 2024-09-21T07:20:58.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.455+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3c71b0 0x56303d7b8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.455+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3cf390 0x56303d7b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.455+0000 7fbfc03a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.455+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41b2320 con 0x56303d3f0070 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.455+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41b1c50 con 0x56303d3c71b0 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.455+0000 7fbfc03a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41aeeb0 con 0x56303d3cf390 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.455+0000 7fbfc03a1740 10 client.0 _ll_register_callbacks cb 0x7fbfa8043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.455+0000 7fbfb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45618/0 (socket says 172.21.15.92:45618) 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/269921860 learned_addr learned my addr 172.21.15.92:0/269921860 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3c71b0 0x56303d7b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfb37fe640 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3cf390 0x56303d7b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/269921860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3cf390 msgr2=0x56303d7b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3cf390 0x56303d7b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/269921860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3c71b0 msgr2=0x56303d7b8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3c71b0 0x56303d7b8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfb2ffd640 1 -- 172.21.15.92:0/269921860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56303d7b6630 con 0x56303d3f0070 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfb2ffd640 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7b5fc0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80059d0 tx=0x7fbfa8032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77b5dd50ab0de26 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbf92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbf92ffd640 1 -- 172.21.15.92:0/269921860 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8060040 con 0x56303d3f0070 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbf92ffd640 1 -- 172.21.15.92:0/269921860 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fbfa80037f0 con 0x56303d3f0070 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfc03a1740 1 -- 172.21.15.92:0/269921860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfa8046040 con 0x56303d3f0070 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbf92ffd640 1 -- 172.21.15.92:0/269921860 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbfa8035040 con 0x56303d3f0070 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfc03a1740 10 client.17841 fetch_fsmap learned FSMap version 29 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbfc03a1740 1 -- 172.21.15.92:0/269921860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56303d81f400 con 0x56303d3f0070 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.456+0000 7fbf92ffd640 1 -- 172.21.15.92:0/269921860 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfa8046040 con 0x56303d3f0070 2024-09-21T07:20:58.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.457+0000 7fbf92ffd640 1 -- 172.21.15.92:0/269921860 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbfa8066020 con 0x56303d3f0070 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.457+0000 7fbfc03a1740 10 client.17841 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.457+0000 7fbfc03a1740 10 client.17841 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.457+0000 7fbfc03a1740 20 client.17841 populate_metadata read hostname 'smithi092' 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.457+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x56303d383da0 0x56303d821a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.457+0000 7fbfc03a1740 4 client.17841 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.457+0000 7fbfc03a1740 1 -- 172.21.15.92:0/269921860 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56303d708cd0 con 0x56303d383da0 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.457+0000 7fbfb37fe640 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x56303d383da0 0x56303d821a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.457+0000 7fbf92ffd640 10 client.17841 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.457+0000 7fbfb37fe640 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x56303d383da0 0x56303d821a20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75401046acdaca0a server_cookie=8a60e22393bbe23f in_seq=0 out_seq=0 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbf92ffd640 1 -- 172.21.15.92:0/269921860 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56303d708cd0 con 0x56303d383da0 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbf92ffd640 10 client.17841 handle_command_reply: tid=0 2024-09-21T07:20:58.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 client.17841 shutdown 2024-09-21T07:20:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 -- 172.21.15.92:0/269921860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 msgr2=0x56303d7b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7b5fc0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80059d0 tx=0x7fbfa8032fc0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 -- 172.21.15.92:0/269921860 shutdown_connections 2024-09-21T07:20:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x56303d383da0 0x56303d821a20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56303d3f0070 0x56303d7b5fc0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56303d3cf390 0x56303d7b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbf92ffd640 0 client.17841 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:20:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 --2- 172.21.15.92:0/269921860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56303d3c71b0 0x56303d7b8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 -- 172.21.15.92:0/269921860 >> 172.21.15.92:0/269921860 conn(0x56303d3e4460 msgr2=0x56303d7a4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:58.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 -- 172.21.15.92:0/269921860 shutdown_connections 2024-09-21T07:20:58.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 1 -- 172.21.15.92:0/269921860 wait complete. 2024-09-21T07:20:58.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.458+0000 7fbfc03a1740 20 client.17841 trim_cache size 0 max 16384 2024-09-21T07:20:58.468 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:20:58.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/2047422598 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf9c0b66b0 msgr2=0x7fbf9c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:58.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf9c0b66b0 0x7fbf9c0b8bc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0e44f0 tx=0x7fbfac0797f0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/2047422598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4109df0 msgr2=0x7fbfb419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:58.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4109df0 0x7fbfb419fd30 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009fd0 tx=0x7fbfac00b8e0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/2047422598 shutdown_connections 2024-09-21T07:20:58.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbf9c0b66b0 0x7fbf9c0b8bc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4109df0 0x7fbfb419fd30 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfb41094a0 0x7fbfb419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 --2- 172.21.15.92:0/2047422598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfb4103b60 0x7fbfb419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:58.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/2047422598 >> 172.21.15.92:0/2047422598 conn(0x7fbfb407b850 msgr2=0x7fbfb41076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:58.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/2047422598 shutdown_connections 2024-09-21T07:20:58.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:20:58.459+0000 7fbfb9e2d640 1 -- 172.21.15.92:0/2047422598 wait complete. 2024-09-21T07:20:59.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:20:59.613 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.079+0000 7ff604a2c640 1 -- 172.21.15.92:0/1647826484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600102a60 msgr2=0x7ff600102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.079+0000 7ff604a2c640 1 --2- 172.21.15.92:0/1647826484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600102a60 0x7ff600102e70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009900 tx=0x7ff5f002a410 comp rx=0 tx=0).stop 2024-09-21T07:21:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.079+0000 7ff604a2c640 1 -- 172.21.15.92:0/1647826484 shutdown_connections 2024-09-21T07:21:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.079+0000 7ff604a2c640 1 --2- 172.21.15.92:0/1647826484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600108cf0 0x7ff60010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.079+0000 7ff604a2c640 1 --2- 172.21.15.92:0/1647826484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6001083a0 0x7ff6001087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.079+0000 7ff604a2c640 1 --2- 172.21.15.92:0/1647826484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600102a60 0x7ff600102e70 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.079+0000 7ff604a2c640 1 -- 172.21.15.92:0/1647826484 >> 172.21.15.92:0/1647826484 conn(0x7ff600079730 msgr2=0x7ff600079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.079+0000 7ff604a2c640 1 -- 172.21.15.92:0/1647826484 shutdown_connections 2024-09-21T07:21:00.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.079+0000 7ff604a2c640 1 -- 172.21.15.92:0/1647826484 wait complete. 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff604a2c640 1 Processor -- start 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff604a2c640 1 -- start start 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff604a2c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff600102a60 0x7ff60019b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff604a2c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001083a0 0x7ff60019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff604a2c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600108cf0 0x7ff60019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff604a2c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff600112810 con 0x7ff6001083a0 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff604a2c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff600112690 con 0x7ff600108cf0 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff604a2c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff600112990 con 0x7ff600102a60 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff5fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001083a0 0x7ff60019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff5fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001083a0 0x7ff60019b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46792/0 (socket says 172.21.15.92:46792) 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.080+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/2260592096 learned_addr learned my addr 172.21.15.92:0/2260592096 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff600102a60 0x7ff60019b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600108cf0 0x7ff60019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/2260592096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff600102a60 msgr2=0x7ff60019b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:00.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff600102a60 0x7ff60019b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/2260592096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600108cf0 msgr2=0x7ff60019bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600108cf0 0x7ff60019bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/2260592096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6001a6400 con 0x7ff6001083a0 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600108cf0 0x7ff60019bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001083a0 0x7ff60019b740 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c970 tx=0x7ff5e800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5f77fe640 1 -- 172.21.15.92:0/2260592096 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8014070 con 0x7ff6001083a0 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5f77fe640 1 -- 172.21.15.92:0/2260592096 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5e8004440 con 0x7ff6001083a0 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff604a2c640 1 -- 172.21.15.92:0/2260592096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6001a66f0 con 0x7ff6001083a0 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff5f77fe640 1 -- 172.21.15.92:0/2260592096 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8003d40 con 0x7ff6001083a0 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.081+0000 7ff604a2c640 1 -- 172.21.15.92:0/2260592096 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6001a6c30 con 0x7ff6001083a0 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff60afa0740 1 Processor -- start 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff60afa0740 1 -- start start 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff5f77fe640 1 -- 172.21.15.92:0/2260592096 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7ff5e8017070 con 0x7ff6001083a0 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee21d070 0x55c8ee5c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 0x55c8ee5c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff60afa0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c8ee53aea0 con 0x55c8ee21d070 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff60afa0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c8ee52a2d0 con 0x55c8ee1f41b0 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff60afa0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c8ee52e0e0 con 0x55c8ee1fc390 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff5fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee21d070 0x55c8ee5c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff5fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee21d070 0x55c8ee5c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46798/0 (socket says 172.21.15.92:46798) 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.084+0000 7ff5fed9d640 1 -- 172.21.15.92:0/421618184 learned_addr learned my addr 172.21.15.92:0/421618184 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/421618184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/421618184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 0x55c8ee5c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5fed9d640 1 -- 172.21.15.92:0/421618184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 msgr2=0x55c8ee5c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/421618184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 0x55c8ee5c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5fed9d640 1 -- 172.21.15.92:0/421618184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 msgr2=0x55c8ee5c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/421618184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5fed9d640 1 -- 172.21.15.92:0/421618184 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ee288650 con 0x55c8ee21d070 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/421618184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 0x55c8ee5c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5f77fe640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5ec0b66b0 0x7ff5ec0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/421618184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee21d070 0x55c8ee5c42c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009e40 tx=0x7ff5f800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45a6c43478c4a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5ec0b66b0 0x7ff5ec0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5f4ff9640 1 -- 172.21.15.92:0/421618184 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8004d20 con 0x55c8ee21d070 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5f4ff9640 1 -- 172.21.15.92:0/421618184 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5f80054b0 con 0x55c8ee21d070 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5f4ff9640 1 -- 172.21.15.92:0/421618184 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8011700 con 0x55c8ee21d070 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.085+0000 7ff5f77fe640 1 -- 172.21.15.92:0/2260592096 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7ff5e80e7710 con 0x7ff6001083a0 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.086+0000 7ff60afa0740 1 -- 172.21.15.92:0/421618184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee21d070 msgr2=0x55c8ee5c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.086+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5ec0b66b0 0x7ff5ec0b8bc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0006010 tx=0x7ff5f0009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.086+0000 7ff60afa0740 1 --2- 172.21.15.92:0/421618184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee21d070 0x55c8ee5c42c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009e40 tx=0x7ff5f800f730 comp rx=0 tx=0).stop 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.086+0000 7ff60afa0740 1 -- 172.21.15.92:0/421618184 shutdown_connections 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.086+0000 7ff60afa0740 1 --2- 172.21.15.92:0/421618184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 0x55c8ee5c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.086+0000 7ff60afa0740 1 --2- 172.21.15.92:0/421618184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.086+0000 7ff60afa0740 1 --2- 172.21.15.92:0/421618184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee21d070 0x55c8ee5c42c0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.086+0000 7ff60afa0740 1 -- 172.21.15.92:0/421618184 >> 172.21.15.92:0/421618184 conn(0x55c8ee211460 msgr2=0x55c8ee5c21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:00.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.086+0000 7ff60afa0740 1 -- 172.21.15.92:0/421618184 shutdown_connections 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.086+0000 7ff60afa0740 1 -- 172.21.15.92:0/421618184 wait complete. 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff60afa0740 1 -- start start 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff60afa0740 1 Processor -- start 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 0x55c8ee5dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff60afa0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c8ee38b700 con 0x55c8ee1fc390 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff60afa0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c8ee4c5160 con 0x55c8ee1f41b0 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff60afa0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c8ee5d2aa0 con 0x55c8ee21d070 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff60afa0740 10 client.0 _ll_register_callbacks cb 0x55c8ee4de9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff5fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff5fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46800/0 (socket says 172.21.15.92:46800) 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.087+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/2590813533 learned_addr learned my addr 172.21.15.92:0/2590813533 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 0x55c8ee5dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/2590813533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 msgr2=0x55c8ee5dbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 0x55c8ee5dbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/2590813533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 msgr2=0x55c8ee5cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/2590813533 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ee4f2c90 con 0x55c8ee1fc390 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 0x55c8ee5dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5cff70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80ace60 tx=0x7ff5e80a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e631d9a00ceca86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/2590813533 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80d0050 con 0x55c8ee1fc390 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/2590813533 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7ff5e80e72b0 con 0x55c8ee1fc390 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff60afa0740 1 -- 172.21.15.92:0/2590813533 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5f80054b0 con 0x55c8ee1fc390 2024-09-21T07:21:00.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/2590813533 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff5e80ac8d0 con 0x55c8ee1fc390 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff60afa0740 10 client.17853 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff60afa0740 1 -- 172.21.15.92:0/2590813533 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c8ee5de850 con 0x55c8ee1fc390 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.088+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/2590813533 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5f80054b0 con 0x55c8ee1fc390 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.089+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/2590813533 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff5e80a8ab0 con 0x55c8ee1fc390 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.089+0000 7ff60afa0740 10 client.17853 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.089+0000 7ff60afa0740 10 client.17853 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.089+0000 7ff60afa0740 20 client.17853 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.089+0000 7ff60afa0740 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55c8ee1db9f0 0x55c8ee5e1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.089+0000 7ff60afa0740 4 client.17853 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.089+0000 7ff60afa0740 1 -- 172.21.15.92:0/2590813533 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8ee53cdf0 con 0x55c8ee1db9f0 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.089+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55c8ee1db9f0 0x55c8ee5e1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.089+0000 7ff5e5ffb640 10 client.17853 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.089+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55c8ee1db9f0 0x55c8ee5e1d20 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b0595e84b53bc7d server_cookie=4096157cf8623455 in_seq=0 out_seq=0 2024-09-21T07:21:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/2590813533 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8ee53cdf0 con 0x55c8ee1db9f0 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff5e5ffb640 10 client.17853 handle_command_reply: tid=0 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff60afa0740 1 client.17853 shutdown 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff60afa0740 1 -- 172.21.15.92:0/2590813533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 msgr2=0x55c8ee5cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff60afa0740 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5cff70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80ace60 tx=0x7ff5e80a9000 comp rx=0 tx=0).stop 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff60afa0740 1 -- 172.21.15.92:0/2590813533 shutdown_connections 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff60afa0740 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55c8ee1db9f0 0x55c8ee5e1d20 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff60afa0740 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 0x55c8ee5dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff60afa0740 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5cff70 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff5e5ffb640 0 client.17853 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff60afa0740 1 --2- 172.21.15.92:0/2590813533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff60afa0740 1 -- 172.21.15.92:0/2590813533 >> 172.21.15.92:0/2590813533 conn(0x55c8ee211460 msgr2=0x55c8ee5c74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.090+0000 7ff60afa0740 1 -- 172.21.15.92:0/2590813533 shutdown_connections 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.091+0000 7ff60afa0740 1 -- 172.21.15.92:0/2590813533 wait complete. 2024-09-21T07:21:00.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.091+0000 7ff60afa0740 20 client.17853 trim_cache size 0 max 16384 2024-09-21T07:21:00.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff60afa0740 1 Processor -- start 2024-09-21T07:21:00.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff60afa0740 1 -- start start 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5dbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 0x55c8ee5dc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff60afa0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6001b0f40 con 0x55c8ee1fc390 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff60afa0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6001b2a80 con 0x55c8ee1f41b0 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff60afa0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6001b1610 con 0x55c8ee21d070 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5dbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5dbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46814/0 (socket says 172.21.15.92:46814) 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/606564252 learned_addr learned my addr 172.21.15.92:0/606564252 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 0x55c8ee5dc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/606564252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 msgr2=0x55c8ee5dc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 0x55c8ee5dc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/606564252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 msgr2=0x55c8ee5c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fdd9b640 1 -- 172.21.15.92:0/606564252 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ee5c65b0 con 0x55c8ee1fc390 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.104+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 0x55c8ee5dc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.105+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5dbc90 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80aa3d0 tx=0x7ff5e800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cb6d545bc3a529 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.105+0000 7ff5e7fff640 1 -- 172.21.15.92:0/606564252 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80d0070 con 0x55c8ee1fc390 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.105+0000 7ff5e7fff640 1 -- 172.21.15.92:0/606564252 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5e80ad860 con 0x55c8ee1fc390 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.105+0000 7ff5e7fff640 1 -- 172.21.15.92:0/606564252 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80e72b0 con 0x55c8ee1fc390 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 -- 172.21.15.92:0/606564252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 msgr2=0x55c8ee5dbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5dbc90 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80aa3d0 tx=0x7ff5e800cf80 comp rx=0 tx=0).stop 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 -- 172.21.15.92:0/606564252 shutdown_connections 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee21d070 0x55c8ee5dc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1fc390 0x55c8ee5dbc90 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 --2- 172.21.15.92:0/606564252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 -- 172.21.15.92:0/606564252 >> 172.21.15.92:0/606564252 conn(0x55c8ee211460 msgr2=0x55c8ee5c73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 -- 172.21.15.92:0/606564252 shutdown_connections 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 -- 172.21.15.92:0/606564252 wait complete. 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 -- start start 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 Processor -- start 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5d3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 0x55c8ee5d4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee21d070 0x55c8ee64b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6001b23b0 con 0x55c8ee1f41b0 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6001b1ce0 con 0x55c8ee21d070 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.106+0000 7ff60afa0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6001aef40 con 0x55c8ee1fc390 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff60afa0740 10 client.0 _ll_register_callbacks cb 0x7ff5e8007ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5d3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5d3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46828/0 (socket says 172.21.15.92:46828) 2024-09-21T07:21:00.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fe59c640 1 -- 172.21.15.92:0/3191106634 learned_addr learned my addr 172.21.15.92:0/3191106634 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee21d070 0x55c8ee64b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 0x55c8ee5d4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fe59c640 1 -- 172.21.15.92:0/3191106634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 msgr2=0x55c8ee5d4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 0x55c8ee5d4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fe59c640 1 -- 172.21.15.92:0/3191106634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee21d070 msgr2=0x55c8ee64b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee21d070 0x55c8ee64b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fe59c640 1 -- 172.21.15.92:0/3191106634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ee5d4ca0 con 0x55c8ee1f41b0 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fed9d640 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee21d070 0x55c8ee64b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 0x55c8ee5d4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5fe59c640 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5d3f50 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009900 tx=0x7ff5f0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e70e9d7b457d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/3191106634 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0035040 con 0x55c8ee1f41b0 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/3191106634 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7ff5f0005040 con 0x55c8ee1f41b0 2024-09-21T07:21:00.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff60afa0740 1 -- 172.21.15.92:0/3191106634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5e80ad860 con 0x55c8ee1f41b0 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/3191106634 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff5f0060050 con 0x55c8ee1f41b0 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff60afa0740 10 client.17859 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.107+0000 7ff60afa0740 1 -- 172.21.15.92:0/3191106634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c8ee64cc50 con 0x55c8ee1f41b0 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.108+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/3191106634 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5e80ad860 con 0x55c8ee1f41b0 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.108+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/3191106634 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff5f00035f0 con 0x55c8ee1f41b0 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.108+0000 7ff60afa0740 10 client.17859 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.108+0000 7ff60afa0740 10 client.17859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.108+0000 7ff60afa0740 20 client.17859 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.108+0000 7ff60afa0740 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55c8ee1b0da0 0x55c8ee64f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.108+0000 7ff60afa0740 4 client.17859 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.108+0000 7ff60afa0740 1 -- 172.21.15.92:0/3191106634 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8ee5388a0 con 0x55c8ee1b0da0 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.108+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55c8ee1b0da0 0x55c8ee64f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff5e5ffb640 10 client.17859 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:00.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff5fdd9b640 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55c8ee1b0da0 0x55c8ee64f440 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=531e049d630b49e2 server_cookie=af33a92f9484f722 in_seq=0 out_seq=0 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff5e5ffb640 1 -- 172.21.15.92:0/3191106634 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8ee5388a0 con 0x55c8ee1b0da0 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff5e5ffb640 10 client.17859 handle_command_reply: tid=0 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 client.17859 shutdown 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 -- 172.21.15.92:0/3191106634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1f41b0 msgr2=0x55c8ee5d3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5d3f50 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009900 tx=0x7ff5f0009260 comp rx=0 tx=0).stop 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 -- 172.21.15.92:0/3191106634 shutdown_connections 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55c8ee1b0da0 0x55c8ee64f440 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c8ee21d070 0x55c8ee64b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8ee1fc390 0x55c8ee5d4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 --2- 172.21.15.92:0/3191106634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c8ee1f41b0 0x55c8ee5d3f50 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 -- 172.21.15.92:0/3191106634 >> 172.21.15.92:0/3191106634 conn(0x55c8ee211460 msgr2=0x55c8ee5c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff5e5ffb640 0 client.17859 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 -- 172.21.15.92:0/3191106634 shutdown_connections 2024-09-21T07:21:00.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 1 -- 172.21.15.92:0/3191106634 wait complete. 2024-09-21T07:21:00.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.109+0000 7ff60afa0740 20 client.17859 trim_cache size 0 max 16384 2024-09-21T07:21:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:00.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 -- 172.21.15.92:0/2260592096 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5ec0b66b0 msgr2=0x7ff5ec0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5ec0b66b0 0x7ff5ec0b8bc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0006010 tx=0x7ff5f0009680 comp rx=0 tx=0).stop 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 -- 172.21.15.92:0/2260592096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001083a0 msgr2=0x7ff60019b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001083a0 0x7ff60019b740 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c970 tx=0x7ff5e800ce30 comp rx=0 tx=0).stop 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 -- 172.21.15.92:0/2260592096 shutdown_connections 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff5ec0b66b0 0x7ff5ec0b8bc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600108cf0 0x7ff60019bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001083a0 0x7ff60019b740 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 --2- 172.21.15.92:0/2260592096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff600102a60 0x7ff60019b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 -- 172.21.15.92:0/2260592096 >> 172.21.15.92:0/2260592096 conn(0x7ff600079730 msgr2=0x7ff6001014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 -- 172.21.15.92:0/2260592096 shutdown_connections 2024-09-21T07:21:00.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:00.110+0000 7ff604a2c640 1 -- 172.21.15.92:0/2260592096 wait complete. 2024-09-21T07:21:00.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:00 smithi092 ceph-mon[30987]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:21:00.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:00 smithi175 ceph-mon[34064]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:21:00.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:00 smithi169 ceph-mon[33705]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:21:01.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:01 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:21:01.794 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:01 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:21:01.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:01 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:21:01.976 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:21:01.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:21:02.221 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:02 smithi092 ceph-mon[30987]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-21T07:21:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:21:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:21:02.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:21:02.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.751+0000 7fd25096a640 1 -- 172.21.15.92:0/1119449699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd24c1021f0 msgr2=0x7fd24c102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:02.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.751+0000 7fd25096a640 1 --2- 172.21.15.92:0/1119449699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd24c1021f0 0x7fd24c102600 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009ca0 tx=0x7fd23c02a8e0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.751+0000 7fd25096a640 1 -- 172.21.15.92:0/1119449699 shutdown_connections 2024-09-21T07:21:02.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.751+0000 7fd25096a640 1 --2- 172.21.15.92:0/1119449699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c108480 0x7fd24c10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.751+0000 7fd25096a640 1 --2- 172.21.15.92:0/1119449699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd24c107b30 0x7fd24c107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.751+0000 7fd25096a640 1 --2- 172.21.15.92:0/1119449699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd24c1021f0 0x7fd24c102600 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.751+0000 7fd25096a640 1 -- 172.21.15.92:0/1119449699 >> 172.21.15.92:0/1119449699 conn(0x7fd24c077c60 msgr2=0x7fd24c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:02.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.751+0000 7fd25096a640 1 -- 172.21.15.92:0/1119449699 shutdown_connections 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.751+0000 7fd25096a640 1 -- 172.21.15.92:0/1119449699 wait complete. 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.752+0000 7fd25096a640 1 Processor -- start 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.752+0000 7fd25096a640 1 -- start start 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd25096a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd24c1021f0 0x7fd24c19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd25096a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c107b30 0x7fd24c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd25096a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd24c108480 0x7fd24c19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd25096a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c112940 con 0x7fd24c108480 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd25096a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1127c0 con 0x7fd24c1021f0 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd25096a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c112ac0 con 0x7fd24c107b30 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd24ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd24c108480 0x7fd24c19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd24a59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd24c1021f0 0x7fd24c19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd24ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd24c108480 0x7fd24c19bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46848/0 (socket says 172.21.15.92:46848) 2024-09-21T07:21:02.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd24ad9d640 1 -- 172.21.15.92:0/1585750561 learned_addr learned my addr 172.21.15.92:0/1585750561 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd249d9b640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c107b30 0x7fd24c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd24ad9d640 1 -- 172.21.15.92:0/1585750561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c107b30 msgr2=0x7fd24c19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd24ad9d640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c107b30 0x7fd24c19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd24ad9d640 1 -- 172.21.15.92:0/1585750561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd24c1021f0 msgr2=0x7fd24c19b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd24ad9d640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd24c1021f0 0x7fd24c19b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd24ad9d640 1 -- 172.21.15.92:0/1585750561 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c1a6630 con 0x7fd24c108480 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd24ad9d640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd24c108480 0x7fd24c19bdf0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd244009fd0 tx=0x7fd24400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd23b7fe640 1 -- 172.21.15.92:0/1585750561 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244011830 con 0x7fd24c108480 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd25096a640 1 -- 172.21.15.92:0/1585750561 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24c1a6920 con 0x7fd24c108480 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd23b7fe640 1 -- 172.21.15.92:0/1585750561 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd244016070 con 0x7fd24c108480 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.753+0000 7fd23b7fe640 1 -- 172.21.15.92:0/1585750561 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244010d20 con 0x7fd24c108480 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.754+0000 7fd25096a640 1 -- 172.21.15.92:0/1585750561 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24c1a6e90 con 0x7fd24c108480 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.756+0000 7fd256ede740 1 Processor -- start 2024-09-21T07:21:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.756+0000 7fd23b7fe640 1 -- 172.21.15.92:0/1585750561 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fd24401b460 con 0x7fd24c108480 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd256ede740 1 -- start start 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd256ede740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fe9350 0x562dd3390430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd256ede740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fc0490 0x562dd3390970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd256ede740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc8670 0x562dd3390eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd256ede740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562dd3306e60 con 0x562dd2fe9350 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd256ede740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562dd32f6290 con 0x562dd2fc8670 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd256ede740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562dd32fa0a0 con 0x562dd2fc0490 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd249d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fe9350 0x562dd3390430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd249d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fe9350 0x562dd3390430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46864/0 (socket says 172.21.15.92:46864) 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd249d9b640 1 -- 172.21.15.92:0/2577307 learned_addr learned my addr 172.21.15.92:0/2577307 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd24a59c640 1 --2- 172.21.15.92:0/2577307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fc0490 0x562dd3390970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd249d9b640 1 --2- 172.21.15.92:0/2577307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc8670 0x562dd3390eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd249d9b640 1 -- 172.21.15.92:0/2577307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fc0490 msgr2=0x562dd3390970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd249d9b640 1 --2- 172.21.15.92:0/2577307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fc0490 0x562dd3390970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd249d9b640 1 -- 172.21.15.92:0/2577307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc8670 msgr2=0x562dd3390eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd249d9b640 1 --2- 172.21.15.92:0/2577307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc8670 0x562dd3390eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd249d9b640 1 -- 172.21.15.92:0/2577307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dd3054930 con 0x562dd2fe9350 2024-09-21T07:21:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.757+0000 7fd23b7fe640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2340b6680 0x7fd2340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.758+0000 7fd249d9b640 1 --2- 172.21.15.92:0/2577307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fe9350 0x562dd3390430 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd240006aa0 tx=0x7fd24000b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d76a0c378cd95f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.758+0000 7fd24a59c640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2340b6680 0x7fd2340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.758+0000 7fd23b7fe640 1 -- 172.21.15.92:0/1585750561 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fd2440e7080 con 0x7fd24c108480 2024-09-21T07:21:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.758+0000 7fd238ff9640 1 -- 172.21.15.92:0/2577307 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24001a070 con 0x562dd2fe9350 2024-09-21T07:21:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.758+0000 7fd238ff9640 1 -- 172.21.15.92:0/2577307 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd240010040 con 0x562dd2fe9350 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.758+0000 7fd238ff9640 1 -- 172.21.15.92:0/2577307 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240013570 con 0x562dd2fe9350 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 -- 172.21.15.92:0/2577307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fe9350 msgr2=0x562dd3390430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd24a59c640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2340b6680 0x7fd2340b8b90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x562dd338f0b0 tx=0x7fd23c009940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 --2- 172.21.15.92:0/2577307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fe9350 0x562dd3390430 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd240006aa0 tx=0x7fd24000b400 comp rx=0 tx=0).stop 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 -- 172.21.15.92:0/2577307 shutdown_connections 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 --2- 172.21.15.92:0/2577307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc8670 0x562dd3390eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 --2- 172.21.15.92:0/2577307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fc0490 0x562dd3390970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 --2- 172.21.15.92:0/2577307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fe9350 0x562dd3390430 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 -- 172.21.15.92:0/2577307 >> 172.21.15.92:0/2577307 conn(0x562dd2fdd740 msgr2=0x562dd338e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 -- 172.21.15.92:0/2577307 shutdown_connections 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 -- 172.21.15.92:0/2577307 wait complete. 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 -- start start 2024-09-21T07:21:02.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.759+0000 7fd256ede740 1 Processor -- start 2024-09-21T07:21:02.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd256ede740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc0490 0x562dd33a0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd256ede740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc8670 0x562dd33a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd256ede740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 0x562dd33ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd256ede740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562dd3157890 con 0x562dd2fc8670 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd256ede740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562dd3290d40 con 0x562dd2fc0490 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd256ede740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562dd33a2f70 con 0x562dd2fe9350 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd256ede740 10 client.0 _ll_register_callbacks cb 0x562dd32f4c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd249d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc8670 0x562dd33a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd249d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc8670 0x562dd33a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46872/0 (socket says 172.21.15.92:46872) 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd249d9b640 1 -- 172.21.15.92:0/708835599 learned_addr learned my addr 172.21.15.92:0/708835599 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd24a59c640 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc0490 0x562dd33a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd249d9b640 1 -- 172.21.15.92:0/708835599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 msgr2=0x562dd33ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd24ad9d640 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 0x562dd33ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd249d9b640 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 0x562dd33ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd249d9b640 1 -- 172.21.15.92:0/708835599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc0490 msgr2=0x562dd33a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd249d9b640 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc0490 0x562dd33a0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd249d9b640 1 -- 172.21.15.92:0/708835599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dd33ac910 con 0x562dd2fc8670 2024-09-21T07:21:02.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd24ad9d640 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 0x562dd33ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd249d9b640 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc8670 0x562dd33a0a30 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd240015d00 tx=0x7fd2400156a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6e601e1f1ad4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.760+0000 7fd231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd231ffb640 1 -- 172.21.15.92:0/708835599 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24001a040 con 0x562dd2fc8670 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd231ffb640 1 -- 172.21.15.92:0/708835599 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fd240015a90 con 0x562dd2fc8670 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd256ede740 1 -- 172.21.15.92:0/708835599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd240010040 con 0x562dd2fc8670 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd231ffb640 1 -- 172.21.15.92:0/708835599 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd24002e050 con 0x562dd2fc8670 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd256ede740 10 client.17871 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd256ede740 1 -- 172.21.15.92:0/708835599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562dd33af240 con 0x562dd2fc8670 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd231ffb640 1 -- 172.21.15.92:0/708835599 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd240010040 con 0x562dd2fc8670 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd231ffb640 1 -- 172.21.15.92:0/708835599 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd2400273e0 con 0x562dd2fc8670 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd256ede740 10 client.17871 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd256ede740 10 client.17871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd256ede740 20 client.17871 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd256ede740 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562dd2fa7cd0 0x562dd33b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd256ede740 4 client.17871 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.761+0000 7fd256ede740 1 -- 172.21.15.92:0/708835599 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562dd3308db0 con 0x562dd2fa7cd0 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.762+0000 7fd24a59c640 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562dd2fa7cd0 0x562dd33b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.762+0000 7fd231ffb640 10 client.17871 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.762+0000 7fd24a59c640 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562dd2fa7cd0 0x562dd33b26b0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91c1ecd35e4110b1 server_cookie=80abadfd0bab11a9 in_seq=0 out_seq=0 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd231ffb640 1 -- 172.21.15.92:0/708835599 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562dd3308db0 con 0x562dd2fa7cd0 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd231ffb640 10 client.17871 handle_command_reply: tid=0 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 client.17871 shutdown 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 -- 172.21.15.92:0/708835599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc8670 msgr2=0x562dd33a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc8670 0x562dd33a0a30 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd240015d00 tx=0x7fd2400156a0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 -- 172.21.15.92:0/708835599 shutdown_connections 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562dd2fa7cd0 0x562dd33b26b0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 0x562dd33ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd231ffb640 0 client.17871 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:02.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc8670 0x562dd33a0a30 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 --2- 172.21.15.92:0/708835599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc0490 0x562dd33a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 -- 172.21.15.92:0/708835599 >> 172.21.15.92:0/708835599 conn(0x562dd2fdd740 msgr2=0x562dd3391e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:02.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 -- 172.21.15.92:0/708835599 shutdown_connections 2024-09-21T07:21:02.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 1 -- 172.21.15.92:0/708835599 wait complete. 2024-09-21T07:21:02.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.763+0000 7fd256ede740 20 client.17871 trim_cache size 0 max 16384 2024-09-21T07:21:02.773 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:02 smithi175 ceph-mon[34064]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-21T07:21:02.773 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:21:02.773 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:21:02.773 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:21:02.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.780+0000 7fd256ede740 1 Processor -- start 2024-09-21T07:21:02.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.780+0000 7fd256ede740 1 -- start start 2024-09-21T07:21:02.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd256ede740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd3395560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd256ede740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc8670 0x562dd3395aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd256ede740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 0x562dd338dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd256ede740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1aef20 con 0x562dd2fc0490 2024-09-21T07:21:02.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd256ede740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1b0a60 con 0x562dd2fc8670 2024-09-21T07:21:02.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd256ede740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1af5f0 con 0x562dd2fe9350 2024-09-21T07:21:02.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd3395560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd3395560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46886/0 (socket says 172.21.15.92:46886) 2024-09-21T07:21:02.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24a59c640 1 -- 172.21.15.92:0/3981533100 learned_addr learned my addr 172.21.15.92:0/3981533100 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:02.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd249d9b640 1 --2- 172.21.15.92:0/3981533100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc8670 0x562dd3395aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24ad9d640 1 --2- 172.21.15.92:0/3981533100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 0x562dd338dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24a59c640 1 -- 172.21.15.92:0/3981533100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 msgr2=0x562dd338dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:02.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24a59c640 1 --2- 172.21.15.92:0/3981533100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 0x562dd338dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24a59c640 1 -- 172.21.15.92:0/3981533100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc8670 msgr2=0x562dd3395aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:02.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24a59c640 1 --2- 172.21.15.92:0/3981533100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc8670 0x562dd3395aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24a59c640 1 -- 172.21.15.92:0/3981533100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dd339e790 con 0x562dd2fc0490 2024-09-21T07:21:02.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24ad9d640 1 --2- 172.21.15.92:0/3981533100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 0x562dd338dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:02.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd24a59c640 1 --2- 172.21.15.92:0/3981533100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd3395560 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009ca0 tx=0x7fd23c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42457fb2b89a586 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:02.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd233fff640 1 -- 172.21.15.92:0/3981533100 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c031b50 con 0x562dd2fc0490 2024-09-21T07:21:02.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd233fff640 1 -- 172.21.15.92:0/3981533100 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd23c036040 con 0x562dd2fc0490 2024-09-21T07:21:02.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.781+0000 7fd233fff640 1 -- 172.21.15.92:0/3981533100 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c030db0 con 0x562dd2fc0490 2024-09-21T07:21:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.782+0000 7fd256ede740 1 -- 172.21.15.92:0/3981533100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 msgr2=0x562dd3395560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.782+0000 7fd256ede740 1 --2- 172.21.15.92:0/3981533100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd3395560 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009ca0 tx=0x7fd23c041000 comp rx=0 tx=0).stop 2024-09-21T07:21:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.782+0000 7fd256ede740 1 -- 172.21.15.92:0/3981533100 shutdown_connections 2024-09-21T07:21:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.782+0000 7fd256ede740 1 --2- 172.21.15.92:0/3981533100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fe9350 0x562dd338dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.782+0000 7fd256ede740 1 --2- 172.21.15.92:0/3981533100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fc8670 0x562dd3395aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.782+0000 7fd256ede740 1 --2- 172.21.15.92:0/3981533100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd3395560 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.782+0000 7fd256ede740 1 -- 172.21.15.92:0/3981533100 >> 172.21.15.92:0/3981533100 conn(0x562dd2fdd740 msgr2=0x562dd339eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.782+0000 7fd256ede740 1 -- 172.21.15.92:0/3981533100 shutdown_connections 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.782+0000 7fd256ede740 1 -- 172.21.15.92:0/3981533100 wait complete. 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd256ede740 1 -- start start 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd256ede740 1 Processor -- start 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd256ede740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd33a8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd256ede740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fc8670 0x562dd33a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd256ede740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fe9350 0x562dd33a31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd256ede740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1b0390 con 0x562dd2fc0490 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd256ede740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1afcc0 con 0x562dd2fe9350 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd256ede740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1acf20 con 0x562dd2fc8670 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd256ede740 10 client.0 _ll_register_callbacks cb 0x7fd240018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd24a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd33a8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd24a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd33a8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46898/0 (socket says 172.21.15.92:46898) 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd24a59c640 1 -- 172.21.15.92:0/3412079837 learned_addr learned my addr 172.21.15.92:0/3412079837 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd24ad9d640 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fe9350 0x562dd33a31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd249d9b640 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fc8670 0x562dd33a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd24a59c640 1 -- 172.21.15.92:0/3412079837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fc8670 msgr2=0x562dd33a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd24a59c640 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fc8670 0x562dd33a87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd24a59c640 1 -- 172.21.15.92:0/3412079837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fe9350 msgr2=0x562dd33a31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd24a59c640 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fe9350 0x562dd33a31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd24a59c640 1 -- 172.21.15.92:0/3412079837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dd33a3730 con 0x562dd2fc0490 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.783+0000 7fd24ad9d640 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fe9350 0x562dd33a31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd24a59c640 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd33a8240 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fd23c043040 tx=0x7fd23c031bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabf7e0d18de7737 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd231ffb640 1 -- 172.21.15.92:0/3412079837 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c05f070 con 0x562dd2fc0490 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd231ffb640 1 -- 172.21.15.92:0/3412079837 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7fd23c004510 con 0x562dd2fc0490 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd256ede740 1 -- 172.21.15.92:0/3412079837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd23c036040 con 0x562dd2fc0490 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd231ffb640 1 -- 172.21.15.92:0/3412079837 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd23c004710 con 0x562dd2fc0490 2024-09-21T07:21:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd256ede740 10 client.17877 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd256ede740 1 -- 172.21.15.92:0/3412079837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562dd341d660 con 0x562dd2fc0490 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd231ffb640 1 -- 172.21.15.92:0/3412079837 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd23c036040 con 0x562dd2fc0490 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd231ffb640 1 -- 172.21.15.92:0/3412079837 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd23c049870 con 0x562dd2fc0490 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd256ede740 10 client.17877 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd256ede740 10 client.17877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd256ede740 20 client.17877 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd256ede740 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562dd2f7d080 0x562dd341fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd256ede740 4 client.17877 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.784+0000 7fd256ede740 1 -- 172.21.15.92:0/3412079837 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562dd3304860 con 0x562dd2f7d080 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.785+0000 7fd249d9b640 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562dd2f7d080 0x562dd341fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.785+0000 7fd231ffb640 10 client.17877 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.785+0000 7fd249d9b640 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562dd2f7d080 0x562dd341fe50 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e9410f3db7b8c9d server_cookie=5e03ba1e1552cf5a in_seq=0 out_seq=0 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.786+0000 7fd231ffb640 1 -- 172.21.15.92:0/3412079837 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562dd3304860 con 0x562dd2f7d080 2024-09-21T07:21:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.786+0000 7fd231ffb640 10 client.17877 handle_command_reply: tid=0 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.786+0000 7fd256ede740 1 client.17877 shutdown 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 1 -- 172.21.15.92:0/3412079837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 msgr2=0x562dd33a8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd33a8240 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fd23c043040 tx=0x7fd23c031bd0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 1 -- 172.21.15.92:0/3412079837 shutdown_connections 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562dd2f7d080 0x562dd341fe50 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562dd2fe9350 0x562dd33a31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562dd2fc8670 0x562dd33a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 1 --2- 172.21.15.92:0/3412079837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dd2fc0490 0x562dd33a8240 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd231ffb640 0 client.17877 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 1 -- 172.21.15.92:0/3412079837 >> 172.21.15.92:0/3412079837 conn(0x562dd2fdd740 msgr2=0x562dd339ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 1 -- 172.21.15.92:0/3412079837 shutdown_connections 2024-09-21T07:21:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 1 -- 172.21.15.92:0/3412079837 wait complete. 2024-09-21T07:21:02.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd256ede740 20 client.17877 trim_cache size 0 max 16384 2024-09-21T07:21:02.794 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:21:02.794 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:21:02.794 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "9d9b4374-4159-4e71-99a9-ab660a57d3cf", 2024-09-21T07:21:02.794 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:21:02.794 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:21:02.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd25096a640 1 -- 172.21.15.92:0/1585750561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2340b6680 msgr2=0x7fd2340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:02.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd25096a640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2340b6680 0x7fd2340b8b90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x562dd338f0b0 tx=0x7fd23c009940 comp rx=0 tx=0).stop 2024-09-21T07:21:02.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd25096a640 1 -- 172.21.15.92:0/1585750561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd24c108480 msgr2=0x7fd24c19bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:02.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.787+0000 7fd25096a640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd24c108480 0x7fd24c19bdf0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd244009fd0 tx=0x7fd24400b8e0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.788+0000 7fd25096a640 1 -- 172.21.15.92:0/1585750561 shutdown_connections 2024-09-21T07:21:02.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.788+0000 7fd25096a640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd2340b6680 0x7fd2340b8b90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.788+0000 7fd25096a640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd24c108480 0x7fd24c19bdf0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.788+0000 7fd25096a640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c107b30 0x7fd24c19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.788+0000 7fd25096a640 1 --2- 172.21.15.92:0/1585750561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd24c1021f0 0x7fd24c19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:02.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.788+0000 7fd25096a640 1 -- 172.21.15.92:0/1585750561 >> 172.21.15.92:0/1585750561 conn(0x7fd24c077c60 msgr2=0x7fd24c105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:02.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.788+0000 7fd25096a640 1 -- 172.21.15.92:0/1585750561 shutdown_connections 2024-09-21T07:21:02.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:02.788+0000 7fd25096a640 1 -- 172.21.15.92:0/1585750561 wait complete. 2024-09-21T07:21:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:02 smithi169 ceph-mon[33705]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-21T07:21:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:21:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:21:02.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:21:03.662 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:21:03.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:03 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:21:03.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:03 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:03.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:03 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:21:03.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:03 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:03.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:03 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:21:03.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:03 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:03.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:03 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:21:03.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:03 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:03.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:03 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:21:03.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:03 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:03.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:03 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:21:03.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:03 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:03.911 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:04.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.400+0000 7f4c82c23640 1 -- 172.21.15.92:0/3154690571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c1083b0 msgr2=0x7f4c7c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:04.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.400+0000 7f4c82c23640 1 --2- 172.21.15.92:0/3154690571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c1083b0 0x7f4c7c1087c0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009900 tx=0x7f4c7002a410 comp rx=0 tx=0).stop 2024-09-21T07:21:04.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.400+0000 7f4c82c23640 1 -- 172.21.15.92:0/3154690571 shutdown_connections 2024-09-21T07:21:04.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.400+0000 7f4c82c23640 1 --2- 172.21.15.92:0/3154690571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7c108d00 0x7f4c7c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.400+0000 7f4c82c23640 1 --2- 172.21.15.92:0/3154690571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c1083b0 0x7f4c7c1087c0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.400+0000 7f4c82c23640 1 --2- 172.21.15.92:0/3154690571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c7c102ac0 0x7f4c7c102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.400+0000 7f4c82c23640 1 -- 172.21.15.92:0/3154690571 >> 172.21.15.92:0/3154690571 conn(0x7f4c7c079790 msgr2=0x7f4c7c079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:04.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.400+0000 7f4c82c23640 1 -- 172.21.15.92:0/3154690571 shutdown_connections 2024-09-21T07:21:04.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.400+0000 7f4c82c23640 1 -- 172.21.15.92:0/3154690571 wait complete. 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c82c23640 1 Processor -- start 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c82c23640 1 -- start start 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c82c23640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c7c102ac0 0x7f4c7c19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c82c23640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c1083b0 0x7f4c7c19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c82c23640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7c108d00 0x7f4c7c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c82c23640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c112870 con 0x7f4c7c1083b0 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c82c23640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1126f0 con 0x7f4c7c108d00 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c82c23640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1129f0 con 0x7f4c7c102ac0 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c1083b0 0x7f4c7c19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c1083b0 0x7f4c7c19b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46922/0 (socket says 172.21.15.92:46922) 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c7bfff640 1 -- 172.21.15.92:0/3310236685 learned_addr learned my addr 172.21.15.92:0/3310236685 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:04.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c809bf640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c7c102ac0 0x7f4c7c19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c811c0640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7c108d00 0x7f4c7c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c7bfff640 1 -- 172.21.15.92:0/3310236685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c7c102ac0 msgr2=0x7f4c7c19b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c7c102ac0 0x7f4c7c19b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c7bfff640 1 -- 172.21.15.92:0/3310236685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7c108d00 msgr2=0x7f4c7c19bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7c108d00 0x7f4c7c19bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.401+0000 7f4c7bfff640 1 -- 172.21.15.92:0/3310236685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c1a6490 con 0x7f4c7c1083b0 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.402+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c1083b0 0x7f4c7c19b6c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4c70005940 tx=0x7f4c700040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.402+0000 7f4c79ffb640 1 -- 172.21.15.92:0/3310236685 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7003f030 con 0x7f4c7c1083b0 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.402+0000 7f4c79ffb640 1 -- 172.21.15.92:0/3310236685 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c70003a80 con 0x7f4c7c1083b0 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.402+0000 7f4c82c23640 1 -- 172.21.15.92:0/3310236685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c1a6720 con 0x7f4c7c1083b0 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.402+0000 7f4c79ffb640 1 -- 172.21.15.92:0/3310236685 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70035070 con 0x7f4c7c1083b0 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.402+0000 7f4c82c23640 1 -- 172.21.15.92:0/3310236685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1a6c00 con 0x7f4c7c1083b0 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.404+0000 7f4c89197740 1 Processor -- start 2024-09-21T07:21:04.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.404+0000 7f4c89197740 1 -- start start 2024-09-21T07:21:04.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c89197740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a336070 0x555b5a6dd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c89197740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a30d1b0 0x555b5a6dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c79ffb640 1 -- 172.21.15.92:0/3310236685 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f4c70042030 con 0x7f4c7c1083b0 2024-09-21T07:21:04.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c89197740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 0x555b5a6ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c89197740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555b5a653e50 con 0x555b5a30d1b0 2024-09-21T07:21:04.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c89197740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555b5a643280 con 0x555b5a336070 2024-09-21T07:21:04.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c89197740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555b5a647090 con 0x555b5a315390 2024-09-21T07:21:04.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c809bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a30d1b0 0x555b5a6dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c809bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a30d1b0 0x555b5a6dd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46936/0 (socket says 172.21.15.92:46936) 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c809bf640 1 -- 172.21.15.92:0/1011512976 learned_addr learned my addr 172.21.15.92:0/1011512976 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c811c0640 1 --2- 172.21.15.92:0/1011512976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a336070 0x555b5a6dd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/1011512976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 0x555b5a6ddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c809bf640 1 -- 172.21.15.92:0/1011512976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 msgr2=0x555b5a6ddcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c809bf640 1 --2- 172.21.15.92:0/1011512976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 0x555b5a6ddcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c809bf640 1 -- 172.21.15.92:0/1011512976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a336070 msgr2=0x555b5a6dd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c809bf640 1 --2- 172.21.15.92:0/1011512976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a336070 0x555b5a6dd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c809bf640 1 -- 172.21.15.92:0/1011512976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5a3a1650 con 0x555b5a30d1b0 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.405+0000 7f4c809bf640 1 --2- 172.21.15.92:0/1011512976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a30d1b0 0x555b5a6dd7b0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c004650 tx=0x7f4c6c00bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cd9c740680e73f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.406+0000 7f4c62ffd640 1 -- 172.21.15.92:0/1011512976 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c003bd0 con 0x555b5a30d1b0 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.406+0000 7f4c79ffb640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4c640b6680 0x7f4c640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.406+0000 7f4c62ffd640 1 -- 172.21.15.92:0/1011512976 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c6c015070 con 0x555b5a30d1b0 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.406+0000 7f4c62ffd640 1 -- 172.21.15.92:0/1011512976 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c004c10 con 0x555b5a30d1b0 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.406+0000 7f4c811c0640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4c640b6680 0x7f4c640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.406+0000 7f4c79ffb640 1 -- 172.21.15.92:0/3310236685 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f4c70108070 con 0x7f4c7c1083b0 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.406+0000 7f4c89197740 1 -- 172.21.15.92:0/1011512976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a30d1b0 msgr2=0x555b5a6dd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.406+0000 7f4c811c0640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4c640b6680 0x7f4c640b8b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c06c900 tx=0x7f4c74009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.406+0000 7f4c89197740 1 --2- 172.21.15.92:0/1011512976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a30d1b0 0x555b5a6dd7b0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c004650 tx=0x7f4c6c00bba0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.407+0000 7f4c89197740 1 -- 172.21.15.92:0/1011512976 shutdown_connections 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.407+0000 7f4c89197740 1 --2- 172.21.15.92:0/1011512976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 0x555b5a6ddcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.407+0000 7f4c89197740 1 --2- 172.21.15.92:0/1011512976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a30d1b0 0x555b5a6dd7b0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.407+0000 7f4c89197740 1 --2- 172.21.15.92:0/1011512976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a336070 0x555b5a6dd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.407+0000 7f4c89197740 1 -- 172.21.15.92:0/1011512976 >> 172.21.15.92:0/1011512976 conn(0x555b5a32a460 msgr2=0x555b5a6db160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.407+0000 7f4c89197740 1 -- 172.21.15.92:0/1011512976 shutdown_connections 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.407+0000 7f4c89197740 1 -- 172.21.15.92:0/1011512976 wait complete. 2024-09-21T07:21:04.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.407+0000 7f4c89197740 1 -- start start 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.407+0000 7f4c89197740 1 Processor -- start 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c89197740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a30d1b0 0x555b5a6e8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c89197740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a315390 0x555b5a6e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c89197740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a336070 0x555b5a6f9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c89197740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555b5a4a4700 con 0x555b5a315390 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c89197740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555b5a5de110 con 0x555b5a336070 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c89197740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555b5a6efe60 con 0x555b5a30d1b0 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c89197740 10 client.0 _ll_register_callbacks cb 0x555b5a5f7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a315390 0x555b5a6e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a315390 0x555b5a6e8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46938/0 (socket says 172.21.15.92:46938) 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c7bfff640 1 -- 172.21.15.92:0/1816126186 learned_addr learned my addr 172.21.15.92:0/1816126186 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c809bf640 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a30d1b0 0x555b5a6e8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c811c0640 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a336070 0x555b5a6f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c7bfff640 1 -- 172.21.15.92:0/1816126186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a30d1b0 msgr2=0x555b5a6e8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a30d1b0 0x555b5a6e8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c7bfff640 1 -- 172.21.15.92:0/1816126186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a336070 msgr2=0x555b5a6f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a336070 0x555b5a6f9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c7bfff640 1 -- 172.21.15.92:0/1816126186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5a60bc40 con 0x555b5a315390 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a315390 0x555b5a6e8e40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f4c7004a000 tx=0x7f4c70003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991df48416caa2c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c5bfff640 1 -- 172.21.15.92:0/1816126186 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70049070 con 0x555b5a315390 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c5bfff640 1 -- 172.21.15.92:0/1816126186 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f4c700d7050 con 0x555b5a315390 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.408+0000 7f4c89197740 1 -- 172.21.15.92:0/1816126186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c6c015070 con 0x555b5a315390 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c5bfff640 1 -- 172.21.15.92:0/1816126186 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4c700cd890 con 0x555b5a315390 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c89197740 10 client.17889 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c89197740 1 -- 172.21.15.92:0/1816126186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555b5a6fbb40 con 0x555b5a315390 2024-09-21T07:21:04.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c5bfff640 1 -- 172.21.15.92:0/1816126186 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c6c015070 con 0x555b5a315390 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c5bfff640 1 -- 172.21.15.92:0/1816126186 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4c7010a0d0 con 0x555b5a315390 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c89197740 10 client.17889 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c89197740 10 client.17889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c89197740 20 client.17889 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c89197740 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555b5a2f49f0 0x555b5a6fef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c89197740 4 client.17889 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c89197740 1 -- 172.21.15.92:0/1816126186 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b5a655da0 con 0x555b5a2f49f0 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.409+0000 7f4c809bf640 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555b5a2f49f0 0x555b5a6fef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.410+0000 7f4c5bfff640 10 client.17889 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.410+0000 7f4c809bf640 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555b5a2f49f0 0x555b5a6fef30 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a150fbc712424f2f server_cookie=367bcf6c9aef360c in_seq=0 out_seq=0 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.410+0000 7f4c5bfff640 1 -- 172.21.15.92:0/1816126186 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b5a655da0 con 0x555b5a2f49f0 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.410+0000 7f4c5bfff640 10 client.17889 handle_command_reply: tid=0 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 client.17889 shutdown 2024-09-21T07:21:04.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 -- 172.21.15.92:0/1816126186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a315390 msgr2=0x555b5a6e8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:04.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a315390 0x555b5a6e8e40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f4c7004a000 tx=0x7f4c70003e60 comp rx=0 tx=0).stop 2024-09-21T07:21:04.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 -- 172.21.15.92:0/1816126186 shutdown_connections 2024-09-21T07:21:04.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555b5a2f49f0 0x555b5a6fef30 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a336070 0x555b5a6f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a315390 0x555b5a6e8e40 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c5bfff640 0 client.17889 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:04.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 --2- 172.21.15.92:0/1816126186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a30d1b0 0x555b5a6e8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 -- 172.21.15.92:0/1816126186 >> 172.21.15.92:0/1816126186 conn(0x555b5a32a460 msgr2=0x555b5a6e0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:04.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 -- 172.21.15.92:0/1816126186 shutdown_connections 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 1 -- 172.21.15.92:0/1816126186 wait complete. 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.411+0000 7f4c89197740 20 client.17889 trim_cache size 0 max 16384 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c89197740 1 Processor -- start 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c89197740 1 -- start start 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c89197740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6dec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c89197740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a30d1b0 0x555b5a6f9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c89197740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a315390 0x555b5a6ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c89197740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1aecb0 con 0x555b5a2f49f0 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c89197740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1b07f0 con 0x555b5a315390 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c89197740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1af380 con 0x555b5a30d1b0 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c809bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c809bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6dec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46952/0 (socket says 172.21.15.92:46952) 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c809bf640 1 -- 172.21.15.92:0/1401342342 learned_addr learned my addr 172.21.15.92:0/1401342342 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:04.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/1401342342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a30d1b0 0x555b5a6f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c809bf640 1 -- 172.21.15.92:0/1401342342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a30d1b0 msgr2=0x555b5a6f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c809bf640 1 --2- 172.21.15.92:0/1401342342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a30d1b0 0x555b5a6f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c809bf640 1 -- 172.21.15.92:0/1401342342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a315390 msgr2=0x555b5a6ea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c811c0640 1 --2- 172.21.15.92:0/1401342342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a315390 0x555b5a6ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c809bf640 1 --2- 172.21.15.92:0/1401342342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a315390 0x555b5a6ea4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.429+0000 7f4c809bf640 1 -- 172.21.15.92:0/1401342342 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5a6df560 con 0x555b5a2f49f0 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.430+0000 7f4c809bf640 1 --2- 172.21.15.92:0/1401342342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6dec60 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x555b5a6dbef0 tx=0x7f4c6c00b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0582b4417ca0a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.430+0000 7f4c627fc640 1 -- 172.21.15.92:0/1401342342 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c032070 con 0x555b5a2f49f0 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.430+0000 7f4c627fc640 1 -- 172.21.15.92:0/1401342342 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c6c015040 con 0x555b5a2f49f0 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.430+0000 7f4c627fc640 1 -- 172.21.15.92:0/1401342342 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0116a0 con 0x555b5a2f49f0 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.430+0000 7f4c89197740 1 -- 172.21.15.92:0/1401342342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 msgr2=0x555b5a6dec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.430+0000 7f4c89197740 1 --2- 172.21.15.92:0/1401342342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6dec60 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x555b5a6dbef0 tx=0x7f4c6c00b3e0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.431+0000 7f4c89197740 1 -- 172.21.15.92:0/1401342342 shutdown_connections 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.431+0000 7f4c89197740 1 --2- 172.21.15.92:0/1401342342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a315390 0x555b5a6ea4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.431+0000 7f4c89197740 1 --2- 172.21.15.92:0/1401342342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a30d1b0 0x555b5a6f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.431+0000 7f4c89197740 1 --2- 172.21.15.92:0/1401342342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6dec60 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.431+0000 7f4c89197740 1 -- 172.21.15.92:0/1401342342 >> 172.21.15.92:0/1401342342 conn(0x555b5a32a460 msgr2=0x555b5a6e9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.431+0000 7f4c89197740 1 -- 172.21.15.92:0/1401342342 shutdown_connections 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.431+0000 7f4c89197740 1 -- 172.21.15.92:0/1401342342 wait complete. 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.431+0000 7f4c89197740 1 -- start start 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.431+0000 7f4c89197740 1 Processor -- start 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c89197740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6f1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c89197740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a30d1b0 0x555b5a6f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c89197740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 0x555b5a6f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c89197740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1b0120 con 0x555b5a2f49f0 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c89197740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1afa50 con 0x555b5a30d1b0 2024-09-21T07:21:04.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c89197740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1accb0 con 0x555b5a315390 2024-09-21T07:21:04.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c89197740 10 client.0 _ll_register_callbacks cb 0x7f4c70005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:04.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c809bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c809bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6f1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46964/0 (socket says 172.21.15.92:46964) 2024-09-21T07:21:04.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c809bf640 1 -- 172.21.15.92:0/641712173 learned_addr learned my addr 172.21.15.92:0/641712173 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:04.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a30d1b0 0x555b5a6f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c811c0640 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 0x555b5a6f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c809bf640 1 -- 172.21.15.92:0/641712173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 msgr2=0x555b5a6f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:04.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c809bf640 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 0x555b5a6f1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c809bf640 1 -- 172.21.15.92:0/641712173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a30d1b0 msgr2=0x555b5a6f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:04.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c809bf640 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a30d1b0 0x555b5a6f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c809bf640 1 -- 172.21.15.92:0/641712173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5a768940 con 0x555b5a2f49f0 2024-09-21T07:21:04.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a30d1b0 0x555b5a6f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:04.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c811c0640 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 0x555b5a6f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:04.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c809bf640 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6f1080 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c030040 tx=0x7f4c6c003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23612ce9f413613b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c5bfff640 1 -- 172.21.15.92:0/641712173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c032040 con 0x555b5a2f49f0 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c5bfff640 1 -- 172.21.15.92:0/641712173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9540+0+0 (secure 0 0 0) 0x7f4c6c02d650 con 0x555b5a2f49f0 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.432+0000 7f4c89197740 1 -- 172.21.15.92:0/641712173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c6c015040 con 0x555b5a2f49f0 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c5bfff640 1 -- 172.21.15.92:0/641712173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4c6c043050 con 0x555b5a2f49f0 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c89197740 10 client.17895 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c89197740 1 -- 172.21.15.92:0/641712173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555b5a769b40 con 0x555b5a2f49f0 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c5bfff640 1 -- 172.21.15.92:0/641712173 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c6c015040 con 0x555b5a2f49f0 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c5bfff640 1 -- 172.21.15.92:0/641712173 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4c6c03e030 con 0x555b5a2f49f0 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c89197740 10 client.17895 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c89197740 10 client.17895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c89197740 20 client.17895 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:04.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c89197740 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555b5a336070 0x555b5a76c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c89197740 4 client.17895 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c89197740 1 -- 172.21.15.92:0/641712173 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555b5a651850 con 0x555b5a336070 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.433+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555b5a336070 0x555b5a76c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555b5a336070 0x555b5a76c0a0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb3dffd3d9d83c89 server_cookie=9ec1eff421dbe891 in_seq=0 out_seq=0 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c5bfff640 10 client.17895 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c5bfff640 1 -- 172.21.15.92:0/641712173 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x555b5a651850 con 0x555b5a336070 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c5bfff640 10 client.17895 handle_command_reply: tid=0 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 client.17895 shutdown 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 -- 172.21.15.92:0/641712173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 msgr2=0x555b5a6f1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6f1080 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c030040 tx=0x7f4c6c003d90 comp rx=0 tx=0).stop 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 -- 172.21.15.92:0/641712173 shutdown_connections 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x555b5a336070 0x555b5a76c0a0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b5a315390 0x555b5a6f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b5a30d1b0 0x555b5a6f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c5bfff640 0 client.17895 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:04.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 --2- 172.21.15.92:0/641712173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b5a2f49f0 0x555b5a6f1080 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 -- 172.21.15.92:0/641712173 >> 172.21.15.92:0/641712173 conn(0x555b5a32a460 msgr2=0x555b5a6ea6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:04.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 -- 172.21.15.92:0/641712173 shutdown_connections 2024-09-21T07:21:04.547 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:21:04.547 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:21:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:21:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: "9d9b4374-4159-4e71-99a9-ab660a57d3cf": { 2024-09-21T07:21:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "9d9b4374-4159-4e71-99a9-ab660a57d3cf", 2024-09-21T07:21:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:21:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:21:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:21:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: "9d9b4374-4159-4e71-99a9-ab660a57d3cf": { 2024-09-21T07:21:04.548 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:02.785673+0000", 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.549 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "3b742b30-fd49-4ec5-844d-6cfbec3bbf45": { 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:48.290915+0000", 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.550 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:21:04.551 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.552 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:21:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:02.985669+0000", 2024-09-21T07:21:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.553 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:21:04.554 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:21:04.555 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:21:04.556 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:21:04.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 1 -- 172.21.15.92:0/641712173 wait complete. 2024-09-21T07:21:04.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.434+0000 7f4c89197740 20 client.17895 trim_cache size 0 max 16384 2024-09-21T07:21:04.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 -- 172.21.15.92:0/3310236685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4c640b6680 msgr2=0x7f4c640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:04.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4c640b6680 0x7f4c640b8b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c06c900 tx=0x7f4c74009760 comp rx=0 tx=0).stop 2024-09-21T07:21:04.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 -- 172.21.15.92:0/3310236685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c1083b0 msgr2=0x7f4c7c19b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:04.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c1083b0 0x7f4c7c19b6c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4c70005940 tx=0x7f4c700040e0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 -- 172.21.15.92:0/3310236685 shutdown_connections 2024-09-21T07:21:04.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4c640b6680 0x7f4c640b8b90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7c108d00 0x7f4c7c19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c1083b0 0x7f4c7c19b6c0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 --2- 172.21.15.92:0/3310236685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c7c102ac0 0x7f4c7c19b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:04.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 -- 172.21.15.92:0/3310236685 >> 172.21.15.92:0/3310236685 conn(0x7f4c7c079790 msgr2=0x7f4c7c104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:04.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 -- 172.21.15.92:0/3310236685 shutdown_connections 2024-09-21T07:21:04.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:04.435+0000 7f4c82c23640 1 -- 172.21.15.92:0/3310236685 wait complete. 2024-09-21T07:21:04.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:04 smithi092 ceph-mon[30987]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:21:04.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:04 smithi169 ceph-mon[33705]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:21:05.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:04 smithi175 ceph-mon[34064]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:21:05.273 INFO:tasks.cephfs.filesystem:scrub status for tag:9d9b4374-4159-4e71-99a9-ab660a57d3cf - {'path': '/', 'tag': '9d9b4374-4159-4e71-99a9-ab660a57d3cf', 'options': 'recursive,force'} 2024-09-21T07:21:05.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:05 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:21:05.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:05 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:21:06.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:05 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:21:06.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:06 smithi092 ceph-mon[30987]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T07:21:06.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:06 smithi169 ceph-mon[33705]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T07:21:07.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:06 smithi175 ceph-mon[34064]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T07:21:08.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:07 smithi092 ceph-mon[30987]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-21T07:21:08.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:07 smithi169 ceph-mon[33705]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-21T07:21:08.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:07 smithi175 ceph-mon[34064]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-21T07:21:10.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:09 smithi169 ceph-mon[33705]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-21T07:21:10.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:09 smithi175 ceph-mon[34064]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-21T07:21:10.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:09 smithi092 ceph-mon[30987]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-21T07:21:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:11 smithi092 ceph-mon[30987]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T07:21:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:11 smithi092 ceph-mon[30987]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-21T07:21:12.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:11 smithi169 ceph-mon[33705]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T07:21:12.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:11 smithi169 ceph-mon[33705]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-21T07:21:12.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:11 smithi175 ceph-mon[34064]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T07:21:12.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:11 smithi175 ceph-mon[34064]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-21T07:21:14.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:13 smithi092 ceph-mon[30987]: pgmap v587: 129 pgs: 129 active+clean; 9.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T07:21:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:13 smithi169 ceph-mon[33705]: pgmap v587: 129 pgs: 129 active+clean; 9.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T07:21:14.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:13 smithi175 ceph-mon[34064]: pgmap v587: 129 pgs: 129 active+clean; 9.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T07:21:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:15 smithi092 ceph-mon[30987]: pgmap v588: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:21:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:15 smithi169 ceph-mon[33705]: pgmap v588: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:21:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:15 smithi175 ceph-mon[34064]: pgmap v588: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:21:18.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:17 smithi092 ceph-mon[30987]: pgmap v589: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:21:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:17 smithi169 ceph-mon[33705]: pgmap v589: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:21:18.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:17 smithi175 ceph-mon[34064]: pgmap v589: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:21:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:20 smithi175 ceph-mon[34064]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T07:21:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:20 smithi175 ceph-mon[34064]: pgmap v591: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2024-09-21T07:21:20.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:20 smithi092 ceph-mon[30987]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T07:21:20.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:20 smithi092 ceph-mon[30987]: pgmap v591: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2024-09-21T07:21:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:20 smithi169 ceph-mon[33705]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T07:21:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:20 smithi169 ceph-mon[33705]: pgmap v591: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2024-09-21T07:21:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:21 smithi169 ceph-mon[33705]: pgmap v592: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:21:22.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:21 smithi175 ceph-mon[34064]: pgmap v592: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:21:22.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:21 smithi092 ceph-mon[30987]: pgmap v592: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:21:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:23 smithi169 ceph-mon[33705]: pgmap v593: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:21:24.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:23 smithi175 ceph-mon[34064]: pgmap v593: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:21:24.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:23 smithi092 ceph-mon[30987]: pgmap v593: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:21:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:25 smithi169 ceph-mon[33705]: pgmap v594: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:21:26.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:25 smithi175 ceph-mon[34064]: pgmap v594: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:21:26.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:25 smithi092 ceph-mon[30987]: pgmap v594: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:21:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:27 smithi169 ceph-mon[33705]: pgmap v595: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:21:28.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:27 smithi175 ceph-mon[34064]: pgmap v595: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:21:28.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:27 smithi092 ceph-mon[30987]: pgmap v595: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:21:30.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:29 smithi169 ceph-mon[33705]: pgmap v596: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T07:21:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:29 smithi175 ceph-mon[34064]: pgmap v596: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T07:21:30.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:29 smithi092 ceph-mon[30987]: pgmap v596: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T07:21:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:31 smithi169 ceph-mon[33705]: pgmap v597: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:21:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:31 smithi175 ceph-mon[34064]: pgmap v597: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:21:32.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:31 smithi092 ceph-mon[30987]: pgmap v597: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:21:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:33 smithi169 ceph-mon[33705]: pgmap v598: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:21:34.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:33 smithi175 ceph-mon[34064]: pgmap v598: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:21:34.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:33 smithi092 ceph-mon[30987]: pgmap v598: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:21:35.274 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:21:35.542 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:35.961 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:35 smithi092 ceph-mon[30987]: pgmap v599: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:21:36.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.053+0000 7ffa69545640 1 -- 172.21.15.92:0/3824449847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa641083a0 msgr2=0x7ffa641087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.053+0000 7ffa69545640 1 --2- 172.21.15.92:0/3824449847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa641083a0 0x7ffa641087b0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009900 tx=0x7ffa4c02a410 comp rx=0 tx=0).stop 2024-09-21T07:21:36.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.053+0000 7ffa69545640 1 -- 172.21.15.92:0/3824449847 shutdown_connections 2024-09-21T07:21:36.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.053+0000 7ffa69545640 1 --2- 172.21.15.92:0/3824449847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa64108cf0 0x7ffa6410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.053+0000 7ffa69545640 1 --2- 172.21.15.92:0/3824449847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa641083a0 0x7ffa641087b0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.053+0000 7ffa69545640 1 --2- 172.21.15.92:0/3824449847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa64102a60 0x7ffa64102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.053+0000 7ffa69545640 1 -- 172.21.15.92:0/3824449847 >> 172.21.15.92:0/3824449847 conn(0x7ffa64079730 msgr2=0x7ffa64079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:36.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.053+0000 7ffa69545640 1 -- 172.21.15.92:0/3824449847 shutdown_connections 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.053+0000 7ffa69545640 1 -- 172.21.15.92:0/3824449847 wait complete. 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.054+0000 7ffa69545640 1 Processor -- start 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.054+0000 7ffa69545640 1 -- start start 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.054+0000 7ffa69545640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa64102a60 0x7ffa6419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.054+0000 7ffa69545640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa641083a0 0x7ffa6419b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.054+0000 7ffa69545640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa64108cf0 0x7ffa6419bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.054+0000 7ffa69545640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64112810 con 0x7ffa641083a0 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.054+0000 7ffa69545640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64112690 con 0x7ffa64102a60 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.054+0000 7ffa69545640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64112990 con 0x7ffa64108cf0 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa5a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa641083a0 0x7ffa6419b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa5a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa641083a0 0x7ffa6419b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37392/0 (socket says 172.21.15.92:37392) 2024-09-21T07:21:36.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa5a7fc640 1 -- 172.21.15.92:0/1180089480 learned_addr learned my addr 172.21.15.92:0/1180089480 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa64102a60 0x7ffa6419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa637fe640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa64108cf0 0x7ffa6419bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa5a7fc640 1 -- 172.21.15.92:0/1180089480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa64108cf0 msgr2=0x7ffa6419bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa64108cf0 0x7ffa6419bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa5a7fc640 1 -- 172.21.15.92:0/1180089480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa64102a60 msgr2=0x7ffa6419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa64102a60 0x7ffa6419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa5a7fc640 1 -- 172.21.15.92:0/1180089480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa641a6440 con 0x7ffa641083a0 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa637fe640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa64108cf0 0x7ffa6419bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa641083a0 0x7ffa6419b6c0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c005940 tx=0x7ffa4c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa60ff9640 1 -- 172.21.15.92:0/1180089480 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c03f030 con 0x7ffa641083a0 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa60ff9640 1 -- 172.21.15.92:0/1180089480 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa4c003c90 con 0x7ffa641083a0 2024-09-21T07:21:36.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa69545640 1 -- 172.21.15.92:0/1180089480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa641a66d0 con 0x7ffa641083a0 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa60ff9640 1 -- 172.21.15.92:0/1180089480 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c035070 con 0x7ffa641083a0 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.055+0000 7ffa69545640 1 -- 172.21.15.92:0/1180089480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa641a6bb0 con 0x7ffa641083a0 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.058+0000 7ffa6fab9740 1 Processor -- start 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.058+0000 7ffa6fab9740 1 -- start start 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.058+0000 7ffa60ff9640 1 -- 172.21.15.92:0/1180089480 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7ffa4c042030 con 0x7ffa641083a0 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.058+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112bc7070 0x562112f6e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.058+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112b9e1b0 0x562112f6eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.058+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f6f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562112ee4e50 con 0x562112bc7070 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562112ed4280 con 0x562112ba6390 2024-09-21T07:21:36.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562112ed8090 con 0x562112b9e1b0 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112bc7070 0x562112f6e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112bc7070 0x562112f6e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37398/0 (socket says 172.21.15.92:37398) 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa637fe640 1 -- 172.21.15.92:0/3785675077 learned_addr learned my addr 172.21.15.92:0/3785675077 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/3785675077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112b9e1b0 0x562112f6eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/3785675077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f6f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa637fe640 1 -- 172.21.15.92:0/3785675077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112b9e1b0 msgr2=0x562112f6eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa637fe640 1 --2- 172.21.15.92:0/3785675077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112b9e1b0 0x562112f6eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa637fe640 1 -- 172.21.15.92:0/3785675077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 msgr2=0x562112f6f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa637fe640 1 --2- 172.21.15.92:0/3785675077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f6f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa637fe640 1 -- 172.21.15.92:0/3785675077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562112c32650 con 0x562112bc7070 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa60ff9640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ffa500b6680 0x7ffa500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa637fe640 1 --2- 172.21.15.92:0/3785675077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112bc7070 0x562112f6e650 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009f30 tx=0x7ffa5c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0edd024b64490e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:36.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ffa500b6680 0x7ffa500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa60ff9640 1 -- 172.21.15.92:0/1180089480 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7ffa4c1080b0 con 0x7ffa641083a0 2024-09-21T07:21:36.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.059+0000 7ffa597fa640 1 -- 172.21.15.92:0/3785675077 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c016070 con 0x562112bc7070 2024-09-21T07:21:36.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.060+0000 7ffa597fa640 1 -- 172.21.15.92:0/3785675077 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa5c01baf0 con 0x562112bc7070 2024-09-21T07:21:36.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.060+0000 7ffa597fa640 1 -- 172.21.15.92:0/3785675077 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c012b20 con 0x562112bc7070 2024-09-21T07:21:36.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.060+0000 7ffa6fab9740 1 -- 172.21.15.92:0/3785675077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112bc7070 msgr2=0x562112f6e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.060+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ffa500b6680 0x7ffa500b8b90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x562112f6d2d0 tx=0x7ffa5400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:36.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.060+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/3785675077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112bc7070 0x562112f6e650 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009f30 tx=0x7ffa5c010800 comp rx=0 tx=0).stop 2024-09-21T07:21:36.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 -- 172.21.15.92:0/3785675077 shutdown_connections 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/3785675077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f6f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/3785675077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112b9e1b0 0x562112f6eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/3785675077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112bc7070 0x562112f6e650 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 -- 172.21.15.92:0/3785675077 >> 172.21.15.92:0/3785675077 conn(0x562112bbb460 msgr2=0x562112f6c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 -- 172.21.15.92:0/3785675077 shutdown_connections 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 -- 172.21.15.92:0/3785675077 wait complete. 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 -- start start 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 Processor -- start 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f79d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f7a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.061+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 0x562112f86120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562112d35700 con 0x562112b9e1b0 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562112e6f110 con 0x562112ba6390 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562112f7ce30 con 0x562112bc7070 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa6fab9740 10 client.0 _ll_register_callbacks cb 0x562112e88990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f79d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f79d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37410/0 (socket says 172.21.15.92:37410) 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa62ffd640 1 -- 172.21.15.92:0/2084419960 learned_addr learned my addr 172.21.15.92:0/2084419960 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f7a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa637fe640 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 0x562112f86120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa62ffd640 1 -- 172.21.15.92:0/2084419960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 msgr2=0x562112f86120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:36.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 0x562112f86120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa62ffd640 1 -- 172.21.15.92:0/2084419960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 msgr2=0x562112f7a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f7a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa62ffd640 1 -- 172.21.15.92:0/2084419960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562112e9cc40 con 0x562112b9e1b0 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa637fe640 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 0x562112f86120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f79d70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ffa5401f550 tx=0x7ffa54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2065e8eb83d4623 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa4a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/2084419960 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5402c060 con 0x562112b9e1b0 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/2084419960 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7ffa54017030 con 0x562112b9e1b0 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.062+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2084419960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa5c01baf0 con 0x562112b9e1b0 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/2084419960 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffa54033050 con 0x562112b9e1b0 2024-09-21T07:21:36.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa6fab9740 10 client.17907 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2084419960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562112f88c00 con 0x562112b9e1b0 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/2084419960 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa5c01baf0 con 0x562112b9e1b0 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/2084419960 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ffa54027710 con 0x562112b9e1b0 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa6fab9740 10 client.17907 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa6fab9740 10 client.17907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa6fab9740 20 client.17907 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562112b859f0 0x562112f8c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa6fab9740 4 client.17907 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.063+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2084419960 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562112ee6da0 con 0x562112b859f0 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.064+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562112b859f0 0x562112f8c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.064+0000 7ffa4a7fc640 10 client.17907 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:36.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.064+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562112b859f0 0x562112f8c130 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc97e43dfdb726af server_cookie=61dc4cd68501a621 in_seq=0 out_seq=0 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/2084419960 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562112ee6da0 con 0x562112b859f0 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa4a7fc640 10 client.17907 handle_command_reply: tid=0 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 client.17907 shutdown 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2084419960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 msgr2=0x562112f79d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f79d70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ffa5401f550 tx=0x7ffa54004730 comp rx=0 tx=0).stop 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2084419960 shutdown_connections 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562112b859f0 0x562112f8c130 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 0x562112f86120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f7a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/2084419960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f79d70 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2084419960 >> 172.21.15.92:0/2084419960 conn(0x562112bbb460 msgr2=0x562112f71800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:36.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa4a7fc640 0 client.17907 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:36.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2084419960 shutdown_connections 2024-09-21T07:21:36.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2084419960 wait complete. 2024-09-21T07:21:36.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.065+0000 7ffa6fab9740 20 client.17907 trim_cache size 0 max 16384 2024-09-21T07:21:36.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.082+0000 7ffa6fab9740 1 Processor -- start 2024-09-21T07:21:36.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.082+0000 7ffa6fab9740 1 -- start start 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f71e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112ba6390 0x562112f86020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112bc7070 0x562112f6be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641b0f60 con 0x562112b9e1b0 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641b2aa0 con 0x562112bc7070 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641b1630 con 0x562112ba6390 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f71e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f71e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37414/0 (socket says 172.21.15.92:37414) 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa62ffd640 1 -- 172.21.15.92:0/2477980806 learned_addr learned my addr 172.21.15.92:0/2477980806 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa62ffd640 1 -- 172.21.15.92:0/2477980806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112ba6390 msgr2=0x562112f86020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/2477980806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112ba6390 0x562112f86020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/2477980806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112ba6390 0x562112f86020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa62ffd640 1 -- 172.21.15.92:0/2477980806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112bc7070 msgr2=0x562112f6be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:36.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/2477980806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112bc7070 0x562112f6be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa62ffd640 1 -- 172.21.15.92:0/2477980806 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562112f78270 con 0x562112b9e1b0 2024-09-21T07:21:36.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/2477980806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112ba6390 0x562112f86020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:36.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.083+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/2477980806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f71e60 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ffa5401ffd0 tx=0x7ffa54027590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffed5ae070326f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:36.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.084+0000 7ffa58ff9640 1 -- 172.21.15.92:0/2477980806 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5401c600 con 0x562112b9e1b0 2024-09-21T07:21:36.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.084+0000 7ffa58ff9640 1 -- 172.21.15.92:0/2477980806 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa5401cc30 con 0x562112b9e1b0 2024-09-21T07:21:36.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.084+0000 7ffa58ff9640 1 -- 172.21.15.92:0/2477980806 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa540109d0 con 0x562112b9e1b0 2024-09-21T07:21:36.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.084+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2477980806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 msgr2=0x562112f71e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.084+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/2477980806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f71e60 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ffa5401ffd0 tx=0x7ffa54027590 comp rx=0 tx=0).stop 2024-09-21T07:21:36.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2477980806 shutdown_connections 2024-09-21T07:21:36.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/2477980806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112bc7070 0x562112f6be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/2477980806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112ba6390 0x562112f86020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/2477980806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f71e60 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2477980806 >> 172.21.15.92:0/2477980806 conn(0x562112bbb460 msgr2=0x562112f71750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2477980806 shutdown_connections 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 -- 172.21.15.92:0/2477980806 wait complete. 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 -- start start 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 Processor -- start 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f82760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f7dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 0x562112f7e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641b23d0 con 0x562112b9e1b0 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641b1d00 con 0x562112ba6390 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641aef60 con 0x562112bc7070 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa6fab9740 10 client.0 _ll_register_callbacks cb 0x7ffa5401f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:36.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.085+0000 7ffa62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f82760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f82760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37422/0 (socket says 172.21.15.92:37422) 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa62ffd640 1 -- 172.21.15.92:0/1100715998 learned_addr learned my addr 172.21.15.92:0/1100715998 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa637fe640 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 0x562112f7e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f7dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa62ffd640 1 -- 172.21.15.92:0/1100715998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 msgr2=0x562112f7e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 0x562112f7e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa62ffd640 1 -- 172.21.15.92:0/1100715998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 msgr2=0x562112f7dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f7dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa62ffd640 1 -- 172.21.15.92:0/1100715998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562112f7e840 con 0x562112b9e1b0 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa62ffd640 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f82760 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ffa54027460 tx=0x7ffa54027490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d119905506429e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa4a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:36.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/1100715998 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5402c040 con 0x562112b9e1b0 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/1100715998 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7ffa5401c800 con 0x562112b9e1b0 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa6fab9740 1 -- 172.21.15.92:0/1100715998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa5401cc30 con 0x562112b9e1b0 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/1100715998 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffa54048050 con 0x562112b9e1b0 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa6fab9740 10 client.17913 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.086+0000 7ffa6fab9740 1 -- 172.21.15.92:0/1100715998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562112ff68a0 con 0x562112b9e1b0 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/1100715998 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa5401cc30 con 0x562112b9e1b0 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/1100715998 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ffa540048c0 con 0x562112b9e1b0 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa6fab9740 10 client.17913 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa6fab9740 10 client.17913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa6fab9740 20 client.17913 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562112b5ada0 0x562112ff8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa6fab9740 4 client.17913 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa6fab9740 1 -- 172.21.15.92:0/1100715998 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562112f67990 con 0x562112b5ada0 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562112b5ada0 0x562112ff8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa4a7fc640 10 client.17913 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.087+0000 7ffa5a7fc640 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562112b5ada0 0x562112ff8f10 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cea6c70b14138eb server_cookie=906f96ab5a5dafc6 in_seq=0 out_seq=0 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa4a7fc640 1 -- 172.21.15.92:0/1100715998 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x562112f67990 con 0x562112b5ada0 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa4a7fc640 10 client.17913 handle_command_reply: tid=0 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 client.17913 shutdown 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 -- 172.21.15.92:0/1100715998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 msgr2=0x562112f82760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f82760 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ffa54027460 tx=0x7ffa54027490 comp rx=0 tx=0).stop 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 -- 172.21.15.92:0/1100715998 shutdown_connections 2024-09-21T07:21:36.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x562112b5ada0 0x562112ff8f10 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa4a7fc640 0 client.17913 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:36.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562112bc7070 0x562112f7e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562112ba6390 0x562112f7dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 --2- 172.21.15.92:0/1100715998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562112b9e1b0 0x562112f82760 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 -- 172.21.15.92:0/1100715998 >> 172.21.15.92:0/1100715998 conn(0x562112bbb460 msgr2=0x562112f6be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:36.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 -- 172.21.15.92:0/1100715998 shutdown_connections 2024-09-21T07:21:36.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 1 -- 172.21.15.92:0/1100715998 wait complete. 2024-09-21T07:21:36.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.088+0000 7ffa6fab9740 20 client.17913 trim_cache size 0 max 16384 2024-09-21T07:21:36.096 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "9d9b4374-4159-4e71-99a9-ab660a57d3cf": { 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:02.785673+0000", 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:21:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "3b742b30-fd49-4ec5-844d-6cfbec3bbf45": { 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:48.290915+0000", 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:21:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:02.985669+0000", 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:21:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:21:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:21:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:21:36.105 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:21:36.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 -- 172.21.15.92:0/1180089480 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ffa500b6680 msgr2=0x7ffa500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ffa500b6680 0x7ffa500b8b90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x562112f6d2d0 tx=0x7ffa5400b410 comp rx=0 tx=0).stop 2024-09-21T07:21:36.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 -- 172.21.15.92:0/1180089480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa641083a0 msgr2=0x7ffa6419b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa641083a0 0x7ffa6419b6c0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c005940 tx=0x7ffa4c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 -- 172.21.15.92:0/1180089480 shutdown_connections 2024-09-21T07:21:36.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ffa500b6680 0x7ffa500b8b90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa64108cf0 0x7ffa6419bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa641083a0 0x7ffa6419b6c0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 --2- 172.21.15.92:0/1180089480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa64102a60 0x7ffa6419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 -- 172.21.15.92:0/1180089480 >> 172.21.15.92:0/1180089480 conn(0x7ffa64079730 msgr2=0x7ffa641044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:36.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 -- 172.21.15.92:0/1180089480 shutdown_connections 2024-09-21T07:21:36.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:36.089+0000 7ffa69545640 1 -- 172.21.15.92:0/1180089480 wait complete. 2024-09-21T07:21:36.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:35 smithi169 ceph-mon[33705]: pgmap v599: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:21:36.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:35 smithi175 ceph-mon[34064]: pgmap v599: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:21:37.007 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:21:37.007 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:21:37.257 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:37.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.746+0000 7fa8b2054640 1 -- 172.21.15.92:0/1383195395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac108d70 msgr2=0x7fa8ac10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:37.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.746+0000 7fa8b2054640 1 --2- 172.21.15.92:0/1383195395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac108d70 0x7fa8ac10f5a0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009900 tx=0x7fa8a402a410 comp rx=0 tx=0).stop 2024-09-21T07:21:37.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.747+0000 7fa8b2054640 1 -- 172.21.15.92:0/1383195395 shutdown_connections 2024-09-21T07:21:37.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.747+0000 7fa8b2054640 1 --2- 172.21.15.92:0/1383195395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac108d70 0x7fa8ac10f5a0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:37.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.747+0000 7fa8b2054640 1 --2- 172.21.15.92:0/1383195395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8ac108420 0x7fa8ac108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.747+0000 7fa8b2054640 1 --2- 172.21.15.92:0/1383195395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8ac102ae0 0x7fa8ac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.747+0000 7fa8b2054640 1 -- 172.21.15.92:0/1383195395 >> 172.21.15.92:0/1383195395 conn(0x7fa8ac079770 msgr2=0x7fa8ac079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.747+0000 7fa8b2054640 1 -- 172.21.15.92:0/1383195395 shutdown_connections 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.747+0000 7fa8b2054640 1 -- 172.21.15.92:0/1383195395 wait complete. 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.747+0000 7fa8b2054640 1 Processor -- start 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.747+0000 7fa8b2054640 1 -- start start 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8b2054640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8ac102ae0 0x7fa8ac19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8b2054640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8ac108420 0x7fa8ac19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8b2054640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac108d70 0x7fa8ac19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8b2054640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac113a20 con 0x7fa8ac108d70 2024-09-21T07:21:37.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8b2054640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac1138a0 con 0x7fa8ac102ae0 2024-09-21T07:21:37.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8b2054640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac113ba0 con 0x7fa8ac108420 2024-09-21T07:21:37.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8abfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac108d70 0x7fa8ac19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:37.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8abfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac108d70 0x7fa8ac19fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37454/0 (socket says 172.21.15.92:37454) 2024-09-21T07:21:37.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8abfff640 1 -- 172.21.15.92:0/3835411624 learned_addr learned my addr 172.21.15.92:0/3835411624 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:37.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8ab7fe640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8ac102ae0 0x7fa8ac19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:37.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8aaffd640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8ac108420 0x7fa8ac19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:37.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8abfff640 1 -- 172.21.15.92:0/3835411624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8ac108420 msgr2=0x7fa8ac19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8abfff640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8ac108420 0x7fa8ac19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8abfff640 1 -- 172.21.15.92:0/3835411624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8ac102ae0 msgr2=0x7fa8ac19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8abfff640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8ac102ae0 0x7fa8ac19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8abfff640 1 -- 172.21.15.92:0/3835411624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ac1a0420 con 0x7fa8ac108d70 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.748+0000 7fa8abfff640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac108d70 0x7fa8ac19fcf0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4005ab0 tx=0x7fa8a40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.749+0000 7fa8a8ff9640 1 -- 172.21.15.92:0/3835411624 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a403f030 con 0x7fa8ac108d70 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.749+0000 7fa8a8ff9640 1 -- 172.21.15.92:0/3835411624 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8a4003a80 con 0x7fa8ac108d70 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.749+0000 7fa8b2054640 1 -- 172.21.15.92:0/3835411624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ac1a06b0 con 0x7fa8ac108d70 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.749+0000 7fa8a8ff9640 1 -- 172.21.15.92:0/3835411624 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4035070 con 0x7fa8ac108d70 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.749+0000 7fa8b2054640 1 -- 172.21.15.92:0/3835411624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ac1a6e70 con 0x7fa8ac108d70 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.750+0000 7fa8b2054640 1 -- 172.21.15.92:0/3835411624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ac103d60 con 0x7fa8ac108d70 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.751+0000 7fa8a8ff9640 1 -- 172.21.15.92:0/3835411624 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fa8a4042030 con 0x7fa8ac108d70 2024-09-21T07:21:37.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.752+0000 7fa8a8ff9640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa8980b6680 0x7fa8980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:37.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.752+0000 7fa8ab7fe640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa8980b6680 0x7fa8980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:37.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.752+0000 7fa8a8ff9640 1 -- 172.21.15.92:0/3835411624 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fa8a41082e0 con 0x7fa8ac108d70 2024-09-21T07:21:37.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.753+0000 7fa8ab7fe640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa8980b6680 0x7fa8980b8b90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa89c005fd0 tx=0x7fa89c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:37.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.756+0000 7fa8a8ff9640 1 -- 172.21.15.92:0/3835411624 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8a40ce430 con 0x7fa8ac108d70 2024-09-21T07:21:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.973+0000 7fa8b2054640 1 -- 172.21.15.92:0/3835411624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8ac102ef0 con 0x7fa8ac108d70 2024-09-21T07:21:37.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:37 smithi092 ceph-mon[30987]: pgmap v600: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:21:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.974+0000 7fa8a8ff9640 1 -- 172.21.15.92:0/3835411624 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7fa8ac102ef0 con 0x7fa8ac108d70 2024-09-21T07:21:37.976 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:21:37.976 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:21:37.976 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 -- 172.21.15.92:0/3835411624 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa8980b6680 msgr2=0x7fa8980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa8980b6680 0x7fa8980b8b90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa89c005fd0 tx=0x7fa89c009680 comp rx=0 tx=0).stop 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 -- 172.21.15.92:0/3835411624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac108d70 msgr2=0x7fa8ac19fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac108d70 0x7fa8ac19fcf0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4005ab0 tx=0x7fa8a40040e0 comp rx=0 tx=0).stop 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 -- 172.21.15.92:0/3835411624 shutdown_connections 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa8980b6680 0x7fa8980b8b90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ac108d70 0x7fa8ac19fcf0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8ac108420 0x7fa8ac19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 --2- 172.21.15.92:0/3835411624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8ac102ae0 0x7fa8ac19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 -- 172.21.15.92:0/3835411624 >> 172.21.15.92:0/3835411624 conn(0x7fa8ac079770 msgr2=0x7fa8ac106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 -- 172.21.15.92:0/3835411624 shutdown_connections 2024-09-21T07:21:37.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:37.976+0000 7fa8b2054640 1 -- 172.21.15.92:0/3835411624 wait complete. 2024-09-21T07:21:38.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:37 smithi169 ceph-mon[33705]: pgmap v600: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:21:38.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:37 smithi175 ceph-mon[34064]: pgmap v600: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:21:38.860 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:21:39.110 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:39.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:38 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3835411624' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:38 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3835411624' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:39.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:38 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3835411624' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:39.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.631+0000 7f0070232640 1 -- 172.21.15.92:0/3522607151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0068114430 msgr2=0x7f0068116900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:39.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.631+0000 7f0070232640 1 --2- 172.21.15.92:0/3522607151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0068114430 0x7f0068116900 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f0060009900 tx=0x7f006002a410 comp rx=0 tx=0).stop 2024-09-21T07:21:39.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.631+0000 7f0070232640 1 -- 172.21.15.92:0/3522607151 shutdown_connections 2024-09-21T07:21:39.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.631+0000 7f0070232640 1 --2- 172.21.15.92:0/3522607151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0068114430 0x7f0068116900 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.631+0000 7f0070232640 1 --2- 172.21.15.92:0/3522607151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0068075dd0 0x7f00680761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.631+0000 7f0070232640 1 --2- 172.21.15.92:0/3522607151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0068077380 0x7f00680757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.631+0000 7f0070232640 1 -- 172.21.15.92:0/3522607151 >> 172.21.15.92:0/3522607151 conn(0x7f006807b850 msgr2=0x7f006807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.632+0000 7f0070232640 1 -- 172.21.15.92:0/3522607151 shutdown_connections 2024-09-21T07:21:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.632+0000 7f0070232640 1 -- 172.21.15.92:0/3522607151 wait complete. 2024-09-21T07:21:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.632+0000 7f0070232640 1 Processor -- start 2024-09-21T07:21:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.632+0000 7f0070232640 1 -- start start 2024-09-21T07:21:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.632+0000 7f0070232640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0068075dd0 0x7f00681a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f0070232640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0068077380 0x7f00681a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f0070232640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0068114430 0x7f00681a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f0070232640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0068119f20 con 0x7f0068077380 2024-09-21T07:21:39.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f0070232640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0068119da0 con 0x7f0068075dd0 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f0070232640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f006811a0a0 con 0x7f0068114430 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006d7cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0068077380 0x7f00681a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006d7cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0068077380 0x7f00681a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37480/0 (socket says 172.21.15.92:37480) 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006d7cd640 1 -- 172.21.15.92:0/4265384685 learned_addr learned my addr 172.21.15.92:0/4265384685 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006dfce640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0068075dd0 0x7f00681a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006e7cf640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0068114430 0x7f00681a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006d7cd640 1 -- 172.21.15.92:0/4265384685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0068114430 msgr2=0x7f00681a6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006d7cd640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0068114430 0x7f00681a6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006d7cd640 1 -- 172.21.15.92:0/4265384685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0068075dd0 msgr2=0x7f00681a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006d7cd640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0068075dd0 0x7f00681a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006d7cd640 1 -- 172.21.15.92:0/4265384685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00681a6880 con 0x7f0068077380 2024-09-21T07:21:39.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f006d7cd640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0068077380 0x7f00681a0eb0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f005800d770 tx=0x7f005800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f005effd640 1 -- 172.21.15.92:0/4265384685 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058017070 con 0x7f0068077380 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f005effd640 1 -- 172.21.15.92:0/4265384685 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0058009c30 con 0x7f0068077380 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f005effd640 1 -- 172.21.15.92:0/4265384685 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005800f620 con 0x7f0068077380 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.633+0000 7f0070232640 1 -- 172.21.15.92:0/4265384685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00681a6b70 con 0x7f0068077380 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.634+0000 7f0070232640 1 -- 172.21.15.92:0/4265384685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00681ad2d0 con 0x7f0068077380 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.636+0000 7f00767a6740 1 Processor -- start 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.636+0000 7f00767a6740 1 -- start start 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.636+0000 7f005effd640 1 -- 172.21.15.92:0/4265384685 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f005801a070 con 0x7f0068077380 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.636+0000 7f00767a6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 0x55975eb6c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.636+0000 7f00767a6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb6cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.636+0000 7f00767a6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7a4390 0x55975eb6d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.636+0000 7f00767a6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55975eae2ea0 con 0x55975e79c1b0 2024-09-21T07:21:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.636+0000 7f00767a6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55975ead22d0 con 0x55975e7c5070 2024-09-21T07:21:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.636+0000 7f00767a6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55975ead60e0 con 0x55975e7a4390 2024-09-21T07:21:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006dfce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb6cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006dfce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb6cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37484/0 (socket says 172.21.15.92:37484) 2024-09-21T07:21:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006dfce640 1 -- 172.21.15.92:0/4206963556 learned_addr learned my addr 172.21.15.92:0/4206963556 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006e7cf640 1 --2- 172.21.15.92:0/4206963556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 0x55975eb6c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006d7cd640 1 --2- 172.21.15.92:0/4206963556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7a4390 0x55975eb6d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006dfce640 1 -- 172.21.15.92:0/4206963556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7a4390 msgr2=0x55975eb6d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:39.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006dfce640 1 --2- 172.21.15.92:0/4206963556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7a4390 0x55975eb6d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006dfce640 1 -- 172.21.15.92:0/4206963556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 msgr2=0x55975eb6c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006dfce640 1 --2- 172.21.15.92:0/4206963556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 0x55975eb6c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006dfce640 1 -- 172.21.15.92:0/4206963556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55975e830650 con 0x55975e79c1b0 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f006dfce640 1 --2- 172.21.15.92:0/4206963556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb6cbe0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f00640103f0 tx=0x7f00640108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf83ed0ade71f7d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f0053fff640 1 -- 172.21.15.92:0/4206963556 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064016070 con 0x55975e79c1b0 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f0053fff640 1 -- 172.21.15.92:0/4206963556 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0064004d20 con 0x55975e79c1b0 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f005effd640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00540b6700 0x7f00540b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.637+0000 7f0053fff640 1 -- 172.21.15.92:0/4206963556 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064005280 con 0x55975e79c1b0 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.638+0000 7f006e7cf640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00540b6700 0x7f00540b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.638+0000 7f005effd640 1 -- 172.21.15.92:0/4265384685 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f00580e75c0 con 0x7f0068077380 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.638+0000 7f00767a6740 1 -- 172.21.15.92:0/4206963556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 msgr2=0x55975eb6cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:39.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.638+0000 7f006e7cf640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00540b6700 0x7f00540b8c10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0060005940 tx=0x7f00600058b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:39.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.638+0000 7f00767a6740 1 --2- 172.21.15.92:0/4206963556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb6cbe0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f00640103f0 tx=0x7f00640108b0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.638+0000 7f00767a6740 1 -- 172.21.15.92:0/4206963556 shutdown_connections 2024-09-21T07:21:39.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.638+0000 7f00767a6740 1 --2- 172.21.15.92:0/4206963556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7a4390 0x55975eb6d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.638+0000 7f00767a6740 1 --2- 172.21.15.92:0/4206963556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb6cbe0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.638+0000 7f00767a6740 1 --2- 172.21.15.92:0/4206963556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 0x55975eb6c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.638+0000 7f00767a6740 1 -- 172.21.15.92:0/4206963556 >> 172.21.15.92:0/4206963556 conn(0x55975e7b9460 msgr2=0x55975eb6a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:39.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.639+0000 7f00767a6740 1 -- 172.21.15.92:0/4206963556 shutdown_connections 2024-09-21T07:21:39.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.639+0000 7f00767a6740 1 -- 172.21.15.92:0/4206963556 wait complete. 2024-09-21T07:21:39.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.639+0000 7f00767a6740 1 -- start start 2024-09-21T07:21:39.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.639+0000 7f00767a6740 1 Processor -- start 2024-09-21T07:21:39.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00767a6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb77ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00767a6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7a4390 0x55975eb78220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00767a6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 0x55975eb78780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00767a6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55975e933700 con 0x55975e79c1b0 2024-09-21T07:21:39.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00767a6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55975ea6d160 con 0x55975e7c5070 2024-09-21T07:21:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00767a6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55975eb7ae80 con 0x55975e7a4390 2024-09-21T07:21:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00767a6740 10 client.0 _ll_register_callbacks cb 0x55975ea869e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006dfce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb77ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006dfce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb77ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37488/0 (socket says 172.21.15.92:37488) 2024-09-21T07:21:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006dfce640 1 -- 172.21.15.92:0/368768948 learned_addr learned my addr 172.21.15.92:0/368768948 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006d7cd640 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7a4390 0x55975eb78220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006e7cf640 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 0x55975eb78780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006dfce640 1 -- 172.21.15.92:0/368768948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7a4390 msgr2=0x55975eb78220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006dfce640 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7a4390 0x55975eb78220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006dfce640 1 -- 172.21.15.92:0/368768948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 msgr2=0x55975eb78780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006dfce640 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 0x55975eb78780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006dfce640 1 -- 172.21.15.92:0/368768948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55975ea9ac90 con 0x55975e79c1b0 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006e7cf640 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 0x55975eb78780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f006dfce640 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb77ce0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f0064006010 tx=0x7f0064003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53391717c55350e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00517fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00517fa640 1 -- 172.21.15.92:0/368768948 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064016070 con 0x55975e79c1b0 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00517fa640 1 -- 172.21.15.92:0/368768948 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f0064012710 con 0x55975e79c1b0 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.640+0000 7f00767a6740 1 -- 172.21.15.92:0/368768948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0064004d20 con 0x55975e79c1b0 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00517fa640 1 -- 172.21.15.92:0/368768948 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0064031050 con 0x55975e79c1b0 2024-09-21T07:21:39.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00767a6740 10 client.17931 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00767a6740 1 -- 172.21.15.92:0/368768948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55975eb86b30 con 0x55975e79c1b0 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00517fa640 1 -- 172.21.15.92:0/368768948 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0064004d20 con 0x55975e79c1b0 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00517fa640 1 -- 172.21.15.92:0/368768948 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f006400f040 con 0x55975e79c1b0 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00767a6740 10 client.17931 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00767a6740 10 client.17931 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00767a6740 20 client.17931 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00767a6740 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55975e7839f0 0x55975eb89f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00767a6740 4 client.17931 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f00767a6740 1 -- 172.21.15.92:0/368768948 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55975eae4df0 con 0x55975e7839f0 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.641+0000 7f006d7cd640 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55975e7839f0 0x55975eb89f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.642+0000 7f006d7cd640 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55975e7839f0 0x55975eb89f40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2f44d7c5e4516505 server_cookie=9e936ca34738035 in_seq=0 out_seq=0 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.642+0000 7f00517fa640 10 client.17931 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00517fa640 1 -- 172.21.15.92:0/368768948 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55975eae4df0 con 0x55975e7839f0 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00517fa640 10 client.17931 handle_command_reply: tid=0 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 client.17931 shutdown 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 -- 172.21.15.92:0/368768948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 msgr2=0x55975eb77ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb77ce0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f0064006010 tx=0x7f0064003970 comp rx=0 tx=0).stop 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 -- 172.21.15.92:0/368768948 shutdown_connections 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55975e7839f0 0x55975eb89f40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e7c5070 0x55975eb78780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7a4390 0x55975eb78220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00517fa640 0 client.17931 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 --2- 172.21.15.92:0/368768948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e79c1b0 0x55975eb77ce0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 -- 172.21.15.92:0/368768948 >> 172.21.15.92:0/368768948 conn(0x55975e7b9460 msgr2=0x55975eb6f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 -- 172.21.15.92:0/368768948 shutdown_connections 2024-09-21T07:21:39.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 1 -- 172.21.15.92:0/368768948 wait complete. 2024-09-21T07:21:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.643+0000 7f00767a6740 20 client.17931 trim_cache size 0 max 16384 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f00767a6740 1 Processor -- start 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f00767a6740 1 -- start start 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f00767a6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7839f0 0x55975eb77a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f00767a6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 0x55975eb77fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f00767a6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb74ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f00767a6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00681b7560 con 0x55975e7a4390 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f00767a6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f00681b90a0 con 0x55975e79c1b0 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f00767a6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00681b7c30 con 0x55975e7839f0 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f006e7cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb74ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f006e7cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb74ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37494/0 (socket says 172.21.15.92:37494) 2024-09-21T07:21:39.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f006e7cf640 1 -- 172.21.15.92:0/1296688026 learned_addr learned my addr 172.21.15.92:0/1296688026 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.656+0000 7f006dfce640 1 --2- 172.21.15.92:0/1296688026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7839f0 0x55975eb77a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f006d7cd640 1 --2- 172.21.15.92:0/1296688026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 0x55975eb77fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f006e7cf640 1 -- 172.21.15.92:0/1296688026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7839f0 msgr2=0x55975eb77a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f006e7cf640 1 --2- 172.21.15.92:0/1296688026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7839f0 0x55975eb77a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f006e7cf640 1 -- 172.21.15.92:0/1296688026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 msgr2=0x55975eb77fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f006e7cf640 1 --2- 172.21.15.92:0/1296688026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 0x55975eb77fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f006e7cf640 1 -- 172.21.15.92:0/1296688026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55975eb78fa0 con 0x55975e7a4390 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f006d7cd640 1 --2- 172.21.15.92:0/1296688026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 0x55975eb77fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f006e7cf640 1 --2- 172.21.15.92:0/1296688026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb74ed0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0060009900 tx=0x7f006003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255fb38a468a2d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f00537fe640 1 -- 172.21.15.92:0/1296688026 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060035040 con 0x55975e7a4390 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f00537fe640 1 -- 172.21.15.92:0/1296688026 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00600054d0 con 0x55975e7a4390 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.657+0000 7f00537fe640 1 -- 172.21.15.92:0/1296688026 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060004c00 con 0x55975e7a4390 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.658+0000 7f00767a6740 1 -- 172.21.15.92:0/1296688026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 msgr2=0x55975eb74ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.658+0000 7f00767a6740 1 --2- 172.21.15.92:0/1296688026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb74ed0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0060009900 tx=0x7f006003e000 comp rx=0 tx=0).stop 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.658+0000 7f00767a6740 1 -- 172.21.15.92:0/1296688026 shutdown_connections 2024-09-21T07:21:39.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.658+0000 7f00767a6740 1 --2- 172.21.15.92:0/1296688026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb74ed0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.658+0000 7f00767a6740 1 --2- 172.21.15.92:0/1296688026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 0x55975eb77fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.658+0000 7f00767a6740 1 --2- 172.21.15.92:0/1296688026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7839f0 0x55975eb77a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.658+0000 7f00767a6740 1 -- 172.21.15.92:0/1296688026 >> 172.21.15.92:0/1296688026 conn(0x55975e7b9460 msgr2=0x55975eb76560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.658+0000 7f00767a6740 1 -- 172.21.15.92:0/1296688026 shutdown_connections 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.658+0000 7f00767a6740 1 -- 172.21.15.92:0/1296688026 wait complete. 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f00767a6740 1 -- start start 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f00767a6740 1 Processor -- start 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f00767a6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7839f0 0x55975eb8b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f00767a6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 0x55975eb8b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f00767a6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb8ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f00767a6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00681b89d0 con 0x55975e7a4390 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f00767a6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f00681b8300 con 0x55975e79c1b0 2024-09-21T07:21:39.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f00767a6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00681b5560 con 0x55975e7839f0 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f00767a6740 10 client.0 _ll_register_callbacks cb 0x7f0060009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f006e7cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb8ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f006e7cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb8ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37510/0 (socket says 172.21.15.92:37510) 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.659+0000 7f006e7cf640 1 -- 172.21.15.92:0/249362373 learned_addr learned my addr 172.21.15.92:0/249362373 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f006dfce640 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7839f0 0x55975eb8b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f006d7cd640 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 0x55975eb8b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f006e7cf640 1 -- 172.21.15.92:0/249362373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7839f0 msgr2=0x55975eb8b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f006e7cf640 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7839f0 0x55975eb8b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f006e7cf640 1 -- 172.21.15.92:0/249362373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 msgr2=0x55975eb8b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f006e7cf640 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 0x55975eb8b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f006e7cf640 1 -- 172.21.15.92:0/249362373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55975ebf3770 con 0x55975e7a4390 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f006e7cf640 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb8ba90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0060032fd0 tx=0x7f0060004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2319923b3b391d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f00517fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:39.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f00517fa640 1 -- 172.21.15.92:0/249362373 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060060060 con 0x55975e7a4390 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f00517fa640 1 -- 172.21.15.92:0/249362373 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f0060003800 con 0x55975e7a4390 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f00767a6740 1 -- 172.21.15.92:0/249362373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00600054d0 con 0x55975e7a4390 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f00517fa640 1 -- 172.21.15.92:0/249362373 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0060067050 con 0x55975e7a4390 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f00767a6740 10 client.17937 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f00767a6740 1 -- 172.21.15.92:0/249362373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55975ebf4960 con 0x55975e7a4390 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.660+0000 7f00517fa640 1 -- 172.21.15.92:0/249362373 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00600054d0 con 0x55975e7a4390 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.661+0000 7f00517fa640 1 -- 172.21.15.92:0/249362373 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f006005ba40 con 0x55975e7a4390 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.661+0000 7f00767a6740 10 client.17937 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.661+0000 7f00767a6740 10 client.17937 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.661+0000 7f00767a6740 20 client.17937 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.661+0000 7f00767a6740 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55975e7c5070 0x55975ebf7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.661+0000 7f00767a6740 4 client.17937 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.661+0000 7f00767a6740 1 -- 172.21.15.92:0/249362373 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55975eae08a0 con 0x55975e7c5070 2024-09-21T07:21:39.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.661+0000 7f006dfce640 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55975e7c5070 0x55975ebf7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:39.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.661+0000 7f006dfce640 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55975e7c5070 0x55975ebf7010 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=571b22479063df1d server_cookie=b9be21877c20d362 in_seq=0 out_seq=0 2024-09-21T07:21:39.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.661+0000 7f00517fa640 10 client.17937 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:21:39.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00517fa640 1 -- 172.21.15.92:0/249362373 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55975eae08a0 con 0x55975e7c5070 2024-09-21T07:21:39.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00517fa640 10 client.17937 handle_command_reply: tid=0 2024-09-21T07:21:39.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 client.17937 shutdown 2024-09-21T07:21:39.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 -- 172.21.15.92:0/249362373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 msgr2=0x55975eb8ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:39.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb8ba90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0060032fd0 tx=0x7f0060004800 comp rx=0 tx=0).stop 2024-09-21T07:21:39.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 -- 172.21.15.92:0/249362373 shutdown_connections 2024-09-21T07:21:39.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x55975e7c5070 0x55975ebf7010 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55975e7a4390 0x55975eb8ba90 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975e79c1b0 0x55975eb8b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 --2- 172.21.15.92:0/249362373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55975e7839f0 0x55975eb8b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00517fa640 0 client.17937 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:21:39.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 -- 172.21.15.92:0/249362373 >> 172.21.15.92:0/249362373 conn(0x55975e7b9460 msgr2=0x55975eb77a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:39.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 -- 172.21.15.92:0/249362373 shutdown_connections 2024-09-21T07:21:39.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 1 -- 172.21.15.92:0/249362373 wait complete. 2024-09-21T07:21:39.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.662+0000 7f00767a6740 20 client.17937 trim_cache size 0 max 16384 2024-09-21T07:21:39.674 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:39.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 -- 172.21.15.92:0/4265384685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00540b6700 msgr2=0x7f00540b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:39.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00540b6700 0x7f00540b8c10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0060005940 tx=0x7f00600058b0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 -- 172.21.15.92:0/4265384685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0068077380 msgr2=0x7f00681a0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:39.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0068077380 0x7f00681a0eb0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f005800d770 tx=0x7f005800dc30 comp rx=0 tx=0).stop 2024-09-21T07:21:39.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 -- 172.21.15.92:0/4265384685 shutdown_connections 2024-09-21T07:21:39.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f00540b6700 0x7f00540b8c10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0068114430 0x7f00681a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0068077380 0x7f00681a0eb0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 --2- 172.21.15.92:0/4265384685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0068075dd0 0x7f00681a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:39.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 -- 172.21.15.92:0/4265384685 >> 172.21.15.92:0/4265384685 conn(0x7f006807b850 msgr2=0x7f00681130a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:39.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 -- 172.21.15.92:0/4265384685 shutdown_connections 2024-09-21T07:21:39.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:39.663+0000 7f0070232640 1 -- 172.21.15.92:0/4265384685 wait complete. 2024-09-21T07:21:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:39 smithi169 ceph-mon[33705]: pgmap v601: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:21:40.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:39 smithi175 ceph-mon[34064]: pgmap v601: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:21:40.274 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:39 smithi092 ceph-mon[30987]: pgmap v601: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:21:40.459 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:21:40.709 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:41.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.274+0000 7feed8942640 1 -- 172.21.15.92:0/4087813639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed41083b0 msgr2=0x7feed41087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:41.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.274+0000 7feed8942640 1 --2- 172.21.15.92:0/4087813639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed41083b0 0x7feed41087c0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7feec8009900 tx=0x7feec802a410 comp rx=0 tx=0).stop 2024-09-21T07:21:41.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.275+0000 7feed8942640 1 -- 172.21.15.92:0/4087813639 shutdown_connections 2024-09-21T07:21:41.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.275+0000 7feed8942640 1 --2- 172.21.15.92:0/4087813639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed4108d00 0x7feed410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.275+0000 7feed8942640 1 --2- 172.21.15.92:0/4087813639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed41083b0 0x7feed41087c0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.275+0000 7feed8942640 1 --2- 172.21.15.92:0/4087813639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feed4102a70 0x7feed4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.275+0000 7feed8942640 1 -- 172.21.15.92:0/4087813639 >> 172.21.15.92:0/4087813639 conn(0x7feed4079710 msgr2=0x7feed4079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:41.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.275+0000 7feed8942640 1 -- 172.21.15.92:0/4087813639 shutdown_connections 2024-09-21T07:21:41.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.275+0000 7feed8942640 1 -- 172.21.15.92:0/4087813639 wait complete. 2024-09-21T07:21:41.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.275+0000 7feed8942640 1 Processor -- start 2024-09-21T07:21:41.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed8942640 1 -- start start 2024-09-21T07:21:41.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed8942640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed4102a70 0x7feed419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed8942640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed41083b0 0x7feed419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed8942640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feed4108d00 0x7feed419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed8942640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feed41139f0 con 0x7feed4102a70 2024-09-21T07:21:41.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed8942640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feed4113870 con 0x7feed4108d00 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed8942640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feed4113b70 con 0x7feed41083b0 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed4102a70 0x7feed419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed4102a70 0x7feed419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48692/0 (socket says 172.21.15.92:48692) 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed259c640 1 -- 172.21.15.92:0/3179583594 learned_addr learned my addr 172.21.15.92:0/3179583594 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed1d9b640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed41083b0 0x7feed419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed2d9d640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feed4108d00 0x7feed419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed259c640 1 -- 172.21.15.92:0/3179583594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed41083b0 msgr2=0x7feed419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed259c640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed41083b0 0x7feed419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed259c640 1 -- 172.21.15.92:0/3179583594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feed4108d00 msgr2=0x7feed419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed259c640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feed4108d00 0x7feed419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.276+0000 7feed259c640 1 -- 172.21.15.92:0/3179583594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed41a0390 con 0x7feed4102a70 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.277+0000 7feed259c640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed4102a70 0x7feed419a420 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7feec400c890 tx=0x7feec400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.277+0000 7feec37fe640 1 -- 172.21.15.92:0/3179583594 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4004220 con 0x7feed4102a70 2024-09-21T07:21:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.277+0000 7feed8942640 1 -- 172.21.15.92:0/3179583594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed41a0680 con 0x7feed4102a70 2024-09-21T07:21:41.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.277+0000 7feec37fe640 1 -- 172.21.15.92:0/3179583594 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feec4007e40 con 0x7feed4102a70 2024-09-21T07:21:41.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.277+0000 7feec37fe640 1 -- 172.21.15.92:0/3179583594 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4004a00 con 0x7feed4102a70 2024-09-21T07:21:41.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.277+0000 7feed8942640 1 -- 172.21.15.92:0/3179583594 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed41a6de0 con 0x7feed4102a70 2024-09-21T07:21:41.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.279+0000 7feedeeb6740 1 Processor -- start 2024-09-21T07:21:41.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feedeeb6740 1 -- start start 2024-09-21T07:21:41.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feec37fe640 1 -- 172.21.15.92:0/3179583594 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7feec4004ba0 con 0x7feed4102a70 2024-09-21T07:21:41.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c21b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be4b1b0 0x56002c21bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 0x56002c21c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feedeeb6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56002c191ea0 con 0x56002be74070 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feedeeb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56002c1812d0 con 0x56002be4b1b0 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feedeeb6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56002c1850e0 con 0x56002be53390 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feed2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c21b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feed2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c21b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48700/0 (socket says 172.21.15.92:48700) 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feed2d9d640 1 -- 172.21.15.92:0/814851289 learned_addr learned my addr 172.21.15.92:0/814851289 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feed259c640 1 --2- 172.21.15.92:0/814851289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be4b1b0 0x56002c21bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feed1d9b640 1 --2- 172.21.15.92:0/814851289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 0x56002c21c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feed2d9d640 1 -- 172.21.15.92:0/814851289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 msgr2=0x56002c21c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feed2d9d640 1 --2- 172.21.15.92:0/814851289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 0x56002c21c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feed2d9d640 1 -- 172.21.15.92:0/814851289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be4b1b0 msgr2=0x56002c21bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:41.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feed2d9d640 1 --2- 172.21.15.92:0/814851289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be4b1b0 0x56002c21bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.280+0000 7feed2d9d640 1 -- 172.21.15.92:0/814851289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002bedf650 con 0x56002be74070 2024-09-21T07:21:41.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.281+0000 7feed1d9b640 1 --2- 172.21.15.92:0/814851289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 0x56002c21c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:41.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.281+0000 7feec37fe640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feebc0b6680 0x7feebc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.281+0000 7feed2d9d640 1 --2- 172.21.15.92:0/814851289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c21b6a0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7feecc009f20 tx=0x7feecc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570dc88d379dc14c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:41.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.281+0000 7feed259c640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feebc0b6680 0x7feebc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.281+0000 7feec0ff9640 1 -- 172.21.15.92:0/814851289 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc01a070 con 0x56002be74070 2024-09-21T07:21:41.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.281+0000 7feec37fe640 1 -- 172.21.15.92:0/3179583594 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7feec40e7860 con 0x7feed4102a70 2024-09-21T07:21:41.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.281+0000 7feec0ff9640 1 -- 172.21.15.92:0/814851289 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feecc0158a0 con 0x56002be74070 2024-09-21T07:21:41.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.281+0000 7feec0ff9640 1 -- 172.21.15.92:0/814851289 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc00a760 con 0x56002be74070 2024-09-21T07:21:41.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.282+0000 7feedeeb6740 1 -- 172.21.15.92:0/814851289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 msgr2=0x56002c21b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:41.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.282+0000 7feedeeb6740 1 --2- 172.21.15.92:0/814851289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c21b6a0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7feecc009f20 tx=0x7feecc00c8b0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.282+0000 7feed259c640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feebc0b6680 0x7feebc0b8b90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feec40e4c60 tx=0x7feec40ed550 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:41.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.282+0000 7feedeeb6740 1 -- 172.21.15.92:0/814851289 shutdown_connections 2024-09-21T07:21:41.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.282+0000 7feedeeb6740 1 --2- 172.21.15.92:0/814851289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 0x56002c21c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.282+0000 7feedeeb6740 1 --2- 172.21.15.92:0/814851289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be4b1b0 0x56002c21bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.282+0000 7feedeeb6740 1 --2- 172.21.15.92:0/814851289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c21b6a0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.282+0000 7feedeeb6740 1 -- 172.21.15.92:0/814851289 >> 172.21.15.92:0/814851289 conn(0x56002be68460 msgr2=0x56002c219590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:41.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.282+0000 7feedeeb6740 1 -- 172.21.15.92:0/814851289 shutdown_connections 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.282+0000 7feedeeb6740 1 -- 172.21.15.92:0/814851289 wait complete. 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feedeeb6740 1 -- start start 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feedeeb6740 1 Processor -- start 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be4b1b0 0x56002c226e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 0x56002c227360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c2375d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feedeeb6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56002bfe2700 con 0x56002be74070 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feedeeb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56002c11c160 con 0x56002be4b1b0 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feedeeb6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56002c22e2e0 con 0x56002be53390 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feedeeb6740 10 client.0 _ll_register_callbacks cb 0x56002c1359e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feed2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c2375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feed2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c2375d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48710/0 (socket says 172.21.15.92:48710) 2024-09-21T07:21:41.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feed2d9d640 1 -- 172.21.15.92:0/1071738592 learned_addr learned my addr 172.21.15.92:0/1071738592 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feed1d9b640 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 0x56002c227360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feed2d9d640 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be4b1b0 0x56002c226e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feed2d9d640 1 -- 172.21.15.92:0/1071738592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 msgr2=0x56002c227360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feed2d9d640 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 0x56002c227360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feed2d9d640 1 -- 172.21.15.92:0/1071738592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be4b1b0 msgr2=0x56002c226e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feed2d9d640 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be4b1b0 0x56002c226e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.283+0000 7feed2d9d640 1 -- 172.21.15.92:0/1071738592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56002c149c90 con 0x56002be74070 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feed2d9d640 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c2375d0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7feecc00a910 tx=0x7feecc00a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4309210f0cbb1ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feeb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1071738592 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc01a040 con 0x56002be74070 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1071738592 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7feecc00a940 con 0x56002be74070 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feedeeb6740 1 -- 172.21.15.92:0/1071738592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feecc0158a0 con 0x56002be74070 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1071738592 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feecc0156c0 con 0x56002be74070 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feedeeb6740 10 client.17949 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feedeeb6740 1 -- 172.21.15.92:0/1071738592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56002c23a000 con 0x56002be74070 2024-09-21T07:21:41.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1071738592 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feecc0158a0 con 0x56002be74070 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1071738592 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7feecc021bd0 con 0x56002be74070 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feedeeb6740 10 client.17949 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feedeeb6740 10 client.17949 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feedeeb6740 20 client.17949 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x56002be329f0 0x56002c23d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feedeeb6740 4 client.17949 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.284+0000 7feedeeb6740 1 -- 172.21.15.92:0/1071738592 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56002c193df0 con 0x56002be329f0 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.285+0000 7feed1d9b640 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x56002be329f0 0x56002c23d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.285+0000 7feed1d9b640 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x56002be329f0 0x56002c23d3c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bdbb5f4db9f1465b server_cookie=460f98733b8638b4 in_seq=0 out_seq=0 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.285+0000 7feeb9ffb640 10 client.17949 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1071738592 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56002c193df0 con 0x56002be329f0 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feeb9ffb640 10 client.17949 handle_command_reply: tid=0 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 client.17949 shutdown 2024-09-21T07:21:41.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 -- 172.21.15.92:0/1071738592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 msgr2=0x56002c2375d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c2375d0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7feecc00a910 tx=0x7feecc00a400 comp rx=0 tx=0).stop 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 -- 172.21.15.92:0/1071738592 shutdown_connections 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x56002be329f0 0x56002c23d3c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be74070 0x56002c2375d0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be53390 0x56002c227360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1071738592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be4b1b0 0x56002c226e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feeb9ffb640 0 client.17949 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 -- 172.21.15.92:0/1071738592 >> 172.21.15.92:0/1071738592 conn(0x56002be68460 msgr2=0x56002c21e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 -- 172.21.15.92:0/1071738592 shutdown_connections 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 1 -- 172.21.15.92:0/1071738592 wait complete. 2024-09-21T07:21:41.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.286+0000 7feedeeb6740 20 client.17949 trim_cache size 0 max 16384 2024-09-21T07:21:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.299+0000 7feedeeb6740 1 Processor -- start 2024-09-21T07:21:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.299+0000 7feedeeb6740 1 -- start start 2024-09-21T07:21:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.299+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be329f0 0x56002c228a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.299+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 0x56002c237540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.299+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be53390 0x56002c224010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.299+0000 7feedeeb6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feed41aee50 con 0x56002be53390 2024-09-21T07:21:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.299+0000 7feedeeb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feed41b0990 con 0x56002be329f0 2024-09-21T07:21:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.299+0000 7feedeeb6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feed41af520 con 0x56002be4b1b0 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be53390 0x56002c224010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be53390 0x56002c224010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48720/0 (socket says 172.21.15.92:48720) 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed2d9d640 1 -- 172.21.15.92:0/3352131868 learned_addr learned my addr 172.21.15.92:0/3352131868 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed1d9b640 1 --2- 172.21.15.92:0/3352131868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 0x56002c237540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed2d9d640 1 --2- 172.21.15.92:0/3352131868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be329f0 0x56002c228a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed2d9d640 1 -- 172.21.15.92:0/3352131868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 msgr2=0x56002c237540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed2d9d640 1 --2- 172.21.15.92:0/3352131868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 0x56002c237540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed2d9d640 1 -- 172.21.15.92:0/3352131868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be329f0 msgr2=0x56002c228a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed2d9d640 1 --2- 172.21.15.92:0/3352131868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be329f0 0x56002c228a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed2d9d640 1 -- 172.21.15.92:0/3352131868 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002c21d990 con 0x56002be53390 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feed2d9d640 1 --2- 172.21.15.92:0/3352131868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be53390 0x56002c224010 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7feecc004a80 tx=0x7feecc0070e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824a489baca2e0a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feebbfff640 1 -- 172.21.15.92:0/3352131868 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc01a070 con 0x56002be53390 2024-09-21T07:21:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feebbfff640 1 -- 172.21.15.92:0/3352131868 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feecc009b50 con 0x56002be53390 2024-09-21T07:21:41.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.300+0000 7feebbfff640 1 -- 172.21.15.92:0/3352131868 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc00ac30 con 0x56002be53390 2024-09-21T07:21:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.301+0000 7feedeeb6740 1 -- 172.21.15.92:0/3352131868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be53390 msgr2=0x56002c224010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.301+0000 7feedeeb6740 1 --2- 172.21.15.92:0/3352131868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be53390 0x56002c224010 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7feecc004a80 tx=0x7feecc0070e0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.301+0000 7feedeeb6740 1 -- 172.21.15.92:0/3352131868 shutdown_connections 2024-09-21T07:21:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.301+0000 7feedeeb6740 1 --2- 172.21.15.92:0/3352131868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be53390 0x56002c224010 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.301+0000 7feedeeb6740 1 --2- 172.21.15.92:0/3352131868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 0x56002c237540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.301+0000 7feedeeb6740 1 --2- 172.21.15.92:0/3352131868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be329f0 0x56002c228a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.302+0000 7feedeeb6740 1 -- 172.21.15.92:0/3352131868 >> 172.21.15.92:0/3352131868 conn(0x56002be68460 msgr2=0x56002c228340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.302+0000 7feedeeb6740 1 -- 172.21.15.92:0/3352131868 shutdown_connections 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.302+0000 7feedeeb6740 1 -- 172.21.15.92:0/3352131868 wait complete. 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.302+0000 7feedeeb6740 1 -- start start 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.302+0000 7feedeeb6740 1 Processor -- start 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be329f0 0x56002c240c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 0x56002c23e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feedeeb6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be53390 0x56002c23e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feedeeb6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feed41b02c0 con 0x56002be329f0 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feedeeb6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feed41afbf0 con 0x56002be53390 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feedeeb6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feed41ace50 con 0x56002be4b1b0 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feedeeb6740 10 client.0 _ll_register_callbacks cb 0x7feecc018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be329f0 0x56002c240c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be329f0 0x56002c240c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48724/0 (socket says 172.21.15.92:48724) 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed2d9d640 1 -- 172.21.15.92:0/1870761781 learned_addr learned my addr 172.21.15.92:0/1870761781 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed1d9b640 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 0x56002c23e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed2d9d640 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be53390 0x56002c23e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed2d9d640 1 -- 172.21.15.92:0/1870761781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 msgr2=0x56002c23e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed2d9d640 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 0x56002c23e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed2d9d640 1 -- 172.21.15.92:0/1870761781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be53390 msgr2=0x56002c23e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed2d9d640 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be53390 0x56002c23e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed2d9d640 1 -- 172.21.15.92:0/1870761781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56002c23eef0 con 0x56002be329f0 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed1d9b640 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 0x56002c23e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feed2d9d640 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be329f0 0x56002c240c70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7feecc007070 tx=0x7feecc007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0215c421bddc6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.303+0000 7feeb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1870761781 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc01a070 con 0x56002be329f0 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1870761781 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7feecc020b80 con 0x56002be329f0 2024-09-21T07:21:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feedeeb6740 1 -- 172.21.15.92:0/1870761781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feecc009b50 con 0x56002be329f0 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1870761781 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feecc020da0 con 0x56002be329f0 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feedeeb6740 10 client.17955 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feedeeb6740 1 -- 172.21.15.92:0/1870761781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56002c2a7b10 con 0x56002be329f0 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1870761781 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feecc009b50 con 0x56002be329f0 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1870761781 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7feecc021730 con 0x56002be329f0 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feedeeb6740 10 client.17955 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feedeeb6740 10 client.17955 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feedeeb6740 20 client.17955 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x56002be74070 0x56002c2aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feedeeb6740 4 client.17955 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.304+0000 7feedeeb6740 1 -- 172.21.15.92:0/1870761781 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56002c18f8a0 con 0x56002be74070 2024-09-21T07:21:41.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.305+0000 7feed1d9b640 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x56002be74070 0x56002c2aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:41.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.305+0000 7feed1d9b640 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x56002be74070 0x56002c2aa0b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5eb844b8ac6ff03c server_cookie=2e3a126b9437084a in_seq=0 out_seq=0 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.305+0000 7feeb9ffb640 10 client.17955 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.305+0000 7feeb9ffb640 1 -- 172.21.15.92:0/1870761781 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56002c18f8a0 con 0x56002be74070 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.305+0000 7feeb9ffb640 10 client.17955 handle_command_reply: tid=0 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.305+0000 7feedeeb6740 1 client.17955 shutdown 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.305+0000 7feedeeb6740 1 -- 172.21.15.92:0/1870761781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be329f0 msgr2=0x56002c240c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.305+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be329f0 0x56002c240c70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7feecc007070 tx=0x7feecc007000 comp rx=0 tx=0).stop 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feedeeb6740 1 -- 172.21.15.92:0/1870761781 shutdown_connections 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002be53390 0x56002c23e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56002be4b1b0 0x56002c23e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x56002be74070 0x56002c2aa0b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feedeeb6740 1 --2- 172.21.15.92:0/1870761781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56002be329f0 0x56002c240c70 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feedeeb6740 1 -- 172.21.15.92:0/1870761781 >> 172.21.15.92:0/1870761781 conn(0x56002be68460 msgr2=0x56002c21c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:41.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feeb9ffb640 0 client.17955 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:21:41.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feedeeb6740 1 -- 172.21.15.92:0/1870761781 shutdown_connections 2024-09-21T07:21:41.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feedeeb6740 1 -- 172.21.15.92:0/1870761781 wait complete. 2024-09-21T07:21:41.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feedeeb6740 20 client.17955 trim_cache size 0 max 16384 2024-09-21T07:21:41.313 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:41.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.306+0000 7feed8942640 1 -- 172.21.15.92:0/3179583594 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feebc0b6680 msgr2=0x7feebc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feebc0b6680 0x7feebc0b8b90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feec40e4c60 tx=0x7feec40ed550 comp rx=0 tx=0).stop 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 -- 172.21.15.92:0/3179583594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed4102a70 msgr2=0x7feed419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed4102a70 0x7feed419a420 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7feec400c890 tx=0x7feec400cd50 comp rx=0 tx=0).stop 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 -- 172.21.15.92:0/3179583594 shutdown_connections 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7feebc0b6680 0x7feebc0b8b90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feed4108d00 0x7feed419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed41083b0 0x7feed419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 --2- 172.21.15.92:0/3179583594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feed4102a70 0x7feed419a420 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 -- 172.21.15.92:0/3179583594 >> 172.21.15.92:0/3179583594 conn(0x7feed4079710 msgr2=0x7feed41064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 -- 172.21.15.92:0/3179583594 shutdown_connections 2024-09-21T07:21:41.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:41.307+0000 7feed8942640 1 -- 172.21.15.92:0/3179583594 wait complete. 2024-09-21T07:21:41.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:41 smithi092 ceph-mon[30987]: pgmap v602: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:21:42.019 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:21:42.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:41 smithi169 ceph-mon[33705]: pgmap v602: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:21:42.264 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:42.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:41 smithi175 ceph-mon[34064]: pgmap v602: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:21:42.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.768+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1690691431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a810de10 msgr2=0x7fd3a8110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.768+0000 7fd3adeb6640 1 --2- 172.21.15.92:0/1690691431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a810de10 0x7fd3a8110320 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009ca0 tx=0x7fd3a002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.768+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1690691431 shutdown_connections 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.768+0000 7fd3adeb6640 1 --2- 172.21.15.92:0/1690691431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a810de10 0x7fd3a8110320 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.768+0000 7fd3adeb6640 1 --2- 172.21.15.92:0/1690691431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3a8105290 0x7fd3a810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.768+0000 7fd3adeb6640 1 --2- 172.21.15.92:0/1690691431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3a8104860 0x7fd3a8104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.768+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1690691431 >> 172.21.15.92:0/1690691431 conn(0x7fd3a8079740 msgr2=0x7fd3a8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.768+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1690691431 shutdown_connections 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.768+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1690691431 wait complete. 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.768+0000 7fd3adeb6640 1 Processor -- start 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3adeb6640 1 -- start start 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3adeb6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3a8104860 0x7fd3a8102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3adeb6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a8105290 0x7fd3a8102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3adeb6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3a810de10 0x7fd3a81031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3adeb6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a8113a30 con 0x7fd3a8105290 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3adeb6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81138b0 con 0x7fd3a810de10 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3adeb6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a8113bb0 con 0x7fd3a8104860 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a8105290 0x7fd3a8102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a8105290 0x7fd3a8102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48740/0 (socket says 172.21.15.92:48740) 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a6ffd640 1 -- 172.21.15.92:0/1926472302 learned_addr learned my addr 172.21.15.92:0/1926472302 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3a8104860 0x7fd3a8102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3a810de10 0x7fd3a81031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a6ffd640 1 -- 172.21.15.92:0/1926472302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3a8104860 msgr2=0x7fd3a8102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3a8104860 0x7fd3a8102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a6ffd640 1 -- 172.21.15.92:0/1926472302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3a810de10 msgr2=0x7fd3a81031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3a810de10 0x7fd3a81031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a6ffd640 1 -- 172.21.15.92:0/1926472302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a81a8610 con 0x7fd3a8105290 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3a810de10 0x7fd3a81031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.769+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3a8104860 0x7fd3a8102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.770+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a8105290 0x7fd3a8102cb0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00c8c0 tx=0x7fd39c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.770+0000 7fd3a4ff9640 1 -- 172.21.15.92:0/1926472302 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c007bb0 con 0x7fd3a8105290 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.770+0000 7fd3a4ff9640 1 -- 172.21.15.92:0/1926472302 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd39c007d50 con 0x7fd3a8105290 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.770+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1926472302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a81a8900 con 0x7fd3a8105290 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.770+0000 7fd3a4ff9640 1 -- 172.21.15.92:0/1926472302 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c0186a0 con 0x7fd3a8105290 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.770+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1926472302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a81a8e40 con 0x7fd3a8105290 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.772+0000 7fd3b442a740 1 Processor -- start 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.772+0000 7fd3b442a740 1 -- start start 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.772+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfdd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.772+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc0d1b0 0x5644dcfddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.772+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc15390 0x5644dcfde120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.772+0000 7fd3b442a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5644dcf53ea0 con 0x5644dcc36070 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.772+0000 7fd3b442a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5644dcf432d0 con 0x5644dcc0d1b0 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.772+0000 7fd3b442a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5644dcf470e0 con 0x5644dcc15390 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfdd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfdd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48748/0 (socket says 172.21.15.92:48748) 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a7fff640 1 -- 172.21.15.92:0/2908626349 learned_addr learned my addr 172.21.15.92:0/2908626349 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a4ff9640 1 -- 172.21.15.92:0/1926472302 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fd39c00f450 con 0x7fd3a8105290 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/2908626349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc0d1b0 0x5644dcfddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a7fff640 1 -- 172.21.15.92:0/2908626349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc15390 msgr2=0x5644dcfde120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/2908626349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc15390 0x5644dcfde120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a7fff640 1 -- 172.21.15.92:0/2908626349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc0d1b0 msgr2=0x5644dcfddbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/2908626349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc0d1b0 0x5644dcfddbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a7fff640 1 -- 172.21.15.92:0/2908626349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644dcca1650 con 0x5644dcc36070 2024-09-21T07:21:42.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/2908626349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfdd6a0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0031610 tx=0x7fd3a0031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3365843f4e0570e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:42.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd3a4ff9640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3900b6680 0x7fd3900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd38dffb640 1 -- 172.21.15.92:0/2908626349 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0031b80 con 0x5644dcc36070 2024-09-21T07:21:42.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd38dffb640 1 -- 172.21.15.92:0/2908626349 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3a0036070 con 0x5644dcc36070 2024-09-21T07:21:42.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.773+0000 7fd38dffb640 1 -- 172.21.15.92:0/2908626349 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0004560 con 0x5644dcc36070 2024-09-21T07:21:42.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.774+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3900b6680 0x7fd3900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.774+0000 7fd3a4ff9640 1 -- 172.21.15.92:0/1926472302 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fd39c0e7c70 con 0x7fd3a8105290 2024-09-21T07:21:42.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.774+0000 7fd3b442a740 1 -- 172.21.15.92:0/2908626349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 msgr2=0x5644dcfdd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.774+0000 7fd3b442a740 1 --2- 172.21.15.92:0/2908626349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfdd6a0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0031610 tx=0x7fd3a0031640 comp rx=0 tx=0).stop 2024-09-21T07:21:42.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.774+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3900b6680 0x7fd3900b8b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x5644dcfdc320 tx=0x7fd398008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.774+0000 7fd3b442a740 1 -- 172.21.15.92:0/2908626349 shutdown_connections 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.774+0000 7fd3b442a740 1 --2- 172.21.15.92:0/2908626349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc15390 0x5644dcfde120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.774+0000 7fd3b442a740 1 --2- 172.21.15.92:0/2908626349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc0d1b0 0x5644dcfddbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.774+0000 7fd3b442a740 1 --2- 172.21.15.92:0/2908626349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfdd6a0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.775+0000 7fd3b442a740 1 -- 172.21.15.92:0/2908626349 >> 172.21.15.92:0/2908626349 conn(0x5644dcc2a460 msgr2=0x5644dcfdb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.775+0000 7fd3b442a740 1 -- 172.21.15.92:0/2908626349 shutdown_connections 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.775+0000 7fd3b442a740 1 -- 172.21.15.92:0/2908626349 wait complete. 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.775+0000 7fd3b442a740 1 -- start start 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.775+0000 7fd3b442a740 1 Processor -- start 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.775+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc0d1b0 0x5644dcfe8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 0x5644dcfe92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc36070 0x5644dcff5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3b442a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5644dcda4700 con 0x5644dcc0d1b0 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3b442a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5644dcede160 con 0x5644dcc15390 2024-09-21T07:21:42.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3b442a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5644dcfebe20 con 0x5644dcc36070 2024-09-21T07:21:42.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3b442a740 10 client.0 _ll_register_callbacks cb 0x5644dcef79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:42.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc0d1b0 0x5644dcfe8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc0d1b0 0x5644dcfe8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48750/0 (socket says 172.21.15.92:48750) 2024-09-21T07:21:42.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a77fe640 1 -- 172.21.15.92:0/530489298 learned_addr learned my addr 172.21.15.92:0/530489298 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:42.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 0x5644dcfe92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc36070 0x5644dcff5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a77fe640 1 -- 172.21.15.92:0/530489298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc36070 msgr2=0x5644dcff5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:42.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc36070 0x5644dcff5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a77fe640 1 -- 172.21.15.92:0/530489298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 msgr2=0x5644dcfe92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:42.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 0x5644dcfe92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a77fe640 1 -- 172.21.15.92:0/530489298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644dcf0bc90 con 0x5644dcc0d1b0 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc0d1b0 0x5644dcfe8db0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd3980167d0 tx=0x7fd3980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846c01c30c219ebe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd386ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.776+0000 7fd386ffd640 1 -- 172.21.15.92:0/530489298 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39801c050 con 0x5644dcc0d1b0 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd3b442a740 1 -- 172.21.15.92:0/530489298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a0036070 con 0x5644dcc0d1b0 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd386ffd640 1 -- 172.21.15.92:0/530489298 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fd398014930 con 0x5644dcc0d1b0 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd386ffd640 1 -- 172.21.15.92:0/530489298 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd398014b30 con 0x5644dcc0d1b0 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd3b442a740 10 client.17967 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd3b442a740 1 -- 172.21.15.92:0/530489298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5644dcff7be0 con 0x5644dcc0d1b0 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd386ffd640 1 -- 172.21.15.92:0/530489298 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3a0036070 con 0x5644dcc0d1b0 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd386ffd640 1 -- 172.21.15.92:0/530489298 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd398006350 con 0x5644dcc0d1b0 2024-09-21T07:21:42.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd3b442a740 10 client.17967 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:42.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd3b442a740 10 client.17967 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:21:42.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd3b442a740 20 client.17967 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:42.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd3b442a740 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5644dcbf49f0 0x5644dcffb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd3b442a740 4 client.17967 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:42.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.777+0000 7fd3b442a740 1 -- 172.21.15.92:0/530489298 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644dcf55df0 con 0x5644dcbf49f0 2024-09-21T07:21:42.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.778+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5644dcbf49f0 0x5644dcffb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.778+0000 7fd386ffd640 10 client.17967 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:21:42.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.778+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5644dcbf49f0 0x5644dcffb050 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b1fb1334ed6a7013 server_cookie=db5f2bbb9ce749db in_seq=0 out_seq=0 2024-09-21T07:21:42.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd386ffd640 1 -- 172.21.15.92:0/530489298 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644dcf55df0 con 0x5644dcbf49f0 2024-09-21T07:21:42.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd386ffd640 10 client.17967 handle_command_reply: tid=0 2024-09-21T07:21:42.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 client.17967 shutdown 2024-09-21T07:21:42.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 -- 172.21.15.92:0/530489298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc0d1b0 msgr2=0x5644dcfe8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc0d1b0 0x5644dcfe8db0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd3980167d0 tx=0x7fd3980046c0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 -- 172.21.15.92:0/530489298 shutdown_connections 2024-09-21T07:21:42.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5644dcbf49f0 0x5644dcffb050 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc36070 0x5644dcff5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 0x5644dcfe92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 --2- 172.21.15.92:0/530489298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc0d1b0 0x5644dcfe8db0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 -- 172.21.15.92:0/530489298 >> 172.21.15.92:0/530489298 conn(0x5644dcc2a460 msgr2=0x5644dcfe0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:42.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd386ffd640 0 client.17967 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:21:42.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 -- 172.21.15.92:0/530489298 shutdown_connections 2024-09-21T07:21:42.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 1 -- 172.21.15.92:0/530489298 wait complete. 2024-09-21T07:21:42.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.779+0000 7fd3b442a740 20 client.17967 trim_cache size 0 max 16384 2024-09-21T07:21:42.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.792+0000 7fd3b442a740 1 Processor -- start 2024-09-21T07:21:42.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.792+0000 7fd3b442a740 1 -- start start 2024-09-21T07:21:42.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.792+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 0x5644dcfdb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.792+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 0x5644dcff5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.792+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfe07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.792+0000 7fd3b442a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81b30f0 con 0x5644dcc36070 2024-09-21T07:21:42.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.792+0000 7fd3b442a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81b4c30 con 0x5644dcc15390 2024-09-21T07:21:42.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.792+0000 7fd3b442a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81b37c0 con 0x5644dcc0d1b0 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfe07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfe07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48760/0 (socket says 172.21.15.92:48760) 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a7fff640 1 -- 172.21.15.92:0/3060371121 learned_addr learned my addr 172.21.15.92:0/3060371121 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/3060371121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 0x5644dcff5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/3060371121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 0x5644dcfdb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a7fff640 1 -- 172.21.15.92:0/3060371121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 msgr2=0x5644dcfdb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/3060371121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 0x5644dcfdb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a7fff640 1 -- 172.21.15.92:0/3060371121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 msgr2=0x5644dcff5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/3060371121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 0x5644dcff5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a7fff640 1 -- 172.21.15.92:0/3060371121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644dcfea070 con 0x5644dcc36070 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/3060371121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 0x5644dcff5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/3060371121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfe07a0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fd3a002c010 tx=0x7fd3a0009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48dc19e7b117dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd38d7fa640 1 -- 172.21.15.92:0/3060371121 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0049040 con 0x5644dcc36070 2024-09-21T07:21:42.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd38d7fa640 1 -- 172.21.15.92:0/3060371121 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3a0036040 con 0x5644dcc36070 2024-09-21T07:21:42.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.793+0000 7fd38d7fa640 1 -- 172.21.15.92:0/3060371121 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0003d60 con 0x5644dcc36070 2024-09-21T07:21:42.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.794+0000 7fd3b442a740 1 -- 172.21.15.92:0/3060371121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 msgr2=0x5644dcfe07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.794+0000 7fd3b442a740 1 --2- 172.21.15.92:0/3060371121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfe07a0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fd3a002c010 tx=0x7fd3a0009650 comp rx=0 tx=0).stop 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.794+0000 7fd3b442a740 1 -- 172.21.15.92:0/3060371121 shutdown_connections 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.794+0000 7fd3b442a740 1 --2- 172.21.15.92:0/3060371121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc36070 0x5644dcfe07a0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.794+0000 7fd3b442a740 1 --2- 172.21.15.92:0/3060371121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc15390 0x5644dcff5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.794+0000 7fd3b442a740 1 --2- 172.21.15.92:0/3060371121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 0x5644dcfdb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.794+0000 7fd3b442a740 1 -- 172.21.15.92:0/3060371121 >> 172.21.15.92:0/3060371121 conn(0x5644dcc2a460 msgr2=0x5644dcfdaeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.794+0000 7fd3b442a740 1 -- 172.21.15.92:0/3060371121 shutdown_connections 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.794+0000 7fd3b442a740 1 -- 172.21.15.92:0/3060371121 wait complete. 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3b442a740 1 -- start start 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3b442a740 1 Processor -- start 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 0x5644dcfecf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc15390 0x5644dcfed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3b442a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc36070 0x5644dcfeda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3b442a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81b4560 con 0x5644dcc15390 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3b442a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81b3e90 con 0x5644dcc36070 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3b442a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81b10f0 con 0x5644dcc0d1b0 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3b442a740 10 client.0 _ll_register_callbacks cb 0x7fd398016480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3a6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc15390 0x5644dcfed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3a6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc15390 0x5644dcfed4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48762/0 (socket says 172.21.15.92:48762) 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.795+0000 7fd3a6ffd640 1 -- 172.21.15.92:0/3452985078 learned_addr learned my addr 172.21.15.92:0/3452985078 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc36070 0x5644dcfeda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3a6ffd640 1 -- 172.21.15.92:0/3452985078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 msgr2=0x5644dcfecf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 0x5644dcfecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 0x5644dcfecf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3a6ffd640 1 -- 172.21.15.92:0/3452985078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc36070 msgr2=0x5644dcfeda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc36070 0x5644dcfeda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3a6ffd640 1 -- 172.21.15.92:0/3452985078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644dd064a30 con 0x5644dcc15390 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3a7fff640 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc36070 0x5644dcfeda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 0x5644dcfecf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3a6ffd640 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc15390 0x5644dcfed4c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00cfd0 tx=0x7fd39c0a9560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d402b41aaca002 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd386ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd386ffd640 1 -- 172.21.15.92:0/3452985078 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c0b21a0 con 0x5644dcc15390 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd386ffd640 1 -- 172.21.15.92:0/3452985078 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fd39c0a9930 con 0x5644dcc15390 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3b442a740 1 -- 172.21.15.92:0/3452985078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a0036040 con 0x5644dcc15390 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd386ffd640 1 -- 172.21.15.92:0/3452985078 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd39c0b70e0 con 0x5644dcc15390 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3b442a740 10 client.17973 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.796+0000 7fd3b442a740 1 -- 172.21.15.92:0/3452985078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5644dd065c40 con 0x5644dcc15390 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd386ffd640 1 -- 172.21.15.92:0/3452985078 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3a0036040 con 0x5644dcc15390 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd386ffd640 1 -- 172.21.15.92:0/3452985078 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd39c0a9010 con 0x5644dcc15390 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd3b442a740 10 client.17973 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd3b442a740 10 client.17973 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:21:42.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd3b442a740 20 client.17973 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd3b442a740 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5644dcbc9da0 0x5644dd068360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd3b442a740 4 client.17973 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd3b442a740 1 -- 172.21.15.92:0/3452985078 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5644dcf518a0 con 0x5644dcbc9da0 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5644dcbc9da0 0x5644dd068360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd386ffd640 10 client.17973 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.797+0000 7fd3a77fe640 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5644dcbc9da0 0x5644dd068360 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69b365d0daf71615 server_cookie=71caedb3bc4d8f00 in_seq=0 out_seq=0 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd386ffd640 1 -- 172.21.15.92:0/3452985078 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5644dcf518a0 con 0x5644dcbc9da0 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd386ffd640 10 client.17973 handle_command_reply: tid=0 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 client.17973 shutdown 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 -- 172.21.15.92:0/3452985078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc15390 msgr2=0x5644dcfed4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc15390 0x5644dcfed4c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00cfd0 tx=0x7fd39c0a9560 comp rx=0 tx=0).stop 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 -- 172.21.15.92:0/3452985078 shutdown_connections 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5644dcbc9da0 0x5644dd068360 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644dcc36070 0x5644dcfeda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644dcc15390 0x5644dcfed4c0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd386ffd640 0 client.17973 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:21:42.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 --2- 172.21.15.92:0/3452985078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644dcc0d1b0 0x5644dcfecf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 -- 172.21.15.92:0/3452985078 >> 172.21.15.92:0/3452985078 conn(0x5644dcc2a460 msgr2=0x5644dcfde6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:42.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 -- 172.21.15.92:0/3452985078 shutdown_connections 2024-09-21T07:21:42.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 1 -- 172.21.15.92:0/3452985078 wait complete. 2024-09-21T07:21:42.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.798+0000 7fd3b442a740 20 client.17973 trim_cache size 0 max 16384 2024-09-21T07:21:42.806 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1926472302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3900b6680 msgr2=0x7fd3900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3900b6680 0x7fd3900b8b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x5644dcfdc320 tx=0x7fd398008040 comp rx=0 tx=0).stop 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1926472302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a8105290 msgr2=0x7fd3a8102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a8105290 0x7fd3a8102cb0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00c8c0 tx=0x7fd39c00cd80 comp rx=0 tx=0).stop 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1926472302 shutdown_connections 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd3900b6680 0x7fd3900b8b90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3a810de10 0x7fd3a81031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a8105290 0x7fd3a8102cb0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 --2- 172.21.15.92:0/1926472302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3a8104860 0x7fd3a8102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1926472302 >> 172.21.15.92:0/1926472302 conn(0x7fd3a8079740 msgr2=0x7fd3a8107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:42.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1926472302 shutdown_connections 2024-09-21T07:21:42.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:42.799+0000 7fd3adeb6640 1 -- 172.21.15.92:0/1926472302 wait complete. 2024-09-21T07:21:43.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:21:43.931 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:44.052 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:43 smithi092 ceph-mon[30987]: pgmap v603: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:21:44.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:43 smithi169 ceph-mon[33705]: pgmap v603: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:21:44.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:43 smithi175 ceph-mon[34064]: pgmap v603: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.475+0000 7f3df9989640 1 -- 172.21.15.92:0/3548303948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df410de50 msgr2=0x7f3df4110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.475+0000 7f3df9989640 1 --2- 172.21.15.92:0/3548303948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df410de50 0x7f3df4110340 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009900 tx=0x7f3dec02a410 comp rx=0 tx=0).stop 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.475+0000 7f3df9989640 1 -- 172.21.15.92:0/3548303948 shutdown_connections 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.475+0000 7f3df9989640 1 --2- 172.21.15.92:0/3548303948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df410de50 0x7f3df4110340 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.475+0000 7f3df9989640 1 --2- 172.21.15.92:0/3548303948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df4105340 0x7f3df410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.475+0000 7f3df9989640 1 --2- 172.21.15.92:0/3548303948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df41049f0 0x7f3df4104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.475+0000 7f3df9989640 1 -- 172.21.15.92:0/3548303948 >> 172.21.15.92:0/3548303948 conn(0x7f3df4079750 msgr2=0x7f3df4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.475+0000 7f3df9989640 1 -- 172.21.15.92:0/3548303948 shutdown_connections 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.475+0000 7f3df9989640 1 -- 172.21.15.92:0/3548303948 wait complete. 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.475+0000 7f3df9989640 1 Processor -- start 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df9989640 1 -- start start 2024-09-21T07:21:44.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df9989640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df41049f0 0x7f3df419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df9989640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df4105340 0x7f3df419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df9989640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df410de50 0x7f3df419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df9989640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3df4113960 con 0x7f3df41049f0 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df9989640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41137e0 con 0x7f3df410de50 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df9989640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3df4113ae0 con 0x7f3df4105340 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df41049f0 0x7f3df419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df41049f0 0x7f3df419a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48778/0 (socket says 172.21.15.92:48778) 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df2ffd640 1 -- 172.21.15.92:0/1208582083 learned_addr learned my addr 172.21.15.92:0/1208582083 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df27fc640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df4105340 0x7f3df419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df37fe640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df410de50 0x7f3df419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df2ffd640 1 -- 172.21.15.92:0/1208582083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df4105340 msgr2=0x7f3df419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df2ffd640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df4105340 0x7f3df419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df2ffd640 1 -- 172.21.15.92:0/1208582083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df410de50 msgr2=0x7f3df419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df2ffd640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df410de50 0x7f3df419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df2ffd640 1 -- 172.21.15.92:0/1208582083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df41a02a0 con 0x7f3df41049f0 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df37fe640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df410de50 0x7f3df419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.476+0000 7f3df2ffd640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df41049f0 0x7f3df419a330 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3de400eab0 tx=0x7f3de400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.477+0000 7f3df8987640 1 -- 172.21.15.92:0/1208582083 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de400ce40 con 0x7f3df41049f0 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.477+0000 7f3df8987640 1 -- 172.21.15.92:0/1208582083 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3de4011900 con 0x7f3df41049f0 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.477+0000 7f3df9989640 1 -- 172.21.15.92:0/1208582083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df41a0590 con 0x7f3df41049f0 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.477+0000 7f3df8987640 1 -- 172.21.15.92:0/1208582083 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de4010990 con 0x7f3df41049f0 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.477+0000 7f3df9989640 1 -- 172.21.15.92:0/1208582083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df41a6cf0 con 0x7f3df41049f0 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.479+0000 7f3dffefd740 1 Processor -- start 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.479+0000 7f3dffefd740 1 -- start start 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df8987640 1 -- 172.21.15.92:0/1208582083 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f3de4011470 con 0x7f3df41049f0 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4fe91b0 0x555ae53b9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4ff1390 0x555ae53b9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3dffefd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555ae532fea0 con 0x555ae5012070 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3dffefd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ae531f2d0 con 0x555ae4ff1390 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3dffefd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555ae53230e0 con 0x555ae4fe91b0 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53b92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48792/0 (socket says 172.21.15.92:48792) 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df37fe640 1 -- 172.21.15.92:0/263100442 learned_addr learned my addr 172.21.15.92:0/263100442 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df2ffd640 1 --2- 172.21.15.92:0/263100442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4fe91b0 0x555ae53b9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df27fc640 1 --2- 172.21.15.92:0/263100442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4ff1390 0x555ae53b9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df37fe640 1 -- 172.21.15.92:0/263100442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4fe91b0 msgr2=0x555ae53b9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df37fe640 1 --2- 172.21.15.92:0/263100442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4fe91b0 0x555ae53b9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df37fe640 1 -- 172.21.15.92:0/263100442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4ff1390 msgr2=0x555ae53b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:44.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df37fe640 1 --2- 172.21.15.92:0/263100442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4ff1390 0x555ae53b9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.480+0000 7f3df37fe640 1 -- 172.21.15.92:0/263100442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ae507d650 con 0x555ae5012070 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.481+0000 7f3df37fe640 1 --2- 172.21.15.92:0/263100442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53b92c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009a20 tx=0x7f3dec032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4250dd868e1bb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.481+0000 7f3df8987640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3ddc0b6700 0x7f3ddc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.481+0000 7f3df2ffd640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3ddc0b6700 0x7f3ddc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.481+0000 7f3dd9ffb640 1 -- 172.21.15.92:0/263100442 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec03f070 con 0x555ae5012070 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.481+0000 7f3dd9ffb640 1 -- 172.21.15.92:0/263100442 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dec0044c0 con 0x555ae5012070 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.481+0000 7f3dd9ffb640 1 -- 172.21.15.92:0/263100442 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec035070 con 0x555ae5012070 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.481+0000 7f3df8987640 1 -- 172.21.15.92:0/1208582083 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f3de40e81b0 con 0x7f3df41049f0 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 -- 172.21.15.92:0/263100442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 msgr2=0x555ae53b92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3df2ffd640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3ddc0b6700 0x7f3ddc0b8c10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3de40e55b0 tx=0x7f3de40094a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 --2- 172.21.15.92:0/263100442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53b92c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009a20 tx=0x7f3dec032c40 comp rx=0 tx=0).stop 2024-09-21T07:21:44.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 -- 172.21.15.92:0/263100442 shutdown_connections 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 --2- 172.21.15.92:0/263100442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4ff1390 0x555ae53b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 --2- 172.21.15.92:0/263100442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4fe91b0 0x555ae53b9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 --2- 172.21.15.92:0/263100442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53b92c0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 -- 172.21.15.92:0/263100442 >> 172.21.15.92:0/263100442 conn(0x555ae5006460 msgr2=0x555ae53b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 -- 172.21.15.92:0/263100442 shutdown_connections 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 -- 172.21.15.92:0/263100442 wait complete. 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 -- start start 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.482+0000 7f3dffefd740 1 Processor -- start 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4fe91b0 0x555ae53c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4ff1390 0x555ae53c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae5012070 0x555ae53d50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3dffefd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555ae5180700 con 0x555ae4ff1390 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3dffefd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ae52ba160 con 0x555ae4fe91b0 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3dffefd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555ae53cbda0 con 0x555ae5012070 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3dffefd740 10 client.0 _ll_register_callbacks cb 0x555ae52d39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4ff1390 0x555ae53c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4ff1390 0x555ae53c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48804/0 (socket says 172.21.15.92:48804) 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df27fc640 1 -- 172.21.15.92:0/1007253676 learned_addr learned my addr 172.21.15.92:0/1007253676 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df37fe640 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4fe91b0 0x555ae53c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df37fe640 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae5012070 0x555ae53d50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df27fc640 1 -- 172.21.15.92:0/1007253676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae5012070 msgr2=0x555ae53d50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df27fc640 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae5012070 0x555ae53d50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df27fc640 1 -- 172.21.15.92:0/1007253676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4fe91b0 msgr2=0x555ae53c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df27fc640 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4fe91b0 0x555ae53c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df27fc640 1 -- 172.21.15.92:0/1007253676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ae52e7c90 con 0x555ae4ff1390 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3df27fc640 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4ff1390 0x555ae53c92a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009e00 tx=0x7f3de80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4e3de42c4bed6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.483+0000 7f3dd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/1007253676 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8012860 con 0x555ae4ff1390 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/1007253676 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f3de8012a00 con 0x555ae4ff1390 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dffefd740 1 -- 172.21.15.92:0/1007253676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555ae5331df0 con 0x555ae4ff1390 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/1007253676 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3de8025050 con 0x555ae4ff1390 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dffefd740 10 client.17985 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dffefd740 1 -- 172.21.15.92:0/1007253676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555ae53d7b40 con 0x555ae4ff1390 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/1007253676 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555ae5331df0 con 0x555ae4ff1390 2024-09-21T07:21:44.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/1007253676 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3de800f040 con 0x555ae4ff1390 2024-09-21T07:21:44.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dffefd740 10 client.17985 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:44.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dffefd740 10 client.17985 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:21:44.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dffefd740 20 client.17985 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:44.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dffefd740 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ae4fd09f0 0x555ae53db0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dffefd740 4 client.17985 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:44.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.484+0000 7f3dffefd740 1 -- 172.21.15.92:0/1007253676 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ae532d8a0 con 0x555ae4fd09f0 2024-09-21T07:21:44.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.485+0000 7f3df37fe640 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ae4fd09f0 0x555ae53db0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.485+0000 7f3df37fe640 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ae4fd09f0 0x555ae53db0b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=27add8ad6e2216a7 server_cookie=1682220c990a95da in_seq=0 out_seq=0 2024-09-21T07:21:44.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.485+0000 7f3dd2ffd640 10 client.17985 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/1007253676 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ae532d8a0 con 0x555ae4fd09f0 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dd2ffd640 10 client.17985 handle_command_reply: tid=0 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 client.17985 shutdown 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 -- 172.21.15.92:0/1007253676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4ff1390 msgr2=0x555ae53c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4ff1390 0x555ae53c92a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009e00 tx=0x7f3de80117b0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 -- 172.21.15.92:0/1007253676 shutdown_connections 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ae4fd09f0 0x555ae53db0b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae5012070 0x555ae53d50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4ff1390 0x555ae53c92a0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dd2ffd640 0 client.17985 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 --2- 172.21.15.92:0/1007253676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4fe91b0 0x555ae53c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 -- 172.21.15.92:0/1007253676 >> 172.21.15.92:0/1007253676 conn(0x555ae5006460 msgr2=0x555ae53b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:44.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 -- 172.21.15.92:0/1007253676 shutdown_connections 2024-09-21T07:21:44.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 1 -- 172.21.15.92:0/1007253676 wait complete. 2024-09-21T07:21:44.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.486+0000 7f3dffefd740 20 client.17985 trim_cache size 0 max 16384 2024-09-21T07:21:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.499+0000 7f3dffefd740 1 Processor -- start 2024-09-21T07:21:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.499+0000 7f3dffefd740 1 -- start start 2024-09-21T07:21:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.499+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4fe91b0 0x555ae53bacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.499+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4ff1390 0x555ae53ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.499+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae5012070 0x555ae53d4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.499+0000 7f3dffefd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41aec60 con 0x555ae4fe91b0 2024-09-21T07:21:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.499+0000 7f3dffefd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41b07a0 con 0x555ae5012070 2024-09-21T07:21:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.499+0000 7f3dffefd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41af330 con 0x555ae4ff1390 2024-09-21T07:21:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4fe91b0 0x555ae53bacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4fe91b0 0x555ae53bacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48816/0 (socket says 172.21.15.92:48816) 2024-09-21T07:21:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df37fe640 1 -- 172.21.15.92:0/1305852596 learned_addr learned my addr 172.21.15.92:0/1305852596 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df27fc640 1 --2- 172.21.15.92:0/1305852596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4ff1390 0x555ae53ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df37fe640 1 --2- 172.21.15.92:0/1305852596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae5012070 0x555ae53d4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df37fe640 1 -- 172.21.15.92:0/1305852596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4ff1390 msgr2=0x555ae53ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:44.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df37fe640 1 --2- 172.21.15.92:0/1305852596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4ff1390 0x555ae53ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df37fe640 1 -- 172.21.15.92:0/1305852596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae5012070 msgr2=0x555ae53d4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df37fe640 1 --2- 172.21.15.92:0/1305852596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae5012070 0x555ae53d4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df37fe640 1 -- 172.21.15.92:0/1305852596 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ae53cb890 con 0x555ae4fe91b0 2024-09-21T07:21:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3df37fe640 1 --2- 172.21.15.92:0/1305852596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4fe91b0 0x555ae53bacb0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3dec000c00 tx=0x7f3dec0051e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1d08af05d7d82a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3dd97fa640 1 -- 172.21.15.92:0/1305852596 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec03f040 con 0x555ae4fe91b0 2024-09-21T07:21:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3dd97fa640 1 -- 172.21.15.92:0/1305852596 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dec005450 con 0x555ae4fe91b0 2024-09-21T07:21:44.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.500+0000 7f3dd97fa640 1 -- 172.21.15.92:0/1305852596 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec035040 con 0x555ae4fe91b0 2024-09-21T07:21:44.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.501+0000 7f3dffefd740 1 -- 172.21.15.92:0/1305852596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4fe91b0 msgr2=0x555ae53bacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.501+0000 7f3dffefd740 1 --2- 172.21.15.92:0/1305852596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4fe91b0 0x555ae53bacb0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3dec000c00 tx=0x7f3dec0051e0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.501+0000 7f3dffefd740 1 -- 172.21.15.92:0/1305852596 shutdown_connections 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.501+0000 7f3dffefd740 1 --2- 172.21.15.92:0/1305852596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae5012070 0x555ae53d4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.501+0000 7f3dffefd740 1 --2- 172.21.15.92:0/1305852596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4ff1390 0x555ae53ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.501+0000 7f3dffefd740 1 --2- 172.21.15.92:0/1305852596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae4fe91b0 0x555ae53bacb0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.501+0000 7f3dffefd740 1 -- 172.21.15.92:0/1305852596 >> 172.21.15.92:0/1305852596 conn(0x555ae5006460 msgr2=0x555ae53ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.501+0000 7f3dffefd740 1 -- 172.21.15.92:0/1305852596 shutdown_connections 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.501+0000 7f3dffefd740 1 -- 172.21.15.92:0/1305852596 wait complete. 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3dffefd740 1 -- start start 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3dffefd740 1 Processor -- start 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4fe91b0 0x555ae53cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4ff1390 0x555ae53cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3dffefd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3dffefd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41b00d0 con 0x555ae5012070 2024-09-21T07:21:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3dffefd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41afa00 con 0x555ae4ff1390 2024-09-21T07:21:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3dffefd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41acc60 con 0x555ae4fe91b0 2024-09-21T07:21:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3dffefd740 10 client.0 _ll_register_callbacks cb 0x7f3de8009630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48828/0 (socket says 172.21.15.92:48828) 2024-09-21T07:21:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.502+0000 7f3df37fe640 1 -- 172.21.15.92:0/2637414894 learned_addr learned my addr 172.21.15.92:0/2637414894 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3df37fe640 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4fe91b0 0x555ae53cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3df27fc640 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4ff1390 0x555ae53cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3df37fe640 1 -- 172.21.15.92:0/2637414894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4fe91b0 msgr2=0x555ae53cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3df37fe640 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4fe91b0 0x555ae53cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3df37fe640 1 -- 172.21.15.92:0/2637414894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4ff1390 msgr2=0x555ae53cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3df37fe640 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4ff1390 0x555ae53cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3df37fe640 1 -- 172.21.15.92:0/2637414894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ae5444ae0 con 0x555ae5012070 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3df37fe640 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53cdaa0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3dec033000 tx=0x7f3dec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a3fec2c4c830c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3dd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/2637414894 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec035030 con 0x555ae5012070 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3dffefd740 1 -- 172.21.15.92:0/2637414894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dec005450 con 0x555ae5012070 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/2637414894 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f3dec004880 con 0x555ae5012070 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/2637414894 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3dec03f040 con 0x555ae5012070 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3dffefd740 10 client.17991 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3dffefd740 1 -- 172.21.15.92:0/2637414894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555ae5445d40 con 0x555ae5012070 2024-09-21T07:21:44.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/2637414894 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dec005450 con 0x555ae5012070 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.503+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/2637414894 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3dec03b900 con 0x555ae5012070 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3dffefd740 10 client.17991 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3dffefd740 10 client.17991 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3dffefd740 20 client.17991 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3dffefd740 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ae4fa5da0 0x555ae5447f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3dffefd740 4 client.17991 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3dffefd740 1 -- 172.21.15.92:0/2637414894 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ae532acd0 con 0x555ae4fa5da0 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3df27fc640 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ae4fa5da0 0x555ae5447f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3dd2ffd640 10 client.17991 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3df27fc640 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ae4fa5da0 0x555ae5447f20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=10515336551743a5 server_cookie=b8e775c1642cd94a in_seq=0 out_seq=0 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3dd2ffd640 1 -- 172.21.15.92:0/2637414894 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ae532acd0 con 0x555ae4fa5da0 2024-09-21T07:21:44.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3dd2ffd640 10 client.17991 handle_command_reply: tid=0 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.504+0000 7f3dffefd740 1 client.17991 shutdown 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 1 -- 172.21.15.92:0/2637414894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 msgr2=0x555ae53cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53cdaa0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3dec033000 tx=0x7f3dec009780 comp rx=0 tx=0).stop 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 1 -- 172.21.15.92:0/2637414894 shutdown_connections 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x555ae4fa5da0 0x555ae5447f20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ae5012070 0x555ae53cdaa0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ae4ff1390 0x555ae53cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 1 --2- 172.21.15.92:0/2637414894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ae4fe91b0 0x555ae53cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 1 -- 172.21.15.92:0/2637414894 >> 172.21.15.92:0/2637414894 conn(0x555ae5006460 msgr2=0x555ae53baa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dd2ffd640 0 client.17991 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 1 -- 172.21.15.92:0/2637414894 shutdown_connections 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 1 -- 172.21.15.92:0/2637414894 wait complete. 2024-09-21T07:21:44.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3dffefd740 20 client.17991 trim_cache size 0 max 16384 2024-09-21T07:21:44.513 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:44.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3df9989640 1 -- 172.21.15.92:0/1208582083 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3ddc0b6700 msgr2=0x7f3ddc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3df9989640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3ddc0b6700 0x7f3ddc0b8c10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3de40e55b0 tx=0x7f3de40094a0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3df9989640 1 -- 172.21.15.92:0/1208582083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df41049f0 msgr2=0x7f3df419a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3df9989640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df41049f0 0x7f3df419a330 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3de400eab0 tx=0x7f3de400ef70 comp rx=0 tx=0).stop 2024-09-21T07:21:44.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3df9989640 1 -- 172.21.15.92:0/1208582083 shutdown_connections 2024-09-21T07:21:44.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3df9989640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3ddc0b6700 0x7f3ddc0b8c10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3df9989640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3df410de50 0x7f3df419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3df9989640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df4105340 0x7f3df419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3df9989640 1 --2- 172.21.15.92:0/1208582083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df41049f0 0x7f3df419a330 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.505+0000 7f3df9989640 1 -- 172.21.15.92:0/1208582083 >> 172.21.15.92:0/1208582083 conn(0x7f3df4079750 msgr2=0x7f3df41007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:44.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.506+0000 7f3df9989640 1 -- 172.21.15.92:0/1208582083 shutdown_connections 2024-09-21T07:21:44.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:44.506+0000 7f3df9989640 1 -- 172.21.15.92:0/1208582083 wait complete. 2024-09-21T07:21:45.226 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:21:45.471 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:46.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.007+0000 7faf1fa43640 1 -- 172.21.15.92:0/1435062920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf18108420 msgr2=0x7faf18108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.007+0000 7faf1fa43640 1 --2- 172.21.15.92:0/1435062920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf18108420 0x7faf18108830 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7faf08009900 tx=0x7faf0802a410 comp rx=0 tx=0).stop 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.007+0000 7faf1fa43640 1 -- 172.21.15.92:0/1435062920 shutdown_connections 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.007+0000 7faf1fa43640 1 --2- 172.21.15.92:0/1435062920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18108d70 0x7faf1810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.007+0000 7faf1fa43640 1 --2- 172.21.15.92:0/1435062920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf18108420 0x7faf18108830 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.007+0000 7faf1fa43640 1 --2- 172.21.15.92:0/1435062920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf18102ae0 0x7faf18102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.007+0000 7faf1fa43640 1 -- 172.21.15.92:0/1435062920 >> 172.21.15.92:0/1435062920 conn(0x7faf18079770 msgr2=0x7faf18079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.007+0000 7faf1fa43640 1 -- 172.21.15.92:0/1435062920 shutdown_connections 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.007+0000 7faf1fa43640 1 -- 172.21.15.92:0/1435062920 wait complete. 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.008+0000 7faf1fa43640 1 Processor -- start 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.008+0000 7faf1fa43640 1 -- start start 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.008+0000 7faf1fa43640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf18102ae0 0x7faf181992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.008+0000 7faf1fa43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18108420 0x7faf18199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.008+0000 7faf1fa43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf18108d70 0x7faf1819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.008+0000 7faf1fa43640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faf181128e0 con 0x7faf18102ae0 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.008+0000 7faf1fa43640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf18112760 con 0x7faf18108d70 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.008+0000 7faf1fa43640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf18112a60 con 0x7faf18108420 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.008+0000 7faf1d7df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf18102ae0 0x7faf181992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.008+0000 7faf1d7df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf18102ae0 0x7faf181992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48834/0 (socket says 172.21.15.92:48834) 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1d7df640 1 -- 172.21.15.92:0/3557124521 learned_addr learned my addr 172.21.15.92:0/3557124521 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1cfde640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18108420 0x7faf18199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf18108d70 0x7faf1819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1d7df640 1 -- 172.21.15.92:0/3557124521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18108420 msgr2=0x7faf18199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1d7df640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18108420 0x7faf18199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1d7df640 1 -- 172.21.15.92:0/3557124521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf18108d70 msgr2=0x7faf1819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1d7df640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf18108d70 0x7faf1819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1d7df640 1 -- 172.21.15.92:0/3557124521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1819f260 con 0x7faf18102ae0 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1cfde640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18108420 0x7faf18199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf18108d70 0x7faf1819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1d7df640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf18102ae0 0x7faf181992f0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7faf1400db80 tx=0x7faf1400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf0e7fc640 1 -- 172.21.15.92:0/3557124521 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14017070 con 0x7faf18102ae0 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1fa43640 1 -- 172.21.15.92:0/3557124521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1819f550 con 0x7faf18102ae0 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf0e7fc640 1 -- 172.21.15.92:0/3557124521 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf14004020 con 0x7faf18102ae0 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf0e7fc640 1 -- 172.21.15.92:0/3557124521 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1400be60 con 0x7faf18102ae0 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.009+0000 7faf1fa43640 1 -- 172.21.15.92:0/3557124521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf181a5cb0 con 0x7faf18102ae0 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf25fb7740 1 Processor -- start 2024-09-21T07:21:46.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf25fb7740 1 -- start start 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd1e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 0x55e9cd1e3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf25fb7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e9cd159ea0 con 0x55e9cce3c070 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf0e7fc640 1 -- 172.21.15.92:0/3557124521 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7faf140106c0 con 0x7faf18102ae0 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf25fb7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e9cd1492d0 con 0x55e9cce1b390 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf25fb7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e9cd14d0e0 con 0x55e9cce131b0 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf1dfe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf1dfe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1e5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48848/0 (socket says 172.21.15.92:48848) 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf1dfe0640 1 -- 172.21.15.92:0/3329314525 learned_addr learned my addr 172.21.15.92:0/3329314525 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.012+0000 7faf1cfde640 1 --2- 172.21.15.92:0/3329314525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 0x55e9cd1e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf1dfe0640 1 -- 172.21.15.92:0/3329314525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 msgr2=0x55e9cd1e32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/3329314525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd1e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf1dfe0640 1 -- 172.21.15.92:0/3329314525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 msgr2=0x55e9cd1e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/3329314525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 0x55e9cd1e3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf1dfe0640 1 -- 172.21.15.92:0/3329314525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ccea7650 con 0x55e9cce3c070 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf1cfde640 1 --2- 172.21.15.92:0/3329314525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 0x55e9cd1e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/3329314525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1e5da0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7faf1000bca0 tx=0x7faf1000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bc0ae18bed4520 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf037fe640 1 -- 172.21.15.92:0/3329314525 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10015070 con 0x55e9cce3c070 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf037fe640 1 -- 172.21.15.92:0/3329314525 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf100054b0 con 0x55e9cce3c070 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf0e7fc640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faf040b6680 0x7faf040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf037fe640 1 -- 172.21.15.92:0/3329314525 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10011440 con 0x55e9cce3c070 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf1d7df640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faf040b6680 0x7faf040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.013+0000 7faf0e7fc640 1 -- 172.21.15.92:0/3557124521 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7faf140e7a50 con 0x7faf18102ae0 2024-09-21T07:21:46.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf25fb7740 1 -- 172.21.15.92:0/3329314525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 msgr2=0x55e9cd1e5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf1d7df640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faf040b6680 0x7faf040b8b90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55e9cd1e1f40 tx=0x7faf1407a150 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf25fb7740 1 --2- 172.21.15.92:0/3329314525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1e5da0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7faf1000bca0 tx=0x7faf1000f730 comp rx=0 tx=0).stop 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf25fb7740 1 -- 172.21.15.92:0/3329314525 shutdown_connections 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf25fb7740 1 --2- 172.21.15.92:0/3329314525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 0x55e9cd1e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf25fb7740 1 --2- 172.21.15.92:0/3329314525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd1e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf25fb7740 1 --2- 172.21.15.92:0/3329314525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1e5da0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf25fb7740 1 -- 172.21.15.92:0/3329314525 >> 172.21.15.92:0/3329314525 conn(0x55e9cce30460 msgr2=0x55e9cd1e11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf25fb7740 1 -- 172.21.15.92:0/3329314525 shutdown_connections 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf25fb7740 1 -- 172.21.15.92:0/3329314525 wait complete. 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.014+0000 7faf25fb7740 1 -- start start 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf25fb7740 1 Processor -- start 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd1f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 0x55e9cd1f3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf25fb7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e9ccfaa700 con 0x55e9cce3c070 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf25fb7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e9cd0e4160 con 0x55e9cce1b390 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf25fb7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e9cd1f5df0 con 0x55e9cce131b0 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf25fb7740 10 client.0 _ll_register_callbacks cb 0x55e9cd0fd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf1dfe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf1dfe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1ff1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48854/0 (socket says 172.21.15.92:48854) 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf1dfe0640 1 -- 172.21.15.92:0/2328759284 learned_addr learned my addr 172.21.15.92:0/2328759284 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf1cfde640 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 0x55e9cd1f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.015+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd1f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf1dfe0640 1 -- 172.21.15.92:0/2328759284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 msgr2=0x55e9cd1f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd1f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf1dfe0640 1 -- 172.21.15.92:0/2328759284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 msgr2=0x55e9cd1f3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 0x55e9cd1f3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf1dfe0640 1 -- 172.21.15.92:0/2328759284 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9cd111c90 con 0x55e9cce3c070 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1ff1b0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7faf10005d30 tx=0x7faf100056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777872b02b833b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf00ff9640 1 -- 172.21.15.92:0/2328759284 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10015070 con 0x55e9cce3c070 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf00ff9640 1 -- 172.21.15.92:0/2328759284 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7faf10005210 con 0x55e9cce3c070 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf25fb7740 1 -- 172.21.15.92:0/2328759284 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf100054b0 con 0x55e9cce3c070 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf00ff9640 1 -- 172.21.15.92:0/2328759284 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf10011440 con 0x55e9cce3c070 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf25fb7740 10 client.18003 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf25fb7740 1 -- 172.21.15.92:0/2328759284 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e9cd201b90 con 0x55e9cce3c070 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf00ff9640 1 -- 172.21.15.92:0/2328759284 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf100054b0 con 0x55e9cce3c070 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf00ff9640 1 -- 172.21.15.92:0/2328759284 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faf10027020 con 0x55e9cce3c070 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf25fb7740 10 client.18003 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf25fb7740 10 client.18003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf25fb7740 20 client.18003 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.016+0000 7faf25fb7740 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e9ccdfa9f0 0x55e9cd205000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.017+0000 7faf25fb7740 4 client.18003 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:46.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.017+0000 7faf25fb7740 1 -- 172.21.15.92:0/2328759284 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9cd15bdf0 con 0x55e9ccdfa9f0 2024-09-21T07:21:46.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.017+0000 7faf1cfde640 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e9ccdfa9f0 0x55e9cd205000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.017+0000 7faf1cfde640 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e9ccdfa9f0 0x55e9cd205000 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4754e5400fdb5444 server_cookie=bdd3ffafdb21c8c8 in_seq=0 out_seq=0 2024-09-21T07:21:46.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.017+0000 7faf00ff9640 10 client.18003 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:46.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf00ff9640 1 -- 172.21.15.92:0/2328759284 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9cd15bdf0 con 0x55e9ccdfa9f0 2024-09-21T07:21:46.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf00ff9640 10 client.18003 handle_command_reply: tid=0 2024-09-21T07:21:46.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 client.18003 shutdown 2024-09-21T07:21:46.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 -- 172.21.15.92:0/2328759284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 msgr2=0x55e9cd1ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1ff1b0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7faf10005d30 tx=0x7faf100056a0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:45 smithi092 ceph-mon[30987]: pgmap v604: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:21:46.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 -- 172.21.15.92:0/2328759284 shutdown_connections 2024-09-21T07:21:46.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e9ccdfa9f0 0x55e9cd205000 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce3c070 0x55e9cd1ff1b0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce1b390 0x55e9cd1f3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf00ff9640 0 client.18003 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:46.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 --2- 172.21.15.92:0/2328759284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd1f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 -- 172.21.15.92:0/2328759284 >> 172.21.15.92:0/2328759284 conn(0x55e9cce30460 msgr2=0x55e9cd1df750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:46.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 -- 172.21.15.92:0/2328759284 shutdown_connections 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 1 -- 172.21.15.92:0/2328759284 wait complete. 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.018+0000 7faf25fb7740 20 client.18003 trim_cache size 0 max 16384 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.031+0000 7faf25fb7740 1 Processor -- start 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.031+0000 7faf25fb7740 1 -- start start 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.031+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9ccdfa9f0 0x55e9cd1e9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce131b0 0x55e9cd1f3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd1e0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf25fb7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faf181aeda0 con 0x55e9cce1b390 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf25fb7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf181b08e0 con 0x55e9cce131b0 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf25fb7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf181af470 con 0x55e9ccdfa9f0 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1dfe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd1e0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1dfe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd1e0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48860/0 (socket says 172.21.15.92:48860) 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1dfe0640 1 -- 172.21.15.92:0/1648011280 learned_addr learned my addr 172.21.15.92:0/1648011280 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:46.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/1648011280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9ccdfa9f0 0x55e9cd1e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1dfe0640 1 -- 172.21.15.92:0/1648011280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9ccdfa9f0 msgr2=0x55e9cd1e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:46.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/1648011280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9ccdfa9f0 0x55e9cd1e9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1dfe0640 1 -- 172.21.15.92:0/1648011280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce131b0 msgr2=0x55e9cd1f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:46.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1cfde640 1 --2- 172.21.15.92:0/1648011280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce131b0 0x55e9cd1f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/1648011280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce131b0 0x55e9cd1f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1dfe0640 1 -- 172.21.15.92:0/1648011280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9cd1f1440 con 0x55e9cce1b390 2024-09-21T07:21:46.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1cfde640 1 --2- 172.21.15.92:0/1648011280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce131b0 0x55e9cd1f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/1648011280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd1e0fb0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7faf10005c80 tx=0x7faf1000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620c8c80c38a9c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf02ffd640 1 -- 172.21.15.92:0/1648011280 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10015070 con 0x55e9cce1b390 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf02ffd640 1 -- 172.21.15.92:0/1648011280 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf1001e020 con 0x55e9cce1b390 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.032+0000 7faf02ffd640 1 -- 172.21.15.92:0/1648011280 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10019ba0 con 0x55e9cce1b390 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 -- 172.21.15.92:0/1648011280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 msgr2=0x55e9cd1e0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 --2- 172.21.15.92:0/1648011280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd1e0fb0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7faf10005c80 tx=0x7faf1000f730 comp rx=0 tx=0).stop 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 -- 172.21.15.92:0/1648011280 shutdown_connections 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 --2- 172.21.15.92:0/1648011280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd1e0fb0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 --2- 172.21.15.92:0/1648011280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9cce131b0 0x55e9cd1f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 --2- 172.21.15.92:0/1648011280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9ccdfa9f0 0x55e9cd1e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 -- 172.21.15.92:0/1648011280 >> 172.21.15.92:0/1648011280 conn(0x55e9cce30460 msgr2=0x55e9cd1f2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:46.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 -- 172.21.15.92:0/1648011280 shutdown_connections 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 -- 172.21.15.92:0/1648011280 wait complete. 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 -- start start 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.033+0000 7faf25fb7740 1 Processor -- start 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9ccdfa9f0 0x55e9cd208030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd208570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf25fb7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd205000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf25fb7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faf181b0210 con 0x55e9cce1b390 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf25fb7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf181afb40 con 0x55e9ccdfa9f0 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf25fb7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf181acda0 con 0x55e9cce131b0 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf25fb7740 10 client.0 _ll_register_callbacks cb 0x7faf1000bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf1dfe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd205000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf1dfe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd205000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48862/0 (socket says 172.21.15.92:48862) 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf1dfe0640 1 -- 172.21.15.92:0/3874400697 learned_addr learned my addr 172.21.15.92:0/3874400697 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:46.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf1cfde640 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd208570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf1dfe0640 1 -- 172.21.15.92:0/3874400697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 msgr2=0x55e9cd208570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd208570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf1dfe0640 1 -- 172.21.15.92:0/3874400697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9ccdfa9f0 msgr2=0x55e9cd208030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9ccdfa9f0 0x55e9cd208030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf1dfe0640 1 -- 172.21.15.92:0/3874400697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9cd208cb0 con 0x55e9cce1b390 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf1dfe0640 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd205000 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7faf10000c00 tx=0x7faf10019ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74abdb2baad65cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.034+0000 7faf00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf00ff9640 1 -- 172.21.15.92:0/3874400697 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10015040 con 0x55e9cce1b390 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf00ff9640 1 -- 172.21.15.92:0/3874400697 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7faf1000fc30 con 0x55e9cce1b390 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf25fb7740 1 -- 172.21.15.92:0/3874400697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf1001e020 con 0x55e9cce1b390 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf00ff9640 1 -- 172.21.15.92:0/3874400697 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf10041050 con 0x55e9cce1b390 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf25fb7740 10 client.18009 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf25fb7740 1 -- 172.21.15.92:0/3874400697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e9cd26fb10 con 0x55e9cce1b390 2024-09-21T07:21:46.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf00ff9640 1 -- 172.21.15.92:0/3874400697 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf1001e020 con 0x55e9cce1b390 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf00ff9640 1 -- 172.21.15.92:0/3874400697 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faf10027040 con 0x55e9cce1b390 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf25fb7740 10 client.18009 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf25fb7740 10 client.18009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf25fb7740 20 client.18009 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf25fb7740 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e9cce3c070 0x55e9cd272320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf25fb7740 4 client.18009 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.035+0000 7faf25fb7740 1 -- 172.21.15.92:0/3874400697 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9cd1578a0 con 0x55e9cce3c070 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf1cfde640 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e9cce3c070 0x55e9cd272320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf1cfde640 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e9cce3c070 0x55e9cd272320 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d912b48fd1d150c7 server_cookie=719c14c735c1934d in_seq=0 out_seq=0 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf00ff9640 10 client.18009 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf00ff9640 1 -- 172.21.15.92:0/3874400697 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9cd1578a0 con 0x55e9cce3c070 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf00ff9640 10 client.18009 handle_command_reply: tid=0 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 client.18009 shutdown 2024-09-21T07:21:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 -- 172.21.15.92:0/3874400697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 msgr2=0x55e9cd205000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd205000 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7faf10000c00 tx=0x7faf10019ab0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 -- 172.21.15.92:0/3874400697 shutdown_connections 2024-09-21T07:21:46.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e9cce3c070 0x55e9cd272320 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.126 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:46.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9cce1b390 0x55e9cd205000 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e9cce131b0 0x55e9cd208570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf00ff9640 0 client.18009 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:46.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 --2- 172.21.15.92:0/3874400697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9ccdfa9f0 0x55e9cd208030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 -- 172.21.15.92:0/3874400697 >> 172.21.15.92:0/3874400697 conn(0x55e9cce30460 msgr2=0x55e9cd1e42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 -- 172.21.15.92:0/3874400697 shutdown_connections 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.036+0000 7faf25fb7740 1 -- 172.21.15.92:0/3874400697 wait complete. 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf25fb7740 20 client.18009 trim_cache size 0 max 16384 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 -- 172.21.15.92:0/3557124521 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faf040b6680 msgr2=0x7faf040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faf040b6680 0x7faf040b8b90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55e9cd1e1f40 tx=0x7faf1407a150 comp rx=0 tx=0).stop 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 -- 172.21.15.92:0/3557124521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf18102ae0 msgr2=0x7faf181992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf18102ae0 0x7faf181992f0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7faf1400db80 tx=0x7faf1400b630 comp rx=0 tx=0).stop 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 -- 172.21.15.92:0/3557124521 shutdown_connections 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7faf040b6680 0x7faf040b8b90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf18108d70 0x7faf1819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18108420 0x7faf18199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 --2- 172.21.15.92:0/3557124521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf18102ae0 0x7faf181992f0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 -- 172.21.15.92:0/3557124521 >> 172.21.15.92:0/3557124521 conn(0x7faf18079770 msgr2=0x7faf18106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 -- 172.21.15.92:0/3557124521 shutdown_connections 2024-09-21T07:21:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:46.037+0000 7faf1fa43640 1 -- 172.21.15.92:0/3557124521 wait complete. 2024-09-21T07:21:46.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:45 smithi169 ceph-mon[33705]: pgmap v604: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:21:46.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:45 smithi175 ceph-mon[34064]: pgmap v604: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:21:47.965 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:21:47.965 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:21:48.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:47 smithi169 ceph-mon[33705]: pgmap v605: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:21:48.219 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:48.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:47 smithi175 ceph-mon[34064]: pgmap v605: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:21:48.340 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:47 smithi092 ceph-mon[30987]: pgmap v605: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.680+0000 7f2e4a938640 1 -- 172.21.15.92:0/1356975182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e44108d70 msgr2=0x7f2e4410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.680+0000 7f2e4a938640 1 --2- 172.21.15.92:0/1356975182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e44108d70 0x7f2e4410f5a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009ca0 tx=0x7f2e3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.680+0000 7f2e4a938640 1 -- 172.21.15.92:0/1356975182 shutdown_connections 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.680+0000 7f2e4a938640 1 --2- 172.21.15.92:0/1356975182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e44108d70 0x7f2e4410f5a0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.680+0000 7f2e4a938640 1 --2- 172.21.15.92:0/1356975182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e44108420 0x7f2e44108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.680+0000 7f2e4a938640 1 --2- 172.21.15.92:0/1356975182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e44102ae0 0x7f2e44102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.680+0000 7f2e4a938640 1 -- 172.21.15.92:0/1356975182 >> 172.21.15.92:0/1356975182 conn(0x7f2e44079770 msgr2=0x7f2e44079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.680+0000 7f2e4a938640 1 -- 172.21.15.92:0/1356975182 shutdown_connections 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.680+0000 7f2e4a938640 1 -- 172.21.15.92:0/1356975182 wait complete. 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.681+0000 7f2e4a938640 1 Processor -- start 2024-09-21T07:21:48.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.681+0000 7f2e4a938640 1 -- start start 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e4a938640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e44102ae0 0x7f2e44199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e4a938640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e44108420 0x7f2e441998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e4a938640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e44108d70 0x7f2e4419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e4a938640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e44112930 con 0x7f2e44108420 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e4a938640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441127b0 con 0x7f2e44108d70 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e4a938640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e44112ab0 con 0x7f2e44102ae0 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e437fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e44108420 0x7f2e441998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e437fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e44108420 0x7f2e441998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48872/0 (socket says 172.21.15.92:48872) 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e437fe640 1 -- 172.21.15.92:0/58624900 learned_addr learned my addr 172.21.15.92:0/58624900 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e48ed5640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e44108d70 0x7f2e4419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e43fff640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e44102ae0 0x7f2e44199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e437fe640 1 -- 172.21.15.92:0/58624900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e44102ae0 msgr2=0x7f2e44199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e437fe640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e44102ae0 0x7f2e44199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e437fe640 1 -- 172.21.15.92:0/58624900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e44108d70 msgr2=0x7f2e4419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e437fe640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e44108d70 0x7f2e4419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e437fe640 1 -- 172.21.15.92:0/58624900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4419f270 con 0x7f2e44108420 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e437fe640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e44108420 0x7f2e441998a0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800d750 tx=0x7f2e3800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e417fa640 1 -- 172.21.15.92:0/58624900 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38017070 con 0x7f2e44108420 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e417fa640 1 -- 172.21.15.92:0/58624900 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e380054b0 con 0x7f2e44108420 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e4a938640 1 -- 172.21.15.92:0/58624900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e4419f560 con 0x7f2e44108420 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e417fa640 1 -- 172.21.15.92:0/58624900 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38004bc0 con 0x7f2e44108420 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.682+0000 7f2e4a938640 1 -- 172.21.15.92:0/58624900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e441a5cc0 con 0x7f2e44108420 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.685+0000 7f2e50eac740 1 Processor -- start 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.685+0000 7f2e417fa640 1 -- 172.21.15.92:0/58624900 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f2e38009c30 con 0x7f2e44108420 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.685+0000 7f2e50eac740 1 -- start start 2024-09-21T07:21:48.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5569350 0x55e3f5910430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5540490 0x55e3f5910970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5548670 0x55e3f5910eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e50eac740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e3f5886e60 con 0x55e3f5569350 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e50eac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e3f5876290 con 0x55e3f5540490 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e50eac740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3f587a0a0 con 0x55e3f5548670 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e48ed5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5569350 0x55e3f5910430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e48ed5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5569350 0x55e3f5910430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48884/0 (socket says 172.21.15.92:48884) 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e48ed5640 1 -- 172.21.15.92:0/1709147970 learned_addr learned my addr 172.21.15.92:0/1709147970 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e43fff640 1 --2- 172.21.15.92:0/1709147970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5540490 0x55e3f5910970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e437fe640 1 --2- 172.21.15.92:0/1709147970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5548670 0x55e3f5910eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e48ed5640 1 -- 172.21.15.92:0/1709147970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5548670 msgr2=0x55e3f5910eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e48ed5640 1 --2- 172.21.15.92:0/1709147970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5548670 0x55e3f5910eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e48ed5640 1 -- 172.21.15.92:0/1709147970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5540490 msgr2=0x55e3f5910970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:48.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e48ed5640 1 --2- 172.21.15.92:0/1709147970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5540490 0x55e3f5910970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e48ed5640 1 -- 172.21.15.92:0/1709147970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3f55d4930 con 0x55e3f5569350 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e417fa640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e2c0b6680 0x7f2e2c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e43fff640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e2c0b6680 0x7f2e2c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e48ed5640 1 --2- 172.21.15.92:0/1709147970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5569350 0x55e3f5910430 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009ca0 tx=0x7f2e3c0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b255ad63648c579 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e417fa640 1 -- 172.21.15.92:0/58624900 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f2e380e7550 con 0x7f2e44108420 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.686+0000 7f2e2a7fc640 1 -- 172.21.15.92:0/1709147970 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c031980 con 0x55e3f5569350 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e2a7fc640 1 -- 172.21.15.92:0/1709147970 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e3c036030 con 0x55e3f5569350 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e2a7fc640 1 -- 172.21.15.92:0/1709147970 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c004590 con 0x55e3f5569350 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e50eac740 1 -- 172.21.15.92:0/1709147970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5569350 msgr2=0x55e3f5910430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e43fff640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e2c0b6680 0x7f2e2c0b8b90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55e3f590f0b0 tx=0x7f2e3400b4d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1709147970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5569350 0x55e3f5910430 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009ca0 tx=0x7f2e3c0094a0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e50eac740 1 -- 172.21.15.92:0/1709147970 shutdown_connections 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1709147970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5548670 0x55e3f5910eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1709147970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5540490 0x55e3f5910970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1709147970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5569350 0x55e3f5910430 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e50eac740 1 -- 172.21.15.92:0/1709147970 >> 172.21.15.92:0/1709147970 conn(0x55e3f555d740 msgr2=0x55e3f590e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.687+0000 7f2e50eac740 1 -- 172.21.15.92:0/1709147970 shutdown_connections 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.688+0000 7f2e50eac740 1 -- 172.21.15.92:0/1709147970 wait complete. 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.688+0000 7f2e50eac740 1 -- start start 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.688+0000 7f2e50eac740 1 Processor -- start 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.688+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5540490 0x55e3f591c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.688+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f591c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.688+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 0x55e3f5927d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.688+0000 7f2e50eac740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e3f56d7890 con 0x55e3f5548670 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.688+0000 7f2e50eac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e3f5810d40 con 0x55e3f5569350 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.688+0000 7f2e50eac740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3f591ea30 con 0x55e3f5540490 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.688+0000 7f2e50eac740 10 client.0 _ll_register_callbacks cb 0x55e3f5874c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e437fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f591c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e437fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f591c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48888/0 (socket says 172.21.15.92:48888) 2024-09-21T07:21:48.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e437fe640 1 -- 172.21.15.92:0/2184431227 learned_addr learned my addr 172.21.15.92:0/2184431227 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e43fff640 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5540490 0x55e3f591c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e48ed5640 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 0x55e3f5927d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e437fe640 1 -- 172.21.15.92:0/2184431227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5540490 msgr2=0x55e3f591c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e437fe640 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5540490 0x55e3f591c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e437fe640 1 -- 172.21.15.92:0/2184431227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 msgr2=0x55e3f5927d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e437fe640 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 0x55e3f5927d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e437fe640 1 -- 172.21.15.92:0/2184431227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3f5928390 con 0x55e3f5548670 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e43fff640 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5540490 0x55e3f591c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e48ed5640 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 0x55e3f5927d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e437fe640 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f591c630 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f2e380e4900 tx=0x7f2e38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d384c0f8133b3ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e237fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e237fe640 1 -- 172.21.15.92:0/2184431227 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38020070 con 0x55e3f5548670 2024-09-21T07:21:48.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e237fe640 1 -- 172.21.15.92:0/2184431227 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f2e38094300 con 0x55e3f5548670 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e50eac740 1 -- 172.21.15.92:0/2184431227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e3c036030 con 0x55e3f5548670 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e237fe640 1 -- 172.21.15.92:0/2184431227 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e380a8e40 con 0x55e3f5548670 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e50eac740 10 client.18021 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e50eac740 1 -- 172.21.15.92:0/2184431227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e3f592ad20 con 0x55e3f5548670 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.689+0000 7f2e237fe640 1 -- 172.21.15.92:0/2184431227 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e3c036030 con 0x55e3f5548670 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.690+0000 7f2e237fe640 1 -- 172.21.15.92:0/2184431227 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2e380981a0 con 0x55e3f5548670 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.690+0000 7f2e50eac740 10 client.18021 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.690+0000 7f2e50eac740 10 client.18021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.690+0000 7f2e50eac740 20 client.18021 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.690+0000 7f2e50eac740 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3f5527cd0 0x55e3f592e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.690+0000 7f2e50eac740 4 client.18021 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:48.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.690+0000 7f2e50eac740 1 -- 172.21.15.92:0/2184431227 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3f5888db0 con 0x55e3f5527cd0 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.690+0000 7f2e43fff640 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3f5527cd0 0x55e3f592e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e43fff640 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3f5527cd0 0x55e3f592e190 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=270c7477a9337c65 server_cookie=6d2796f1cfb1302a in_seq=0 out_seq=0 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e237fe640 10 client.18021 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e237fe640 1 -- 172.21.15.92:0/2184431227 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3f5888db0 con 0x55e3f5527cd0 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e237fe640 10 client.18021 handle_command_reply: tid=0 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e50eac740 1 client.18021 shutdown 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e50eac740 1 -- 172.21.15.92:0/2184431227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 msgr2=0x55e3f591c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e50eac740 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f591c630 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f2e380e4900 tx=0x7f2e38004730 comp rx=0 tx=0).stop 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e50eac740 1 -- 172.21.15.92:0/2184431227 shutdown_connections 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e50eac740 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3f5527cd0 0x55e3f592e190 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e50eac740 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 0x55e3f5927d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e50eac740 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f591c630 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e237fe640 0 client.18021 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e50eac740 1 --2- 172.21.15.92:0/2184431227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5540490 0x55e3f591c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.691+0000 7f2e50eac740 1 -- 172.21.15.92:0/2184431227 >> 172.21.15.92:0/2184431227 conn(0x55e3f555d740 msgr2=0x55e3f5913610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:48.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.692+0000 7f2e50eac740 1 -- 172.21.15.92:0/2184431227 shutdown_connections 2024-09-21T07:21:48.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.692+0000 7f2e50eac740 1 -- 172.21.15.92:0/2184431227 wait complete. 2024-09-21T07:21:48.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.692+0000 7f2e50eac740 20 client.18021 trim_cache size 0 max 16384 2024-09-21T07:21:48.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.709+0000 7f2e50eac740 1 Processor -- start 2024-09-21T07:21:48.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.709+0000 7f2e50eac740 1 -- start start 2024-09-21T07:21:48.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.709+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5540490 0x55e3f5915bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.709+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f5927c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.709+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5569350 0x55e3f591dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.709+0000 7f2e50eac740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441b0e80 con 0x55e3f5548670 2024-09-21T07:21:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.709+0000 7f2e50eac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441b29c0 con 0x55e3f5540490 2024-09-21T07:21:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.709+0000 7f2e50eac740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441b1550 con 0x55e3f5569350 2024-09-21T07:21:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e437fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f5927c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e437fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f5927c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48904/0 (socket says 172.21.15.92:48904) 2024-09-21T07:21:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e437fe640 1 -- 172.21.15.92:0/1098979613 learned_addr learned my addr 172.21.15.92:0/1098979613 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e43fff640 1 --2- 172.21.15.92:0/1098979613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5540490 0x55e3f5915bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e48ed5640 1 --2- 172.21.15.92:0/1098979613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5569350 0x55e3f591dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e437fe640 1 -- 172.21.15.92:0/1098979613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5569350 msgr2=0x55e3f591dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:48.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e437fe640 1 --2- 172.21.15.92:0/1098979613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5569350 0x55e3f591dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e437fe640 1 -- 172.21.15.92:0/1098979613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5540490 msgr2=0x55e3f5915bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e437fe640 1 --2- 172.21.15.92:0/1098979613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5540490 0x55e3f5915bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e437fe640 1 -- 172.21.15.92:0/1098979613 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3f5928190 con 0x55e3f5548670 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e437fe640 1 --2- 172.21.15.92:0/1098979613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f5927c50 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2e380a9520 tx=0x7f2e380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e099c7581d795ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e29ffb640 1 -- 172.21.15.92:0/1098979613 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38020040 con 0x55e3f5548670 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e29ffb640 1 -- 172.21.15.92:0/1098979613 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e380ad6a0 con 0x55e3f5548670 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.710+0000 7f2e29ffb640 1 -- 172.21.15.92:0/1098979613 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e380ac710 con 0x55e3f5548670 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.711+0000 7f2e50eac740 1 -- 172.21.15.92:0/1098979613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 msgr2=0x55e3f5927c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.711+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1098979613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f5927c50 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2e380a9520 tx=0x7f2e380046c0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.711+0000 7f2e50eac740 1 -- 172.21.15.92:0/1098979613 shutdown_connections 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.711+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1098979613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5569350 0x55e3f591dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.711+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1098979613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5548670 0x55e3f5927c50 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.711+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1098979613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5540490 0x55e3f5915bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.711+0000 7f2e50eac740 1 -- 172.21.15.92:0/1098979613 >> 172.21.15.92:0/1098979613 conn(0x55e3f555d740 msgr2=0x55e3f591d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:48.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.711+0000 7f2e50eac740 1 -- 172.21.15.92:0/1098979613 shutdown_connections 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.711+0000 7f2e50eac740 1 -- 172.21.15.92:0/1098979613 wait complete. 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.711+0000 7f2e50eac740 1 -- start start 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e50eac740 1 Processor -- start 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5540490 0x55e3f59242e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5548670 0x55e3f59207a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e50eac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 0x55e3f5920ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e50eac740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441b22f0 con 0x55e3f5540490 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e50eac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441b1c20 con 0x55e3f5569350 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e50eac740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441aee80 con 0x55e3f5548670 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e50eac740 10 client.0 _ll_register_callbacks cb 0x7f2e380057f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e43fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5540490 0x55e3f59242e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e43fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5540490 0x55e3f59242e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48910/0 (socket says 172.21.15.92:48910) 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e43fff640 1 -- 172.21.15.92:0/1478459405 learned_addr learned my addr 172.21.15.92:0/1478459405 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e48ed5640 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 0x55e3f5920ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e437fe640 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5548670 0x55e3f59207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e43fff640 1 -- 172.21.15.92:0/1478459405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5548670 msgr2=0x55e3f59207a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e43fff640 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5548670 0x55e3f59207a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e43fff640 1 -- 172.21.15.92:0/1478459405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 msgr2=0x55e3f5920ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e43fff640 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 0x55e3f5920ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.712+0000 7f2e43fff640 1 -- 172.21.15.92:0/1478459405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3f59212d0 con 0x55e3f5540490 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e48ed5640 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 0x55e3f5920ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e43fff640 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5540490 0x55e3f59242e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x55e3f592e8c0 tx=0x7f2e340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03960088cbd8208 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e237fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e237fe640 1 -- 172.21.15.92:0/1478459405 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34032680 con 0x55e3f5540490 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e237fe640 1 -- 172.21.15.92:0/1478459405 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f2e3401d400 con 0x55e3f5540490 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e50eac740 1 -- 172.21.15.92:0/1478459405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e380ad6a0 con 0x55e3f5540490 2024-09-21T07:21:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e237fe640 1 -- 172.21.15.92:0/1478459405 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e34032820 con 0x55e3f5540490 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e50eac740 10 client.18027 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e50eac740 1 -- 172.21.15.92:0/1478459405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e3f59999b0 con 0x55e3f5540490 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e237fe640 1 -- 172.21.15.92:0/1478459405 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e380ad6a0 con 0x55e3f5540490 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e237fe640 1 -- 172.21.15.92:0/1478459405 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2e3401dc20 con 0x55e3f5540490 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e50eac740 10 client.18027 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e50eac740 10 client.18027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e50eac740 20 client.18027 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3f54fd080 0x55e3f599c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e50eac740 4 client.18027 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.713+0000 7f2e50eac740 1 -- 172.21.15.92:0/1478459405 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e3f5884860 con 0x55e3f54fd080 2024-09-21T07:21:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.714+0000 7f2e437fe640 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3f54fd080 0x55e3f599c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:48.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.714+0000 7f2e237fe640 10 client.18027 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:48.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.714+0000 7f2e437fe640 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3f54fd080 0x55e3f599c150 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1d8f0e9ec002542 server_cookie=b3d0e77fe0de3de in_seq=0 out_seq=0 2024-09-21T07:21:48.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e237fe640 1 -- 172.21.15.92:0/1478459405 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e3f5884860 con 0x55e3f54fd080 2024-09-21T07:21:48.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e237fe640 10 client.18027 handle_command_reply: tid=0 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 client.18027 shutdown 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 -- 172.21.15.92:0/1478459405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5540490 msgr2=0x55e3f59242e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5540490 0x55e3f59242e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x55e3f592e8c0 tx=0x7f2e340046c0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 -- 172.21.15.92:0/1478459405 shutdown_connections 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55e3f54fd080 0x55e3f599c150 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3f5569350 0x55e3f5920ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3f5548670 0x55e3f59207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 --2- 172.21.15.92:0/1478459405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f5540490 0x55e3f59242e0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 -- 172.21.15.92:0/1478459405 >> 172.21.15.92:0/1478459405 conn(0x55e3f555d740 msgr2=0x55e3f5911db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e237fe640 0 client.18027 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 -- 172.21.15.92:0/1478459405 shutdown_connections 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 1 -- 172.21.15.92:0/1478459405 wait complete. 2024-09-21T07:21:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.716+0000 7f2e50eac740 20 client.18027 trim_cache size 0 max 16384 2024-09-21T07:21:48.722 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:21:48.722 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:21:48.722 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "68bc1b81-ff26-4d23-bedd-ea1f5bf7ce64", 2024-09-21T07:21:48.722 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:21:48.722 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 -- 172.21.15.92:0/58624900 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e2c0b6680 msgr2=0x7f2e2c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e2c0b6680 0x7f2e2c0b8b90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55e3f590f0b0 tx=0x7f2e3400b4d0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 -- 172.21.15.92:0/58624900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e44108420 msgr2=0x7f2e441998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e44108420 0x7f2e441998a0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800d750 tx=0x7f2e3800dc10 comp rx=0 tx=0).stop 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 -- 172.21.15.92:0/58624900 shutdown_connections 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e2c0b6680 0x7f2e2c0b8b90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e44108d70 0x7f2e4419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e44108420 0x7f2e441998a0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 --2- 172.21.15.92:0/58624900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e44102ae0 0x7f2e44199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 -- 172.21.15.92:0/58624900 >> 172.21.15.92:0/58624900 conn(0x7f2e44079770 msgr2=0x7f2e44106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 -- 172.21.15.92:0/58624900 shutdown_connections 2024-09-21T07:21:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:48.717+0000 7f2e4a938640 1 -- 172.21.15.92:0/58624900 wait complete. 2024-09-21T07:21:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:48 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:21:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:48 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:48 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:21:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:48 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:49.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:48 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:21:49.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:48 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:49.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:48 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:21:49.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:48 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:49.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:48 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:21:49.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:48 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:49.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:48 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:21:49.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:48 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:21:49.649 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:21:49.898 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:50.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:49 smithi175 ceph-mon[34064]: pgmap v606: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:21:50.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:49 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:21:50.305 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:49 smithi092 ceph-mon[30987]: pgmap v606: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:21:50.306 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:49 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:21:50.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:49 smithi169 ceph-mon[33705]: pgmap v606: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:21:50.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:49 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.396+0000 7f5053ea3640 1 -- 172.21.15.92:0/691800181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f504c1083d0 msgr2=0x7f504c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.396+0000 7f5053ea3640 1 --2- 172.21.15.92:0/691800181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f504c1083d0 0x7f504c1087e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f5040009900 tx=0x7f504002a410 comp rx=0 tx=0).stop 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.396+0000 7f5053ea3640 1 -- 172.21.15.92:0/691800181 shutdown_connections 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.396+0000 7f5053ea3640 1 --2- 172.21.15.92:0/691800181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f504c108d20 0x7f504c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.396+0000 7f5053ea3640 1 --2- 172.21.15.92:0/691800181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f504c1083d0 0x7f504c1087e0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.396+0000 7f5053ea3640 1 --2- 172.21.15.92:0/691800181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f504c102ae0 0x7f504c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.396+0000 7f5053ea3640 1 -- 172.21.15.92:0/691800181 >> 172.21.15.92:0/691800181 conn(0x7f504c079760 msgr2=0x7f504c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.396+0000 7f5053ea3640 1 -- 172.21.15.92:0/691800181 shutdown_connections 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.396+0000 7f5053ea3640 1 -- 172.21.15.92:0/691800181 wait complete. 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5053ea3640 1 Processor -- start 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5053ea3640 1 -- start start 2024-09-21T07:21:50.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5053ea3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f504c102ae0 0x7f504c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5053ea3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f504c1083d0 0x7f504c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5053ea3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f504c108d20 0x7f504c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5053ea3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f504c112840 con 0x7f504c102ae0 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5053ea3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1126c0 con 0x7f504c108d20 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5053ea3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1129c0 con 0x7f504c1083d0 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5051c3f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f504c102ae0 0x7f504c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5051c3f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f504c102ae0 0x7f504c19a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38580/0 (socket says 172.21.15.92:38580) 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f5051c3f640 1 -- 172.21.15.92:0/2416897006 learned_addr learned my addr 172.21.15.92:0/2416897006 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.397+0000 7f505143e640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f504c1083d0 0x7f504c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f5052440640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f504c108d20 0x7f504c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f5051c3f640 1 -- 172.21.15.92:0/2416897006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f504c1083d0 msgr2=0x7f504c19a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f5051c3f640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f504c1083d0 0x7f504c19a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f5051c3f640 1 -- 172.21.15.92:0/2416897006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f504c108d20 msgr2=0x7f504c19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f5051c3f640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f504c108d20 0x7f504c19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f5051c3f640 1 -- 172.21.15.92:0/2416897006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504c1a0330 con 0x7f504c102ae0 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f5052440640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f504c108d20 0x7f504c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f505143e640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f504c1083d0 0x7f504c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f5051c3f640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f504c102ae0 0x7f504c19a3c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f503c00eb90 tx=0x7f503c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f504affd640 1 -- 172.21.15.92:0/2416897006 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c004d20 con 0x7f504c102ae0 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f5053ea3640 1 -- 172.21.15.92:0/2416897006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f504c1a0620 con 0x7f504c102ae0 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f504affd640 1 -- 172.21.15.92:0/2416897006 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f503c00ee90 con 0x7f504c102ae0 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f504affd640 1 -- 172.21.15.92:0/2416897006 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c010690 con 0x7f504c102ae0 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.398+0000 7f5053ea3640 1 -- 172.21.15.92:0/2416897006 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f504c1a6d80 con 0x7f504c102ae0 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.400+0000 7f505a417740 1 Processor -- start 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f505a417740 1 -- start start 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f504affd640 1 -- 172.21.15.92:0/2416897006 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f503c005020 con 0x7f504c102ae0 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f505a417740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04064f070 0x55a0409f6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f505a417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a0409f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f505a417740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a0409f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f505a417740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a04096ce50 con 0x55a04064f070 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f505a417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a04095c280 con 0x55a0406261b0 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f505a417740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a040960090 con 0x55a04062e390 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f5052440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04064f070 0x55a0409f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f5052440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04064f070 0x55a0409f6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38592/0 (socket says 172.21.15.92:38592) 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f5052440640 1 -- 172.21.15.92:0/2068794722 learned_addr learned my addr 172.21.15.92:0/2068794722 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f505143e640 1 --2- 172.21.15.92:0/2068794722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a0409f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.401+0000 7f5051c3f640 1 --2- 172.21.15.92:0/2068794722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a0409f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5052440640 1 -- 172.21.15.92:0/2068794722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 msgr2=0x55a0409f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5052440640 1 --2- 172.21.15.92:0/2068794722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a0409f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5052440640 1 -- 172.21.15.92:0/2068794722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 msgr2=0x55a0409f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5052440640 1 --2- 172.21.15.92:0/2068794722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a0409f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5052440640 1 -- 172.21.15.92:0/2068794722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0406ba650 con 0x55a04064f070 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5051c3f640 1 --2- 172.21.15.92:0/2068794722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a0409f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5052440640 1 --2- 172.21.15.92:0/2068794722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04064f070 0x55a0409f6270 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5044009bd0 tx=0x7f504400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0bebe2bf292121 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f504affd640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50340b6680 0x7f50340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5033fff640 1 -- 172.21.15.92:0/2068794722 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044016070 con 0x55a04064f070 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5051c3f640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50340b6680 0x7f50340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5033fff640 1 -- 172.21.15.92:0/2068794722 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5044011900 con 0x55a04064f070 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f5033fff640 1 -- 172.21.15.92:0/2068794722 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044010630 con 0x55a04064f070 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.402+0000 7f504affd640 1 -- 172.21.15.92:0/2416897006 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f503c0e82b0 con 0x7f504c102ae0 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f505a417740 1 -- 172.21.15.92:0/2068794722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04064f070 msgr2=0x55a0409f6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f5051c3f640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50340b6680 0x7f50340b8b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f503c0e56b0 tx=0x7f503c0ea040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f505a417740 1 --2- 172.21.15.92:0/2068794722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04064f070 0x55a0409f6270 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5044009bd0 tx=0x7f504400e6c0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f505a417740 1 -- 172.21.15.92:0/2068794722 shutdown_connections 2024-09-21T07:21:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f505a417740 1 --2- 172.21.15.92:0/2068794722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a0409f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f505a417740 1 --2- 172.21.15.92:0/2068794722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a0409f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f505a417740 1 --2- 172.21.15.92:0/2068794722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04064f070 0x55a0409f6270 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f505a417740 1 -- 172.21.15.92:0/2068794722 >> 172.21.15.92:0/2068794722 conn(0x55a040643460 msgr2=0x55a0409f4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f505a417740 1 -- 172.21.15.92:0/2068794722 shutdown_connections 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f505a417740 1 -- 172.21.15.92:0/2068794722 wait complete. 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.403+0000 7f505a417740 1 -- start start 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f505a417740 1 Processor -- start 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f505a417740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0406261b0 0x55a040a01900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f505a417740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a040a01e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f505a417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04064f070 0x55a040a0dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f505a417740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0407bd700 con 0x55a0406261b0 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f505a417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a0408f7110 con 0x55a04064f070 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f505a417740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a040a04a50 con 0x55a04062e390 2024-09-21T07:21:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f505a417740 10 client.0 _ll_register_callbacks cb 0x55a040910990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f5052440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0406261b0 0x55a040a01900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f5052440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0406261b0 0x55a040a01900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38606/0 (socket says 172.21.15.92:38606) 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f5052440640 1 -- 172.21.15.92:0/4066732065 learned_addr learned my addr 172.21.15.92:0/4066732065 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f505143e640 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a040a01e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f5052440640 1 -- 172.21.15.92:0/4066732065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 msgr2=0x55a040a01e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f5052440640 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a040a01e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f5052440640 1 -- 172.21.15.92:0/4066732065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04064f070 msgr2=0x55a040a0dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f5052440640 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04064f070 0x55a040a0dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.404+0000 7f5052440640 1 -- 172.21.15.92:0/4066732065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a040924c40 con 0x55a0406261b0 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f5052440640 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0406261b0 0x55a040a01900 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5044009960 tx=0x7f5044011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f4082c6ebb86b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f50317fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f50317fa640 1 -- 172.21.15.92:0/4066732065 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044016050 con 0x55a0406261b0 2024-09-21T07:21:50.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f50317fa640 1 -- 172.21.15.92:0/4066732065 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f5044005240 con 0x55a0406261b0 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f505a417740 1 -- 172.21.15.92:0/4066732065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5044011900 con 0x55a0406261b0 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f50317fa640 1 -- 172.21.15.92:0/4066732065 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5044005440 con 0x55a0406261b0 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f505a417740 10 client.18039 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f505a417740 1 -- 172.21.15.92:0/4066732065 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a040a10700 con 0x55a0406261b0 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f50317fa640 1 -- 172.21.15.92:0/4066732065 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5044011900 con 0x55a0406261b0 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f50317fa640 1 -- 172.21.15.92:0/4066732065 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f504400f040 con 0x55a0406261b0 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f505a417740 10 client.18039 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.405+0000 7f505a417740 10 client.18039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.406+0000 7f505a417740 20 client.18039 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.406+0000 7f505a417740 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04060d9f0 0x55a040a13b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.406+0000 7f505a417740 4 client.18039 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.406+0000 7f505a417740 1 -- 172.21.15.92:0/4066732065 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a04096eda0 con 0x55a04060d9f0 2024-09-21T07:21:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.406+0000 7f505143e640 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04060d9f0 0x55a040a13b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.406+0000 7f50317fa640 10 client.18039 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.406+0000 7f505143e640 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04060d9f0 0x55a040a13b10 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a46203b9ac578f4 server_cookie=1d1ba5758fa9959f in_seq=0 out_seq=0 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f50317fa640 1 -- 172.21.15.92:0/4066732065 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a04096eda0 con 0x55a04060d9f0 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f50317fa640 10 client.18039 handle_command_reply: tid=0 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 client.18039 shutdown 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 -- 172.21.15.92:0/4066732065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0406261b0 msgr2=0x55a040a01900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0406261b0 0x55a040a01900 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5044009960 tx=0x7f5044011ab0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 -- 172.21.15.92:0/4066732065 shutdown_connections 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04060d9f0 0x55a040a13b10 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a04064f070 0x55a040a0dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a040a01e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f50317fa640 0 client.18039 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:50.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 --2- 172.21.15.92:0/4066732065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0406261b0 0x55a040a01900 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 -- 172.21.15.92:0/4066732065 >> 172.21.15.92:0/4066732065 conn(0x55a040643460 msgr2=0x55a0409f9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:50.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 -- 172.21.15.92:0/4066732065 shutdown_connections 2024-09-21T07:21:50.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 1 -- 172.21.15.92:0/4066732065 wait complete. 2024-09-21T07:21:50.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.407+0000 7f505a417740 20 client.18039 trim_cache size 0 max 16384 2024-09-21T07:21:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f505a417740 1 Processor -- start 2024-09-21T07:21:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f505a417740 1 -- start start 2024-09-21T07:21:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f505a417740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a0409f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f505a417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a040a03530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f505a417740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a0409f3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f505a417740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1b1030 con 0x55a04060d9f0 2024-09-21T07:21:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f505a417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1b2b70 con 0x55a0406261b0 2024-09-21T07:21:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f505a417740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1b1700 con 0x55a04062e390 2024-09-21T07:21:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f5052440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a0409f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f5052440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a0409f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38612/0 (socket says 172.21.15.92:38612) 2024-09-21T07:21:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f5052440640 1 -- 172.21.15.92:0/1514183380 learned_addr learned my addr 172.21.15.92:0/1514183380 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f5052440640 1 -- 172.21.15.92:0/1514183380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 msgr2=0x55a0409f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f5052440640 1 --2- 172.21.15.92:0/1514183380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a0409f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f505143e640 1 --2- 172.21.15.92:0/1514183380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a040a03530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f5052440640 1 -- 172.21.15.92:0/1514183380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 msgr2=0x55a040a03530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f5052440640 1 --2- 172.21.15.92:0/1514183380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a040a03530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.425+0000 7f5052440640 1 -- 172.21.15.92:0/1514183380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0409f4e90 con 0x55a04060d9f0 2024-09-21T07:21:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.426+0000 7f5052440640 1 --2- 172.21.15.92:0/1514183380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a0409f7c60 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f5044009400 tx=0x7f504401b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6784d52ce5a9b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.426+0000 7f50337fe640 1 -- 172.21.15.92:0/1514183380 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044016070 con 0x55a04060d9f0 2024-09-21T07:21:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.426+0000 7f50337fe640 1 -- 172.21.15.92:0/1514183380 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f50440055e0 con 0x55a04060d9f0 2024-09-21T07:21:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.426+0000 7f50337fe640 1 -- 172.21.15.92:0/1514183380 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50440267b0 con 0x55a04060d9f0 2024-09-21T07:21:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 -- 172.21.15.92:0/1514183380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 msgr2=0x55a0409f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 --2- 172.21.15.92:0/1514183380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a0409f7c60 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f5044009400 tx=0x7f504401b450 comp rx=0 tx=0).stop 2024-09-21T07:21:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 -- 172.21.15.92:0/1514183380 shutdown_connections 2024-09-21T07:21:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 --2- 172.21.15.92:0/1514183380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a0409f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 --2- 172.21.15.92:0/1514183380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a040a03530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 --2- 172.21.15.92:0/1514183380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a0409f7c60 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 -- 172.21.15.92:0/1514183380 >> 172.21.15.92:0/1514183380 conn(0x55a040643460 msgr2=0x55a040a02e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 -- 172.21.15.92:0/1514183380 shutdown_connections 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 -- 172.21.15.92:0/1514183380 wait complete. 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 -- start start 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.427+0000 7f505a417740 1 Processor -- start 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f505a417740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a040a0a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f505a417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a040a056d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f505a417740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a040a05c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f505a417740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1b24a0 con 0x55a04060d9f0 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f505a417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1b1dd0 con 0x55a0406261b0 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f505a417740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1af030 con 0x55a04062e390 2024-09-21T07:21:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f505a417740 10 client.0 _ll_register_callbacks cb 0x7f503c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f5052440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a040a0a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f5052440640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a040a0a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38624/0 (socket says 172.21.15.92:38624) 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f5052440640 1 -- 172.21.15.92:0/3045190178 learned_addr learned my addr 172.21.15.92:0/3045190178 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f505143e640 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a040a056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f5052440640 1 -- 172.21.15.92:0/3045190178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 msgr2=0x55a040a05c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f5052440640 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a040a05c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f5052440640 1 -- 172.21.15.92:0/3045190178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 msgr2=0x55a040a056d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f5052440640 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a040a056d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f5052440640 1 -- 172.21.15.92:0/3045190178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a040a06150 con 0x55a04060d9f0 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f505143e640 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a040a056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f5052440640 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a040a0a1d0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f5044009bd0 tx=0x7f5044011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac720c14352e9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f50317fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:50.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.428+0000 7f50317fa640 1 -- 172.21.15.92:0/3045190178 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044043060 con 0x55a04060d9f0 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f50317fa640 1 -- 172.21.15.92:0/3045190178 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f504401b920 con 0x55a04060d9f0 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f505a417740 1 -- 172.21.15.92:0/3045190178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50440055e0 con 0x55a04060d9f0 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f50317fa640 1 -- 172.21.15.92:0/3045190178 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5044016070 con 0x55a04060d9f0 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f505a417740 10 client.18045 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f505a417740 1 -- 172.21.15.92:0/3045190178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a040a7e060 con 0x55a04060d9f0 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f50317fa640 1 -- 172.21.15.92:0/3045190178 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f50440055e0 con 0x55a04060d9f0 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f50317fa640 1 -- 172.21.15.92:0/3045190178 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5044035bf0 con 0x55a04060d9f0 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f505a417740 10 client.18045 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f505a417740 10 client.18045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f505a417740 20 client.18045 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f505a417740 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04064f070 0x55a040a80530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f505a417740 4 client.18045 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f505a417740 1 -- 172.21.15.92:0/3045190178 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a04096a850 con 0x55a04064f070 2024-09-21T07:21:50.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.429+0000 7f505143e640 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04064f070 0x55a040a80530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:50.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f50317fa640 10 client.18045 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505143e640 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04064f070 0x55a040a80530 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fba147ec4484217 server_cookie=cd4ee05a359e4b19 in_seq=0 out_seq=0 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f50317fa640 1 -- 172.21.15.92:0/3045190178 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x55a04096a850 con 0x55a04064f070 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f50317fa640 10 client.18045 handle_command_reply: tid=0 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 client.18045 shutdown 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 -- 172.21.15.92:0/3045190178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 msgr2=0x55a040a0a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a040a0a1d0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f5044009bd0 tx=0x7f5044011900 comp rx=0 tx=0).stop 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 -- 172.21.15.92:0/3045190178 shutdown_connections 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55a04064f070 0x55a040a80530 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a04062e390 0x55a040a05c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0406261b0 0x55a040a056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f50317fa640 0 client.18045 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:50.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 --2- 172.21.15.92:0/3045190178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a04060d9f0 0x55a040a0a1d0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 -- 172.21.15.92:0/3045190178 >> 172.21.15.92:0/3045190178 conn(0x55a040643460 msgr2=0x55a0409f7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:50.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 -- 172.21.15.92:0/3045190178 shutdown_connections 2024-09-21T07:21:50.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.430+0000 7f505a417740 1 -- 172.21.15.92:0/3045190178 wait complete. 2024-09-21T07:21:50.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f505a417740 20 client.18045 trim_cache size 0 max 16384 2024-09-21T07:21:50.437 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:21:50.437 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:21:50.437 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:21:50.437 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:21:50.437 INFO:teuthology.orchestra.run.smithi092.stdout: "9d9b4374-4159-4e71-99a9-ab660a57d3cf": { 2024-09-21T07:21:50.437 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:02.785673+0000", 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.438 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "3b742b30-fd49-4ec5-844d-6cfbec3bbf45": { 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:48.290915+0000", 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.439 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "68bc1b81-ff26-4d23-bedd-ea1f5bf7ce64": { 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:48.714909+0000", 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.440 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.441 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:02.985669+0000", 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:21:50.442 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.443 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:21:50.444 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:21:50.444 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:21:50.444 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:21:50.444 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:21:50.444 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:21:50.444 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:21:50.444 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:21:50.444 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:21:50.444 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:21:50.444 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:21:50.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 -- 172.21.15.92:0/2416897006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50340b6680 msgr2=0x7f50340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:50.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50340b6680 0x7f50340b8b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f503c0e56b0 tx=0x7f503c0ea040 comp rx=0 tx=0).stop 2024-09-21T07:21:50.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 -- 172.21.15.92:0/2416897006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f504c102ae0 msgr2=0x7f504c19a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:50.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f504c102ae0 0x7f504c19a3c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f503c00eb90 tx=0x7f503c00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 -- 172.21.15.92:0/2416897006 shutdown_connections 2024-09-21T07:21:50.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f50340b6680 0x7f50340b8b90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f504c108d20 0x7f504c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f504c1083d0 0x7f504c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 --2- 172.21.15.92:0/2416897006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f504c102ae0 0x7f504c19a3c0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:50.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 -- 172.21.15.92:0/2416897006 >> 172.21.15.92:0/2416897006 conn(0x7f504c079760 msgr2=0x7f504c101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:50.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 -- 172.21.15.92:0/2416897006 shutdown_connections 2024-09-21T07:21:50.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:50.431+0000 7f5053ea3640 1 -- 172.21.15.92:0/2416897006 wait complete. 2024-09-21T07:21:51.113 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:21:51.113 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:21:51.357 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:51.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.944+0000 7f4f107b1640 1 -- 172.21.15.92:0/1026454456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f08102a60 msgr2=0x7f4f08102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.944+0000 7f4f107b1640 1 --2- 172.21.15.92:0/1026454456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f08102a60 0x7f4f08102e70 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009900 tx=0x7f4f0402a410 comp rx=0 tx=0).stop 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.944+0000 7f4f107b1640 1 -- 172.21.15.92:0/1026454456 shutdown_connections 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.944+0000 7f4f107b1640 1 --2- 172.21.15.92:0/1026454456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08108cf0 0x7f4f0810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.944+0000 7f4f107b1640 1 --2- 172.21.15.92:0/1026454456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f081083a0 0x7f4f081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.944+0000 7f4f107b1640 1 --2- 172.21.15.92:0/1026454456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f08102a60 0x7f4f08102e70 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.944+0000 7f4f107b1640 1 -- 172.21.15.92:0/1026454456 >> 172.21.15.92:0/1026454456 conn(0x7f4f08079730 msgr2=0x7f4f08079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.944+0000 7f4f107b1640 1 -- 172.21.15.92:0/1026454456 shutdown_connections 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.944+0000 7f4f107b1640 1 -- 172.21.15.92:0/1026454456 wait complete. 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f107b1640 1 Processor -- start 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f107b1640 1 -- start start 2024-09-21T07:21:51.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f107b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f08102a60 0x7f4f0819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f107b1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f081083a0 0x7f4f0819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f107b1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08108cf0 0x7f4f0819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f107b1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f08112810 con 0x7f4f08102a60 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f107b1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4f08112690 con 0x7f4f081083a0 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f107b1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4f08112990 con 0x7f4f08108cf0 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f0e54d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f08102a60 0x7f4f0819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f0e54d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f08102a60 0x7f4f0819b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38642/0 (socket says 172.21.15.92:38642) 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f0e54d640 1 -- 172.21.15.92:0/2993140564 learned_addr learned my addr 172.21.15.92:0/2993140564 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.945+0000 7f4f0dd4c640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f081083a0 0x7f4f0819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4f0e54d640 1 -- 172.21.15.92:0/2993140564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08108cf0 msgr2=0x7f4f0819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4f0e54d640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08108cf0 0x7f4f0819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:51.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4f0e54d640 1 -- 172.21.15.92:0/2993140564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f081083a0 msgr2=0x7f4f0819b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:51.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4f0e54d640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f081083a0 0x7f4f0819b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:51.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4f0e54d640 1 -- 172.21.15.92:0/2993140564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f081a6430 con 0x7f4f08102a60 2024-09-21T07:21:51.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4f0e54d640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f08102a60 0x7f4f0819b1a0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009230 tx=0x7f4f04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:51.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4eff7fe640 1 -- 172.21.15.92:0/2993140564 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0403f030 con 0x7f4f08102a60 2024-09-21T07:21:51.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4eff7fe640 1 -- 172.21.15.92:0/2993140564 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f04003a80 con 0x7f4f08102a60 2024-09-21T07:21:51.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4f107b1640 1 -- 172.21.15.92:0/2993140564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f081a66c0 con 0x7f4f08102a60 2024-09-21T07:21:51.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4eff7fe640 1 -- 172.21.15.92:0/2993140564 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04035070 con 0x7f4f08102a60 2024-09-21T07:21:51.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.946+0000 7f4f107b1640 1 -- 172.21.15.92:0/2993140564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f081a6ba0 con 0x7f4f08102a60 2024-09-21T07:21:51.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.947+0000 7f4f107b1640 1 -- 172.21.15.92:0/2993140564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f08102e70 con 0x7f4f08102a60 2024-09-21T07:21:51.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.948+0000 7f4eff7fe640 1 -- 172.21.15.92:0/2993140564 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f4f04042030 con 0x7f4f08102a60 2024-09-21T07:21:51.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.949+0000 7f4eff7fe640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ef40b66b0 0x7f4ef40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:51.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.949+0000 7f4f0dd4c640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ef40b66b0 0x7f4ef40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:51.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.949+0000 7f4eff7fe640 1 -- 172.21.15.92:0/2993140564 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f4f04108350 con 0x7f4f08102a60 2024-09-21T07:21:51.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.950+0000 7f4f0dd4c640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ef40b66b0 0x7f4ef40b8bc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8005fd0 tx=0x7f4ef8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:51.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:51.954+0000 7f4eff7fe640 1 -- 172.21.15.92:0/2993140564 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f040ce4a0 con 0x7f4f08102a60 2024-09-21T07:21:52.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:51 smithi092 ceph-mon[30987]: pgmap v607: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-09-21T07:21:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:51 smithi169 ceph-mon[33705]: pgmap v607: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-09-21T07:21:52.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.168+0000 7f4f107b1640 1 -- 172.21.15.92:0/2993140564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f0806b270 con 0x7f4f08102a60 2024-09-21T07:21:52.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.169+0000 7f4eff7fe640 1 -- 172.21.15.92:0/2993140564 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f4f0806b270 con 0x7f4f08102a60 2024-09-21T07:21:52.171 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:21:52.171 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:21:52.171 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:21:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.171+0000 7f4f107b1640 1 -- 172.21.15.92:0/2993140564 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ef40b66b0 msgr2=0x7f4ef40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.171+0000 7f4f107b1640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ef40b66b0 0x7f4ef40b8bc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8005fd0 tx=0x7f4ef8005850 comp rx=0 tx=0).stop 2024-09-21T07:21:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.171+0000 7f4f107b1640 1 -- 172.21.15.92:0/2993140564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f08102a60 msgr2=0x7f4f0819b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:52.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.171+0000 7f4f107b1640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f08102a60 0x7f4f0819b1a0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009230 tx=0x7f4f04004270 comp rx=0 tx=0).stop 2024-09-21T07:21:52.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.171+0000 7f4f107b1640 1 -- 172.21.15.92:0/2993140564 shutdown_connections 2024-09-21T07:21:52.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.171+0000 7f4f107b1640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4ef40b66b0 0x7f4ef40b8bc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:52.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.171+0000 7f4f107b1640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f08108cf0 0x7f4f0819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:52.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.171+0000 7f4f107b1640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f081083a0 0x7f4f0819b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:52.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.171+0000 7f4f107b1640 1 --2- 172.21.15.92:0/2993140564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f08102a60 0x7f4f0819b1a0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:52.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.171+0000 7f4f107b1640 1 -- 172.21.15.92:0/2993140564 >> 172.21.15.92:0/2993140564 conn(0x7f4f08079730 msgr2=0x7f4f08101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:52.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.172+0000 7f4f107b1640 1 -- 172.21.15.92:0/2993140564 shutdown_connections 2024-09-21T07:21:52.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:52.172+0000 7f4f107b1640 1 -- 172.21.15.92:0/2993140564 wait complete. 2024-09-21T07:21:52.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:51 smithi175 ceph-mon[34064]: pgmap v607: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-09-21T07:21:52.876 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:21:53.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:52 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2993140564' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:53.121 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:53.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:52 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2993140564' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:53.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:52 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2993140564' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:53.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.632+0000 7f864950e640 1 -- 172.21.15.92:0/710241590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86441052b0 msgr2=0x7f864410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:53.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.632+0000 7f864950e640 1 --2- 172.21.15.92:0/710241590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86441052b0 0x7f864410d8f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f862c009900 tx=0x7f862c02a410 comp rx=0 tx=0).stop 2024-09-21T07:21:53.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.632+0000 7f864950e640 1 -- 172.21.15.92:0/710241590 shutdown_connections 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.632+0000 7f864950e640 1 --2- 172.21.15.92:0/710241590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f864410de30 0x7f8644110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.632+0000 7f864950e640 1 --2- 172.21.15.92:0/710241590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86441052b0 0x7f864410d8f0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.632+0000 7f864950e640 1 --2- 172.21.15.92:0/710241590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8644104880 0x7f8644104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.632+0000 7f864950e640 1 -- 172.21.15.92:0/710241590 >> 172.21.15.92:0/710241590 conn(0x7f8644079730 msgr2=0x7f8644079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.632+0000 7f864950e640 1 -- 172.21.15.92:0/710241590 shutdown_connections 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.632+0000 7f864950e640 1 -- 172.21.15.92:0/710241590 wait complete. 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.632+0000 7f864950e640 1 Processor -- start 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f864950e640 1 -- start start 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f864950e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8644104880 0x7f864419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f864950e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86441052b0 0x7f864419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f864950e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f864410de30 0x7f86441a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f864950e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8644113960 con 0x7f864410de30 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f864950e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86441137e0 con 0x7f86441052b0 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f864950e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8644113ae0 con 0x7f8644104880 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f86437fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f864410de30 0x7f86441a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f86437fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f864410de30 0x7f86441a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38662/0 (socket says 172.21.15.92:38662) 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f86437fe640 1 -- 172.21.15.92:0/4015339552 learned_addr learned my addr 172.21.15.92:0/4015339552 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f8642ffd640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8644104880 0x7f864419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f86427fc640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86441052b0 0x7f864419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f86437fe640 1 -- 172.21.15.92:0/4015339552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8644104880 msgr2=0x7f864419c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f86437fe640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8644104880 0x7f864419c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f86437fe640 1 -- 172.21.15.92:0/4015339552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86441052b0 msgr2=0x7f864419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:53.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f86437fe640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86441052b0 0x7f864419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f86437fe640 1 -- 172.21.15.92:0/4015339552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86441a25a0 con 0x7f864410de30 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.633+0000 7f86427fc640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86441052b0 0x7f864419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.634+0000 7f86437fe640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f864410de30 0x7f86441a1e70 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f863c009fd0 tx=0x7f863c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.634+0000 7f863bfff640 1 -- 172.21.15.92:0/4015339552 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c011830 con 0x7f864410de30 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.634+0000 7f864950e640 1 -- 172.21.15.92:0/4015339552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86441a2890 con 0x7f864410de30 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.634+0000 7f863bfff640 1 -- 172.21.15.92:0/4015339552 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f863c016070 con 0x7f864410de30 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.634+0000 7f863bfff640 1 -- 172.21.15.92:0/4015339552 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c010d20 con 0x7f864410de30 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.634+0000 7f864950e640 1 -- 172.21.15.92:0/4015339552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86441a8ff0 con 0x7f864410de30 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f864fa82740 1 Processor -- start 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f863bfff640 1 -- 172.21.15.92:0/4015339552 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f863c01b460 con 0x7f864410de30 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f864fa82740 1 -- start start 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f864fa82740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f752fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f864fa82740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f2d1b0 0x557f752fd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f864fa82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f35390 0x557f752fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f864fa82740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557f75273ea0 con 0x557f74f2d1b0 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f864fa82740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557f752632d0 con 0x557f74f56070 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f864fa82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557f752670e0 con 0x557f74f35390 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f8642ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f2d1b0 0x557f752fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f8642ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f2d1b0 0x557f752fd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38666/0 (socket says 172.21.15.92:38666) 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.637+0000 7f8642ffd640 1 -- 172.21.15.92:0/407216033 learned_addr learned my addr 172.21.15.92:0/407216033 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f86427fc640 1 --2- 172.21.15.92:0/407216033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f752fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f863bfff640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86300b6680 0x7f86300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f86427fc640 1 --2- 172.21.15.92:0/407216033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f35390 0x557f752fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f8642ffd640 1 -- 172.21.15.92:0/407216033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f35390 msgr2=0x557f752fdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f8642ffd640 1 --2- 172.21.15.92:0/407216033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f35390 0x557f752fdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f8642ffd640 1 -- 172.21.15.92:0/407216033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 msgr2=0x557f752fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f8642ffd640 1 --2- 172.21.15.92:0/407216033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f752fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f8642ffd640 1 -- 172.21.15.92:0/407216033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f74fc1650 con 0x557f74f2d1b0 2024-09-21T07:21:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f86437fe640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86300b6680 0x7f86300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f86427fc640 1 --2- 172.21.15.92:0/407216033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f752fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f8642ffd640 1 --2- 172.21.15.92:0/407216033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f2d1b0 0x557f752fd800 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f8634003a70 tx=0x7f8634003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1096fcec0f4a5bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f863bfff640 1 -- 172.21.15.92:0/4015339552 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f863c0e7010 con 0x7f864410de30 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f86397fa640 1 -- 172.21.15.92:0/407216033 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634012450 con 0x557f74f2d1b0 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f86397fa640 1 -- 172.21.15.92:0/407216033 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8634012a80 con 0x557f74f2d1b0 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.638+0000 7f86397fa640 1 -- 172.21.15.92:0/407216033 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634011a50 con 0x557f74f2d1b0 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.639+0000 7f864fa82740 1 -- 172.21.15.92:0/407216033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f2d1b0 msgr2=0x557f752fd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.639+0000 7f86437fe640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86300b6680 0x7f86300b8b90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f863c0ac9f0 tx=0x7f863c078610 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.639+0000 7f864fa82740 1 --2- 172.21.15.92:0/407216033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f2d1b0 0x557f752fd800 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f8634003a70 tx=0x7f8634003f30 comp rx=0 tx=0).stop 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.639+0000 7f864fa82740 1 -- 172.21.15.92:0/407216033 shutdown_connections 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.639+0000 7f864fa82740 1 --2- 172.21.15.92:0/407216033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f35390 0x557f752fdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.639+0000 7f864fa82740 1 --2- 172.21.15.92:0/407216033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f2d1b0 0x557f752fd800 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.639+0000 7f864fa82740 1 --2- 172.21.15.92:0/407216033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f752fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.639+0000 7f864fa82740 1 -- 172.21.15.92:0/407216033 >> 172.21.15.92:0/407216033 conn(0x557f74f4a460 msgr2=0x557f752fb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.639+0000 7f864fa82740 1 -- 172.21.15.92:0/407216033 shutdown_connections 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.639+0000 7f864fa82740 1 -- 172.21.15.92:0/407216033 wait complete. 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f864fa82740 1 -- start start 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f864fa82740 1 Processor -- start 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f864fa82740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f2d1b0 0x557f75308980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f864fa82740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f35390 0x557f75308ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f864fa82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f56070 0x557f75314dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f864fa82740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557f750c4700 con 0x557f74f35390 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f864fa82740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557f751fe160 con 0x557f74f2d1b0 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f864fa82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557f7530baa0 con 0x557f74f56070 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f864fa82740 10 client.0 _ll_register_callbacks cb 0x557f752179e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f8642ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f35390 0x557f75308ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f8642ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f35390 0x557f75308ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38676/0 (socket says 172.21.15.92:38676) 2024-09-21T07:21:53.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f8642ffd640 1 -- 172.21.15.92:0/1577862133 learned_addr learned my addr 172.21.15.92:0/1577862133 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.640+0000 7f86427fc640 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f56070 0x557f75314dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f86427fc640 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f2d1b0 0x557f75308980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f8642ffd640 1 -- 172.21.15.92:0/1577862133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f56070 msgr2=0x557f75314dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f8642ffd640 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f56070 0x557f75314dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f8642ffd640 1 -- 172.21.15.92:0/1577862133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f2d1b0 msgr2=0x557f75308980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f8642ffd640 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f2d1b0 0x557f75308980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f8642ffd640 1 -- 172.21.15.92:0/1577862133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f7522bc90 con 0x557f74f35390 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f86427fc640 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f2d1b0 0x557f75308980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f8642ffd640 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f35390 0x557f75308ec0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f86340049d0 tx=0x7f8634011520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155727d1c492503f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f862a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f862a7fc640 1 -- 172.21.15.92:0/1577862133 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634012db0 con 0x557f74f35390 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f862a7fc640 1 -- 172.21.15.92:0/1577862133 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f8634004c50 con 0x557f74f35390 2024-09-21T07:21:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f864fa82740 1 -- 172.21.15.92:0/1577862133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8634012a80 con 0x557f74f35390 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f862a7fc640 1 -- 172.21.15.92:0/1577862133 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f863402f050 con 0x557f74f35390 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f864fa82740 10 client.18063 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.641+0000 7f864fa82740 1 -- 172.21.15.92:0/1577862133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557f753177b0 con 0x557f74f35390 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f862a7fc640 1 -- 172.21.15.92:0/1577862133 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8634012a80 con 0x557f74f35390 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f862a7fc640 1 -- 172.21.15.92:0/1577862133 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f863400f040 con 0x557f74f35390 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f864fa82740 10 client.18063 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f864fa82740 10 client.18063 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f864fa82740 20 client.18063 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f864fa82740 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x557f74f149f0 0x557f7531abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f864fa82740 4 client.18063 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f864fa82740 1 -- 172.21.15.92:0/1577862133 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f75275df0 con 0x557f74f149f0 2024-09-21T07:21:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f86427fc640 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x557f74f149f0 0x557f7531abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f862a7fc640 10 client.18063 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:21:53.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.642+0000 7f86427fc640 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x557f74f149f0 0x557f7531abc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3b7df47aa6866a2 server_cookie=7c5cb0ef615a8f6 in_seq=0 out_seq=0 2024-09-21T07:21:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.643+0000 7f862a7fc640 1 -- 172.21.15.92:0/1577862133 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f75275df0 con 0x557f74f149f0 2024-09-21T07:21:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.643+0000 7f862a7fc640 10 client.18063 handle_command_reply: tid=0 2024-09-21T07:21:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.643+0000 7f864fa82740 1 client.18063 shutdown 2024-09-21T07:21:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f864fa82740 1 -- 172.21.15.92:0/1577862133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f35390 msgr2=0x557f75308ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f864fa82740 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f35390 0x557f75308ec0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f86340049d0 tx=0x7f8634011520 comp rx=0 tx=0).stop 2024-09-21T07:21:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f864fa82740 1 -- 172.21.15.92:0/1577862133 shutdown_connections 2024-09-21T07:21:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f864fa82740 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x557f74f149f0 0x557f7531abc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f864fa82740 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f56070 0x557f75314dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f864fa82740 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74f35390 0x557f75308ec0 secure :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f86340049d0 tx=0x7f8634011520 comp rx=0 tx=0).stop 2024-09-21T07:21:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f864fa82740 1 --2- 172.21.15.92:0/1577862133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f2d1b0 0x557f75308980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f864fa82740 1 -- 172.21.15.92:0/1577862133 >> 172.21.15.92:0/1577862133 conn(0x557f74f4a460 msgr2=0x557f75300450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f862a7fc640 0 client.18063 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:21:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f864fa82740 1 -- 172.21.15.92:0/1577862133 shutdown_connections 2024-09-21T07:21:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.644+0000 7f864fa82740 1 -- 172.21.15.92:0/1577862133 wait complete. 2024-09-21T07:21:53.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.645+0000 7f864fa82740 20 client.18063 trim_cache size 0 max 16384 2024-09-21T07:21:53.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.659+0000 7f864fa82740 1 Processor -- start 2024-09-21T07:21:53.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.659+0000 7f864fa82740 1 -- start start 2024-09-21T07:21:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f864fa82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 0x557f75314d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f864fa82740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f752fa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f864fa82740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f752faca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f864fa82740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b3210 con 0x557f74ee9da0 2024-09-21T07:21:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f864fa82740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b4d50 con 0x557f74f56070 2024-09-21T07:21:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f864fa82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b38e0 con 0x557f74f2d1b0 2024-09-21T07:21:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f86427fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f752faca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f86427fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f752faca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38680/0 (socket says 172.21.15.92:38680) 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f86427fc640 1 -- 172.21.15.92:0/4023518344 learned_addr learned my addr 172.21.15.92:0/4023518344 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f86427fc640 1 --2- 172.21.15.92:0/4023518344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 0x557f75314d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f8642ffd640 1 --2- 172.21.15.92:0/4023518344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f752fa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f86427fc640 1 -- 172.21.15.92:0/4023518344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 msgr2=0x557f75314d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f86427fc640 1 --2- 172.21.15.92:0/4023518344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 0x557f75314d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f86427fc640 1 -- 172.21.15.92:0/4023518344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 msgr2=0x557f752fa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f86427fc640 1 --2- 172.21.15.92:0/4023518344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f752fa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f86427fc640 1 -- 172.21.15.92:0/4023518344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f75306e80 con 0x557f74ee9da0 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.660+0000 7f8642ffd640 1 --2- 172.21.15.92:0/4023518344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f752fa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.661+0000 7f86427fc640 1 --2- 172.21.15.92:0/4023518344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f752faca0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f862c0058f0 tx=0x7f862c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efc424a8ad8f2b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:53.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.661+0000 7f8638ff9640 1 -- 172.21.15.92:0/4023518344 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c035040 con 0x557f74ee9da0 2024-09-21T07:21:53.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.661+0000 7f8638ff9640 1 -- 172.21.15.92:0/4023518344 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f862c04c040 con 0x557f74ee9da0 2024-09-21T07:21:53.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.661+0000 7f8638ff9640 1 -- 172.21.15.92:0/4023518344 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c03d450 con 0x557f74ee9da0 2024-09-21T07:21:53.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 -- 172.21.15.92:0/4023518344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 msgr2=0x557f752faca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:53.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 --2- 172.21.15.92:0/4023518344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f752faca0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f862c0058f0 tx=0x7f862c009260 comp rx=0 tx=0).stop 2024-09-21T07:21:53.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 -- 172.21.15.92:0/4023518344 shutdown_connections 2024-09-21T07:21:53.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 --2- 172.21.15.92:0/4023518344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f752faca0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 --2- 172.21.15.92:0/4023518344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f752fa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 --2- 172.21.15.92:0/4023518344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 0x557f75314d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 -- 172.21.15.92:0/4023518344 >> 172.21.15.92:0/4023518344 conn(0x557f74f4a460 msgr2=0x557f75307200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 -- 172.21.15.92:0/4023518344 shutdown_connections 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 -- 172.21.15.92:0/4023518344 wait complete. 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 -- start start 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.662+0000 7f864fa82740 1 Processor -- start 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f864fa82740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f7531e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f864fa82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 0x557f7531b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f864fa82740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f7531bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f864fa82740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b4680 con 0x557f74ee9da0 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f864fa82740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b3fb0 con 0x557f74f56070 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f864fa82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b1210 con 0x557f74f2d1b0 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f864fa82740 10 client.0 _ll_register_callbacks cb 0x7f8634009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:53.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f86427fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f7531e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f86427fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f7531e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38690/0 (socket says 172.21.15.92:38690) 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f86427fc640 1 -- 172.21.15.92:0/2881207317 learned_addr learned my addr 172.21.15.92:0/2881207317 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f8642ffd640 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 0x557f7531b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f86427fc640 1 -- 172.21.15.92:0/2881207317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 msgr2=0x557f7531b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f86427fc640 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 0x557f7531b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f86427fc640 1 -- 172.21.15.92:0/2881207317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 msgr2=0x557f7531bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f86427fc640 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f7531bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f86427fc640 1 -- 172.21.15.92:0/2881207317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f7531c0d0 con 0x557f74ee9da0 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f8642ffd640 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 0x557f7531b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f86427fc640 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f7531e180 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f862c031790 tx=0x7f862c003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d423a2cf8ea0a892 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.663+0000 7f862a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f862a7fc640 1 -- 172.21.15.92:0/2881207317 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c035040 con 0x557f74ee9da0 2024-09-21T07:21:53.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f862a7fc640 1 -- 172.21.15.92:0/2881207317 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f862c0035f0 con 0x557f74ee9da0 2024-09-21T07:21:53.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f864fa82740 1 -- 172.21.15.92:0/2881207317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f862c04c040 con 0x557f74ee9da0 2024-09-21T07:21:53.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f862a7fc640 1 -- 172.21.15.92:0/2881207317 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f862c003ed0 con 0x557f74ee9da0 2024-09-21T07:21:53.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f864fa82740 10 client.18069 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:53.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f864fa82740 1 -- 172.21.15.92:0/2881207317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557f75385030 con 0x557f74ee9da0 2024-09-21T07:21:53.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f862a7fc640 1 -- 172.21.15.92:0/2881207317 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f862c04c040 con 0x557f74ee9da0 2024-09-21T07:21:53.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f862a7fc640 1 -- 172.21.15.92:0/2881207317 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f862c050030 con 0x557f74ee9da0 2024-09-21T07:21:53.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f864fa82740 10 client.18069 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:53.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f864fa82740 10 client.18069 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:21:53.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f864fa82740 20 client.18069 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f864fa82740 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x557f75385650 0x557f75387a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f864fa82740 4 client.18069 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f864fa82740 1 -- 172.21.15.92:0/2881207317 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557f752718a0 con 0x557f75385650 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.664+0000 7f8642ffd640 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x557f75385650 0x557f75387a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f862a7fc640 10 client.18069 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f8642ffd640 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x557f75385650 0x557f75387a70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1d3bacb7fca274d3 server_cookie=790b89b2e4ce2b26 in_seq=0 out_seq=0 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f862a7fc640 1 -- 172.21.15.92:0/2881207317 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557f752718a0 con 0x557f75385650 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f862a7fc640 10 client.18069 handle_command_reply: tid=0 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f864fa82740 1 client.18069 shutdown 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f864fa82740 1 -- 172.21.15.92:0/2881207317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 msgr2=0x557f7531e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f864fa82740 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f7531e180 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f862c031790 tx=0x7f862c003d20 comp rx=0 tx=0).stop 2024-09-21T07:21:53.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f864fa82740 1 -- 172.21.15.92:0/2881207317 shutdown_connections 2024-09-21T07:21:53.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f864fa82740 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x557f75385650 0x557f75387a70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f864fa82740 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f74f56070 0x557f7531bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f862a7fc640 0 client.18069 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:21:53.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.665+0000 7f864fa82740 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557f74f2d1b0 0x557f7531b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864fa82740 1 --2- 172.21.15.92:0/2881207317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f74ee9da0 0x557f7531e180 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864fa82740 1 -- 172.21.15.92:0/2881207317 >> 172.21.15.92:0/2881207317 conn(0x557f74f4a460 msgr2=0x557f752fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:53.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864fa82740 1 -- 172.21.15.92:0/2881207317 shutdown_connections 2024-09-21T07:21:53.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864fa82740 1 -- 172.21.15.92:0/2881207317 wait complete. 2024-09-21T07:21:53.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864fa82740 20 client.18069 trim_cache size 0 max 16384 2024-09-21T07:21:53.673 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:53.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864950e640 1 -- 172.21.15.92:0/4015339552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86300b6680 msgr2=0x7f86300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:53.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864950e640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86300b6680 0x7f86300b8b90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f863c0ac9f0 tx=0x7f863c078610 comp rx=0 tx=0).stop 2024-09-21T07:21:53.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864950e640 1 -- 172.21.15.92:0/4015339552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f864410de30 msgr2=0x7f86441a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:53.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864950e640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f864410de30 0x7f86441a1e70 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f863c009fd0 tx=0x7f863c00b8e0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864950e640 1 -- 172.21.15.92:0/4015339552 shutdown_connections 2024-09-21T07:21:53.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864950e640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f86300b6680 0x7f86300b8b90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864950e640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f864410de30 0x7f86441a1e70 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864950e640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86441052b0 0x7f864419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864950e640 1 --2- 172.21.15.92:0/4015339552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8644104880 0x7f864419c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:53.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.666+0000 7f864950e640 1 -- 172.21.15.92:0/4015339552 >> 172.21.15.92:0/4015339552 conn(0x7f8644079730 msgr2=0x7f8644109e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:53.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.667+0000 7f864950e640 1 -- 172.21.15.92:0/4015339552 shutdown_connections 2024-09-21T07:21:53.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:53.667+0000 7f864950e640 1 -- 172.21.15.92:0/4015339552 wait complete. 2024-09-21T07:21:54.055 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:53 smithi092 ceph-mon[30987]: pgmap v608: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 op/s 2024-09-21T07:21:54.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:53 smithi169 ceph-mon[33705]: pgmap v608: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 op/s 2024-09-21T07:21:54.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:53 smithi175 ceph-mon[34064]: pgmap v608: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 op/s 2024-09-21T07:21:54.396 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:21:54.642 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:55.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 -- 172.21.15.92:0/1153883360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbbc102240 msgr2=0x7fbbbc102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:55.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 --2- 172.21.15.92:0/1153883360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbbc102240 0x7fbbbc102650 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009900 tx=0x7fbbb802a410 comp rx=0 tx=0).stop 2024-09-21T07:21:55.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 -- 172.21.15.92:0/1153883360 shutdown_connections 2024-09-21T07:21:55.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 --2- 172.21.15.92:0/1153883360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbbc1084d0 0x7fbbbc10ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 --2- 172.21.15.92:0/1153883360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbbc107b80 0x7fbbbc107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 --2- 172.21.15.92:0/1153883360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbbc102240 0x7fbbbc102650 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 -- 172.21.15.92:0/1153883360 >> 172.21.15.92:0/1153883360 conn(0x7fbbbc079f90 msgr2=0x7fbbbc07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:55.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 -- 172.21.15.92:0/1153883360 shutdown_connections 2024-09-21T07:21:55.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 -- 172.21.15.92:0/1153883360 wait complete. 2024-09-21T07:21:55.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 Processor -- start 2024-09-21T07:21:55.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.142+0000 7fbbc3768640 1 -- start start 2024-09-21T07:21:55.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc3768640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbbc102240 0x7fbbbc19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc3768640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbbc107b80 0x7fbbbc19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc3768640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbbc1084d0 0x7fbbbc19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc3768640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1117c0 con 0x7fbbbc102240 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc3768640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc111640 con 0x7fbbbc107b80 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc3768640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc111940 con 0x7fbbbc1084d0 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc1504640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbbc102240 0x7fbbbc19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc1504640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbbc102240 0x7fbbbc19a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38702/0 (socket says 172.21.15.92:38702) 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc1504640 1 -- 172.21.15.92:0/3691632329 learned_addr learned my addr 172.21.15.92:0/3691632329 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc1d05640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbbc1084d0 0x7fbbbc19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc0d03640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbbc107b80 0x7fbbbc19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc1504640 1 -- 172.21.15.92:0/3691632329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbbc1084d0 msgr2=0x7fbbbc19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc1504640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbbc1084d0 0x7fbbbc19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc1504640 1 -- 172.21.15.92:0/3691632329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbbc107b80 msgr2=0x7fbbbc19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc1504640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbbc107b80 0x7fbbbc19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc1504640 1 -- 172.21.15.92:0/3691632329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbbc1a02d0 con 0x7fbbbc102240 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbc1504640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbbc102240 0x7fbbbc19a420 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009230 tx=0x7fbbb8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbb27fc640 1 -- 172.21.15.92:0/3691632329 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb803f030 con 0x7fbbbc102240 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.143+0000 7fbbb27fc640 1 -- 172.21.15.92:0/3691632329 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbb8003a80 con 0x7fbbbc102240 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.144+0000 7fbbc3768640 1 -- 172.21.15.92:0/3691632329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbbc1a0560 con 0x7fbbbc102240 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.144+0000 7fbbb27fc640 1 -- 172.21.15.92:0/3691632329 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8035070 con 0x7fbbbc102240 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.144+0000 7fbbc3768640 1 -- 172.21.15.92:0/3691632329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbbc1a0a40 con 0x7fbbbc102240 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.146+0000 7fbbc9cdc740 1 Processor -- start 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.146+0000 7fbbc9cdc740 1 -- start start 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbb27fc640 1 -- 172.21.15.92:0/3691632329 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fbbb8042030 con 0x7fbbbc102240 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5554070 0x555fe58fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe58fb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5533390 0x555fe58fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555fe5871ea0 con 0x555fe552b1b0 2024-09-21T07:21:55.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555fe58612d0 con 0x555fe5533390 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555fe58650e0 con 0x555fe5554070 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc1504640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe58fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc1504640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe58fb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38708/0 (socket says 172.21.15.92:38708) 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc1504640 1 -- 172.21.15.92:0/1038665756 learned_addr learned my addr 172.21.15.92:0/1038665756 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc0d03640 1 --2- 172.21.15.92:0/1038665756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5533390 0x555fe58fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc1d05640 1 --2- 172.21.15.92:0/1038665756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5554070 0x555fe58fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc1504640 1 -- 172.21.15.92:0/1038665756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5554070 msgr2=0x555fe58fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc1504640 1 --2- 172.21.15.92:0/1038665756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5554070 0x555fe58fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc1504640 1 -- 172.21.15.92:0/1038665756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5533390 msgr2=0x555fe58fbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc1504640 1 --2- 172.21.15.92:0/1038665756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5533390 0x555fe58fbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc1504640 1 -- 172.21.15.92:0/1038665756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fe55bf650 con 0x555fe552b1b0 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbc1504640 1 --2- 172.21.15.92:0/1038665756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe58fb800 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8105640 tx=0x7fbbb8110640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2839bd542c9362d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:55.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.147+0000 7fbbb27fc640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbba80b66b0 0x7fbba80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.148+0000 7fbbc1d05640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbba80b66b0 0x7fbba80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.148+0000 7fbba77fe640 1 -- 172.21.15.92:0/1038665756 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80ca3f0 con 0x555fe552b1b0 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.148+0000 7fbba77fe640 1 -- 172.21.15.92:0/1038665756 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbb8115030 con 0x555fe552b1b0 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.148+0000 7fbbb27fc640 1 -- 172.21.15.92:0/3691632329 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fbbb8108350 con 0x7fbbbc102240 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.148+0000 7fbba77fe640 1 -- 172.21.15.92:0/1038665756 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80cd510 con 0x555fe552b1b0 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/1038665756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 msgr2=0x555fe58fb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc1d05640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbba80b66b0 0x7fbba80b8bc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4007e30 tx=0x7fbbb4007400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/1038665756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe58fb800 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8105640 tx=0x7fbbb8110640 comp rx=0 tx=0).stop 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/1038665756 shutdown_connections 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/1038665756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5533390 0x555fe58fbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/1038665756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe58fb800 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/1038665756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5554070 0x555fe58fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/1038665756 >> 172.21.15.92:0/1038665756 conn(0x555fe5548460 msgr2=0x555fe58f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:55.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/1038665756 shutdown_connections 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/1038665756 wait complete. 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 -- start start 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.149+0000 7fbbc9cdc740 1 Processor -- start 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe552b1b0 0x555fe590ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 0x555fe590b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5554070 0x555fe5916e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555fe56c2700 con 0x555fe5554070 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555fe57fc160 con 0x555fe552b1b0 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555fe590dbc0 con 0x555fe5533390 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc9cdc740 10 client.0 _ll_register_callbacks cb 0x555fe58159e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc1d05640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5554070 0x555fe5916e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc1d05640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5554070 0x555fe5916e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38722/0 (socket says 172.21.15.92:38722) 2024-09-21T07:21:55.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc1d05640 1 -- 172.21.15.92:0/3611414304 learned_addr learned my addr 172.21.15.92:0/3611414304 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc1504640 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe552b1b0 0x555fe590ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc0d03640 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 0x555fe590b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc1d05640 1 -- 172.21.15.92:0/3611414304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 msgr2=0x555fe590b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc1d05640 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 0x555fe590b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc1d05640 1 -- 172.21.15.92:0/3611414304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe552b1b0 msgr2=0x555fe590ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc1d05640 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe552b1b0 0x555fe590ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc1d05640 1 -- 172.21.15.92:0/3611414304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fe5829c90 con 0x555fe5554070 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbbc1d05640 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5554070 0x555fe5916e70 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4011e40 tx=0x7fbbb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b28ab99a991c607 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbba4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.150+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3611414304 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb401e620 con 0x555fe5554070 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3611414304 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fbbb401e7c0 con 0x555fe5554070 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3611414304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb8115030 con 0x555fe5554070 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3611414304 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbbb401e9c0 con 0x555fe5554070 2024-09-21T07:21:55.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbbc9cdc740 10 client.18081 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:55.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3611414304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555fe5919890 con 0x555fe5554070 2024-09-21T07:21:55.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3611414304 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbb8115030 con 0x555fe5554070 2024-09-21T07:21:55.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3611414304 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbbb4026b00 con 0x555fe5554070 2024-09-21T07:21:55.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbbc9cdc740 10 client.18081 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:55.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbbc9cdc740 10 client.18081 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:21:55.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbbc9cdc740 20 client.18081 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:55.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x555fe55129f0 0x555fe591cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbbc9cdc740 4 client.18081 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:55.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3611414304 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fe5873df0 con 0x555fe55129f0 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.151+0000 7fbbc1504640 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x555fe55129f0 0x555fe591cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.152+0000 7fbba4ff9640 10 client.18081 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.152+0000 7fbbc1504640 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x555fe55129f0 0x555fe591cda0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d231543e0085e62 server_cookie=b217e737b63d0069 in_seq=0 out_seq=0 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3611414304 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555fe5873df0 con 0x555fe55129f0 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbba4ff9640 10 client.18081 handle_command_reply: tid=0 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 client.18081 shutdown 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3611414304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5554070 msgr2=0x555fe5916e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5554070 0x555fe5916e70 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4011e40 tx=0x7fbbb4004a40 comp rx=0 tx=0).stop 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3611414304 shutdown_connections 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x555fe55129f0 0x555fe591cda0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5554070 0x555fe5916e70 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 0x555fe590b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3611414304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe552b1b0 0x555fe590ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbba4ff9640 0 client.18081 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3611414304 >> 172.21.15.92:0/3611414304 conn(0x555fe5548460 msgr2=0x555fe58fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3611414304 shutdown_connections 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3611414304 wait complete. 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.153+0000 7fbbc9cdc740 20 client.18081 trim_cache size 0 max 16384 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.166+0000 7fbbc9cdc740 1 Processor -- start 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.166+0000 7fbbc9cdc740 1 -- start start 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.166+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe590ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.166+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 0x555fe590b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 0x555fe5907f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1aed60 con 0x555fe552b1b0 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1b08a0 con 0x555fe5554070 2024-09-21T07:21:55.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1af430 con 0x555fe5533390 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc1504640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe590ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc1504640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe590ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38738/0 (socket says 172.21.15.92:38738) 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc1504640 1 -- 172.21.15.92:0/1045514677 learned_addr learned my addr 172.21.15.92:0/1045514677 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc0d03640 1 --2- 172.21.15.92:0/1045514677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 0x555fe590b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc1d05640 1 --2- 172.21.15.92:0/1045514677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 0x555fe5907f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc1504640 1 -- 172.21.15.92:0/1045514677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 msgr2=0x555fe590b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc1504640 1 --2- 172.21.15.92:0/1045514677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 0x555fe590b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc1504640 1 -- 172.21.15.92:0/1045514677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 msgr2=0x555fe5907f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc1504640 1 --2- 172.21.15.92:0/1045514677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 0x555fe5907f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc1504640 1 -- 172.21.15.92:0/1045514677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fe58f47f0 con 0x555fe552b1b0 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc0d03640 1 --2- 172.21.15.92:0/1045514677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 0x555fe590b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbbc1504640 1 --2- 172.21.15.92:0/1045514677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe590ab10 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80cb010 tx=0x7fbbb802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e36dbf2ae93cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbba6ffd640 1 -- 172.21.15.92:0/1045514677 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8049070 con 0x555fe552b1b0 2024-09-21T07:21:55.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbba6ffd640 1 -- 172.21.15.92:0/1045514677 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbb8115030 con 0x555fe552b1b0 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.167+0000 7fbba6ffd640 1 -- 172.21.15.92:0/1045514677 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80cd6f0 con 0x555fe552b1b0 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.168+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/1045514677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 msgr2=0x555fe590ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.168+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/1045514677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe590ab10 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80cb010 tx=0x7fbbb802a410 comp rx=0 tx=0).stop 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.168+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/1045514677 shutdown_connections 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.168+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/1045514677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 0x555fe5907f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.168+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/1045514677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe5533390 0x555fe590b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.168+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/1045514677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe552b1b0 0x555fe590ab10 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.168+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/1045514677 >> 172.21.15.92:0/1045514677 conn(0x555fe5548460 msgr2=0x555fe59095e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.168+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/1045514677 shutdown_connections 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.168+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/1045514677 wait complete. 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc9cdc740 1 -- start start 2024-09-21T07:21:55.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc9cdc740 1 Processor -- start 2024-09-21T07:21:55.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe552b1b0 0x555fe590ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5533390 0x555fe590f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc9cdc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 0x555fe590fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1b01d0 con 0x555fe5533390 2024-09-21T07:21:55.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1afb00 con 0x555fe5554070 2024-09-21T07:21:55.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc9cdc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1acd60 con 0x555fe552b1b0 2024-09-21T07:21:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc9cdc740 10 client.0 _ll_register_callbacks cb 0x7fbbb4007ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc0d03640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5533390 0x555fe590f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc0d03640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5533390 0x555fe590f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38744/0 (socket says 172.21.15.92:38744) 2024-09-21T07:21:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc0d03640 1 -- 172.21.15.92:0/3952635131 learned_addr learned my addr 172.21.15.92:0/3952635131 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.169+0000 7fbbc1504640 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe552b1b0 0x555fe590ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc1d05640 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 0x555fe590fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc0d03640 1 -- 172.21.15.92:0/3952635131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe552b1b0 msgr2=0x555fe590ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc0d03640 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe552b1b0 0x555fe590ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc0d03640 1 -- 172.21.15.92:0/3952635131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 msgr2=0x555fe590fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc0d03640 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 0x555fe590fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc0d03640 1 -- 172.21.15.92:0/3952635131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fe59868c0 con 0x555fe5533390 2024-09-21T07:21:55.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc1d05640 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 0x555fe590fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:55.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc0d03640 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5533390 0x555fe590f4d0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00ea70 tx=0x7fbbac00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c19d9d13a085a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:55.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbba4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:55.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3952635131 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac020060 con 0x555fe5533390 2024-09-21T07:21:55.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3952635131 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fbbac01b480 con 0x555fe5533390 2024-09-21T07:21:55.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3952635131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb8115030 con 0x555fe5533390 2024-09-21T07:21:55.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3952635131 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbbac027050 con 0x555fe5533390 2024-09-21T07:21:55.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc9cdc740 10 client.18087 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:55.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3952635131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555fe5987ba0 con 0x555fe5533390 2024-09-21T07:21:55.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.170+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3952635131 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbb8115030 con 0x555fe5533390 2024-09-21T07:21:55.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.171+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3952635131 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbbac00b040 con 0x555fe5533390 2024-09-21T07:21:55.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.171+0000 7fbbc9cdc740 10 client.18087 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:55.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.171+0000 7fbbc9cdc740 10 client.18087 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:21:55.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.171+0000 7fbbc9cdc740 20 client.18087 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:55.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.171+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x555fe54e7da0 0x555fe598a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:55.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.171+0000 7fbbc9cdc740 4 client.18087 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:55.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.171+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3952635131 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555fe586f8a0 con 0x555fe54e7da0 2024-09-21T07:21:55.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.171+0000 7fbbc1504640 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x555fe54e7da0 0x555fe598a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.171+0000 7fbba4ff9640 10 client.18087 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:21:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.171+0000 7fbbc1504640 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x555fe54e7da0 0x555fe598a3c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8b533e2d5ee39c1c server_cookie=e7b8f780a2220c78 in_seq=0 out_seq=0 2024-09-21T07:21:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbba4ff9640 1 -- 172.21.15.92:0/3952635131 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555fe586f8a0 con 0x555fe54e7da0 2024-09-21T07:21:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbba4ff9640 10 client.18087 handle_command_reply: tid=0 2024-09-21T07:21:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 client.18087 shutdown 2024-09-21T07:21:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3952635131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5533390 msgr2=0x555fe590f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5533390 0x555fe590f4d0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00ea70 tx=0x7fbbac00ef30 comp rx=0 tx=0).stop 2024-09-21T07:21:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3952635131 shutdown_connections 2024-09-21T07:21:55.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555fe5554070 0x555fe590fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x555fe54e7da0 0x555fe598a3c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555fe5533390 0x555fe590f4d0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 --2- 172.21.15.92:0/3952635131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555fe552b1b0 0x555fe590ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3952635131 >> 172.21.15.92:0/3952635131 conn(0x555fe5548460 msgr2=0x555fe590ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbba4ff9640 0 client.18087 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:21:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3952635131 shutdown_connections 2024-09-21T07:21:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 1 -- 172.21.15.92:0/3952635131 wait complete. 2024-09-21T07:21:55.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.172+0000 7fbbc9cdc740 20 client.18087 trim_cache size 0 max 16384 2024-09-21T07:21:55.193 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:55.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 -- 172.21.15.92:0/3691632329 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbba80b66b0 msgr2=0x7fbba80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:55.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbba80b66b0 0x7fbba80b8bc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4007e30 tx=0x7fbbb4007400 comp rx=0 tx=0).stop 2024-09-21T07:21:55.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 -- 172.21.15.92:0/3691632329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbbc102240 msgr2=0x7fbbbc19a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:55.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbbc102240 0x7fbbbc19a420 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009230 tx=0x7fbbb8004270 comp rx=0 tx=0).stop 2024-09-21T07:21:55.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 -- 172.21.15.92:0/3691632329 shutdown_connections 2024-09-21T07:21:55.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbba80b66b0 0x7fbba80b8bc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbbc1084d0 0x7fbbbc19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbbc107b80 0x7fbbbc19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 --2- 172.21.15.92:0/3691632329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbbc102240 0x7fbbbc19a420 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:55.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 -- 172.21.15.92:0/3691632329 >> 172.21.15.92:0/3691632329 conn(0x7fbbbc079f90 msgr2=0x7fbbbc105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:55.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 -- 172.21.15.92:0/3691632329 shutdown_connections 2024-09-21T07:21:55.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:55.173+0000 7fbbc3768640 1 -- 172.21.15.92:0/3691632329 wait complete. 2024-09-21T07:21:55.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:21:56.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:55 smithi092 ceph-mon[30987]: pgmap v609: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:21:56.129 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:56.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:55 smithi169 ceph-mon[33705]: pgmap v609: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:21:56.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:55 smithi175 ceph-mon[34064]: pgmap v609: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:21:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.713+0000 7f2e23980640 1 -- 172.21.15.92:0/2465945905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e1c102080 msgr2=0x7f2e1c102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.713+0000 7f2e23980640 1 --2- 172.21.15.92:0/2465945905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e1c102080 0x7f2e1c102490 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009900 tx=0x7f2e0c02a410 comp rx=0 tx=0).stop 2024-09-21T07:21:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.713+0000 7f2e23980640 1 -- 172.21.15.92:0/2465945905 shutdown_connections 2024-09-21T07:21:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.713+0000 7f2e23980640 1 --2- 172.21.15.92:0/2465945905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e1c109eb0 0x7f2e1c1106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.713+0000 7f2e23980640 1 --2- 172.21.15.92:0/2465945905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1c109560 0x7f2e1c109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.713+0000 7f2e23980640 1 --2- 172.21.15.92:0/2465945905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e1c102080 0x7f2e1c102490 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.713+0000 7f2e23980640 1 -- 172.21.15.92:0/2465945905 >> 172.21.15.92:0/2465945905 conn(0x7f2e1c079ec0 msgr2=0x7f2e1c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.713+0000 7f2e23980640 1 -- 172.21.15.92:0/2465945905 shutdown_connections 2024-09-21T07:21:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.713+0000 7f2e23980640 1 -- 172.21.15.92:0/2465945905 wait complete. 2024-09-21T07:21:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.713+0000 7f2e23980640 1 Processor -- start 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e23980640 1 -- start start 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e23980640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e1c102080 0x7f2e1c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e23980640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1c109560 0x7f2e1c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e23980640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e1c109eb0 0x7f2e1c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e23980640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c113a20 con 0x7f2e1c102080 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e23980640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1138a0 con 0x7f2e1c109eb0 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e23980640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c113ba0 con 0x7f2e1c109560 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e2171c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e1c102080 0x7f2e1c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e2171c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e1c102080 0x7f2e1c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38768/0 (socket says 172.21.15.92:38768) 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e2171c640 1 -- 172.21.15.92:0/4285913372 learned_addr learned my addr 172.21.15.92:0/4285913372 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e20f1b640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1c109560 0x7f2e1c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e2171c640 1 -- 172.21.15.92:0/4285913372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1c109560 msgr2=0x7f2e1c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e2171c640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1c109560 0x7f2e1c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e2171c640 1 -- 172.21.15.92:0/4285913372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e1c109eb0 msgr2=0x7f2e1c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e2171c640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e1c109eb0 0x7f2e1c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e2171c640 1 -- 172.21.15.92:0/4285913372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c1a0420 con 0x7f2e1c102080 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.714+0000 7f2e2171c640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e1c102080 0x7f2e1c19a4b0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009230 tx=0x7f2e0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.715+0000 7f2e1a7fc640 1 -- 172.21.15.92:0/4285913372 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c03f030 con 0x7f2e1c102080 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.715+0000 7f2e1a7fc640 1 -- 172.21.15.92:0/4285913372 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e0c003a80 con 0x7f2e1c102080 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.715+0000 7f2e23980640 1 -- 172.21.15.92:0/4285913372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1c1a06b0 con 0x7f2e1c102080 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.715+0000 7f2e1a7fc640 1 -- 172.21.15.92:0/4285913372 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c035070 con 0x7f2e1c102080 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.715+0000 7f2e23980640 1 -- 172.21.15.92:0/4285913372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e1c1a6e70 con 0x7f2e1c102080 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.717+0000 7f2e1a7fc640 1 -- 172.21.15.92:0/4285913372 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f2e0c042030 con 0x7f2e1c102080 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.717+0000 7f2e29ef4740 1 Processor -- start 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.717+0000 7f2e29ef4740 1 -- start start 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fddedb8070 0x55fddf15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded8f1b0 0x55fddf15fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded97390 0x55fddf160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fddf0d5ea0 con 0x55fddedb8070 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fddf0c52d0 con 0x55fdded97390 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fddf0c90e0 con 0x55fdded8f1b0 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e21f1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fddedb8070 0x55fddf15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e21f1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fddedb8070 0x55fddf15f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38770/0 (socket says 172.21.15.92:38770) 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e21f1d640 1 -- 172.21.15.92:0/948135123 learned_addr learned my addr 172.21.15.92:0/948135123 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e2171c640 1 --2- 172.21.15.92:0/948135123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded8f1b0 0x55fddf15fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e1a7fc640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e040b6700 0x7f2e040b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e20f1b640 1 --2- 172.21.15.92:0/948135123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded97390 0x55fddf160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e21f1d640 1 -- 172.21.15.92:0/948135123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded8f1b0 msgr2=0x55fddf15fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e21f1d640 1 --2- 172.21.15.92:0/948135123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded8f1b0 0x55fddf15fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e21f1d640 1 -- 172.21.15.92:0/948135123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded97390 msgr2=0x55fddf160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e21f1d640 1 --2- 172.21.15.92:0/948135123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded97390 0x55fddf160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e21f1d640 1 -- 172.21.15.92:0/948135123 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fddee23650 con 0x55fddedb8070 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e1a7fc640 1 -- 172.21.15.92:0/4285913372 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f2e0c108100 con 0x7f2e1c102080 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e21f1d640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e040b6700 0x7f2e040b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.718+0000 7f2e21f1d640 1 --2- 172.21.15.92:0/948135123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fddedb8070 0x55fddf15f6a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2e14007dd0 tx=0x7f2e1400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3ee94fe59529d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.719+0000 7f2e037fe640 1 -- 172.21.15.92:0/948135123 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14016070 con 0x55fddedb8070 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.719+0000 7f2e037fe640 1 -- 172.21.15.92:0/948135123 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e1401c470 con 0x55fddedb8070 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.719+0000 7f2e037fe640 1 -- 172.21.15.92:0/948135123 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1401b630 con 0x55fddedb8070 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 -- 172.21.15.92:0/948135123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fddedb8070 msgr2=0x55fddf15f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/948135123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fddedb8070 0x55fddf15f6a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2e14007dd0 tx=0x7f2e1400c6a0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e21f1d640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e040b6700 0x7f2e040b8c10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400cfd0 tx=0x7f2e1401bdb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 -- 172.21.15.92:0/948135123 shutdown_connections 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/948135123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded97390 0x55fddf160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/948135123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded8f1b0 0x55fddf15fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/948135123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fddedb8070 0x55fddf15f6a0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 -- 172.21.15.92:0/948135123 >> 172.21.15.92:0/948135123 conn(0x55fddedac460 msgr2=0x55fddf15d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 -- 172.21.15.92:0/948135123 shutdown_connections 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 -- 172.21.15.92:0/948135123 wait complete. 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 -- start start 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.720+0000 7f2e29ef4740 1 Processor -- start 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded8f1b0 0x55fddf16f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded97390 0x55fddf16f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fddedb8070 0x55fddf17b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fddef26700 con 0x55fdded8f1b0 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fddf060160 con 0x55fddedb8070 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fddf1721e0 con 0x55fdded97390 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e29ef4740 10 client.0 _ll_register_callbacks cb 0x55fddf0799e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e2171c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded8f1b0 0x55fddf16f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e2171c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded8f1b0 0x55fddf16f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38772/0 (socket says 172.21.15.92:38772) 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e2171c640 1 -- 172.21.15.92:0/688946789 learned_addr learned my addr 172.21.15.92:0/688946789 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e20f1b640 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded97390 0x55fddf16f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e21f1d640 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fddedb8070 0x55fddf17b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e2171c640 1 -- 172.21.15.92:0/688946789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded97390 msgr2=0x55fddf16f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e2171c640 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded97390 0x55fddf16f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e2171c640 1 -- 172.21.15.92:0/688946789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fddedb8070 msgr2=0x55fddf17b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e2171c640 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fddedb8070 0x55fddf17b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e2171c640 1 -- 172.21.15.92:0/688946789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fddf08dc90 con 0x55fdded8f1b0 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e2171c640 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded8f1b0 0x55fddf16f180 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c105a50 tx=0x7f2e0c105980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3d7ce756b2fc33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e00ff9640 1 -- 172.21.15.92:0/688946789 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c049030 con 0x55fdded8f1b0 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e00ff9640 1 -- 172.21.15.92:0/688946789 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f2e0c0d70e0 con 0x55fdded8f1b0 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.721+0000 7f2e29ef4740 1 -- 172.21.15.92:0/688946789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e1401c470 con 0x55fdded8f1b0 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e00ff9640 1 -- 172.21.15.92:0/688946789 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e0c0cd4a0 con 0x55fdded8f1b0 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e29ef4740 10 client.18099 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e29ef4740 1 -- 172.21.15.92:0/688946789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fddf17df40 con 0x55fdded8f1b0 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e00ff9640 1 -- 172.21.15.92:0/688946789 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e1401c470 con 0x55fdded8f1b0 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e00ff9640 1 -- 172.21.15.92:0/688946789 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2e0c0d21a0 con 0x55fdded8f1b0 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e29ef4740 10 client.18099 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e29ef4740 10 client.18099 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e29ef4740 20 client.18099 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fdded769f0 0x55fddf1814b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e29ef4740 4 client.18099 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e29ef4740 1 -- 172.21.15.92:0/688946789 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fddf0d7df0 con 0x55fdded769f0 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.722+0000 7f2e20f1b640 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fdded769f0 0x55fddf1814b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.723+0000 7f2e00ff9640 10 client.18099 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.723+0000 7f2e20f1b640 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fdded769f0 0x55fddf1814b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e5df3069284d7747 server_cookie=2b19c51aa583c5 in_seq=0 out_seq=0 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e00ff9640 1 -- 172.21.15.92:0/688946789 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fddf0d7df0 con 0x55fdded769f0 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e00ff9640 10 client.18099 handle_command_reply: tid=0 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 client.18099 shutdown 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 -- 172.21.15.92:0/688946789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded8f1b0 msgr2=0x55fddf16f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded8f1b0 0x55fddf16f180 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c105a50 tx=0x7f2e0c105980 comp rx=0 tx=0).stop 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 -- 172.21.15.92:0/688946789 shutdown_connections 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fdded769f0 0x55fddf1814b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fddedb8070 0x55fddf17b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded97390 0x55fddf16f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e00ff9640 0 client.18099 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/688946789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded8f1b0 0x55fddf16f180 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 -- 172.21.15.92:0/688946789 >> 172.21.15.92:0/688946789 conn(0x55fddedac460 msgr2=0x55fddf161090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 -- 172.21.15.92:0/688946789 shutdown_connections 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 1 -- 172.21.15.92:0/688946789 wait complete. 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.724+0000 7f2e29ef4740 20 client.18099 trim_cache size 0 max 16384 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.737+0000 7f2e29ef4740 1 Processor -- start 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.737+0000 7f2e29ef4740 1 -- start start 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fddedac460 0x55fddf16c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded8f1b0 0x55fddf16c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf186c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1aed70 con 0x55fdded97390 2024-09-21T07:21:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1b08b0 con 0x55fdded8f1b0 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1af440 con 0x55fddedac460 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e21f1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf186c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e21f1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf186c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38774/0 (socket says 172.21.15.92:38774) 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e21f1d640 1 -- 172.21.15.92:0/2075259328 learned_addr learned my addr 172.21.15.92:0/2075259328 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e20f1b640 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded8f1b0 0x55fddf16c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e2171c640 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fddedac460 0x55fddf16c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e21f1d640 1 -- 172.21.15.92:0/2075259328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fddedac460 msgr2=0x55fddf16c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e21f1d640 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fddedac460 0x55fddf16c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e21f1d640 1 -- 172.21.15.92:0/2075259328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded8f1b0 msgr2=0x55fddf16c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e21f1d640 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded8f1b0 0x55fddf16c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e21f1d640 1 -- 172.21.15.92:0/2075259328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fddf161df0 con 0x55fdded97390 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e2171c640 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fddedac460 0x55fddf16c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e20f1b640 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded8f1b0 0x55fddf16c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:56.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e21f1d640 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf186c70 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c6e0 tx=0x7f2e14022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c532017d973b018a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.738+0000 7f2e02ffd640 1 -- 172.21.15.92:0/2075259328 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14016040 con 0x55fdded97390 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e02ffd640 1 -- 172.21.15.92:0/2075259328 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e14010970 con 0x55fdded97390 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e02ffd640 1 -- 172.21.15.92:0/2075259328 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e140117c0 con 0x55fdded97390 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e29ef4740 1 -- 172.21.15.92:0/2075259328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 msgr2=0x55fddf186c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf186c70 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c6e0 tx=0x7f2e14022000 comp rx=0 tx=0).stop 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e29ef4740 1 -- 172.21.15.92:0/2075259328 shutdown_connections 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf186c70 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fdded8f1b0 0x55fddf16c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/2075259328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fddedac460 0x55fddf16c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e29ef4740 1 -- 172.21.15.92:0/2075259328 >> 172.21.15.92:0/2075259328 conn(0x55fddf17b9c0 msgr2=0x55fddf16da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e29ef4740 1 -- 172.21.15.92:0/2075259328 shutdown_connections 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.739+0000 7f2e29ef4740 1 -- 172.21.15.92:0/2075259328 wait complete. 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e29ef4740 1 -- start start 2024-09-21T07:21:56.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e29ef4740 1 Processor -- start 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded8f1b0 0x55fddf1779f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf173eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e29ef4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fddedac460 0x55fddf1743f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1b01e0 con 0x55fdded97390 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1afb10 con 0x55fddedac460 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e29ef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1acd70 con 0x55fdded8f1b0 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e29ef4740 10 client.0 _ll_register_callbacks cb 0x7f2e0c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e20f1b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf173eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e20f1b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf173eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38788/0 (socket says 172.21.15.92:38788) 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e20f1b640 1 -- 172.21.15.92:0/1943198210 learned_addr learned my addr 172.21.15.92:0/1943198210 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.740+0000 7f2e2171c640 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded8f1b0 0x55fddf1779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e21f1d640 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fddedac460 0x55fddf1743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e20f1b640 1 -- 172.21.15.92:0/1943198210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded8f1b0 msgr2=0x55fddf1779f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:56.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e20f1b640 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded8f1b0 0x55fddf1779f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e20f1b640 1 -- 172.21.15.92:0/1943198210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fddedac460 msgr2=0x55fddf1743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e20f1b640 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fddedac460 0x55fddf1743f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e20f1b640 1 -- 172.21.15.92:0/1943198210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fddf1604e0 con 0x55fdded97390 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e20f1b640 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf173eb0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000fc60 tx=0x7f2e10012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0bb7e946816b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e00ff9640 1 -- 172.21.15.92:0/1943198210 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10011850 con 0x55fdded97390 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e00ff9640 1 -- 172.21.15.92:0/1943198210 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f2e100119f0 con 0x55fdded97390 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e29ef4740 1 -- 172.21.15.92:0/1943198210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e14010970 con 0x55fdded97390 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e00ff9640 1 -- 172.21.15.92:0/1943198210 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e1002e050 con 0x55fdded97390 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e29ef4740 10 client.18105 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e29ef4740 1 -- 172.21.15.92:0/1943198210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fddf1ec930 con 0x55fdded97390 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.741+0000 7f2e00ff9640 1 -- 172.21.15.92:0/1943198210 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e14010970 con 0x55fdded97390 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.742+0000 7f2e00ff9640 1 -- 172.21.15.92:0/1943198210 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2e10023c10 con 0x55fdded97390 2024-09-21T07:21:56.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.742+0000 7f2e29ef4740 10 client.18105 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.742+0000 7f2e29ef4740 10 client.18105 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.742+0000 7f2e29ef4740 20 client.18105 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.742+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fddedb8070 0x55fddf1ef120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.742+0000 7f2e29ef4740 4 client.18105 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.742+0000 7f2e29ef4740 1 -- 172.21.15.92:0/1943198210 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fddf0d38a0 con 0x55fddedb8070 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.742+0000 7f2e2171c640 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fddedb8070 0x55fddf1ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e00ff9640 10 client.18105 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e2171c640 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fddedb8070 0x55fddf1ef120 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e7e9791d827adb0c server_cookie=56289b93af5b13c2 in_seq=0 out_seq=0 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e00ff9640 1 -- 172.21.15.92:0/1943198210 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fddf0d38a0 con 0x55fddedb8070 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e00ff9640 10 client.18105 handle_command_reply: tid=0 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 client.18105 shutdown 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 -- 172.21.15.92:0/1943198210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 msgr2=0x55fddf173eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:56.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf173eb0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000fc60 tx=0x7f2e10012820 comp rx=0 tx=0).stop 2024-09-21T07:21:56.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 -- 172.21.15.92:0/1943198210 shutdown_connections 2024-09-21T07:21:56.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55fddedb8070 0x55fddf1ef120 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fddedac460 0x55fddf1743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fdded97390 0x55fddf173eb0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e00ff9640 0 client.18105 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:21:56.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 --2- 172.21.15.92:0/1943198210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fdded8f1b0 0x55fddf1779f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 -- 172.21.15.92:0/1943198210 >> 172.21.15.92:0/1943198210 conn(0x55fddf17b9c0 msgr2=0x55fddf1606b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:56.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 -- 172.21.15.92:0/1943198210 shutdown_connections 2024-09-21T07:21:56.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 1 -- 172.21.15.92:0/1943198210 wait complete. 2024-09-21T07:21:56.795 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.743+0000 7f2e29ef4740 20 client.18105 trim_cache size 0 max 16384 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 -- 172.21.15.92:0/4285913372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e040b6700 msgr2=0x7f2e040b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e040b6700 0x7f2e040b8c10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400cfd0 tx=0x7f2e1401bdb0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 -- 172.21.15.92:0/4285913372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e1c102080 msgr2=0x7f2e1c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e1c102080 0x7f2e1c19a4b0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009230 tx=0x7f2e0c004270 comp rx=0 tx=0).stop 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 -- 172.21.15.92:0/4285913372 shutdown_connections 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f2e040b6700 0x7f2e040b8c10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e1c109eb0 0x7f2e1c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e1c109560 0x7f2e1c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 --2- 172.21.15.92:0/4285913372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e1c102080 0x7f2e1c19a4b0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:56.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 -- 172.21.15.92:0/4285913372 >> 172.21.15.92:0/4285913372 conn(0x7f2e1c079ec0 msgr2=0x7f2e1c1076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:56.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 -- 172.21.15.92:0/4285913372 shutdown_connections 2024-09-21T07:21:56.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:56.744+0000 7f2e23980640 1 -- 172.21.15.92:0/4285913372 wait complete. 2024-09-21T07:21:57.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:21:57.835 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:58.122 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:57 smithi092 ceph-mon[30987]: pgmap v610: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 11 op/s 2024-09-21T07:21:58.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:57 smithi169 ceph-mon[33705]: pgmap v610: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 11 op/s 2024-09-21T07:21:58.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:57 smithi175 ceph-mon[34064]: pgmap v610: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 11 op/s 2024-09-21T07:21:58.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.353+0000 7f8f3256e640 1 -- 172.21.15.92:0/2361009602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f2c102a60 msgr2=0x7f8f2c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:58.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.353+0000 7f8f3256e640 1 --2- 172.21.15.92:0/2361009602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f2c102a60 0x7f8f2c102e70 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009900 tx=0x7f8f1c02a410 comp rx=0 tx=0).stop 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.354+0000 7f8f3256e640 1 -- 172.21.15.92:0/2361009602 shutdown_connections 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.354+0000 7f8f3256e640 1 --2- 172.21.15.92:0/2361009602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.354+0000 7f8f3256e640 1 --2- 172.21.15.92:0/2361009602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.354+0000 7f8f3256e640 1 --2- 172.21.15.92:0/2361009602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f2c102a60 0x7f8f2c102e70 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.354+0000 7f8f3256e640 1 -- 172.21.15.92:0/2361009602 >> 172.21.15.92:0/2361009602 conn(0x7f8f2c079730 msgr2=0x7f8f2c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.354+0000 7f8f3256e640 1 -- 172.21.15.92:0/2361009602 shutdown_connections 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.354+0000 7f8f3256e640 1 -- 172.21.15.92:0/2361009602 wait complete. 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.354+0000 7f8f3256e640 1 Processor -- start 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.354+0000 7f8f3256e640 1 -- start start 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f3256e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f2c102a60 0x7f8f2c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f3256e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f3256e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f3256e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c112810 con 0x7f8f2c108cf0 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f3256e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c112690 con 0x7f8f2c102a60 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f3256e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c112990 con 0x7f8f2c1083a0 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f30b0b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f30b0b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c19eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38806/0 (socket says 172.21.15.92:38806) 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f30b0b640 1 -- 172.21.15.92:0/3250359358 learned_addr learned my addr 172.21.15.92:0/3250359358 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f2bfff640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f2c102a60 0x7f8f2c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f30b0b640 1 -- 172.21.15.92:0/3250359358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f2c1083a0 msgr2=0x7f8f2c199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f30b0b640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f30b0b640 1 -- 172.21.15.92:0/3250359358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f2c102a60 msgr2=0x7f8f2c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f30b0b640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f2c102a60 0x7f8f2c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f30b0b640 1 -- 172.21.15.92:0/3250359358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c19f230 con 0x7f8f2c108cf0 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.355+0000 7f8f30b0b640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c19eb00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400eaa0 tx=0x7f8f2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.356+0000 7f8f297fa640 1 -- 172.21.15.92:0/3250359358 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400cdb0 con 0x7f8f2c108cf0 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.356+0000 7f8f3256e640 1 -- 172.21.15.92:0/3250359358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2c19f520 con 0x7f8f2c108cf0 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.356+0000 7f8f297fa640 1 -- 172.21.15.92:0/3250359358 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f24005020 con 0x7f8f2c108cf0 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.356+0000 7f8f297fa640 1 -- 172.21.15.92:0/3250359358 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f240116d0 con 0x7f8f2c108cf0 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.356+0000 7f8f3256e640 1 -- 172.21.15.92:0/3250359358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2c1a5c80 con 0x7f8f2c108cf0 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.358+0000 7f8f38ae2740 1 Processor -- start 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f297fa640 1 -- 172.21.15.92:0/3250359358 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f8f24011870 con 0x7f8f2c108cf0 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f38ae2740 1 -- start start 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd76652c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 0x560cd7665800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd7665d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560cd75dbea0 con 0x560cd729d390 2024-09-21T07:21:58.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560cd75cb2d0 con 0x560cd72951b0 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560cd75cf0e0 con 0x560cd72be070 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd7665d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd7665d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38816/0 (socket says 172.21.15.92:38816) 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/1099934946 learned_addr learned my addr 172.21.15.92:0/1099934946 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.359+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/1099934946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd76652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f2bfff640 1 --2- 172.21.15.92:0/1099934946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 0x560cd7665800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f297fa640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8f140b6680 0x7f8f140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/1099934946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 msgr2=0x560cd76652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/1099934946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd76652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/1099934946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 msgr2=0x560cd7665800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/1099934946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 0x560cd7665800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/1099934946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cd7329650 con 0x560cd729d390 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f2bfff640 1 --2- 172.21.15.92:0/1099934946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 0x560cd7665800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f30b0b640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8f140b6680 0x7f8f140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/1099934946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd7665d40 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f8f20015470 tx=0x7f8f20009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c17e5883972c9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f297fa640 1 -- 172.21.15.92:0/3250359358 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f8f240e7c70 con 0x7f8f2c108cf0 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f127fc640 1 -- 172.21.15.92:0/1099934946 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20005020 con 0x560cd729d390 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f127fc640 1 -- 172.21.15.92:0/1099934946 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f200047a0 con 0x560cd729d390 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.360+0000 7f8f127fc640 1 -- 172.21.15.92:0/1099934946 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20005650 con 0x560cd729d390 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f38ae2740 1 -- 172.21.15.92:0/1099934946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 msgr2=0x560cd7665d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f30b0b640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8f140b6680 0x7f8f140b8b90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8f240aa930 tx=0x7f8f2407a370 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/1099934946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd7665d40 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f8f20015470 tx=0x7f8f20009550 comp rx=0 tx=0).stop 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f38ae2740 1 -- 172.21.15.92:0/1099934946 shutdown_connections 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/1099934946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd7665d40 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/1099934946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 0x560cd7665800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/1099934946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd76652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f38ae2740 1 -- 172.21.15.92:0/1099934946 >> 172.21.15.92:0/1099934946 conn(0x560cd72b2460 msgr2=0x560cd76631b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:58.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f38ae2740 1 -- 172.21.15.92:0/1099934946 shutdown_connections 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f38ae2740 1 -- 172.21.15.92:0/1099934946 wait complete. 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.361+0000 7f8f38ae2740 1 -- start start 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f38ae2740 1 Processor -- start 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72951b0 0x560cd7670960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd729d390 0x560cd7670ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72be070 0x560cd767cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560cd742c700 con 0x560cd72be070 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560cd7566160 con 0x560cd729d390 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560cd7673aa0 con 0x560cd72951b0 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f38ae2740 10 client.0 _ll_register_callbacks cb 0x560cd757f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72be070 0x560cd767cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72be070 0x560cd767cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38824/0 (socket says 172.21.15.92:38824) 2024-09-21T07:21:58.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/3720031252 learned_addr learned my addr 172.21.15.92:0/3720031252 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72951b0 0x560cd7670960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.362+0000 7f8f2bfff640 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd729d390 0x560cd7670ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/3720031252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72951b0 msgr2=0x560cd7670960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72951b0 0x560cd7670960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/3720031252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd729d390 msgr2=0x560cd7670ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd729d390 0x560cd7670ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/3720031252 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cd7593c90 con 0x560cd72be070 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72be070 0x560cd767cd90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f8f200136f0 tx=0x7f8f20015f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db01d3f83e02e078 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/3720031252 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20013720 con 0x560cd72be070 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/3720031252 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f8f200138c0 con 0x560cd72be070 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3720031252 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f200047a0 con 0x560cd72be070 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/3720031252 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8f20013ac0 con 0x560cd72be070 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f38ae2740 10 client.18117 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:58.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3720031252 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560cd76818f0 con 0x560cd72be070 2024-09-21T07:21:58.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.363+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/3720031252 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f200047a0 con 0x560cd72be070 2024-09-21T07:21:58.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.364+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/3720031252 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8f2002d030 con 0x560cd72be070 2024-09-21T07:21:58.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.364+0000 7f8f38ae2740 10 client.18117 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:58.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.364+0000 7f8f38ae2740 10 client.18117 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:21:58.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.364+0000 7f8f38ae2740 20 client.18117 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:58.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.364+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x560cd727c9f0 0x560cd7684d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.364+0000 7f8f38ae2740 4 client.18117 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:58.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.364+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3720031252 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cd75dddf0 con 0x560cd727c9f0 2024-09-21T07:21:58.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.364+0000 7f8f2bfff640 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x560cd727c9f0 0x560cd7684d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.365+0000 7f8f0b7fe640 10 client.18117 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.365+0000 7f8f2bfff640 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x560cd727c9f0 0x560cd7684d00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2fd14311e7f9d8a server_cookie=8b38f354e2fd2fec in_seq=0 out_seq=0 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.365+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/3720031252 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560cd75dddf0 con 0x560cd727c9f0 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.365+0000 7f8f0b7fe640 10 client.18117 handle_command_reply: tid=0 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.365+0000 7f8f38ae2740 1 client.18117 shutdown 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3720031252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72be070 msgr2=0x560cd767cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72be070 0x560cd767cd90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f8f200136f0 tx=0x7f8f20015f70 comp rx=0 tx=0).stop 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3720031252 shutdown_connections 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x560cd727c9f0 0x560cd7684d00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72be070 0x560cd767cd90 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd729d390 0x560cd7670ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f0b7fe640 0 client.18117 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/3720031252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72951b0 0x560cd7670960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3720031252 >> 172.21.15.92:0/3720031252 conn(0x560cd72b2460 msgr2=0x560cd7668450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:58.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3720031252 shutdown_connections 2024-09-21T07:21:58.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3720031252 wait complete. 2024-09-21T07:21:58.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.366+0000 7f8f38ae2740 20 client.18117 trim_cache size 0 max 16384 2024-09-21T07:21:58.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f38ae2740 1 Processor -- start 2024-09-21T07:21:58.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f38ae2740 1 -- start start 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72951b0 0x560cd7666dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd729d390 0x560cd7672840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd767ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1aedf0 con 0x560cd72951b0 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1b0930 con 0x560cd729d390 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1af4c0 con 0x560cd72be070 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72951b0 0x560cd7666dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72951b0 0x560cd7666dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38832/0 (socket says 172.21.15.92:38832) 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/3170194560 learned_addr learned my addr 172.21.15.92:0/3170194560 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.379+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/3170194560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd767ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.380+0000 7f8f2bfff640 1 --2- 172.21.15.92:0/3170194560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd729d390 0x560cd7672840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.380+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/3170194560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 msgr2=0x560cd767ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:58.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.380+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/3170194560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd767ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.380+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/3170194560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd729d390 msgr2=0x560cd7672840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:58.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.380+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/3170194560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd729d390 0x560cd7672840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.380+0000 7f8f2b7fe640 1 -- 172.21.15.92:0/3170194560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cd765d460 con 0x560cd72951b0 2024-09-21T07:21:58.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.380+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/3170194560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72951b0 0x560cd7666dc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8f20005d00 tx=0x7f8f20005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d89dd2b162af49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:58.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.380+0000 7f8f11ffb640 1 -- 172.21.15.92:0/3170194560 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20009700 con 0x560cd72951b0 2024-09-21T07:21:58.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.380+0000 7f8f11ffb640 1 -- 172.21.15.92:0/3170194560 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f20004680 con 0x560cd72951b0 2024-09-21T07:21:58.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.380+0000 7f8f11ffb640 1 -- 172.21.15.92:0/3170194560 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20004d90 con 0x560cd72951b0 2024-09-21T07:21:58.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.381+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3170194560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72951b0 msgr2=0x560cd7666dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.381+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/3170194560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72951b0 0x560cd7666dc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8f20005d00 tx=0x7f8f20005c50 comp rx=0 tx=0).stop 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.381+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3170194560 shutdown_connections 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.381+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/3170194560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd767ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.381+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/3170194560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd729d390 0x560cd7672840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.381+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/3170194560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd72951b0 0x560cd7666dc0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.381+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3170194560 >> 172.21.15.92:0/3170194560 conn(0x560cd72b2460 msgr2=0x560cd766a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.381+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3170194560 shutdown_connections 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.381+0000 7f8f38ae2740 1 -- 172.21.15.92:0/3170194560 wait complete. 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.381+0000 7f8f38ae2740 1 -- start start 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f38ae2740 1 Processor -- start 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 0x560cd7683c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd76841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f38ae2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd76846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1b0260 con 0x560cd729d390 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1afb90 con 0x560cd72951b0 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f38ae2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1acdf0 con 0x560cd72be070 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f38ae2740 10 client.0 _ll_register_callbacks cb 0x7f8f20009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd76841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd76841a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38848/0 (socket says 172.21.15.92:38848) 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f2bfff640 1 -- 172.21.15.92:0/850639026 learned_addr learned my addr 172.21.15.92:0/850639026 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 0x560cd7683c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd76846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f2bfff640 1 -- 172.21.15.92:0/850639026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 msgr2=0x560cd76846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f2bfff640 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd76846e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f2bfff640 1 -- 172.21.15.92:0/850639026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 msgr2=0x560cd7683c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.382+0000 7f8f2bfff640 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 0x560cd7683c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f2bfff640 1 -- 172.21.15.92:0/850639026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cd76718b0 con 0x560cd729d390 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd76846e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f2bfff640 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd76841a0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c006010 tx=0x7f8f1c0041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cde98a660770b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/850639026 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c035040 con 0x560cd729d390 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/850639026 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f8f1c031600 con 0x560cd729d390 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f38ae2740 1 -- 172.21.15.92:0/850639026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f20004680 con 0x560cd729d390 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/850639026 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8f1c056050 con 0x560cd729d390 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f38ae2740 10 client.18123 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f38ae2740 1 -- 172.21.15.92:0/850639026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560cd76681c0 con 0x560cd729d390 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.383+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/850639026 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f20004680 con 0x560cd729d390 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.384+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/850639026 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8f1c03c440 con 0x560cd729d390 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.384+0000 7f8f38ae2740 10 client.18123 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.384+0000 7f8f38ae2740 10 client.18123 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.384+0000 7f8f38ae2740 20 client.18123 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.384+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x560cd7251da0 0x560cd76f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.384+0000 7f8f38ae2740 4 client.18123 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.384+0000 7f8f38ae2740 1 -- 172.21.15.92:0/850639026 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560cd75d98a0 con 0x560cd7251da0 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.384+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x560cd7251da0 0x560cd76f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f2b7fe640 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x560cd7251da0 0x560cd76f3e80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=547b52ab06f4c3af server_cookie=88fcab19e49a1b93 in_seq=0 out_seq=0 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f0b7fe640 10 client.18123 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f0b7fe640 1 -- 172.21.15.92:0/850639026 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560cd75d98a0 con 0x560cd7251da0 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f0b7fe640 10 client.18123 handle_command_reply: tid=0 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 client.18123 shutdown 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 -- 172.21.15.92:0/850639026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 msgr2=0x560cd76841a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd76841a0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c006010 tx=0x7f8f1c0041a0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 -- 172.21.15.92:0/850639026 shutdown_connections 2024-09-21T07:21:58.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x560cd7251da0 0x560cd76f3e80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cd72be070 0x560cd76846e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560cd729d390 0x560cd76841a0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 --2- 172.21.15.92:0/850639026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560cd72951b0 0x560cd7683c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 -- 172.21.15.92:0/850639026 >> 172.21.15.92:0/850639026 conn(0x560cd72b2460 msgr2=0x560cd766a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:58.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f0b7fe640 0 client.18123 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:21:58.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 -- 172.21.15.92:0/850639026 shutdown_connections 2024-09-21T07:21:58.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 1 -- 172.21.15.92:0/850639026 wait complete. 2024-09-21T07:21:58.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.385+0000 7f8f38ae2740 20 client.18123 trim_cache size 0 max 16384 2024-09-21T07:21:58.392 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:58.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 -- 172.21.15.92:0/3250359358 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8f140b6680 msgr2=0x7f8f140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:58.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8f140b6680 0x7f8f140b8b90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8f240aa930 tx=0x7f8f2407a370 comp rx=0 tx=0).stop 2024-09-21T07:21:58.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 -- 172.21.15.92:0/3250359358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f2c108cf0 msgr2=0x7f8f2c19eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:58.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c19eb00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400eaa0 tx=0x7f8f2400ef60 comp rx=0 tx=0).stop 2024-09-21T07:21:58.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 -- 172.21.15.92:0/3250359358 shutdown_connections 2024-09-21T07:21:58.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8f140b6680 0x7f8f140b8b90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c19eb00 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 --2- 172.21.15.92:0/3250359358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f2c102a60 0x7f8f2c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:58.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 -- 172.21.15.92:0/3250359358 >> 172.21.15.92:0/3250359358 conn(0x7f8f2c079730 msgr2=0x7f8f2c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:58.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 -- 172.21.15.92:0/3250359358 shutdown_connections 2024-09-21T07:21:58.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:58.386+0000 7f8f3256e640 1 -- 172.21.15.92:0/3250359358 wait complete. 2024-09-21T07:21:59.097 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:21:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:59.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.804+0000 7f27a8e6e640 1 -- 172.21.15.92:0/462002868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27a41094a0 msgr2=0x7f27a41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:59.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.804+0000 7f27a8e6e640 1 --2- 172.21.15.92:0/462002868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27a41094a0 0x7f27a41098b0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f2798009900 tx=0x7f279802a410 comp rx=0 tx=0).stop 2024-09-21T07:21:59.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.804+0000 7f27a8e6e640 1 -- 172.21.15.92:0/462002868 shutdown_connections 2024-09-21T07:21:59.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.804+0000 7f27a8e6e640 1 --2- 172.21.15.92:0/462002868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4109df0 0x7f27a4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.804+0000 7f27a8e6e640 1 --2- 172.21.15.92:0/462002868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27a41094a0 0x7f27a41098b0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.804+0000 7f27a8e6e640 1 --2- 172.21.15.92:0/462002868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27a4103b60 0x7f27a4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.804+0000 7f27a8e6e640 1 -- 172.21.15.92:0/462002868 >> 172.21.15.92:0/462002868 conn(0x7f27a407b850 msgr2=0x7f27a407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:59.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.804+0000 7f27a8e6e640 1 -- 172.21.15.92:0/462002868 shutdown_connections 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.804+0000 7f27a8e6e640 1 -- 172.21.15.92:0/462002868 wait complete. 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.805+0000 7f27a8e6e640 1 Processor -- start 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.805+0000 7f27a8e6e640 1 -- start start 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.805+0000 7f27a8e6e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4103b60 0x7f27a419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.805+0000 7f27a8e6e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27a41094a0 0x7f27a419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.805+0000 7f27a8e6e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27a4109df0 0x7f27a419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.805+0000 7f27a8e6e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f27a4113980 con 0x7f27a41094a0 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.805+0000 7f27a8e6e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27a4113800 con 0x7f27a4109df0 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.805+0000 7f27a8e6e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27a4113b00 con 0x7f27a4103b60 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27a41094a0 0x7f27a419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27a41094a0 0x7f27a419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38876/0 (socket says 172.21.15.92:38876) 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a1d9b640 1 -- 172.21.15.92:0/2426058468 learned_addr learned my addr 172.21.15.92:0/2426058468 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:59.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27a4109df0 0x7f27a419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a259c640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4103b60 0x7f27a419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a1d9b640 1 -- 172.21.15.92:0/2426058468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4103b60 msgr2=0x7f27a419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a1d9b640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4103b60 0x7f27a419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a1d9b640 1 -- 172.21.15.92:0/2426058468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27a4109df0 msgr2=0x7f27a419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a1d9b640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27a4109df0 0x7f27a419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a1d9b640 1 -- 172.21.15.92:0/2426058468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a41a0360 con 0x7f27a41094a0 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a1d9b640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27a41094a0 0x7f27a419a990 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f2798005940 tx=0x7f27980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27937fe640 1 -- 172.21.15.92:0/2426058468 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279803f030 con 0x7f27a41094a0 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27937fe640 1 -- 172.21.15.92:0/2426058468 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2798003c90 con 0x7f27a41094a0 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a8e6e640 1 -- 172.21.15.92:0/2426058468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a41a05f0 con 0x7f27a41094a0 2024-09-21T07:21:59.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27937fe640 1 -- 172.21.15.92:0/2426058468 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798035070 con 0x7f27a41094a0 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.806+0000 7f27a8e6e640 1 -- 172.21.15.92:0/2426058468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a41a6db0 con 0x7f27a41094a0 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.809+0000 7f27af3e2740 1 Processor -- start 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.809+0000 7f27af3e2740 1 -- start start 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.809+0000 7f27937fe640 1 -- 172.21.15.92:0/2426058468 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f2798042030 con 0x7f27a41094a0 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.809+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af460070 0x5569af8076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.809+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af807be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.809+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af43f390 0x5569af808120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.809+0000 7f27af3e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5569af77dea0 con 0x5569af4371b0 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.809+0000 7f27af3e2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5569af76d2d0 con 0x5569af460070 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.809+0000 7f27af3e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5569af7710e0 con 0x5569af43f390 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af807be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af807be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38884/0 (socket says 172.21.15.92:38884) 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a259c640 1 -- 172.21.15.92:0/3602065469 learned_addr learned my addr 172.21.15.92:0/3602065469 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:59.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/3602065469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af460070 0x5569af8076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a1d9b640 1 --2- 172.21.15.92:0/3602065469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af43f390 0x5569af808120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a259c640 1 -- 172.21.15.92:0/3602065469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af43f390 msgr2=0x5569af808120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a259c640 1 --2- 172.21.15.92:0/3602065469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af43f390 0x5569af808120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a259c640 1 -- 172.21.15.92:0/3602065469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af460070 msgr2=0x5569af8076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a259c640 1 --2- 172.21.15.92:0/3602065469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af460070 0x5569af8076a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a259c640 1 -- 172.21.15.92:0/3602065469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569af4cb650 con 0x5569af4371b0 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/3602065469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af460070 0x5569af8076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f27a259c640 1 --2- 172.21.15.92:0/3602065469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af807be0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f279400ac20 tx=0x7f279400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd59e36d5b602948 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f2790ff9640 1 -- 172.21.15.92:0/3602065469 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279401d070 con 0x5569af4371b0 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f2790ff9640 1 -- 172.21.15.92:0/3602065469 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2794018ad0 con 0x5569af4371b0 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.810+0000 7f2790ff9640 1 -- 172.21.15.92:0/3602065469 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27940109d0 con 0x5569af4371b0 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27937fe640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f278c0b6680 0x7f278c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f278c0b6680 0x7f278c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27937fe640 1 -- 172.21.15.92:0/2426058468 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f27981083f0 con 0x7f27a41094a0 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27af3e2740 1 -- 172.21.15.92:0/3602065469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 msgr2=0x5569af807be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27af3e2740 1 --2- 172.21.15.92:0/3602065469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af807be0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f279400ac20 tx=0x7f279400f790 comp rx=0 tx=0).stop 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f278c0b6680 0x7f278c0b8b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f279c00a5d0 tx=0x7f279c00d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27af3e2740 1 -- 172.21.15.92:0/3602065469 shutdown_connections 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27af3e2740 1 --2- 172.21.15.92:0/3602065469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af43f390 0x5569af808120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27af3e2740 1 --2- 172.21.15.92:0/3602065469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af807be0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27af3e2740 1 --2- 172.21.15.92:0/3602065469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af460070 0x5569af8076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.811+0000 7f27af3e2740 1 -- 172.21.15.92:0/3602065469 >> 172.21.15.92:0/3602065469 conn(0x5569af454460 msgr2=0x5569af805590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 1 -- 172.21.15.92:0/3602065469 shutdown_connections 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 1 -- 172.21.15.92:0/3602065469 wait complete. 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 1 -- start start 2024-09-21T07:21:59.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 1 Processor -- start 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af4371b0 0x5569af812d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af813280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af8235b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5569af5ce700 con 0x5569af460070 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5569af708160 con 0x5569af43f390 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5569af81a290 con 0x5569af4371b0 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.812+0000 7f27af3e2740 10 client.0 _ll_register_callbacks cb 0x5569af7219e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af8235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af8235b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38886/0 (socket says 172.21.15.92:38886) 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a2d9d640 1 -- 172.21.15.92:0/486417707 learned_addr learned my addr 172.21.15.92:0/486417707 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:59.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a259c640 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af4371b0 0x5569af812d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a1d9b640 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af813280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a2d9d640 1 -- 172.21.15.92:0/486417707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af4371b0 msgr2=0x5569af812d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af4371b0 0x5569af812d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a2d9d640 1 -- 172.21.15.92:0/486417707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 msgr2=0x5569af813280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af813280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a2d9d640 1 -- 172.21.15.92:0/486417707 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569af735c90 con 0x5569af460070 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a1d9b640 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af813280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af8235b0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f279c018e30 tx=0x7f279c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23d73cef8092adb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f2789ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f2789ffb640 1 -- 172.21.15.92:0/486417707 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c028060 con 0x5569af460070 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27af3e2740 1 -- 172.21.15.92:0/486417707 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2794018ad0 con 0x5569af460070 2024-09-21T07:21:59.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f2789ffb640 1 -- 172.21.15.92:0/486417707 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f279c023670 con 0x5569af460070 2024-09-21T07:21:59.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f2789ffb640 1 -- 172.21.15.92:0/486417707 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f279c02f050 con 0x5569af460070 2024-09-21T07:21:59.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27af3e2740 10 client.18135 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:59.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.813+0000 7f27af3e2740 1 -- 172.21.15.92:0/486417707 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569af826040 con 0x5569af460070 2024-09-21T07:21:59.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f2789ffb640 1 -- 172.21.15.92:0/486417707 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2794018ad0 con 0x5569af460070 2024-09-21T07:21:59.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f2789ffb640 1 -- 172.21.15.92:0/486417707 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f279c0117a0 con 0x5569af460070 2024-09-21T07:21:59.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f27af3e2740 10 client.18135 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:59.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f27af3e2740 10 client.18135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:59.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f27af3e2740 20 client.18135 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:59.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f27af3e2740 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5569af41e9f0 0x5569af8295a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f27af3e2740 4 client.18135 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f27af3e2740 1 -- 172.21.15.92:0/486417707 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569af77fdf0 con 0x5569af41e9f0 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f27a259c640 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5569af41e9f0 0x5569af8295a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f2789ffb640 10 client.18135 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.814+0000 7f27a259c640 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5569af41e9f0 0x5569af8295a0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c18edb638d92ac4b server_cookie=25a6c8d13af9a955 in_seq=0 out_seq=0 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f2789ffb640 1 -- 172.21.15.92:0/486417707 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569af77fdf0 con 0x5569af41e9f0 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f2789ffb640 10 client.18135 handle_command_reply: tid=0 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f27af3e2740 1 client.18135 shutdown 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f27af3e2740 1 -- 172.21.15.92:0/486417707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 msgr2=0x5569af8235b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f27af3e2740 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af8235b0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f279c018e30 tx=0x7f279c004a40 comp rx=0 tx=0).stop 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f27af3e2740 1 -- 172.21.15.92:0/486417707 shutdown_connections 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f27af3e2740 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5569af41e9f0 0x5569af8295a0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f27af3e2740 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af8235b0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f27af3e2740 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af813280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f27af3e2740 1 --2- 172.21.15.92:0/486417707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af4371b0 0x5569af812d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f2789ffb640 0 client.18135 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:59.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.815+0000 7f27af3e2740 1 -- 172.21.15.92:0/486417707 >> 172.21.15.92:0/486417707 conn(0x5569af454460 msgr2=0x5569af80a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:59.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.816+0000 7f27af3e2740 1 -- 172.21.15.92:0/486417707 shutdown_connections 2024-09-21T07:21:59.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.816+0000 7f27af3e2740 1 -- 172.21.15.92:0/486417707 wait complete. 2024-09-21T07:21:59.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.816+0000 7f27af3e2740 20 client.18135 trim_cache size 0 max 16384 2024-09-21T07:21:59.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27af3e2740 1 Processor -- start 2024-09-21T07:21:59.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27af3e2740 1 -- start start 2024-09-21T07:21:59.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af4371b0 0x5569af813200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af8234b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af80ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27af3e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41aedb0 con 0x5569af460070 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27af3e2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41b08f0 con 0x5569af43f390 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27af3e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41af480 con 0x5569af4371b0 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27a2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af80ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27a2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af80ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38898/0 (socket says 172.21.15.92:38898) 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27a2d9d640 1 -- 172.21.15.92:0/3094690709 learned_addr learned my addr 172.21.15.92:0/3094690709 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27a259c640 1 --2- 172.21.15.92:0/3094690709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af4371b0 0x5569af813200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27a2d9d640 1 -- 172.21.15.92:0/3094690709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af4371b0 msgr2=0x5569af813200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/3094690709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af4371b0 0x5569af813200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27a2d9d640 1 -- 172.21.15.92:0/3094690709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 msgr2=0x5569af8234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:59.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/3094690709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af8234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27a2d9d640 1 -- 172.21.15.92:0/3094690709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569af806350 con 0x5569af460070 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.829+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/3094690709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af80ff30 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f279c00ae60 tx=0x7f279c0173c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d27b6d4c026b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f278bfff640 1 -- 172.21.15.92:0/3094690709 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c037070 con 0x5569af460070 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f278bfff640 1 -- 172.21.15.92:0/3094690709 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f279c01f040 con 0x5569af460070 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f278bfff640 1 -- 172.21.15.92:0/3094690709 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c018e60 con 0x5569af460070 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f27af3e2740 1 -- 172.21.15.92:0/3094690709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 msgr2=0x5569af80ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f27af3e2740 1 --2- 172.21.15.92:0/3094690709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af80ff30 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f279c00ae60 tx=0x7f279c0173c0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f27af3e2740 1 -- 172.21.15.92:0/3094690709 shutdown_connections 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f27af3e2740 1 --2- 172.21.15.92:0/3094690709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af460070 0x5569af80ff30 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f27af3e2740 1 --2- 172.21.15.92:0/3094690709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af8234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f27af3e2740 1 --2- 172.21.15.92:0/3094690709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af4371b0 0x5569af813200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f27af3e2740 1 -- 172.21.15.92:0/3094690709 >> 172.21.15.92:0/3094690709 conn(0x5569af454460 msgr2=0x5569af812af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f27af3e2740 1 -- 172.21.15.92:0/3094690709 shutdown_connections 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.830+0000 7f27af3e2740 1 -- 172.21.15.92:0/3094690709 wait complete. 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27af3e2740 1 -- start start 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27af3e2740 1 Processor -- start 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af81b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af81b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27af3e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af460070 0x5569af81beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27af3e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41b0220 con 0x5569af4371b0 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27af3e2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41afb50 con 0x5569af43f390 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27af3e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41acdb0 con 0x5569af460070 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27af3e2740 10 client.0 _ll_register_callbacks cb 0x7f279c009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27a259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af81b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27a259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af81b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38908/0 (socket says 172.21.15.92:38908) 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27a259c640 1 -- 172.21.15.92:0/1176753060 learned_addr learned my addr 172.21.15.92:0/1176753060 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.831+0000 7f27a1d9b640 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af81b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af460070 0x5569af81beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27a259c640 1 -- 172.21.15.92:0/1176753060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af460070 msgr2=0x5569af81beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27a259c640 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af460070 0x5569af81beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27a259c640 1 -- 172.21.15.92:0/1176753060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 msgr2=0x5569af81b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27a259c640 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af81b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27a259c640 1 -- 172.21.15.92:0/1176753060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569af892f60 con 0x5569af4371b0 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27a2d9d640 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af460070 0x5569af81beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27a259c640 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af81b430 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x5569af806320 tx=0x7f2794010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ce2d56a4cd078e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f2789ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f2789ffb640 1 -- 172.21.15.92:0/1176753060 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279401d040 con 0x5569af4371b0 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f2789ffb640 1 -- 172.21.15.92:0/1176753060 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7f2794018d00 con 0x5569af4371b0 2024-09-21T07:21:59.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27af3e2740 1 -- 172.21.15.92:0/1176753060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f279c01f040 con 0x5569af4371b0 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f2789ffb640 1 -- 172.21.15.92:0/1176753060 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f279403a050 con 0x5569af4371b0 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27af3e2740 10 client.18141 fetch_fsmap learned FSMap version 29 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f27af3e2740 1 -- 172.21.15.92:0/1176753060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569af894150 con 0x5569af4371b0 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.832+0000 7f2789ffb640 1 -- 172.21.15.92:0/1176753060 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f279c01f040 con 0x5569af4371b0 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.833+0000 7f2789ffb640 1 -- 172.21.15.92:0/1176753060 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2794018690 con 0x5569af4371b0 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.833+0000 7f27af3e2740 10 client.18141 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.833+0000 7f27af3e2740 10 client.18141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.833+0000 7f27af3e2740 20 client.18141 populate_metadata read hostname 'smithi092' 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.833+0000 7f27af3e2740 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5569af3f3da0 0x5569af896660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.833+0000 7f27af3e2740 4 client.18141 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:21:59.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.833+0000 7f27af3e2740 1 -- 172.21.15.92:0/1176753060 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569af77b8a0 con 0x5569af3f3da0 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.833+0000 7f27a1d9b640 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5569af3f3da0 0x5569af896660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.833+0000 7f27a1d9b640 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5569af3f3da0 0x5569af896660 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2000c781a651940f server_cookie=23de6fe9b1917e16 in_seq=0 out_seq=0 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.833+0000 7f2789ffb640 10 client.18141 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f2789ffb640 1 -- 172.21.15.92:0/1176753060 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569af77b8a0 con 0x5569af3f3da0 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f2789ffb640 10 client.18141 handle_command_reply: tid=0 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 client.18141 shutdown 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 -- 172.21.15.92:0/1176753060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 msgr2=0x5569af81b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af81b430 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x5569af806320 tx=0x7f2794010650 comp rx=0 tx=0).stop 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 -- 172.21.15.92:0/1176753060 shutdown_connections 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5569af3f3da0 0x5569af896660 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569af460070 0x5569af81beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569af43f390 0x5569af81b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f2789ffb640 0 client.18141 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 --2- 172.21.15.92:0/1176753060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569af4371b0 0x5569af81b430 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 -- 172.21.15.92:0/1176753060 >> 172.21.15.92:0/1176753060 conn(0x5569af454460 msgr2=0x5569af8086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:59.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 -- 172.21.15.92:0/1176753060 shutdown_connections 2024-09-21T07:21:59.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 1 -- 172.21.15.92:0/1176753060 wait complete. 2024-09-21T07:21:59.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27af3e2740 20 client.18141 trim_cache size 0 max 16384 2024-09-21T07:21:59.845 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:21:59.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27a8e6e640 1 -- 172.21.15.92:0/2426058468 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f278c0b6680 msgr2=0x7f278c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:59.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27a8e6e640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f278c0b6680 0x7f278c0b8b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f279c00a5d0 tx=0x7f279c00d040 comp rx=0 tx=0).stop 2024-09-21T07:21:59.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27a8e6e640 1 -- 172.21.15.92:0/2426058468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27a41094a0 msgr2=0x7f27a419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:59.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.834+0000 7f27a8e6e640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27a41094a0 0x7f27a419a990 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f2798005940 tx=0x7f27980042f0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.835+0000 7f27a8e6e640 1 -- 172.21.15.92:0/2426058468 shutdown_connections 2024-09-21T07:21:59.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.835+0000 7f27a8e6e640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f278c0b6680 0x7f278c0b8b90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.835+0000 7f27a8e6e640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27a4109df0 0x7f27a419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.835+0000 7f27a8e6e640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27a41094a0 0x7f27a419a990 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.835+0000 7f27a8e6e640 1 --2- 172.21.15.92:0/2426058468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4103b60 0x7f27a419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:59.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.835+0000 7f27a8e6e640 1 -- 172.21.15.92:0/2426058468 >> 172.21.15.92:0/2426058468 conn(0x7f27a407b850 msgr2=0x7f27a41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:59.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.835+0000 7f27a8e6e640 1 -- 172.21.15.92:0/2426058468 shutdown_connections 2024-09-21T07:21:59.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:21:59.835+0000 7f27a8e6e640 1 -- 172.21.15.92:0/2426058468 wait complete. 2024-09-21T07:22:00.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:21:59 smithi092 ceph-mon[30987]: pgmap v611: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:22:00.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:21:59 smithi169 ceph-mon[33705]: pgmap v611: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:22:00.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:21:59 smithi175 ceph-mon[34064]: pgmap v611: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:22:01.560 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:22:01.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:22:01.815 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:02.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:01 smithi169 ceph-mon[33705]: pgmap v612: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T07:22:02.202 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:01 smithi092 ceph-mon[30987]: pgmap v612: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T07:22:02.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:01 smithi175 ceph-mon[34064]: pgmap v612: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T07:22:02.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 -- 172.21.15.92:0/2337230006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3581094a0 msgr2=0x7fc3581098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 --2- 172.21.15.92:0/2337230006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3581094a0 0x7fc3581098b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc348009900 tx=0x7fc34802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 -- 172.21.15.92:0/2337230006 shutdown_connections 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 --2- 172.21.15.92:0/2337230006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358109df0 0x7fc358110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 --2- 172.21.15.92:0/2337230006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3581094a0 0x7fc3581098b0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 --2- 172.21.15.92:0/2337230006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc358103b60 0x7fc358103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 -- 172.21.15.92:0/2337230006 >> 172.21.15.92:0/2337230006 conn(0x7fc35807b850 msgr2=0x7fc35807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 -- 172.21.15.92:0/2337230006 shutdown_connections 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 -- 172.21.15.92:0/2337230006 wait complete. 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 Processor -- start 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.358+0000 7fc35f847640 1 -- start start 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35f847640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358103b60 0x7fc35819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35f847640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3581094a0 0x7fc35819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35f847640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358109df0 0x7fc35819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35f847640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc358113960 con 0x7fc358109df0 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35f847640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581137e0 con 0x7fc358103b60 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35f847640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc358113ae0 con 0x7fc3581094a0 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35dde4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358109df0 0x7fc35819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35dde4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358109df0 0x7fc35819fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56574/0 (socket says 172.21.15.92:56574) 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35dde4640 1 -- 172.21.15.92:0/844926618 learned_addr learned my addr 172.21.15.92:0/844926618 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358103b60 0x7fc35819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35cde2640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3581094a0 0x7fc35819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35dde4640 1 -- 172.21.15.92:0/844926618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3581094a0 msgr2=0x7fc35819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35dde4640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3581094a0 0x7fc35819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35dde4640 1 -- 172.21.15.92:0/844926618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358103b60 msgr2=0x7fc35819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35dde4640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358103b60 0x7fc35819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35dde4640 1 -- 172.21.15.92:0/844926618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3581a02c0 con 0x7fc358109df0 2024-09-21T07:22:02.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.359+0000 7fc35dde4640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358109df0 0x7fc35819fc50 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc35000cce0 tx=0x7fc35000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.360+0000 7fc34e7fc640 1 -- 172.21.15.92:0/844926618 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35000f450 con 0x7fc358109df0 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.360+0000 7fc34e7fc640 1 -- 172.21.15.92:0/844926618 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc35000fa80 con 0x7fc358109df0 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.360+0000 7fc35f847640 1 -- 172.21.15.92:0/844926618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3581a05b0 con 0x7fc358109df0 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.360+0000 7fc34e7fc640 1 -- 172.21.15.92:0/844926618 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350018ad0 con 0x7fc358109df0 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.360+0000 7fc35f847640 1 -- 172.21.15.92:0/844926618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3581a0a70 con 0x7fc358109df0 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc365dbb740 1 Processor -- start 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc34e7fc640 1 -- 172.21.15.92:0/844926618 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fc35000f5f0 con 0x7fc358109df0 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc365dbb740 1 -- start start 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 0x55851d4ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d102670 0x55851d4caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc365dbb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55851d440e60 con 0x55851d0fa490 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc365dbb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55851d430290 con 0x55851d123350 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc365dbb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55851d4340a0 con 0x55851d102670 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc35d5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc35d5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56584/0 (socket says 172.21.15.92:56584) 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.363+0000 7fc35d5e3640 1 -- 172.21.15.92:0/3994955442 learned_addr learned my addr 172.21.15.92:0/3994955442 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35cde2640 1 --2- 172.21.15.92:0/3994955442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 0x55851d4ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35cde2640 1 --2- 172.21.15.92:0/3994955442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d102670 0x55851d4caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35d5e3640 1 -- 172.21.15.92:0/3994955442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d102670 msgr2=0x55851d4caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/3994955442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d102670 0x55851d4caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35d5e3640 1 -- 172.21.15.92:0/3994955442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 msgr2=0x55851d4ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/3994955442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 0x55851d4ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35d5e3640 1 -- 172.21.15.92:0/3994955442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851d18e930 con 0x55851d0fa490 2024-09-21T07:22:02.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc34e7fc640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc3440b66b0 0x7fc3440b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35cde2640 1 --2- 172.21.15.92:0/3994955442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 0x55851d4ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35cde2640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc3440b66b0 0x7fc3440b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc34e7fc640 1 -- 172.21.15.92:0/844926618 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fc3500e82c0 con 0x7fc358109df0 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/3994955442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4ca970 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc35400b760 tx=0x7fc35400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc90c4cd1691e11c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc35cde2640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc3440b66b0 0x7fc3440b8bc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc3480057c0 tx=0x7fc348005a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.364+0000 7fc3437fe640 1 -- 172.21.15.92:0/3994955442 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354003dd0 con 0x55851d0fa490 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.365+0000 7fc3437fe640 1 -- 172.21.15.92:0/3994955442 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc354015070 con 0x55851d0fa490 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.365+0000 7fc3437fe640 1 -- 172.21.15.92:0/3994955442 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354004cc0 con 0x55851d0fa490 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.365+0000 7fc365dbb740 1 -- 172.21.15.92:0/3994955442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 msgr2=0x55851d4ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.365+0000 7fc365dbb740 1 --2- 172.21.15.92:0/3994955442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4ca970 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc35400b760 tx=0x7fc35400bc20 comp rx=0 tx=0).stop 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.366+0000 7fc365dbb740 1 -- 172.21.15.92:0/3994955442 shutdown_connections 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.366+0000 7fc365dbb740 1 --2- 172.21.15.92:0/3994955442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d102670 0x55851d4caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.366+0000 7fc365dbb740 1 --2- 172.21.15.92:0/3994955442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4ca970 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.366+0000 7fc365dbb740 1 --2- 172.21.15.92:0/3994955442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 0x55851d4ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.366+0000 7fc365dbb740 1 -- 172.21.15.92:0/3994955442 >> 172.21.15.92:0/3994955442 conn(0x55851d117740 msgr2=0x55851d4c8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.366+0000 7fc365dbb740 1 -- 172.21.15.92:0/3994955442 shutdown_connections 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.366+0000 7fc365dbb740 1 -- 172.21.15.92:0/3994955442 wait complete. 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.366+0000 7fc365dbb740 1 -- start start 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.366+0000 7fc365dbb740 1 Processor -- start 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4da3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 0x55851d4da920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d123350 0x55851d4e6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc365dbb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55851d291890 con 0x55851d0fa490 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc365dbb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55851d3cad40 con 0x55851d102670 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc365dbb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55851d4dcf40 con 0x55851d123350 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc365dbb740 10 client.0 _ll_register_callbacks cb 0x55851d42ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35d5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4da3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35d5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4da3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56588/0 (socket says 172.21.15.92:56588) 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35d5e3640 1 -- 172.21.15.92:0/1755624193 learned_addr learned my addr 172.21.15.92:0/1755624193 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35cde2640 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 0x55851d4da920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35dde4640 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d123350 0x55851d4e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35d5e3640 1 -- 172.21.15.92:0/1755624193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d123350 msgr2=0x55851d4e6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d123350 0x55851d4e6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35d5e3640 1 -- 172.21.15.92:0/1755624193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 msgr2=0x55851d4da920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 0x55851d4da920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35d5e3640 1 -- 172.21.15.92:0/1755624193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851d4e6830 con 0x55851d0fa490 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4da3e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fc354003e00 tx=0x7fc354003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52dcb86ae62d6b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc340ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc340ff9640 1 -- 172.21.15.92:0/1755624193 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354028060 con 0x55851d0fa490 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc340ff9640 1 -- 172.21.15.92:0/1755624193 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fc354011850 con 0x55851d0fa490 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.367+0000 7fc365dbb740 1 -- 172.21.15.92:0/1755624193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc354015070 con 0x55851d0fa490 2024-09-21T07:22:02.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc340ff9640 1 -- 172.21.15.92:0/1755624193 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc35402f050 con 0x55851d0fa490 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc365dbb740 10 client.18153 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc365dbb740 1 -- 172.21.15.92:0/1755624193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55851d4e9160 con 0x55851d0fa490 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc340ff9640 1 -- 172.21.15.92:0/1755624193 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc354015070 con 0x55851d0fa490 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc340ff9640 1 -- 172.21.15.92:0/1755624193 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc354022030 con 0x55851d0fa490 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc365dbb740 10 client.18153 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc365dbb740 10 client.18153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc365dbb740 20 client.18153 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc365dbb740 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55851d0e1cd0 0x55851d4ec570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc365dbb740 4 client.18153 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc365dbb740 1 -- 172.21.15.92:0/1755624193 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55851d442db0 con 0x55851d0e1cd0 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.368+0000 7fc35cde2640 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55851d0e1cd0 0x55851d4ec570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.369+0000 7fc35cde2640 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55851d0e1cd0 0x55851d4ec570 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf9da4898ec6ffa2 server_cookie=a67a38252a11e1a6 in_seq=0 out_seq=0 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.369+0000 7fc340ff9640 10 client.18153 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:02.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.369+0000 7fc340ff9640 1 -- 172.21.15.92:0/1755624193 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55851d442db0 con 0x55851d0e1cd0 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.369+0000 7fc340ff9640 10 client.18153 handle_command_reply: tid=0 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.369+0000 7fc365dbb740 1 client.18153 shutdown 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.369+0000 7fc365dbb740 1 -- 172.21.15.92:0/1755624193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 msgr2=0x55851d4da3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.369+0000 7fc365dbb740 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4da3e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fc354003e00 tx=0x7fc354003e30 comp rx=0 tx=0).stop 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.370+0000 7fc365dbb740 1 -- 172.21.15.92:0/1755624193 shutdown_connections 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.370+0000 7fc365dbb740 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55851d0e1cd0 0x55851d4ec570 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.370+0000 7fc365dbb740 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d123350 0x55851d4e6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.370+0000 7fc340ff9640 0 client.18153 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.370+0000 7fc365dbb740 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 0x55851d4da920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.370+0000 7fc365dbb740 1 --2- 172.21.15.92:0/1755624193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4da3e0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.370+0000 7fc365dbb740 1 -- 172.21.15.92:0/1755624193 >> 172.21.15.92:0/1755624193 conn(0x55851d117740 msgr2=0x55851d4c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.370+0000 7fc365dbb740 1 -- 172.21.15.92:0/1755624193 shutdown_connections 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.370+0000 7fc365dbb740 1 -- 172.21.15.92:0/1755624193 wait complete. 2024-09-21T07:22:02.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.370+0000 7fc365dbb740 20 client.18153 trim_cache size 0 max 16384 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc365dbb740 1 Processor -- start 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc365dbb740 1 -- start start 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d0fa490 0x55851d4e61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 0x55851d4c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d123350 0x55851d4c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc365dbb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581aec50 con 0x55851d123350 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc365dbb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581b0790 con 0x55851d102670 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc365dbb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581af320 con 0x55851d0fa490 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc35dde4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d123350 0x55851d4c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc35dde4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d123350 0x55851d4c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56596/0 (socket says 172.21.15.92:56596) 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.387+0000 7fc35dde4640 1 -- 172.21.15.92:0/3208232238 learned_addr learned my addr 172.21.15.92:0/3208232238 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d0fa490 0x55851d4e61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc35dde4640 1 -- 172.21.15.92:0/3208232238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d0fa490 msgr2=0x55851d4e61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:02.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc35cde2640 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 0x55851d4c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc35dde4640 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d0fa490 0x55851d4e61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc35dde4640 1 -- 172.21.15.92:0/3208232238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 msgr2=0x55851d4c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc35dde4640 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 0x55851d4c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc35dde4640 1 -- 172.21.15.92:0/3208232238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851d4d5a70 con 0x55851d123350 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d0fa490 0x55851d4e61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc35cde2640 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 0x55851d4c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc35dde4640 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d123350 0x55851d4c6d90 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fc3500e5670 tx=0x7fc3500ad480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7979c79b6e5a0a4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc342ffd640 1 -- 172.21.15.92:0/3208232238 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500ae410 con 0x55851d123350 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc342ffd640 1 -- 172.21.15.92:0/3208232238 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3500b2030 con 0x55851d123350 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.388+0000 7fc342ffd640 1 -- 172.21.15.92:0/3208232238 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500d10b0 con 0x55851d123350 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 -- 172.21.15.92:0/3208232238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d123350 msgr2=0x55851d4c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d123350 0x55851d4c6d90 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fc3500e5670 tx=0x7fc3500ad480 comp rx=0 tx=0).stop 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 -- 172.21.15.92:0/3208232238 shutdown_connections 2024-09-21T07:22:02.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d123350 0x55851d4c6d90 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d102670 0x55851d4c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 --2- 172.21.15.92:0/3208232238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d0fa490 0x55851d4e61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 -- 172.21.15.92:0/3208232238 >> 172.21.15.92:0/3208232238 conn(0x55851d117740 msgr2=0x55851d4d8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 -- 172.21.15.92:0/3208232238 shutdown_connections 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 -- 172.21.15.92:0/3208232238 wait complete. 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 -- start start 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.389+0000 7fc365dbb740 1 Processor -- start 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4edf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d102670 0x55851d4ee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc365dbb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 0x55851d54fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc365dbb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581b00c0 con 0x55851d0fa490 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc365dbb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581af9f0 con 0x55851d123350 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc365dbb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581acc50 con 0x55851d102670 2024-09-21T07:22:02.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc365dbb740 10 client.0 _ll_register_callbacks cb 0x7fc354004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35d5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35d5e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4edf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56598/0 (socket says 172.21.15.92:56598) 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35d5e3640 1 -- 172.21.15.92:0/2919014146 learned_addr learned my addr 172.21.15.92:0/2919014146 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35cde2640 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d102670 0x55851d4ee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35dde4640 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 0x55851d54fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35d5e3640 1 -- 172.21.15.92:0/2919014146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d102670 msgr2=0x55851d4ee4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d102670 0x55851d4ee4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35d5e3640 1 -- 172.21.15.92:0/2919014146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 msgr2=0x55851d54fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 0x55851d54fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35d5e3640 1 -- 172.21.15.92:0/2919014146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851d5503a0 con 0x55851d0fa490 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc35d5e3640 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4edf50 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fc354004330 tx=0x7fc35400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f9f79805f8984 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc340ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.390+0000 7fc340ff9640 1 -- 172.21.15.92:0/2919014146 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354028050 con 0x55851d0fa490 2024-09-21T07:22:02.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc340ff9640 1 -- 172.21.15.92:0/2919014146 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fc354003ea0 con 0x55851d0fa490 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc365dbb740 1 -- 172.21.15.92:0/2919014146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3500b2030 con 0x55851d0fa490 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc340ff9640 1 -- 172.21.15.92:0/2919014146 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc354040050 con 0x55851d0fa490 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc365dbb740 10 client.18159 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc365dbb740 1 -- 172.21.15.92:0/2919014146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55851d5575e0 con 0x55851d0fa490 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc340ff9640 1 -- 172.21.15.92:0/2919014146 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3500b2030 con 0x55851d0fa490 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc340ff9640 1 -- 172.21.15.92:0/2919014146 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc35403b030 con 0x55851d0fa490 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc365dbb740 10 client.18159 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc365dbb740 10 client.18159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc365dbb740 20 client.18159 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc365dbb740 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55851d0b7080 0x55851d559d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc365dbb740 4 client.18159 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc365dbb740 1 -- 172.21.15.92:0/2919014146 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55851d43e860 con 0x55851d0b7080 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.391+0000 7fc35cde2640 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55851d0b7080 0x55851d559d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:02.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.392+0000 7fc35cde2640 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55851d0b7080 0x55851d559d60 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be9239d169ddbbba server_cookie=3e6eb469b25327fb in_seq=0 out_seq=0 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.392+0000 7fc340ff9640 10 client.18159 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc340ff9640 1 -- 172.21.15.92:0/2919014146 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55851d43e860 con 0x55851d0b7080 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc340ff9640 10 client.18159 handle_command_reply: tid=0 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc365dbb740 1 client.18159 shutdown 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc365dbb740 1 -- 172.21.15.92:0/2919014146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 msgr2=0x55851d4edf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc365dbb740 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4edf50 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fc354004330 tx=0x7fc35400b670 comp rx=0 tx=0).stop 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc365dbb740 1 -- 172.21.15.92:0/2919014146 shutdown_connections 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc365dbb740 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55851d0b7080 0x55851d559d60 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc365dbb740 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55851d123350 0x55851d54fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc365dbb740 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55851d102670 0x55851d4ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc365dbb740 1 --2- 172.21.15.92:0/2919014146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55851d0fa490 0x55851d4edf50 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.460 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:22:02.460 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:22:02.460 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "43824538-18e3-40c5-b1a4-5cf927a6fc24", 2024-09-21T07:22:02.460 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:22:02.460 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:22:02.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc365dbb740 1 -- 172.21.15.92:0/2919014146 >> 172.21.15.92:0/2919014146 conn(0x55851d117740 msgr2=0x55851d4cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:02.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.393+0000 7fc340ff9640 0 client.18159 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:02.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc365dbb740 1 -- 172.21.15.92:0/2919014146 shutdown_connections 2024-09-21T07:22:02.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc365dbb740 1 -- 172.21.15.92:0/2919014146 wait complete. 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc365dbb740 20 client.18159 trim_cache size 0 max 16384 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc35f847640 1 -- 172.21.15.92:0/844926618 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc3440b66b0 msgr2=0x7fc3440b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc35f847640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc3440b66b0 0x7fc3440b8bc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc3480057c0 tx=0x7fc348005a40 comp rx=0 tx=0).stop 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc35f847640 1 -- 172.21.15.92:0/844926618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358109df0 msgr2=0x7fc35819fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc35f847640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358109df0 0x7fc35819fc50 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc35000cce0 tx=0x7fc35000a620 comp rx=0 tx=0).stop 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc35f847640 1 -- 172.21.15.92:0/844926618 shutdown_connections 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc35f847640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc3440b66b0 0x7fc3440b8bc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc35f847640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358109df0 0x7fc35819fc50 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc35f847640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3581094a0 0x7fc35819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.394+0000 7fc35f847640 1 --2- 172.21.15.92:0/844926618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358103b60 0x7fc35819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.395+0000 7fc35f847640 1 -- 172.21.15.92:0/844926618 >> 172.21.15.92:0/844926618 conn(0x7fc35807b850 msgr2=0x7fc3581055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.395+0000 7fc35f847640 1 -- 172.21.15.92:0/844926618 shutdown_connections 2024-09-21T07:22:02.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:02.395+0000 7fc35f847640 1 -- 172.21.15.92:0/844926618 wait complete. 2024-09-21T07:22:03.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:02 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:22:03.130 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:22:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:02 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:22:03.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:02 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:22:03.387 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.850+0000 7fbc8aeed640 1 -- 172.21.15.92:0/674055239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc841083a0 msgr2=0x7fbc841087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.850+0000 7fbc8aeed640 1 --2- 172.21.15.92:0/674055239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc841083a0 0x7fbc841087b0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009900 tx=0x7fbc7402a410 comp rx=0 tx=0).stop 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.850+0000 7fbc8aeed640 1 -- 172.21.15.92:0/674055239 shutdown_connections 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.850+0000 7fbc8aeed640 1 --2- 172.21.15.92:0/674055239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc84108cf0 0x7fbc8410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.850+0000 7fbc8aeed640 1 --2- 172.21.15.92:0/674055239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc841083a0 0x7fbc841087b0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.850+0000 7fbc8aeed640 1 --2- 172.21.15.92:0/674055239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc84102a60 0x7fbc84102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.850+0000 7fbc8aeed640 1 -- 172.21.15.92:0/674055239 >> 172.21.15.92:0/674055239 conn(0x7fbc84079730 msgr2=0x7fbc84079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.850+0000 7fbc8aeed640 1 -- 172.21.15.92:0/674055239 shutdown_connections 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.850+0000 7fbc8aeed640 1 -- 172.21.15.92:0/674055239 wait complete. 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc8aeed640 1 Processor -- start 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc8aeed640 1 -- start start 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc8aeed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc84102a60 0x7fbc84199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc8aeed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc841083a0 0x7fbc841998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc8aeed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc84108cf0 0x7fbc8419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc8aeed640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84112850 con 0x7fbc84102a60 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc8aeed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841126d0 con 0x7fbc841083a0 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc8aeed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841129d0 con 0x7fbc84108cf0 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc88c89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc84102a60 0x7fbc84199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc88c89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc84102a60 0x7fbc84199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56612/0 (socket says 172.21.15.92:56612) 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.851+0000 7fbc88c89640 1 -- 172.21.15.92:0/995080835 learned_addr learned my addr 172.21.15.92:0/995080835 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc88c89640 1 -- 172.21.15.92:0/995080835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc84108cf0 msgr2=0x7fbc8419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc88c89640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc84108cf0 0x7fbc8419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc841083a0 0x7fbc841998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc88c89640 1 -- 172.21.15.92:0/995080835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc841083a0 msgr2=0x7fbc841998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc88c89640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc841083a0 0x7fbc841998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc88c89640 1 -- 172.21.15.92:0/995080835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8419f290 con 0x7fbc84102a60 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc841083a0 0x7fbc841998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc88c89640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc84102a60 0x7fbc84199320 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000b4a0 tx=0x7fbc8000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:03.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc79ffb640 1 -- 172.21.15.92:0/995080835 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80014070 con 0x7fbc84102a60 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc79ffb640 1 -- 172.21.15.92:0/995080835 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc80010aa0 con 0x7fbc84102a60 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc8aeed640 1 -- 172.21.15.92:0/995080835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8419f580 con 0x7fbc84102a60 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc79ffb640 1 -- 172.21.15.92:0/995080835 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80017b70 con 0x7fbc84102a60 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.852+0000 7fbc8aeed640 1 -- 172.21.15.92:0/995080835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc841a5d60 con 0x7fbc84102a60 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc79ffb640 1 -- 172.21.15.92:0/995080835 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fbc80017070 con 0x7fbc84102a60 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc91461740 1 Processor -- start 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc91461740 1 -- start start 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc91461740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55796887a070 0x557968c21650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc91461740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579688511b0 0x557968c21b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc91461740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c220d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc91461740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557968b97e50 con 0x557968859390 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc91461740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557968b87280 con 0x5579688511b0 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc91461740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557968b8b090 con 0x55796887a070 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc79ffb640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc6c0b6700 0x7fbc6c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc7bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc7bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c220d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56626/0 (socket says 172.21.15.92:56626) 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.855+0000 7fbc7bfff640 1 -- 172.21.15.92:0/1737172945 learned_addr learned my addr 172.21.15.92:0/1737172945 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc88c89640 1 --2- 172.21.15.92:0/1737172945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579688511b0 0x557968c21b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc8948a640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc6c0b6700 0x7fbc6c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc8948a640 1 --2- 172.21.15.92:0/1737172945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55796887a070 0x557968c21650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc79ffb640 1 -- 172.21.15.92:0/995080835 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fbc800e7130 con 0x7fbc84102a60 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc7bfff640 1 -- 172.21.15.92:0/1737172945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55796887a070 msgr2=0x557968c21650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/1737172945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55796887a070 0x557968c21650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc7bfff640 1 -- 172.21.15.92:0/1737172945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579688511b0 msgr2=0x557968c21b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/1737172945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579688511b0 0x557968c21b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc7bfff640 1 -- 172.21.15.92:0/1737172945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579688e5650 con 0x557968859390 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc88c89640 1 --2- 172.21.15.92:0/1737172945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579688511b0 0x557968c21b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:03.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/1737172945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c220d0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fbc74033000 tx=0x7fbc74032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bd3d84813260ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc8948a640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc6c0b6700 0x7fbc6c0b8c10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c013640 tx=0x7fbc7c009280 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc6affd640 1 -- 172.21.15.92:0/1737172945 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7403f070 con 0x557968859390 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc6affd640 1 -- 172.21.15.92:0/1737172945 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc740044c0 con 0x557968859390 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.856+0000 7fbc6affd640 1 -- 172.21.15.92:0/1737172945 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74035070 con 0x557968859390 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.857+0000 7fbc91461740 1 -- 172.21.15.92:0/1737172945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 msgr2=0x557968c220d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.857+0000 7fbc91461740 1 --2- 172.21.15.92:0/1737172945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c220d0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fbc74033000 tx=0x7fbc74032dd0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.857+0000 7fbc91461740 1 -- 172.21.15.92:0/1737172945 shutdown_connections 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.857+0000 7fbc91461740 1 --2- 172.21.15.92:0/1737172945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c220d0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.857+0000 7fbc91461740 1 --2- 172.21.15.92:0/1737172945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579688511b0 0x557968c21b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.857+0000 7fbc91461740 1 --2- 172.21.15.92:0/1737172945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55796887a070 0x557968c21650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.857+0000 7fbc91461740 1 -- 172.21.15.92:0/1737172945 >> 172.21.15.92:0/1737172945 conn(0x55796886e460 msgr2=0x557968c1f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.857+0000 7fbc91461740 1 -- 172.21.15.92:0/1737172945 shutdown_connections 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.857+0000 7fbc91461740 1 -- 172.21.15.92:0/1737172945 wait complete. 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.857+0000 7fbc91461740 1 -- start start 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc91461740 1 Processor -- start 2024-09-21T07:22:03.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc91461740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968c2cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc91461740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 0x557968c2d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc91461740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c2d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc91461740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5579689e8700 con 0x55796887a070 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc91461740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557968b22110 con 0x557968859390 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc91461740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557968c31fe0 con 0x5579688511b0 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc91461740 10 client.0 _ll_register_callbacks cb 0x557968b3b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc8948a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c2d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc8948a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c2d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56630/0 (socket says 172.21.15.92:56630) 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc8948a640 1 -- 172.21.15.92:0/3277022424 learned_addr learned my addr 172.21.15.92:0/3277022424 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc88c89640 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968c2cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.858+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 0x557968c2d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc8948a640 1 -- 172.21.15.92:0/3277022424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 msgr2=0x557968c2cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc8948a640 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968c2cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc8948a640 1 -- 172.21.15.92:0/3277022424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 msgr2=0x557968c2d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc8948a640 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 0x557968c2d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc8948a640 1 -- 172.21.15.92:0/3277022424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557968b4fc40 con 0x55796887a070 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 0x557968c2d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc8948a640 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c2d6d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00f680 tx=0x7fbc7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc054f74113569d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc63fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc63fff640 1 -- 172.21.15.92:0/3277022424 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c023070 con 0x55796887a070 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc91461740 1 -- 172.21.15.92:0/3277022424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557968b99da0 con 0x55796887a070 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc63fff640 1 -- 172.21.15.92:0/3277022424 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fbc7c003b70 con 0x55796887a070 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc63fff640 1 -- 172.21.15.92:0/3277022424 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc7c003d70 con 0x55796887a070 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc91461740 10 client.18171 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc91461740 1 -- 172.21.15.92:0/3277022424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557968c3dbd0 con 0x55796887a070 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.859+0000 7fbc63fff640 1 -- 172.21.15.92:0/3277022424 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557968b99da0 con 0x55796887a070 2024-09-21T07:22:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.860+0000 7fbc63fff640 1 -- 172.21.15.92:0/3277022424 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbc7c00f040 con 0x55796887a070 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.860+0000 7fbc91461740 10 client.18171 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.860+0000 7fbc91461740 10 client.18171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.860+0000 7fbc91461740 20 client.18171 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.860+0000 7fbc91461740 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5579688389f0 0x557968c410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.860+0000 7fbc91461740 4 client.18171 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.860+0000 7fbc91461740 1 -- 172.21.15.92:0/3277022424 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557968b95850 con 0x5579688389f0 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.860+0000 7fbc88c89640 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5579688389f0 0x557968c410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.860+0000 7fbc63fff640 10 client.18171 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.860+0000 7fbc88c89640 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5579688389f0 0x557968c410e0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28c12ae5a0ca83f1 server_cookie=94b870935eee693b in_seq=0 out_seq=0 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc63fff640 1 -- 172.21.15.92:0/3277022424 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557968b95850 con 0x5579688389f0 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc63fff640 10 client.18171 handle_command_reply: tid=0 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc91461740 1 client.18171 shutdown 2024-09-21T07:22:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc91461740 1 -- 172.21.15.92:0/3277022424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 msgr2=0x557968c2d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc91461740 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c2d6d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00f680 tx=0x7fbc7c004a40 comp rx=0 tx=0).stop 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc91461740 1 -- 172.21.15.92:0/3277022424 shutdown_connections 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc91461740 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x5579688389f0 0x557968c410e0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc91461740 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c2d6d0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc91461740 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 0x557968c2d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc63fff640 0 client.18171 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc91461740 1 --2- 172.21.15.92:0/3277022424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968c2cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.861+0000 7fbc91461740 1 -- 172.21.15.92:0/3277022424 >> 172.21.15.92:0/3277022424 conn(0x55796886e460 msgr2=0x557968c247e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.862+0000 7fbc91461740 1 -- 172.21.15.92:0/3277022424 shutdown_connections 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.862+0000 7fbc91461740 1 -- 172.21.15.92:0/3277022424 wait complete. 2024-09-21T07:22:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.862+0000 7fbc91461740 20 client.18171 trim_cache size 0 max 16384 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.879+0000 7fbc91461740 1 Processor -- start 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc91461740 1 -- start start 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc91461740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968c2ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc91461740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 0x557968c22ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc91461740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c24e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc91461740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841aee80 con 0x55796887a070 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc91461740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841b09c0 con 0x557968859390 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc91461740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841af550 con 0x5579688511b0 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc8948a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c24e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc8948a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c24e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56640/0 (socket says 172.21.15.92:56640) 2024-09-21T07:22:03.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc8948a640 1 -- 172.21.15.92:0/2181109259 learned_addr learned my addr 172.21.15.92:0/2181109259 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/2181109259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 0x557968c22ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc88c89640 1 --2- 172.21.15.92:0/2181109259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968c2ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc8948a640 1 -- 172.21.15.92:0/2181109259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 msgr2=0x557968c2ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc8948a640 1 --2- 172.21.15.92:0/2181109259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968c2ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc8948a640 1 -- 172.21.15.92:0/2181109259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 msgr2=0x557968c22ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc8948a640 1 --2- 172.21.15.92:0/2181109259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 0x557968c22ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.880+0000 7fbc8948a640 1 -- 172.21.15.92:0/2181109259 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557968c2f390 con 0x55796887a070 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.881+0000 7fbc8948a640 1 --2- 172.21.15.92:0/2181109259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c24e60 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c000f80 tx=0x7fbc7c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5dea3aec0214974 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.881+0000 7fbc6a7fc640 1 -- 172.21.15.92:0/2181109259 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c037070 con 0x55796887a070 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.881+0000 7fbc6a7fc640 1 -- 172.21.15.92:0/2181109259 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc7c019040 con 0x55796887a070 2024-09-21T07:22:03.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.881+0000 7fbc6a7fc640 1 -- 172.21.15.92:0/2181109259 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c023070 con 0x55796887a070 2024-09-21T07:22:03.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 -- 172.21.15.92:0/2181109259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 msgr2=0x557968c24e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:03.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 --2- 172.21.15.92:0/2181109259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c24e60 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c000f80 tx=0x7fbc7c009610 comp rx=0 tx=0).stop 2024-09-21T07:22:03.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 -- 172.21.15.92:0/2181109259 shutdown_connections 2024-09-21T07:22:03.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 --2- 172.21.15.92:0/2181109259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55796887a070 0x557968c24e60 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 --2- 172.21.15.92:0/2181109259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557968859390 0x557968c22ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 --2- 172.21.15.92:0/2181109259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968c2ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 -- 172.21.15.92:0/2181109259 >> 172.21.15.92:0/2181109259 conn(0x55796886e460 msgr2=0x557968c24750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 -- 172.21.15.92:0/2181109259 shutdown_connections 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 -- 172.21.15.92:0/2181109259 wait complete. 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 -- start start 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.882+0000 7fbc91461740 1 Processor -- start 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc91461740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968ca74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc91461740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c37250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc91461740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55796887a070 0x557968c37960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc91461740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841b02f0 con 0x557968859390 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc91461740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841afc20 con 0x55796887a070 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc91461740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841ace80 con 0x5579688511b0 2024-09-21T07:22:03.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc91461740 10 client.0 _ll_register_callbacks cb 0x7fbc7c009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc7bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c37250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc7bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c37250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56648/0 (socket says 172.21.15.92:56648) 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc7bfff640 1 -- 172.21.15.92:0/2362291981 learned_addr learned my addr 172.21.15.92:0/2362291981 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc8948a640 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55796887a070 0x557968c37960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc88c89640 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968ca74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc7bfff640 1 -- 172.21.15.92:0/2362291981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 msgr2=0x557968ca74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968ca74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc7bfff640 1 -- 172.21.15.92:0/2362291981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55796887a070 msgr2=0x557968c37960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55796887a070 0x557968c37960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc7bfff640 1 -- 172.21.15.92:0/2362291981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557968c30c40 con 0x557968859390 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc8948a640 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55796887a070 0x557968c37960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc7bfff640 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c37250 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fbc740057c0 tx=0x7fbc74031e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd9c56070f6d309 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc63fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:03.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.883+0000 7fbc63fff640 1 -- 172.21.15.92:0/2362291981 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74035070 con 0x557968859390 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc63fff640 1 -- 172.21.15.92:0/2362291981 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9540+0+0 (secure 0 0 0) 0x7fbc74005030 con 0x557968859390 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc91461740 1 -- 172.21.15.92:0/2362291981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc7c019040 con 0x557968859390 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc63fff640 1 -- 172.21.15.92:0/2362291981 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc74056050 con 0x557968859390 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc91461740 10 client.18177 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc91461740 1 -- 172.21.15.92:0/2362291981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557968cae070 con 0x557968859390 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc63fff640 1 -- 172.21.15.92:0/2362291981 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc7c019040 con 0x557968859390 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc63fff640 1 -- 172.21.15.92:0/2362291981 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbc74004c30 con 0x557968859390 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc91461740 10 client.18177 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc91461740 10 client.18177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc91461740 20 client.18177 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc91461740 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55796880dda0 0x557968cb03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc91461740 4 client.18177 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:22:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.884+0000 7fbc91461740 1 -- 172.21.15.92:0/2362291981 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557968b92c80 con 0x55796880dda0 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.885+0000 7fbc88c89640 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55796880dda0 0x557968cb03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.885+0000 7fbc63fff640 10 client.18177 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.885+0000 7fbc88c89640 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55796880dda0 0x557968cb03e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce2116bd0436ad8f server_cookie=c84da0ef9fce71ae in_seq=0 out_seq=0 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.885+0000 7fbc63fff640 1 -- 172.21.15.92:0/2362291981 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x557968b92c80 con 0x55796880dda0 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.885+0000 7fbc63fff640 10 client.18177 handle_command_reply: tid=0 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.885+0000 7fbc91461740 1 client.18177 shutdown 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.885+0000 7fbc91461740 1 -- 172.21.15.92:0/2362291981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 msgr2=0x557968c37250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.885+0000 7fbc91461740 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c37250 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fbc740057c0 tx=0x7fbc74031e40 comp rx=0 tx=0).stop 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc91461740 1 -- 172.21.15.92:0/2362291981 shutdown_connections 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc91461740 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55796880dda0 0x557968cb03e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc63fff640 0 client.18177 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc91461740 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55796887a070 0x557968c37960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc91461740 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557968859390 0x557968c37250 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc91461740 1 --2- 172.21.15.92:0/2362291981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579688511b0 0x557968ca74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc91461740 1 -- 172.21.15.92:0/2362291981 >> 172.21.15.92:0/2362291981 conn(0x55796886e460 msgr2=0x557968c25110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc91461740 1 -- 172.21.15.92:0/2362291981 shutdown_connections 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc91461740 1 -- 172.21.15.92:0/2362291981 wait complete. 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc91461740 20 client.18177 trim_cache size 0 max 16384 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:22:03.893 INFO:teuthology.orchestra.run.smithi092.stdout: "43824538-18e3-40c5-b1a4-5cf927a6fc24": { 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "43824538-18e3-40c5-b1a4-5cf927a6fc24", 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: "9d9b4374-4159-4e71-99a9-ab660a57d3cf": { 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:02.785673+0000", 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.894 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:22:03.895 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "3b742b30-fd49-4ec5-844d-6cfbec3bbf45": { 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:48.290915+0000", 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "43824538-18e3-40c5-b1a4-5cf927a6fc24": { 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:22:02.392681+0000", 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.897 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "68bc1b81-ff26-4d23-bedd-ea1f5bf7ce64": { 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:48.714909+0000", 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:22:03.898 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:22:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:02.985669+0000", 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.900 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:03.902 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:03.902 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:22:03.902 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:22:03.902 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:22:03.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc8aeed640 1 -- 172.21.15.92:0/995080835 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc6c0b6700 msgr2=0x7fbc6c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc8aeed640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc6c0b6700 0x7fbc6c0b8c10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c013640 tx=0x7fbc7c009280 comp rx=0 tx=0).stop 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc8aeed640 1 -- 172.21.15.92:0/995080835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc84102a60 msgr2=0x7fbc84199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.886+0000 7fbc8aeed640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc84102a60 0x7fbc84199320 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000b4a0 tx=0x7fbc8000b960 comp rx=0 tx=0).stop 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.887+0000 7fbc8aeed640 1 -- 172.21.15.92:0/995080835 shutdown_connections 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.887+0000 7fbc8aeed640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc6c0b6700 0x7fbc6c0b8c10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.887+0000 7fbc8aeed640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc84108cf0 0x7fbc8419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.887+0000 7fbc8aeed640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc841083a0 0x7fbc841998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.887+0000 7fbc8aeed640 1 --2- 172.21.15.92:0/995080835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc84102a60 0x7fbc84199320 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.887+0000 7fbc8aeed640 1 -- 172.21.15.92:0/995080835 >> 172.21.15.92:0/995080835 conn(0x7fbc84079730 msgr2=0x7fbc841052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.887+0000 7fbc8aeed640 1 -- 172.21.15.92:0/995080835 shutdown_connections 2024-09-21T07:22:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:03.887+0000 7fbc8aeed640 1 -- 172.21.15.92:0/995080835 wait complete. 2024-09-21T07:22:04.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:03 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:22:04.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:03 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:04.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:03 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:22:04.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:03 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:04.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:22:04.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:22:04.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:22:04.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:03 smithi092 ceph-mon[30987]: pgmap v613: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:22:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:03 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:22:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:03 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:03 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:22:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:03 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:22:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:22:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:22:04.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:03 smithi169 ceph-mon[33705]: pgmap v613: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:22:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:03 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:22:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:03 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:03 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:22:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:03 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:22:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:22:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:22:04.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:03 smithi175 ceph-mon[34064]: pgmap v613: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:22:04.701 INFO:tasks.cephfs.filesystem:scrub status for tag:43824538-18e3-40c5-b1a4-5cf927a6fc24 - {'path': '/', 'tag': '43824538-18e3-40c5-b1a4-5cf927a6fc24', 'options': 'recursive,force'} 2024-09-21T07:22:05.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:05 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:22:05.645 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:05 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:22:05.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:05 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:22:06.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:06 smithi092 ceph-mon[30987]: pgmap v614: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T07:22:06.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:06 smithi169 ceph-mon[33705]: pgmap v614: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T07:22:06.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:06 smithi175 ceph-mon[34064]: pgmap v614: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T07:22:08.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:07 smithi169 ceph-mon[33705]: pgmap v615: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-21T07:22:08.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:07 smithi175 ceph-mon[34064]: pgmap v615: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-21T07:22:08.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:07 smithi092 ceph-mon[30987]: pgmap v615: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-21T07:22:10.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:09 smithi169 ceph-mon[33705]: pgmap v616: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T07:22:10.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:09 smithi175 ceph-mon[34064]: pgmap v616: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T07:22:10.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:09 smithi092 ceph-mon[30987]: pgmap v616: 129 pgs: 129 active+clean; 9.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T07:22:11.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:10 smithi175 ceph-mon[34064]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T07:22:11.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:10 smithi092 ceph-mon[30987]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T07:22:11.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:10 smithi169 ceph-mon[33705]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T07:22:12.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:11 smithi175 ceph-mon[34064]: pgmap v618: 129 pgs: 129 active+clean; 9.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-21T07:22:12.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:11 smithi092 ceph-mon[30987]: pgmap v618: 129 pgs: 129 active+clean; 9.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-21T07:22:12.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:11 smithi169 ceph-mon[33705]: pgmap v618: 129 pgs: 129 active+clean; 9.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-21T07:22:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:13 smithi169 ceph-mon[33705]: pgmap v619: 129 pgs: 129 active+clean; 8.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T07:22:14.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:13 smithi175 ceph-mon[34064]: pgmap v619: 129 pgs: 129 active+clean; 8.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T07:22:14.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:13 smithi092 ceph-mon[30987]: pgmap v619: 129 pgs: 129 active+clean; 8.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T07:22:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:15 smithi169 ceph-mon[33705]: pgmap v620: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:22:16.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:15 smithi175 ceph-mon[34064]: pgmap v620: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:22:16.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:15 smithi092 ceph-mon[30987]: pgmap v620: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:22:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:17 smithi169 ceph-mon[33705]: pgmap v621: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:22:18.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:17 smithi175 ceph-mon[34064]: pgmap v621: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:22:18.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:17 smithi092 ceph-mon[30987]: pgmap v621: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:22:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:20 smithi175 ceph-mon[34064]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T07:22:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:20 smithi175 ceph-mon[34064]: pgmap v623: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2024-09-21T07:22:20.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:20 smithi092 ceph-mon[30987]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T07:22:20.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:20 smithi092 ceph-mon[30987]: pgmap v623: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2024-09-21T07:22:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:20 smithi169 ceph-mon[33705]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T07:22:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:20 smithi169 ceph-mon[33705]: pgmap v623: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2024-09-21T07:22:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:21 smithi169 ceph-mon[33705]: pgmap v624: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:22:22.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:21 smithi175 ceph-mon[34064]: pgmap v624: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:22:22.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:21 smithi092 ceph-mon[30987]: pgmap v624: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:22:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:23 smithi169 ceph-mon[33705]: pgmap v625: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:22:24.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:23 smithi175 ceph-mon[34064]: pgmap v625: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:22:24.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:23 smithi092 ceph-mon[30987]: pgmap v625: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:22:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:25 smithi169 ceph-mon[33705]: pgmap v626: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:22:26.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:25 smithi175 ceph-mon[34064]: pgmap v626: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:22:26.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:25 smithi092 ceph-mon[30987]: pgmap v626: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:22:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:27 smithi169 ceph-mon[33705]: pgmap v627: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:22:28.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:27 smithi175 ceph-mon[34064]: pgmap v627: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:22:28.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:27 smithi092 ceph-mon[30987]: pgmap v627: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:22:30.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:30 smithi175 ceph-mon[34064]: pgmap v628: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T07:22:30.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:30 smithi092 ceph-mon[30987]: pgmap v628: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T07:22:30.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:30 smithi169 ceph-mon[33705]: pgmap v628: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T07:22:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:31 smithi169 ceph-mon[33705]: pgmap v629: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:22:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:31 smithi175 ceph-mon[34064]: pgmap v629: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:22:32.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:31 smithi092 ceph-mon[30987]: pgmap v629: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:22:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:33 smithi169 ceph-mon[33705]: pgmap v630: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:22:34.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:33 smithi175 ceph-mon[34064]: pgmap v630: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:22:34.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:33 smithi092 ceph-mon[30987]: pgmap v630: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:22:34.702 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:22:34.961 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:35.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.434+0000 7f8dffcb3640 1 -- 172.21.15.92:0/3726399826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8df81083a0 msgr2=0x7f8df81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.434+0000 7f8dffcb3640 1 --2- 172.21.15.92:0/3726399826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8df81083a0 0x7f8df81087b0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f8dec009900 tx=0x7f8dec02a410 comp rx=0 tx=0).stop 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.434+0000 7f8dffcb3640 1 -- 172.21.15.92:0/3726399826 shutdown_connections 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.434+0000 7f8dffcb3640 1 --2- 172.21.15.92:0/3726399826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df8108cf0 0x7f8df810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.434+0000 7f8dffcb3640 1 --2- 172.21.15.92:0/3726399826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8df81083a0 0x7f8df81087b0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.434+0000 7f8dffcb3640 1 --2- 172.21.15.92:0/3726399826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df8102a60 0x7f8df8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.434+0000 7f8dffcb3640 1 -- 172.21.15.92:0/3726399826 >> 172.21.15.92:0/3726399826 conn(0x7f8df8079730 msgr2=0x7f8df8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.434+0000 7f8dffcb3640 1 -- 172.21.15.92:0/3726399826 shutdown_connections 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.434+0000 7f8dffcb3640 1 -- 172.21.15.92:0/3726399826 wait complete. 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dffcb3640 1 Processor -- start 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dffcb3640 1 -- start start 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dffcb3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8df8102a60 0x7f8df819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dffcb3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df81083a0 0x7f8df819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dffcb3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df8108cf0 0x7f8df819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dffcb3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8df8112810 con 0x7f8df8102a60 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dffcb3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8df8112690 con 0x7f8df81083a0 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dffcb3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8df8112990 con 0x7f8df8108cf0 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dfda4f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8df8102a60 0x7f8df819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dfda4f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8df8102a60 0x7f8df819b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40042/0 (socket says 172.21.15.92:40042) 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dfda4f640 1 -- 172.21.15.92:0/1756997946 learned_addr learned my addr 172.21.15.92:0/1756997946 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df81083a0 0x7f8df819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.435+0000 7f8dfe250640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df8108cf0 0x7f8df819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8dfda4f640 1 -- 172.21.15.92:0/1756997946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df8108cf0 msgr2=0x7f8df819bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df8108cf0 0x7f8df819bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8dfda4f640 1 -- 172.21.15.92:0/1756997946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df81083a0 msgr2=0x7f8df819b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df81083a0 0x7f8df819b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8dfda4f640 1 -- 172.21.15.92:0/1756997946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df81a6450 con 0x7f8df8102a60 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df81083a0 0x7f8df819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8df8102a60 0x7f8df819b1c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f8de800ebc0 tx=0x7f8de800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8df6ffd640 1 -- 172.21.15.92:0/1756997946 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8010630 con 0x7f8df8102a60 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8df6ffd640 1 -- 172.21.15.92:0/1756997946 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8de8010c60 con 0x7f8df8102a60 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8df6ffd640 1 -- 172.21.15.92:0/1756997946 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8018b00 con 0x7f8df8102a60 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8dffcb3640 1 -- 172.21.15.92:0/1756997946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df81a6740 con 0x7f8df8102a60 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.436+0000 7f8dffcb3640 1 -- 172.21.15.92:0/1756997946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df81a6c00 con 0x7f8df8102a60 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8e06227740 1 Processor -- start 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8e06227740 1 -- start start 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8df6ffd640 1 -- 172.21.15.92:0/1756997946 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f8de8018ca0 con 0x7f8df8102a60 2024-09-21T07:22:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8e06227740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 0x55d19d91f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8e06227740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d91fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8e06227740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d557390 0x55d19d9200d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8e06227740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d19d895e50 con 0x55d19d54f1b0 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8e06227740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d19d885280 con 0x55d19d557390 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8e06227740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d19d889090 con 0x55d19d578070 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8dfda4f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d91fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8dfda4f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d91fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40052/0 (socket says 172.21.15.92:40052) 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.439+0000 7f8dfda4f640 1 -- 172.21.15.92:0/2980072474 learned_addr learned my addr 172.21.15.92:0/2980072474 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8dfe250640 1 --2- 172.21.15.92:0/2980072474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 0x55d19d91f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8dfda4f640 1 -- 172.21.15.92:0/2980072474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 msgr2=0x55d19d91f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:35.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/2980072474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 0x55d19d91f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8dfda4f640 1 -- 172.21.15.92:0/2980072474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d557390 msgr2=0x55d19d9200d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/2980072474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d557390 0x55d19d9200d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8dfda4f640 1 -- 172.21.15.92:0/2980072474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19d5e3650 con 0x55d19d54f1b0 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8dfe250640 1 --2- 172.21.15.92:0/2980072474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 0x55d19d91f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8df6ffd640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8de00b6730 0x7f8de00b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/2980072474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d91fb90 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f8de80e5430 tx=0x7f8de80f0860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87874c63696c36a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8dfe250640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8de00b6730 0x7f8de00b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8df6ffd640 1 -- 172.21.15.92:0/1756997946 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7f8de80e8170 con 0x7f8df8102a60 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8ddffff640 1 -- 172.21.15.92:0/2980072474 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de80aa210 con 0x55d19d54f1b0 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8ddffff640 1 -- 172.21.15.92:0/2980072474 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8de8018420 con 0x55d19d54f1b0 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.440+0000 7f8ddffff640 1 -- 172.21.15.92:0/2980072474 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de80ad330 con 0x55d19d54f1b0 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.441+0000 7f8e06227740 1 -- 172.21.15.92:0/2980072474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 msgr2=0x55d19d91fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.441+0000 7f8e06227740 1 --2- 172.21.15.92:0/2980072474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d91fb90 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f8de80e5430 tx=0x7f8de80f0860 comp rx=0 tx=0).stop 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.441+0000 7f8dfe250640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8de00b6730 0x7f8de00b8c40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8df000cbf0 tx=0x7f8df000c5d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.441+0000 7f8e06227740 1 -- 172.21.15.92:0/2980072474 shutdown_connections 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.441+0000 7f8e06227740 1 --2- 172.21.15.92:0/2980072474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d557390 0x55d19d9200d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.441+0000 7f8e06227740 1 --2- 172.21.15.92:0/2980072474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d91fb90 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.441+0000 7f8e06227740 1 --2- 172.21.15.92:0/2980072474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 0x55d19d91f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.441+0000 7f8e06227740 1 -- 172.21.15.92:0/2980072474 >> 172.21.15.92:0/2980072474 conn(0x55d19d56c460 msgr2=0x55d19d91d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.441+0000 7f8e06227740 1 -- 172.21.15.92:0/2980072474 shutdown_connections 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.441+0000 7f8e06227740 1 -- 172.21.15.92:0/2980072474 wait complete. 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8e06227740 1 -- start start 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8e06227740 1 Processor -- start 2024-09-21T07:22:35.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8e06227740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d54f1b0 0x55d19d92f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8e06227740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d557390 0x55d19d92f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8e06227740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 0x55d19d93b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8e06227740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d19d6e6700 con 0x55d19d557390 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8e06227740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d19d820110 con 0x55d19d54f1b0 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8e06227740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d19d932190 con 0x55d19d578070 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8e06227740 10 client.0 _ll_register_callbacks cb 0x55d19d839990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8dfd24e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d557390 0x55d19d92f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.442+0000 7f8dfd24e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d557390 0x55d19d92f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40056/0 (socket says 172.21.15.92:40056) 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8dfd24e640 1 -- 172.21.15.92:0/3322672491 learned_addr learned my addr 172.21.15.92:0/3322672491 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d54f1b0 0x55d19d92f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8dfe250640 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 0x55d19d93b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8dfd24e640 1 -- 172.21.15.92:0/3322672491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 msgr2=0x55d19d93b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:35.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 0x55d19d93b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8dfd24e640 1 -- 172.21.15.92:0/3322672491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d54f1b0 msgr2=0x55d19d92f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d54f1b0 0x55d19d92f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8dfd24e640 1 -- 172.21.15.92:0/3322672491 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19d84dc40 con 0x55d19d557390 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8dfe250640 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 0x55d19d93b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d557390 0x55d19d92f670 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f8dec005ab0 tx=0x7f8dec031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e45afaf09436c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8ddd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/3322672491 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec03f070 con 0x55d19d557390 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8e06227740 1 -- 172.21.15.92:0/3322672491 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d19d897da0 con 0x55d19d557390 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/3322672491 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7f8dec004040 con 0x55d19d557390 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/3322672491 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8dec04d050 con 0x55d19d557390 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8e06227740 10 client.18189 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.443+0000 7f8e06227740 1 -- 172.21.15.92:0/3322672491 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d19d93dec0 con 0x55d19d557390 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/3322672491 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d19d897da0 con 0x55d19d557390 2024-09-21T07:22:35.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/3322672491 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8dec0048c0 con 0x55d19d557390 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8e06227740 10 client.18189 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8e06227740 10 client.18189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8e06227740 20 client.18189 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8e06227740 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d19d5369f0 0x55d19d9413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8e06227740 4 client.18189 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8e06227740 1 -- 172.21.15.92:0/3322672491 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d19d893850 con 0x55d19d5369f0 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d19d5369f0 0x55d19d9413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8ddd7fa640 10 client.18189 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.444+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d19d5369f0 0x55d19d9413e0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fbb7b289c3a043e server_cookie=4812db6e7bbe49f8 in_seq=0 out_seq=0 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.445+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/3322672491 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d19d893850 con 0x55d19d5369f0 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.445+0000 7f8ddd7fa640 10 client.18189 handle_command_reply: tid=0 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.445+0000 7f8e06227740 1 client.18189 shutdown 2024-09-21T07:22:35.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 1 -- 172.21.15.92:0/3322672491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d557390 msgr2=0x55d19d92f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d557390 0x55d19d92f670 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f8dec005ab0 tx=0x7f8dec031400 comp rx=0 tx=0).stop 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 1 -- 172.21.15.92:0/3322672491 shutdown_connections 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d19d5369f0 0x55d19d9413e0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d578070 0x55d19d93b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d557390 0x55d19d92f670 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8ddd7fa640 0 client.18189 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 1 --2- 172.21.15.92:0/3322672491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d54f1b0 0x55d19d92f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 1 -- 172.21.15.92:0/3322672491 >> 172.21.15.92:0/3322672491 conn(0x55d19d56c460 msgr2=0x55d19d921040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 1 -- 172.21.15.92:0/3322672491 shutdown_connections 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 1 -- 172.21.15.92:0/3322672491 wait complete. 2024-09-21T07:22:35.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.446+0000 7f8e06227740 20 client.18189 trim_cache size 0 max 16384 2024-09-21T07:22:35.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.463+0000 7f8e06227740 1 Processor -- start 2024-09-21T07:22:35.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.463+0000 7f8e06227740 1 -- start start 2024-09-21T07:22:35.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.463+0000 7f8e06227740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d5369f0 0x55d19d930d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.463+0000 7f8e06227740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d93b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.463+0000 7f8e06227740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 0x55d19d92c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.463+0000 7f8e06227740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81aed80 con 0x55d19d54f1b0 2024-09-21T07:22:35.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.463+0000 7f8e06227740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81b08c0 con 0x55d19d5369f0 2024-09-21T07:22:35.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.463+0000 7f8e06227740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81af450 con 0x55d19d557390 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.463+0000 7f8dfd24e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d93b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8dfd24e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d93b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40066/0 (socket says 172.21.15.92:40066) 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8dfd24e640 1 -- 172.21.15.92:0/2418302894 learned_addr learned my addr 172.21.15.92:0/2418302894 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8dfe250640 1 --2- 172.21.15.92:0/2418302894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 0x55d19d92c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/2418302894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d5369f0 0x55d19d930d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8dfd24e640 1 -- 172.21.15.92:0/2418302894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 msgr2=0x55d19d92c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/2418302894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 0x55d19d92c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8dfd24e640 1 -- 172.21.15.92:0/2418302894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d5369f0 msgr2=0x55d19d930d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/2418302894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d5369f0 0x55d19d930d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8dfd24e640 1 -- 172.21.15.92:0/2418302894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19d91da80 con 0x55d19d54f1b0 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/2418302894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d93b3c0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f8dec02a930 tx=0x7f8dec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b933269ab59e31d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8ddf7fe640 1 -- 172.21.15.92:0/2418302894 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec03f070 con 0x55d19d54f1b0 2024-09-21T07:22:35.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8ddf7fe640 1 -- 172.21.15.92:0/2418302894 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dec056070 con 0x55d19d54f1b0 2024-09-21T07:22:35.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.464+0000 7f8ddf7fe640 1 -- 172.21.15.92:0/2418302894 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec035070 con 0x55d19d54f1b0 2024-09-21T07:22:35.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.465+0000 7f8e06227740 1 -- 172.21.15.92:0/2418302894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 msgr2=0x55d19d93b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.465+0000 7f8e06227740 1 --2- 172.21.15.92:0/2418302894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d93b3c0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f8dec02a930 tx=0x7f8dec009780 comp rx=0 tx=0).stop 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.465+0000 7f8e06227740 1 -- 172.21.15.92:0/2418302894 shutdown_connections 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.465+0000 7f8e06227740 1 --2- 172.21.15.92:0/2418302894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 0x55d19d92c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.465+0000 7f8e06227740 1 --2- 172.21.15.92:0/2418302894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d93b3c0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.465+0000 7f8e06227740 1 --2- 172.21.15.92:0/2418302894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d5369f0 0x55d19d930d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.465+0000 7f8e06227740 1 -- 172.21.15.92:0/2418302894 >> 172.21.15.92:0/2418302894 conn(0x55d19d56c460 msgr2=0x55d19d930650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.465+0000 7f8e06227740 1 -- 172.21.15.92:0/2418302894 shutdown_connections 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.465+0000 7f8e06227740 1 -- 172.21.15.92:0/2418302894 wait complete. 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8e06227740 1 -- start start 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8e06227740 1 Processor -- start 2024-09-21T07:22:35.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8e06227740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d5369f0 0x55d19d933660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8e06227740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d933ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8e06227740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 0x55d19d9aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8e06227740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81b01f0 con 0x55d19d54f1b0 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8e06227740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81afb20 con 0x55d19d5369f0 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8e06227740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81acd80 con 0x55d19d557390 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8e06227740 10 client.0 _ll_register_callbacks cb 0x7f8de80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8dfd24e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d933ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8dfd24e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d933ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40070/0 (socket says 172.21.15.92:40070) 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.466+0000 7f8dfd24e640 1 -- 172.21.15.92:0/207906550 learned_addr learned my addr 172.21.15.92:0/207906550 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d5369f0 0x55d19d933660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8dfe250640 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 0x55d19d9aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8dfd24e640 1 -- 172.21.15.92:0/207906550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 msgr2=0x55d19d9aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 0x55d19d9aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8dfd24e640 1 -- 172.21.15.92:0/207906550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d5369f0 msgr2=0x55d19d933660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d5369f0 0x55d19d933660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8dfd24e640 1 -- 172.21.15.92:0/207906550 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19d934390 con 0x55d19d54f1b0 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8dfe250640 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 0x55d19d9aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8dfd24e640 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d933ba0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f8dec009900 tx=0x7f8dec031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3496f41a72c16a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8ddd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/207906550 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec035070 con 0x55d19d54f1b0 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/207906550 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7f8dec04a040 con 0x55d19d54f1b0 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8e06227740 1 -- 172.21.15.92:0/207906550 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dec056070 con 0x55d19d54f1b0 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/207906550 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8dec067050 con 0x55d19d54f1b0 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8e06227740 10 client.18195 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8e06227740 1 -- 172.21.15.92:0/207906550 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d19d9ac2a0 con 0x55d19d54f1b0 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.467+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/207906550 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dec056070 con 0x55d19d54f1b0 2024-09-21T07:22:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.468+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/207906550 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8dec044720 con 0x55d19d54f1b0 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.468+0000 7f8e06227740 10 client.18195 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.468+0000 7f8e06227740 10 client.18195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.468+0000 7f8e06227740 20 client.18195 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.468+0000 7f8e06227740 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d19d578070 0x55d19d9ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.468+0000 7f8e06227740 4 client.18195 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.468+0000 7f8e06227740 1 -- 172.21.15.92:0/207906550 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d19d890c80 con 0x55d19d578070 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.468+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d19d578070 0x55d19d9ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8ddd7fa640 10 client.18195 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8dfda4f640 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d19d578070 0x55d19d9ae900 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9560b0802846e9c4 server_cookie=874ca93656c1e1ef in_seq=0 out_seq=0 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8ddd7fa640 1 -- 172.21.15.92:0/207906550 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x55d19d890c80 con 0x55d19d578070 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8ddd7fa640 10 client.18195 handle_command_reply: tid=0 2024-09-21T07:22:35.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 client.18195 shutdown 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 -- 172.21.15.92:0/207906550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 msgr2=0x55d19d933ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d933ba0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f8dec009900 tx=0x7f8dec031530 comp rx=0 tx=0).stop 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 -- 172.21.15.92:0/207906550 shutdown_connections 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55d19d578070 0x55d19d9ae900 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d19d557390 0x55d19d9aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d19d54f1b0 0x55d19d933ba0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8ddd7fa640 0 client.18195 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 --2- 172.21.15.92:0/207906550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d19d5369f0 0x55d19d933660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 -- 172.21.15.92:0/207906550 >> 172.21.15.92:0/207906550 conn(0x55d19d56c460 msgr2=0x55d19d921040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 -- 172.21.15.92:0/207906550 shutdown_connections 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 1 -- 172.21.15.92:0/207906550 wait complete. 2024-09-21T07:22:35.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.469+0000 7f8e06227740 20 client.18195 trim_cache size 0 max 16384 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "9d9b4374-4159-4e71-99a9-ab660a57d3cf": { 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:02.785673+0000", 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "3b742b30-fd49-4ec5-844d-6cfbec3bbf45": { 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:48.290915+0000", 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "43824538-18e3-40c5-b1a4-5cf927a6fc24": { 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:22:02.392681+0000", 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "68bc1b81-ff26-4d23-bedd-ea1f5bf7ce64": { 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:48.714909+0000", 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:02.985669+0000", 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:22:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:22:35.485 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:22:35.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 -- 172.21.15.92:0/1756997946 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8de00b6730 msgr2=0x7f8de00b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8de00b6730 0x7f8de00b8c40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8df000cbf0 tx=0x7f8df000c5d0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 -- 172.21.15.92:0/1756997946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8df8102a60 msgr2=0x7f8df819b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:35.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8df8102a60 0x7f8df819b1c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f8de800ebc0 tx=0x7f8de800c6a0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 -- 172.21.15.92:0/1756997946 shutdown_connections 2024-09-21T07:22:35.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8de00b6730 0x7f8de00b8c40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df8108cf0 0x7f8df819bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8df81083a0 0x7f8df819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 --2- 172.21.15.92:0/1756997946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8df8102a60 0x7f8df819b1c0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:35.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 -- 172.21.15.92:0/1756997946 >> 172.21.15.92:0/1756997946 conn(0x7f8df8079730 msgr2=0x7f8df8104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:35.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 -- 172.21.15.92:0/1756997946 shutdown_connections 2024-09-21T07:22:35.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:35.470+0000 7f8dffcb3640 1 -- 172.21.15.92:0/1756997946 wait complete. 2024-09-21T07:22:36.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:35 smithi169 ceph-mon[33705]: pgmap v631: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:22:36.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:35 smithi092 ceph-mon[30987]: pgmap v631: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:22:36.264 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:22:36.265 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:22:36.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:35 smithi175 ceph-mon[34064]: pgmap v631: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:22:36.512 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:37.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.083+0000 7f3b9661f640 1 -- 172.21.15.92:0/848227011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b901083c0 msgr2=0x7f3b901087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:37.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.083+0000 7f3b9661f640 1 --2- 172.21.15.92:0/848227011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b901083c0 0x7f3b901087d0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009900 tx=0x7f3b8402a410 comp rx=0 tx=0).stop 2024-09-21T07:22:37.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.083+0000 7f3b9661f640 1 -- 172.21.15.92:0/848227011 shutdown_connections 2024-09-21T07:22:37.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.083+0000 7f3b9661f640 1 --2- 172.21.15.92:0/848227011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b90108d10 0x7f3b9010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:37.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.083+0000 7f3b9661f640 1 --2- 172.21.15.92:0/848227011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b901083c0 0x7f3b901087d0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.083+0000 7f3b9661f640 1 --2- 172.21.15.92:0/848227011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b90102a80 0x7f3b90102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.083+0000 7f3b9661f640 1 -- 172.21.15.92:0/848227011 >> 172.21.15.92:0/848227011 conn(0x7f3b90079740 msgr2=0x7f3b90079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.083+0000 7f3b9661f640 1 -- 172.21.15.92:0/848227011 shutdown_connections 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.083+0000 7f3b9661f640 1 -- 172.21.15.92:0/848227011 wait complete. 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b9661f640 1 Processor -- start 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b9661f640 1 -- start start 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b9661f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b90102a80 0x7f3b9019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b9661f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b901083c0 0x7f3b9019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b9661f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b90108d10 0x7f3b9019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b9661f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b90113970 con 0x7f3b90108d10 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b9661f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3b901137f0 con 0x7f3b90102a80 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b9661f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b90113af0 con 0x7f3b901083c0 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b94bbc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b90108d10 0x7f3b9019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:37.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b94bbc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b90108d10 0x7f3b9019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40074/0 (socket says 172.21.15.92:40074) 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b94bbc640 1 -- 172.21.15.92:0/4108110460 learned_addr learned my addr 172.21.15.92:0/4108110460 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b8ffff640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b90102a80 0x7f3b9019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b8f7fe640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b901083c0 0x7f3b9019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b94bbc640 1 -- 172.21.15.92:0/4108110460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b901083c0 msgr2=0x7f3b9019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b94bbc640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b901083c0 0x7f3b9019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b94bbc640 1 -- 172.21.15.92:0/4108110460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b90102a80 msgr2=0x7f3b9019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b94bbc640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b90102a80 0x7f3b9019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.084+0000 7f3b94bbc640 1 -- 172.21.15.92:0/4108110460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b901a0370 con 0x7f3b90108d10 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.085+0000 7f3b8ffff640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b90102a80 0x7f3b9019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.085+0000 7f3b94bbc640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b90108d10 0x7f3b9019fc40 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800eaa0 tx=0x7f3b8800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.085+0000 7f3b8d7fa640 1 -- 172.21.15.92:0/4108110460 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800cdb0 con 0x7f3b90108d10 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.085+0000 7f3b8d7fa640 1 -- 172.21.15.92:0/4108110460 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b88005020 con 0x7f3b90108d10 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.085+0000 7f3b8d7fa640 1 -- 172.21.15.92:0/4108110460 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b880116d0 con 0x7f3b90108d10 2024-09-21T07:22:37.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.085+0000 7f3b9661f640 1 -- 172.21.15.92:0/4108110460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b901a0660 con 0x7f3b90108d10 2024-09-21T07:22:37.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.085+0000 7f3b9661f640 1 -- 172.21.15.92:0/4108110460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b901a6dc0 con 0x7f3b90108d10 2024-09-21T07:22:37.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.086+0000 7f3b9661f640 1 -- 172.21.15.92:0/4108110460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b90103d00 con 0x7f3b90108d10 2024-09-21T07:22:37.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.087+0000 7f3b8d7fa640 1 -- 172.21.15.92:0/4108110460 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f3b880051d0 con 0x7f3b90108d10 2024-09-21T07:22:37.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.088+0000 7f3b8d7fa640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b780b6700 0x7f3b780b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:37.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.089+0000 7f3b8ffff640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b780b6700 0x7f3b780b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:37.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.089+0000 7f3b8d7fa640 1 -- 172.21.15.92:0/4108110460 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7f3b880e8170 con 0x7f3b90108d10 2024-09-21T07:22:37.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.089+0000 7f3b8ffff640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b780b6700 0x7f3b780b8c10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3b80006fd0 tx=0x7f3b80008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:37.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.092+0000 7f3b8d7fa640 1 -- 172.21.15.92:0/4108110460 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b88016030 con 0x7f3b90108d10 2024-09-21T07:22:37.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.307+0000 7f3b9661f640 1 -- 172.21.15.92:0/4108110460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b9019b530 con 0x7f3b90108d10 2024-09-21T07:22:37.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.308+0000 7f3b8d7fa640 1 -- 172.21.15.92:0/4108110460 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f3b880ae2e0 con 0x7f3b90108d10 2024-09-21T07:22:37.310 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:22:37.311 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:22:37.311 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:22:37.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 -- 172.21.15.92:0/4108110460 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b780b6700 msgr2=0x7f3b780b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:37.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b780b6700 0x7f3b780b8c10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3b80006fd0 tx=0x7f3b80008040 comp rx=0 tx=0).stop 2024-09-21T07:22:37.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 -- 172.21.15.92:0/4108110460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b90108d10 msgr2=0x7f3b9019fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:37.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b90108d10 0x7f3b9019fc40 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800eaa0 tx=0x7f3b8800ef60 comp rx=0 tx=0).stop 2024-09-21T07:22:37.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 -- 172.21.15.92:0/4108110460 shutdown_connections 2024-09-21T07:22:37.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f3b780b6700 0x7f3b780b8c10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:37.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b90108d10 0x7f3b9019fc40 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:37.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b901083c0 0x7f3b9019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:37.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 --2- 172.21.15.92:0/4108110460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b90102a80 0x7f3b9019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:37.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 -- 172.21.15.92:0/4108110460 >> 172.21.15.92:0/4108110460 conn(0x7f3b90079740 msgr2=0x7f3b90105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:37.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 -- 172.21.15.92:0/4108110460 shutdown_connections 2024-09-21T07:22:37.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:37.310+0000 7f3b9661f640 1 -- 172.21.15.92:0/4108110460 wait complete. 2024-09-21T07:22:37.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:37 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/4108110460' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:22:37.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:37 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/4108110460' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:22:37.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:37 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/4108110460' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:22:38.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:22:38.308 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:38.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:38 smithi169 ceph-mon[33705]: pgmap v632: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:22:38.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:38 smithi092 ceph-mon[30987]: pgmap v632: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:22:38.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:38 smithi175 ceph-mon[34064]: pgmap v632: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:22:38.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.819+0000 7fda17ce7640 1 -- 172.21.15.92:0/3330558467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda10103230 msgr2=0x7fda10103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:38.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.819+0000 7fda17ce7640 1 --2- 172.21.15.92:0/3330558467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda10103230 0x7fda10103640 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fda00009ca0 tx=0x7fda0002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.819+0000 7fda17ce7640 1 -- 172.21.15.92:0/3330558467 shutdown_connections 2024-09-21T07:22:38.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.819+0000 7fda17ce7640 1 --2- 172.21.15.92:0/3330558467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda10108db0 0x7fda1010f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.819+0000 7fda17ce7640 1 --2- 172.21.15.92:0/3330558467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda10108460 0x7fda10108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.819+0000 7fda17ce7640 1 --2- 172.21.15.92:0/3330558467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda10103230 0x7fda10103640 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.819+0000 7fda17ce7640 1 -- 172.21.15.92:0/3330558467 >> 172.21.15.92:0/3330558467 conn(0x7fda10079ec0 msgr2=0x7fda1007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.819+0000 7fda17ce7640 1 -- 172.21.15.92:0/3330558467 shutdown_connections 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.819+0000 7fda17ce7640 1 -- 172.21.15.92:0/3330558467 wait complete. 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda17ce7640 1 Processor -- start 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda17ce7640 1 -- start start 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda17ce7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda10103230 0x7fda101100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda17ce7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda10108460 0x7fda10110600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda17ce7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda10108db0 0x7fda10110b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda17ce7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fda10113a70 con 0x7fda10103230 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda17ce7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda101138f0 con 0x7fda10108db0 2024-09-21T07:22:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda17ce7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda10113bf0 con 0x7fda10108460 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda15a83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda10103230 0x7fda101100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda15a83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda10103230 0x7fda101100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40084/0 (socket says 172.21.15.92:40084) 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda15a83640 1 -- 172.21.15.92:0/2079744355 learned_addr learned my addr 172.21.15.92:0/2079744355 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda15282640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda10108460 0x7fda10110600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda15a83640 1 -- 172.21.15.92:0/2079744355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda10108460 msgr2=0x7fda10110600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda15a83640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda10108460 0x7fda10110600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda15a83640 1 -- 172.21.15.92:0/2079744355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda10108db0 msgr2=0x7fda10110b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda15a83640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda10108db0 0x7fda10110b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.820+0000 7fda15a83640 1 -- 172.21.15.92:0/2079744355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda101a8710 con 0x7fda10103230 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.821+0000 7fda15a83640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda10103230 0x7fda101100c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fda00009dc0 tx=0x7fda00032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.821+0000 7fda0effd640 1 -- 172.21.15.92:0/2079744355 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00004040 con 0x7fda10103230 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.821+0000 7fda17ce7640 1 -- 172.21.15.92:0/2079744355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda101a89a0 con 0x7fda10103230 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.821+0000 7fda17ce7640 1 -- 172.21.15.92:0/2079744355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda101a8f30 con 0x7fda10103230 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.821+0000 7fda0effd640 1 -- 172.21.15.92:0/2079744355 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda00004670 con 0x7fda10103230 2024-09-21T07:22:38.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.821+0000 7fda0effd640 1 -- 172.21.15.92:0/2079744355 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00030a50 con 0x7fda10103230 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.823+0000 7fda0effd640 1 -- 172.21.15.92:0/2079744355 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fda00030bf0 con 0x7fda10103230 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda1e25b740 1 Processor -- start 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda1e25b740 1 -- start start 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d7510070 0x5564d78b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78b7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d74ef390 0x5564d78b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda1e25b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5564d782dea0 con 0x5564d74e71b0 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda1e25b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5564d781d2d0 con 0x5564d7510070 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda1e25b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5564d78210e0 con 0x5564d74ef390 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda15a83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda15a83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78b7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40098/0 (socket says 172.21.15.92:40098) 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.824+0000 7fda15a83640 1 -- 172.21.15.92:0/2449747004 learned_addr learned my addr 172.21.15.92:0/2449747004 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda16284640 1 --2- 172.21.15.92:0/2449747004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d7510070 0x5564d78b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda0effd640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd9f80b6680 0x7fd9f80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda15282640 1 --2- 172.21.15.92:0/2449747004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d74ef390 0x5564d78b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda16284640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd9f80b6680 0x7fd9f80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda15a83640 1 -- 172.21.15.92:0/2449747004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d74ef390 msgr2=0x5564d78b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda15a83640 1 --2- 172.21.15.92:0/2449747004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d74ef390 0x5564d78b7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda15a83640 1 -- 172.21.15.92:0/2449747004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d7510070 msgr2=0x5564d78b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda15a83640 1 --2- 172.21.15.92:0/2449747004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d7510070 0x5564d78b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda15a83640 1 -- 172.21.15.92:0/2449747004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d757b650 con 0x5564d74e71b0 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda15282640 1 --2- 172.21.15.92:0/2449747004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d74ef390 0x5564d78b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda0effd640 1 -- 172.21.15.92:0/2079744355 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fda00108cd0 con 0x7fda10103230 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda15a83640 1 --2- 172.21.15.92:0/2449747004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78b7800 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fda00105f90 tx=0x7fda000439b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11194fe8653565e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fda16284640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd9f80b6680 0x7fd9f80b8b90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fda08005fd0 tx=0x7fda08005890 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fd9f7fff640 1 -- 172.21.15.92:0/2449747004 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda000ce4f0 con 0x5564d74e71b0 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fd9f7fff640 1 -- 172.21.15.92:0/2449747004 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda00036020 con 0x5564d74e71b0 2024-09-21T07:22:38.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.825+0000 7fd9f7fff640 1 -- 172.21.15.92:0/2449747004 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0003a620 con 0x5564d74e71b0 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.826+0000 7fda1e25b740 1 -- 172.21.15.92:0/2449747004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 msgr2=0x5564d78b7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.826+0000 7fda1e25b740 1 --2- 172.21.15.92:0/2449747004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78b7800 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fda00105f90 tx=0x7fda000439b0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.826+0000 7fda1e25b740 1 -- 172.21.15.92:0/2449747004 shutdown_connections 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.826+0000 7fda1e25b740 1 --2- 172.21.15.92:0/2449747004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d74ef390 0x5564d78b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.826+0000 7fda1e25b740 1 --2- 172.21.15.92:0/2449747004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78b7800 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.826+0000 7fda1e25b740 1 --2- 172.21.15.92:0/2449747004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d7510070 0x5564d78b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.826+0000 7fda1e25b740 1 -- 172.21.15.92:0/2449747004 >> 172.21.15.92:0/2449747004 conn(0x5564d7504460 msgr2=0x5564d78b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.826+0000 7fda1e25b740 1 -- 172.21.15.92:0/2449747004 shutdown_connections 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.826+0000 7fda1e25b740 1 -- 172.21.15.92:0/2449747004 wait complete. 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda1e25b740 1 -- start start 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda1e25b740 1 Processor -- start 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 0x5564d78c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d78ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda1e25b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5564d767e700 con 0x5564d74e71b0 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda1e25b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5564d77b8160 con 0x5564d74ef390 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda1e25b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5564d782dea0 con 0x5564d7510070 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda1e25b740 10 client.0 _ll_register_callbacks cb 0x5564d77d19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda15a83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda15a83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40114/0 (socket says 172.21.15.92:40114) 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.827+0000 7fda15a83640 1 -- 172.21.15.92:0/4188554340 learned_addr learned my addr 172.21.15.92:0/4188554340 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda15282640 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 0x5564d78c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda16284640 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d78ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda15a83640 1 -- 172.21.15.92:0/4188554340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 msgr2=0x5564d78ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda15a83640 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d78ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda15a83640 1 -- 172.21.15.92:0/4188554340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 msgr2=0x5564d78c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda15a83640 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 0x5564d78c2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda15a83640 1 -- 172.21.15.92:0/4188554340 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564d77e5c90 con 0x5564d74e71b0 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda15282640 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 0x5564d78c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:38.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda16284640 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d78ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda15a83640 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c2950 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fda00000f80 tx=0x7fda00003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1c1e606fac85d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fd9f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fd9f57fa640 1 -- 172.21.15.92:0/4188554340 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda000cde90 con 0x5564d74e71b0 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fd9f57fa640 1 -- 172.21.15.92:0/4188554340 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fda0010c480 con 0x5564d74e71b0 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.828+0000 7fda1e25b740 1 -- 172.21.15.92:0/4188554340 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda00036020 con 0x5564d74e71b0 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fd9f57fa640 1 -- 172.21.15.92:0/4188554340 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fda000e9050 con 0x5564d74e71b0 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fda1e25b740 10 client.18213 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fda1e25b740 1 -- 172.21.15.92:0/4188554340 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564d78d1300 con 0x5564d74e71b0 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fd9f57fa640 1 -- 172.21.15.92:0/4188554340 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda0008de50 con 0x5564d74e71b0 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fd9f57fa640 1 -- 172.21.15.92:0/4188554340 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fda000ca990 con 0x5564d74e71b0 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fda1e25b740 10 client.18213 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fda1e25b740 10 client.18213 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fda1e25b740 20 client.18213 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fda1e25b740 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564d74ce9f0 0x5564d78d47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fda1e25b740 4 client.18213 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:38.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.829+0000 7fda1e25b740 1 -- 172.21.15.92:0/4188554340 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fda00036020 con 0x5564d74ce9f0 2024-09-21T07:22:38.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.830+0000 7fda15282640 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564d74ce9f0 0x5564d78d47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.830+0000 7fd9f57fa640 10 client.18213 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.830+0000 7fda15282640 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564d74ce9f0 0x5564d78d47f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=83067600ae42af96 server_cookie=778286125657fbae in_seq=0 out_seq=0 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fd9f57fa640 1 -- 172.21.15.92:0/4188554340 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fda00036020 con 0x5564d74ce9f0 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fd9f57fa640 10 client.18213 handle_command_reply: tid=0 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 client.18213 shutdown 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 -- 172.21.15.92:0/4188554340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 msgr2=0x5564d78c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c2950 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fda00000f80 tx=0x7fda00003eb0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 -- 172.21.15.92:0/4188554340 shutdown_connections 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564d74ce9f0 0x5564d78d47f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d78ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 0x5564d78c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 --2- 172.21.15.92:0/4188554340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c2950 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fd9f57fa640 0 client.18213 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:22:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 -- 172.21.15.92:0/4188554340 >> 172.21.15.92:0/4188554340 conn(0x5564d7504460 msgr2=0x5564d78b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 -- 172.21.15.92:0/4188554340 shutdown_connections 2024-09-21T07:22:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 1 -- 172.21.15.92:0/4188554340 wait complete. 2024-09-21T07:22:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.831+0000 7fda1e25b740 20 client.18213 trim_cache size 0 max 16384 2024-09-21T07:22:38.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.844+0000 7fda1e25b740 1 Processor -- start 2024-09-21T07:22:38.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.844+0000 7fda1e25b740 1 -- start start 2024-09-21T07:22:38.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74e71b0 0x5564d78c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74ef390 0x5564d78c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d78bfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda1e25b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc0100d0 con 0x5564d74ef390 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda1e25b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc011c10 con 0x5564d74e71b0 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda1e25b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc0107a0 con 0x5564d7510070 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda15282640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74ef390 0x5564d78c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda15282640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74ef390 0x5564d78c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40116/0 (socket says 172.21.15.92:40116) 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda15282640 1 -- 172.21.15.92:0/3258633772 learned_addr learned my addr 172.21.15.92:0/3258633772 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda15a83640 1 --2- 172.21.15.92:0/3258633772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74e71b0 0x5564d78c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda16284640 1 --2- 172.21.15.92:0/3258633772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d78bfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda15282640 1 -- 172.21.15.92:0/3258633772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 msgr2=0x5564d78bfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda15282640 1 --2- 172.21.15.92:0/3258633772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d78bfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda15282640 1 -- 172.21.15.92:0/3258633772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74e71b0 msgr2=0x5564d78c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda15282640 1 --2- 172.21.15.92:0/3258633772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74e71b0 0x5564d78c11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda15282640 1 -- 172.21.15.92:0/3258633772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d78c39f0 con 0x5564d74ef390 2024-09-21T07:22:38.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fda15282640 1 --2- 172.21.15.92:0/3258633772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74ef390 0x5564d78c1710 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fda0400bfd0 tx=0x7fda04005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e54092ee4ff6e00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:38.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fd9f77fe640 1 -- 172.21.15.92:0/3258633772 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda04005220 con 0x5564d74ef390 2024-09-21T07:22:38.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fd9f77fe640 1 -- 172.21.15.92:0/3258633772 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda040053c0 con 0x5564d74ef390 2024-09-21T07:22:38.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.845+0000 7fd9f77fe640 1 -- 172.21.15.92:0/3258633772 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda040119f0 con 0x5564d74ef390 2024-09-21T07:22:38.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.846+0000 7fda1e25b740 1 -- 172.21.15.92:0/3258633772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74ef390 msgr2=0x5564d78c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:38.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.846+0000 7fda1e25b740 1 --2- 172.21.15.92:0/3258633772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74ef390 0x5564d78c1710 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fda0400bfd0 tx=0x7fda04005c70 comp rx=0 tx=0).stop 2024-09-21T07:22:38.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.846+0000 7fda1e25b740 1 -- 172.21.15.92:0/3258633772 shutdown_connections 2024-09-21T07:22:38.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.846+0000 7fda1e25b740 1 --2- 172.21.15.92:0/3258633772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d78bfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.846+0000 7fda1e25b740 1 --2- 172.21.15.92:0/3258633772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74ef390 0x5564d78c1710 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.846+0000 7fda1e25b740 1 --2- 172.21.15.92:0/3258633772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74e71b0 0x5564d78c11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.846+0000 7fda1e25b740 1 -- 172.21.15.92:0/3258633772 >> 172.21.15.92:0/3258633772 conn(0x5564d7504460 msgr2=0x5564d78bda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.846+0000 7fda1e25b740 1 -- 172.21.15.92:0/3258633772 shutdown_connections 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.846+0000 7fda1e25b740 1 -- 172.21.15.92:0/3258633772 wait complete. 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda1e25b740 1 -- start start 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda1e25b740 1 Processor -- start 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 0x5564d78c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda1e25b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d79381d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda1e25b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc011540 con 0x5564d74e71b0 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda1e25b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc010e70 con 0x5564d74ef390 2024-09-21T07:22:38.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda1e25b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc00e0d0 con 0x5564d7510070 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda1e25b740 10 client.0 _ll_register_callbacks cb 0x7fda08005f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda15a83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda15a83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40118/0 (socket says 172.21.15.92:40118) 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.847+0000 7fda15a83640 1 -- 172.21.15.92:0/3594983225 learned_addr learned my addr 172.21.15.92:0/3594983225 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda15a83640 1 -- 172.21.15.92:0/3594983225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 msgr2=0x5564d79381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda15a83640 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d79381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda15a83640 1 -- 172.21.15.92:0/3594983225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 msgr2=0x5564d78c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda15282640 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 0x5564d78c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda15a83640 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 0x5564d78c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda15a83640 1 -- 172.21.15.92:0/3594983225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564d7938840 con 0x5564d74e71b0 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda15282640 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 0x5564d78c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda15a83640 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c7100 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fda00006010 tx=0x7fda000ca2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ade9d6c2f208d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fd9f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:38.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fd9f57fa640 1 -- 172.21.15.92:0/3594983225 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda000ce070 con 0x5564d74e71b0 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fd9f57fa640 1 -- 172.21.15.92:0/3594983225 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fda000d7eb0 con 0x5564d74e71b0 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda1e25b740 1 -- 172.21.15.92:0/3594983225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda040053c0 con 0x5564d74e71b0 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fd9f57fa640 1 -- 172.21.15.92:0/3594983225 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fda000cde90 con 0x5564d74e71b0 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda1e25b740 10 client.18219 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fda1e25b740 1 -- 172.21.15.92:0/3594983225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564d7938840 con 0x5564d74e71b0 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.848+0000 7fd9f57fa640 1 -- 172.21.15.92:0/3594983225 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda040053c0 con 0x5564d74e71b0 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.849+0000 7fd9f57fa640 1 -- 172.21.15.92:0/3594983225 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fda000cd980 con 0x5564d74e71b0 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.849+0000 7fda1e25b740 10 client.18219 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.849+0000 7fda1e25b740 10 client.18219 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.849+0000 7fda1e25b740 20 client.18219 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.849+0000 7fda1e25b740 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564d74a3da0 0x5564d7941f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.849+0000 7fda1e25b740 4 client.18219 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.849+0000 7fda1e25b740 1 -- 172.21.15.92:0/3594983225 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5564d782fdf0 con 0x5564d74a3da0 2024-09-21T07:22:38.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.849+0000 7fda15282640 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564d74a3da0 0x5564d7941f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.849+0000 7fd9f57fa640 10 client.18219 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.849+0000 7fda15282640 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564d74a3da0 0x5564d7941f20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=739d10e4cb0dd008 server_cookie=130a265ab28fbad7 in_seq=0 out_seq=0 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fd9f57fa640 1 -- 172.21.15.92:0/3594983225 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5564d782fdf0 con 0x5564d74a3da0 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fd9f57fa640 10 client.18219 handle_command_reply: tid=0 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 client.18219 shutdown 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 -- 172.21.15.92:0/3594983225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 msgr2=0x5564d78c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c7100 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fda00006010 tx=0x7fda000ca2a0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 -- 172.21.15.92:0/3594983225 shutdown_connections 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5564d74a3da0 0x5564d7941f20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d7510070 0x5564d79381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5564d74ef390 0x5564d78c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 --2- 172.21.15.92:0/3594983225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564d74e71b0 0x5564d78c7100 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fd9f57fa640 0 client.18219 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:22:38.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 -- 172.21.15.92:0/3594983225 >> 172.21.15.92:0/3594983225 conn(0x5564d7504460 msgr2=0x5564d78c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:38.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 -- 172.21.15.92:0/3594983225 shutdown_connections 2024-09-21T07:22:38.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 1 -- 172.21.15.92:0/3594983225 wait complete. 2024-09-21T07:22:38.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.850+0000 7fda1e25b740 20 client.18219 trim_cache size 0 max 16384 2024-09-21T07:22:38.859 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 -- 172.21.15.92:0/2079744355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd9f80b6680 msgr2=0x7fd9f80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd9f80b6680 0x7fd9f80b8b90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fda08005fd0 tx=0x7fda08005890 comp rx=0 tx=0).stop 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 -- 172.21.15.92:0/2079744355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda10103230 msgr2=0x7fda101100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda10103230 0x7fda101100c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fda00009dc0 tx=0x7fda00032bc0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 -- 172.21.15.92:0/2079744355 shutdown_connections 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd9f80b6680 0x7fd9f80b8b90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda10108db0 0x7fda10110b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda10108460 0x7fda10110600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 --2- 172.21.15.92:0/2079744355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda10103230 0x7fda101100c0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 -- 172.21.15.92:0/2079744355 >> 172.21.15.92:0/2079744355 conn(0x7fda10079ec0 msgr2=0x7fda101065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 -- 172.21.15.92:0/2079744355 shutdown_connections 2024-09-21T07:22:38.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:38.851+0000 7fda17ce7640 1 -- 172.21.15.92:0/2079744355 wait complete. 2024-09-21T07:22:39.681 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:22:39.928 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:40.049 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:39 smithi092 ceph-mon[30987]: pgmap v633: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:22:40.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:39 smithi169 ceph-mon[33705]: pgmap v633: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:22:40.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:39 smithi175 ceph-mon[34064]: pgmap v633: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:22:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.480+0000 7fa2da51c640 1 -- 172.21.15.92:0/845561549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d4102b10 msgr2=0x7fa2d4102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.480+0000 7fa2da51c640 1 --2- 172.21.15.92:0/845561549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d4102b10 0x7fa2d4102f20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009900 tx=0x7fa2c402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.480+0000 7fa2da51c640 1 -- 172.21.15.92:0/845561549 shutdown_connections 2024-09-21T07:22:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.480+0000 7fa2da51c640 1 --2- 172.21.15.92:0/845561549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d4108da0 0x7fa2d410f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.480+0000 7fa2da51c640 1 --2- 172.21.15.92:0/845561549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2d4108450 0x7fa2d4108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.480+0000 7fa2da51c640 1 --2- 172.21.15.92:0/845561549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d4102b10 0x7fa2d4102f20 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.480+0000 7fa2da51c640 1 -- 172.21.15.92:0/845561549 >> 172.21.15.92:0/845561549 conn(0x7fa2d40796d0 msgr2=0x7fa2d4079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.480+0000 7fa2da51c640 1 -- 172.21.15.92:0/845561549 shutdown_connections 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.480+0000 7fa2da51c640 1 -- 172.21.15.92:0/845561549 wait complete. 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.481+0000 7fa2da51c640 1 Processor -- start 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.481+0000 7fa2da51c640 1 -- start start 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.481+0000 7fa2da51c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d4102b10 0x7fa2d419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.481+0000 7fa2da51c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d4108450 0x7fa2d419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.481+0000 7fa2da51c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2d4108da0 0x7fa2d419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2da51c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4112910 con 0x7fa2d4108450 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2da51c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4112790 con 0x7fa2d4102b10 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2da51c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4112a90 con 0x7fa2d4108da0 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d4108450 0x7fa2d419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d4108450 0x7fa2d419aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41432/0 (socket says 172.21.15.92:41432) 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d37fe640 1 -- 172.21.15.92:0/3851112279 learned_addr learned my addr 172.21.15.92:0/3851112279 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d4102b10 0x7fa2d419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d8ab9640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2d4108da0 0x7fa2d419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d37fe640 1 -- 172.21.15.92:0/3851112279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2d4108da0 msgr2=0x7fa2d419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2d4108da0 0x7fa2d419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d37fe640 1 -- 172.21.15.92:0/3851112279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d4102b10 msgr2=0x7fa2d419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d4102b10 0x7fa2d419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d37fe640 1 -- 172.21.15.92:0/3851112279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d41a0320 con 0x7fa2d4108450 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d4108450 0x7fa2d419aa10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c8c0 tx=0x7fa2c800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d17fa640 1 -- 172.21.15.92:0/3851112279 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8007bb0 con 0x7fa2d4108450 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2da51c640 1 -- 172.21.15.92:0/3851112279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d41a0610 con 0x7fa2d4108450 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d17fa640 1 -- 172.21.15.92:0/3851112279 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2c8007d50 con 0x7fa2d4108450 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2d17fa640 1 -- 172.21.15.92:0/3851112279 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8018660 con 0x7fa2d4108450 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.482+0000 7fa2da51c640 1 -- 172.21.15.92:0/3851112279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d41a6e30 con 0x7fa2d4108450 2024-09-21T07:22:40.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.485+0000 7fa2e0a90740 1 Processor -- start 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.485+0000 7fa2e0a90740 1 -- start start 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.485+0000 7fa2d17fa640 1 -- 172.21.15.92:0/3851112279 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fa2c800fa00 con 0x7fa2d4108450 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.485+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.485+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef51be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.485+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 0x55608ef52120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.485+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55608eec7ea0 con 0x55608ebaa070 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.485+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55608eeb72d0 con 0x55608eb89390 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.485+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55608eebb0e0 con 0x55608eb811b0 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.485+0000 7fa2d8ab9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d8ab9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41438/0 (socket says 172.21.15.92:41438) 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d8ab9640 1 -- 172.21.15.92:0/2220961728 learned_addr learned my addr 172.21.15.92:0/2220961728 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/2220961728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef51be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/2220961728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 0x55608ef52120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d8ab9640 1 -- 172.21.15.92:0/2220961728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 msgr2=0x55608ef51be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d8ab9640 1 --2- 172.21.15.92:0/2220961728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef51be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d8ab9640 1 -- 172.21.15.92:0/2220961728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 msgr2=0x55608ef52120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d8ab9640 1 --2- 172.21.15.92:0/2220961728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 0x55608ef52120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d8ab9640 1 -- 172.21.15.92:0/2220961728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55608ec15650 con 0x55608ebaa070 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d17fa640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2bc0b66b0 0x7fa2bc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d8ab9640 1 --2- 172.21.15.92:0/2220961728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef516a0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc010370 tx=0x7fa2cc010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2579b4861c8f6a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2bc0b66b0 0x7fa2bc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2d17fa640 1 -- 172.21.15.92:0/3851112279 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fa2c80e7b00 con 0x7fa2d4108450 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2ba7fc640 1 -- 172.21.15.92:0/2220961728 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc016070 con 0x55608ebaa070 2024-09-21T07:22:40.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2ba7fc640 1 -- 172.21.15.92:0/2220961728 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2cc004d20 con 0x55608ebaa070 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.486+0000 7fa2ba7fc640 1 -- 172.21.15.92:0/2220961728 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc005280 con 0x55608ebaa070 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.487+0000 7fa2e0a90740 1 -- 172.21.15.92:0/2220961728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 msgr2=0x55608ef516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.487+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2bc0b66b0 0x7fa2bc0b8bc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40057c0 tx=0x7fa2c40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.487+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/2220961728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef516a0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc010370 tx=0x7fa2cc010830 comp rx=0 tx=0).stop 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.487+0000 7fa2e0a90740 1 -- 172.21.15.92:0/2220961728 shutdown_connections 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.487+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/2220961728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 0x55608ef52120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.487+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/2220961728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef51be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.487+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/2220961728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef516a0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.487+0000 7fa2e0a90740 1 -- 172.21.15.92:0/2220961728 >> 172.21.15.92:0/2220961728 conn(0x55608eb9e460 msgr2=0x55608ef4f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.487+0000 7fa2e0a90740 1 -- 172.21.15.92:0/2220961728 shutdown_connections 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.487+0000 7fa2e0a90740 1 -- 172.21.15.92:0/2220961728 wait complete. 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.488+0000 7fa2e0a90740 1 -- start start 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.488+0000 7fa2e0a90740 1 Processor -- start 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.488+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb811b0 0x55608ef5cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.488+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb89390 0x55608ef5d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.488+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608ebaa070 0x55608ef69170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.488+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55608ed18700 con 0x55608eb811b0 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.488+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55608ee52160 con 0x55608ebaa070 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.488+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55608ef5fe80 con 0x55608eb89390 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.488+0000 7fa2e0a90740 10 client.0 _ll_register_callbacks cb 0x55608ee6b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb811b0 0x55608ef5cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb811b0 0x55608ef5cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41448/0 (socket says 172.21.15.92:41448) 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d3fff640 1 -- 172.21.15.92:0/3772311021 learned_addr learned my addr 172.21.15.92:0/3772311021 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb89390 0x55608ef5d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d8ab9640 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608ebaa070 0x55608ef69170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d3fff640 1 -- 172.21.15.92:0/3772311021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb89390 msgr2=0x55608ef5d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb89390 0x55608ef5d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d3fff640 1 -- 172.21.15.92:0/3772311021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608ebaa070 msgr2=0x55608ef69170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:40.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608ebaa070 0x55608ef69170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d3fff640 1 -- 172.21.15.92:0/3772311021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55608ee7fc90 con 0x55608eb811b0 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb811b0 0x55608ef5cda0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4033000 tx=0x7fa2c4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346441be72a0775 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2b37fe640 1 -- 172.21.15.92:0/3772311021 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4035040 con 0x55608eb811b0 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2b37fe640 1 -- 172.21.15.92:0/3772311021 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fa2c403da50 con 0x55608eb811b0 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.489+0000 7fa2e0a90740 1 -- 172.21.15.92:0/3772311021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2cc004d20 con 0x55608eb811b0 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2b37fe640 1 -- 172.21.15.92:0/3772311021 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2c4050430 con 0x55608eb811b0 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2e0a90740 10 client.18231 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2e0a90740 1 -- 172.21.15.92:0/3772311021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55608ef6bbf0 con 0x55608eb811b0 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2b37fe640 1 -- 172.21.15.92:0/3772311021 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2cc004d20 con 0x55608eb811b0 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2b37fe640 1 -- 172.21.15.92:0/3772311021 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa2c4044070 con 0x55608eb811b0 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2e0a90740 10 client.18231 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2e0a90740 10 client.18231 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2e0a90740 20 client.18231 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55608eb689f0 0x55608ef6f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2e0a90740 4 client.18231 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2e0a90740 1 -- 172.21.15.92:0/3772311021 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55608eec9df0 con 0x55608eb689f0 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.490+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55608eb689f0 0x55608ef6f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.491+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55608eb689f0 0x55608ef6f130 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=70fc7729d9f877e server_cookie=e1e1e8756544caa7 in_seq=0 out_seq=0 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.491+0000 7fa2b37fe640 10 client.18231 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.491+0000 7fa2b37fe640 1 -- 172.21.15.92:0/3772311021 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55608eec9df0 con 0x55608eb689f0 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.491+0000 7fa2b37fe640 10 client.18231 handle_command_reply: tid=0 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 client.18231 shutdown 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 -- 172.21.15.92:0/3772311021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb811b0 msgr2=0x55608ef5cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb811b0 0x55608ef5cda0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4033000 tx=0x7fa2c4009260 comp rx=0 tx=0).stop 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 -- 172.21.15.92:0/3772311021 shutdown_connections 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608ebaa070 0x55608ef69170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb89390 0x55608ef5d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55608eb689f0 0x55608ef6f130 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/3772311021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb811b0 0x55608ef5cda0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 -- 172.21.15.92:0/3772311021 >> 172.21.15.92:0/3772311021 conn(0x55608eb9e460 msgr2=0x55608ef54880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2b37fe640 0 client.18231 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:22:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 -- 172.21.15.92:0/3772311021 shutdown_connections 2024-09-21T07:22:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 1 -- 172.21.15.92:0/3772311021 wait complete. 2024-09-21T07:22:40.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.492+0000 7fa2e0a90740 20 client.18231 trim_cache size 0 max 16384 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2e0a90740 1 Processor -- start 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2e0a90740 1 -- start start 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef5e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 0x55608ef4ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef4f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41b0f00 con 0x55608ebaa070 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41b2a40 con 0x55608eb89390 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41b15d0 con 0x55608eb811b0 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2d8ab9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef4f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2d8ab9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef4f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41464/0 (socket says 172.21.15.92:41464) 2024-09-21T07:22:40.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.505+0000 7fa2d8ab9640 1 -- 172.21.15.92:0/902283443 learned_addr learned my addr 172.21.15.92:0/902283443 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef5e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 0x55608ef4ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2d8ab9640 1 -- 172.21.15.92:0/902283443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 msgr2=0x55608ef5e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2d8ab9640 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef5e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2d8ab9640 1 -- 172.21.15.92:0/902283443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 msgr2=0x55608ef4ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2d8ab9640 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 0x55608ef4ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2d8ab9640 1 -- 172.21.15.92:0/902283443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55608ef579d0 con 0x55608ebaa070 2024-09-21T07:22:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef5e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 0x55608ef4ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2d8ab9640 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef4f100 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc010370 tx=0x7fa2cc012de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276f412e54840d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2b9ffb640 1 -- 172.21.15.92:0/902283443 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc02a070 con 0x55608ebaa070 2024-09-21T07:22:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2b9ffb640 1 -- 172.21.15.92:0/902283443 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2cc003e00 con 0x55608ebaa070 2024-09-21T07:22:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.506+0000 7fa2b9ffb640 1 -- 172.21.15.92:0/902283443 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc016070 con 0x55608ebaa070 2024-09-21T07:22:40.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.507+0000 7fa2e0a90740 1 -- 172.21.15.92:0/902283443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 msgr2=0x55608ef4f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.507+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef4f100 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc010370 tx=0x7fa2cc012de0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.507+0000 7fa2e0a90740 1 -- 172.21.15.92:0/902283443 shutdown_connections 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.507+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608ebaa070 0x55608ef4f100 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.507+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608eb89390 0x55608ef4ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.507+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/902283443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef5e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.507+0000 7fa2e0a90740 1 -- 172.21.15.92:0/902283443 >> 172.21.15.92:0/902283443 conn(0x55608eb9e460 msgr2=0x55608ef5e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.507+0000 7fa2e0a90740 1 -- 172.21.15.92:0/902283443 shutdown_connections 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.507+0000 7fa2e0a90740 1 -- 172.21.15.92:0/902283443 wait complete. 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.507+0000 7fa2e0a90740 1 -- start start 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2e0a90740 1 Processor -- start 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb89390 0x55608ef60ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2e0a90740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608ebaa070 0x55608ef611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41b2370 con 0x55608eb89390 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41b1ca0 con 0x55608ebaa070 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2e0a90740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41aef00 con 0x55608eb811b0 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2e0a90740 10 client.0 _ll_register_callbacks cb 0x7fa2c4009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb89390 0x55608ef60ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb89390 0x55608ef60ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41478/0 (socket says 172.21.15.92:41478) 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2d37fe640 1 -- 172.21.15.92:0/1844282581 learned_addr learned my addr 172.21.15.92:0/1844282581 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2d37fe640 1 -- 172.21.15.92:0/1844282581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 msgr2=0x55608ef657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2d37fe640 1 -- 172.21.15.92:0/1844282581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608ebaa070 msgr2=0x55608ef611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608ebaa070 0x55608ef611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2d37fe640 1 -- 172.21.15.92:0/1844282581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55608ef618a0 con 0x55608eb89390 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.508+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2d37fe640 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb89390 0x55608ef60ca0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80ad4e0 tx=0x7fa2c80e5350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6699442c165ecab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2b37fe640 1 -- 172.21.15.92:0/1844282581 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8098020 con 0x55608eb89390 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2b37fe640 1 -- 172.21.15.92:0/1844282581 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fa2c80ac7b0 con 0x55608eb89390 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2e0a90740 1 -- 172.21.15.92:0/1844282581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2cc003e00 con 0x55608eb89390 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2b37fe640 1 -- 172.21.15.92:0/1844282581 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2c80ad320 con 0x55608eb89390 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2e0a90740 10 client.18237 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2e0a90740 1 -- 172.21.15.92:0/1844282581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55608efd9930 con 0x55608eb89390 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2b37fe640 1 -- 172.21.15.92:0/1844282581 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2cc003e00 con 0x55608eb89390 2024-09-21T07:22:40.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2b37fe640 1 -- 172.21.15.92:0/1844282581 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa2c80ac220 con 0x55608eb89390 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2e0a90740 10 client.18237 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2e0a90740 10 client.18237 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2e0a90740 20 client.18237 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55608eb3dda0 0x55608efdc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2e0a90740 4 client.18237 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.509+0000 7fa2e0a90740 1 -- 172.21.15.92:0/1844282581 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55608eec58a0 con 0x55608eb3dda0 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.510+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55608eb3dda0 0x55608efdc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.510+0000 7fa2b37fe640 10 client.18237 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.510+0000 7fa2d3fff640 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55608eb3dda0 0x55608efdc090 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eecff1aaf0ca2387 server_cookie=caef6e2e2e9ac3f2 in_seq=0 out_seq=0 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.510+0000 7fa2b37fe640 1 -- 172.21.15.92:0/1844282581 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55608eec58a0 con 0x55608eb3dda0 2024-09-21T07:22:40.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.510+0000 7fa2b37fe640 10 client.18237 handle_command_reply: tid=0 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.510+0000 7fa2e0a90740 1 client.18237 shutdown 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 1 -- 172.21.15.92:0/1844282581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb89390 msgr2=0x55608ef60ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb89390 0x55608ef60ca0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80ad4e0 tx=0x7fa2c80e5350 comp rx=0 tx=0).stop 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 1 -- 172.21.15.92:0/1844282581 shutdown_connections 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55608ebaa070 0x55608ef611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55608eb3dda0 0x55608efdc090 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55608eb89390 0x55608ef60ca0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 1 --2- 172.21.15.92:0/1844282581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55608eb811b0 0x55608ef657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 1 -- 172.21.15.92:0/1844282581 >> 172.21.15.92:0/1844282581 conn(0x55608eb9e460 msgr2=0x55608ef526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2b37fe640 0 client.18237 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 1 -- 172.21.15.92:0/1844282581 shutdown_connections 2024-09-21T07:22:40.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 1 -- 172.21.15.92:0/1844282581 wait complete. 2024-09-21T07:22:40.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2e0a90740 20 client.18237 trim_cache size 0 max 16384 2024-09-21T07:22:40.519 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:22:40.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.511+0000 7fa2da51c640 1 -- 172.21.15.92:0/3851112279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2bc0b66b0 msgr2=0x7fa2bc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2bc0b66b0 0x7fa2bc0b8bc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40057c0 tx=0x7fa2c40058d0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 -- 172.21.15.92:0/3851112279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d4108450 msgr2=0x7fa2d419aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d4108450 0x7fa2d419aa10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c8c0 tx=0x7fa2c800cd80 comp rx=0 tx=0).stop 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 -- 172.21.15.92:0/3851112279 shutdown_connections 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa2bc0b66b0 0x7fa2bc0b8bc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2d4108da0 0x7fa2d419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2d4108450 0x7fa2d419aa10 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 --2- 172.21.15.92:0/3851112279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d4102b10 0x7fa2d419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 -- 172.21.15.92:0/3851112279 >> 172.21.15.92:0/3851112279 conn(0x7fa2d40796d0 msgr2=0x7fa2d4101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 -- 172.21.15.92:0/3851112279 shutdown_connections 2024-09-21T07:22:40.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:40.512+0000 7fa2da51c640 1 -- 172.21.15.92:0/3851112279 wait complete. 2024-09-21T07:22:41.373 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:22:41.623 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:42.084 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:41 smithi092 ceph-mon[30987]: pgmap v634: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:22:42.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:41 smithi169 ceph-mon[33705]: pgmap v634: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:22:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.174+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/1804694730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f4109e10 msgr2=0x7fd8f4110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.174+0000 7fd8fb8a3640 1 --2- 172.21.15.92:0/1804694730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f4109e10 0x7fd8f4110640 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009ca0 tx=0x7fd8ec02a8e0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.174+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/1804694730 shutdown_connections 2024-09-21T07:22:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.174+0000 7fd8fb8a3640 1 --2- 172.21.15.92:0/1804694730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f4109e10 0x7fd8f4110640 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.174+0000 7fd8fb8a3640 1 --2- 172.21.15.92:0/1804694730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f41094c0 0x7fd8f41098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.174+0000 7fd8fb8a3640 1 --2- 172.21.15.92:0/1804694730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f4103b80 0x7fd8f4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.174+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/1804694730 >> 172.21.15.92:0/1804694730 conn(0x7fd8f40ff610 msgr2=0x7fd8f4101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.174+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/1804694730 shutdown_connections 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.174+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/1804694730 wait complete. 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8fb8a3640 1 Processor -- start 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8fb8a3640 1 -- start start 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8fb8a3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f4103b80 0x7fd8f419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8fb8a3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f41094c0 0x7fd8f419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8fb8a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f4109e10 0x7fd8f419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8fb8a3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f4113a40 con 0x7fd8f4109e10 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8fb8a3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f41138c0 con 0x7fd8f41094c0 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8fb8a3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f4113bc0 con 0x7fd8f4103b80 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8f9e40640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f4109e10 0x7fd8f419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8f9e40640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f4109e10 0x7fd8f419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41506/0 (socket says 172.21.15.92:41506) 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.175+0000 7fd8f9e40640 1 -- 172.21.15.92:0/220029696 learned_addr learned my addr 172.21.15.92:0/220029696 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8f963f640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f4103b80 0x7fd8f419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f41094c0 0x7fd8f419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8f9e40640 1 -- 172.21.15.92:0/220029696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f4103b80 msgr2=0x7fd8f419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8f9e40640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f4103b80 0x7fd8f419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8f9e40640 1 -- 172.21.15.92:0/220029696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f41094c0 msgr2=0x7fd8f419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8f9e40640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f41094c0 0x7fd8f419aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8f9e40640 1 -- 172.21.15.92:0/220029696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f41a0400 con 0x7fd8f4109e10 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8f9e40640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f4109e10 0x7fd8f419fcd0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec006010 tx=0x7fd8ec003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8e67fc640 1 -- 172.21.15.92:0/220029696 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec004240 con 0x7fd8f4109e10 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8e67fc640 1 -- 172.21.15.92:0/220029696 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8ec0305e0 con 0x7fd8f4109e10 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/220029696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f41a0690 con 0x7fd8f4109e10 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8e67fc640 1 -- 172.21.15.92:0/220029696 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec03b660 con 0x7fd8f4109e10 2024-09-21T07:22:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.176+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/220029696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f41a6e50 con 0x7fd8f4109e10 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.179+0000 7fd901e17740 1 Processor -- start 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.179+0000 7fd8e67fc640 1 -- 172.21.15.92:0/220029696 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fd8ec030ad0 con 0x7fd8f4109e10 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.179+0000 7fd901e17740 1 -- start start 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.179+0000 7fd901e17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41fe070 0x55f0a45a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.179+0000 7fd901e17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41d51b0 0x55f0a45a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.179+0000 7fd901e17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.179+0000 7fd901e17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f0a451bea0 con 0x55f0a41dd390 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.179+0000 7fd901e17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f0a450b2d0 con 0x55f0a41fe070 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.179+0000 7fd901e17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f0a450f0e0 con 0x55f0a41d51b0 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f8e3e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f8e3e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45a5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41516/0 (socket says 172.21.15.92:41516) 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/3880455152 learned_addr learned my addr 172.21.15.92:0/3880455152 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f963f640 1 --2- 172.21.15.92:0/3880455152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41d51b0 0x55f0a45a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/3880455152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41fe070 0x55f0a45a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/3880455152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41d51b0 msgr2=0x55f0a45a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/3880455152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41d51b0 0x55f0a45a5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8e67fc640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8e00b6680 0x7fd8e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/3880455152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41fe070 msgr2=0x55f0a45a52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/3880455152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41fe070 0x55f0a45a52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/3880455152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a4269650 con 0x55f0a41dd390 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f963f640 1 --2- 172.21.15.92:0/3880455152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41d51b0 0x55f0a45a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f9e40640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8e00b6680 0x7fd8e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/3880455152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45a5d40 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800ae60 tx=0x7fd8e800a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02ef00f726c14e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8e67fc640 1 -- 172.21.15.92:0/220029696 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fd8ec1091e0 con 0x7fd8f4109e10 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8df7fe640 1 -- 172.21.15.92:0/3880455152 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e801b070 con 0x55f0a41dd390 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8df7fe640 1 -- 172.21.15.92:0/3880455152 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8e800edc0 con 0x55f0a41dd390 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.180+0000 7fd8df7fe640 1 -- 172.21.15.92:0/3880455152 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e800f040 con 0x55f0a41dd390 2024-09-21T07:22:42.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.181+0000 7fd901e17740 1 -- 172.21.15.92:0/3880455152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 msgr2=0x55f0a45a5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.181+0000 7fd8f9e40640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8e00b6680 0x7fd8e00b8b90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec1065e0 tx=0x7fd8ec09bf10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.181+0000 7fd901e17740 1 --2- 172.21.15.92:0/3880455152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45a5d40 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800ae60 tx=0x7fd8e800a2b0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.181+0000 7fd901e17740 1 -- 172.21.15.92:0/3880455152 shutdown_connections 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.181+0000 7fd901e17740 1 --2- 172.21.15.92:0/3880455152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45a5d40 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.181+0000 7fd901e17740 1 --2- 172.21.15.92:0/3880455152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41d51b0 0x55f0a45a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.181+0000 7fd901e17740 1 --2- 172.21.15.92:0/3880455152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41fe070 0x55f0a45a52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.181+0000 7fd901e17740 1 -- 172.21.15.92:0/3880455152 >> 172.21.15.92:0/3880455152 conn(0x55f0a41f2460 msgr2=0x55f0a45a31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.181+0000 7fd901e17740 1 -- 172.21.15.92:0/3880455152 shutdown_connections 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.181+0000 7fd901e17740 1 -- 172.21.15.92:0/3880455152 wait complete. 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.182+0000 7fd901e17740 1 -- start start 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.182+0000 7fd901e17740 1 Processor -- start 2024-09-21T07:22:42.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd901e17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41d51b0 0x55f0a45b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd901e17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd901e17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41fe070 0x55f0a45bcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd901e17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f0a436c700 con 0x55f0a41dd390 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd901e17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f0a44a6160 con 0x55f0a41d51b0 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd901e17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f0a45b3aa0 con 0x55f0a41fe070 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd901e17740 10 client.0 _ll_register_callbacks cb 0x55f0a44bf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f963f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f963f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41520/0 (socket says 172.21.15.92:41520) 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f963f640 1 -- 172.21.15.92:0/3510185476 learned_addr learned my addr 172.21.15.92:0/3510185476 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41fe070 0x55f0a45bcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41d51b0 0x55f0a45b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f963f640 1 -- 172.21.15.92:0/3510185476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41fe070 msgr2=0x55f0a45bcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f963f640 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41fe070 0x55f0a45bcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f963f640 1 -- 172.21.15.92:0/3510185476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41d51b0 msgr2=0x55f0a45b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f963f640 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41d51b0 0x55f0a45b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f963f640 1 -- 172.21.15.92:0/3510185476 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0a44d3c90 con 0x55f0a41dd390 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41fe070 0x55f0a45bcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8f963f640 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45b0f20 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000bfd0 tx=0x7fd8f000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67c5a2682171eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8dcff9640 1 -- 172.21.15.92:0/3510185476 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0018020 con 0x55f0a41dd390 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd8dcff9640 1 -- 172.21.15.92:0/3510185476 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fd8f0014870 con 0x55f0a41dd390 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.183+0000 7fd901e17740 1 -- 172.21.15.92:0/3510185476 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e800edc0 con 0x55f0a41dd390 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd8dcff9640 1 -- 172.21.15.92:0/3510185476 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd8f0023050 con 0x55f0a41dd390 2024-09-21T07:22:42.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd901e17740 10 client.18249 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd901e17740 1 -- 172.21.15.92:0/3510185476 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f0a45bf8a0 con 0x55f0a41dd390 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd8dcff9640 1 -- 172.21.15.92:0/3510185476 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8e800edc0 con 0x55f0a41dd390 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd8dcff9640 1 -- 172.21.15.92:0/3510185476 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd8f0013970 con 0x55f0a41dd390 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd901e17740 10 client.18249 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd901e17740 10 client.18249 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd901e17740 20 client.18249 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd901e17740 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55f0a41bc9f0 0x55f0a45c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd901e17740 4 client.18249 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd901e17740 1 -- 172.21.15.92:0/3510185476 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0a451ddf0 con 0x55f0a41bc9f0 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.184+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55f0a41bc9f0 0x55f0a45c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.185+0000 7fd8dcff9640 10 client.18249 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.185+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55f0a41bc9f0 0x55f0a45c2e10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=450cb87d7816da34 server_cookie=a48c13db3eaa07a in_seq=0 out_seq=0 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.185+0000 7fd8dcff9640 1 -- 172.21.15.92:0/3510185476 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0a451ddf0 con 0x55f0a41bc9f0 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.185+0000 7fd8dcff9640 10 client.18249 handle_command_reply: tid=0 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 client.18249 shutdown 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 -- 172.21.15.92:0/3510185476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 msgr2=0x55f0a45b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45b0f20 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000bfd0 tx=0x7fd8f000f670 comp rx=0 tx=0).stop 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 -- 172.21.15.92:0/3510185476 shutdown_connections 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55f0a41bc9f0 0x55f0a45c2e10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41fe070 0x55f0a45bcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41dd390 0x55f0a45b0f20 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd8dcff9640 0 client.18249 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:22:42.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 --2- 172.21.15.92:0/3510185476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41d51b0 0x55f0a45b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 -- 172.21.15.92:0/3510185476 >> 172.21.15.92:0/3510185476 conn(0x55f0a41f2460 msgr2=0x55f0a45a8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:42.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 -- 172.21.15.92:0/3510185476 shutdown_connections 2024-09-21T07:22:42.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 1 -- 172.21.15.92:0/3510185476 wait complete. 2024-09-21T07:22:42.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.186+0000 7fd901e17740 20 client.18249 trim_cache size 0 max 16384 2024-09-21T07:22:42.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd901e17740 1 Processor -- start 2024-09-21T07:22:42.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd901e17740 1 -- start start 2024-09-21T07:22:42.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd901e17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd901e17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41dd390 0x55f0a45a2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd901e17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41fe070 0x55f0a45a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd901e17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f41b1040 con 0x55f0a41d51b0 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd901e17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f41b2b80 con 0x55f0a41fe070 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd901e17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f41b1710 con 0x55f0a41dd390 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd8f8e3e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd8f8e3e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41532/0 (socket says 172.21.15.92:41532) 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.199+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/2246472837 learned_addr learned my addr 172.21.15.92:0/2246472837 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.200+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/2246472837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41dd390 msgr2=0x55f0a45a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.200+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/2246472837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41dd390 0x55f0a45a2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.200+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/2246472837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41fe070 msgr2=0x55f0a45a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.200+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/2246472837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41fe070 0x55f0a45a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.200+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/2246472837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a45a75b0 con 0x55f0a41d51b0 2024-09-21T07:22:42.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.200+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/2246472837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b2610 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800ae60 tx=0x7fd8e800af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30924168e1f4a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.200+0000 7fd8deffd640 1 -- 172.21.15.92:0/2246472837 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e801b040 con 0x55f0a41d51b0 2024-09-21T07:22:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.200+0000 7fd8deffd640 1 -- 172.21.15.92:0/2246472837 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8e8016900 con 0x55f0a41d51b0 2024-09-21T07:22:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.200+0000 7fd8deffd640 1 -- 172.21.15.92:0/2246472837 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e802cba0 con 0x55f0a41d51b0 2024-09-21T07:22:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 -- 172.21.15.92:0/2246472837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 msgr2=0x55f0a45b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 --2- 172.21.15.92:0/2246472837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b2610 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800ae60 tx=0x7fd8e800af50 comp rx=0 tx=0).stop 2024-09-21T07:22:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 -- 172.21.15.92:0/2246472837 shutdown_connections 2024-09-21T07:22:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 --2- 172.21.15.92:0/2246472837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41fe070 0x55f0a45a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 --2- 172.21.15.92:0/2246472837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41dd390 0x55f0a45a2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 --2- 172.21.15.92:0/2246472837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b2610 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 -- 172.21.15.92:0/2246472837 >> 172.21.15.92:0/2246472837 conn(0x55f0a41f2460 msgr2=0x55f0a45b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 -- 172.21.15.92:0/2246472837 shutdown_connections 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 -- 172.21.15.92:0/2246472837 wait complete. 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 -- start start 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.201+0000 7fd901e17740 1 Processor -- start 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd901e17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd901e17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41dd390 0x55f0a45b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd901e17740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41fe070 0x55f0a45b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd901e17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f41b24b0 con 0x55f0a41d51b0 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd901e17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f41b1de0 con 0x55f0a41dd390 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd901e17740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f41af040 con 0x55f0a41fe070 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd901e17740 10 client.0 _ll_register_callbacks cb 0x7fd8f000b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:42.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd8f8e3e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd8f8e3e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41544/0 (socket says 172.21.15.92:41544) 2024-09-21T07:22:42.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/4213998474 learned_addr learned my addr 172.21.15.92:0/4213998474 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:42.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/4213998474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41fe070 msgr2=0x55f0a45b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:42.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd8f963f640 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41dd390 0x55f0a45b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41fe070 0x55f0a45b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/4213998474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41dd390 msgr2=0x55f0a45b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41dd390 0x55f0a45b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd8f8e3e640 1 -- 172.21.15.92:0/4213998474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0a4630c20 con 0x55f0a41d51b0 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.202+0000 7fd8f963f640 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41dd390 0x55f0a45b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd8f8e3e640 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b96e0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800ae30 tx=0x7fd8e800a520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3d1224d3f3f32e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd8dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd8dcff9640 1 -- 172.21.15.92:0/4213998474 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8039020 con 0x55f0a41d51b0 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd901e17740 1 -- 172.21.15.92:0/4213998474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e8016900 con 0x55f0a41d51b0 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd8dcff9640 1 -- 172.21.15.92:0/4213998474 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fd8e8016470 con 0x55f0a41d51b0 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd8dcff9640 1 -- 172.21.15.92:0/4213998474 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd8e801b040 con 0x55f0a41d51b0 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd901e17740 10 client.18255 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd901e17740 1 -- 172.21.15.92:0/4213998474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f0a4631d40 con 0x55f0a41d51b0 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd8dcff9640 1 -- 172.21.15.92:0/4213998474 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8e8016900 con 0x55f0a41d51b0 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd8dcff9640 1 -- 172.21.15.92:0/4213998474 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd8e8021040 con 0x55f0a41d51b0 2024-09-21T07:22:42.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd901e17740 10 client.18255 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd901e17740 10 client.18255 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd901e17740 20 client.18255 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd901e17740 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55f0a4191da0 0x55f0a46341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd901e17740 4 client.18255 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.203+0000 7fd901e17740 1 -- 172.21.15.92:0/4213998474 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f0a45198a0 con 0x55f0a4191da0 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd8f963f640 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55f0a4191da0 0x55f0a46341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd8dcff9640 10 client.18255 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd8f963f640 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55f0a4191da0 0x55f0a46341d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a9ad8aa35a1e7900 server_cookie=4498c86182b51da5 in_seq=0 out_seq=0 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd8dcff9640 1 -- 172.21.15.92:0/4213998474 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f0a45198a0 con 0x55f0a4191da0 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd8dcff9640 10 client.18255 handle_command_reply: tid=0 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd901e17740 1 client.18255 shutdown 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd901e17740 1 -- 172.21.15.92:0/4213998474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 msgr2=0x55f0a45b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd901e17740 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b96e0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800ae30 tx=0x7fd8e800a520 comp rx=0 tx=0).stop 2024-09-21T07:22:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd901e17740 1 -- 172.21.15.92:0/4213998474 shutdown_connections 2024-09-21T07:22:42.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd901e17740 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x55f0a4191da0 0x55f0a46341d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd901e17740 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0a41fe070 0x55f0a45b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd901e17740 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f0a41dd390 0x55f0a45b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd8dcff9640 0 client.18255 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:22:42.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd901e17740 1 --2- 172.21.15.92:0/4213998474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0a41d51b0 0x55f0a45b96e0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.204+0000 7fd901e17740 1 -- 172.21.15.92:0/4213998474 >> 172.21.15.92:0/4213998474 conn(0x55f0a41f2460 msgr2=0x55f0a45b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:42.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd901e17740 1 -- 172.21.15.92:0/4213998474 shutdown_connections 2024-09-21T07:22:42.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd901e17740 1 -- 172.21.15.92:0/4213998474 wait complete. 2024-09-21T07:22:42.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd901e17740 20 client.18255 trim_cache size 0 max 16384 2024-09-21T07:22:42.215 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:22:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/220029696 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8e00b6680 msgr2=0x7fd8e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8e00b6680 0x7fd8e00b8b90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec1065e0 tx=0x7fd8ec09bf10 comp rx=0 tx=0).stop 2024-09-21T07:22:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/220029696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f4109e10 msgr2=0x7fd8f419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f4109e10 0x7fd8f419fcd0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec006010 tx=0x7fd8ec003c90 comp rx=0 tx=0).stop 2024-09-21T07:22:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/220029696 shutdown_connections 2024-09-21T07:22:42.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fd8e00b6680 0x7fd8e00b8b90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f4109e10 0x7fd8f419fcd0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f41094c0 0x7fd8f419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 --2- 172.21.15.92:0/220029696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f4103b80 0x7fd8f419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:42.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/220029696 >> 172.21.15.92:0/220029696 conn(0x7fd8f40ff610 msgr2=0x7fd8f4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:42.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/220029696 shutdown_connections 2024-09-21T07:22:42.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:42.205+0000 7fd8fb8a3640 1 -- 172.21.15.92:0/220029696 wait complete. 2024-09-21T07:22:42.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:41 smithi175 ceph-mon[34064]: pgmap v634: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:22:42.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:22:43.240 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:43.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.715+0000 7fc433bfe640 1 -- 172.21.15.92:0/1306767160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42c108cf0 msgr2=0x7fc42c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:43.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.715+0000 7fc433bfe640 1 --2- 172.21.15.92:0/1306767160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42c108cf0 0x7fc42c10f520 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc424009ca0 tx=0x7fc42402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.715+0000 7fc433bfe640 1 -- 172.21.15.92:0/1306767160 shutdown_connections 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.715+0000 7fc433bfe640 1 --2- 172.21.15.92:0/1306767160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42c108cf0 0x7fc42c10f520 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.715+0000 7fc433bfe640 1 --2- 172.21.15.92:0/1306767160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42c1083a0 0x7fc42c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.715+0000 7fc433bfe640 1 --2- 172.21.15.92:0/1306767160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc42c102a60 0x7fc42c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.715+0000 7fc433bfe640 1 -- 172.21.15.92:0/1306767160 >> 172.21.15.92:0/1306767160 conn(0x7fc42c079730 msgr2=0x7fc42c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.715+0000 7fc433bfe640 1 -- 172.21.15.92:0/1306767160 shutdown_connections 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.715+0000 7fc433bfe640 1 -- 172.21.15.92:0/1306767160 wait complete. 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc433bfe640 1 Processor -- start 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc433bfe640 1 -- start start 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc433bfe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42c102a60 0x7fc42c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc433bfe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc42c1083a0 0x7fc42c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc433bfe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42c108cf0 0x7fc42c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc433bfe640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1139c0 con 0x7fc42c102a60 2024-09-21T07:22:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc433bfe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c113840 con 0x7fc42c1083a0 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc433bfe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c113b40 con 0x7fc42c108cf0 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc43199a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42c102a60 0x7fc42c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc43199a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42c102a60 0x7fc42c19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41560/0 (socket says 172.21.15.92:41560) 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc43199a640 1 -- 172.21.15.92:0/3123467494 learned_addr learned my addr 172.21.15.92:0/3123467494 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc431199640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc42c1083a0 0x7fc42c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc43219b640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42c108cf0 0x7fc42c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc43199a640 1 -- 172.21.15.92:0/3123467494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42c108cf0 msgr2=0x7fc42c19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc43199a640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42c108cf0 0x7fc42c19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc43199a640 1 -- 172.21.15.92:0/3123467494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc42c1083a0 msgr2=0x7fc42c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc43199a640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc42c1083a0 0x7fc42c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.716+0000 7fc43199a640 1 -- 172.21.15.92:0/3123467494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c1a02e0 con 0x7fc42c102a60 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.717+0000 7fc431199640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc42c1083a0 0x7fc42c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.717+0000 7fc43199a640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42c102a60 0x7fc42c19a430 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00b4a0 tx=0x7fc41c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:43.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.717+0000 7fc422ffd640 1 -- 172.21.15.92:0/3123467494 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c014070 con 0x7fc42c102a60 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.717+0000 7fc422ffd640 1 -- 172.21.15.92:0/3123467494 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc41c010aa0 con 0x7fc42c102a60 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.717+0000 7fc433bfe640 1 -- 172.21.15.92:0/3123467494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42c1a05d0 con 0x7fc42c102a60 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.717+0000 7fc422ffd640 1 -- 172.21.15.92:0/3123467494 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c017b70 con 0x7fc42c102a60 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.717+0000 7fc433bfe640 1 -- 172.21.15.92:0/3123467494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42c1a6df0 con 0x7fc42c102a60 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.719+0000 7fc422ffd640 1 -- 172.21.15.92:0/3123467494 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fc41c017070 con 0x7fc42c102a60 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc43a172740 1 Processor -- start 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc43a172740 1 -- start start 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc43a172740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cfa070 0x55e4a80a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc43a172740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cd11b0 0x55e4a80a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc43a172740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80a2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc43a172740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e4a8017ea0 con 0x55e4a7cd9390 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc43a172740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e4a80072d0 con 0x55e4a7cfa070 2024-09-21T07:22:43.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc43a172740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e4a800b0e0 con 0x55e4a7cd11b0 2024-09-21T07:22:43.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc431199640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc431199640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80a2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41572/0 (socket says 172.21.15.92:41572) 2024-09-21T07:22:43.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc431199640 1 -- 172.21.15.92:0/3042351302 learned_addr learned my addr 172.21.15.92:0/3042351302 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:43.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc43199a640 1 --2- 172.21.15.92:0/3042351302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cd11b0 0x55e4a80a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc43219b640 1 --2- 172.21.15.92:0/3042351302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cfa070 0x55e4a80a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.720+0000 7fc422ffd640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4180b66b0 0x7fc4180b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc431199640 1 -- 172.21.15.92:0/3042351302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cd11b0 msgr2=0x55e4a80a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:43.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc431199640 1 --2- 172.21.15.92:0/3042351302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cd11b0 0x55e4a80a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc431199640 1 -- 172.21.15.92:0/3042351302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cfa070 msgr2=0x55e4a80a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc431199640 1 --2- 172.21.15.92:0/3042351302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cfa070 0x55e4a80a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc431199640 1 -- 172.21.15.92:0/3042351302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4a7d65650 con 0x55e4a7cd9390 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc43219b640 1 --2- 172.21.15.92:0/3042351302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cfa070 0x55e4a80a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc43219b640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4180b66b0 0x7fc4180b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc422ffd640 1 -- 172.21.15.92:0/3123467494 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fc41c0e6e20 con 0x7fc42c102a60 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc431199640 1 --2- 172.21.15.92:0/3042351302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80a2120 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fc428008c00 tx=0x7fc42800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afdd534117b9725 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc417fff640 1 -- 172.21.15.92:0/3042351302 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428014070 con 0x55e4a7cd9390 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc417fff640 1 -- 172.21.15.92:0/3042351302 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4280047a0 con 0x55e4a7cd9390 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.721+0000 7fc417fff640 1 -- 172.21.15.92:0/3042351302 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428010690 con 0x55e4a7cd9390 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43a172740 1 -- 172.21.15.92:0/3042351302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 msgr2=0x55e4a80a2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43a172740 1 --2- 172.21.15.92:0/3042351302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80a2120 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fc428008c00 tx=0x7fc42800e720 comp rx=0 tx=0).stop 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43219b640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4180b66b0 0x7fc4180b8bc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc424005cc0 tx=0x7fc4240095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:43.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43a172740 1 -- 172.21.15.92:0/3042351302 shutdown_connections 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43a172740 1 --2- 172.21.15.92:0/3042351302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80a2120 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43a172740 1 --2- 172.21.15.92:0/3042351302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cd11b0 0x55e4a80a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43a172740 1 --2- 172.21.15.92:0/3042351302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cfa070 0x55e4a80a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43a172740 1 -- 172.21.15.92:0/3042351302 >> 172.21.15.92:0/3042351302 conn(0x55e4a7cee460 msgr2=0x55e4a809f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43a172740 1 -- 172.21.15.92:0/3042351302 shutdown_connections 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43a172740 1 -- 172.21.15.92:0/3042351302 wait complete. 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.722+0000 7fc43a172740 1 -- start start 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc43a172740 1 Processor -- start 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc43a172740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 0x55e4a80acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc43a172740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc43a172740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cfa070 0x55e4a80b9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc43a172740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e4a7e68700 con 0x55e4a7cd9390 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc43a172740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e4a7fa2160 con 0x55e4a7cd11b0 2024-09-21T07:22:43.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc43a172740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e4a80afe80 con 0x55e4a7cfa070 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc43a172740 10 client.0 _ll_register_callbacks cb 0x55e4a7fbb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc431199640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc431199640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41580/0 (socket says 172.21.15.92:41580) 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc431199640 1 -- 172.21.15.92:0/953716829 learned_addr learned my addr 172.21.15.92:0/953716829 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc43219b640 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cfa070 0x55e4a80b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc43199a640 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 0x55e4a80acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc431199640 1 -- 172.21.15.92:0/953716829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cfa070 msgr2=0x55e4a80b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc431199640 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cfa070 0x55e4a80b9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc431199640 1 -- 172.21.15.92:0/953716829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 msgr2=0x55e4a80acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc431199640 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 0x55e4a80acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.723+0000 7fc431199640 1 -- 172.21.15.92:0/953716829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4a7fcfc90 con 0x55e4a7cd9390 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc43219b640 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cfa070 0x55e4a80b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc43199a640 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 0x55e4a80acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:43.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc431199640 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80ad2e0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc428008fd0 tx=0x7fc4280050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9bce7269b103de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc4157fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc4157fa640 1 -- 172.21.15.92:0/953716829 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428014030 con 0x55e4a7cd9390 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc4157fa640 1 -- 172.21.15.92:0/953716829 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fc428005450 con 0x55e4a7cd9390 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc43a172740 1 -- 172.21.15.92:0/953716829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4280047a0 con 0x55e4a7cd9390 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc4157fa640 1 -- 172.21.15.92:0/953716829 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc428005650 con 0x55e4a7cd9390 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc43a172740 10 client.18267 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc43a172740 1 -- 172.21.15.92:0/953716829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e4a80bbbf0 con 0x55e4a7cd9390 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc4157fa640 1 -- 172.21.15.92:0/953716829 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4280047a0 con 0x55e4a7cd9390 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.724+0000 7fc4157fa640 1 -- 172.21.15.92:0/953716829 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc428003ab0 con 0x55e4a7cd9390 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.725+0000 7fc43a172740 10 client.18267 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.725+0000 7fc43a172740 10 client.18267 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.725+0000 7fc43a172740 20 client.18267 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.725+0000 7fc43a172740 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55e4a7cb89f0 0x55e4a80bef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.725+0000 7fc43a172740 4 client.18267 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:43.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.725+0000 7fc43a172740 1 -- 172.21.15.92:0/953716829 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4a8019df0 con 0x55e4a7cb89f0 2024-09-21T07:22:43.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.725+0000 7fc43199a640 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55e4a7cb89f0 0x55e4a80bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.725+0000 7fc4157fa640 10 client.18267 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:22:43.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.725+0000 7fc43199a640 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55e4a7cb89f0 0x55e4a80bef50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29ff5fbf51d11896 server_cookie=eabd7089cb5ca72a in_seq=0 out_seq=0 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.726+0000 7fc4157fa640 1 -- 172.21.15.92:0/953716829 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e4a8019df0 con 0x55e4a7cb89f0 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.726+0000 7fc4157fa640 10 client.18267 handle_command_reply: tid=0 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.726+0000 7fc43a172740 1 client.18267 shutdown 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.726+0000 7fc43a172740 1 -- 172.21.15.92:0/953716829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 msgr2=0x55e4a80ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.726+0000 7fc43a172740 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80ad2e0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc428008fd0 tx=0x7fc4280050d0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.727+0000 7fc43a172740 1 -- 172.21.15.92:0/953716829 shutdown_connections 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.727+0000 7fc43a172740 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55e4a7cb89f0 0x55e4a80bef50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.727+0000 7fc43a172740 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cfa070 0x55e4a80b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.727+0000 7fc43a172740 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd9390 0x55e4a80ad2e0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.727+0000 7fc43a172740 1 --2- 172.21.15.92:0/953716829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 0x55e4a80acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.727+0000 7fc4157fa640 0 client.18267 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:22:43.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.727+0000 7fc43a172740 1 -- 172.21.15.92:0/953716829 >> 172.21.15.92:0/953716829 conn(0x55e4a7cee460 msgr2=0x55e4a80a4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:43.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.727+0000 7fc43a172740 1 -- 172.21.15.92:0/953716829 shutdown_connections 2024-09-21T07:22:43.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.727+0000 7fc43a172740 1 -- 172.21.15.92:0/953716829 wait complete. 2024-09-21T07:22:43.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.727+0000 7fc43a172740 20 client.18267 trim_cache size 0 max 16384 2024-09-21T07:22:43.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43a172740 1 Processor -- start 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43a172740 1 -- start start 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43a172740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd11b0 0x55e4a809ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43a172740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd9390 0x55e4a809f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43a172740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cfa070 0x55e4a80a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43a172740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1b0fd0 con 0x55e4a7cd11b0 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43a172740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1b2b10 con 0x55e4a7cd9390 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43a172740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1b16a0 con 0x55e4a7cfa070 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43199a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd11b0 0x55e4a809ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43199a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd11b0 0x55e4a809ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41588/0 (socket says 172.21.15.92:41588) 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43199a640 1 -- 172.21.15.92:0/699518052 learned_addr learned my addr 172.21.15.92:0/699518052 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc431199640 1 --2- 172.21.15.92:0/699518052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd9390 0x55e4a809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43199a640 1 -- 172.21.15.92:0/699518052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cfa070 msgr2=0x55e4a80a9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43199a640 1 --2- 172.21.15.92:0/699518052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cfa070 0x55e4a80a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43199a640 1 -- 172.21.15.92:0/699518052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd9390 msgr2=0x55e4a809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43199a640 1 --2- 172.21.15.92:0/699518052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd9390 0x55e4a809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc43199a640 1 -- 172.21.15.92:0/699518052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4a809fe80 con 0x55e4a7cd11b0 2024-09-21T07:22:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.740+0000 7fc431199640 1 --2- 172.21.15.92:0/699518052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd9390 0x55e4a809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.741+0000 7fc43199a640 1 --2- 172.21.15.92:0/699518052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd11b0 0x55e4a809ebc0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0e4770 tx=0x7fc41c0d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d90085bbfebebc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.741+0000 7fc4177fe640 1 -- 172.21.15.92:0/699518052 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c01e070 con 0x55e4a7cd11b0 2024-09-21T07:22:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.741+0000 7fc4177fe640 1 -- 172.21.15.92:0/699518052 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc41c017360 con 0x55e4a7cd11b0 2024-09-21T07:22:43.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.741+0000 7fc4177fe640 1 -- 172.21.15.92:0/699518052 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0b1350 con 0x55e4a7cd11b0 2024-09-21T07:22:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.741+0000 7fc43a172740 1 -- 172.21.15.92:0/699518052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd11b0 msgr2=0x55e4a809ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.741+0000 7fc43a172740 1 --2- 172.21.15.92:0/699518052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd11b0 0x55e4a809ebc0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0e4770 tx=0x7fc41c0d0040 comp rx=0 tx=0).stop 2024-09-21T07:22:43.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 -- 172.21.15.92:0/699518052 shutdown_connections 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 --2- 172.21.15.92:0/699518052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cfa070 0x55e4a80a9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 --2- 172.21.15.92:0/699518052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd9390 0x55e4a809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 --2- 172.21.15.92:0/699518052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cd11b0 0x55e4a809ebc0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 -- 172.21.15.92:0/699518052 >> 172.21.15.92:0/699518052 conn(0x55e4a7cee460 msgr2=0x55e4a80ab620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 -- 172.21.15.92:0/699518052 shutdown_connections 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 -- 172.21.15.92:0/699518052 wait complete. 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 -- start start 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 Processor -- start 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 0x55e4a80b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cd9390 0x55e4a80b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.742+0000 7fc43a172740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cfa070 0x55e4a8128780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43a172740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1b2440 con 0x55e4a7cfa070 2024-09-21T07:22:43.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43a172740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1b1d70 con 0x55e4a7cd11b0 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43a172740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1aefd0 con 0x55e4a7cd9390 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43a172740 10 client.0 _ll_register_callbacks cb 0x7fc41c0a8f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43219b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cfa070 0x55e4a8128780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43199a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 0x55e4a80b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43219b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cfa070 0x55e4a8128780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41598/0 (socket says 172.21.15.92:41598) 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43219b640 1 -- 172.21.15.92:0/1184318697 learned_addr learned my addr 172.21.15.92:0/1184318697 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc431199640 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cd9390 0x55e4a80b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43219b640 1 -- 172.21.15.92:0/1184318697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cd9390 msgr2=0x55e4a80b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43219b640 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cd9390 0x55e4a80b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43219b640 1 -- 172.21.15.92:0/1184318697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 msgr2=0x55e4a80b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:43.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43219b640 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 0x55e4a80b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43219b640 1 -- 172.21.15.92:0/1184318697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4a80b21f0 con 0x55e4a7cfa070 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43219b640 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cfa070 0x55e4a8128780 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc424009ca0 tx=0x7fc424005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5c01333d377a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc4157fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc4157fa640 1 -- 172.21.15.92:0/1184318697 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424004450 con 0x55e4a7cfa070 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc4157fa640 1 -- 172.21.15.92:0/1184318697 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fc4240045f0 con 0x55e4a7cfa070 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.743+0000 7fc43a172740 1 -- 172.21.15.92:0/1184318697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e4a80158a0 con 0x55e4a7cfa070 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc4157fa640 1 -- 172.21.15.92:0/1184318697 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc4240047f0 con 0x55e4a7cfa070 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc43a172740 10 client.18273 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc43a172740 1 -- 172.21.15.92:0/1184318697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e4a812e0c0 con 0x55e4a7cfa070 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc4157fa640 1 -- 172.21.15.92:0/1184318697 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e4a80158a0 con 0x55e4a7cfa070 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc4157fa640 1 -- 172.21.15.92:0/1184318697 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc42403d6e0 con 0x55e4a7cfa070 2024-09-21T07:22:43.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc43a172740 10 client.18273 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc43a172740 10 client.18273 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc43a172740 20 client.18273 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc43a172740 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55e4a7c8dda0 0x55e4a8130930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc43a172740 4 client.18273 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc43a172740 1 -- 172.21.15.92:0/1184318697 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e4a8012cd0 con 0x55e4a7c8dda0 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.744+0000 7fc43199a640 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55e4a7c8dda0 0x55e4a8130930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc4157fa640 10 client.18273 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43199a640 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55e4a7c8dda0 0x55e4a8130930 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=664cf806f5304db server_cookie=49cc69746f0e6b79 in_seq=0 out_seq=0 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc4157fa640 1 -- 172.21.15.92:0/1184318697 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e4a8012cd0 con 0x55e4a7c8dda0 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc4157fa640 10 client.18273 handle_command_reply: tid=0 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 client.18273 shutdown 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 -- 172.21.15.92:0/1184318697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cfa070 msgr2=0x55e4a8128780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:43.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cfa070 0x55e4a8128780 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc424009ca0 tx=0x7fc424005c50 comp rx=0 tx=0).stop 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 -- 172.21.15.92:0/1184318697 shutdown_connections 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x55e4a7c8dda0 0x55e4a8130930 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4a7cfa070 0x55e4a8128780 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4a7cd9390 0x55e4a80b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 --2- 172.21.15.92:0/1184318697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a7cd11b0 0x55e4a80b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc4157fa640 0 client.18273 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 -- 172.21.15.92:0/1184318697 >> 172.21.15.92:0/1184318697 conn(0x55e4a7cee460 msgr2=0x55e4a80ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 -- 172.21.15.92:0/1184318697 shutdown_connections 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 1 -- 172.21.15.92:0/1184318697 wait complete. 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.745+0000 7fc43a172740 20 client.18273 trim_cache size 0 max 16384 2024-09-21T07:22:43.752 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:22:43.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 -- 172.21.15.92:0/3123467494 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4180b66b0 msgr2=0x7fc4180b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:43.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4180b66b0 0x7fc4180b8bc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc424005cc0 tx=0x7fc4240095c0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 -- 172.21.15.92:0/3123467494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42c102a60 msgr2=0x7fc42c19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:43.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42c102a60 0x7fc42c19a430 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00b4a0 tx=0x7fc41c00b960 comp rx=0 tx=0).stop 2024-09-21T07:22:43.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 -- 172.21.15.92:0/3123467494 shutdown_connections 2024-09-21T07:22:43.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc4180b66b0 0x7fc4180b8bc0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42c108cf0 0x7fc42c19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc42c1083a0 0x7fc42c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 --2- 172.21.15.92:0/3123467494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc42c102a60 0x7fc42c19a430 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:43.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 -- 172.21.15.92:0/3123467494 >> 172.21.15.92:0/3123467494 conn(0x7fc42c079730 msgr2=0x7fc42c105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:43.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 -- 172.21.15.92:0/3123467494 shutdown_connections 2024-09-21T07:22:43.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:43.746+0000 7fc433bfe640 1 -- 172.21.15.92:0/3123467494 wait complete. 2024-09-21T07:22:44.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:43 smithi092 ceph-mon[30987]: pgmap v635: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:22:44.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:43 smithi169 ceph-mon[33705]: pgmap v635: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:22:44.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:43 smithi175 ceph-mon[34064]: pgmap v635: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:22:44.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:22:44.902 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:45.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.354+0000 7ff3d09ef640 1 -- 172.21.15.92:0/1140189605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3cc108d70 msgr2=0x7ff3cc10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.354+0000 7ff3d09ef640 1 --2- 172.21.15.92:0/1140189605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3cc108d70 0x7ff3cc10f5a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009ca0 tx=0x7ff3c402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.354+0000 7ff3d09ef640 1 -- 172.21.15.92:0/1140189605 shutdown_connections 2024-09-21T07:22:45.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.354+0000 7ff3d09ef640 1 --2- 172.21.15.92:0/1140189605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3cc108d70 0x7ff3cc10f5a0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.354+0000 7ff3d09ef640 1 --2- 172.21.15.92:0/1140189605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc108420 0x7ff3cc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.354+0000 7ff3d09ef640 1 --2- 172.21.15.92:0/1140189605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3cc102ae0 0x7ff3cc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.354+0000 7ff3d09ef640 1 -- 172.21.15.92:0/1140189605 >> 172.21.15.92:0/1140189605 conn(0x7ff3cc079770 msgr2=0x7ff3cc079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.354+0000 7ff3d09ef640 1 -- 172.21.15.92:0/1140189605 shutdown_connections 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.354+0000 7ff3d09ef640 1 -- 172.21.15.92:0/1140189605 wait complete. 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.355+0000 7ff3d09ef640 1 Processor -- start 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.355+0000 7ff3d09ef640 1 -- start start 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3d09ef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3cc102ae0 0x7ff3cc199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3d09ef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc108420 0x7ff3cc1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3d09ef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3cc108d70 0x7ff3cc19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3d09ef640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc112930 con 0x7ff3cc102ae0 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3d09ef640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1127b0 con 0x7ff3cc108d70 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3d09ef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc112ab0 con 0x7ff3cc108420 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3ca59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3cc102ae0 0x7ff3cc199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3ca59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3cc102ae0 0x7ff3cc199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41626/0 (socket says 172.21.15.92:41626) 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3ca59c640 1 -- 172.21.15.92:0/630070515 learned_addr learned my addr 172.21.15.92:0/630070515 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3c9d9b640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc108420 0x7ff3cc1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3cc108d70 0x7ff3cc19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3ca59c640 1 -- 172.21.15.92:0/630070515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc108420 msgr2=0x7ff3cc1998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3ca59c640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc108420 0x7ff3cc1998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3ca59c640 1 -- 172.21.15.92:0/630070515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3cc108d70 msgr2=0x7ff3cc19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3ca59c640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3cc108d70 0x7ff3cc19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.356+0000 7ff3ca59c640 1 -- 172.21.15.92:0/630070515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc19f270 con 0x7ff3cc102ae0 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.357+0000 7ff3ca59c640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3cc102ae0 0x7ff3cc199300 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00d950 tx=0x7ff3bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.357+0000 7ff3bb7fe640 1 -- 172.21.15.92:0/630070515 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc017070 con 0x7ff3cc102ae0 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.357+0000 7ff3bb7fe640 1 -- 172.21.15.92:0/630070515 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3bc009c30 con 0x7ff3cc102ae0 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.357+0000 7ff3bb7fe640 1 -- 172.21.15.92:0/630070515 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00f620 con 0x7ff3cc102ae0 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.357+0000 7ff3d09ef640 1 -- 172.21.15.92:0/630070515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3cc19f560 con 0x7ff3cc102ae0 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.357+0000 7ff3d09ef640 1 -- 172.21.15.92:0/630070515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3cc06bb60 con 0x7ff3cc102ae0 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3d6f63740 1 Processor -- start 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3d6f63740 1 -- start start 2024-09-21T07:22:45.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3bb7fe640 1 -- 172.21.15.92:0/630070515 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7ff3bc010460 con 0x7ff3cc102ae0 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f1fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b57390 0x55f255f20120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f255e95ea0 con 0x55f255b78070 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f255e852d0 con 0x55f255b4f1b0 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f255e890e0 con 0x55f255b57390 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3cad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3cad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41628/0 (socket says 172.21.15.92:41628) 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.360+0000 7ff3cad9d640 1 -- 172.21.15.92:0/2637555812 learned_addr learned my addr 172.21.15.92:0/2637555812 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3ca59c640 1 --2- 172.21.15.92:0/2637555812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f1fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3c9d9b640 1 --2- 172.21.15.92:0/2637555812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b57390 0x55f255f20120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3cad9d640 1 -- 172.21.15.92:0/2637555812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b57390 msgr2=0x55f255f20120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/2637555812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b57390 0x55f255f20120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3cad9d640 1 -- 172.21.15.92:0/2637555812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 msgr2=0x55f255f1fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/2637555812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f1fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3cad9d640 1 -- 172.21.15.92:0/2637555812 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f255be3650 con 0x55f255b78070 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3bb7fe640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff3b40b6700 0x7ff3b40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/2637555812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1f6a0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009ca0 tx=0x7ff3c40094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd2fae0b5612c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3ca59c640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff3b40b6700 0x7ff3b40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3b8ff9640 1 -- 172.21.15.92:0/2637555812 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4031980 con 0x55f255b78070 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3bb7fe640 1 -- 172.21.15.92:0/630070515 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7ff3bc0e7670 con 0x7ff3cc102ae0 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3b8ff9640 1 -- 172.21.15.92:0/2637555812 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3c4036030 con 0x55f255b78070 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.361+0000 7ff3b8ff9640 1 -- 172.21.15.92:0/2637555812 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40044e0 con 0x55f255b78070 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.362+0000 7ff3ca59c640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff3b40b6700 0x7ff3b40b8c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc0e4a70 tx=0x7ff3bc094040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.362+0000 7ff3d6f63740 1 -- 172.21.15.92:0/2637555812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 msgr2=0x55f255f1f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.362+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/2637555812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1f6a0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009ca0 tx=0x7ff3c40094a0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.362+0000 7ff3d6f63740 1 -- 172.21.15.92:0/2637555812 shutdown_connections 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.362+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/2637555812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b57390 0x55f255f20120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.362+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/2637555812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f1fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.362+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/2637555812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1f6a0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.362+0000 7ff3d6f63740 1 -- 172.21.15.92:0/2637555812 >> 172.21.15.92:0/2637555812 conn(0x55f255b6c460 msgr2=0x55f255f1d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.362+0000 7ff3d6f63740 1 -- 172.21.15.92:0/2637555812 shutdown_connections 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.362+0000 7ff3d6f63740 1 -- 172.21.15.92:0/2637555812 wait complete. 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3d6f63740 1 -- start start 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3d6f63740 1 Processor -- start 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b4f1b0 0x55f255f2ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b57390 0x55f255f2b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f36fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f255ce6700 con 0x55f255b78070 2024-09-21T07:22:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f255e20160 con 0x55f255b57390 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f255f2dca0 con 0x55f255b4f1b0 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3d6f63740 10 client.0 _ll_register_callbacks cb 0x55f255e399e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3cad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f36fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3cad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f36fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41634/0 (socket says 172.21.15.92:41634) 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3cad9d640 1 -- 172.21.15.92:0/3435996501 learned_addr learned my addr 172.21.15.92:0/3435996501 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b4f1b0 0x55f255f2ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.363+0000 7ff3c9d9b640 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b57390 0x55f255f2b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3cad9d640 1 -- 172.21.15.92:0/3435996501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b4f1b0 msgr2=0x55f255f2ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b4f1b0 0x55f255f2ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3cad9d640 1 -- 172.21.15.92:0/3435996501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b57390 msgr2=0x55f255f2b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b57390 0x55f255f2b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3cad9d640 1 -- 172.21.15.92:0/3435996501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f255e4dc90 con 0x55f255b78070 2024-09-21T07:22:45.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3c9d9b640 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b57390 0x55f255f2b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f36fc0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40049d0 tx=0x7ff3c4004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375854cbb2eda30a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/3435996501 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4058060 con 0x55f255b78070 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/3435996501 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7ff3c4003b80 con 0x55f255b78070 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3435996501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c4036030 con 0x55f255b78070 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/3435996501 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3c405f050 con 0x55f255b78070 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3d6f63740 10 client.18285 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3435996501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f255f399b0 con 0x55f255b78070 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/3435996501 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3c4036030 con 0x55f255b78070 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/3435996501 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff3c4050070 con 0x55f255b78070 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3d6f63740 10 client.18285 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3d6f63740 10 client.18285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.364+0000 7ff3d6f63740 20 client.18285 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:45.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.365+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f255b369f0 0x55f255f3cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.365+0000 7ff3d6f63740 4 client.18285 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.365+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3435996501 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f255e97df0 con 0x55f255b369f0 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.365+0000 7ff3c9d9b640 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f255b369f0 0x55f255f3cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.365+0000 7ff3b1ffb640 10 client.18285 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.365+0000 7ff3c9d9b640 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f255b369f0 0x55f255f3cd10 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c815da4c85099d57 server_cookie=a00438f2ea5f3eec in_seq=0 out_seq=0 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/3435996501 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f255e97df0 con 0x55f255b369f0 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3b1ffb640 10 client.18285 handle_command_reply: tid=0 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 client.18285 shutdown 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3435996501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 msgr2=0x55f255f36fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f36fc0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40049d0 tx=0x7ff3c4004180 comp rx=0 tx=0).stop 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3435996501 shutdown_connections 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f255b369f0 0x55f255f3cd10 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f36fc0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b57390 0x55f255f2b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3b1ffb640 0 client.18285 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/3435996501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b4f1b0 0x55f255f2ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3435996501 >> 172.21.15.92:0/3435996501 conn(0x55f255b6c460 msgr2=0x55f255f22880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3435996501 shutdown_connections 2024-09-21T07:22:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3435996501 wait complete. 2024-09-21T07:22:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.366+0000 7ff3d6f63740 20 client.18285 trim_cache size 0 max 16384 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3d6f63740 1 Processor -- start 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3d6f63740 1 -- start start 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f21090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b57390 0x55f255f2c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1b3000 con 0x55f255b78070 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1b4b40 con 0x55f255b4f1b0 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1b36d0 con 0x55f255b57390 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3cad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3cad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41650/0 (socket says 172.21.15.92:41650) 2024-09-21T07:22:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3cad9d640 1 -- 172.21.15.92:0/3145163304 learned_addr learned my addr 172.21.15.92:0/3145163304 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3c9d9b640 1 --2- 172.21.15.92:0/3145163304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b57390 0x55f255f2c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/3145163304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f21090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3cad9d640 1 -- 172.21.15.92:0/3145163304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b57390 msgr2=0x55f255f2c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/3145163304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b57390 0x55f255f2c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3cad9d640 1 -- 172.21.15.92:0/3145163304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 msgr2=0x55f255f21090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/3145163304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f21090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.380+0000 7ff3cad9d640 1 -- 172.21.15.92:0/3145163304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f255f29260 con 0x55f255b78070 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.381+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/3145163304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1cbc0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4005e30 tx=0x7ff3c4031f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a251b70abc52e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.381+0000 7ff3b3fff640 1 -- 172.21.15.92:0/3145163304 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4009360 con 0x55f255b78070 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.381+0000 7ff3b3fff640 1 -- 172.21.15.92:0/3145163304 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3c4036040 con 0x55f255b78070 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.381+0000 7ff3b3fff640 1 -- 172.21.15.92:0/3145163304 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4003b80 con 0x55f255b78070 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.381+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3145163304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 msgr2=0x55f255f1cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.381+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/3145163304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1cbc0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4005e30 tx=0x7ff3c4031f30 comp rx=0 tx=0).stop 2024-09-21T07:22:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3145163304 shutdown_connections 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/3145163304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b78070 0x55f255f1cbc0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/3145163304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b57390 0x55f255f2c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/3145163304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f21090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3145163304 >> 172.21.15.92:0/3145163304 conn(0x55f255b6c460 msgr2=0x55f255f2c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3145163304 shutdown_connections 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 -- 172.21.15.92:0/3145163304 wait complete. 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 -- start start 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 Processor -- start 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f333f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b57390 0x55f255f2e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b78070 0x55f255f2ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1b4470 con 0x55f255b57390 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1b3da0 con 0x55f255b4f1b0 2024-09-21T07:22:45.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.382+0000 7ff3d6f63740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1b1000 con 0x55f255b78070 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3d6f63740 10 client.0 _ll_register_callbacks cb 0x7ff3c4031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3c9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b57390 0x55f255f2e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3c9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b57390 0x55f255f2e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41662/0 (socket says 172.21.15.92:41662) 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3c9d9b640 1 -- 172.21.15.92:0/207104892 learned_addr learned my addr 172.21.15.92:0/207104892 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b78070 0x55f255f2ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3c9d9b640 1 -- 172.21.15.92:0/207104892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b78070 msgr2=0x55f255f2ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3c9d9b640 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b78070 0x55f255f2ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3c9d9b640 1 -- 172.21.15.92:0/207104892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 msgr2=0x55f255f333f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3c9d9b640 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f333f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3c9d9b640 1 -- 172.21.15.92:0/207104892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f255f2f320 con 0x55f255b57390 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f333f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3c9d9b640 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b57390 0x55f255f2e8a0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0005fd0 tx=0x7ff3c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b4756f4c436a86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:45.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/207104892 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0012450 con 0x55f255b57390 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/207104892 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7ff3c00125f0 con 0x55f255b57390 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3d6f63740 1 -- 172.21.15.92:0/207104892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c4036040 con 0x55f255b57390 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/207104892 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3c002e050 con 0x55f255b57390 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3d6f63740 10 client.18291 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.383+0000 7ff3d6f63740 1 -- 172.21.15.92:0/207104892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f255fa71c0 con 0x55f255b57390 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.384+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/207104892 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3c4036040 con 0x55f255b57390 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.384+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/207104892 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff3c00238a0 con 0x55f255b57390 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.384+0000 7ff3d6f63740 10 client.18291 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.384+0000 7ff3d6f63740 10 client.18291 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.384+0000 7ff3d6f63740 20 client.18291 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:45.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.384+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f255b0bda0 0x55f255fa99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.384+0000 7ff3d6f63740 4 client.18291 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.384+0000 7ff3d6f63740 1 -- 172.21.15.92:0/207104892 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f255e938a0 con 0x55f255b0bda0 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.384+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f255b0bda0 0x55f255fa99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3cad9d640 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f255b0bda0 0x55f255fa99b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5df53bbda6a3017 server_cookie=bd4c07f1200dafac in_seq=0 out_seq=0 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3b1ffb640 10 client.18291 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3b1ffb640 1 -- 172.21.15.92:0/207104892 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f255e938a0 con 0x55f255b0bda0 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3b1ffb640 10 client.18291 handle_command_reply: tid=0 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 client.18291 shutdown 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 -- 172.21.15.92:0/207104892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b57390 msgr2=0x55f255f2e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b57390 0x55f255f2e8a0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0005fd0 tx=0x7ff3c000be30 comp rx=0 tx=0).stop 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 -- 172.21.15.92:0/207104892 shutdown_connections 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f255b0bda0 0x55f255fa99b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f255b78070 0x55f255f2ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255b57390 0x55f255f2e8a0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3b1ffb640 0 client.18291 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:45.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 --2- 172.21.15.92:0/207104892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f255b4f1b0 0x55f255f333f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 -- 172.21.15.92:0/207104892 >> 172.21.15.92:0/207104892 conn(0x55f255b6c460 msgr2=0x55f255f20f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 -- 172.21.15.92:0/207104892 shutdown_connections 2024-09-21T07:22:45.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 1 -- 172.21.15.92:0/207104892 wait complete. 2024-09-21T07:22:45.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.385+0000 7ff3d6f63740 20 client.18291 trim_cache size 0 max 16384 2024-09-21T07:22:45.400 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:22:45.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 -- 172.21.15.92:0/630070515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff3b40b6700 msgr2=0x7ff3b40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff3b40b6700 0x7ff3b40b8c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc0e4a70 tx=0x7ff3bc094040 comp rx=0 tx=0).stop 2024-09-21T07:22:45.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 -- 172.21.15.92:0/630070515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3cc102ae0 msgr2=0x7ff3cc199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:45.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3cc102ae0 0x7ff3cc199300 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00d950 tx=0x7ff3bc00de10 comp rx=0 tx=0).stop 2024-09-21T07:22:45.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 -- 172.21.15.92:0/630070515 shutdown_connections 2024-09-21T07:22:45.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff3b40b6700 0x7ff3b40b8c10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3cc108d70 0x7ff3cc19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3cc108420 0x7ff3cc1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 --2- 172.21.15.92:0/630070515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3cc102ae0 0x7ff3cc199300 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:45.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 -- 172.21.15.92:0/630070515 >> 172.21.15.92:0/630070515 conn(0x7ff3cc079770 msgr2=0x7ff3cc106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:45.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 -- 172.21.15.92:0/630070515 shutdown_connections 2024-09-21T07:22:45.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:45.386+0000 7ff3d09ef640 1 -- 172.21.15.92:0/630070515 wait complete. 2024-09-21T07:22:46.093 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:45 smithi092 ceph-mon[30987]: pgmap v636: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:22:46.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:45 smithi169 ceph-mon[33705]: pgmap v636: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:22:46.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:45 smithi175 ceph-mon[34064]: pgmap v636: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:22:47.123 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:22:47.123 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:22:47.384 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:47.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.875+0000 7f51f90be640 1 -- 172.21.15.92:0/2475116080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f4105380 msgr2=0x7f51f410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.875+0000 7f51f90be640 1 --2- 172.21.15.92:0/2475116080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f4105380 0x7f51f410d8d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009900 tx=0x7f51dc02a410 comp rx=0 tx=0).stop 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.875+0000 7f51f90be640 1 -- 172.21.15.92:0/2475116080 shutdown_connections 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.875+0000 7f51f90be640 1 --2- 172.21.15.92:0/2475116080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51f410de60 0x7f51f4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.875+0000 7f51f90be640 1 --2- 172.21.15.92:0/2475116080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f4105380 0x7f51f410d8d0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.875+0000 7f51f90be640 1 --2- 172.21.15.92:0/2475116080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f4104a30 0x7f51f4104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.875+0000 7f51f90be640 1 -- 172.21.15.92:0/2475116080 >> 172.21.15.92:0/2475116080 conn(0x7f51f4079790 msgr2=0x7f51f4079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.875+0000 7f51f90be640 1 -- 172.21.15.92:0/2475116080 shutdown_connections 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.875+0000 7f51f90be640 1 -- 172.21.15.92:0/2475116080 wait complete. 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.876+0000 7f51f90be640 1 Processor -- start 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.876+0000 7f51f90be640 1 -- start start 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.876+0000 7f51f90be640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51f4104a30 0x7f51f419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.876+0000 7f51f90be640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f4105380 0x7f51f419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.876+0000 7f51f90be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f410de60 0x7f51f419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.876+0000 7f51f90be640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41139a0 con 0x7f51f410de60 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.876+0000 7f51f90be640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51f4113820 con 0x7f51f4104a30 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.876+0000 7f51f90be640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51f4113b20 con 0x7f51f4105380 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.876+0000 7f51f359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f410de60 0x7f51f419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.877+0000 7f51f359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f410de60 0x7f51f419fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41672/0 (socket says 172.21.15.92:41672) 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.877+0000 7f51f359e640 1 -- 172.21.15.92:0/1737894924 learned_addr learned my addr 172.21.15.92:0/1737894924 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.877+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51f4104a30 0x7f51f419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.877+0000 7f51ebfff640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f4105380 0x7f51f419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.877+0000 7f51f359e640 1 -- 172.21.15.92:0/1737894924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f4105380 msgr2=0x7f51f419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.877+0000 7f51f359e640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f4105380 0x7f51f419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.877+0000 7f51f359e640 1 -- 172.21.15.92:0/1737894924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51f4104a30 msgr2=0x7f51f419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.877+0000 7f51f359e640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51f4104a30 0x7f51f419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.877+0000 7f51f359e640 1 -- 172.21.15.92:0/1737894924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f41a0280 con 0x7f51f410de60 2024-09-21T07:22:47.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.877+0000 7f51f359e640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f410de60 0x7f51f419fc10 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00cce0 tx=0x7f51ec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.883+0000 7f51f0d99640 1 -- 172.21.15.92:0/1737894924 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00f450 con 0x7f51f410de60 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.883+0000 7f51f90be640 1 -- 172.21.15.92:0/1737894924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f41a0570 con 0x7f51f410de60 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.883+0000 7f51f0d99640 1 -- 172.21.15.92:0/1737894924 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51ec00fa80 con 0x7f51f410de60 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.883+0000 7f51f0d99640 1 -- 172.21.15.92:0/1737894924 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec018ad0 con 0x7f51f410de60 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.883+0000 7f51f90be640 1 -- 172.21.15.92:0/1737894924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f41a6d90 con 0x7f51f410de60 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.885+0000 7f51f0d99640 1 -- 172.21.15.92:0/1737894924 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f51ec018c70 con 0x7f51f410de60 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.885+0000 7f51ff632740 1 Processor -- start 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ff632740 1 -- start start 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ff632740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc61350 0x56424d008430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ff632740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc38490 0x56424d008970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ff632740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d008eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ff632740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56424cf7ee60 con 0x56424cc40670 2024-09-21T07:22:47.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ff632740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56424cf6e290 con 0x56424cc61350 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ff632740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56424cf720a0 con 0x56424cc38490 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d008eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d008eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41674/0 (socket says 172.21.15.92:41674) 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ebfff640 1 -- 172.21.15.92:0/2951145251 learned_addr learned my addr 172.21.15.92:0/2951145251 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/2951145251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc38490 0x56424d008970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ebfff640 1 --2- 172.21.15.92:0/2951145251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc61350 0x56424d008430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ebfff640 1 -- 172.21.15.92:0/2951145251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc38490 msgr2=0x56424d008970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ebfff640 1 --2- 172.21.15.92:0/2951145251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc38490 0x56424d008970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ebfff640 1 -- 172.21.15.92:0/2951145251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc61350 msgr2=0x56424d008430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ebfff640 1 --2- 172.21.15.92:0/2951145251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc61350 0x56424d008430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51ebfff640 1 -- 172.21.15.92:0/2951145251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56424cccc930 con 0x56424cc40670 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.886+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/2951145251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc38490 0x56424d008970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.887+0000 7f51ebfff640 1 --2- 172.21.15.92:0/2951145251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d008eb0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f51dc005ab0 tx=0x7f51dc005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659e55806586e77a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:47.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.887+0000 7f51f0d99640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f51e00b66b0 0x7f51e00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.887+0000 7f51e97fa640 1 -- 172.21.15.92:0/2951145251 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc035030 con 0x56424cc40670 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.887+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f51e00b66b0 0x7f51e00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.887+0000 7f51e97fa640 1 -- 172.21.15.92:0/2951145251 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51dc003d40 con 0x56424cc40670 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.887+0000 7f51e97fa640 1 -- 172.21.15.92:0/2951145251 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc03bd40 con 0x56424cc40670 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.887+0000 7f51f0d99640 1 -- 172.21.15.92:0/1737894924 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7f51ec0e7dd0 con 0x7f51f410de60 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 -- 172.21.15.92:0/2951145251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 msgr2=0x56424d008eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f51e00b66b0 0x7f51e00b8bc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x56424d0070b0 tx=0x7f51e400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 --2- 172.21.15.92:0/2951145251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d008eb0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f51dc005ab0 tx=0x7f51dc005f00 comp rx=0 tx=0).stop 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 -- 172.21.15.92:0/2951145251 shutdown_connections 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 --2- 172.21.15.92:0/2951145251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d008eb0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 --2- 172.21.15.92:0/2951145251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc38490 0x56424d008970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 --2- 172.21.15.92:0/2951145251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc61350 0x56424d008430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 -- 172.21.15.92:0/2951145251 >> 172.21.15.92:0/2951145251 conn(0x56424cc55740 msgr2=0x56424d006320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:47.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 -- 172.21.15.92:0/2951145251 shutdown_connections 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 -- 172.21.15.92:0/2951145251 wait complete. 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 -- start start 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.888+0000 7f51ff632740 1 Processor -- start 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51ff632740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d013fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51ff632740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 0x56424d014510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51ff632740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc61350 0x56424d01fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51ff632740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56424cdcf890 con 0x56424cc38490 2024-09-21T07:22:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51ff632740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56424cf08d40 con 0x56424cc40670 2024-09-21T07:22:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51ff632740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56424d016bb0 con 0x56424cc61350 2024-09-21T07:22:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51ff632740 10 client.0 _ll_register_callbacks cb 0x56424cf6cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51f2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d013fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51f2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d013fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41684/0 (socket says 172.21.15.92:41684) 2024-09-21T07:22:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51f2d9d640 1 -- 172.21.15.92:0/3303516752 learned_addr learned my addr 172.21.15.92:0/3303516752 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51ebfff640 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 0x56424d014510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51f359e640 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc61350 0x56424d01fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51f2d9d640 1 -- 172.21.15.92:0/3303516752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc61350 msgr2=0x56424d01fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:47.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc61350 0x56424d01fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51f2d9d640 1 -- 172.21.15.92:0/3303516752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 msgr2=0x56424d014510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 0x56424d014510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51f2d9d640 1 -- 172.21.15.92:0/3303516752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56424d020460 con 0x56424cc38490 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51ebfff640 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 0x56424d014510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d013fd0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f51e4003e00 tx=0x7f51e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efa8ea0ab6b0590 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.889+0000 7f51da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51da7fc640 1 -- 172.21.15.92:0/3303516752 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4011650 con 0x56424cc38490 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51da7fc640 1 -- 172.21.15.92:0/3303516752 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7f51e40117f0 con 0x56424cc38490 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51ff632740 1 -- 172.21.15.92:0/3303516752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51dc003d40 con 0x56424cc38490 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51da7fc640 1 -- 172.21.15.92:0/3303516752 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f51e40119f0 con 0x56424cc38490 2024-09-21T07:22:47.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51ff632740 10 client.18303 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51ff632740 1 -- 172.21.15.92:0/3303516752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56424d022df0 con 0x56424cc38490 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51da7fc640 1 -- 172.21.15.92:0/3303516752 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51dc003d40 con 0x56424cc38490 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51da7fc640 1 -- 172.21.15.92:0/3303516752 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f51e4026070 con 0x56424cc38490 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51ff632740 10 client.18303 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51ff632740 10 client.18303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51ff632740 20 client.18303 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51ff632740 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56424cc1fcd0 0x56424d0263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51ff632740 4 client.18303 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.890+0000 7f51ff632740 1 -- 172.21.15.92:0/3303516752 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56424cf80db0 con 0x56424cc1fcd0 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.891+0000 7f51ebfff640 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56424cc1fcd0 0x56424d0263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.891+0000 7f51da7fc640 10 client.18303 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.891+0000 7f51ebfff640 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56424cc1fcd0 0x56424d0263e0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47a5cb7c8d0ed794 server_cookie=1a52d9648131a134 in_seq=0 out_seq=0 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51da7fc640 1 -- 172.21.15.92:0/3303516752 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56424cf80db0 con 0x56424cc1fcd0 2024-09-21T07:22:47.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51da7fc640 10 client.18303 handle_command_reply: tid=0 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 client.18303 shutdown 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 -- 172.21.15.92:0/3303516752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 msgr2=0x56424d013fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d013fd0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f51e4003e00 tx=0x7f51e4004730 comp rx=0 tx=0).stop 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 -- 172.21.15.92:0/3303516752 shutdown_connections 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56424cc1fcd0 0x56424d0263e0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc61350 0x56424d01fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 0x56424d014510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51da7fc640 0 client.18303 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 --2- 172.21.15.92:0/3303516752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d013fd0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 -- 172.21.15.92:0/3303516752 >> 172.21.15.92:0/3303516752 conn(0x56424cc55740 msgr2=0x56424d00b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 -- 172.21.15.92:0/3303516752 shutdown_connections 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 1 -- 172.21.15.92:0/3303516752 wait complete. 2024-09-21T07:22:47.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.892+0000 7f51ff632740 20 client.18303 trim_cache size 0 max 16384 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.909+0000 7f51ff632740 1 Processor -- start 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.909+0000 7f51ff632740 1 -- start start 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ff632740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc1fcd0 0x56424d00f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ff632740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d00e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ff632740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 0x56424d015a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ff632740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41b0e90 con 0x56424cc38490 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ff632740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41b29d0 con 0x56424cc40670 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ff632740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41b1560 con 0x56424cc1fcd0 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d00e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d00e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41694/0 (socket says 172.21.15.92:41694) 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ebfff640 1 -- 172.21.15.92:0/559288573 learned_addr learned my addr 172.21.15.92:0/559288573 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/559288573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc1fcd0 0x56424d00f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51f359e640 1 --2- 172.21.15.92:0/559288573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 0x56424d015a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ebfff640 1 -- 172.21.15.92:0/559288573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc1fcd0 msgr2=0x56424d00f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ebfff640 1 --2- 172.21.15.92:0/559288573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc1fcd0 0x56424d00f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ebfff640 1 -- 172.21.15.92:0/559288573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 msgr2=0x56424d015a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ebfff640 1 --2- 172.21.15.92:0/559288573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 0x56424d015a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.910+0000 7f51ebfff640 1 -- 172.21.15.92:0/559288573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56424d00a720 con 0x56424cc38490 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.911+0000 7f51ebfff640 1 --2- 172.21.15.92:0/559288573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d00e550 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009900 tx=0x7f51dc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9377ce8eef574525 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.911+0000 7f51e8ff9640 1 -- 172.21.15.92:0/559288573 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc035040 con 0x56424cc38490 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.911+0000 7f51e8ff9640 1 -- 172.21.15.92:0/559288573 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51dc03f040 con 0x56424cc38490 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.911+0000 7f51e8ff9640 1 -- 172.21.15.92:0/559288573 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc03bd50 con 0x56424cc38490 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 -- 172.21.15.92:0/559288573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 msgr2=0x56424d00e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 --2- 172.21.15.92:0/559288573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d00e550 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009900 tx=0x7f51dc02a410 comp rx=0 tx=0).stop 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 -- 172.21.15.92:0/559288573 shutdown_connections 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 --2- 172.21.15.92:0/559288573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc40670 0x56424d015a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 --2- 172.21.15.92:0/559288573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc38490 0x56424d00e550 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 --2- 172.21.15.92:0/559288573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc1fcd0 0x56424d00f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 -- 172.21.15.92:0/559288573 >> 172.21.15.92:0/559288573 conn(0x56424cc55740 msgr2=0x56424d0152f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 -- 172.21.15.92:0/559288573 shutdown_connections 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 -- 172.21.15.92:0/559288573 wait complete. 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 -- start start 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.912+0000 7f51ff632740 1 Processor -- start 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51ff632740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc1fcd0 0x56424d01c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51ff632740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc38490 0x56424d018960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51ff632740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d018ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51ff632740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41b2300 con 0x56424cc40670 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51ff632740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41b1c30 con 0x56424cc38490 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51ff632740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41aee90 con 0x56424cc1fcd0 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51ff632740 10 client.0 _ll_register_callbacks cb 0x7f51e400b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51f359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d018ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51f2d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc1fcd0 0x56424d01c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51f359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d018ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41708/0 (socket says 172.21.15.92:41708) 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51f359e640 1 -- 172.21.15.92:0/3438588318 learned_addr learned my addr 172.21.15.92:0/3438588318 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51ebfff640 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc38490 0x56424d018960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51f359e640 1 -- 172.21.15.92:0/3438588318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc1fcd0 msgr2=0x56424d01c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51f359e640 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc1fcd0 0x56424d01c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51f359e640 1 -- 172.21.15.92:0/3438588318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc38490 msgr2=0x56424d018960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51f359e640 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc38490 0x56424d018960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51f359e640 1 -- 172.21.15.92:0/3438588318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56424d0194e0 con 0x56424cc40670 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51f359e640 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d018ea0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0ad520 tx=0x7f51ec0ad170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad06bafa75a2fa95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.913+0000 7f51da7fc640 1 -- 172.21.15.92:0/3438588318 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0acc80 con 0x56424cc40670 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51da7fc640 1 -- 172.21.15.92:0/3438588318 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7f51ec0a9170 con 0x56424cc40670 2024-09-21T07:22:47.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51ff632740 1 -- 172.21.15.92:0/3438588318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51dc03f040 con 0x56424cc40670 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51da7fc640 1 -- 172.21.15.92:0/3438588318 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f51ec0adf20 con 0x56424cc40670 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51ff632740 10 client.18309 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51ff632740 1 -- 172.21.15.92:0/3438588318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56424d091c40 con 0x56424cc40670 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51da7fc640 1 -- 172.21.15.92:0/3438588318 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51dc03f040 con 0x56424cc40670 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51da7fc640 1 -- 172.21.15.92:0/3438588318 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f51ec020030 con 0x56424cc40670 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51ff632740 10 client.18309 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51ff632740 10 client.18309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51ff632740 20 client.18309 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51ff632740 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56424cc61350 0x56424d0943c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51ff632740 4 client.18309 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51ff632740 1 -- 172.21.15.92:0/3438588318 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56424cf7c860 con 0x56424cc61350 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.914+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56424cc61350 0x56424d0943c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:47.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.915+0000 7f51da7fc640 10 client.18309 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.915+0000 7f51f2d9d640 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56424cc61350 0x56424d0943c0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83010c37678ffed1 server_cookie=95610ba2d7042ae3 in_seq=0 out_seq=0 2024-09-21T07:22:47.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.916+0000 7f51da7fc640 1 -- 172.21.15.92:0/3438588318 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56424cf7c860 con 0x56424cc61350 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.916+0000 7f51da7fc640 10 client.18309 handle_command_reply: tid=0 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.916+0000 7f51ff632740 1 client.18309 shutdown 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 1 -- 172.21.15.92:0/3438588318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 msgr2=0x56424d018ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d018ea0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0ad520 tx=0x7f51ec0ad170 comp rx=0 tx=0).stop 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 1 -- 172.21.15.92:0/3438588318 shutdown_connections 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x56424cc61350 0x56424d0943c0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56424cc40670 0x56424d018ea0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56424cc38490 0x56424d018960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51da7fc640 0 client.18309 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 1 --2- 172.21.15.92:0/3438588318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56424cc1fcd0 0x56424d01c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 1 -- 172.21.15.92:0/3438588318 >> 172.21.15.92:0/3438588318 conn(0x56424cc55740 msgr2=0x56424d015090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 1 -- 172.21.15.92:0/3438588318 shutdown_connections 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 1 -- 172.21.15.92:0/3438588318 wait complete. 2024-09-21T07:22:47.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51ff632740 20 client.18309 trim_cache size 0 max 16384 2024-09-21T07:22:47.934 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:22:47.934 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-21T07:22:47.934 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "cd334e02-568f-4a8a-a06d-5f1b1ac65611", 2024-09-21T07:22:47.934 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-21T07:22:47.934 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51f90be640 1 -- 172.21.15.92:0/1737894924 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f51e00b66b0 msgr2=0x7f51e00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51f90be640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f51e00b66b0 0x7f51e00b8bc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x56424d0070b0 tx=0x7f51e400b390 comp rx=0 tx=0).stop 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51f90be640 1 -- 172.21.15.92:0/1737894924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f410de60 msgr2=0x7f51f419fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.917+0000 7f51f90be640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f410de60 0x7f51f419fc10 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00cce0 tx=0x7f51ec00a620 comp rx=0 tx=0).stop 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.918+0000 7f51f90be640 1 -- 172.21.15.92:0/1737894924 shutdown_connections 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.918+0000 7f51f90be640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f51e00b66b0 0x7f51e00b8bc0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.918+0000 7f51f90be640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51f410de60 0x7f51f419fc10 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.918+0000 7f51f90be640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51f4105380 0x7f51f419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.918+0000 7f51f90be640 1 --2- 172.21.15.92:0/1737894924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51f4104a30 0x7f51f419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.918+0000 7f51f90be640 1 -- 172.21.15.92:0/1737894924 >> 172.21.15.92:0/1737894924 conn(0x7f51f4079790 msgr2=0x7f51f40ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.918+0000 7f51f90be640 1 -- 172.21.15.92:0/1737894924 shutdown_connections 2024-09-21T07:22:47.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:47.918+0000 7f51f90be640 1 -- 172.21.15.92:0/1737894924 wait complete. 2024-09-21T07:22:48.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:47 smithi092 ceph-mon[30987]: pgmap v637: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:22:48.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:47 smithi169 ceph-mon[33705]: pgmap v637: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:22:48.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:47 smithi175 ceph-mon[34064]: pgmap v637: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:22:48.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:22:48.965 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:22:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:48 smithi169 ceph-mon[33705]: scrub queued for path: / 2024-09-21T07:22:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:48 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:48 smithi169 ceph-mon[33705]: scrub summary: active paths [/] 2024-09-21T07:22:49.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:48 smithi169 ceph-mon[33705]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:49.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:48 smithi092 ceph-mon[30987]: scrub queued for path: / 2024-09-21T07:22:49.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:48 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:49.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:48 smithi092 ceph-mon[30987]: scrub summary: active paths [/] 2024-09-21T07:22:49.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:48 smithi092 ceph-mon[30987]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:48 smithi175 ceph-mon[34064]: scrub queued for path: / 2024-09-21T07:22:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:48 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:48 smithi175 ceph-mon[34064]: scrub summary: active paths [/] 2024-09-21T07:22:49.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:48 smithi175 ceph-mon[34064]: scrub summary: idle+waiting paths [/] 2024-09-21T07:22:49.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 -- 172.21.15.92:0/1381401487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc34104a30 msgr2=0x7fbc34104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 --2- 172.21.15.92:0/1381401487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc34104a30 0x7fbc34104e40 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009ca0 tx=0x7fbc2402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 -- 172.21.15.92:0/1381401487 shutdown_connections 2024-09-21T07:22:49.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 --2- 172.21.15.92:0/1381401487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc3410de90 0x7fbc34110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 --2- 172.21.15.92:0/1381401487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc34105380 0x7fbc3410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 --2- 172.21.15.92:0/1381401487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc34104a30 0x7fbc34104e40 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 -- 172.21.15.92:0/1381401487 >> 172.21.15.92:0/1381401487 conn(0x7fbc34079770 msgr2=0x7fbc34079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 -- 172.21.15.92:0/1381401487 shutdown_connections 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 -- 172.21.15.92:0/1381401487 wait complete. 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 Processor -- start 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.445+0000 7fbc3bb45640 1 -- start start 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc3bb45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc34104a30 0x7fbc3419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc3bb45640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc34105380 0x7fbc3419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc3bb45640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc3410de90 0x7fbc3419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc3bb45640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbc341139f0 con 0x7fbc34104a30 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc3bb45640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc34113870 con 0x7fbc3410de90 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc3bb45640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc34113b70 con 0x7fbc34105380 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc398e1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc34104a30 0x7fbc3419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc398e1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc34104a30 0x7fbc3419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41728/0 (socket says 172.21.15.92:41728) 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc398e1640 1 -- 172.21.15.92:0/234676558 learned_addr learned my addr 172.21.15.92:0/234676558 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc3410de90 0x7fbc3419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc390e0640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc34105380 0x7fbc3419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc398e1640 1 -- 172.21.15.92:0/234676558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc34105380 msgr2=0x7fbc3419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc398e1640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc34105380 0x7fbc3419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc398e1640 1 -- 172.21.15.92:0/234676558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc3410de90 msgr2=0x7fbc3419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc398e1640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc3410de90 0x7fbc3419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc398e1640 1 -- 172.21.15.92:0/234676558 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc341a0370 con 0x7fbc34104a30 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc390e0640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc34105380 0x7fbc3419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc398e1640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc34104a30 0x7fbc3419a4c0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009dc0 tx=0x7fbc24032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.446+0000 7fbc32ffd640 1 -- 172.21.15.92:0/234676558 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24004040 con 0x7fbc34104a30 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.447+0000 7fbc32ffd640 1 -- 172.21.15.92:0/234676558 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc24004670 con 0x7fbc34104a30 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.447+0000 7fbc32ffd640 1 -- 172.21.15.92:0/234676558 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24030c80 con 0x7fbc34104a30 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.447+0000 7fbc3bb45640 1 -- 172.21.15.92:0/234676558 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc341a0600 con 0x7fbc34104a30 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.447+0000 7fbc3bb45640 1 -- 172.21.15.92:0/234676558 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc341a6e80 con 0x7fbc34104a30 2024-09-21T07:22:49.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.449+0000 7fbc420b9740 1 Processor -- start 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.449+0000 7fbc420b9740 1 -- start start 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc32ffd640 1 -- 172.21.15.92:0/234676558 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fbc240041e0 con 0x7fbc34104a30 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d27070 0x5617130ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712cfe1b0 0x5617130ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712d06390 0x5617130cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc420b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561713044e50 con 0x561712d27070 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc420b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561713034280 con 0x561712cfe1b0 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc420b9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561713038090 con 0x561712d06390 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc3a0e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d27070 0x5617130ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc3a0e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d27070 0x5617130ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41734/0 (socket says 172.21.15.92:41734) 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/2482584185 learned_addr learned my addr 172.21.15.92:0/2482584185 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc390e0640 1 --2- 172.21.15.92:0/2482584185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712d06390 0x5617130cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc398e1640 1 --2- 172.21.15.92:0/2482584185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712cfe1b0 0x5617130ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/2482584185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712d06390 msgr2=0x5617130cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/2482584185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712d06390 0x5617130cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/2482584185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712cfe1b0 msgr2=0x5617130ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/2482584185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712cfe1b0 0x5617130ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/2482584185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561712d92650 con 0x561712d27070 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc390e0640 1 --2- 172.21.15.92:0/2482584185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712d06390 0x5617130cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.450+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/2482584185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d27070 0x5617130ce650 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00ab90 tx=0x7fbc2c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea40b53ad3857e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.451+0000 7fbc32ffd640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc1c0b6730 0x7fbc1c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.451+0000 7fbc1bfff640 1 -- 172.21.15.92:0/2482584185 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c005220 con 0x561712d27070 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.451+0000 7fbc1bfff640 1 -- 172.21.15.92:0/2482584185 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc2c0047a0 con 0x561712d27070 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.451+0000 7fbc398e1640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc1c0b6730 0x7fbc1c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.451+0000 7fbc1bfff640 1 -- 172.21.15.92:0/2482584185 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c0186a0 con 0x561712d27070 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.451+0000 7fbc32ffd640 1 -- 172.21.15.92:0/234676558 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fbc24108d40 con 0x7fbc34104a30 2024-09-21T07:22:49.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 -- 172.21.15.92:0/2482584185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d27070 msgr2=0x5617130ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc398e1640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc1c0b6730 0x7fbc1c0b8c40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbc24106140 tx=0x7fbc24032fe0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 --2- 172.21.15.92:0/2482584185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d27070 0x5617130ce650 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00ab90 tx=0x7fbc2c00f790 comp rx=0 tx=0).stop 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 -- 172.21.15.92:0/2482584185 shutdown_connections 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 --2- 172.21.15.92:0/2482584185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712d06390 0x5617130cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 --2- 172.21.15.92:0/2482584185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712cfe1b0 0x5617130ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 --2- 172.21.15.92:0/2482584185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d27070 0x5617130ce650 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 -- 172.21.15.92:0/2482584185 >> 172.21.15.92:0/2482584185 conn(0x561712d1b460 msgr2=0x5617130cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 -- 172.21.15.92:0/2482584185 shutdown_connections 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 -- 172.21.15.92:0/2482584185 wait complete. 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 -- start start 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.452+0000 7fbc420b9740 1 Processor -- start 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130de1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x5617130de6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712d27070 0x5617130ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc420b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561712e95700 con 0x561712d06390 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc420b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561712fcf110 con 0x561712d27070 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc420b9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5617130e1190 con 0x561712cfe1b0 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc420b9740 10 client.0 _ll_register_callbacks cb 0x561712fe8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc390e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x5617130de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc390e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x5617130de6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41746/0 (socket says 172.21.15.92:41746) 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc390e0640 1 -- 172.21.15.92:0/1490314405 learned_addr learned my addr 172.21.15.92:0/1490314405 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130de1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712d27070 0x5617130ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc390e0640 1 -- 172.21.15.92:0/1490314405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 msgr2=0x5617130de1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc390e0640 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130de1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc390e0640 1 -- 172.21.15.92:0/1490314405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712d27070 msgr2=0x5617130ea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc390e0640 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712d27070 0x5617130ea4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc390e0640 1 -- 172.21.15.92:0/1490314405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561712ffcc40 con 0x561712d06390 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc390e0640 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x5617130de6f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800bf00 tx=0x7fbc280117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993fd13e7487e04e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.453+0000 7fbc197fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc197fa640 1 -- 172.21.15.92:0/1490314405 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28012650 con 0x561712d06390 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc197fa640 1 -- 172.21.15.92:0/1490314405 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fbc280127f0 con 0x561712d06390 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc420b9740 1 -- 172.21.15.92:0/1490314405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc2c0047a0 con 0x561712d06390 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc197fa640 1 -- 172.21.15.92:0/1490314405 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc280129f0 con 0x561712d06390 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc420b9740 10 client.18321 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc420b9740 1 -- 172.21.15.92:0/1490314405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5617130ecfa0 con 0x561712d06390 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc197fa640 1 -- 172.21.15.92:0/1490314405 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc2c0047a0 con 0x561712d06390 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc197fa640 1 -- 172.21.15.92:0/1490314405 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbc2801a3d0 con 0x561712d06390 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc420b9740 10 client.18321 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc420b9740 10 client.18321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc420b9740 20 client.18321 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc420b9740 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561712ce59f0 0x5617130f0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc420b9740 4 client.18321 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.454+0000 7fbc420b9740 1 -- 172.21.15.92:0/1490314405 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561713046da0 con 0x561712ce59f0 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.455+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561712ce59f0 0x5617130f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.455+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561712ce59f0 0x5617130f0540 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46356eb1a318226c server_cookie=47fb6153f1796eb7 in_seq=0 out_seq=0 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.455+0000 7fbc197fa640 10 client.18321 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc197fa640 1 -- 172.21.15.92:0/1490314405 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561713046da0 con 0x561712ce59f0 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc197fa640 10 client.18321 handle_command_reply: tid=0 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 client.18321 shutdown 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 -- 172.21.15.92:0/1490314405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 msgr2=0x5617130de6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x5617130de6f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800bf00 tx=0x7fbc280117b0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 -- 172.21.15.92:0/1490314405 shutdown_connections 2024-09-21T07:22:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561712ce59f0 0x5617130f0540 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712d27070 0x5617130ea4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x5617130de6f0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc197fa640 0 client.18321 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 --2- 172.21.15.92:0/1490314405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130de1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 -- 172.21.15.92:0/1490314405 >> 172.21.15.92:0/1490314405 conn(0x561712d1b460 msgr2=0x5617130d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 -- 172.21.15.92:0/1490314405 shutdown_connections 2024-09-21T07:22:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 1 -- 172.21.15.92:0/1490314405 wait complete. 2024-09-21T07:22:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.456+0000 7fbc420b9740 20 client.18321 trim_cache size 0 max 16384 2024-09-21T07:22:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.473+0000 7fbc420b9740 1 Processor -- start 2024-09-21T07:22:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.473+0000 7fbc420b9740 1 -- start start 2024-09-21T07:22:49.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712ce59f0 0x5617130de670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712d06390 0x5617130ea900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc420b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbc341aed90 con 0x561712ce59f0 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc420b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc341b08d0 con 0x561712d06390 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc420b9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc341af460 con 0x561712cfe1b0 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc3a0e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712ce59f0 0x5617130de670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc3a0e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712ce59f0 0x5617130de670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41756/0 (socket says 172.21.15.92:41756) 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/1301098101 learned_addr learned my addr 172.21.15.92:0/1301098101 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc390e0640 1 --2- 172.21.15.92:0/1301098101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/1301098101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712d06390 0x5617130ea900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/1301098101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 msgr2=0x5617130ea3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/1301098101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130ea3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/1301098101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712d06390 msgr2=0x5617130ea900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/1301098101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712d06390 0x5617130ea900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.474+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/1301098101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617130dd110 con 0x561712ce59f0 2024-09-21T07:22:49.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.475+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/1301098101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712ce59f0 0x5617130de670 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00a920 tx=0x7fbc2c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d232d0c4c38ba3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:49.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.475+0000 7fbc1b7fe640 1 -- 172.21.15.92:0/1301098101 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c004220 con 0x561712ce59f0 2024-09-21T07:22:49.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.475+0000 7fbc1b7fe640 1 -- 172.21.15.92:0/1301098101 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc2c028030 con 0x561712ce59f0 2024-09-21T07:22:49.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.475+0000 7fbc1b7fe640 1 -- 172.21.15.92:0/1301098101 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c018440 con 0x561712ce59f0 2024-09-21T07:22:49.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 -- 172.21.15.92:0/1301098101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712ce59f0 msgr2=0x5617130de670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 --2- 172.21.15.92:0/1301098101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712ce59f0 0x5617130de670 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00a920 tx=0x7fbc2c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 -- 172.21.15.92:0/1301098101 shutdown_connections 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 --2- 172.21.15.92:0/1301098101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712d06390 0x5617130ea900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 --2- 172.21.15.92:0/1301098101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 --2- 172.21.15.92:0/1301098101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712ce59f0 0x5617130de670 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 -- 172.21.15.92:0/1301098101 >> 172.21.15.92:0/1301098101 conn(0x561712d1b460 msgr2=0x5617130ddf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 -- 172.21.15.92:0/1301098101 shutdown_connections 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 -- 172.21.15.92:0/1301098101 wait complete. 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 -- start start 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.476+0000 7fbc420b9740 1 Processor -- start 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712ce59f0 0x5617130e2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc420b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x561713159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc420b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbc341b0200 con 0x561712d06390 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc420b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc341afb30 con 0x561712ce59f0 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc420b9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc341acd90 con 0x561712cfe1b0 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc420b9740 10 client.0 _ll_register_callbacks cb 0x7fbc2800b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc3a0e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x561713159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc3a0e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x561713159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41764/0 (socket says 172.21.15.92:41764) 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/3879332687 learned_addr learned my addr 172.21.15.92:0/3879332687 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc390e0640 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712ce59f0 0x5617130e2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/3879332687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 msgr2=0x5617130e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130e30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/3879332687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712ce59f0 msgr2=0x5617130e2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712ce59f0 0x5617130e2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc3a0e2640 1 -- 172.21.15.92:0/3879332687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171315a400 con 0x561712d06390 2024-09-21T07:22:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc3a0e2640 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x561713159ec0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x561712fd46c0 tx=0x7fbc2c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f506aa15bcfa39d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.477+0000 7fbc197fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc197fa640 1 -- 172.21.15.92:0/3879332687 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c003800 con 0x561712d06390 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc420b9740 1 -- 172.21.15.92:0/3879332687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc2c028030 con 0x561712d06390 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc197fa640 1 -- 172.21.15.92:0/3879332687 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9540+0+0 (secure 0 0 0) 0x7fbc2c0039a0 con 0x561712d06390 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc197fa640 1 -- 172.21.15.92:0/3879332687 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc2c003f30 con 0x561712d06390 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc420b9740 10 client.18327 fetch_fsmap learned FSMap version 29 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc420b9740 1 -- 172.21.15.92:0/3879332687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56171315b660 con 0x561712d06390 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc197fa640 1 -- 172.21.15.92:0/3879332687 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc2c028030 con 0x561712d06390 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc197fa640 1 -- 172.21.15.92:0/3879332687 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbc2c031070 con 0x561712d06390 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc420b9740 10 client.18327 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc420b9740 10 client.18327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc420b9740 20 client.18327 populate_metadata read hostname 'smithi092' 2024-09-21T07:22:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc420b9740 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561712d27070 0x56171315daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:22:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc420b9740 4 client.18327 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:22:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.478+0000 7fbc420b9740 1 -- 172.21.15.92:0/3879332687 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561713042850 con 0x561712d27070 2024-09-21T07:22:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.479+0000 7fbc390e0640 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561712d27070 0x56171315daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:22:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.479+0000 7fbc197fa640 10 client.18327 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.479+0000 7fbc390e0640 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561712d27070 0x56171315daf0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48deea99a27dae37 server_cookie=200b68ce99ee9b5c in_seq=0 out_seq=0 2024-09-21T07:22:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.479+0000 7fbc197fa640 1 -- 172.21.15.92:0/3879332687 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x561713042850 con 0x561712d27070 2024-09-21T07:22:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.479+0000 7fbc197fa640 10 client.18327 handle_command_reply: tid=0 2024-09-21T07:22:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.479+0000 7fbc420b9740 1 client.18327 shutdown 2024-09-21T07:22:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.479+0000 7fbc420b9740 1 -- 172.21.15.92:0/3879332687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 msgr2=0x561713159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.479+0000 7fbc420b9740 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x561713159ec0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x561712fd46c0 tx=0x7fbc2c00f790 comp rx=0 tx=0).stop 2024-09-21T07:22:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc420b9740 1 -- 172.21.15.92:0/3879332687 shutdown_connections 2024-09-21T07:22:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc420b9740 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x561712d27070 0x56171315daf0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc420b9740 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561712d06390 0x561713159ec0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc420b9740 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561712cfe1b0 0x5617130e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc420b9740 1 --2- 172.21.15.92:0/3879332687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561712ce59f0 0x5617130e2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc197fa640 0 client.18327 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:22:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc420b9740 1 -- 172.21.15.92:0/3879332687 >> 172.21.15.92:0/3879332687 conn(0x561712d1b460 msgr2=0x5617130cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc420b9740 1 -- 172.21.15.92:0/3879332687 shutdown_connections 2024-09-21T07:22:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc420b9740 1 -- 172.21.15.92:0/3879332687 wait complete. 2024-09-21T07:22:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc420b9740 20 client.18327 trim_cache size 0 max 16384 2024-09-21T07:22:49.487 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:22:49.487 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:22:49.487 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-21T07:22:49.487 INFO:teuthology.orchestra.run.smithi092.stdout: "cd334e02-568f-4a8a-a06d-5f1b1ac65611": { 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "cd334e02-568f-4a8a-a06d-5f1b1ac65611", 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "cd334e02-568f-4a8a-a06d-5f1b1ac65611": { 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:22:47.914924+0000", 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.488 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.489 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:02.985669+0000", 2024-09-21T07:22:49.490 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.491 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "68bc1b81-ff26-4d23-bedd-ea1f5bf7ce64": { 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:48.714909+0000", 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.492 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "43824538-18e3-40c5-b1a4-5cf927a6fc24": { 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:22:02.392681+0000", 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.493 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "3b742b30-fd49-4ec5-844d-6cfbec3bbf45": { 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:48.290915+0000", 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.494 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.495 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout: "9d9b4374-4159-4e71-99a9-ab660a57d3cf": { 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:02.785673+0000", 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:22:49.496 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:22:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc3bb45640 1 -- 172.21.15.92:0/234676558 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc1c0b6730 msgr2=0x7fbc1c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc3bb45640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc1c0b6730 0x7fbc1c0b8c40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbc24106140 tx=0x7fbc24032fe0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc3bb45640 1 -- 172.21.15.92:0/234676558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc34104a30 msgr2=0x7fbc3419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:22:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc3bb45640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc34104a30 0x7fbc3419a4c0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009dc0 tx=0x7fbc24032bc0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc3bb45640 1 -- 172.21.15.92:0/234676558 shutdown_connections 2024-09-21T07:22:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc3bb45640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fbc1c0b6730 0x7fbc1c0b8c40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc3bb45640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc3410de90 0x7fbc3419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc3bb45640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc34105380 0x7fbc3419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc3bb45640 1 --2- 172.21.15.92:0/234676558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc34104a30 0x7fbc3419a4c0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:22:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.480+0000 7fbc3bb45640 1 -- 172.21.15.92:0/234676558 >> 172.21.15.92:0/234676558 conn(0x7fbc34079770 msgr2=0x7fbc34100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:22:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.481+0000 7fbc3bb45640 1 -- 172.21.15.92:0/234676558 shutdown_connections 2024-09-21T07:22:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:22:49.481+0000 7fbc3bb45640 1 -- 172.21.15.92:0/234676558 wait complete. 2024-09-21T07:22:50.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:49 smithi092 ceph-mon[30987]: pgmap v638: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:22:50.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:49 smithi169 ceph-mon[33705]: pgmap v638: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:22:50.259 INFO:tasks.cephfs.filesystem:scrub status for tag:cd334e02-568f-4a8a-a06d-5f1b1ac65611 - {'path': '/', 'tag': 'cd334e02-568f-4a8a-a06d-5f1b1ac65611', 'options': 'recursive,force'} 2024-09-21T07:22:50.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:49 smithi175 ceph-mon[34064]: pgmap v638: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:22:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:50 smithi169 ceph-mon[33705]: scrub summary: idle 2024-09-21T07:22:51.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:50 smithi175 ceph-mon[34064]: scrub summary: idle 2024-09-21T07:22:51.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:50 smithi092 ceph-mon[30987]: scrub summary: idle 2024-09-21T07:22:52.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:51 smithi169 ceph-mon[33705]: pgmap v639: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-09-21T07:22:52.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:51 smithi175 ceph-mon[34064]: pgmap v639: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-09-21T07:22:52.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:51 smithi092 ceph-mon[30987]: pgmap v639: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-09-21T07:22:54.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:53 smithi169 ceph-mon[33705]: pgmap v640: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 11 op/s 2024-09-21T07:22:54.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:53 smithi175 ceph-mon[34064]: pgmap v640: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 11 op/s 2024-09-21T07:22:54.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:53 smithi092 ceph-mon[30987]: pgmap v640: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 11 op/s 2024-09-21T07:22:56.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:55 smithi169 ceph-mon[33705]: pgmap v641: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:22:56.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:55 smithi175 ceph-mon[34064]: pgmap v641: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:22:56.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:55 smithi092 ceph-mon[30987]: pgmap v641: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:22:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:22:58 smithi169 ceph-mon[33705]: pgmap v642: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 12 op/s 2024-09-21T07:22:59.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:22:58 smithi175 ceph-mon[34064]: pgmap v642: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 12 op/s 2024-09-21T07:22:59.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:22:58 smithi092 ceph-mon[30987]: pgmap v642: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 12 op/s 2024-09-21T07:23:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:00 smithi169 ceph-mon[33705]: pgmap v643: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:23:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:00 smithi175 ceph-mon[34064]: pgmap v643: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:23:01.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:00 smithi092 ceph-mon[30987]: pgmap v643: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:23:03.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:02 smithi169 ceph-mon[33705]: pgmap v644: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-21T07:23:03.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:02 smithi175 ceph-mon[34064]: pgmap v644: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-21T07:23:03.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:02 smithi092 ceph-mon[30987]: pgmap v644: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-21T07:23:04.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:03 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:23:04.157 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:03 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:23:04.224 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:03 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:23:06.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:05 smithi092 ceph-mon[30987]: pgmap v645: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:23:06.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:23:06.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:23:06.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:05 smithi169 ceph-mon[33705]: pgmap v645: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:23:06.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:23:06.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:23:06.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:05 smithi175 ceph-mon[34064]: pgmap v645: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:23:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:23:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:23:06.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:23:08.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:07 smithi092 ceph-mon[30987]: pgmap v646: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T07:23:08.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:07 smithi169 ceph-mon[33705]: pgmap v646: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T07:23:08.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:07 smithi175 ceph-mon[34064]: pgmap v646: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T07:23:10.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:09 smithi092 ceph-mon[30987]: pgmap v647: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-21T07:23:10.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:09 smithi169 ceph-mon[33705]: pgmap v647: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-21T07:23:10.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:09 smithi175 ceph-mon[34064]: pgmap v647: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-21T07:23:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:11 smithi092 ceph-mon[30987]: pgmap v648: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T07:23:12.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:11 smithi092 ceph-mon[30987]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T07:23:12.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:11 smithi169 ceph-mon[33705]: pgmap v648: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T07:23:12.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:11 smithi169 ceph-mon[33705]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T07:23:12.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:11 smithi175 ceph-mon[34064]: pgmap v648: 129 pgs: 129 active+clean; 8.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T07:23:12.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:11 smithi175 ceph-mon[34064]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T07:23:14.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:13 smithi092 ceph-mon[30987]: pgmap v650: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 7.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T07:23:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:13 smithi169 ceph-mon[33705]: pgmap v650: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 7.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T07:23:14.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:13 smithi175 ceph-mon[34064]: pgmap v650: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 7.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T07:23:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:15 smithi092 ceph-mon[30987]: pgmap v651: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 3.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T07:23:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:15 smithi169 ceph-mon[33705]: pgmap v651: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 3.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T07:23:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:15 smithi175 ceph-mon[34064]: pgmap v651: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 3.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T07:23:18.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:17 smithi092 ceph-mon[30987]: pgmap v652: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 546 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:23:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:17 smithi169 ceph-mon[33705]: pgmap v652: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 546 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:23:18.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:17 smithi175 ceph-mon[34064]: pgmap v652: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 546 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:23:20.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:19 smithi092 ceph-mon[30987]: pgmap v653: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:23:20.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:19 smithi092 ceph-mon[30987]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T07:23:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:19 smithi169 ceph-mon[33705]: pgmap v653: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:23:20.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:19 smithi169 ceph-mon[33705]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T07:23:20.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:23:20.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:19 smithi175 ceph-mon[34064]: pgmap v653: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:23:20.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:19 smithi175 ceph-mon[34064]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T07:23:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:21.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.151+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/3546386555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe79c102a80 msgr2=0x7fe79c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.151+0000 7fe7a2b3d640 1 --2- 172.21.15.92:0/3546386555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe79c102a80 0x7fe79c102e90 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fe790009900 tx=0x7fe79002a410 comp rx=0 tx=0).stop 2024-09-21T07:23:21.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.151+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/3546386555 shutdown_connections 2024-09-21T07:23:21.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.151+0000 7fe7a2b3d640 1 --2- 172.21.15.92:0/3546386555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe79c108d10 0x7fe79c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.151+0000 7fe7a2b3d640 1 --2- 172.21.15.92:0/3546386555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe79c1083c0 0x7fe79c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.151+0000 7fe7a2b3d640 1 --2- 172.21.15.92:0/3546386555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe79c102a80 0x7fe79c102e90 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.151+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/3546386555 >> 172.21.15.92:0/3546386555 conn(0x7fe79c079740 msgr2=0x7fe79c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:21.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.151+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/3546386555 shutdown_connections 2024-09-21T07:23:21.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.151+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/3546386555 wait complete. 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a2b3d640 1 Processor -- start 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a2b3d640 1 -- start start 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a2b3d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe79c102a80 0x7fe79c19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a2b3d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe79c1083c0 0x7fe79c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a2b3d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe79c108d10 0x7fe79c19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a2b3d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c113950 con 0x7fe79c102a80 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a2b3d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1137d0 con 0x7fe79c1083c0 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a2b3d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c113ad0 con 0x7fe79c108d10 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a08d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe79c102a80 0x7fe79c19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a08d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe79c102a80 0x7fe79c19a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34680/0 (socket says 172.21.15.92:34680) 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe7a08d9640 1 -- 172.21.15.92:0/2164015580 learned_addr learned my addr 172.21.15.92:0/2164015580 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.152+0000 7fe79bfff640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe79c1083c0 0x7fe79c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe7a10da640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe79c108d10 0x7fe79c19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe7a08d9640 1 -- 172.21.15.92:0/2164015580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe79c108d10 msgr2=0x7fe79c19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe79c108d10 0x7fe79c19fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe7a08d9640 1 -- 172.21.15.92:0/2164015580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe79c1083c0 msgr2=0x7fe79c19a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe79c1083c0 0x7fe79c19a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe7a08d9640 1 -- 172.21.15.92:0/2164015580 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c1a0230 con 0x7fe79c102a80 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe7a10da640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe79c108d10 0x7fe79c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe79c102a80 0x7fe79c19a380 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fe790009230 tx=0x7fe790004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe799ffb640 1 -- 172.21.15.92:0/2164015580 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79003f030 con 0x7fe79c102a80 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/2164015580 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79c1a04c0 con 0x7fe79c102a80 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe799ffb640 1 -- 172.21.15.92:0/2164015580 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe790003a80 con 0x7fe79c102a80 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe799ffb640 1 -- 172.21.15.92:0/2164015580 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe790035070 con 0x7fe79c102a80 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.153+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/2164015580 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79c1a09a0 con 0x7fe79c102a80 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.156+0000 7fe7a90b1740 1 Processor -- start 2024-09-21T07:23:21.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.156+0000 7fe7a90b1740 1 -- start start 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.156+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d590070 0x55f89d937650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.156+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d937b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.156+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 0x55f89d9380d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.156+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f89d8ade50 con 0x55f89d5671b0 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.156+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f89d89d280 con 0x55f89d590070 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.156+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f89d8a1090 con 0x55f89d56f390 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.156+0000 7fe799ffb640 1 -- 172.21.15.92:0/2164015580 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fe790042030 con 0x7fe79c102a80 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.156+0000 7fe7a08d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d937b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe7a08d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d937b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34696/0 (socket says 172.21.15.92:34696) 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe7a08d9640 1 -- 172.21.15.92:0/3797389323 learned_addr learned my addr 172.21.15.92:0/3797389323 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe7a10da640 1 --2- 172.21.15.92:0/3797389323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d590070 0x55f89d937650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe79bfff640 1 --2- 172.21.15.92:0/3797389323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 0x55f89d9380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe7a08d9640 1 -- 172.21.15.92:0/3797389323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 msgr2=0x55f89d9380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/3797389323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 0x55f89d9380d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe7a08d9640 1 -- 172.21.15.92:0/3797389323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d590070 msgr2=0x55f89d937650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/3797389323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d590070 0x55f89d937650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe7a08d9640 1 -- 172.21.15.92:0/3797389323 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f89d5fb650 con 0x55f89d5671b0 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/3797389323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d937b90 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fe790105620 tx=0x7fe790110600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b2969854b422b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe799ffb640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe78c0b66b0 0x7fe78c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe7a10da640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe78c0b66b0 0x7fe78c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.157+0000 7fe786ffd640 1 -- 172.21.15.92:0/3797389323 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7900ca3d0 con 0x55f89d5671b0 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe786ffd640 1 -- 172.21.15.92:0/3797389323 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe790115030 con 0x55f89d5671b0 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe786ffd640 1 -- 172.21.15.92:0/3797389323 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7900d7310 con 0x55f89d5671b0 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe799ffb640 1 -- 172.21.15.92:0/2164015580 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7fe790108330 con 0x7fe79c102a80 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe7a90b1740 1 -- 172.21.15.92:0/3797389323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 msgr2=0x55f89d937b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe7a10da640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe78c0b66b0 0x7fe78c0b8bc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe794005fd0 tx=0x7fe794009700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/3797389323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d937b90 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fe790105620 tx=0x7fe790110600 comp rx=0 tx=0).stop 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe7a90b1740 1 -- 172.21.15.92:0/3797389323 shutdown_connections 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/3797389323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 0x55f89d9380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/3797389323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d937b90 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/3797389323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d590070 0x55f89d937650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe7a90b1740 1 -- 172.21.15.92:0/3797389323 >> 172.21.15.92:0/3797389323 conn(0x55f89d584460 msgr2=0x55f89d935540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe7a90b1740 1 -- 172.21.15.92:0/3797389323 shutdown_connections 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.158+0000 7fe7a90b1740 1 -- 172.21.15.92:0/3797389323 wait complete. 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.159+0000 7fe7a90b1740 1 -- start start 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.159+0000 7fe7a90b1740 1 Processor -- start 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.159+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d5671b0 0x55f89d942cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.159+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d943210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.159+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d590070 0x55f89d94ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.159+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f89d6fe700 con 0x55f89d56f390 2024-09-21T07:23:21.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.159+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f89d838110 con 0x55f89d5671b0 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.159+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f89d945bf0 con 0x55f89d590070 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.159+0000 7fe7a90b1740 10 client.0 _ll_register_callbacks cb 0x55f89d851990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.159+0000 7fe79bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d943210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe79bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d943210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34706/0 (socket says 172.21.15.92:34706) 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe79bfff640 1 -- 172.21.15.92:0/750203833 learned_addr learned my addr 172.21.15.92:0/750203833 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d5671b0 0x55f89d942cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe7a10da640 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d590070 0x55f89d94ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe79bfff640 1 -- 172.21.15.92:0/750203833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d590070 msgr2=0x55f89d94ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe79bfff640 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d590070 0x55f89d94ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe79bfff640 1 -- 172.21.15.92:0/750203833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d5671b0 msgr2=0x55f89d942cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe79bfff640 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d5671b0 0x55f89d942cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe79bfff640 1 -- 172.21.15.92:0/750203833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f89d865c40 con 0x55f89d56f390 2024-09-21T07:23:21.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe79bfff640 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d943210 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fe788004650 tx=0x7fe7880039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea9d165e341806e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe77bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe77bfff640 1 -- 172.21.15.92:0/750203833 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788011910 con 0x55f89d56f390 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe77bfff640 1 -- 172.21.15.92:0/750203833 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7fe788011ab0 con 0x55f89d56f390 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe7a90b1740 1 -- 172.21.15.92:0/750203833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe790115030 con 0x55f89d56f390 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe77bfff640 1 -- 172.21.15.92:0/750203833 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe788011cb0 con 0x55f89d56f390 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe7a90b1740 10 client.18339 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.160+0000 7fe7a90b1740 1 -- 172.21.15.92:0/750203833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f89d951870 con 0x55f89d56f390 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.161+0000 7fe77bfff640 1 -- 172.21.15.92:0/750203833 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe790115030 con 0x55f89d56f390 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.161+0000 7fe77bfff640 1 -- 172.21.15.92:0/750203833 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe788018070 con 0x55f89d56f390 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.161+0000 7fe7a90b1740 10 client.18339 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.161+0000 7fe7a90b1740 10 client.18339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.161+0000 7fe7a90b1740 20 client.18339 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.161+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f89d54e9f0 0x55f89d954e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.161+0000 7fe7a90b1740 4 client.18339 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.161+0000 7fe7a90b1740 1 -- 172.21.15.92:0/750203833 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f89d8afda0 con 0x55f89d54e9f0 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.161+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f89d54e9f0 0x55f89d954e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f89d54e9f0 0x55f89d954e60 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6899a9b45e441f37 server_cookie=a8a24c0fcbd8a525 in_seq=0 out_seq=0 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe77bfff640 10 client.18339 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe77bfff640 1 -- 172.21.15.92:0/750203833 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f89d8afda0 con 0x55f89d54e9f0 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe77bfff640 10 client.18339 handle_command_reply: tid=0 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe7a90b1740 1 client.18339 shutdown 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe7a90b1740 1 -- 172.21.15.92:0/750203833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 msgr2=0x55f89d943210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d943210 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fe788004650 tx=0x7fe7880039c0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe7a90b1740 1 -- 172.21.15.92:0/750203833 shutdown_connections 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f89d54e9f0 0x55f89d954e60 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d590070 0x55f89d94ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d943210 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe77bfff640 0 client.18339 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.162+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/750203833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d5671b0 0x55f89d942cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.163+0000 7fe7a90b1740 1 -- 172.21.15.92:0/750203833 >> 172.21.15.92:0/750203833 conn(0x55f89d584460 msgr2=0x55f89d93a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.163+0000 7fe7a90b1740 1 -- 172.21.15.92:0/750203833 shutdown_connections 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.163+0000 7fe7a90b1740 1 -- 172.21.15.92:0/750203833 wait complete. 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.163+0000 7fe7a90b1740 20 client.18339 trim_cache size 0 max 16384 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a90b1740 1 Processor -- start 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a90b1740 1 -- start start 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 0x55f89d944900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d934b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 0x55f89d9350b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1b0f00 con 0x55f89d5671b0 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1b2a40 con 0x55f89d54e9f0 2024-09-21T07:23:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1b15d0 con 0x55f89d56f390 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe79bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d934b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe79bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d934b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34714/0 (socket says 172.21.15.92:34714) 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe79bfff640 1 -- 172.21.15.92:0/2459869511 learned_addr learned my addr 172.21.15.92:0/2459869511 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a10da640 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 0x55f89d9350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe79bfff640 1 -- 172.21.15.92:0/2459869511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 msgr2=0x55f89d9350b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 0x55f89d944900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe79bfff640 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 0x55f89d9350b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe79bfff640 1 -- 172.21.15.92:0/2459869511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 msgr2=0x55f89d944900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe79bfff640 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 0x55f89d944900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe79bfff640 1 -- 172.21.15.92:0/2459869511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f89d93a4b0 con 0x55f89d5671b0 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a10da640 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 0x55f89d9350b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.180+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 0x55f89d944900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.181+0000 7fe79bfff640 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d934b70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fe7880058c0 tx=0x7fe788003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cb5d9b2bb328ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.181+0000 7fe7867fc640 1 -- 172.21.15.92:0/2459869511 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78802c020 con 0x55f89d5671b0 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.181+0000 7fe7867fc640 1 -- 172.21.15.92:0/2459869511 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe788011910 con 0x55f89d5671b0 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.181+0000 7fe7867fc640 1 -- 172.21.15.92:0/2459869511 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7880286a0 con 0x55f89d5671b0 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 -- 172.21.15.92:0/2459869511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 msgr2=0x55f89d934b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d934b70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fe7880058c0 tx=0x7fe788003ee0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 -- 172.21.15.92:0/2459869511 shutdown_connections 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d56f390 0x55f89d9350b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d5671b0 0x55f89d934b70 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/2459869511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 0x55f89d944900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 -- 172.21.15.92:0/2459869511 >> 172.21.15.92:0/2459869511 conn(0x55f89d584460 msgr2=0x55f89d9441f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 -- 172.21.15.92:0/2459869511 shutdown_connections 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 -- 172.21.15.92:0/2459869511 wait complete. 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 -- start start 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.182+0000 7fe7a90b1740 1 Processor -- start 2024-09-21T07:23:21.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 0x55f89d94b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d5671b0 0x55f89d946c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a90b1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d947350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1b2370 con 0x55f89d56f390 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1b1ca0 con 0x55f89d54e9f0 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a90b1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1aef00 con 0x55f89d5671b0 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a90b1740 10 client.0 _ll_register_callbacks cb 0x7fe788004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a10da640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d947350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a10da640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d947350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34716/0 (socket says 172.21.15.92:34716) 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a10da640 1 -- 172.21.15.92:0/1896790493 learned_addr learned my addr 172.21.15.92:0/1896790493 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 0x55f89d94b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe79bfff640 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d5671b0 0x55f89d946c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a10da640 1 -- 172.21.15.92:0/1896790493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d5671b0 msgr2=0x55f89d946c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a10da640 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d5671b0 0x55f89d946c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a10da640 1 -- 172.21.15.92:0/1896790493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 msgr2=0x55f89d94b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a10da640 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 0x55f89d94b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a10da640 1 -- 172.21.15.92:0/1896790493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f89d9be820 con 0x55f89d56f390 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe79bfff640 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d5671b0 0x55f89d946c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 0x55f89d94b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a10da640 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d947350 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fe794009a70 tx=0x7fe794004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e5ce00cad86a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe77bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe77bfff640 1 -- 172.21.15.92:0/1896790493 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79402c060 con 0x55f89d56f390 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe77bfff640 1 -- 172.21.15.92:0/1896790493 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7fe79401eb20 con 0x55f89d56f390 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.183+0000 7fe7a90b1740 1 -- 172.21.15.92:0/1896790493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe788011910 con 0x55f89d56f390 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe77bfff640 1 -- 172.21.15.92:0/1896790493 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe794033050 con 0x55f89d56f390 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe7a90b1740 10 client.18345 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe7a90b1740 1 -- 172.21.15.92:0/1896790493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f89d9bf8c0 con 0x55f89d56f390 2024-09-21T07:23:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe77bfff640 1 -- 172.21.15.92:0/1896790493 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe788011910 con 0x55f89d56f390 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe77bfff640 1 -- 172.21.15.92:0/1896790493 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe794026070 con 0x55f89d56f390 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe7a90b1740 10 client.18345 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe7a90b1740 10 client.18345 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe7a90b1740 20 client.18345 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f89d590070 0x55f89d9c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe7a90b1740 4 client.18345 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.184+0000 7fe7a90b1740 1 -- 172.21.15.92:0/1896790493 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f89d8ab850 con 0x55f89d590070 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f89d590070 0x55f89d9c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe77bfff640 10 client.18345 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a08d9640 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f89d590070 0x55f89d9c20b0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9222853de855ef6 server_cookie=ee0bcb505876bd15 in_seq=0 out_seq=0 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe77bfff640 1 -- 172.21.15.92:0/1896790493 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x55f89d8ab850 con 0x55f89d590070 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe77bfff640 10 client.18345 handle_command_reply: tid=0 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a90b1740 1 client.18345 shutdown 2024-09-21T07:23:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a90b1740 1 -- 172.21.15.92:0/1896790493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 msgr2=0x55f89d947350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d947350 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fe794009a70 tx=0x7fe794004a40 comp rx=0 tx=0).stop 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a90b1740 1 -- 172.21.15.92:0/1896790493 shutdown_connections 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55f89d590070 0x55f89d9c20b0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f89d56f390 0x55f89d947350 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f89d5671b0 0x55f89d946c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe77bfff640 0 client.18345 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a90b1740 1 --2- 172.21.15.92:0/1896790493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f89d54e9f0 0x55f89d94b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.185+0000 7fe7a90b1740 1 -- 172.21.15.92:0/1896790493 >> 172.21.15.92:0/1896790493 conn(0x55f89d584460 msgr2=0x55f89d943210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a90b1740 1 -- 172.21.15.92:0/1896790493 shutdown_connections 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a90b1740 1 -- 172.21.15.92:0/1896790493 wait complete. 2024-09-21T07:23:21.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a90b1740 20 client.18345 trim_cache size 0 max 16384 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {}, 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_stats": { 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: "cd334e02-568f-4a8a-a06d-5f1b1ac65611": { 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:22:47.914924+0000", 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "d407b537-389e-488f-bc01-d777c1d3796e": { 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:13:27.380280+0000", 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "a7beebc0-d49b-4092-a8c1-d3775fd34626": { 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:18:30.807206+0000", 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "948a50ad-2413-4f45-8f96-803f86b37155": { 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:19:16.879437+0000", 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "8c7a4c62-4362-4a71-98c9-de1f7a97d8cd": { 2024-09-21T07:23:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:02.985669+0000", 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "a3f536c9-d1d0-43e0-a8b0-f66d83a0e424": { 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:14:18.346428+0000", 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "c9198dd4-042b-40fb-8657-b26652eb8d60": { 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:15:11.184545+0000", 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "68bc1b81-ff26-4d23-bedd-ea1f5bf7ce64": { 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:48.714909+0000", 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "43824538-18e3-40c5-b1a4-5cf927a6fc24": { 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:22:02.392681+0000", 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "40c1cdf7-9a11-43e9-af28-0a82c962cfb4": { 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:00.309724+0000", 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "3b742b30-fd49-4ec5-844d-6cfbec3bbf45": { 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:20:48.290915+0000", 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "3e49e930-1eb4-4d55-a2f4-79d05ccc0f76": { 2024-09-21T07:23:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:16:46.904945+0000", 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "292dce6e-19f6-49e4-b6d9-4413b78c9bb9": { 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:17:44.863974+0000", 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: "9d9b4374-4159-4e71-99a9-ab660a57d3cf": { 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: "start_time": "2024-09-21T07:21:02.785673+0000", 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_passed": 0, 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_failed": 0, 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_skipped": 0 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/2164015580 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe78c0b66b0 msgr2=0x7fe78c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe78c0b66b0 0x7fe78c0b8bc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe794005fd0 tx=0x7fe794009700 comp rx=0 tx=0).stop 2024-09-21T07:23:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/2164015580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe79c102a80 msgr2=0x7fe79c19a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe79c102a80 0x7fe79c19a380 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fe790009230 tx=0x7fe790004270 comp rx=0 tx=0).stop 2024-09-21T07:23:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/2164015580 shutdown_connections 2024-09-21T07:23:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe78c0b66b0 0x7fe78c0b8bc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe79c108d10 0x7fe79c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe79c1083c0 0x7fe79c19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 --2- 172.21.15.92:0/2164015580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe79c102a80 0x7fe79c19a380 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/2164015580 >> 172.21.15.92:0/2164015580 conn(0x7fe79c079740 msgr2=0x7fe79c1014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/2164015580 shutdown_connections 2024-09-21T07:23:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:21.186+0000 7fe7a2b3d640 1 -- 172.21.15.92:0/2164015580 wait complete. 2024-09-21T07:23:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:21 smithi092 ceph-mon[30987]: pgmap v655: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 226 B/s wr, 11 op/s 2024-09-21T07:23:22.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:21 smithi169 ceph-mon[33705]: pgmap v655: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 226 B/s wr, 11 op/s 2024-09-21T07:23:22.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:21 smithi175 ceph-mon[34064]: pgmap v655: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 226 B/s wr, 11 op/s 2024-09-21T07:23:23.053 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:23:23.054 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:23:23.307 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:23.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.800+0000 7f440f1bc640 1 -- 172.21.15.92:0/1088538779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44081094f0 msgr2=0x7f4408109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.800+0000 7f440f1bc640 1 --2- 172.21.15.92:0/1088538779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44081094f0 0x7f4408109900 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009900 tx=0x7f43f002a410 comp rx=0 tx=0).stop 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.800+0000 7f440f1bc640 1 -- 172.21.15.92:0/1088538779 shutdown_connections 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.800+0000 7f440f1bc640 1 --2- 172.21.15.92:0/1088538779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4408109e40 0x7f4408110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.800+0000 7f440f1bc640 1 --2- 172.21.15.92:0/1088538779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44081094f0 0x7f4408109900 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.800+0000 7f440f1bc640 1 --2- 172.21.15.92:0/1088538779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4408103bb0 0x7f4408103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.800+0000 7f440f1bc640 1 -- 172.21.15.92:0/1088538779 >> 172.21.15.92:0/1088538779 conn(0x7f44080ff600 msgr2=0x7f4408101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.800+0000 7f440f1bc640 1 -- 172.21.15.92:0/1088538779 shutdown_connections 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.800+0000 7f440f1bc640 1 -- 172.21.15.92:0/1088538779 wait complete. 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.800+0000 7f440f1bc640 1 Processor -- start 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f440f1bc640 1 -- start start 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f440f1bc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4408103bb0 0x7f440819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f440f1bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44081094f0 0x7f440819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f440f1bc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4408109e40 0x7f440819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f440f1bc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f44081139b0 con 0x7f44081094f0 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f440f1bc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4408113830 con 0x7f4408103bb0 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f440f1bc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4408113b30 con 0x7f4408109e40 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f4407fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44081094f0 0x7f440819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f4407fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44081094f0 0x7f440819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34732/0 (socket says 172.21.15.92:34732) 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f4407fff640 1 -- 172.21.15.92:0/2731663298 learned_addr learned my addr 172.21.15.92:0/2731663298 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f440cf58640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4408103bb0 0x7f440819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f440d759640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4408109e40 0x7f440819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f4407fff640 1 -- 172.21.15.92:0/2731663298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4408109e40 msgr2=0x7f440819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f4407fff640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4408109e40 0x7f440819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f4407fff640 1 -- 172.21.15.92:0/2731663298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4408103bb0 msgr2=0x7f440819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f4407fff640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4408103bb0 0x7f440819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:23.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f4407fff640 1 -- 172.21.15.92:0/2731663298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44081a02f0 con 0x7f44081094f0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f440d759640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4408109e40 0x7f440819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.801+0000 7f4407fff640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44081094f0 0x7f440819a9e0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f43f0005940 tx=0x7f43f00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.802+0000 7f4405ffb640 1 -- 172.21.15.92:0/2731663298 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f003f030 con 0x7f44081094f0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.802+0000 7f440f1bc640 1 -- 172.21.15.92:0/2731663298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44081a0580 con 0x7f44081094f0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.802+0000 7f4405ffb640 1 -- 172.21.15.92:0/2731663298 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43f0003a80 con 0x7f44081094f0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.802+0000 7f4405ffb640 1 -- 172.21.15.92:0/2731663298 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f0035070 con 0x7f44081094f0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.802+0000 7f440f1bc640 1 -- 172.21.15.92:0/2731663298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44081a0ab0 con 0x7f44081094f0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.803+0000 7f440f1bc640 1 -- 172.21.15.92:0/2731663298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4408103fc0 con 0x7f44081094f0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.804+0000 7f4405ffb640 1 -- 172.21.15.92:0/2731663298 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f43f0042030 con 0x7f44081094f0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.805+0000 7f4405ffb640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f43f40b66b0 0x7f43f40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.805+0000 7f440cf58640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f43f40b66b0 0x7f43f40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.805+0000 7f4405ffb640 1 -- 172.21.15.92:0/2731663298 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f43f0108440 con 0x7f44081094f0 2024-09-21T07:23:23.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.806+0000 7f440cf58640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f43f40b66b0 0x7f43f40b8bc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f43f8005fd0 tx=0x7f43f800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:23.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:23.808+0000 7f4405ffb640 1 -- 172.21.15.92:0/2731663298 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44081a0ab0 con 0x7f44081094f0 2024-09-21T07:23:24.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.025+0000 7f440f1bc640 1 -- 172.21.15.92:0/2731663298 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f440810bc40 con 0x7f44081094f0 2024-09-21T07:23:24.029 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:23 smithi092 ceph-mon[30987]: pgmap v656: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:23:24.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.026+0000 7f4405ffb640 1 -- 172.21.15.92:0/2731663298 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f43f00ce590 con 0x7f44081094f0 2024-09-21T07:23:24.029 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:23:24.029 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:23:24.030 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 -- 172.21.15.92:0/2731663298 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f43f40b66b0 msgr2=0x7f43f40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f43f40b66b0 0x7f43f40b8bc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f43f8005fd0 tx=0x7f43f800b390 comp rx=0 tx=0).stop 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 -- 172.21.15.92:0/2731663298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44081094f0 msgr2=0x7f440819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44081094f0 0x7f440819a9e0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f43f0005940 tx=0x7f43f00040e0 comp rx=0 tx=0).stop 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 -- 172.21.15.92:0/2731663298 shutdown_connections 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f43f40b66b0 0x7f43f40b8bc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4408109e40 0x7f440819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44081094f0 0x7f440819a9e0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 --2- 172.21.15.92:0/2731663298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4408103bb0 0x7f440819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 -- 172.21.15.92:0/2731663298 >> 172.21.15.92:0/2731663298 conn(0x7f44080ff600 msgr2=0x7f4408101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 -- 172.21.15.92:0/2731663298 shutdown_connections 2024-09-21T07:23:24.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:24.029+0000 7f440f1bc640 1 -- 172.21.15.92:0/2731663298 wait complete. 2024-09-21T07:23:24.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:23 smithi169 ceph-mon[33705]: pgmap v656: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:23:24.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:23 smithi175 ceph-mon[34064]: pgmap v656: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T07:23:24.836 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:23:25.085 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:25.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:24 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2731663298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:23:25.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:24 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2731663298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:23:25.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:24 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2731663298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:23:25.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.564+0000 7f056b0f8640 1 -- 172.21.15.92:0/3742266174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0564108cf0 msgr2=0x7f056410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.564+0000 7f056b0f8640 1 --2- 172.21.15.92:0/3742266174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0564108cf0 0x7f056410f520 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f055c009ca0 tx=0x7f055c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.564+0000 7f056b0f8640 1 -- 172.21.15.92:0/3742266174 shutdown_connections 2024-09-21T07:23:25.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.564+0000 7f056b0f8640 1 --2- 172.21.15.92:0/3742266174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0564108cf0 0x7f056410f520 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.564+0000 7f056b0f8640 1 --2- 172.21.15.92:0/3742266174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05641083a0 0x7f05641087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.564+0000 7f056b0f8640 1 --2- 172.21.15.92:0/3742266174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0564102a60 0x7f0564102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.564+0000 7f056b0f8640 1 -- 172.21.15.92:0/3742266174 >> 172.21.15.92:0/3742266174 conn(0x7f0564079730 msgr2=0x7f0564079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:25.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.564+0000 7f056b0f8640 1 -- 172.21.15.92:0/3742266174 shutdown_connections 2024-09-21T07:23:25.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.564+0000 7f056b0f8640 1 -- 172.21.15.92:0/3742266174 wait complete. 2024-09-21T07:23:25.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f056b0f8640 1 Processor -- start 2024-09-21T07:23:25.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f056b0f8640 1 -- start start 2024-09-21T07:23:25.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f056b0f8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0564102a60 0x7f056419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f056b0f8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05641083a0 0x7f056419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f056b0f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0564108cf0 0x7f056419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f056b0f8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0564113960 con 0x7f0564102a60 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f056b0f8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05641137e0 con 0x7f05641083a0 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f056b0f8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0564113ae0 con 0x7f0564108cf0 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f0568e94640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0564102a60 0x7f056419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f0568e94640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0564102a60 0x7f056419a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34744/0 (socket says 172.21.15.92:34744) 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f0568e94640 1 -- 172.21.15.92:0/1789252747 learned_addr learned my addr 172.21.15.92:0/1789252747 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f0563fff640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05641083a0 0x7f056419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.565+0000 7f0569695640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0564108cf0 0x7f056419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f0568e94640 1 -- 172.21.15.92:0/1789252747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0564108cf0 msgr2=0x7f056419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f0568e94640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0564108cf0 0x7f056419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f0568e94640 1 -- 172.21.15.92:0/1789252747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05641083a0 msgr2=0x7f056419a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f0568e94640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05641083a0 0x7f056419a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f0568e94640 1 -- 172.21.15.92:0/1789252747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05641a0280 con 0x7f0564102a60 2024-09-21T07:23:25.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f0568e94640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0564102a60 0x7f056419a310 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f055800d770 tx=0x7f055800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:25.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f0561ffb640 1 -- 172.21.15.92:0/1789252747 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558017070 con 0x7f0564102a60 2024-09-21T07:23:25.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f0561ffb640 1 -- 172.21.15.92:0/1789252747 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05580054b0 con 0x7f0564102a60 2024-09-21T07:23:25.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f056b0f8640 1 -- 172.21.15.92:0/1789252747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05641a0570 con 0x7f0564102a60 2024-09-21T07:23:25.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f0561ffb640 1 -- 172.21.15.92:0/1789252747 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558004c60 con 0x7f0564102a60 2024-09-21T07:23:25.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.566+0000 7f056b0f8640 1 -- 172.21.15.92:0/1789252747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05641a6cd0 con 0x7f0564102a60 2024-09-21T07:23:25.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f0561ffb640 1 -- 172.21.15.92:0/1789252747 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f0558004e00 con 0x7f0564102a60 2024-09-21T07:23:25.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f057166c740 1 Processor -- start 2024-09-21T07:23:25.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f057166c740 1 -- start start 2024-09-21T07:23:25.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f057166c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f057166c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f057166c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 0x5561c54af120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f057166c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5561c5424ea0 con 0x5561c5107070 2024-09-21T07:23:25.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f057166c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5561c54142d0 con 0x5561c50e6390 2024-09-21T07:23:25.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f057166c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5561c54180e0 con 0x5561c50de1b0 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f0569695640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f0569695640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34758/0 (socket says 172.21.15.92:34758) 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.569+0000 7f0569695640 1 -- 172.21.15.92:0/3979047778 learned_addr learned my addr 172.21.15.92:0/3979047778 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0568e94640 1 --2- 172.21.15.92:0/3979047778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0563fff640 1 --2- 172.21.15.92:0/3979047778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 0x5561c54af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0569695640 1 -- 172.21.15.92:0/3979047778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 msgr2=0x5561c54aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0569695640 1 --2- 172.21.15.92:0/3979047778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0569695640 1 -- 172.21.15.92:0/3979047778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 msgr2=0x5561c54af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0569695640 1 --2- 172.21.15.92:0/3979047778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 0x5561c54af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0569695640 1 -- 172.21.15.92:0/3979047778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c5172650 con 0x5561c5107070 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0561ffb640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05540b6680 0x7f05540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0563fff640 1 --2- 172.21.15.92:0/3979047778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 0x5561c54af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0568e94640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05540b6680 0x7f05540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0569695640 1 --2- 172.21.15.92:0/3979047778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54ae6a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f055c009ca0 tx=0x7f055c031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43afa91ff4538f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:25.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f0561ffb640 1 -- 172.21.15.92:0/1789252747 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f05580e74e0 con 0x7f0564102a60 2024-09-21T07:23:25.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f054effd640 1 -- 172.21.15.92:0/3979047778 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c0317b0 con 0x5561c5107070 2024-09-21T07:23:25.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f054effd640 1 -- 172.21.15.92:0/3979047778 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f055c036030 con 0x5561c5107070 2024-09-21T07:23:25.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.570+0000 7f054effd640 1 -- 172.21.15.92:0/3979047778 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c004590 con 0x5561c5107070 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.571+0000 7f057166c740 1 -- 172.21.15.92:0/3979047778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 msgr2=0x5561c54ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.571+0000 7f0568e94640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05540b6680 0x7f05540b8b90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f05580e48e0 tx=0x7f05580ed0e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.571+0000 7f057166c740 1 --2- 172.21.15.92:0/3979047778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54ae6a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f055c009ca0 tx=0x7f055c031500 comp rx=0 tx=0).stop 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.571+0000 7f057166c740 1 -- 172.21.15.92:0/3979047778 shutdown_connections 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.571+0000 7f057166c740 1 --2- 172.21.15.92:0/3979047778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 0x5561c54af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.571+0000 7f057166c740 1 --2- 172.21.15.92:0/3979047778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.571+0000 7f057166c740 1 --2- 172.21.15.92:0/3979047778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54ae6a0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.571+0000 7f057166c740 1 -- 172.21.15.92:0/3979047778 >> 172.21.15.92:0/3979047778 conn(0x5561c50fb460 msgr2=0x5561c54ac590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.571+0000 7f057166c740 1 -- 172.21.15.92:0/3979047778 shutdown_connections 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.571+0000 7f057166c740 1 -- 172.21.15.92:0/3979047778 wait complete. 2024-09-21T07:23:25.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.572+0000 7f057166c740 1 -- start start 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.572+0000 7f057166c740 1 Processor -- start 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.572+0000 7f057166c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54b9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.572+0000 7f057166c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 0x5561c54ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.572+0000 7f057166c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.572+0000 7f057166c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5561c5275700 con 0x5561c5107070 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.572+0000 7f057166c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5561c53af160 con 0x5561c50e6390 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.572+0000 7f057166c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5561c54bcca0 con 0x5561c50de1b0 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.572+0000 7f057166c740 10 client.0 _ll_register_callbacks cb 0x5561c53c89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.572+0000 7f0569695640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0569695640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34764/0 (socket says 172.21.15.92:34764) 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0569695640 1 -- 172.21.15.92:0/125209212 learned_addr learned my addr 172.21.15.92:0/125209212 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0563fff640 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 0x5561c54ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0569695640 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54b9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0569695640 1 -- 172.21.15.92:0/125209212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 msgr2=0x5561c54b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:25.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0569695640 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54b9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0569695640 1 -- 172.21.15.92:0/125209212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 msgr2=0x5561c54ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:25.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0569695640 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 0x5561c54ba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0569695640 1 -- 172.21.15.92:0/125209212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561c53dcc90 con 0x5561c5107070 2024-09-21T07:23:25.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0569695640 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54c5f90 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x5561c54b0cf0 tx=0x7f055c004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9924e4ce29ac62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:25.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0543fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:25.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0543fff640 1 -- 172.21.15.92:0/125209212 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c058060 con 0x5561c5107070 2024-09-21T07:23:25.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0543fff640 1 -- 172.21.15.92:0/125209212 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f055c004310 con 0x5561c5107070 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f057166c740 1 -- 172.21.15.92:0/125209212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f055c036030 con 0x5561c5107070 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f0543fff640 1 -- 172.21.15.92:0/125209212 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f055c05f050 con 0x5561c5107070 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f057166c740 10 client.18363 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.573+0000 7f057166c740 1 -- 172.21.15.92:0/125209212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561c54c8990 con 0x5561c5107070 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.574+0000 7f0543fff640 1 -- 172.21.15.92:0/125209212 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f055c036030 con 0x5561c5107070 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.574+0000 7f0543fff640 1 -- 172.21.15.92:0/125209212 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f055c050070 con 0x5561c5107070 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.574+0000 7f057166c740 10 client.18363 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.574+0000 7f057166c740 10 client.18363 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.574+0000 7f057166c740 20 client.18363 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.574+0000 7f057166c740 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5561c50c59f0 0x5561c54cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.574+0000 7f057166c740 4 client.18363 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.574+0000 7f057166c740 1 -- 172.21.15.92:0/125209212 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561c5426df0 con 0x5561c50c59f0 2024-09-21T07:23:25.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.574+0000 7f0563fff640 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5561c50c59f0 0x5561c54cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.575+0000 7f0543fff640 10 client.18363 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:23:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.575+0000 7f0563fff640 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5561c50c59f0 0x5561c54cbcf0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=94988b26034f0ef3 server_cookie=ba2250bf5d4021f9 in_seq=0 out_seq=0 2024-09-21T07:23:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.575+0000 7f0543fff640 1 -- 172.21.15.92:0/125209212 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561c5426df0 con 0x5561c50c59f0 2024-09-21T07:23:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.575+0000 7f0543fff640 10 client.18363 handle_command_reply: tid=0 2024-09-21T07:23:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 client.18363 shutdown 2024-09-21T07:23:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 -- 172.21.15.92:0/125209212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 msgr2=0x5561c54c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54c5f90 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x5561c54b0cf0 tx=0x7f055c004170 comp rx=0 tx=0).stop 2024-09-21T07:23:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 -- 172.21.15.92:0/125209212 shutdown_connections 2024-09-21T07:23:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5561c50c59f0 0x5561c54cbcf0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54c5f90 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50e6390 0x5561c54ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 --2- 172.21.15.92:0/125209212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 -- 172.21.15.92:0/125209212 >> 172.21.15.92:0/125209212 conn(0x5561c50fb460 msgr2=0x5561c54b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f0543fff640 0 client.18363 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:23:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 -- 172.21.15.92:0/125209212 shutdown_connections 2024-09-21T07:23:25.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 1 -- 172.21.15.92:0/125209212 wait complete. 2024-09-21T07:23:25.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.576+0000 7f057166c740 20 client.18363 trim_cache size 0 max 16384 2024-09-21T07:23:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f057166c740 1 Processor -- start 2024-09-21T07:23:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f057166c740 1 -- start start 2024-09-21T07:23:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f057166c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f057166c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c50e6390 0x5561c54bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f057166c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c5107070 0x5561c54c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f057166c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05641b0dd0 con 0x5561c50e6390 2024-09-21T07:23:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f057166c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05641b2910 con 0x5561c5107070 2024-09-21T07:23:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f057166c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05641b14a0 con 0x5561c50de1b0 2024-09-21T07:23:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f0563fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c50e6390 0x5561c54bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f0563fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c50e6390 0x5561c54bbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34780/0 (socket says 172.21.15.92:34780) 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.589+0000 7f0563fff640 1 -- 172.21.15.92:0/1936292996 learned_addr learned my addr 172.21.15.92:0/1936292996 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f0569695640 1 --2- 172.21.15.92:0/1936292996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f0569695640 1 --2- 172.21.15.92:0/1936292996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c5107070 0x5561c54c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f0563fff640 1 -- 172.21.15.92:0/1936292996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 msgr2=0x5561c54b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f0563fff640 1 --2- 172.21.15.92:0/1936292996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f0563fff640 1 -- 172.21.15.92:0/1936292996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c5107070 msgr2=0x5561c54c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f0563fff640 1 --2- 172.21.15.92:0/1936292996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c5107070 0x5561c54c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f0563fff640 1 -- 172.21.15.92:0/1936292996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c54bb000 con 0x5561c50e6390 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f0563fff640 1 --2- 172.21.15.92:0/1936292996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c50e6390 0x5561c54bbc20 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f05500058c0 tx=0x7f05500118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5008bb4b1a5edd5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f054e7fc640 1 -- 172.21.15.92:0/1936292996 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055001d620 con 0x5561c50e6390 2024-09-21T07:23:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f054e7fc640 1 -- 172.21.15.92:0/1936292996 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f055001dc50 con 0x5561c50e6390 2024-09-21T07:23:25.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.590+0000 7f054e7fc640 1 -- 172.21.15.92:0/1936292996 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0550024d80 con 0x5561c50e6390 2024-09-21T07:23:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 -- 172.21.15.92:0/1936292996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c50e6390 msgr2=0x5561c54bbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 --2- 172.21.15.92:0/1936292996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c50e6390 0x5561c54bbc20 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f05500058c0 tx=0x7f05500118d0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 -- 172.21.15.92:0/1936292996 shutdown_connections 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 --2- 172.21.15.92:0/1936292996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c5107070 0x5561c54c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 --2- 172.21.15.92:0/1936292996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c50e6390 0x5561c54bbc20 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 --2- 172.21.15.92:0/1936292996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50de1b0 0x5561c54b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 -- 172.21.15.92:0/1936292996 >> 172.21.15.92:0/1936292996 conn(0x5561c50fb460 msgr2=0x5561c54b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 -- 172.21.15.92:0/1936292996 shutdown_connections 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 -- 172.21.15.92:0/1936292996 wait complete. 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 -- start start 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.591+0000 7f057166c740 1 Processor -- start 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f057166c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50de1b0 0x5561c54bdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f057166c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50e6390 0x5561c54be430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f057166c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54be970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f057166c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05641b2240 con 0x5561c5107070 2024-09-21T07:23:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f057166c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05641b1b70 con 0x5561c50de1b0 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f057166c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05641aedd0 con 0x5561c50e6390 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f057166c740 10 client.0 _ll_register_callbacks cb 0x7f05580eaf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f0569695640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f0569695640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54be970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34790/0 (socket says 172.21.15.92:34790) 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f0569695640 1 -- 172.21.15.92:0/3329701234 learned_addr learned my addr 172.21.15.92:0/3329701234 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f0563fff640 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50e6390 0x5561c54be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f0569695640 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50de1b0 0x5561c54bdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f0569695640 1 -- 172.21.15.92:0/3329701234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50e6390 msgr2=0x5561c54be430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f0569695640 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50e6390 0x5561c54be430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f0569695640 1 -- 172.21.15.92:0/3329701234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50de1b0 msgr2=0x5561c54bdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f0569695640 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50de1b0 0x5561c54bdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.592+0000 7f0569695640 1 -- 172.21.15.92:0/3329701234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561c5535490 con 0x5561c5107070 2024-09-21T07:23:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f0569695640 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54be970 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f055c009ca0 tx=0x7f055c004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679b046d4614c106 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f0543fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f0543fff640 1 -- 172.21.15.92:0/3329701234 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c058040 con 0x5561c5107070 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f0543fff640 1 -- 172.21.15.92:0/3329701234 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f055c031d00 con 0x5561c5107070 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f057166c740 1 -- 172.21.15.92:0/3329701234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f055001dc50 con 0x5561c5107070 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f0543fff640 1 -- 172.21.15.92:0/3329701234 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f055c004b40 con 0x5561c5107070 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f057166c740 10 client.18369 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f057166c740 1 -- 172.21.15.92:0/3329701234 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561c55366e0 con 0x5561c5107070 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f0543fff640 1 -- 172.21.15.92:0/3329701234 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f055001dc50 con 0x5561c5107070 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f0543fff640 1 -- 172.21.15.92:0/3329701234 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f055c050040 con 0x5561c5107070 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f057166c740 10 client.18369 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f057166c740 10 client.18369 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f057166c740 20 client.18369 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f057166c740 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5561c509ada0 0x5561c5538b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:25.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f057166c740 4 client.18369 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.593+0000 7f057166c740 1 -- 172.21.15.92:0/3329701234 --> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561c54228a0 con 0x5561c509ada0 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.594+0000 7f0563fff640 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5561c509ada0 0x5561c5538b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.594+0000 7f0563fff640 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5561c509ada0 0x5561c5538b60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=57759f19f86babd3 server_cookie=6dbf24b10908e6fb in_seq=0 out_seq=0 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.594+0000 7f0543fff640 10 client.18369 ms_handle_connect on v2:172.21.15.175:6836/1654191634 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.594+0000 7f0543fff640 1 -- 172.21.15.92:0/3329701234 <== mds.4 v2:172.21.15.175:6836/1654191634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561c54228a0 con 0x5561c509ada0 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.594+0000 7f0543fff640 10 client.18369 handle_command_reply: tid=0 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.594+0000 7f057166c740 1 client.18369 shutdown 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.594+0000 7f057166c740 1 -- 172.21.15.92:0/3329701234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 msgr2=0x5561c54be970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.594+0000 7f057166c740 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54be970 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f055c009ca0 tx=0x7f055c004170 comp rx=0 tx=0).stop 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f057166c740 1 -- 172.21.15.92:0/3329701234 shutdown_connections 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f057166c740 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.175:6836/1654191634,v1:172.21.15.175:6837/1654191634] conn(0x5561c509ada0 0x5561c5538b60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f057166c740 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561c5107070 0x5561c54be970 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f057166c740 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5561c50e6390 0x5561c54be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f057166c740 1 --2- 172.21.15.92:0/3329701234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5561c50de1b0 0x5561c54bdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f057166c740 1 -- 172.21.15.92:0/3329701234 >> 172.21.15.92:0/3329701234 conn(0x5561c50fb460 msgr2=0x5561c54bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:25.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f0543fff640 0 client.18369 ms_handle_reset on v2:172.21.15.175:6836/1654191634 2024-09-21T07:23:25.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f057166c740 1 -- 172.21.15.92:0/3329701234 shutdown_connections 2024-09-21T07:23:25.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f057166c740 1 -- 172.21.15.92:0/3329701234 wait complete. 2024-09-21T07:23:25.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f057166c740 20 client.18369 trim_cache size 0 max 16384 2024-09-21T07:23:25.603 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:23:25.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f056b0f8640 1 -- 172.21.15.92:0/1789252747 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05540b6680 msgr2=0x7f05540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f056b0f8640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05540b6680 0x7f05540b8b90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f05580e48e0 tx=0x7f05580ed0e0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f056b0f8640 1 -- 172.21.15.92:0/1789252747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0564102a60 msgr2=0x7f056419a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:25.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f056b0f8640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0564102a60 0x7f056419a310 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f055800d770 tx=0x7f055800dc30 comp rx=0 tx=0).stop 2024-09-21T07:23:25.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f056b0f8640 1 -- 172.21.15.92:0/1789252747 shutdown_connections 2024-09-21T07:23:25.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f056b0f8640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f05540b6680 0x7f05540b8b90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f056b0f8640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0564108cf0 0x7f056419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.595+0000 7f056b0f8640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05641083a0 0x7f056419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.596+0000 7f056b0f8640 1 --2- 172.21.15.92:0/1789252747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0564102a60 0x7f056419a310 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:25.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.596+0000 7f056b0f8640 1 -- 172.21.15.92:0/1789252747 >> 172.21.15.92:0/1789252747 conn(0x7f0564079730 msgr2=0x7f05641043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:25.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.596+0000 7f056b0f8640 1 -- 172.21.15.92:0/1789252747 shutdown_connections 2024-09-21T07:23:25.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:25.596+0000 7f056b0f8640 1 -- 172.21.15.92:0/1789252747 wait complete. 2024-09-21T07:23:26.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:25 smithi092 ceph-mon[30987]: pgmap v657: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:23:26.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:25 smithi169 ceph-mon[33705]: pgmap v657: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:23:26.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:25 smithi175 ceph-mon[34064]: pgmap v657: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:23:26.413 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:23:26.666 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.179+0000 7f9667fe4640 1 -- 172.21.15.92:0/3342794117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f966010de90 msgr2=0x7f9660110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.179+0000 7f9667fe4640 1 --2- 172.21.15.92:0/3342794117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f966010de90 0x7f9660110380 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f9658009ca0 tx=0x7f965802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.179+0000 7f9667fe4640 1 -- 172.21.15.92:0/3342794117 shutdown_connections 2024-09-21T07:23:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.179+0000 7f9667fe4640 1 --2- 172.21.15.92:0/3342794117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f966010de90 0x7f9660110380 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.179+0000 7f9667fe4640 1 --2- 172.21.15.92:0/3342794117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9660105380 0x7f966010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.179+0000 7f9667fe4640 1 --2- 172.21.15.92:0/3342794117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660104a30 0x7f9660104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.179+0000 7f9667fe4640 1 -- 172.21.15.92:0/3342794117 >> 172.21.15.92:0/3342794117 conn(0x7f9660079770 msgr2=0x7f9660079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.179+0000 7f9667fe4640 1 -- 172.21.15.92:0/3342794117 shutdown_connections 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.179+0000 7f9667fe4640 1 -- 172.21.15.92:0/3342794117 wait complete. 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.180+0000 7f9667fe4640 1 Processor -- start 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.180+0000 7f9667fe4640 1 -- start start 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.180+0000 7f9667fe4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660104a30 0x7f966019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.180+0000 7f9667fe4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9660105380 0x7f966019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.180+0000 7f9667fe4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f966010de90 0x7f966019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f9667fe4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9660113a10 con 0x7f9660105380 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f9667fe4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9660113890 con 0x7f9660104a30 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f9667fe4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9660113b90 con 0x7f966010de90 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f966557f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9660105380 0x7f966019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f966557f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9660105380 0x7f966019a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34804/0 (socket says 172.21.15.92:34804) 2024-09-21T07:23:27.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f966557f640 1 -- 172.21.15.92:0/1160995454 learned_addr learned my addr 172.21.15.92:0/1160995454 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f9665d80640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660104a30 0x7f966019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f9666581640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f966010de90 0x7f966019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f966557f640 1 -- 172.21.15.92:0/1160995454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f966010de90 msgr2=0x7f966019fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f966557f640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f966010de90 0x7f966019fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f966557f640 1 -- 172.21.15.92:0/1160995454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660104a30 msgr2=0x7f966019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f966557f640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660104a30 0x7f966019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f966557f640 1 -- 172.21.15.92:0/1160995454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96601a0390 con 0x7f9660105380 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f966557f640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9660105380 0x7f966019a9c0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f965c00d750 tx=0x7f965c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f9652ffd640 1 -- 172.21.15.92:0/1160995454 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c017070 con 0x7f9660105380 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f9652ffd640 1 -- 172.21.15.92:0/1160995454 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f965c0054b0 con 0x7f9660105380 2024-09-21T07:23:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f9652ffd640 1 -- 172.21.15.92:0/1160995454 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c004bc0 con 0x7f9660105380 2024-09-21T07:23:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f9667fe4640 1 -- 172.21.15.92:0/1160995454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96601a0680 con 0x7f9660105380 2024-09-21T07:23:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.181+0000 7f9667fe4640 1 -- 172.21.15.92:0/1160995454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96601a6de0 con 0x7f9660105380 2024-09-21T07:23:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.184+0000 7f966e558740 1 Processor -- start 2024-09-21T07:23:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.184+0000 7f966e558740 1 -- start start 2024-09-21T07:23:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.184+0000 7f9652ffd640 1 -- 172.21.15.92:0/1160995454 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f965c009c30 con 0x7f9660105380 2024-09-21T07:23:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.184+0000 7f966e558740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b40a070 0x55d99b7b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.184+0000 7f966e558740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e11b0 0x55d99b7b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.184+0000 7f966e558740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e9390 0x55d99b7b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.184+0000 7f966e558740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d99b727ea0 con 0x55d99b40a070 2024-09-21T07:23:27.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.184+0000 7f966e558740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d99b7172d0 con 0x55d99b3e11b0 2024-09-21T07:23:27.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.184+0000 7f966e558740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d99b71b0e0 con 0x55d99b3e9390 2024-09-21T07:23:27.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9666581640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b40a070 0x55d99b7b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9666581640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b40a070 0x55d99b7b16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34818/0 (socket says 172.21.15.92:34818) 2024-09-21T07:23:27.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9666581640 1 -- 172.21.15.92:0/2274100696 learned_addr learned my addr 172.21.15.92:0/2274100696 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:27.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9665d80640 1 --2- 172.21.15.92:0/2274100696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e11b0 0x55d99b7b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f966557f640 1 --2- 172.21.15.92:0/2274100696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e9390 0x55d99b7b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9666581640 1 -- 172.21.15.92:0/2274100696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e9390 msgr2=0x55d99b7b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:27.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9666581640 1 --2- 172.21.15.92:0/2274100696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e9390 0x55d99b7b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9666581640 1 -- 172.21.15.92:0/2274100696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e11b0 msgr2=0x55d99b7b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:27.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9666581640 1 --2- 172.21.15.92:0/2274100696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e11b0 0x55d99b7b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9666581640 1 -- 172.21.15.92:0/2274100696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99b475650 con 0x55d99b40a070 2024-09-21T07:23:27.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f966557f640 1 --2- 172.21.15.92:0/2274100696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e9390 0x55d99b7b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:27.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9666581640 1 --2- 172.21.15.92:0/2274100696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b40a070 0x55d99b7b16a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f9658035000 tx=0x7f9658031580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f97bbfb270f1fcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:27.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f964bfff640 1 -- 172.21.15.92:0/2274100696 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658031b80 con 0x55d99b40a070 2024-09-21T07:23:27.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f964bfff640 1 -- 172.21.15.92:0/2274100696 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9658036040 con 0x55d99b40a070 2024-09-21T07:23:27.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f964bfff640 1 -- 172.21.15.92:0/2274100696 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658004480 con 0x55d99b40a070 2024-09-21T07:23:27.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.185+0000 7f9652ffd640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f964c0b6700 0x7f964c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f9665d80640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f964c0b6700 0x7f964c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f9652ffd640 1 -- 172.21.15.92:0/1160995454 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f965c0e74b0 con 0x7f9660105380 2024-09-21T07:23:27.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f966e558740 1 -- 172.21.15.92:0/2274100696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b40a070 msgr2=0x55d99b7b16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f9665d80640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f964c0b6700 0x7f964c0b8c10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x55d99b7b0320 tx=0x7f965400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:27.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f966e558740 1 --2- 172.21.15.92:0/2274100696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b40a070 0x55d99b7b16a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f9658035000 tx=0x7f9658031580 comp rx=0 tx=0).stop 2024-09-21T07:23:27.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f966e558740 1 -- 172.21.15.92:0/2274100696 shutdown_connections 2024-09-21T07:23:27.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f966e558740 1 --2- 172.21.15.92:0/2274100696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e9390 0x55d99b7b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f966e558740 1 --2- 172.21.15.92:0/2274100696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e11b0 0x55d99b7b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f966e558740 1 --2- 172.21.15.92:0/2274100696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b40a070 0x55d99b7b16a0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f966e558740 1 -- 172.21.15.92:0/2274100696 >> 172.21.15.92:0/2274100696 conn(0x55d99b3fe460 msgr2=0x55d99b7af590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:27.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f966e558740 1 -- 172.21.15.92:0/2274100696 shutdown_connections 2024-09-21T07:23:27.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.186+0000 7f966e558740 1 -- 172.21.15.92:0/2274100696 wait complete. 2024-09-21T07:23:27.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966e558740 1 -- start start 2024-09-21T07:23:27.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966e558740 1 Processor -- start 2024-09-21T07:23:27.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966e558740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e11b0 0x55d99b7bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966e558740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7bd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966e558740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b40a070 0x55d99b7c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966e558740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d99b578700 con 0x55d99b3e9390 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966e558740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d99b6b2160 con 0x55d99b3e11b0 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966e558740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d99b7bfe20 con 0x55d99b40a070 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966e558740 10 client.0 _ll_register_callbacks cb 0x55d99b6cb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966557f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7bd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.187+0000 7f966557f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7bd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34820/0 (socket says 172.21.15.92:34820) 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f966557f640 1 -- 172.21.15.92:0/1169458727 learned_addr learned my addr 172.21.15.92:0/1169458727 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f9665d80640 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e11b0 0x55d99b7bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f9666581640 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b40a070 0x55d99b7c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f966557f640 1 -- 172.21.15.92:0/1169458727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b40a070 msgr2=0x55d99b7c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f966557f640 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b40a070 0x55d99b7c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f966557f640 1 -- 172.21.15.92:0/1169458727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e11b0 msgr2=0x55d99b7bcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f966557f640 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e11b0 0x55d99b7bcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f966557f640 1 -- 172.21.15.92:0/1169458727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99b6dfc90 con 0x55d99b3e9390 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f966557f640 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7bd320 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f965c00d720 tx=0x7f965c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf66cedc8f960678 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f96497fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f96497fa640 1 -- 172.21.15.92:0/1169458727 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c020070 con 0x55d99b3e9390 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f966e558740 1 -- 172.21.15.92:0/1169458727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9658036040 con 0x55d99b3e9390 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f96497fa640 1 -- 172.21.15.92:0/1169458727 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f965c0940f0 con 0x55d99b3e9390 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f96497fa640 1 -- 172.21.15.92:0/1169458727 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f965c0ac850 con 0x55d99b3e9390 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f966e558740 10 client.18381 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f966e558740 1 -- 172.21.15.92:0/1169458727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d99b7cbc70 con 0x55d99b3e9390 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.188+0000 7f96497fa640 1 -- 172.21.15.92:0/1169458727 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9658036040 con 0x55d99b3e9390 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.189+0000 7f96497fa640 1 -- 172.21.15.92:0/1169458727 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f965c0abbd0 con 0x55d99b3e9390 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.189+0000 7f966e558740 10 client.18381 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.189+0000 7f966e558740 10 client.18381 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.189+0000 7f966e558740 20 client.18381 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.189+0000 7f966e558740 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d99b3c89f0 0x55d99b7cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.189+0000 7f966e558740 4 client.18381 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.189+0000 7f966e558740 1 -- 172.21.15.92:0/1169458727 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d99b729df0 con 0x55d99b3c89f0 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.189+0000 7f9665d80640 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d99b3c89f0 0x55d99b7cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.189+0000 7f96497fa640 10 client.18381 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.189+0000 7f9665d80640 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d99b3c89f0 0x55d99b7cf140 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=872a72cf4b077306 server_cookie=453d7007f417c7ef in_seq=0 out_seq=0 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.190+0000 7f96497fa640 1 -- 172.21.15.92:0/1169458727 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d99b729df0 con 0x55d99b3c89f0 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.190+0000 7f96497fa640 10 client.18381 handle_command_reply: tid=0 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.190+0000 7f966e558740 1 client.18381 shutdown 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.190+0000 7f966e558740 1 -- 172.21.15.92:0/1169458727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 msgr2=0x55d99b7bd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.190+0000 7f966e558740 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7bd320 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f965c00d720 tx=0x7f965c005740 comp rx=0 tx=0).stop 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.191+0000 7f966e558740 1 -- 172.21.15.92:0/1169458727 shutdown_connections 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.191+0000 7f966e558740 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b40a070 0x55d99b7c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.191+0000 7f966e558740 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d99b3c89f0 0x55d99b7cf140 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.191+0000 7f966e558740 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7bd320 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.191+0000 7f966e558740 1 --2- 172.21.15.92:0/1169458727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e11b0 0x55d99b7bcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.191+0000 7f96497fa640 0 client.18381 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.191+0000 7f966e558740 1 -- 172.21.15.92:0/1169458727 >> 172.21.15.92:0/1169458727 conn(0x55d99b3fe460 msgr2=0x55d99b7b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.191+0000 7f966e558740 1 -- 172.21.15.92:0/1169458727 shutdown_connections 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.191+0000 7f966e558740 1 -- 172.21.15.92:0/1169458727 wait complete. 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.191+0000 7f966e558740 20 client.18381 trim_cache size 0 max 16384 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966e558740 1 Processor -- start 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966e558740 1 -- start start 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966e558740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e11b0 0x55d99b7af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966e558740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966e558740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b40a070 0x55d99b7b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966e558740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f96601b0ff0 con 0x55d99b3e9390 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966e558740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f96601b2b30 con 0x55d99b40a070 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966e558740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96601b16c0 con 0x55d99b3e11b0 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966557f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966557f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34836/0 (socket says 172.21.15.92:34836) 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966557f640 1 -- 172.21.15.92:0/3548878180 learned_addr learned my addr 172.21.15.92:0/3548878180 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966557f640 1 -- 172.21.15.92:0/3548878180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e11b0 msgr2=0x55d99b7af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f9665d80640 1 --2- 172.21.15.92:0/3548878180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e11b0 0x55d99b7af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966557f640 1 --2- 172.21.15.92:0/3548878180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e11b0 0x55d99b7af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966557f640 1 -- 172.21.15.92:0/3548878180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b40a070 msgr2=0x55d99b7b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966557f640 1 --2- 172.21.15.92:0/3548878180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b40a070 0x55d99b7b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966557f640 1 -- 172.21.15.92:0/3548878180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99b7b4500 con 0x55d99b3e9390 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f966557f640 1 --2- 172.21.15.92:0/3548878180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7c9040 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f965c0acc00 tx=0x7f965c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cae258207ac724 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.204+0000 7f964b7fe640 1 -- 172.21.15.92:0/3548878180 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c020030 con 0x55d99b3e9390 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f964b7fe640 1 -- 172.21.15.92:0/3548878180 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f965c0aca10 con 0x55d99b3e9390 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f964b7fe640 1 -- 172.21.15.92:0/3548878180 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c098040 con 0x55d99b3e9390 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f966e558740 1 -- 172.21.15.92:0/3548878180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 msgr2=0x55d99b7c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f966e558740 1 --2- 172.21.15.92:0/3548878180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7c9040 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f965c0acc00 tx=0x7f965c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f966e558740 1 -- 172.21.15.92:0/3548878180 shutdown_connections 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f966e558740 1 --2- 172.21.15.92:0/3548878180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b40a070 0x55d99b7b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f966e558740 1 --2- 172.21.15.92:0/3548878180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e9390 0x55d99b7c9040 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f966e558740 1 --2- 172.21.15.92:0/3548878180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b3e11b0 0x55d99b7af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f966e558740 1 -- 172.21.15.92:0/3548878180 >> 172.21.15.92:0/3548878180 conn(0x55d99b3fe460 msgr2=0x55d99b7aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f966e558740 1 -- 172.21.15.92:0/3548878180 shutdown_connections 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.205+0000 7f966e558740 1 -- 172.21.15.92:0/3548878180 wait complete. 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.206+0000 7f966e558740 1 -- start start 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.206+0000 7f966e558740 1 Processor -- start 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.206+0000 7f966e558740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e11b0 0x55d99b7c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.206+0000 7f966e558740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e9390 0x55d99b7c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.206+0000 7f966e558740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b40a070 0x55d99b7c1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.206+0000 7f966e558740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f96601b2460 con 0x55d99b3e11b0 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.206+0000 7f966e558740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f96601b1d90 con 0x55d99b3e9390 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.206+0000 7f966e558740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96601aeff0 con 0x55d99b40a070 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.206+0000 7f966e558740 10 client.0 _ll_register_callbacks cb 0x7f965c0057f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f9665d80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e11b0 0x55d99b7c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f9665d80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e11b0 0x55d99b7c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34848/0 (socket says 172.21.15.92:34848) 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f9665d80640 1 -- 172.21.15.92:0/2402202014 learned_addr learned my addr 172.21.15.92:0/2402202014 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f966557f640 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e9390 0x55d99b7c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f9666581640 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b40a070 0x55d99b7c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f9665d80640 1 -- 172.21.15.92:0/2402202014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b40a070 msgr2=0x55d99b7c1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f9665d80640 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b40a070 0x55d99b7c1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f9665d80640 1 -- 172.21.15.92:0/2402202014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e9390 msgr2=0x55d99b7c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f9665d80640 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e9390 0x55d99b7c0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f9665d80640 1 -- 172.21.15.92:0/2402202014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99b7c1ac0 con 0x55d99b3e11b0 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f9665d80640 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e11b0 0x55d99b7c58e0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9654011010 tx=0x7f9654015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3787b90481212ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f96497fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f96497fa640 1 -- 172.21.15.92:0/2402202014 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965401bd40 con 0x55d99b3e11b0 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f96497fa640 1 -- 172.21.15.92:0/2402202014 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f9654004020 con 0x55d99b3e11b0 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f966e558740 1 -- 172.21.15.92:0/2402202014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f965c0aca10 con 0x55d99b3e11b0 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f96497fa640 1 -- 172.21.15.92:0/2402202014 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9654039050 con 0x55d99b3e11b0 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f966e558740 10 client.18387 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.207+0000 7f966e558740 1 -- 172.21.15.92:0/2402202014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d99b839a50 con 0x55d99b3e11b0 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.208+0000 7f96497fa640 1 -- 172.21.15.92:0/2402202014 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f965c0aca10 con 0x55d99b3e11b0 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.208+0000 7f96497fa640 1 -- 172.21.15.92:0/2402202014 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9654003c60 con 0x55d99b3e11b0 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.208+0000 7f966e558740 10 client.18387 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.208+0000 7f966e558740 10 client.18387 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.208+0000 7f966e558740 20 client.18387 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.208+0000 7f966e558740 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d99b39dda0 0x55d99b83c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.208+0000 7f966e558740 4 client.18387 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.208+0000 7f966e558740 1 -- 172.21.15.92:0/2402202014 --> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d99b7258a0 con 0x55d99b39dda0 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.208+0000 7f966557f640 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d99b39dda0 0x55d99b83c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:27.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f96497fa640 10 client.18387 ms_handle_connect on v2:172.21.15.175:6832/2860278829 2024-09-21T07:23:27.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966557f640 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d99b39dda0 0x55d99b83c270 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a00b250bf730492d server_cookie=c3d21fd1a108c069 in_seq=0 out_seq=0 2024-09-21T07:23:27.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f96497fa640 1 -- 172.21.15.92:0/2402202014 <== mds.3 v2:172.21.15.175:6832/2860278829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d99b7258a0 con 0x55d99b39dda0 2024-09-21T07:23:27.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f96497fa640 10 client.18387 handle_command_reply: tid=0 2024-09-21T07:23:27.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 client.18387 shutdown 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 -- 172.21.15.92:0/2402202014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e11b0 msgr2=0x55d99b7c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e11b0 0x55d99b7c58e0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9654011010 tx=0x7f9654015000 comp rx=0 tx=0).stop 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 -- 172.21.15.92:0/2402202014 shutdown_connections 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d99b40a070 0x55d99b7c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d99b3e9390 0x55d99b7c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.175:6832/2860278829,v1:172.21.15.175:6833/2860278829] conn(0x55d99b39dda0 0x55d99b83c270 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 --2- 172.21.15.92:0/2402202014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d99b3e11b0 0x55d99b7c58e0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f96497fa640 0 client.18387 ms_handle_reset on v2:172.21.15.175:6832/2860278829 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 -- 172.21.15.92:0/2402202014 >> 172.21.15.92:0/2402202014 conn(0x55d99b3fe460 msgr2=0x55d99b7aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 -- 172.21.15.92:0/2402202014 shutdown_connections 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 1 -- 172.21.15.92:0/2402202014 wait complete. 2024-09-21T07:23:27.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.209+0000 7f966e558740 20 client.18387 trim_cache size 0 max 16384 2024-09-21T07:23:27.232 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:23:27.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 -- 172.21.15.92:0/1160995454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f964c0b6700 msgr2=0x7f964c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f964c0b6700 0x7f964c0b8c10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x55d99b7b0320 tx=0x7f965400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 -- 172.21.15.92:0/1160995454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9660105380 msgr2=0x7f966019a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9660105380 0x7f966019a9c0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f965c00d750 tx=0x7f965c00dc10 comp rx=0 tx=0).stop 2024-09-21T07:23:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 -- 172.21.15.92:0/1160995454 shutdown_connections 2024-09-21T07:23:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f964c0b6700 0x7f964c0b8c10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f966010de90 0x7f966019fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9660105380 0x7f966019a9c0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 --2- 172.21.15.92:0/1160995454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660104a30 0x7f966019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 -- 172.21.15.92:0/1160995454 >> 172.21.15.92:0/1160995454 conn(0x7f9660079770 msgr2=0x7f9660107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 -- 172.21.15.92:0/1160995454 shutdown_connections 2024-09-21T07:23:27.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:27.210+0000 7f9667fe4640 1 -- 172.21.15.92:0/1160995454 wait complete. 2024-09-21T07:23:28.014 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:27 smithi092 ceph-mon[30987]: pgmap v658: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:23:28.045 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:23:28.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:27 smithi169 ceph-mon[33705]: pgmap v658: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:23:28.174 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T07:23:28.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:27 smithi175 ceph-mon[34064]: pgmap v658: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.294+0000 7f050bfda640 1 -- 172.21.15.92:0/3590596377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05041029d0 msgr2=0x7f0504102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.294+0000 7f050bfda640 1 --2- 172.21.15.92:0/3590596377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05041029d0 0x7f0504102de0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f0500009900 tx=0x7f050002a410 comp rx=0 tx=0).stop 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.294+0000 7f050bfda640 1 -- 172.21.15.92:0/3590596377 shutdown_connections 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.294+0000 7f050bfda640 1 --2- 172.21.15.92:0/3590596377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0504108c50 0x7f050410f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.294+0000 7f050bfda640 1 --2- 172.21.15.92:0/3590596377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0504108300 0x7f0504108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.294+0000 7f050bfda640 1 --2- 172.21.15.92:0/3590596377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05041029d0 0x7f0504102de0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.294+0000 7f050bfda640 1 -- 172.21.15.92:0/3590596377 >> 172.21.15.92:0/3590596377 conn(0x7f050407a6f0 msgr2=0x7f050407ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.295+0000 7f050bfda640 1 -- 172.21.15.92:0/3590596377 shutdown_connections 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.295+0000 7f050bfda640 1 -- 172.21.15.92:0/3590596377 wait complete. 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.295+0000 7f050bfda640 1 Processor -- start 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.295+0000 7f050bfda640 1 -- start start 2024-09-21T07:23:28.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.295+0000 7f050bfda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05041029d0 0x7f05041992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.295+0000 7f050bfda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0504108300 0x7f0504199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.295+0000 7f050bfda640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0504108c50 0x7f050419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f050bfda640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0504112810 con 0x7f05041029d0 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f050bfda640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0504112690 con 0x7f0504108c50 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f050bfda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0504112990 con 0x7f0504108300 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f0509d76640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05041029d0 0x7f05041992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f0509d76640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05041029d0 0x7f05041992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34876/0 (socket says 172.21.15.92:34876) 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f0509d76640 1 -- 172.21.15.92:0/2632211174 learned_addr learned my addr 172.21.15.92:0/2632211174 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f050a577640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0504108c50 0x7f050419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f0509575640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0504108300 0x7f0504199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f0509d76640 1 -- 172.21.15.92:0/2632211174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0504108300 msgr2=0x7f0504199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f0509d76640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0504108300 0x7f0504199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f0509d76640 1 -- 172.21.15.92:0/2632211174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0504108c50 msgr2=0x7f050419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f0509d76640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0504108c50 0x7f050419eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f0509d76640 1 -- 172.21.15.92:0/2632211174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050419f200 con 0x7f05041029d0 2024-09-21T07:23:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f0509d76640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05041029d0 0x7f05041992d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f050002a930 tx=0x7f0500003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.296+0000 7f04faffd640 1 -- 172.21.15.92:0/2632211174 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050003f070 con 0x7f05041029d0 2024-09-21T07:23:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.297+0000 7f050bfda640 1 -- 172.21.15.92:0/2632211174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050419f490 con 0x7f05041029d0 2024-09-21T07:23:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.297+0000 7f04faffd640 1 -- 172.21.15.92:0/2632211174 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0500003e40 con 0x7f05041029d0 2024-09-21T07:23:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.297+0000 7f050bfda640 1 -- 172.21.15.92:0/2632211174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05041a5c80 con 0x7f05041029d0 2024-09-21T07:23:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.297+0000 7f04faffd640 1 -- 172.21.15.92:0/2632211174 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500035030 con 0x7f05041029d0 2024-09-21T07:23:28.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.298+0000 7f050bfda640 1 -- 172.21.15.92:0/2632211174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0504102de0 con 0x7f05041029d0 2024-09-21T07:23:28.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.300+0000 7f04faffd640 1 -- 172.21.15.92:0/2632211174 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f0500042070 con 0x7f05041029d0 2024-09-21T07:23:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.301+0000 7f04faffd640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04f00b6700 0x7f04f00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.301+0000 7f0509575640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04f00b6700 0x7f04f00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.301+0000 7f04faffd640 1 -- 172.21.15.92:0/2632211174 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f0500108710 con 0x7f05041029d0 2024-09-21T07:23:28.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.302+0000 7f0509575640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04f00b6700 0x7f04f00b8c10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0504105320 tx=0x7f04f400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.305+0000 7f04faffd640 1 -- 172.21.15.92:0/2632211174 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05000d2be0 con 0x7f05041029d0 2024-09-21T07:23:28.307 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:28.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.516+0000 7f050bfda640 1 -- 172.21.15.92:0/2632211174 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f0504063800 con 0x7f04f00b6700 2024-09-21T07:23:28.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.524+0000 7f04faffd640 1 -- 172.21.15.92:0/2632211174 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f0504063800 con 0x7f04f00b6700 2024-09-21T07:23:28.526 INFO:teuthology.orchestra.run.smithi092.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T07:13:26", "first": "2024-09-21T07:14:00", "last": "2024-09-21T07:23:00", "last_pruned": "2024-09-21T07:23:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-21T07:23:28.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 -- 172.21.15.92:0/2632211174 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04f00b6700 msgr2=0x7f04f00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04f00b6700 0x7f04f00b8c10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0504105320 tx=0x7f04f400b410 comp rx=0 tx=0).stop 2024-09-21T07:23:28.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 -- 172.21.15.92:0/2632211174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05041029d0 msgr2=0x7f05041992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05041029d0 0x7f05041992d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f050002a930 tx=0x7f0500003c20 comp rx=0 tx=0).stop 2024-09-21T07:23:28.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 -- 172.21.15.92:0/2632211174 shutdown_connections 2024-09-21T07:23:28.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f04f00b6700 0x7f04f00b8c10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0504108c50 0x7f050419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0504108300 0x7f0504199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 --2- 172.21.15.92:0/2632211174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05041029d0 0x7f05041992d0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 -- 172.21.15.92:0/2632211174 >> 172.21.15.92:0/2632211174 conn(0x7f050407a6f0 msgr2=0x7f0504106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 -- 172.21.15.92:0/2632211174 shutdown_connections 2024-09-21T07:23:28.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.526+0000 7f050bfda640 1 -- 172.21.15.92:0/2632211174 wait complete. 2024-09-21T07:23:28.540 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T07:23:28.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.662+0000 7fc854e63640 1 -- 172.21.15.92:0/2400553659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc850109430 msgr2=0x7fc850109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.662+0000 7fc854e63640 1 --2- 172.21.15.92:0/2400553659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc850109430 0x7fc850109840 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fc844009900 tx=0x7fc84402a410 comp rx=0 tx=0).stop 2024-09-21T07:23:28.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.662+0000 7fc854e63640 1 -- 172.21.15.92:0/2400553659 shutdown_connections 2024-09-21T07:23:28.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.662+0000 7fc854e63640 1 --2- 172.21.15.92:0/2400553659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850109d80 0x7fc8501105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.662+0000 7fc854e63640 1 --2- 172.21.15.92:0/2400553659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc850109430 0x7fc850109840 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.662+0000 7fc854e63640 1 --2- 172.21.15.92:0/2400553659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850103b00 0x7fc850103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.662+0000 7fc854e63640 1 -- 172.21.15.92:0/2400553659 >> 172.21.15.92:0/2400553659 conn(0x7fc8500ff500 msgr2=0x7fc850101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.662+0000 7fc854e63640 1 -- 172.21.15.92:0/2400553659 shutdown_connections 2024-09-21T07:23:28.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.662+0000 7fc854e63640 1 -- 172.21.15.92:0/2400553659 wait complete. 2024-09-21T07:23:28.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.663+0000 7fc854e63640 1 Processor -- start 2024-09-21T07:23:28.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.663+0000 7fc854e63640 1 -- start start 2024-09-21T07:23:28.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.663+0000 7fc854e63640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850103b00 0x7fc85019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.663+0000 7fc854e63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc850109430 0x7fc85019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.663+0000 7fc854e63640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850109d80 0x7fc85019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.663+0000 7fc854e63640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc8501138f0 con 0x7fc850109430 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.663+0000 7fc854e63640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc850113770 con 0x7fc850103b00 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.663+0000 7fc854e63640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc850113a70 con 0x7fc850109d80 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc850109430 0x7fc85019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc850109430 0x7fc85019a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34894/0 (socket says 172.21.15.92:34894) 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84dd9b640 1 -- 172.21.15.92:0/2520278122 learned_addr learned my addr 172.21.15.92:0/2520278122 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84e59c640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850103b00 0x7fc85019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84ed9d640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850109d80 0x7fc85019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84dd9b640 1 -- 172.21.15.92:0/2520278122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850109d80 msgr2=0x7fc85019fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84dd9b640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850109d80 0x7fc85019fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84dd9b640 1 -- 172.21.15.92:0/2520278122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850103b00 msgr2=0x7fc85019a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84dd9b640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850103b00 0x7fc85019a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84dd9b640 1 -- 172.21.15.92:0/2520278122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8501a02c0 con 0x7fc850109430 2024-09-21T07:23:28.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84e59c640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850103b00 0x7fc85019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:28.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84ed9d640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850109d80 0x7fc85019fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:28.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc84dd9b640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc850109430 0x7fc85019a930 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fc844005940 tx=0x7fc8440040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc83f7fe640 1 -- 172.21.15.92:0/2520278122 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84403f030 con 0x7fc850109430 2024-09-21T07:23:28.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc83f7fe640 1 -- 172.21.15.92:0/2520278122 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc844003a80 con 0x7fc850109430 2024-09-21T07:23:28.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc854e63640 1 -- 172.21.15.92:0/2520278122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8501a0550 con 0x7fc850109430 2024-09-21T07:23:28.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc83f7fe640 1 -- 172.21.15.92:0/2520278122 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844035070 con 0x7fc850109430 2024-09-21T07:23:28.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.664+0000 7fc854e63640 1 -- 172.21.15.92:0/2520278122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8501a6d40 con 0x7fc850109430 2024-09-21T07:23:28.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.665+0000 7fc854e63640 1 -- 172.21.15.92:0/2520278122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc850104d70 con 0x7fc850109430 2024-09-21T07:23:28.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.667+0000 7fc83f7fe640 1 -- 172.21.15.92:0/2520278122 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fc844042030 con 0x7fc850109430 2024-09-21T07:23:28.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.668+0000 7fc83f7fe640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc8380b6680 0x7fc8380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.668+0000 7fc84e59c640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc8380b6680 0x7fc8380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.668+0000 7fc83f7fe640 1 -- 172.21.15.92:0/2520278122 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7fc844108510 con 0x7fc850109430 2024-09-21T07:23:28.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.668+0000 7fc84e59c640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc8380b6680 0x7fc8380b8b90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc8400058c0 tx=0x7fc840005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.671+0000 7fc83f7fe640 1 -- 172.21.15.92:0/2520278122 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8440ce660 con 0x7fc850109430 2024-09-21T07:23:28.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.817+0000 7f92830a0640 1 -- 172.21.15.92:0/836557613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c1083a0 msgr2=0x7f927c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.817+0000 7f92830a0640 1 --2- 172.21.15.92:0/836557613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c1083a0 0x7f927c1087b0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f9268009900 tx=0x7f926802a410 comp rx=0 tx=0).stop 2024-09-21T07:23:28.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.817+0000 7f92830a0640 1 -- 172.21.15.92:0/836557613 shutdown_connections 2024-09-21T07:23:28.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.817+0000 7f92830a0640 1 --2- 172.21.15.92:0/836557613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f927c108cf0 0x7f927c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.817+0000 7f92830a0640 1 --2- 172.21.15.92:0/836557613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c1083a0 0x7f927c1087b0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.817+0000 7f92830a0640 1 --2- 172.21.15.92:0/836557613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c102a60 0x7f927c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.817+0000 7f92830a0640 1 -- 172.21.15.92:0/836557613 >> 172.21.15.92:0/836557613 conn(0x7f927c079730 msgr2=0x7f927c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.817+0000 7f92830a0640 1 -- 172.21.15.92:0/836557613 shutdown_connections 2024-09-21T07:23:28.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.817+0000 7f92830a0640 1 -- 172.21.15.92:0/836557613 wait complete. 2024-09-21T07:23:28.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.818+0000 7f92830a0640 1 Processor -- start 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.818+0000 7f92830a0640 1 -- start start 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.818+0000 7f92830a0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c102a60 0x7f927c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.818+0000 7f92830a0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f927c1083a0 0x7f927c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.818+0000 7f92830a0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c108cf0 0x7f927c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.818+0000 7f92830a0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f927c112810 con 0x7f927c108cf0 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.818+0000 7f92830a0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f927c112690 con 0x7f927c1083a0 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.818+0000 7f92830a0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f927c112990 con 0x7f927c102a60 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f928163d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c108cf0 0x7f927c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f928163d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c108cf0 0x7f927c1000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34912/0 (socket says 172.21.15.92:34912) 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f928163d640 1 -- 172.21.15.92:0/894074035 learned_addr learned my addr 172.21.15.92:0/894074035 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f927bfff640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f927c1083a0 0x7f927c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f9280e3c640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c102a60 0x7f927c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f928163d640 1 -- 172.21.15.92:0/894074035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c102a60 msgr2=0x7f927c0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f928163d640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c102a60 0x7f927c0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f928163d640 1 -- 172.21.15.92:0/894074035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f927c1083a0 msgr2=0x7f927c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f928163d640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f927c1083a0 0x7f927c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f928163d640 1 -- 172.21.15.92:0/894074035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c1a85e0 con 0x7f927c108cf0 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f9280e3c640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c102a60 0x7f927c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f928163d640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c108cf0 0x7f927c1000f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f927400cce0 tx=0x7f927400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f9279ffb640 1 -- 172.21.15.92:0/894074035 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927400f450 con 0x7f927c108cf0 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f92830a0640 1 -- 172.21.15.92:0/894074035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927c1a88d0 con 0x7f927c108cf0 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f9279ffb640 1 -- 172.21.15.92:0/894074035 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f927400fa80 con 0x7f927c108cf0 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.819+0000 7f9279ffb640 1 -- 172.21.15.92:0/894074035 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274018ad0 con 0x7f927c108cf0 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.820+0000 7f92830a0640 1 -- 172.21.15.92:0/894074035 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927c1a8d90 con 0x7f927c108cf0 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.823+0000 7f9279ffb640 1 -- 172.21.15.92:0/894074035 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f927400f5f0 con 0x7f927c108cf0 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.823+0000 7f9289614740 1 Processor -- start 2024-09-21T07:23:28.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.823+0000 7f9289614740 1 -- start start 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9289614740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc0162c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9289614740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 0x5646dc016800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9289614740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc016d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9289614740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5646dbf8cea0 con 0x5646dbc4e390 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9289614740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5646dbf7c2d0 con 0x5646dbc461b0 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9289614740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5646dbf800e0 con 0x5646dbc6f070 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9279ffb640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f926c0b6680 0x7f926c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f927bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc016d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9280e3c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 0x5646dc016800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9279ffb640 1 -- 172.21.15.92:0/894074035 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f92740e8340 con 0x7f927c108cf0 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f927bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc016d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34926/0 (socket says 172.21.15.92:34926) 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9280e3c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 0x5646dc016800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.92:51114/0 (socket says 172.21.15.92:51114) 2024-09-21T07:23:28.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f927bfff640 1 -- 172.21.15.92:0/2071117990 learned_addr learned my addr 172.21.15.92:0/2071117990 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f927bfff640 1 --2- 172.21.15.92:0/2071117990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc0162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9280e3c640 1 -- 172.21.15.92:0/2071117990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 msgr2=0x5646dc0162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9280e3c640 1 --2- 172.21.15.92:0/2071117990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc0162c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9280e3c640 1 -- 172.21.15.92:0/2071117990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 msgr2=0x5646dc016d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9280e3c640 1 --2- 172.21.15.92:0/2071117990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc016d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f9280e3c640 1 -- 172.21.15.92:0/2071117990 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646dbcda650 con 0x5646dbc461b0 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.824+0000 7f927bfff640 1 --2- 172.21.15.92:0/2071117990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc016d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.825+0000 7f9280e3c640 1 --2- 172.21.15.92:0/2071117990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 0x5646dc016800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f927c1010c0 tx=0x7f927000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a691c1e5bc5d34e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.825+0000 7f928163d640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f926c0b6680 0x7f926c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.825+0000 7f928163d640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f926c0b6680 0x7f926c0b8b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f92740add20 tx=0x7f927400af30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.826+0000 7f9266ffd640 1 -- 172.21.15.92:0/2071117990 <== mon.2 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270015070 con 0x5646dbc461b0 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.826+0000 7f9266ffd640 1 -- 172.21.15.92:0/2071117990 <== mon.2 v2:172.21.15.169:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f927001a8f0 con 0x5646dbc461b0 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.826+0000 7f9266ffd640 1 -- 172.21.15.92:0/2071117990 <== mon.2 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270011860 con 0x5646dbc461b0 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 -- 172.21.15.92:0/2071117990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 msgr2=0x5646dc016800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 --2- 172.21.15.92:0/2071117990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 0x5646dc016800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f927c1010c0 tx=0x7f927000f730 comp rx=0 tx=0).stop 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 -- 172.21.15.92:0/2071117990 shutdown_connections 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 --2- 172.21.15.92:0/2071117990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc016d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 --2- 172.21.15.92:0/2071117990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 0x5646dc016800 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 --2- 172.21.15.92:0/2071117990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc0162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 -- 172.21.15.92:0/2071117990 >> 172.21.15.92:0/2071117990 conn(0x5646dbc63460 msgr2=0x5646dc0141b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 -- 172.21.15.92:0/2071117990 shutdown_connections 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 -- 172.21.15.92:0/2071117990 wait complete. 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 -- start start 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.827+0000 7f9289614740 1 Processor -- start 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f9289614740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc0219c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f9289614740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc4e390 0x5646dc021f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f9289614740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc6f070 0x5646dc02dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f9289614740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5646dbddd700 con 0x5646dbc461b0 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f9289614740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5646dbf17160 con 0x5646dbc6f070 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f9289614740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5646dc024aa0 con 0x5646dbc4e390 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f9289614740 10 client.0 _ll_register_callbacks cb 0x5646dbf309e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f927bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc0219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f927bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc0219c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34938/0 (socket says 172.21.15.92:34938) 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f927bfff640 1 -- 172.21.15.92:0/1870594926 learned_addr learned my addr 172.21.15.92:0/1870594926 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f9280e3c640 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc4e390 0x5646dc021f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f927bfff640 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc6f070 0x5646dc02dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f927bfff640 1 -- 172.21.15.92:0/1870594926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc4e390 msgr2=0x5646dc021f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f927bfff640 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc4e390 0x5646dc021f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f927bfff640 1 -- 172.21.15.92:0/1870594926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc6f070 msgr2=0x5646dc02dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f927bfff640 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc6f070 0x5646dc02dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f927bfff640 1 -- 172.21.15.92:0/1870594926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646dbf44c90 con 0x5646dbc461b0 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f927bfff640 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc0219c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f9268005940 tx=0x7f926802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b497ea33f0e0c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.828+0000 7f925bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f925bfff640 1 -- 172.21.15.92:0/1870594926 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926804d060 con 0x5646dbc461b0 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f925bfff640 1 -- 172.21.15.92:0/1870594926 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f9268004040 con 0x5646dbc461b0 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f9289614740 1 -- 172.21.15.92:0/1870594926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f927001a8f0 con 0x5646dbc461b0 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f925bfff640 1 -- 172.21.15.92:0/1870594926 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9268054050 con 0x5646dbc461b0 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f9289614740 10 client.18411 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f9289614740 1 -- 172.21.15.92:0/1870594926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5646dc030810 con 0x5646dbc461b0 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f925bfff640 1 -- 172.21.15.92:0/1870594926 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f927001a8f0 con 0x5646dbc461b0 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f925bfff640 1 -- 172.21.15.92:0/1870594926 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f926803d450 con 0x5646dbc461b0 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f9289614740 10 client.18411 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f9289614740 10 client.18411 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f9289614740 20 client.18411 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:28.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f9289614740 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5646dbc2d9f0 0x5646dc033ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f9289614740 4 client.18411 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.829+0000 7f9289614740 1 -- 172.21.15.92:0/1870594926 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646dbf8edf0 con 0x5646dbc2d9f0 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.830+0000 7f9280e3c640 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5646dbc2d9f0 0x5646dc033ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.830+0000 7f9280e3c640 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5646dbc2d9f0 0x5646dc033ce0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b9d17aabe877189 server_cookie=3a6c324f4105f8b5 in_seq=0 out_seq=0 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.830+0000 7f925bfff640 10 client.18411 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f925bfff640 1 -- 172.21.15.92:0/1870594926 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646dbf8edf0 con 0x5646dbc2d9f0 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f925bfff640 10 client.18411 handle_command_reply: tid=0 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 client.18411 shutdown 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 -- 172.21.15.92:0/1870594926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 msgr2=0x5646dc0219c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc0219c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f9268005940 tx=0x7f926802a410 comp rx=0 tx=0).stop 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 -- 172.21.15.92:0/1870594926 shutdown_connections 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5646dbc2d9f0 0x5646dc033ce0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc6f070 0x5646dc02dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc4e390 0x5646dc021f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 --2- 172.21.15.92:0/1870594926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc0219c0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 -- 172.21.15.92:0/1870594926 >> 172.21.15.92:0/1870594926 conn(0x5646dbc63460 msgr2=0x5646dc019450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f925bfff640 0 client.18411 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:23:28.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 -- 172.21.15.92:0/1870594926 shutdown_connections 2024-09-21T07:23:28.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 1 -- 172.21.15.92:0/1870594926 wait complete. 2024-09-21T07:23:28.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.831+0000 7f9289614740 20 client.18411 trim_cache size 0 max 16384 2024-09-21T07:23:28.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f9289614740 1 Processor -- start 2024-09-21T07:23:28.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f9289614740 1 -- start start 2024-09-21T07:23:28.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f9289614740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc019ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f9289614740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc4e390 0x5646dc01ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f9289614740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc01f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f9289614740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f927c1b2fb0 con 0x5646dbc461b0 2024-09-21T07:23:28.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f9289614740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f927c1b4af0 con 0x5646dbc4e390 2024-09-21T07:23:28.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f9289614740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f927c1b3680 con 0x5646dbc6f070 2024-09-21T07:23:28.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f927bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc019ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f927bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc019ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34950/0 (socket says 172.21.15.92:34950) 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f927bfff640 1 -- 172.21.15.92:0/2626356203 learned_addr learned my addr 172.21.15.92:0/2626356203 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.845+0000 7f9280e3c640 1 --2- 172.21.15.92:0/2626356203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc4e390 0x5646dc01ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.846+0000 7f927bfff640 1 --2- 172.21.15.92:0/2626356203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc01f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.846+0000 7f927bfff640 1 -- 172.21.15.92:0/2626356203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 msgr2=0x5646dc01f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.846+0000 7f927bfff640 1 --2- 172.21.15.92:0/2626356203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc01f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.846+0000 7f927bfff640 1 -- 172.21.15.92:0/2626356203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc4e390 msgr2=0x5646dc01ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.846+0000 7f927bfff640 1 --2- 172.21.15.92:0/2626356203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc4e390 0x5646dc01ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.846+0000 7f927bfff640 1 -- 172.21.15.92:0/2626356203 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646dc0185b0 con 0x5646dbc461b0 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.846+0000 7f927bfff640 1 --2- 172.21.15.92:0/2626356203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc019ad0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f9268009850 tx=0x7f9268005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8f7ae1f95e8b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.846+0000 7f92667fc640 1 -- 172.21.15.92:0/2626356203 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926804d070 con 0x5646dbc461b0 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.846+0000 7f92667fc640 1 -- 172.21.15.92:0/2626356203 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f926803dc40 con 0x5646dbc461b0 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.846+0000 7f92667fc640 1 -- 172.21.15.92:0/2626356203 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268035040 con 0x5646dbc461b0 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 -- 172.21.15.92:0/2626356203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 msgr2=0x5646dc019ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 --2- 172.21.15.92:0/2626356203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc019ad0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f9268009850 tx=0x7f9268005c90 comp rx=0 tx=0).stop 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 -- 172.21.15.92:0/2626356203 shutdown_connections 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 --2- 172.21.15.92:0/2626356203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc01f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 --2- 172.21.15.92:0/2626356203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc4e390 0x5646dc01ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 --2- 172.21.15.92:0/2626356203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc461b0 0x5646dc019ad0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 -- 172.21.15.92:0/2626356203 >> 172.21.15.92:0/2626356203 conn(0x5646dbc63460 msgr2=0x5646dc0193c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 -- 172.21.15.92:0/2626356203 shutdown_connections 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 -- 172.21.15.92:0/2626356203 wait complete. 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 -- start start 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.847+0000 7f9289614740 1 Processor -- start 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9289614740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 0x5646dc026440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9289614740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc026980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9289614740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc09d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9289614740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f927c1b4420 con 0x5646dbc4e390 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9289614740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f927c1b3d50 con 0x5646dbc461b0 2024-09-21T07:23:28.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9289614740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f927c1b0fb0 con 0x5646dbc6f070 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9289614740 10 client.0 _ll_register_callbacks cb 0x7f9268032db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9280e3c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc026980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9280e3c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc026980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34958/0 (socket says 172.21.15.92:34958) 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9280e3c640 1 -- 172.21.15.92:0/1358625419 learned_addr learned my addr 172.21.15.92:0/1358625419 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f927bfff640 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 0x5646dc026440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9280e3c640 1 -- 172.21.15.92:0/1358625419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 msgr2=0x5646dc09d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f927bfff640 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc09d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9280e3c640 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc09d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9280e3c640 1 -- 172.21.15.92:0/1358625419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 msgr2=0x5646dc026440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9280e3c640 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 0x5646dc026440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f9280e3c640 1 -- 172.21.15.92:0/1358625419 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646dc09dbf0 con 0x5646dbc4e390 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.848+0000 7f927bfff640 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc09d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.849+0000 7f9280e3c640 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc026980 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f927000fc30 tx=0x7f9270005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d427cfb3b3aeb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:28.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.849+0000 7f925bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.849+0000 7f925bfff640 1 -- 172.21.15.92:0/1358625419 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270015040 con 0x5646dbc4e390 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.849+0000 7f925bfff640 1 -- 172.21.15.92:0/1358625419 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f9270005300 con 0x5646dbc4e390 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.849+0000 7f9289614740 1 -- 172.21.15.92:0/1358625419 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f926803dc40 con 0x5646dbc4e390 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.849+0000 7f925bfff640 1 -- 172.21.15.92:0/1358625419 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9270039050 con 0x5646dbc4e390 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.849+0000 7f9289614740 10 client.18417 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.849+0000 7f9289614740 1 -- 172.21.15.92:0/1358625419 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5646dc09ee50 con 0x5646dbc4e390 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.849+0000 7f925bfff640 1 -- 172.21.15.92:0/1358625419 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f926803dc40 con 0x5646dbc4e390 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.850+0000 7f925bfff640 1 -- 172.21.15.92:0/1358625419 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9270011570 con 0x5646dbc4e390 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.850+0000 7f9289614740 10 client.18417 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.850+0000 7f9289614740 10 client.18417 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.850+0000 7f9289614740 20 client.18417 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.850+0000 7f9289614740 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5646dbc02da0 0x5646dc0a1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.850+0000 7f9289614740 4 client.18417 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:23:28.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.850+0000 7f9289614740 1 -- 172.21.15.92:0/1358625419 --> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646dbf8a8a0 con 0x5646dbc02da0 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.850+0000 7f927bfff640 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5646dbc02da0 0x5646dc0a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f927bfff640 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5646dbc02da0 0x5646dc0a1380 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=59d3eb4568a7f554 server_cookie=8b353788f8cf82f0 in_seq=0 out_seq=0 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f925bfff640 10 client.18417 ms_handle_connect on v2:172.21.15.169:6838/44894739 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f925bfff640 1 -- 172.21.15.92:0/1358625419 <== mds.2 v2:172.21.15.169:6838/44894739 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646dbf8a8a0 con 0x5646dbc02da0 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f925bfff640 10 client.18417 handle_command_reply: tid=0 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 client.18417 shutdown 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 -- 172.21.15.92:0/1358625419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 msgr2=0x5646dc026980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc026980 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f927000fc30 tx=0x7f9270005850 comp rx=0 tx=0).stop 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 -- 172.21.15.92:0/1358625419 shutdown_connections 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.169:6838/44894739,v1:172.21.15.169:6839/44894739] conn(0x5646dbc02da0 0x5646dc0a1380 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f925bfff640 0 client.18417 ms_handle_reset on v2:172.21.15.169:6838/44894739 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646dbc6f070 0x5646dc09d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dbc4e390 0x5646dc026980 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 --2- 172.21.15.92:0/1358625419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5646dbc461b0 0x5646dc026440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 -- 172.21.15.92:0/1358625419 >> 172.21.15.92:0/1358625419 conn(0x5646dbc63460 msgr2=0x5646dc022e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 -- 172.21.15.92:0/1358625419 shutdown_connections 2024-09-21T07:23:28.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 1 -- 172.21.15.92:0/1358625419 wait complete. 2024-09-21T07:23:28.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.851+0000 7f9289614740 20 client.18417 trim_cache size 0 max 16384 2024-09-21T07:23:28.864 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 -- 172.21.15.92:0/894074035 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f926c0b6680 msgr2=0x7f926c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f926c0b6680 0x7f926c0b8b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f92740add20 tx=0x7f927400af30 comp rx=0 tx=0).stop 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 -- 172.21.15.92:0/894074035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c108cf0 msgr2=0x7f927c1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c108cf0 0x7f927c1000f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f927400cce0 tx=0x7f927400a620 comp rx=0 tx=0).stop 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 -- 172.21.15.92:0/894074035 shutdown_connections 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f926c0b6680 0x7f926c0b8b90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c108cf0 0x7f927c1000f0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f927c1083a0 0x7f927c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 --2- 172.21.15.92:0/894074035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c102a60 0x7f927c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 -- 172.21.15.92:0/894074035 >> 172.21.15.92:0/894074035 conn(0x7f927c079730 msgr2=0x7f927c06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 -- 172.21.15.92:0/894074035 shutdown_connections 2024-09-21T07:23:28.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.852+0000 7f92830a0640 1 -- 172.21.15.92:0/894074035 wait complete. 2024-09-21T07:23:28.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.891+0000 7fc854e63640 1 -- 172.21.15.92:0/2520278122 --> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fc850063800 con 0x7fc8380b6680 2024-09-21T07:23:28.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.899+0000 7fc83f7fe640 1 -- 172.21.15.92:0/2520278122 <== mgr.14223 v2:172.21.15.92:6800/3526511181 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fc850063800 con 0x7fc8380b6680 2024-09-21T07:23:28.900 INFO:teuthology.orchestra.run.smithi092.stdout:/ 1m 6m3h 2024-09-21T07:23:28.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 -- 172.21.15.92:0/2520278122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc8380b6680 msgr2=0x7fc8380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc8380b6680 0x7fc8380b8b90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc8400058c0 tx=0x7fc840005ec0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 -- 172.21.15.92:0/2520278122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc850109430 msgr2=0x7fc85019a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc850109430 0x7fc85019a930 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fc844005940 tx=0x7fc8440040e0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 -- 172.21.15.92:0/2520278122 shutdown_connections 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fc8380b6680 0x7fc8380b8b90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850109d80 0x7fc85019fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc850109430 0x7fc85019a930 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 --2- 172.21.15.92:0/2520278122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850103b00 0x7fc85019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 -- 172.21.15.92:0/2520278122 >> 172.21.15.92:0/2520278122 conn(0x7fc8500ff500 msgr2=0x7fc850101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 -- 172.21.15.92:0/2520278122 shutdown_connections 2024-09-21T07:23:28.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:28.901+0000 7fc854e63640 1 -- 172.21.15.92:0/2520278122 wait complete. 2024-09-21T07:23:28.914 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T07:23:28.926 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T07:23:29.742 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:23:29.995 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:30.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:29 smithi092 ceph-mon[30987]: pgmap v659: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:23:30.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:29 smithi092 ceph-mon[30987]: from='client.18393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:23:30.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:29 smithi169 ceph-mon[33705]: pgmap v659: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:23:30.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:29 smithi169 ceph-mon[33705]: from='client.18393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:23:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:29 smithi175 ceph-mon[34064]: pgmap v659: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:23:30.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:29 smithi175 ceph-mon[34064]: from='client.18393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:23:30.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.482+0000 7ff026db7640 1 -- 172.21.15.92:0/3549559924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff020103190 msgr2=0x7ff0201035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.482+0000 7ff026db7640 1 --2- 172.21.15.92:0/3549559924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff020103190 0x7ff0201035a0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ff014009900 tx=0x7ff01402a410 comp rx=0 tx=0).stop 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.482+0000 7ff026db7640 1 -- 172.21.15.92:0/3549559924 shutdown_connections 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.482+0000 7ff026db7640 1 --2- 172.21.15.92:0/3549559924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff020108d50 0x7ff02010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.482+0000 7ff026db7640 1 --2- 172.21.15.92:0/3549559924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff020108400 0x7ff020108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.482+0000 7ff026db7640 1 --2- 172.21.15.92:0/3549559924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff020103190 0x7ff0201035a0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.482+0000 7ff026db7640 1 -- 172.21.15.92:0/3549559924 >> 172.21.15.92:0/3549559924 conn(0x7ff020079f90 msgr2=0x7ff02007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.482+0000 7ff026db7640 1 -- 172.21.15.92:0/3549559924 shutdown_connections 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.482+0000 7ff026db7640 1 -- 172.21.15.92:0/3549559924 wait complete. 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff026db7640 1 Processor -- start 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff026db7640 1 -- start start 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff026db7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff020103190 0x7ff020199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff026db7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff020108400 0x7ff020199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff026db7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff020108d50 0x7ff02019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff026db7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201128c0 con 0x7ff020108d50 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff026db7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff020112740 con 0x7ff020108400 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff026db7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff020112a40 con 0x7ff020103190 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff025354640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff020108d50 0x7ff02019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff025354640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff020108d50 0x7ff02019ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38382/0 (socket says 172.21.15.92:38382) 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff025354640 1 -- 172.21.15.92:0/3774807446 learned_addr learned my addr 172.21.15.92:0/3774807446 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff024b53640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff020103190 0x7ff020199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff01ffff640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff020108400 0x7ff020199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff025354640 1 -- 172.21.15.92:0/3774807446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff020103190 msgr2=0x7ff020199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.483+0000 7ff025354640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff020103190 0x7ff020199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.484+0000 7ff025354640 1 -- 172.21.15.92:0/3774807446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff020108400 msgr2=0x7ff020199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.484+0000 7ff025354640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff020108400 0x7ff020199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.484+0000 7ff025354640 1 -- 172.21.15.92:0/3774807446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02019f240 con 0x7ff020108d50 2024-09-21T07:23:30.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.484+0000 7ff025354640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff020108d50 0x7ff02019ebd0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff01800eb10 tx=0x7ff01800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.484+0000 7ff01dffb640 1 -- 172.21.15.92:0/3774807446 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018004b20 con 0x7ff020108d50 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.484+0000 7ff026db7640 1 -- 172.21.15.92:0/3774807446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02019f530 con 0x7ff020108d50 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.484+0000 7ff01dffb640 1 -- 172.21.15.92:0/3774807446 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff018004cc0 con 0x7ff020108d50 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.484+0000 7ff01dffb640 1 -- 172.21.15.92:0/3774807446 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018010690 con 0x7ff020108d50 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.484+0000 7ff026db7640 1 -- 172.21.15.92:0/3774807446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0201a5d50 con 0x7ff020108d50 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.486+0000 7ff02d32b740 1 Processor -- start 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff01dffb640 1 -- 172.21.15.92:0/3774807446 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7ff018005000 con 0x7ff020108d50 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff02d32b740 1 -- start start 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f75442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7544800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f717c390 0x5630f7544d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff02d32b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5630f74baea0 con 0x5630f719d070 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff02d32b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5630f74aa2d0 con 0x5630f717c390 2024-09-21T07:23:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff02d32b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5630f74ae0e0 con 0x5630f71741b0 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f75442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f75442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38384/0 (socket says 172.21.15.92:38384) 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff01ffff640 1 -- 172.21.15.92:0/3296031427 learned_addr learned my addr 172.21.15.92:0/3296031427 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff024b53640 1 --2- 172.21.15.92:0/3296031427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7544800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff01dffb640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff0100b66b0 0x7ff0100b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.487+0000 7ff01ffff640 1 --2- 172.21.15.92:0/3296031427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f717c390 0x5630f7544d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff01ffff640 1 -- 172.21.15.92:0/3296031427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 msgr2=0x5630f7544800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff01ffff640 1 --2- 172.21.15.92:0/3296031427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7544800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff01ffff640 1 -- 172.21.15.92:0/3296031427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f717c390 msgr2=0x5630f7544d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff01ffff640 1 --2- 172.21.15.92:0/3296031427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f717c390 0x5630f7544d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff01ffff640 1 -- 172.21.15.92:0/3296031427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f7208650 con 0x5630f719d070 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff025354640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff0100b66b0 0x7ff0100b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff01dffb640 1 -- 172.21.15.92:0/3774807446 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7ff0180e8120 con 0x7ff020108d50 2024-09-21T07:23:30.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff01ffff640 1 --2- 172.21.15.92:0/3296031427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f75442c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00bfd0 tx=0x7ff00c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec79ad519ee092c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff00affd640 1 -- 172.21.15.92:0/3296031427 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c005020 con 0x5630f719d070 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff00affd640 1 -- 172.21.15.92:0/3296031427 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff00c0047a0 con 0x5630f719d070 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.488+0000 7ff00affd640 1 -- 172.21.15.92:0/3296031427 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c005650 con 0x5630f719d070 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff02d32b740 1 -- 172.21.15.92:0/3296031427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 msgr2=0x5630f75442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff02d32b740 1 --2- 172.21.15.92:0/3296031427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f75442c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00bfd0 tx=0x7ff00c00b4a0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff025354640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff0100b66b0 0x7ff0100b8bc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff0180e5520 tx=0x7ff01800cf70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff02d32b740 1 -- 172.21.15.92:0/3296031427 shutdown_connections 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff02d32b740 1 --2- 172.21.15.92:0/3296031427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f717c390 0x5630f7544d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff02d32b740 1 --2- 172.21.15.92:0/3296031427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7544800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff02d32b740 1 --2- 172.21.15.92:0/3296031427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f75442c0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff02d32b740 1 -- 172.21.15.92:0/3296031427 >> 172.21.15.92:0/3296031427 conn(0x5630f7191460 msgr2=0x5630f75421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff02d32b740 1 -- 172.21.15.92:0/3296031427 shutdown_connections 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff02d32b740 1 -- 172.21.15.92:0/3296031427 wait complete. 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.489+0000 7ff02d32b740 1 -- start start 2024-09-21T07:23:30.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff02d32b740 1 Processor -- start 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f71741b0 0x5630f7551ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f717c390 0x5630f7552020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f719d070 0x5630f7552560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff02d32b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5630f730b700 con 0x5630f71741b0 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff02d32b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5630f7445160 con 0x5630f719d070 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff02d32b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5630f7554ba0 con 0x5630f717c390 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff02d32b740 10 client.0 _ll_register_callbacks cb 0x5630f745e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f71741b0 0x5630f7551ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f71741b0 0x5630f7551ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38398/0 (socket says 172.21.15.92:38398) 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff01ffff640 1 -- 172.21.15.92:0/110878014 learned_addr learned my addr 172.21.15.92:0/110878014 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff024b53640 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f717c390 0x5630f7552020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff01ffff640 1 -- 172.21.15.92:0/110878014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f717c390 msgr2=0x5630f7552020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff01ffff640 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f717c390 0x5630f7552020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff01ffff640 1 -- 172.21.15.92:0/110878014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f719d070 msgr2=0x5630f7552560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:30.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff01ffff640 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f719d070 0x5630f7552560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.490+0000 7ff01ffff640 1 -- 172.21.15.92:0/110878014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f7472c90 con 0x5630f71741b0 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.491+0000 7ff01ffff640 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f71741b0 0x5630f7551ae0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff00c01b030 tx=0x7ff00c014300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647cc9c56753d143 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.491+0000 7feffffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.491+0000 7feffffff640 1 -- 172.21.15.92:0/110878014 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c022070 con 0x5630f71741b0 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.491+0000 7feffffff640 1 -- 172.21.15.92:0/110878014 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7ff00c005440 con 0x5630f71741b0 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.491+0000 7ff02d32b740 1 -- 172.21.15.92:0/110878014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff00c0047a0 con 0x5630f71741b0 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.491+0000 7feffffff640 1 -- 172.21.15.92:0/110878014 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff00c005640 con 0x5630f71741b0 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.491+0000 7ff02d32b740 10 client.18429 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.491+0000 7ff02d32b740 1 -- 172.21.15.92:0/110878014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5630f7560810 con 0x5630f71741b0 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.491+0000 7feffffff640 1 -- 172.21.15.92:0/110878014 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff00c0047a0 con 0x5630f71741b0 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.491+0000 7feffffff640 1 -- 172.21.15.92:0/110878014 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff00c012450 con 0x5630f71741b0 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.492+0000 7ff02d32b740 10 client.18429 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.492+0000 7ff02d32b740 10 client.18429 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:23:30.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.492+0000 7ff02d32b740 20 client.18429 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.492+0000 7ff02d32b740 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5630f715b9f0 0x5630f7563bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.492+0000 7ff02d32b740 4 client.18429 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.492+0000 7ff02d32b740 1 -- 172.21.15.92:0/110878014 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630f74bcdf0 con 0x5630f715b9f0 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.492+0000 7ff024b53640 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5630f715b9f0 0x5630f7563bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.492+0000 7ff024b53640 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5630f715b9f0 0x5630f7563bd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=140a3da5088196e7 server_cookie=b099b86d35d1d8d8 in_seq=0 out_seq=0 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.492+0000 7feffffff640 10 client.18429 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7feffffff640 1 -- 172.21.15.92:0/110878014 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630f74bcdf0 con 0x5630f715b9f0 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7feffffff640 10 client.18429 handle_command_reply: tid=0 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7ff02d32b740 1 client.18429 shutdown 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7ff02d32b740 1 -- 172.21.15.92:0/110878014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f71741b0 msgr2=0x5630f7551ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7ff02d32b740 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f71741b0 0x5630f7551ae0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff00c01b030 tx=0x7ff00c014300 comp rx=0 tx=0).stop 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7ff02d32b740 1 -- 172.21.15.92:0/110878014 shutdown_connections 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7ff02d32b740 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5630f715b9f0 0x5630f7563bd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7ff02d32b740 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f719d070 0x5630f7552560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7ff02d32b740 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f717c390 0x5630f7552020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7ff02d32b740 1 --2- 172.21.15.92:0/110878014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f71741b0 0x5630f7551ae0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7ff02d32b740 1 -- 172.21.15.92:0/110878014 >> 172.21.15.92:0/110878014 conn(0x5630f7191460 msgr2=0x5630f7540750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.493+0000 7feffffff640 0 client.18429 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:23:30.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.494+0000 7ff02d32b740 1 -- 172.21.15.92:0/110878014 shutdown_connections 2024-09-21T07:23:30.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.494+0000 7ff02d32b740 1 -- 172.21.15.92:0/110878014 wait complete. 2024-09-21T07:23:30.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.494+0000 7ff02d32b740 20 client.18429 trim_cache size 0 max 16384 2024-09-21T07:23:30.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff02d32b740 1 Processor -- start 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff02d32b740 1 -- start start 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7553ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f717c390 0x5630f75421b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f719d070 0x5630f754ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff02d32b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201aece0 con 0x5630f717c390 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff02d32b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201b0820 con 0x5630f719d070 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff02d32b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201af3b0 con 0x5630f71741b0 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff024b53640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f717c390 0x5630f75421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff024b53640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f717c390 0x5630f75421b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38404/0 (socket says 172.21.15.92:38404) 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff024b53640 1 -- 172.21.15.92:0/2173091104 learned_addr learned my addr 172.21.15.92:0/2173091104 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff01ffff640 1 --2- 172.21.15.92:0/2173091104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7553ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff024b53640 1 -- 172.21.15.92:0/2173091104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 msgr2=0x5630f7553ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff024b53640 1 --2- 172.21.15.92:0/2173091104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7553ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff024b53640 1 -- 172.21.15.92:0/2173091104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f719d070 msgr2=0x5630f754ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:30.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff024b53640 1 --2- 172.21.15.92:0/2173091104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f719d070 0x5630f754ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.507+0000 7ff024b53640 1 -- 172.21.15.92:0/2173091104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f75426f0 con 0x5630f717c390 2024-09-21T07:23:30.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.508+0000 7ff024b53640 1 --2- 172.21.15.92:0/2173091104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f717c390 0x5630f75421b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ff01402a930 tx=0x7ff014009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c3688296f7b28a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.508+0000 7ff00a7fc640 1 -- 172.21.15.92:0/2173091104 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff014035040 con 0x5630f717c390 2024-09-21T07:23:30.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.508+0000 7ff00a7fc640 1 -- 172.21.15.92:0/2173091104 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff014031890 con 0x5630f717c390 2024-09-21T07:23:30.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.508+0000 7ff00a7fc640 1 -- 172.21.15.92:0/2173091104 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff014003df0 con 0x5630f717c390 2024-09-21T07:23:30.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 -- 172.21.15.92:0/2173091104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f717c390 msgr2=0x5630f75421b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 --2- 172.21.15.92:0/2173091104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f717c390 0x5630f75421b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ff01402a930 tx=0x7ff014009260 comp rx=0 tx=0).stop 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 -- 172.21.15.92:0/2173091104 shutdown_connections 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 --2- 172.21.15.92:0/2173091104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f719d070 0x5630f754ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 --2- 172.21.15.92:0/2173091104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f717c390 0x5630f75421b0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 --2- 172.21.15.92:0/2173091104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7553ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 -- 172.21.15.92:0/2173091104 >> 172.21.15.92:0/2173091104 conn(0x5630f7191460 msgr2=0x5630f7545cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 -- 172.21.15.92:0/2173091104 shutdown_connections 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 -- 172.21.15.92:0/2173091104 wait complete. 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 -- start start 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.509+0000 7ff02d32b740 1 Processor -- start 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7567190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f717c390 0x5630f7564660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff02d32b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f7564ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff02d32b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201b0150 con 0x5630f719d070 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff02d32b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201afa80 con 0x5630f717c390 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff02d32b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201acce0 con 0x5630f71741b0 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff02d32b740 10 client.0 _ll_register_callbacks cb 0x7ff00c00be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f7564ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f7564ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38408/0 (socket says 172.21.15.92:38408) 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff01ffff640 1 -- 172.21.15.92:0/1090584989 learned_addr learned my addr 172.21.15.92:0/1090584989 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff01ffff640 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7567190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff024b53640 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f717c390 0x5630f7564660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff01ffff640 1 -- 172.21.15.92:0/1090584989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 msgr2=0x5630f7567190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff01ffff640 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7567190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff01ffff640 1 -- 172.21.15.92:0/1090584989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f717c390 msgr2=0x5630f7564660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff01ffff640 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f717c390 0x5630f7564660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff01ffff640 1 -- 172.21.15.92:0/1090584989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f75650e0 con 0x5630f719d070 2024-09-21T07:23:30.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7ff01ffff640 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f7564ba0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0128a0 tx=0x7ff00c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8755b145f87e6699 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.510+0000 7feffffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7feffffff640 1 -- 172.21.15.92:0/1090584989 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00b420 con 0x5630f719d070 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7feffffff640 1 -- 172.21.15.92:0/1090584989 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7ff00c00b5c0 con 0x5630f719d070 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7ff02d32b740 1 -- 172.21.15.92:0/1090584989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff014031890 con 0x5630f719d070 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7feffffff640 1 -- 172.21.15.92:0/1090584989 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff00c03f050 con 0x5630f719d070 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7ff02d32b740 10 client.18435 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7ff02d32b740 1 -- 172.21.15.92:0/1090584989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5630f75ce040 con 0x5630f719d070 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7feffffff640 1 -- 172.21.15.92:0/1090584989 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff014031890 con 0x5630f719d070 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7feffffff640 1 -- 172.21.15.92:0/1090584989 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff00c00e470 con 0x5630f719d070 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7ff02d32b740 10 client.18435 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7ff02d32b740 10 client.18435 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.f 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7ff02d32b740 20 client.18435 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7ff02d32b740 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5630f7130da0 0x5630f75d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7ff02d32b740 4 client.18435 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:23:30.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.511+0000 7ff02d32b740 1 -- 172.21.15.92:0/1090584989 --> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630f74b88a0 con 0x5630f7130da0 2024-09-21T07:23:30.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff024b53640 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5630f7130da0 0x5630f75d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:30.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7feffffff640 10 client.18435 ms_handle_connect on v2:172.21.15.175:6834/2445062283 2024-09-21T07:23:30.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff024b53640 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5630f7130da0 0x5630f75d0740 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc4a5d929b6465e3 server_cookie=f870f8569fc01f20 in_seq=0 out_seq=0 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7feffffff640 1 -- 172.21.15.92:0/1090584989 <== mds.1 v2:172.21.15.175:6834/2445062283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630f74b88a0 con 0x5630f7130da0 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7feffffff640 10 client.18435 handle_command_reply: tid=0 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff02d32b740 1 client.18435 shutdown 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff02d32b740 1 -- 172.21.15.92:0/1090584989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 msgr2=0x5630f7564ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff02d32b740 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f7564ba0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0128a0 tx=0x7ff00c00bf30 comp rx=0 tx=0).stop 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff02d32b740 1 -- 172.21.15.92:0/1090584989 shutdown_connections 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff02d32b740 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.175:6834/2445062283,v1:172.21.15.175:6835/2445062283] conn(0x5630f7130da0 0x5630f75d0740 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff02d32b740 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630f719d070 0x5630f7564ba0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7feffffff640 0 client.18435 ms_handle_reset on v2:172.21.15.175:6834/2445062283 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff02d32b740 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630f717c390 0x5630f7564660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff02d32b740 1 --2- 172.21.15.92:0/1090584989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f71741b0 0x5630f7567190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.512+0000 7ff02d32b740 1 -- 172.21.15.92:0/1090584989 >> 172.21.15.92:0/1090584989 conn(0x5630f7191460 msgr2=0x5630f7545110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff02d32b740 1 -- 172.21.15.92:0/1090584989 shutdown_connections 2024-09-21T07:23:30.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff02d32b740 1 -- 172.21.15.92:0/1090584989 wait complete. 2024-09-21T07:23:30.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff02d32b740 20 client.18435 trim_cache size 0 max 16384 2024-09-21T07:23:30.519 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:23:30.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 -- 172.21.15.92:0/3774807446 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff0100b66b0 msgr2=0x7ff0100b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff0100b66b0 0x7ff0100b8bc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff0180e5520 tx=0x7ff01800cf70 comp rx=0 tx=0).stop 2024-09-21T07:23:30.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 -- 172.21.15.92:0/3774807446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff020108d50 msgr2=0x7ff02019ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:30.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff020108d50 0x7ff02019ebd0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff01800eb10 tx=0x7ff01800c2d0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 -- 172.21.15.92:0/3774807446 shutdown_connections 2024-09-21T07:23:30.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff0100b66b0 0x7ff0100b8bc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff020108d50 0x7ff02019ebd0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff020108400 0x7ff020199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 --2- 172.21.15.92:0/3774807446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff020103190 0x7ff020199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:30.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 -- 172.21.15.92:0/3774807446 >> 172.21.15.92:0/3774807446 conn(0x7ff020079f90 msgr2=0x7ff0201065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:30.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.513+0000 7ff026db7640 1 -- 172.21.15.92:0/3774807446 shutdown_connections 2024-09-21T07:23:30.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:30.514+0000 7ff026db7640 1 -- 172.21.15.92:0/3774807446 wait complete. 2024-09-21T07:23:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:30 smithi092 ceph-mon[30987]: from='client.18399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:23:31.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:30 smithi169 ceph-mon[33705]: from='client.18399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:23:31.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:30 smithi175 ceph-mon[34064]: from='client.18399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:23:31.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:23:31.576 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:31.963 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:31 smithi092 ceph-mon[30987]: pgmap v660: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:23:32.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.052+0000 7f54f203c640 1 -- 172.21.15.92:0/1366814473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54ec105220 msgr2=0x7f54ec105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.052+0000 7f54f203c640 1 --2- 172.21.15.92:0/1366814473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54ec105220 0x7f54ec105630 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009900 tx=0x7f54d402a410 comp rx=0 tx=0).stop 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.052+0000 7f54f203c640 1 -- 172.21.15.92:0/1366814473 shutdown_connections 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.052+0000 7f54f203c640 1 --2- 172.21.15.92:0/1366814473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ec105b70 0x7f54ec10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.052+0000 7f54f203c640 1 --2- 172.21.15.92:0/1366814473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54ec105220 0x7f54ec105630 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.052+0000 7f54f203c640 1 --2- 172.21.15.92:0/1366814473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54ec103210 0x7f54ec103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.052+0000 7f54f203c640 1 -- 172.21.15.92:0/1366814473 >> 172.21.15.92:0/1366814473 conn(0x7f54ec079ea0 msgr2=0x7f54ec07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.052+0000 7f54f203c640 1 -- 172.21.15.92:0/1366814473 shutdown_connections 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.052+0000 7f54f203c640 1 -- 172.21.15.92:0/1366814473 wait complete. 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54f203c640 1 Processor -- start 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54f203c640 1 -- start start 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54f203c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54ec103210 0x7f54ec19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54f203c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54ec105220 0x7f54ec19b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54f203c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ec105b70 0x7f54ec19bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54f203c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1128f0 con 0x7f54ec103210 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54f203c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec112770 con 0x7f54ec105220 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54f203c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec112a70 con 0x7f54ec105b70 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54ec103210 0x7f54ec19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54ec103210 0x7f54ec19b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38430/0 (socket says 172.21.15.92:38430) 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54eb7fe640 1 -- 172.21.15.92:0/1518507375 learned_addr learned my addr 172.21.15.92:0/1518507375 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54eb7fe640 1 -- 172.21.15.92:0/1518507375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ec105b70 msgr2=0x7f54ec19bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54eb7fe640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ec105b70 0x7f54ec19bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54eb7fe640 1 -- 172.21.15.92:0/1518507375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54ec105220 msgr2=0x7f54ec19b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54e3fff640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54ec105220 0x7f54ec19b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54eb7fe640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54ec105220 0x7f54ec19b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.053+0000 7f54eb7fe640 1 -- 172.21.15.92:0/1518507375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec1a6510 con 0x7f54ec103210 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.054+0000 7f54eb7fe640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54ec103210 0x7f54ec19b200 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00c970 tx=0x7f54dc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.054+0000 7f54e97fa640 1 -- 172.21.15.92:0/1518507375 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc004220 con 0x7f54ec103210 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.054+0000 7f54f203c640 1 -- 172.21.15.92:0/1518507375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec1a6800 con 0x7f54ec103210 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.054+0000 7f54e97fa640 1 -- 172.21.15.92:0/1518507375 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54dc007e40 con 0x7f54ec103210 2024-09-21T07:23:32.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.054+0000 7f54e97fa640 1 -- 172.21.15.92:0/1518507375 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00f450 con 0x7f54ec103210 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.054+0000 7f54f203c640 1 -- 172.21.15.92:0/1518507375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ec1a6d90 con 0x7f54ec103210 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.057+0000 7f54f85b0740 1 Processor -- start 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.057+0000 7f54f85b0740 1 -- start start 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.057+0000 7f54e97fa640 1 -- 172.21.15.92:0/1518507375 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f54dc00f5f0 con 0x7f54ec103210 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.057+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 0x55775e9906a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.057+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c01b0 0x55775e990be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.057+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e991120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.057+0000 7f54f85b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55775e906ea0 con 0x55775e5c8390 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.057+0000 7f54f85b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55775e8f62d0 con 0x55775e5c01b0 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.057+0000 7f54f85b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55775e8fa0e0 con 0x55775e5e9070 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.057+0000 7f54e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e991120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e991120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38438/0 (socket says 172.21.15.92:38438) 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c01b0 0x55775e990be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e3fff640 1 -- 172.21.15.92:0/2134473165 learned_addr learned my addr 172.21.15.92:0/2134473165 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54ebfff640 1 --2- 172.21.15.92:0/2134473165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 0x55775e9906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e3fff640 1 -- 172.21.15.92:0/2134473165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 msgr2=0x55775e9906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e3fff640 1 --2- 172.21.15.92:0/2134473165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 0x55775e9906a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e3fff640 1 -- 172.21.15.92:0/2134473165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c01b0 msgr2=0x55775e990be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e3fff640 1 --2- 172.21.15.92:0/2134473165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c01b0 0x55775e990be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e3fff640 1 -- 172.21.15.92:0/2134473165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55775e654650 con 0x55775e5c8390 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54ebfff640 1 --2- 172.21.15.92:0/2134473165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 0x55775e9906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e97fa640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f54d80b6680 0x7f54d80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e3fff640 1 --2- 172.21.15.92:0/2134473165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e991120 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f54d402a930 tx=0x7f54d4031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0a390acc26e4a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54ebfff640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f54d80b6680 0x7f54d80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e97fa640 1 -- 172.21.15.92:0/1518507375 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f54dc0e78d0 con 0x7f54ec103210 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.058+0000 7f54e1ffb640 1 -- 172.21.15.92:0/2134473165 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4035030 con 0x55775e5c8390 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54e1ffb640 1 -- 172.21.15.92:0/2134473165 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54d4004030 con 0x55775e5c8390 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54e1ffb640 1 -- 172.21.15.92:0/2134473165 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4005440 con 0x55775e5c8390 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54f85b0740 1 -- 172.21.15.92:0/2134473165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 msgr2=0x55775e991120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54ebfff640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f54d80b6680 0x7f54d80b8b90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f54ec102f50 tx=0x7f54e4009b60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2134473165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e991120 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f54d402a930 tx=0x7f54d4031480 comp rx=0 tx=0).stop 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54f85b0740 1 -- 172.21.15.92:0/2134473165 shutdown_connections 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2134473165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e991120 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2134473165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c01b0 0x55775e990be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2134473165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 0x55775e9906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54f85b0740 1 -- 172.21.15.92:0/2134473165 >> 172.21.15.92:0/2134473165 conn(0x55775e5dd460 msgr2=0x55775e98e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54f85b0740 1 -- 172.21.15.92:0/2134473165 shutdown_connections 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.059+0000 7f54f85b0740 1 -- 172.21.15.92:0/2134473165 wait complete. 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.060+0000 7f54f85b0740 1 -- start start 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.060+0000 7f54f85b0740 1 Processor -- start 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.060+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5c01b0 0x55775e99bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.060+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c8390 0x55775e99c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.060+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5e9070 0x55775e9a8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.060+0000 7f54f85b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55775e757700 con 0x55775e5e9070 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.060+0000 7f54f85b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55775e891160 con 0x55775e5c8390 2024-09-21T07:23:32.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.060+0000 7f54f85b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55775e99ee20 con 0x55775e5c01b0 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54f85b0740 10 client.0 _ll_register_callbacks cb 0x55775e8aa9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5e9070 0x55775e9a8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5e9070 0x55775e9a8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38452/0 (socket says 172.21.15.92:38452) 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54ebfff640 1 -- 172.21.15.92:0/525744327 learned_addr learned my addr 172.21.15.92:0/525744327 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54e3fff640 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c8390 0x55775e99c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54eb7fe640 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5c01b0 0x55775e99bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54ebfff640 1 -- 172.21.15.92:0/525744327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5c01b0 msgr2=0x55775e99bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54ebfff640 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5c01b0 0x55775e99bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54ebfff640 1 -- 172.21.15.92:0/525744327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c8390 msgr2=0x55775e99c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54ebfff640 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c8390 0x55775e99c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54ebfff640 1 -- 172.21.15.92:0/525744327 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55775e8bec90 con 0x55775e5e9070 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54ebfff640 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5e9070 0x55775e9a8110 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f54e4011bb0 tx=0x7f54e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b4d2181bc7b832 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:32.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54caffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54caffd640 1 -- 172.21.15.92:0/525744327 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e401e420 con 0x55775e5e9070 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54caffd640 1 -- 172.21.15.92:0/525744327 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f54e401e5c0 con 0x55775e5e9070 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54f85b0740 1 -- 172.21.15.92:0/525744327 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54d4004030 con 0x55775e5e9070 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.061+0000 7f54caffd640 1 -- 172.21.15.92:0/525744327 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f54e401e7c0 con 0x55775e5e9070 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54f85b0740 10 client.18447 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54f85b0740 1 -- 172.21.15.92:0/525744327 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55775e9aabf0 con 0x55775e5e9070 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54caffd640 1 -- 172.21.15.92:0/525744327 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54d4004030 con 0x55775e5e9070 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54caffd640 1 -- 172.21.15.92:0/525744327 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f54e40268a0 con 0x55775e5e9070 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54f85b0740 10 client.18447 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54f85b0740 10 client.18447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54f85b0740 20 client.18447 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54f85b0740 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55775e5a79f0 0x55775e9ae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54f85b0740 4 client.18447 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54f85b0740 1 -- 172.21.15.92:0/525744327 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55775e908df0 con 0x55775e5a79f0 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.062+0000 7f54eb7fe640 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55775e5a79f0 0x55775e9ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.063+0000 7f54caffd640 10 client.18447 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.063+0000 7f54eb7fe640 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55775e5a79f0 0x55775e9ae130 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2d85ac56900123b server_cookie=12a0757c7e81003f in_seq=0 out_seq=0 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.063+0000 7f54caffd640 1 -- 172.21.15.92:0/525744327 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55775e908df0 con 0x55775e5a79f0 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.063+0000 7f54caffd640 10 client.18447 handle_command_reply: tid=0 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 client.18447 shutdown 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 -- 172.21.15.92:0/525744327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5e9070 msgr2=0x55775e9a8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5e9070 0x55775e9a8110 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f54e4011bb0 tx=0x7f54e4004a40 comp rx=0 tx=0).stop 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 -- 172.21.15.92:0/525744327 shutdown_connections 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55775e5a79f0 0x55775e9ae130 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5e9070 0x55775e9a8110 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c8390 0x55775e99c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54caffd640 0 client.18447 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:23:32.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 --2- 172.21.15.92:0/525744327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5c01b0 0x55775e99bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 -- 172.21.15.92:0/525744327 >> 172.21.15.92:0/525744327 conn(0x55775e5dd460 msgr2=0x55775e993830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:32.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 -- 172.21.15.92:0/525744327 shutdown_connections 2024-09-21T07:23:32.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 1 -- 172.21.15.92:0/525744327 wait complete. 2024-09-21T07:23:32.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.064+0000 7f54f85b0740 20 client.18447 trim_cache size 0 max 16384 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54f85b0740 1 Processor -- start 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54f85b0740 1 -- start start 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c01b0 0x55775e99c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e9a8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 0x55775e9a8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54f85b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1b1030 con 0x55775e5c8390 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54f85b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1b2b70 con 0x55775e5c01b0 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54f85b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1b1700 con 0x55775e5e9070 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e9a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e9a8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38464/0 (socket says 172.21.15.92:38464) 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.077+0000 7f54e3fff640 1 -- 172.21.15.92:0/2906055959 learned_addr learned my addr 172.21.15.92:0/2906055959 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:32.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54ebfff640 1 --2- 172.21.15.92:0/2906055959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 0x55775e9a8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54e3fff640 1 -- 172.21.15.92:0/2906055959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 msgr2=0x55775e9a8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:32.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54eb7fe640 1 --2- 172.21.15.92:0/2906055959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c01b0 0x55775e99c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54e3fff640 1 --2- 172.21.15.92:0/2906055959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 0x55775e9a8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54e3fff640 1 -- 172.21.15.92:0/2906055959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c01b0 msgr2=0x55775e99c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:32.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54e3fff640 1 --2- 172.21.15.92:0/2906055959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c01b0 0x55775e99c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54e3fff640 1 -- 172.21.15.92:0/2906055959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55775e99a2a0 con 0x55775e5c8390 2024-09-21T07:23:32.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54ebfff640 1 --2- 172.21.15.92:0/2906055959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 0x55775e9a8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54e3fff640 1 --2- 172.21.15.92:0/2906055959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e9a8010 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f54d4006010 tx=0x7f54d4031710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbca86450b438079 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54e17fa640 1 -- 172.21.15.92:0/2906055959 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4035070 con 0x55775e5c8390 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54e17fa640 1 -- 172.21.15.92:0/2906055959 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54d40044d0 con 0x55775e5c8390 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.078+0000 7f54e17fa640 1 -- 172.21.15.92:0/2906055959 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40035f0 con 0x55775e5c8390 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.079+0000 7f54f85b0740 1 -- 172.21.15.92:0/2906055959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 msgr2=0x55775e9a8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.079+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2906055959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e9a8010 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f54d4006010 tx=0x7f54d4031710 comp rx=0 tx=0).stop 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.079+0000 7f54f85b0740 1 -- 172.21.15.92:0/2906055959 shutdown_connections 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.079+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2906055959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5e9070 0x55775e9a8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.079+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2906055959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c8390 0x55775e9a8010 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.079+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2906055959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5c01b0 0x55775e99c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.079+0000 7f54f85b0740 1 -- 172.21.15.92:0/2906055959 >> 172.21.15.92:0/2906055959 conn(0x55775e5dd460 msgr2=0x55775e99bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.079+0000 7f54f85b0740 1 -- 172.21.15.92:0/2906055959 shutdown_connections 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.079+0000 7f54f85b0740 1 -- 172.21.15.92:0/2906055959 wait complete. 2024-09-21T07:23:32.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.079+0000 7f54f85b0740 1 -- start start 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54f85b0740 1 Processor -- start 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c01b0 0x55775e9a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5c8390 0x55775e9a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54f85b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5e9070 0x55775ea17af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54f85b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1b24a0 con 0x55775e5c01b0 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54f85b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1b1dd0 con 0x55775e5e9070 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54f85b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1af030 con 0x55775e5c8390 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54f85b0740 10 client.0 _ll_register_callbacks cb 0x7f54e40099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c01b0 0x55775e9a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c01b0 0x55775e9a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38478/0 (socket says 172.21.15.92:38478) 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54eb7fe640 1 -- 172.21.15.92:0/2536527136 learned_addr learned my addr 172.21.15.92:0/2536527136 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54e3fff640 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5c8390 0x55775e9a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54eb7fe640 1 -- 172.21.15.92:0/2536527136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5c8390 msgr2=0x55775e9a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:32.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54eb7fe640 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5c8390 0x55775e9a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54eb7fe640 1 -- 172.21.15.92:0/2536527136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5e9070 msgr2=0x55775ea17af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54eb7fe640 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5e9070 0x55775ea17af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54eb7fe640 1 -- 172.21.15.92:0/2536527136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55775ea18030 con 0x55775e5c01b0 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54eb7fe640 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c01b0 0x55775e9a07d0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00afd0 tx=0x7f54dc0ad1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee840b6e8408a03c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.080+0000 7f54caffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54caffd640 1 -- 172.21.15.92:0/2536527136 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc01d040 con 0x55775e5c01b0 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54caffd640 1 -- 172.21.15.92:0/2536527136 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f54dc003610 con 0x55775e5c01b0 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54f85b0740 1 -- 172.21.15.92:0/2536527136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54d40044d0 con 0x55775e5c01b0 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54caffd640 1 -- 172.21.15.92:0/2536527136 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f54dc003e70 con 0x55775e5c01b0 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54f85b0740 10 client.18453 fetch_fsmap learned FSMap version 29 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54f85b0740 1 -- 172.21.15.92:0/2536527136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55775ea19280 con 0x55775e5c01b0 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54caffd640 1 -- 172.21.15.92:0/2536527136 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54d40044d0 con 0x55775e5c01b0 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54caffd640 1 -- 172.21.15.92:0/2536527136 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f54dc0e7450 con 0x55775e5c01b0 2024-09-21T07:23:32.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54f85b0740 10 client.18453 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54f85b0740 10 client.18453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54f85b0740 20 client.18453 populate_metadata read hostname 'smithi092' 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55775e57cda0 0x55775ea1ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54f85b0740 4 client.18453 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.081+0000 7f54f85b0740 1 -- 172.21.15.92:0/2536527136 --> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55775e9048a0 con 0x55775e57cda0 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54e3fff640 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55775e57cda0 0x55775ea1ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54e3fff640 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55775e57cda0 0x55775ea1ba10 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b93d69d7f8eef8e server_cookie=c361a59bf1fbca59 in_seq=0 out_seq=0 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54caffd640 10 client.18453 ms_handle_connect on v2:172.21.15.175:6838/3839014225 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54caffd640 1 -- 172.21.15.92:0/2536527136 <== mds.0 v2:172.21.15.175:6838/3839014225 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55775e9048a0 con 0x55775e57cda0 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54caffd640 10 client.18453 handle_command_reply: tid=0 2024-09-21T07:23:32.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54f85b0740 1 client.18453 shutdown 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54f85b0740 1 -- 172.21.15.92:0/2536527136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c01b0 msgr2=0x55775e9a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c01b0 0x55775e9a07d0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00afd0 tx=0x7f54dc0ad1b0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54f85b0740 1 -- 172.21.15.92:0/2536527136 shutdown_connections 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.175:6838/3839014225,v1:172.21.15.175:6839/3839014225] conn(0x55775e57cda0 0x55775ea1ba10 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.082+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55775e5e9070 0x55775ea17af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55775e5c8390 0x55775e9a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f85b0740 1 --2- 172.21.15.92:0/2536527136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55775e5c01b0 0x55775e9a07d0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f85b0740 1 -- 172.21.15.92:0/2536527136 >> 172.21.15.92:0/2536527136 conn(0x55775e5dd460 msgr2=0x55775e99d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:32.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54caffd640 0 client.18453 ms_handle_reset on v2:172.21.15.175:6838/3839014225 2024-09-21T07:23:32.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f85b0740 1 -- 172.21.15.92:0/2536527136 shutdown_connections 2024-09-21T07:23:32.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f85b0740 1 -- 172.21.15.92:0/2536527136 wait complete. 2024-09-21T07:23:32.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f85b0740 20 client.18453 trim_cache size 0 max 16384 2024-09-21T07:23:32.091 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 -- 172.21.15.92:0/1518507375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f54d80b6680 msgr2=0x7f54d80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f54d80b6680 0x7f54d80b8b90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f54ec102f50 tx=0x7f54e4009b60 comp rx=0 tx=0).stop 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 -- 172.21.15.92:0/1518507375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54ec103210 msgr2=0x7f54ec19b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54ec103210 0x7f54ec19b200 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00c970 tx=0x7f54dc00ce30 comp rx=0 tx=0).stop 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 -- 172.21.15.92:0/1518507375 shutdown_connections 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f54d80b6680 0x7f54d80b8b90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ec105b70 0x7f54ec19bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54ec105220 0x7f54ec19b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 --2- 172.21.15.92:0/1518507375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54ec103210 0x7f54ec19b200 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 -- 172.21.15.92:0/1518507375 >> 172.21.15.92:0/1518507375 conn(0x7f54ec079ea0 msgr2=0x7f54ec106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 -- 172.21.15.92:0/1518507375 shutdown_connections 2024-09-21T07:23:32.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:32.083+0000 7f54f203c640 1 -- 172.21.15.92:0/1518507375 wait complete. 2024-09-21T07:23:32.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:31 smithi169 ceph-mon[33705]: pgmap v660: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:23:32.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:31 smithi175 ceph-mon[34064]: pgmap v660: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:23:32.941 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T07:23:32.941 INFO:tasks.fwd_scrub:done joining 2024-09-21T07:23:32.941 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T07:23:32.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:23:32.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:32 smithi092 ceph-mon[30987]: pgmap v661: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-21T07:23:33.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.062+0000 7fe134094640 1 -- 172.21.15.92:0/1512255517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe12c10dd70 msgr2=0x7fe12c110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.062+0000 7fe134094640 1 --2- 172.21.15.92:0/1512255517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe12c10dd70 0x7fe12c110260 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe124009ca0 tx=0x7fe12402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.062+0000 7fe134094640 1 -- 172.21.15.92:0/1512255517 shutdown_connections 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.062+0000 7fe134094640 1 --2- 172.21.15.92:0/1512255517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe12c10dd70 0x7fe12c110260 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.062+0000 7fe134094640 1 --2- 172.21.15.92:0/1512255517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c105260 0x7fe12c10d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.062+0000 7fe134094640 1 --2- 172.21.15.92:0/1512255517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe12c104910 0x7fe12c104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.062+0000 7fe134094640 1 -- 172.21.15.92:0/1512255517 >> 172.21.15.92:0/1512255517 conn(0x7fe12c0fe3c0 msgr2=0x7fe12c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.063+0000 7fe134094640 1 -- 172.21.15.92:0/1512255517 shutdown_connections 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.063+0000 7fe134094640 1 -- 172.21.15.92:0/1512255517 wait complete. 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.063+0000 7fe134094640 1 Processor -- start 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.063+0000 7fe134094640 1 -- start start 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.063+0000 7fe134094640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe12c104910 0x7fe12c102640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.063+0000 7fe134094640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe12c105260 0x7fe12c102b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.063+0000 7fe134094640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c10dd70 0x7fe12c1030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.063+0000 7fe134094640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c1138f0 con 0x7fe12c104910 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.063+0000 7fe134094640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c113770 con 0x7fe12c105260 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.063+0000 7fe134094640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c113a70 con 0x7fe12c10dd70 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe131e30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe12c104910 0x7fe12c102640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe131e30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe12c104910 0x7fe12c102640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38504/0 (socket says 172.21.15.92:38504) 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe131e30640 1 -- 172.21.15.92:0/1305559098 learned_addr learned my addr 172.21.15.92:0/1305559098 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe13162f640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe12c105260 0x7fe12c102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe131e30640 1 -- 172.21.15.92:0/1305559098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c10dd70 msgr2=0x7fe12c1030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe132631640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c10dd70 0x7fe12c1030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe131e30640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c10dd70 0x7fe12c1030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe131e30640 1 -- 172.21.15.92:0/1305559098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe12c105260 msgr2=0x7fe12c102b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe131e30640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe12c105260 0x7fe12c102b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe131e30640 1 -- 172.21.15.92:0/1305559098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12c1a8560 con 0x7fe12c104910 2024-09-21T07:23:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe13162f640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe12c105260 0x7fe12c102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:33.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe131e30640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe12c104910 0x7fe12c102640 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe12800d950 tx=0x7fe12800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:33.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe122ffd640 1 -- 172.21.15.92:0/1305559098 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe128017070 con 0x7fe12c104910 2024-09-21T07:23:33.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe134094640 1 -- 172.21.15.92:0/1305559098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe12c1a8850 con 0x7fe12c104910 2024-09-21T07:23:33.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe122ffd640 1 -- 172.21.15.92:0/1305559098 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe128009c30 con 0x7fe12c104910 2024-09-21T07:23:33.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe122ffd640 1 -- 172.21.15.92:0/1305559098 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12800f620 con 0x7fe12c104910 2024-09-21T07:23:33.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.064+0000 7fe134094640 1 -- 172.21.15.92:0/1305559098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe12c1a8df0 con 0x7fe12c104910 2024-09-21T07:23:33.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.065+0000 7fe134094640 1 -- 172.21.15.92:0/1305559098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe12c104d20 con 0x7fe12c104910 2024-09-21T07:23:33.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.067+0000 7fe122ffd640 1 -- 172.21.15.92:0/1305559098 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fe128010460 con 0x7fe12c104910 2024-09-21T07:23:33.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.067+0000 7fe122ffd640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1180b66b0 0x7fe1180b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.068+0000 7fe13162f640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1180b66b0 0x7fe1180b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.068+0000 7fe122ffd640 1 -- 172.21.15.92:0/1305559098 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7fe1280e77f0 con 0x7fe12c104910 2024-09-21T07:23:33.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.068+0000 7fe13162f640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1180b66b0 0x7fe1180b8bc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe12c1100b0 tx=0x7fe11c005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:33.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.072+0000 7fe122ffd640 1 -- 172.21.15.92:0/1305559098 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1280ad940 con 0x7fe12c104910 2024-09-21T07:23:33.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:32 smithi169 ceph-mon[33705]: pgmap v661: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-21T07:23:33.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.249+0000 7fe134094640 1 -- 172.21.15.92:0/1305559098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe12c1a91d0 con 0x7fe12c104910 2024-09-21T07:23:33.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.250+0000 7fe122ffd640 1 -- 172.21.15.92:0/1305559098 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+25446 (secure 0 0 0) 0x7fe12808e380 con 0x7fe12c104910 2024-09-21T07:23:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:23:33.253 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":94,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:23:19.467528+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:23:33.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.252+0000 7fe134094640 1 -- 172.21.15.92:0/1305559098 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1180b66b0 msgr2=0x7fe1180b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.252+0000 7fe134094640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1180b66b0 0x7fe1180b8bc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe12c1100b0 tx=0x7fe11c005e50 comp rx=0 tx=0).stop 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.253+0000 7fe134094640 1 -- 172.21.15.92:0/1305559098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe12c104910 msgr2=0x7fe12c102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.253+0000 7fe134094640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe12c104910 0x7fe12c102640 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe12800d950 tx=0x7fe12800de10 comp rx=0 tx=0).stop 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.253+0000 7fe134094640 1 -- 172.21.15.92:0/1305559098 shutdown_connections 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.253+0000 7fe134094640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fe1180b66b0 0x7fe1180b8bc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.253+0000 7fe134094640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c10dd70 0x7fe12c1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.253+0000 7fe134094640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe12c105260 0x7fe12c102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.253+0000 7fe134094640 1 --2- 172.21.15.92:0/1305559098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe12c104910 0x7fe12c102640 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.253+0000 7fe134094640 1 -- 172.21.15.92:0/1305559098 >> 172.21.15.92:0/1305559098 conn(0x7fe12c0fe3c0 msgr2=0x7fe12c100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.253+0000 7fe134094640 1 -- 172.21.15.92:0/1305559098 shutdown_connections 2024-09-21T07:23:33.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.253+0000 7fe134094640 1 -- 172.21.15.92:0/1305559098 wait complete. 2024-09-21T07:23:33.267 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:06:11.822418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:10:50.128666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:10:52.137256+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T07:10:58.524238+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T07:23:33.267 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:23:33.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:32 smithi175 ceph-mon[34064]: pgmap v661: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-21T07:23:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 -- 172.21.15.92:0/959111667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca8c108c50 msgr2=0x7fca8c10f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 --2- 172.21.15.92:0/959111667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca8c108c50 0x7fca8c10f480 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fca84009ca0 tx=0x7fca8402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 -- 172.21.15.92:0/959111667 shutdown_connections 2024-09-21T07:23:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 --2- 172.21.15.92:0/959111667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca8c108c50 0x7fca8c10f480 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 --2- 172.21.15.92:0/959111667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca8c108300 0x7fca8c108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 --2- 172.21.15.92:0/959111667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c1029d0 0x7fca8c102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 -- 172.21.15.92:0/959111667 >> 172.21.15.92:0/959111667 conn(0x7fca8c0fe3b0 msgr2=0x7fca8c100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 -- 172.21.15.92:0/959111667 shutdown_connections 2024-09-21T07:23:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 -- 172.21.15.92:0/959111667 wait complete. 2024-09-21T07:23:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 Processor -- start 2024-09-21T07:23:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.419+0000 7fca913ad640 1 -- start start 2024-09-21T07:23:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca913ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca8c1029d0 0x7fca8c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca913ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c108300 0x7fca8c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca913ad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca8c108c50 0x7fca8c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca913ad640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c112810 con 0x7fca8c1029d0 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca913ad640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c112690 con 0x7fca8c108c50 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca913ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c112990 con 0x7fca8c108300 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca8affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca8c1029d0 0x7fca8c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca8affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca8c1029d0 0x7fca8c19a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38524/0 (socket says 172.21.15.92:38524) 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca8affd640 1 -- 172.21.15.92:0/2977537205 learned_addr learned my addr 172.21.15.92:0/2977537205 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca83fff640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c108300 0x7fca8c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca8b7fe640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca8c108c50 0x7fca8c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca8affd640 1 -- 172.21.15.92:0/2977537205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c108300 msgr2=0x7fca8c19a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca8affd640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c108300 0x7fca8c19a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca8affd640 1 -- 172.21.15.92:0/2977537205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca8c108c50 msgr2=0x7fca8c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca8affd640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca8c108c50 0x7fca8c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca8affd640 1 -- 172.21.15.92:0/2977537205 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c1a0270 con 0x7fca8c1029d0 2024-09-21T07:23:33.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca83fff640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c108300 0x7fca8c19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:33.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca8affd640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca8c1029d0 0x7fca8c19a340 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00d950 tx=0x7fca7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:33.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca88ff9640 1 -- 172.21.15.92:0/2977537205 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c017030 con 0x7fca8c1029d0 2024-09-21T07:23:33.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca913ad640 1 -- 172.21.15.92:0/2977537205 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8c1a0560 con 0x7fca8c1029d0 2024-09-21T07:23:33.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca88ff9640 1 -- 172.21.15.92:0/2977537205 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca7c004020 con 0x7fca8c1029d0 2024-09-21T07:23:33.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca88ff9640 1 -- 172.21.15.92:0/2977537205 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0055d0 con 0x7fca8c1029d0 2024-09-21T07:23:33.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.420+0000 7fca913ad640 1 -- 172.21.15.92:0/2977537205 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8c1a6cf0 con 0x7fca8c1029d0 2024-09-21T07:23:33.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.421+0000 7fca913ad640 1 -- 172.21.15.92:0/2977537205 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca8c102de0 con 0x7fca8c1029d0 2024-09-21T07:23:33.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.423+0000 7fca88ff9640 1 -- 172.21.15.92:0/2977537205 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fca7c009a30 con 0x7fca8c1029d0 2024-09-21T07:23:33.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.423+0000 7fca88ff9640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fca780b6680 0x7fca780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.424+0000 7fca83fff640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fca780b6680 0x7fca780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.424+0000 7fca88ff9640 1 -- 172.21.15.92:0/2977537205 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7fca7c0e7cf0 con 0x7fca8c1029d0 2024-09-21T07:23:33.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.424+0000 7fca83fff640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fca780b6680 0x7fca780b8b90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fca8c100b10 tx=0x7fca74005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:33.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.426+0000 7fca88ff9640 1 -- 172.21.15.92:0/2977537205 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca7c0ade40 con 0x7fca8c1029d0 2024-09-21T07:23:33.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.608+0000 7fca913ad640 1 -- 172.21.15.92:0/2977537205 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fca8c1a7080 con 0x7fca8c1029d0 2024-09-21T07:23:33.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.609+0000 7fca88ff9640 1 -- 172.21.15.92:0/2977537205 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7fca7c0b2220 con 0x7fca8c1029d0 2024-09-21T07:23:33.611 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2024-09-21T07:23:33.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.611+0000 7fca913ad640 1 -- 172.21.15.92:0/2977537205 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fca780b6680 msgr2=0x7fca780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.611+0000 7fca913ad640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fca780b6680 0x7fca780b8b90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fca8c100b10 tx=0x7fca74005f90 comp rx=0 tx=0).stop 2024-09-21T07:23:33.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.611+0000 7fca913ad640 1 -- 172.21.15.92:0/2977537205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca8c1029d0 msgr2=0x7fca8c19a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.611+0000 7fca913ad640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca8c1029d0 0x7fca8c19a340 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00d950 tx=0x7fca7c00de10 comp rx=0 tx=0).stop 2024-09-21T07:23:33.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.611+0000 7fca913ad640 1 -- 172.21.15.92:0/2977537205 shutdown_connections 2024-09-21T07:23:33.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.611+0000 7fca913ad640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fca780b6680 0x7fca780b8b90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.612+0000 7fca913ad640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca8c108c50 0x7fca8c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.612+0000 7fca913ad640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c108300 0x7fca8c19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.612+0000 7fca913ad640 1 --2- 172.21.15.92:0/2977537205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca8c1029d0 0x7fca8c19a340 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.612+0000 7fca913ad640 1 -- 172.21.15.92:0/2977537205 >> 172.21.15.92:0/2977537205 conn(0x7fca8c0fe3b0 msgr2=0x7fca8c1016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:33.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.612+0000 7fca913ad640 1 -- 172.21.15.92:0/2977537205 shutdown_connections 2024-09-21T07:23:33.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.612+0000 7fca913ad640 1 -- 172.21.15.92:0/2977537205 wait complete. 2024-09-21T07:23:33.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T07:23:33.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.734+0000 7f84c489b640 1 -- 172.21.15.92:0/2353189738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c0108300 msgr2=0x7f84c0108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.734+0000 7f84c489b640 1 --2- 172.21.15.92:0/2353189738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c0108300 0x7f84c0108710 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009900 tx=0x7f84a802a410 comp rx=0 tx=0).stop 2024-09-21T07:23:33.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.734+0000 7f84c489b640 1 -- 172.21.15.92:0/2353189738 shutdown_connections 2024-09-21T07:23:33.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.734+0000 7f84c489b640 1 --2- 172.21.15.92:0/2353189738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84c0108c50 0x7f84c010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.734+0000 7f84c489b640 1 --2- 172.21.15.92:0/2353189738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c0108300 0x7f84c0108710 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.734+0000 7f84c489b640 1 --2- 172.21.15.92:0/2353189738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0102a20 0x7f84c0102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.734+0000 7f84c489b640 1 -- 172.21.15.92:0/2353189738 >> 172.21.15.92:0/2353189738 conn(0x7f84c0079630 msgr2=0x7f84c0079a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:33.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.734+0000 7f84c489b640 1 -- 172.21.15.92:0/2353189738 shutdown_connections 2024-09-21T07:23:33.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.734+0000 7f84c489b640 1 -- 172.21.15.92:0/2353189738 wait complete. 2024-09-21T07:23:33.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.735+0000 7f84c489b640 1 Processor -- start 2024-09-21T07:23:33.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.735+0000 7f84c489b640 1 -- start start 2024-09-21T07:23:33.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84c489b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c0102a20 0x7f84c0199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84c489b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84c0108300 0x7f84c01998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84c489b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108c50 0x7f84c019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84c489b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f84c01127c0 con 0x7f84c0102a20 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84c489b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0112640 con 0x7f84c0108300 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84c489b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0112940 con 0x7f84c0108c50 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c0102a20 0x7f84c0199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c0102a20 0x7f84c0199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38542/0 (socket says 172.21.15.92:38542) 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84be59c640 1 -- 172.21.15.92:0/3508781896 learned_addr learned my addr 172.21.15.92:0/3508781896 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84bdd9b640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84c0108300 0x7f84c01998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84bed9d640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108c50 0x7f84c019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84be59c640 1 -- 172.21.15.92:0/3508781896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108c50 msgr2=0x7f84c019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84be59c640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108c50 0x7f84c019eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84be59c640 1 -- 172.21.15.92:0/3508781896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84c0108300 msgr2=0x7f84c01998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84be59c640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84c0108300 0x7f84c01998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84be59c640 1 -- 172.21.15.92:0/3508781896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c019f1e0 con 0x7f84c0102a20 2024-09-21T07:23:33.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84be59c640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c0102a20 0x7f84c0199340 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f84b000c920 tx=0x7f84b000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:33.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84b77fe640 1 -- 172.21.15.92:0/3508781896 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0007c70 con 0x7f84c0102a20 2024-09-21T07:23:33.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84b77fe640 1 -- 172.21.15.92:0/3508781896 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84b0007e10 con 0x7f84c0102a20 2024-09-21T07:23:33.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84c489b640 1 -- 172.21.15.92:0/3508781896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c019f4d0 con 0x7f84c0102a20 2024-09-21T07:23:33.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84b77fe640 1 -- 172.21.15.92:0/3508781896 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0018710 con 0x7f84c0102a20 2024-09-21T07:23:33.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.736+0000 7f84c489b640 1 -- 172.21.15.92:0/3508781896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c01a5cf0 con 0x7f84c0102a20 2024-09-21T07:23:33.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.737+0000 7f84c489b640 1 -- 172.21.15.92:0/3508781896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c0102e30 con 0x7f84c0102a20 2024-09-21T07:23:33.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.739+0000 7f84b77fe640 1 -- 172.21.15.92:0/3508781896 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f84b000f450 con 0x7f84c0102a20 2024-09-21T07:23:33.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.740+0000 7f84b77fe640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84ac0b6680 0x7f84ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:33.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.740+0000 7f84bdd9b640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84ac0b6680 0x7f84ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:33.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.740+0000 7f84b77fe640 1 -- 172.21.15.92:0/3508781896 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f84b00e7fa0 con 0x7f84c0102a20 2024-09-21T07:23:33.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.740+0000 7f84bdd9b640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84ac0b6680 0x7f84ac0b8b90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f84a8005940 tx=0x7f84a80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:33.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.743+0000 7f84b77fe640 1 -- 172.21.15.92:0/3508781896 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84b0014030 con 0x7f84c0102a20 2024-09-21T07:23:33.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.922+0000 7f84c489b640 1 -- 172.21.15.92:0/3508781896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f84c002e640 con 0x7f84c0102a20 2024-09-21T07:23:33.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.922+0000 7f84b77fe640 1 -- 172.21.15.92:0/3508781896 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f84b00ae180 con 0x7f84c0102a20 2024-09-21T07:23:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2024-09-21T07:23:33.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 -- 172.21.15.92:0/3508781896 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84ac0b6680 msgr2=0x7f84ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84ac0b6680 0x7f84ac0b8b90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f84a8005940 tx=0x7f84a80058d0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 -- 172.21.15.92:0/3508781896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c0102a20 msgr2=0x7f84c0199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c0102a20 0x7f84c0199340 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f84b000c920 tx=0x7f84b000cde0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 -- 172.21.15.92:0/3508781896 shutdown_connections 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f84ac0b6680 0x7f84ac0b8b90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108c50 0x7f84c019eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84c0108300 0x7f84c01998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 --2- 172.21.15.92:0/3508781896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c0102a20 0x7f84c0199340 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 -- 172.21.15.92:0/3508781896 >> 172.21.15.92:0/3508781896 conn(0x7f84c0079630 msgr2=0x7f84c0106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 -- 172.21.15.92:0/3508781896 shutdown_connections 2024-09-21T07:23:33.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:33.925+0000 7f84c489b640 1 -- 172.21.15.92:0/3508781896 wait complete. 2024-09-21T07:23:33.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:33 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1305559098' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:23:33.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:33 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2977537205' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:23:33.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T07:23:34.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.049+0000 7f4b416f9640 1 -- 172.21.15.92:0/4112488377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b3c108310 msgr2=0x7f4b3c108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.049+0000 7f4b416f9640 1 --2- 172.21.15.92:0/4112488377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b3c108310 0x7f4b3c108720 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009900 tx=0x7f4b3002a410 comp rx=0 tx=0).stop 2024-09-21T07:23:34.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.050+0000 7f4b416f9640 1 -- 172.21.15.92:0/4112488377 shutdown_connections 2024-09-21T07:23:34.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.050+0000 7f4b416f9640 1 --2- 172.21.15.92:0/4112488377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c108c60 0x7f4b3c10f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.050+0000 7f4b416f9640 1 --2- 172.21.15.92:0/4112488377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b3c108310 0x7f4b3c108720 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.050+0000 7f4b416f9640 1 --2- 172.21.15.92:0/4112488377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c1029e0 0x7f4b3c102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.050+0000 7f4b416f9640 1 -- 172.21.15.92:0/4112488377 >> 172.21.15.92:0/4112488377 conn(0x7f4b3c0fe3c0 msgr2=0x7f4b3c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:34.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.050+0000 7f4b416f9640 1 -- 172.21.15.92:0/4112488377 shutdown_connections 2024-09-21T07:23:34.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.050+0000 7f4b416f9640 1 -- 172.21.15.92:0/4112488377 wait complete. 2024-09-21T07:23:34.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.050+0000 7f4b416f9640 1 Processor -- start 2024-09-21T07:23:34.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.050+0000 7f4b416f9640 1 -- start start 2024-09-21T07:23:34.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b416f9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c1029e0 0x7f4b3c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b416f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b3c108310 0x7f4b3c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b416f9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c108c60 0x7f4b3c1a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b416f9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1138f0 con 0x7f4b3c108310 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b416f9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c113770 con 0x7f4b3c1029e0 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b416f9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c113a70 con 0x7f4b3c108c60 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b3c108310 0x7f4b3c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b3c108310 0x7f4b3c19cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38562/0 (socket says 172.21.15.92:38562) 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3a7fc640 1 -- 172.21.15.92:0/223323249 learned_addr learned my addr 172.21.15.92:0/223323249 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3affd640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c1029e0 0x7f4b3c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3b7fe640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c108c60 0x7f4b3c1a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3a7fc640 1 -- 172.21.15.92:0/223323249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c108c60 msgr2=0x7f4b3c1a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3a7fc640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c108c60 0x7f4b3c1a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3a7fc640 1 -- 172.21.15.92:0/223323249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c1029e0 msgr2=0x7f4b3c19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3a7fc640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c1029e0 0x7f4b3c19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3a7fc640 1 -- 172.21.15.92:0/223323249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c1a2450 con 0x7f4b3c108310 2024-09-21T07:23:34.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b3a7fc640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b3c108310 0x7f4b3c19cb50 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4b30004770 tx=0x7f4b30004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:34.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b23fff640 1 -- 172.21.15.92:0/223323249 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3003f030 con 0x7f4b3c108310 2024-09-21T07:23:34.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b23fff640 1 -- 172.21.15.92:0/223323249 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b30004440 con 0x7f4b3c108310 2024-09-21T07:23:34.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b416f9640 1 -- 172.21.15.92:0/223323249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c1a26e0 con 0x7f4b3c108310 2024-09-21T07:23:34.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b23fff640 1 -- 172.21.15.92:0/223323249 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30035070 con 0x7f4b3c108310 2024-09-21T07:23:34.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.051+0000 7f4b416f9640 1 -- 172.21.15.92:0/223323249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1a2bd0 con 0x7f4b3c108310 2024-09-21T07:23:34.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.052+0000 7f4b416f9640 1 -- 172.21.15.92:0/223323249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3c102df0 con 0x7f4b3c108310 2024-09-21T07:23:34.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.055+0000 7f4b23fff640 1 -- 172.21.15.92:0/223323249 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f4b30042030 con 0x7f4b3c108310 2024-09-21T07:23:34.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.055+0000 7f4b23fff640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4b240b6680 0x7f4b240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.056+0000 7f4b3affd640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4b240b6680 0x7f4b240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.056+0000 7f4b23fff640 1 -- 172.21.15.92:0/223323249 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f4b301082a0 con 0x7f4b3c108310 2024-09-21T07:23:34.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.056+0000 7f4b3affd640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4b240b6680 0x7f4b240b8b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c007ec0 tx=0x7f4b2c0075b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:34.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.059+0000 7f4b23fff640 1 -- 172.21.15.92:0/223323249 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b300d27d0 con 0x7f4b3c108310 2024-09-21T07:23:34.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:33 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1305559098' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:23:34.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:33 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2977537205' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:23:34.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.235+0000 7f4b416f9640 1 -- 172.21.15.92:0/223323249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4b3c1a90e0 con 0x7f4b3c108310 2024-09-21T07:23:34.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.236+0000 7f4b23fff640 1 -- 172.21.15.92:0/223323249 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7f4b300d7710 con 0x7f4b3c108310 2024-09-21T07:23:34.237 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 -- 172.21.15.92:0/223323249 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4b240b6680 msgr2=0x7f4b240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4b240b6680 0x7f4b240b8b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c007ec0 tx=0x7f4b2c0075b0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 -- 172.21.15.92:0/223323249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b3c108310 msgr2=0x7f4b3c19cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b3c108310 0x7f4b3c19cb50 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4b30004770 tx=0x7f4b30004040 comp rx=0 tx=0).stop 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 -- 172.21.15.92:0/223323249 shutdown_connections 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f4b240b6680 0x7f4b240b8b90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c108c60 0x7f4b3c1a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b3c108310 0x7f4b3c19cb50 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 --2- 172.21.15.92:0/223323249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c1029e0 0x7f4b3c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 -- 172.21.15.92:0/223323249 >> 172.21.15.92:0/223323249 conn(0x7f4b3c0fe3c0 msgr2=0x7f4b3c106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 -- 172.21.15.92:0/223323249 shutdown_connections 2024-09-21T07:23:34.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.238+0000 7f4b416f9640 1 -- 172.21.15.92:0/223323249 wait complete. 2024-09-21T07:23:34.251 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T07:23:34.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:33 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1305559098' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:23:34.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:33 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2977537205' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:23:34.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.361+0000 7f9a6da40640 1 -- 172.21.15.92:0/2005820947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a681082c0 msgr2=0x7f9a681086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.361+0000 7f9a6da40640 1 --2- 172.21.15.92:0/2005820947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a681082c0 0x7f9a681086d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009900 tx=0x7f9a5002a410 comp rx=0 tx=0).stop 2024-09-21T07:23:34.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.361+0000 7f9a6da40640 1 -- 172.21.15.92:0/2005820947 shutdown_connections 2024-09-21T07:23:34.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.361+0000 7f9a6da40640 1 --2- 172.21.15.92:0/2005820947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a68108c10 0x7f9a6810f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.361+0000 7f9a6da40640 1 --2- 172.21.15.92:0/2005820947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a681082c0 0x7f9a681086d0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.361+0000 7f9a6da40640 1 --2- 172.21.15.92:0/2005820947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a68102990 0x7f9a68102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.361+0000 7f9a6da40640 1 -- 172.21.15.92:0/2005820947 >> 172.21.15.92:0/2005820947 conn(0x7f9a680fe3b0 msgr2=0x7f9a68100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:34.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.361+0000 7f9a6da40640 1 -- 172.21.15.92:0/2005820947 shutdown_connections 2024-09-21T07:23:34.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.361+0000 7f9a6da40640 1 -- 172.21.15.92:0/2005820947 wait complete. 2024-09-21T07:23:34.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a6da40640 1 Processor -- start 2024-09-21T07:23:34.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a6da40640 1 -- start start 2024-09-21T07:23:34.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a6da40640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a68102990 0x7f9a6819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a6da40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a681082c0 0x7f9a6819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a6da40640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a68108c10 0x7f9a6819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a6da40640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68112780 con 0x7f9a68102990 2024-09-21T07:23:34.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a6da40640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68112600 con 0x7f9a68108c10 2024-09-21T07:23:34.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a6da40640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68112900 con 0x7f9a681082c0 2024-09-21T07:23:34.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a66ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a68102990 0x7f9a6819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a66ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a68102990 0x7f9a6819a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38576/0 (socket says 172.21.15.92:38576) 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a66ffd640 1 -- 172.21.15.92:0/1312362956 learned_addr learned my addr 172.21.15.92:0/1312362956 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a5e7fc640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a681082c0 0x7f9a6819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.362+0000 7f9a677fe640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a68108c10 0x7f9a6819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a66ffd640 1 -- 172.21.15.92:0/1312362956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a681082c0 msgr2=0x7f9a6819a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a66ffd640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a681082c0 0x7f9a6819a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a66ffd640 1 -- 172.21.15.92:0/1312362956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a68108c10 msgr2=0x7f9a6819fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a66ffd640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a68108c10 0x7f9a6819fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a66ffd640 1 -- 172.21.15.92:0/1312362956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a681a0240 con 0x7f9a68102990 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a677fe640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a68108c10 0x7f9a6819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a66ffd640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a68102990 0x7f9a6819a310 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800d770 tx=0x7f9a5800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a6ca3e640 1 -- 172.21.15.92:0/1312362956 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58017070 con 0x7f9a68102990 2024-09-21T07:23:34.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a6ca3e640 1 -- 172.21.15.92:0/1312362956 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a580054b0 con 0x7f9a68102990 2024-09-21T07:23:34.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a6da40640 1 -- 172.21.15.92:0/1312362956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a681a0530 con 0x7f9a68102990 2024-09-21T07:23:34.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a6ca3e640 1 -- 172.21.15.92:0/1312362956 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58004c60 con 0x7f9a68102990 2024-09-21T07:23:34.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.363+0000 7f9a6da40640 1 -- 172.21.15.92:0/1312362956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a681a6cc0 con 0x7f9a68102990 2024-09-21T07:23:34.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.364+0000 7f9a6da40640 1 -- 172.21.15.92:0/1312362956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a68102da0 con 0x7f9a68102990 2024-09-21T07:23:34.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.365+0000 7f9a6ca3e640 1 -- 172.21.15.92:0/1312362956 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f9a58004e00 con 0x7f9a68102990 2024-09-21T07:23:34.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.366+0000 7f9a6ca3e640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a540b6680 0x7f9a540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.367+0000 7f9a5e7fc640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a540b6680 0x7f9a540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.367+0000 7f9a6ca3e640 1 -- 172.21.15.92:0/1312362956 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f9a580e79b0 con 0x7f9a68102990 2024-09-21T07:23:34.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.367+0000 7f9a5e7fc640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a540b6680 0x7f9a540b8b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9a50005940 tx=0x7f9a500058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:34.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.370+0000 7f9a6ca3e640 1 -- 172.21.15.92:0/1312362956 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a580adb00 con 0x7f9a68102990 2024-09-21T07:23:34.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.548+0000 7f9a6da40640 1 -- 172.21.15.92:0/1312362956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9a681a6ef0 con 0x7f9a68102990 2024-09-21T07:23:34.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.548+0000 7f9a6ca3e640 1 -- 172.21.15.92:0/1312362956 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) ==== 103+0+11 (secure 0 0 0) 0x7f9a580b1ee0 con 0x7f9a68102990 2024-09-21T07:23:34.550 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2024-09-21T07:23:34.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.550+0000 7f9a6da40640 1 -- 172.21.15.92:0/1312362956 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a540b6680 msgr2=0x7f9a540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.550+0000 7f9a6da40640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a540b6680 0x7f9a540b8b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9a50005940 tx=0x7f9a500058d0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.550+0000 7f9a6da40640 1 -- 172.21.15.92:0/1312362956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a68102990 msgr2=0x7f9a6819a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.550+0000 7f9a6da40640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a68102990 0x7f9a6819a310 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800d770 tx=0x7f9a5800dc30 comp rx=0 tx=0).stop 2024-09-21T07:23:34.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.551+0000 7f9a6da40640 1 -- 172.21.15.92:0/1312362956 shutdown_connections 2024-09-21T07:23:34.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.551+0000 7f9a6da40640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f9a540b6680 0x7f9a540b8b90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.551+0000 7f9a6da40640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a68108c10 0x7f9a6819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.551+0000 7f9a6da40640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a681082c0 0x7f9a6819a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.551+0000 7f9a6da40640 1 --2- 172.21.15.92:0/1312362956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a68102990 0x7f9a6819a310 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.551+0000 7f9a6da40640 1 -- 172.21.15.92:0/1312362956 >> 172.21.15.92:0/1312362956 conn(0x7f9a680fe3b0 msgr2=0x7f9a68101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:34.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.551+0000 7f9a6da40640 1 -- 172.21.15.92:0/1312362956 shutdown_connections 2024-09-21T07:23:34.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.551+0000 7f9a6da40640 1 -- 172.21.15.92:0/1312362956 wait complete. 2024-09-21T07:23:34.564 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T07:23:34.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.671+0000 7fcc6de0a640 1 -- 172.21.15.92:0/1086422476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc68108300 msgr2=0x7fcc68108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.671+0000 7fcc6de0a640 1 --2- 172.21.15.92:0/1086422476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc68108300 0x7fcc68108710 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009900 tx=0x7fcc5c02a410 comp rx=0 tx=0).stop 2024-09-21T07:23:34.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.671+0000 7fcc6de0a640 1 -- 172.21.15.92:0/1086422476 shutdown_connections 2024-09-21T07:23:34.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.671+0000 7fcc6de0a640 1 --2- 172.21.15.92:0/1086422476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc68108c50 0x7fcc6810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.671+0000 7fcc6de0a640 1 --2- 172.21.15.92:0/1086422476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc68108300 0x7fcc68108710 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.671+0000 7fcc6de0a640 1 --2- 172.21.15.92:0/1086422476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc681029e0 0x7fcc68102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.671+0000 7fcc6de0a640 1 -- 172.21.15.92:0/1086422476 >> 172.21.15.92:0/1086422476 conn(0x7fcc680786b0 msgr2=0x7fcc68078ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:34.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.671+0000 7fcc6de0a640 1 -- 172.21.15.92:0/1086422476 shutdown_connections 2024-09-21T07:23:34.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.671+0000 7fcc6de0a640 1 -- 172.21.15.92:0/1086422476 wait complete. 2024-09-21T07:23:34.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.672+0000 7fcc6de0a640 1 Processor -- start 2024-09-21T07:23:34.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.672+0000 7fcc6de0a640 1 -- start start 2024-09-21T07:23:34.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.672+0000 7fcc6de0a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc681029e0 0x7fcc6819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.672+0000 7fcc6de0a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc68108300 0x7fcc6819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.672+0000 7fcc6de0a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc68108c50 0x7fcc6819fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.672+0000 7fcc6de0a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcc681127c0 con 0x7fcc68108300 2024-09-21T07:23:34.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.672+0000 7fcc6de0a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcc68112640 con 0x7fcc68108c50 2024-09-21T07:23:34.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.672+0000 7fcc6de0a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc68112940 con 0x7fcc681029e0 2024-09-21T07:23:34.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.672+0000 7fcc66ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc68108300 0x7fcc6819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc66ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc68108300 0x7fcc6819a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38590/0 (socket says 172.21.15.92:38590) 2024-09-21T07:23:34.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc66ffd640 1 -- 172.21.15.92:0/943671418 learned_addr learned my addr 172.21.15.92:0/943671418 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:34.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc67fff640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc68108c50 0x7fcc6819fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc677fe640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc681029e0 0x7fcc6819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc66ffd640 1 -- 172.21.15.92:0/943671418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc681029e0 msgr2=0x7fcc6819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc66ffd640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc681029e0 0x7fcc6819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc66ffd640 1 -- 172.21.15.92:0/943671418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc68108c50 msgr2=0x7fcc6819fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:34.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc66ffd640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc68108c50 0x7fcc6819fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:34.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc66ffd640 1 -- 172.21.15.92:0/943671418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc681a0220 con 0x7fcc68108300 2024-09-21T07:23:34.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc66ffd640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc68108300 0x7fcc6819a890 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c005940 tx=0x7fcc5c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:34.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc64ff9640 1 -- 172.21.15.92:0/943671418 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c03f030 con 0x7fcc68108300 2024-09-21T07:23:34.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc6de0a640 1 -- 172.21.15.92:0/943671418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc681a04b0 con 0x7fcc68108300 2024-09-21T07:23:34.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc64ff9640 1 -- 172.21.15.92:0/943671418 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc5c003a80 con 0x7fcc68108300 2024-09-21T07:23:34.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc64ff9640 1 -- 172.21.15.92:0/943671418 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c035070 con 0x7fcc68108300 2024-09-21T07:23:34.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.673+0000 7fcc6de0a640 1 -- 172.21.15.92:0/943671418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc681a6ca0 con 0x7fcc68108300 2024-09-21T07:23:34.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.674+0000 7fcc6de0a640 1 -- 172.21.15.92:0/943671418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc68102df0 con 0x7fcc68108300 2024-09-21T07:23:34.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.676+0000 7fcc64ff9640 1 -- 172.21.15.92:0/943671418 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fcc5c042030 con 0x7fcc68108300 2024-09-21T07:23:34.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.676+0000 7fcc64ff9640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcc500b6680 0x7fcc500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:34.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.676+0000 7fcc677fe640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcc500b6680 0x7fcc500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:34.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.677+0000 7fcc64ff9640 1 -- 172.21.15.92:0/943671418 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7fcc5c1084f0 con 0x7fcc68108300 2024-09-21T07:23:34.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.677+0000 7fcc677fe640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcc500b6680 0x7fcc500b8b90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcc58005fd0 tx=0x7fcc58005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:34.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.680+0000 7fcc64ff9640 1 -- 172.21.15.92:0/943671418 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcc5c0ce640 con 0x7fcc68108300 2024-09-21T07:23:34.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.907+0000 7fcc6de0a640 1 -- 172.21.15.92:0/943671418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fcc6810ba30 con 0x7fcc68108300 2024-09-21T07:23:34.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.915+0000 7fcc64ff9640 1 -- 172.21.15.92:0/943671418 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+834054 (secure 0 0 0) 0x7fcc5c0d2a20 con 0x7fcc68108300 2024-09-21T07:23:34.927 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:23:34.927 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:23:34.927 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 26, 2024-09-21T07:23:34.927 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.927 INFO:teuthology.orchestra.run.smithi092.stdout: "active_gid": 14223, 2024-09-21T07:23:34.927 INFO:teuthology.orchestra.run.smithi092.stdout: "active_name": "x", 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: "active_addrs": { 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:6800", 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3526511181 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:6801", 2024-09-21T07:23:34.928 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3526511181 2024-09-21T07:23:34.929 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:34.929 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:34.929 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.929 INFO:teuthology.orchestra.run.smithi092.stdout: "active_addr": "172.21.15.92:6801/3526511181", 2024-09-21T07:23:34.929 INFO:teuthology.orchestra.run.smithi092.stdout: "active_change": "2024-09-21T07:04:13.495661+0000", 2024-09-21T07:23:34.930 INFO:teuthology.orchestra.run.smithi092.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T07:23:34.930 INFO:teuthology.orchestra.run.smithi092.stdout: "available": true, 2024-09-21T07:23:34.930 INFO:teuthology.orchestra.run.smithi092.stdout: "standbys": [ 2024-09-21T07:23:34.930 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:34.931 INFO:teuthology.orchestra.run.smithi092.stdout: "gid": 24145, 2024-09-21T07:23:34.931 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "z", 2024-09-21T07:23:34.931 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr_features": 4540719139924082687, 2024-09-21T07:23:34.931 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2024-09-21T07:23:34.931 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:34.931 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2024-09-21T07:23:34.931 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:34.932 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:34.932 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:34.932 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:34.932 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:34.932 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:34.932 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.932 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.932 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:34.932 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.933 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:34.934 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.935 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.936 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:34.936 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.936 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.936 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.936 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.936 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:34.936 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:34.936 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.936 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.936 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:34.937 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.938 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.939 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:34.939 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.939 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.939 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.939 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.939 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2024-09-21T07:23:34.939 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2024-09-21T07:23:34.939 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.939 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.939 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.940 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:34.940 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.940 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.940 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.940 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:23:34.941 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.941 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.941 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.941 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2024-09-21T07:23:34.942 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2024-09-21T07:23:34.943 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2024-09-21T07:23:34.944 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.945 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:23:34.946 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.947 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.947 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.947 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.947 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2024-09-21T07:23:34.947 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2024-09-21T07:23:34.947 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:34.947 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.947 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.947 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:34.947 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.948 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:34.949 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.950 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.950 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.950 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:34.950 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.950 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.950 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.950 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:34.950 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:34.951 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2024-09-21T07:23:34.952 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-21T07:23:34.953 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-21T07:23:34.954 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.954 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:23:34.954 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:23:34.954 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.954 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.954 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.954 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2024-09-21T07:23:34.954 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:23:34.955 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:34.955 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.955 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.955 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2024-09-21T07:23:34.955 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:34.955 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2024-09-21T07:23:34.955 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.955 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:23:34.955 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.955 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:23:34.956 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:23:34.957 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.957 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.957 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.957 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2024-09-21T07:23:34.957 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2024-09-21T07:23:34.957 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:34.957 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.957 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.957 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2024-09-21T07:23:34.957 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.958 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:34.959 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.960 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:34.961 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:34.962 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.962 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.962 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.962 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.962 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:34.962 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:34.962 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:34.962 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.963 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.963 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:34.963 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.963 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.963 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.963 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:34.964 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.964 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.964 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.964 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.964 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:34.964 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:34.965 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.965 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.965 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.965 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:34.965 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.965 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.966 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:34.966 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:34.966 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:34.966 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:34.966 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:34.966 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:34.967 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:34.967 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:34.967 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:34.967 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.967 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.968 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.968 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.968 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:34.968 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:34.968 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:34.968 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.969 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.969 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:34.969 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.969 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.969 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.970 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:34.970 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.970 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.970 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.970 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.970 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2024-09-21T07:23:34.971 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2024-09-21T07:23:34.971 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:34.971 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.972 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.973 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:34.973 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.973 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.973 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.973 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:23:34.973 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.973 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.973 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2024-09-21T07:23:34.974 INFO:teuthology.orchestra.run.smithi092.stdout: "read", 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap", 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap-read" 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:34.975 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:34.976 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:34.977 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:34.978 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.979 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:34.980 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.981 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:23:34.982 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.983 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.984 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:23:34.985 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:23:34.986 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2024-09-21T07:23:34.987 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.988 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.989 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.990 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.991 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:23:34.992 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2024-09-21T07:23:34.993 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.994 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.995 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.996 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:23:34.997 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2024-09-21T07:23:34.998 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:34.999 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.000 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nginx": { 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nginx", 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nginx container image", 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.001 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.002 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.003 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.004 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.005 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.006 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba": { 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba", 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.007 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba_metrics": { 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.008 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.010 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.011 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.012 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2024-09-21T07:23:35.013 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2024-09-21T07:23:35.014 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2024-09-21T07:23:35.015 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "grafana_dashboards_path": { 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.016 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.017 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "hw_monitoring": { 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hw_monitoring", 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.018 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.019 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.020 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.021 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.022 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.023 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.024 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.025 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.026 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2024-09-21T07:23:35.027 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.028 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.030 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2024-09-21T07:23:35.031 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "oob_default_addr": { 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "oob_default_addr", 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "169.254.1.1", 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.033 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.034 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.035 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.036 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.037 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:23:35.038 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2024-09-21T07:23:35.039 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.040 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2024-09-21T07:23:35.041 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:23:35.042 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_keepalive_interval": { 2024-09-21T07:23:35.043 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2024-09-21T07:23:35.044 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.045 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.046 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2024-09-21T07:23:35.047 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.048 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.049 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.050 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.051 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.053 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.054 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.055 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.056 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.057 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:23:35.058 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:23:35.059 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:23:35.060 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.061 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:23:35.062 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:23:35.063 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:23:35.064 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:23:35.065 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:23:35.066 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:23:35.067 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.068 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:23:35.069 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.070 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.072 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.073 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.074 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.075 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.076 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.077 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.078 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.079 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "[]", 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.081 INFO:teuthology.orchestra.run.smithi092.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "{}", 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.082 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.083 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.084 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.085 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.087 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:23:35.088 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:23:35.089 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:23:35.090 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:23:35.091 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.092 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.093 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.094 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.095 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.096 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.097 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.098 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.099 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.100 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.101 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:23:35.102 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.103 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2024-09-21T07:23:35.104 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.105 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.106 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.107 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.108 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.109 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.110 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.111 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.112 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2024-09-21T07:23:35.114 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:23:35.115 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-21T07:23:35.116 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.117 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.118 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.119 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.120 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "sso_oauth2": { 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sso_oauth2", 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.121 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.122 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.124 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.125 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.126 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.126 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.126 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-21T07:23:35.126 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.127 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.128 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.129 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.130 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.131 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.132 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2024-09-21T07:23:35.133 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2024-09-21T07:23:35.134 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2024-09-21T07:23:35.135 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2024-09-21T07:23:35.136 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:35.137 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.138 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2024-09-21T07:23:35.139 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.140 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.141 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.142 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.143 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.144 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.146 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.146 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.146 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.146 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.146 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.146 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.146 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.146 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-21T07:23:35.147 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2024-09-21T07:23:35.148 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.149 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.150 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.151 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:23:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.153 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.154 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.155 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.156 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.157 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.158 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.159 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.160 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.161 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.162 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.163 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.164 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.165 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.166 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.167 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.168 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.169 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.170 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.171 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.172 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.173 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.174 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.175 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.176 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.177 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.178 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.180 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-21T07:23:35.181 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2024-09-21T07:23:35.182 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.183 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.184 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.185 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.186 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.187 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.188 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.189 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.190 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.191 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.192 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.193 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.194 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.195 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.196 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.197 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.198 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.199 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.200 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.201 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.202 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.203 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.204 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.205 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.206 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.207 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.208 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.210 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.211 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.212 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.213 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.214 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.215 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.216 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.217 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.218 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.220 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.221 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.222 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.223 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.224 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.225 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.226 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2024-09-21T07:23:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2024-09-21T07:23:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-21T07:23:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2024-09-21T07:23:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2024-09-21T07:23:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2024-09-21T07:23:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:23:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2024-09-21T07:23:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2024-09-21T07:23:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2024-09-21T07:23:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-21T07:23:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.280 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.281 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.282 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.284 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.285 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.286 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.287 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.288 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.289 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.292 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.293 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "max_requests": { 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_requests", 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-21T07:23:35.294 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.295 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.296 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.297 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.298 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.299 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.300 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.301 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.303 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.304 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.305 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.306 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.307 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.308 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.309 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.311 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.312 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2024-09-21T07:23:35.313 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.314 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.315 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.316 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.317 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.318 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.319 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.320 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.321 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.323 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.324 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.325 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.326 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.327 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2024-09-21T07:23:35.328 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2024-09-21T07:23:35.329 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2024-09-21T07:23:35.330 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.331 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smb", 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "internal_store_backend": { 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "internal_store_backend", 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:23:35.332 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.333 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.334 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.335 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.338 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "update_orchestration": { 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "update_orchestration", 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.339 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.340 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.341 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.342 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.343 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.344 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.345 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.346 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.347 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2024-09-21T07:23:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.349 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.350 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.351 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.353 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.354 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.355 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.356 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.358 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.359 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.360 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.361 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.362 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.363 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.364 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.365 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.366 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.367 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.368 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.369 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:23:35.370 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.371 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.372 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.373 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.375 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.376 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.377 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.378 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.379 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.381 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.382 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.383 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.384 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.385 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.386 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.387 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.388 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.389 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.390 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.391 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.392 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.395 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.396 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.397 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.399 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.400 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.401 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.402 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.403 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.404 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.405 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.406 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.407 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.408 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:35.409 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.410 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.411 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.412 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.413 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.414 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.415 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.416 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.417 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.418 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.419 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.420 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.421 INFO:teuthology.orchestra.run.smithi092.stdout: "gid": 24149, 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "y", 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr_features": 4540719139924082687, 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.422 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.423 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.426 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.427 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.428 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2024-09-21T07:23:35.429 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.430 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.431 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2024-09-21T07:23:35.432 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.433 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.434 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.437 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.438 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.439 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2024-09-21T07:23:35.440 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2024-09-21T07:23:35.440 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:35.440 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.440 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.440 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.440 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-21T07:23:35.441 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-21T07:23:35.441 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.441 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.442 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:23:35.443 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:23:35.444 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:23:35.445 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:23:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.447 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.448 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.449 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.450 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.451 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.452 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.453 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "read", 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap", 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap-read" 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2024-09-21T07:23:35.454 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:35.455 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.456 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.457 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.458 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.459 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.460 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.461 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.462 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.463 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.464 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.465 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:23:35.466 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.467 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.468 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.469 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.470 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.472 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.473 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.474 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.475 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.476 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.477 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.478 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.479 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nginx": { 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nginx", 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.480 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nginx container image", 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:35.481 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2024-09-21T07:23:35.482 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.483 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.484 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.485 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba": { 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba", 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:23:35.486 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba_metrics": { 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:23:35.487 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.488 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.489 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.490 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.493 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.494 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "grafana_dashboards_path": { 2024-09-21T07:23:35.495 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.496 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.497 INFO:teuthology.orchestra.run.smithi092.stdout: "hw_monitoring": { 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hw_monitoring", 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.498 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.499 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.500 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:23:35.501 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:23:35.502 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.503 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.504 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.505 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.506 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.507 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.508 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.509 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.510 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "oob_default_addr": { 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "oob_default_addr", 2024-09-21T07:23:35.511 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "169.254.1.1", 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.512 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.513 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.514 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.515 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.516 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.517 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2024-09-21T07:23:35.518 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.519 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.520 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.521 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_keepalive_interval": { 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.522 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.523 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.524 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.525 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.526 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.527 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2024-09-21T07:23:35.528 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.529 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.530 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.532 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.534 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.535 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.536 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.537 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.538 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.539 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.540 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.541 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.542 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.543 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.544 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.545 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.546 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.547 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.548 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.549 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.550 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.551 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.552 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.553 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.554 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.555 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.556 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.557 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.558 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.559 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "[]", 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "{}", 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.562 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.563 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.564 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.565 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.566 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.567 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.568 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.570 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.571 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.572 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.573 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.575 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.576 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.577 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.578 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.579 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.580 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.582 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.583 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2024-09-21T07:23:35.584 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2024-09-21T07:23:35.585 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-21T07:23:35.586 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.587 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.588 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.589 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.590 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.592 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.593 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.594 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.595 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.596 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.597 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2024-09-21T07:23:35.598 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: "sso_oauth2": { 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sso_oauth2", 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.599 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.600 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-21T07:23:35.601 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2024-09-21T07:23:35.602 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.605 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.606 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.607 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.608 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.609 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.610 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.611 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.612 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.613 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.614 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.615 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.616 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.617 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.618 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.619 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.620 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.621 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.622 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2024-09-21T07:23:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2024-09-21T07:23:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.673 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:23:35.674 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.675 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:23:35.676 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.677 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.678 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.679 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.680 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.681 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.682 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.683 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.684 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.685 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.688 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.689 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.690 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.691 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.692 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.693 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.694 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.695 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2024-09-21T07:23:35.696 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.697 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.698 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.699 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.700 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.701 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.702 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.703 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.704 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.705 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.706 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.707 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.708 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.709 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.710 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.711 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.712 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.713 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.714 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.715 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.716 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.717 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.718 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.719 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.720 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.721 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:35.722 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.723 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2024-09-21T07:23:35.724 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.725 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.726 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.727 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.728 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.729 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.730 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.731 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.732 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.733 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.734 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.735 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2024-09-21T07:23:35.736 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2024-09-21T07:23:35.737 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.738 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.739 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.740 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.741 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.742 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.743 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.744 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.745 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.746 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.747 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.748 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.749 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.750 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-21T07:23:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.753 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.754 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.755 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.756 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.757 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.758 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.759 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.760 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.760 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.760 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.761 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.761 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.761 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.761 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.761 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.761 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2024-09-21T07:23:35.762 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.763 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.764 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.765 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.766 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.767 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.768 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.769 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.770 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "max_requests": { 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_requests", 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.771 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.772 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.773 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.774 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.775 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.776 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.777 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.778 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.779 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.781 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.783 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.784 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.785 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.786 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.787 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.788 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.789 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.790 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.791 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.792 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.793 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.794 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.795 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.796 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.797 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.798 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.799 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.800 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.801 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.802 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.803 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.804 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.805 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.806 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.807 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.808 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smb", 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "internal_store_backend": { 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "internal_store_backend", 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.809 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.810 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.811 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.812 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.813 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.814 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.815 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "update_orchestration": { 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "update_orchestration", 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.816 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2024-09-21T07:23:35.817 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2024-09-21T07:23:35.818 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.819 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.820 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.821 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.822 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.823 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.824 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.825 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.826 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.827 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.828 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.829 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.830 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.831 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.832 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.833 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.834 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.835 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.836 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.837 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:23:35.838 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2024-09-21T07:23:35.839 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.840 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.841 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.842 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.842 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.842 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.842 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.842 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.842 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.842 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.842 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.842 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.842 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.843 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.844 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.845 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.846 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.847 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.848 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.849 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.850 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.851 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.852 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.853 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.854 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.855 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.856 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.857 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.858 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.859 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.860 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.861 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.862 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.863 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.865 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.866 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.867 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.868 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.869 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.870 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.871 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.872 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.873 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.874 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.875 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.876 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.877 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.878 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.879 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.880 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.881 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.882 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.883 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.884 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.885 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2024-09-21T07:23:35.886 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.887 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.888 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.889 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.890 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.891 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.892 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.893 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.894 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.895 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.896 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.897 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: "modules": [ 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-21T07:23:35.898 INFO:teuthology.orchestra.run.smithi092.stdout: "dashboard", 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "iostat", 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "nfs", 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "restful", 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "snap_schedule" 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:35.899 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.900 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.901 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.902 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.903 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.904 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.905 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2024-09-21T07:23:35.906 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.907 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.907 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.907 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2024-09-21T07:23:35.907 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.907 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.907 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.907 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2024-09-21T07:23:35.907 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.907 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2024-09-21T07:23:35.908 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2024-09-21T07:23:35.909 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2024-09-21T07:23:35.910 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:23:35.911 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.912 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.913 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.914 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.915 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.916 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.917 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.918 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.919 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2024-09-21T07:23:35.920 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2024-09-21T07:23:35.921 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.922 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.924 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.925 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.926 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.927 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.928 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "read", 2024-09-21T07:23:35.929 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap", 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap-read" 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.930 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.931 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:35.932 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:35.933 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.934 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:35.935 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.936 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2024-09-21T07:23:35.937 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2024-09-21T07:23:35.938 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2024-09-21T07:23:35.939 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2024-09-21T07:23:35.941 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.942 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.943 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.944 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.945 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.946 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.947 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.948 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.949 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.950 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.950 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2024-09-21T07:23:35.950 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2024-09-21T07:23:35.950 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.950 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.950 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.950 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:23:35.950 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.950 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.951 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:23:35.952 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.953 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.954 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.955 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2024-09-21T07:23:35.956 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.956 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.956 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.956 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.956 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2024-09-21T07:23:35.956 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2024-09-21T07:23:35.956 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.956 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.956 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.956 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nginx": { 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nginx", 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.957 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nginx container image", 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.958 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.959 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2024-09-21T07:23:35.960 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.961 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.961 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.961 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.961 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:23:35.961 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:23:35.961 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.961 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.961 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2024-09-21T07:23:35.962 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.963 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.964 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2024-09-21T07:23:35.964 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2024-09-21T07:23:35.964 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.964 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.964 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.964 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:23:35.964 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.964 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.964 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.964 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba": { 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba", 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.965 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba_metrics": { 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.966 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:23:35.967 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.967 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.967 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.967 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:23:35.967 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.967 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.967 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.967 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.967 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2024-09-21T07:23:35.967 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.968 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.969 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.970 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.971 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.972 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.973 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.974 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.975 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.976 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "grafana_dashboards_path": { 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:23:35.977 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.978 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "hw_monitoring": { 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hw_monitoring", 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.979 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.980 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:35.981 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.982 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2024-09-21T07:23:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.984 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:35.986 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.987 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.988 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.989 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.990 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.991 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2024-09-21T07:23:35.992 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.993 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.994 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2024-09-21T07:23:35.995 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "oob_default_addr": { 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "oob_default_addr", 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "169.254.1.1", 2024-09-21T07:23:35.996 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:23:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2024-09-21T07:23:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:23:35.997 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:35.998 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:23:35.999 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.000 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.001 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.002 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.003 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.004 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.005 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:23:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.006 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.007 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:23:36.008 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.009 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_keepalive_interval": { 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.010 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.011 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.012 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.013 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.014 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.015 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2024-09-21T07:23:36.016 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.017 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.018 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.019 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.020 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2024-09-21T07:23:36.022 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2024-09-21T07:23:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:23:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.023 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.024 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2024-09-21T07:23:36.025 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2024-09-21T07:23:36.026 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.027 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.029 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:23:36.030 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.031 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.032 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.033 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.034 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.035 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.036 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.037 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:23:36.038 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:23:36.039 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.040 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.041 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.042 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.043 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.044 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.045 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.046 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:23:36.047 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:23:36.048 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.049 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.050 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.051 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "[]", 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.052 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "{}", 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.053 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.054 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.055 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:23:36.056 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.057 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.058 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.059 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.060 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.061 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.063 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.064 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.065 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.065 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.065 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.065 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.065 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.065 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.065 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:23:36.065 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:23:36.065 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.065 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:23:36.066 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.067 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.068 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.069 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.070 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.071 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.072 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.073 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.074 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.075 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:23:36.076 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.077 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.078 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.079 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.080 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.081 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.082 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.083 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.084 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.085 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.086 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.086 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.086 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.086 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.086 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.086 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.086 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.086 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.086 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.087 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.088 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.089 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.090 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.091 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-21T07:23:36.092 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.093 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.095 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.096 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.097 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "sso_oauth2": { 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sso_oauth2", 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.098 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.099 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.100 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-21T07:23:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-21T07:23:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-21T07:23:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-21T07:23:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-21T07:23:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.101 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2024-09-21T07:23:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2024-09-21T07:23:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.102 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.103 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.104 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.105 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.106 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.107 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.108 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.109 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.110 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.110 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.110 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.110 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.110 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.110 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.110 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.110 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.110 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.110 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.111 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2024-09-21T07:23:36.112 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.113 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.114 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.116 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.117 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.118 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.119 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:23:36.120 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.121 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.122 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.123 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.123 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.123 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.123 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.123 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.123 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.123 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.123 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.123 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.123 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.124 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.125 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.126 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.128 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.129 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.130 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.131 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:23:36.132 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.133 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.134 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.135 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.136 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.137 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.138 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.139 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.140 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.142 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.143 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.144 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.144 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.144 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.144 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.144 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:23:36.144 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.144 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.144 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.144 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.144 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2024-09-21T07:23:36.145 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2024-09-21T07:23:36.145 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.145 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.145 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.145 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2024-09-21T07:23:36.145 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.145 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.145 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.145 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2024-09-21T07:23:36.145 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.146 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2024-09-21T07:23:36.147 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.148 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.149 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2024-09-21T07:23:36.150 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.151 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.152 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.155 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.156 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.157 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.158 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2024-09-21T07:23:36.159 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.160 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.161 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.162 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.164 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.165 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.166 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.166 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.166 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.166 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.166 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.166 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.166 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.166 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.166 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.166 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.167 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.167 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.167 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.167 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.167 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.167 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.169 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.169 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.170 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.171 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.172 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.173 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.174 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.175 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.176 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.178 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.179 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.180 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.181 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.182 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.183 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.184 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.185 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.186 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.187 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.188 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.189 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.190 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.191 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.192 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.193 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.194 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.195 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.196 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.197 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.198 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.199 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.200 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.201 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.202 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.203 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.204 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.205 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.206 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.207 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.208 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.209 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.210 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.211 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.212 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.213 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.214 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.216 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.217 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.218 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.219 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.220 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.222 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.223 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.224 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2024-09-21T07:23:36.225 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.226 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.227 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.228 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.229 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.230 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.230 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.230 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.230 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.230 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.230 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.230 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.231 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.232 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.233 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.234 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.235 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.236 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.237 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.238 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.239 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.240 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.241 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.242 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.243 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.244 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.245 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.246 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.247 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.248 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.249 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.250 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2024-09-21T07:23:36.251 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.252 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.255 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.257 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.258 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.259 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.260 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.261 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-21T07:23:36.262 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2024-09-21T07:23:36.263 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.264 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.265 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.266 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-21T07:23:36.267 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.268 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.269 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.270 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.271 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.272 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.273 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.274 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.275 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.276 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.277 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.278 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.281 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.282 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.283 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.284 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "max_requests": { 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_requests", 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.285 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.286 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.287 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.288 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.289 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.290 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.291 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.292 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.294 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.295 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.296 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.297 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.298 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.299 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.300 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.301 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2024-09-21T07:23:36.302 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.303 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.304 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.305 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.306 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.308 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.309 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.310 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.311 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.312 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.315 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.316 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.318 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.319 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.320 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.321 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smb", 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.322 INFO:teuthology.orchestra.run.smithi092.stdout: "internal_store_backend": { 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "internal_store_backend", 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.323 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.324 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.326 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.327 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.328 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "update_orchestration": { 2024-09-21T07:23:36.329 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "update_orchestration", 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.330 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.331 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.332 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.333 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.334 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.335 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.336 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.337 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.338 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.339 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.340 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.341 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.342 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.343 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.344 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.345 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.346 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.347 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.348 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.349 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.350 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.351 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.352 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.353 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.354 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.355 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.357 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.358 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.359 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.361 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.362 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.363 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.364 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.365 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.366 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.367 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.368 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.369 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.370 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.371 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.372 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.373 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.374 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.375 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.376 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.377 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.380 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.381 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.383 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.384 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.385 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.386 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.387 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.388 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.389 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.390 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.391 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.392 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.393 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.394 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:23:36.395 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.396 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.397 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.398 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.399 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-21T07:23:36.400 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.401 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.402 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.404 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.405 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-21T07:23:36.406 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "sqlite3_killpoint": { 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "dev", 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.411 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-21T07:23:36.412 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: "services": { 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: "dashboard": "https://172.21.15.92:8443/" 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: "always_on_modules": { 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: "octopus": [ 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-21T07:23:36.413 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "pacific": [ 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-21T07:23:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "quincy": [ 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-21T07:23:36.415 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "reef": [ 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-21T07:23:36.416 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "squid": [ 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:36.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: "last_failure_osd_epoch": 5, 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: "active_clients": [ 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3437188055 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.418 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "libcephsqlite", 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3187478097 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-21T07:23:36.419 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 1733618324 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3441258076 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.420 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3593147049 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-21T07:23:36.421 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-21T07:23:36.422 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-21T07:23:36.422 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2082264883 2024-09-21T07:23:36.422 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.422 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:36.422 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:36.422 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-21T07:23:36.422 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:23:36.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 -- 172.21.15.92:0/943671418 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcc500b6680 msgr2=0x7fcc500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcc500b6680 0x7fcc500b8b90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcc58005fd0 tx=0x7fcc58005850 comp rx=0 tx=0).stop 2024-09-21T07:23:36.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 -- 172.21.15.92:0/943671418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc68108300 msgr2=0x7fcc6819a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:36.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc68108300 0x7fcc6819a890 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c005940 tx=0x7fcc5c0040e0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 -- 172.21.15.92:0/943671418 shutdown_connections 2024-09-21T07:23:36.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fcc500b6680 0x7fcc500b8b90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc68108c50 0x7fcc6819fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc68108300 0x7fcc6819a890 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 --2- 172.21.15.92:0/943671418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc681029e0 0x7fcc6819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 -- 172.21.15.92:0/943671418 >> 172.21.15.92:0/943671418 conn(0x7fcc680786b0 msgr2=0x7fcc6806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 -- 172.21.15.92:0/943671418 shutdown_connections 2024-09-21T07:23:36.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:34.921+0000 7fcc6de0a640 1 -- 172.21.15.92:0/943671418 wait complete. 2024-09-21T07:23:36.431 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T07:23:36.431 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T07:23:36.432 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:34 smithi092 ceph-mon[30987]: pgmap v662: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T07:23:36.432 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:34 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3508781896' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:23:36.432 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:34 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/223323249' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:23:36.432 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:34 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1312362956' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T07:23:36.432 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:35 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/943671418' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:23:36.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:34 smithi175 ceph-mon[34064]: pgmap v662: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T07:23:36.433 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:34 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3508781896' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:23:36.433 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:34 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/223323249' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:23:36.433 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:34 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1312362956' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T07:23:36.433 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:35 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/943671418' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:23:36.433 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:34 smithi169 ceph-mon[33705]: pgmap v662: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T07:23:36.433 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:34 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3508781896' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:23:36.433 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:34 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/223323249' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:23:36.433 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:34 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1312362956' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T07:23:36.433 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:35 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/943671418' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:23:36.690 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:37.090 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:36 smithi092 ceph-mon[30987]: pgmap v663: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T07:23:37.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:36 smithi169 ceph-mon[33705]: pgmap v663: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T07:23:37.209 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:23:37.209 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:37.209 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 733, 2024-09-21T07:23:37.209 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 735, 2024-09-21T07:23:37.209 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 195109, 2024-09-21T07:23:37.209 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 233158, 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 6, 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.065607614, 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.028587204, 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.014652130, 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.016676376, 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 733, 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.022833423, 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000031150 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:37.210 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 656, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 814, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 161312, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 565143, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 5, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 4, 2024-09-21T07:23:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.081032790, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.040961843, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.014000239, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.020544798, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 812, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.024907114, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000030673 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:23:37.212 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 356848 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 958, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 948, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1422864, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 360858, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 3, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.139222026, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.069492915, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.051843123, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.021391074, 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:37.213 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 948, 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.050442860, 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000053209 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1179936, 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 130944 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-09-21T07:23:37.214 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3558, 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.098155269, 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000027587 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.215 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 0, 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 0, 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 0, 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 0, 2024-09-21T07:23:37.216 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 1, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 0, 2024-09-21T07:23:37.217 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2024-09-21T07:23:37.218 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:23:37.219 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 0 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-09-21T07:23:37.220 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:23:37.221 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_succeeded": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_write_failed": 0 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 8, 2024-09-21T07:23:37.222 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 0, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 2, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 4196840, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 4196699, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.223 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 8 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 3, 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 3, 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 0, 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 1, 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 1, 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 0, 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 0, 2024-09-21T07:23:37.224 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 0, 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 0, 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 0, 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 0, 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 0, 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 117012, 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 316424192 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 0, 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 0, 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 0, 2024-09-21T07:23:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 0, 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 0, 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-09-21T07:23:37.226 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.227 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.228 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.229 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.230 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.230 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.230 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-09-21T07:23:37.230 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.230 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.230 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.230 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.230 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.232 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.233 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.234 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-09-21T07:23:37.235 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.236 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.237 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 2, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 4, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 2, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 3, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 0, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 0, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 2240, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:37.238 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:37.239 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:37.240 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 189423, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 51, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9832, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 199, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 8672, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 13, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:37.242 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 2111, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 21, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 3, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 2111, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2111, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.130967220, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000535749 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-09-21T07:23:37.243 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2111, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2112 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 2111, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 2111, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 0, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 1376, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 0, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 733, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 0, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 0, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-09-21T07:23:37.244 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-09-21T07:23:37.245 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-09-21T07:23:37.246 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 94, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 10, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 5, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 5, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 0, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2024-09-21T07:23:37.247 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 0 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 0, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 0, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 0, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 0, 2024-09-21T07:23:37.248 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 2343, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 1553580, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 2343, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2343, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 1553580, 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:37.249 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 2111, 2024-09-21T07:23:37.250 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 2541, 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2111, 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2541, 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:37.251 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 2111, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 2111, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2111, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2111, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:37.253 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x5561ec9a5380": { 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-21T07:23:37.254 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: "trackedop": { 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:37.255 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:23:37.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:36 smithi175 ceph-mon[34064]: pgmap v663: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T07:23:37.924 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-21T07:23:37.924 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-21T07:23:37.924 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-21T07:23:37.925 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-21T07:23:37.925 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-21T07:23:37.925 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-21T07:23:37.925 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T07:23:37.925 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T07:23:37.925 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T07:23:38.172 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:38.735 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:23:38.736 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:38.736 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 4, 2024-09-21T07:23:38.736 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 4, 2024-09-21T07:23:38.736 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 2992, 2024-09-21T07:23:38.736 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 448, 2024-09-21T07:23:38.736 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2024-09-21T07:23:38.736 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 0, 2024-09-21T07:23:38.736 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.002976286, 2024-09-21T07:23:38.736 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000038982, 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.002127926, 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3, 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.003877262, 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001292420 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.737 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1, 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 163, 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 160, 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 108944, 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 3, 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.015485903, 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.012782870, 2024-09-21T07:23:38.738 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001213996, 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 161, 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.009130808, 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000056713 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 108944 2024-09-21T07:23:38.739 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 222, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 215, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1147184, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 131904, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 2, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.042744755, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.018548810, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.034689892, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:38.740 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 214, 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.010758885, 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000050275 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1147184, 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 131904 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 0, 2024-09-21T07:23:38.741 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:38.742 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:38.743 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:38.744 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 149024, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 31, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:38.745 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 968, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 2, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:38.746 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 223, 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 1115813, 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 223, 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 223, 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 1115813, 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:38.747 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:38.748 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:23:39.054 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:38 smithi092 ceph-mon[30987]: pgmap v664: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T07:23:39.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:38 smithi169 ceph-mon[33705]: pgmap v664: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T07:23:39.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:38 smithi175 ceph-mon[34064]: pgmap v664: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T07:23:39.453 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T07:23:39.453 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T07:23:39.453 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T07:23:39.453 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T07:23:39.453 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T07:23:39.454 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T07:23:39.454 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T07:23:39.454 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T07:23:39.454 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T07:23:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:40.277 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:23:40.277 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:40.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1460, 2024-09-21T07:23:40.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 1460, 2024-09-21T07:23:40.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 439631, 2024-09-21T07:23:40.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 463457, 2024-09-21T07:23:40.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 6, 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.132417280, 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.058154497, 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.030371761, 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.034105128, 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1459, 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.040065163, 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000027460 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:40.278 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 627, 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 786, 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 154808, 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 556160, 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 5, 2024-09-21T07:23:40.279 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 4, 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.074619168, 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.035441037, 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.013655173, 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.019770314, 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 784, 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.025573261, 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000032618 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 357024 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 234, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 226, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1177756, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 132094, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 3, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.040127061, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.018441738, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.031490364, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000014110, 2024-09-21T07:23:40.281 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 225, 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.013021032, 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000057871 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1177488, 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 131776 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-21T07:23:40.282 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-09-21T07:23:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-21T07:23:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-09-21T07:23:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-21T07:23:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-21T07:23:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3473, 2024-09-21T07:23:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.083205682, 2024-09-21T07:23:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000023957 2024-09-21T07:23:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:40.283 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 0, 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 0, 2024-09-21T07:23:40.284 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 0, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 0, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 0, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 0, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 0, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 0, 2024-09-21T07:23:40.285 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 1, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:23:40.286 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 0, 2024-09-21T07:23:40.287 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:23:40.288 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 0 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-09-21T07:23:40.289 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:23:40.290 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_started": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_succeeded": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "uninline_write_failed": 0 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2024-09-21T07:23:40.291 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 4, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 0, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 2, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 4195776, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 4195385, 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-09-21T07:23:40.292 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 4 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 3, 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 3, 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 0, 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 1, 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 1, 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 0, 2024-09-21T07:23:40.293 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 0, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 0, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 0, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 0, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 0, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 0, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 117168, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 316424192 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 0, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 0, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 0, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 0, 2024-09-21T07:23:40.294 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 0, 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.296 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.297 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.298 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.299 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.299 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-09-21T07:23:40.299 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.299 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.299 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.300 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-09-21T07:23:40.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.302 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.303 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.304 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-09-21T07:23:40.305 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-09-21T07:23:40.306 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 2, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 2, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 0, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 2, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 0, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 0, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 1700, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:40.307 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:40.308 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:40.309 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 189383, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 50, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:40.310 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:40.311 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:40.311 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9832, 2024-09-21T07:23:40.311 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 199, 2024-09-21T07:23:40.311 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:40.311 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:40.311 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:40.311 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-21T07:23:40.311 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 8672, 2024-09-21T07:23:40.311 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 13, 2024-09-21T07:23:40.312 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:40.312 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-21T07:23:40.312 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:40.312 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-21T07:23:40.312 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.313 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-09-21T07:23:40.313 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-09-21T07:23:40.313 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-09-21T07:23:40.313 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 2083, 2024-09-21T07:23:40.313 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 21, 2024-09-21T07:23:40.313 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 3, 2024-09-21T07:23:40.313 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 2083, 2024-09-21T07:23:40.313 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-09-21T07:23:40.314 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2083, 2024-09-21T07:23:40.314 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.390959706, 2024-09-21T07:23:40.314 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000667767 2024-09-21T07:23:40.314 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.314 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-09-21T07:23:40.314 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-09-21T07:23:40.314 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2083, 2024-09-21T07:23:40.314 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2084 2024-09-21T07:23:40.315 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.315 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 2083, 2024-09-21T07:23:40.315 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 2083, 2024-09-21T07:23:40.315 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 0, 2024-09-21T07:23:40.315 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-09-21T07:23:40.315 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-09-21T07:23:40.315 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 1349, 2024-09-21T07:23:40.315 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 0, 2024-09-21T07:23:40.315 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 732, 2024-09-21T07:23:40.315 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-09-21T07:23:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-09-21T07:23:40.317 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 94, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 10, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 5, 2024-09-21T07:23:40.318 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 5, 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 0, 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 0 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 0, 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-09-21T07:23:40.319 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 0, 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 0, 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 0, 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:40.320 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 2317, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 1548726, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 2317, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2317, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 1548726, 2024-09-21T07:23:40.321 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:40.322 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 2083, 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 1477, 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2083, 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 1477, 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:40.323 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 2083, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 2083, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2083, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2083, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:23:40.324 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.325 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x55d0cf6d1520": { 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2024-09-21T07:23:40.326 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2024-09-21T07:23:40.327 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:40.327 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:40.327 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:40.327 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:40.327 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:40.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:40.327 INFO:teuthology.orchestra.run.smithi092.stdout: "trackedop": { 2024-09-21T07:23:40.327 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2024-09-21T07:23:40.327 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:40.327 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:23:41.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:40 smithi092 ceph-mon[30987]: pgmap v665: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T07:23:41.120 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-21T07:23:41.120 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-21T07:23:41.120 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-21T07:23:41.120 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-21T07:23:41.120 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-21T07:23:41.120 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-21T07:23:41.121 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T07:23:41.121 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T07:23:41.121 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T07:23:41.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:40 smithi169 ceph-mon[33705]: pgmap v665: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T07:23:41.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:40 smithi175 ceph-mon[34064]: pgmap v665: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T07:23:41.369 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:41.873 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-21T07:23:41.873 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:41.873 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 0, 2024-09-21T07:23:41.873 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2, 2024-09-21T07:23:41.873 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 0, 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 0, 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 0, 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.001078377, 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.000254956, 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:41.874 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 5, 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 166, 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 3152, 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 109568, 2024-09-21T07:23:41.875 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 3, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.019352498, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.014048444, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.003765221, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 165, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.012766028, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000077369 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:41.876 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 109568 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 223, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 216, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1147456, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 132544, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 2, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.044388543, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.018666849, 2024-09-21T07:23:41.877 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.036313124, 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 215, 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.011413991, 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000053088 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1147456, 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 132544 2024-09-21T07:23:41.878 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 0, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:41.879 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:41.880 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:41.881 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 148967, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 29, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:41.882 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 968, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 2, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-21T07:23:41.883 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 224, 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 1115943, 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 224, 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 224, 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 1115943, 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-21T07:23:41.884 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-21T07:23:42.678 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T07:23:42.678 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T07:23:42.679 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T07:23:42.679 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T07:23:42.679 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T07:23:42.679 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T07:23:42.679 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T07:23:42.679 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T07:23:42.679 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T07:23:42.946 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:23:43.064 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:42 smithi169 ceph-mon[33705]: pgmap v666: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T07:23:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:42 smithi092 ceph-mon[30987]: pgmap v666: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T07:23:43.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:42 smithi175 ceph-mon[34064]: pgmap v666: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T07:23:43.603 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-21T07:23:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 307, 2024-09-21T07:23:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 321, 2024-09-21T07:23:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1209890, 2024-09-21T07:23:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 229581, 2024-09-21T07:23:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 15, 2024-09-21T07:23:43.603 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.058639144, 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.022813878, 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.043406311, 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000548337, 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 320, 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.027753208, 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000086728 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 54, 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000011787, 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000218 2024-09-21T07:23:43.604 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1202528, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 137312 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 55, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 215, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 11959, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 697313, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 33, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 8, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.027576693, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.012122708, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.012486284, 2024-09-21T07:23:43.605 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000576915, 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 213, 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.026065744, 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000122374 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 47, 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000005362, 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000114 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 3536, 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 363504 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.606 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 561, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 635, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 169005, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 363104, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 9, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 5, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.079431717, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.036508058, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.037379830, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.005314934, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 634, 2024-09-21T07:23:43.607 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.045008409, 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000070991 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1129, 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000298626, 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000264 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 6528, 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 11760 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-21T07:23:43.608 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 51, 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.002334843, 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000045781 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2, 2024-09-21T07:23:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000023560, 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000011780 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 10, 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 7, 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 7, 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.001569878, 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000224268 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 3, 2024-09-21T07:23:43.610 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 11, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 16, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 0, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 16, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 13, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 4, 2024-09-21T07:23:43.611 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 2, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 2, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 3, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 31, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 26, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 4, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-21T07:23:43.612 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 4, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 234, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 6, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:23:43.613 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 5, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 5, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-21T07:23:43.614 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 14, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 9, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 10, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-21T07:23:43.615 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 4, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 27, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_started": 0, 2024-09-21T07:23:43.616 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_succeeded": 0, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_write_failed": 0 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 8, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 8, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 2, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-21T07:23:43.617 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 2, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 2, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4194304, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 4196840, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 0, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 7, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.013408755, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001915536 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 0 2024-09-21T07:23:43.618 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 20, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 22, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 2, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 19, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 23, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 4, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 16, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 20, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 4, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 2, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 5, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 3, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 119004, 2024-09-21T07:23:43.619 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 325857280 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 10, 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 10, 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 25, 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-21T07:23:43.620 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 5, 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.001112786, 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000222557 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.621 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2, 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000457092, 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000228546 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.622 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.623 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-21T07:23:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-21T07:23:43.624 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-21T07:23:43.625 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.626 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.627 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-21T07:23:43.628 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-21T07:23:43.629 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.630 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 2, 2024-09-21T07:23:43.631 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 4, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 2, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 2, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 5, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 1, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 600, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:43.632 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:43.633 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:43.634 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 246663, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 85, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 9832, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 199, 2024-09-21T07:23:43.635 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 84089, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 371, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-21T07:23:43.636 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 48, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 13284, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 33, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 48, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 48, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.241994603, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.005041554 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 48, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 73 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.637 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 48, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 0, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 48, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 0, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 10, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 0, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 7, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 9, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-21T07:23:43.638 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 6, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 20, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:23:43.639 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-21T07:23:43.640 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 94, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 10, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 8, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 8, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 19, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 0, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 2 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.641 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 1, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.642 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 919, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1290248, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 919, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 919, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1290248, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.643 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 48, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 13284, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 48, 2024-09-21T07:23:43.644 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 13284, 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:43.645 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 48, 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 48, 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 48, 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 48, 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.646 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.647 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x556879baf450": { 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 8, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 2536, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 8, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 7, 2024-09-21T07:23:43.648 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 2536, 2024-09-21T07:23:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "trackedop": { 2024-09-21T07:23:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 31 2024-09-21T07:23:43.649 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:43.649 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-21T07:23:44.649 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-21T07:23:44.649 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-21T07:23:44.649 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-09-21T07:23:44.650 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=14 2024-09-21T07:23:44.650 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T07:23:44.650 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-21T07:23:44.650 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T07:23:44.650 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T07:23:44.650 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T07:23:44.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:44 smithi169 ceph-mon[33705]: pgmap v667: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T07:23:44.899 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:23:45.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:44 smithi175 ceph-mon[34064]: pgmap v667: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T07:23:45.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:44 smithi092 ceph-mon[30987]: pgmap v667: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T07:23:45.517 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-21T07:23:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1557, 2024-09-21T07:23:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1559, 2024-09-21T07:23:45.517 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1262845, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 495136, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 6, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 2, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.182677737, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.088423496, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.037313292, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.043786767, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1557, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.051283994, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000032937 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:45.518 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 244, 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 236, 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1181000, 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 136634, 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-21T07:23:45.519 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.047500149, 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.020653113, 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.039444600, 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000113237, 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 235, 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.019194294, 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000081677 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1179344, 2024-09-21T07:23:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 135296 2024-09-21T07:23:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.521 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 737, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 898, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 183295, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 594233, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.094931148, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.043199722, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.018215222, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.025244338, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 897, 2024-09-21T07:23:45.522 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.035870013, 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000039988 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 361456 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-21T07:23:45.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3827, 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.110954425, 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000028992 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.524 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-21T07:23:45.525 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 29, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 10, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 19, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 9, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 2, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-21T07:23:45.526 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:23:45.527 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 4, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 234, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 6, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:23:45.528 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-21T07:23:45.529 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:23:45.530 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_started": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_succeeded": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_write_failed": 0 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-21T07:23:45.531 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 220, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 2, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 22, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4952327, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 4996020, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 4995884, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.532 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 220 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 20, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 23, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 3, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 12, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 12, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 0, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 29, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 29, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 0, 2024-09-21T07:23:45.533 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 117832, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 316420096 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.534 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-21T07:23:45.535 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.536 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.537 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.538 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-21T07:23:45.539 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.540 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.541 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.542 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-21T07:23:45.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:23:45.544 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 2, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 5, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 3, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 3, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 2269, 2024-09-21T07:23:45.545 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:45.546 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:45.547 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 189423, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 51, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:45.548 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 9832, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 199, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 101812, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 691, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:45.549 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 2293, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 26, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 4, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 2293, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2293, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.161974206, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000506748 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.550 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2293, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2294 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 2293, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 2293, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 1462, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 828, 2024-09-21T07:23:45.551 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 2, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-21T07:23:45.552 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-21T07:23:45.553 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 94, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 10, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 5, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 5, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-21T07:23:45.554 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-21T07:23:45.555 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 2534, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 2383783, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 2534, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2534, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 2383783, 2024-09-21T07:23:45.556 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2293, 2024-09-21T07:23:45.557 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 801726, 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2293, 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 801726, 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:45.558 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2293, 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 2293, 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2293, 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 2293, 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:23:45.559 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.560 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x562589909520": { 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:45.561 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: "trackedop": { 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:45.562 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-21T07:23:46.217 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T07:23:46.217 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T07:23:46.218 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T07:23:46.218 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T07:23:46.218 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-09-21T07:23:46.218 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-21T07:23:46.218 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T07:23:46.218 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T07:23:46.218 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T07:23:46.465 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:23:46.971 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-21T07:23:46.971 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:46.971 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 737, 2024-09-21T07:23:46.971 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 738, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 249225, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 233861, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 6, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 2, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.111222197, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.050947251, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.023717098, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.027195417, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 737, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.045949077, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000062346 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.972 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 2656, 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1603, 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1595, 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1527850, 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 568459, 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-21T07:23:46.973 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.178753739, 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.078403697, 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.064294722, 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.038470201, 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1594, 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.075581819, 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000047416 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.974 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1178304, 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 133696 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 4, 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 165, 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1508, 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 359989, 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 4, 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.013201787, 2024-09-21T07:23:46.975 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.009535238, 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.001896768, 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000146177, 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 163, 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.011734849, 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000071992 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:23:46.976 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 359024 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3569, 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.109621243, 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000030714 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:46.977 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-21T07:23:46.978 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 0, 2024-09-21T07:23:46.979 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 1, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-21T07:23:46.980 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-21T07:23:46.981 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:23:46.982 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-21T07:23:46.983 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_started": 0, 2024-09-21T07:23:46.984 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_succeeded": 0, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_write_failed": 0 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 4, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 2, 2024-09-21T07:23:46.985 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 2, 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4194304, 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 4195776, 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 4195385, 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 4 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.986 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 3, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 3, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 0, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 1, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 1, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 0, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 0, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 0, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 0, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 116996, 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 316416000 2024-09-21T07:23:46.987 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.988 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.989 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.990 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.991 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.992 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.992 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-21T07:23:46.992 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.992 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.992 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.992 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.993 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.994 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-21T07:23:46.995 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-21T07:23:46.996 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.997 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.998 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 2, 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 2, 2024-09-21T07:23:46.999 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 0, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 2, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 1718, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:47.000 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:47.001 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:47.002 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 197463, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 54, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 9832, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 199, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:47.003 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 8672, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 13, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-21T07:23:47.004 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 2104, 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 21, 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 3, 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 2104, 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2104, 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.127974958, 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000536109 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2104, 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2105 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.005 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 2104, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 2104, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 1363, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 739, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-21T07:23:47.006 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 1, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-21T07:23:47.007 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-21T07:23:47.008 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 94, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 10, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 6, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 6, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.009 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-21T07:23:47.010 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 2341, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1553134, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 2341, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2341, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1553134, 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:47.011 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2104, 2024-09-21T07:23:47.012 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 1477, 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2104, 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1477, 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:47.013 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2104, 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 2104, 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2104, 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 2104, 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:23:47.014 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:47.015 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x55c73f7c9450": { 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-21T07:23:47.016 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-21T07:23:47.017 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:47.017 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:47.017 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:47.017 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:47.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:47.017 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:47.017 INFO:teuthology.orchestra.run.smithi169.stdout: "trackedop": { 2024-09-21T07:23:47.017 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-21T07:23:47.017 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:47.017 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-21T07:23:47.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:46 smithi169 ceph-mon[33705]: pgmap v668: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:23:47.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:46 smithi175 ceph-mon[34064]: pgmap v668: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:23:47.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:46 smithi092 ceph-mon[30987]: pgmap v668: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:23:47.668 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T07:23:47.668 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T07:23:47.668 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-21T07:23:47.668 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-21T07:23:47.668 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-21T07:23:47.668 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-21T07:23:47.668 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T07:23:47.668 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T07:23:47.669 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T07:23:47.916 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:23:48.478 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-21T07:23:48.478 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:48.478 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 976, 2024-09-21T07:23:48.478 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 968, 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1426624, 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 370468, 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 1, 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.145783824, 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.067004481, 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.061413513, 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.023989357, 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 967, 2024-09-21T07:23:48.479 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.041865150, 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000043293 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1180000, 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 137056 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.480 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 7, 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 170, 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 3708, 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 362506, 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.015197718, 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.009901565, 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.003642464, 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000056790, 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:48.481 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 169, 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.016190066, 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000095799 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 361808 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1405, 2024-09-21T07:23:48.482 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1407, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 359632, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 446797, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.116906988, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.048923420, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.025450598, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.036381244, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1405, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.053059806, 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000037764 2024-09-21T07:23:48.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-21T07:23:48.484 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3608, 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.096457325, 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000026734 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-21T07:23:48.486 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 1, 2024-09-21T07:23:48.487 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-21T07:23:48.488 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-21T07:23:48.489 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:23:48.490 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:23:48.490 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:23:48.490 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:23:48.490 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:23:48.490 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:23:48.490 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-21T07:23:48.490 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:23:48.490 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-21T07:23:48.490 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-21T07:23:48.491 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-21T07:23:48.492 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_started": 0, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_succeeded": 0, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "uninline_write_failed": 0 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 5, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-21T07:23:48.493 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 2, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 2, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4194304, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 4195917, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 4195424, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.494 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 5 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 3, 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 3, 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 0, 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 1, 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 1, 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 0, 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 0, 2024-09-21T07:23:48.495 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 0, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 0, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 118088, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 316420096 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-21T07:23:48.496 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.497 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.498 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.500 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-21T07:23:48.501 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.502 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.503 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.504 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.505 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.506 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:23:48.507 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 2, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 1, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 1, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 1721, 2024-09-21T07:23:48.508 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:48.509 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:48.510 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 181303, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 46, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-21T07:23:48.511 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 9832, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 199, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 8672, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 13, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-21T07:23:48.512 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 2141, 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 21, 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 3, 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 2141, 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2141, 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.347970066, 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000629598 2024-09-21T07:23:48.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2141, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 2142 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 2141, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 2141, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 1398, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 741, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-21T07:23:48.514 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 1, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-21T07:23:48.515 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-21T07:23:48.516 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 94, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 10, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 4, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 4, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 0, 2024-09-21T07:23:48.517 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-21T07:23:48.518 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 2384, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1559997, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 2384, 2024-09-21T07:23:48.519 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2384, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1559997, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:48.520 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2141, 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 1618, 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2141, 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1618, 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-21T07:23:48.521 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 2141, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 2141, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2141, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 2141, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.522 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-21T07:23:48.523 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x5591baab96c0": { 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-21T07:23:48.524 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout: "trackedop": { 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-21T07:23:48.525 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-21T07:23:49.141 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:48 smithi169 ceph-mon[33705]: pgmap v669: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:23:49.170 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-21T07:23:49.170 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-21T07:23:49.170 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-21T07:23:49.170 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-21T07:23:49.171 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-21T07:23:49.171 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-21T07:23:49.171 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T07:23:49.171 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T07:23:49.171 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T07:23:49.200 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:48 smithi175 ceph-mon[34064]: pgmap v669: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:23:49.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:48 smithi092 ceph-mon[30987]: pgmap v669: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:23:49.430 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:23:49.968 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 834, 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 869, 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1360003, 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 784739, 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 35, 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.145806125, 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.063092674, 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.089721153, 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.004310861, 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:49.969 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 869, 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.062118994, 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000071483 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1104, 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000261149, 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000236 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1193824, 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 139744 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:49.970 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 23, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 199, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 4689, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 424881, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 12, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.018692642, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.011196962, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.005329357, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000282014, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 197, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.021169079, 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000107457 2024-09-21T07:23:49.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 36, 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000010278, 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000285 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 360848 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 29, 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 45, 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 6919, 2024-09-21T07:23:49.972 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 39026, 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 9, 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.006949470, 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.001666088, 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.004523757, 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000556932, 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 43, 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.021970111, 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000510932 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:49.973 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 32, 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000007859, 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000245 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 5152 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T07:23:49.974 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 49, 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001612017, 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000032898 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000028493, 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000014246 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:49.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-21T07:23:49.976 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 16, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 16, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 13, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 4, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 3, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 17, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 13, 2024-09-21T07:23:49.977 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 4, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:23:49.978 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:23:49.979 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 14, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 9, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 10, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-21T07:23:49.980 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 4, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 27, 2024-09-21T07:23:49.981 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_started": 0, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_succeeded": 0, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_write_failed": 0 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 4, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-21T07:23:49.982 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 4, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 2, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4195776, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-21T07:23:49.983 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.005037946, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001679315 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 20, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 22, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 2, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 19, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 23, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 4, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 16, 2024-09-21T07:23:49.984 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 20, 2024-09-21T07:23:49.985 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 4, 2024-09-21T07:23:49.985 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-09-21T07:23:49.985 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-09-21T07:23:49.985 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-09-21T07:23:49.985 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 121752, 2024-09-21T07:23:49.985 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 325861376 2024-09-21T07:23:49.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.985 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-21T07:23:49.985 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 17, 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.989 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.990 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.990 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-21T07:23:49.990 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.990 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.990 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.991 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.992 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.994 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.995 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.996 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 2, 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 0, 2024-09-21T07:23:49.997 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 611, 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:49.998 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:49.999 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 246439, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 83, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-21T07:23:50.001 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 9832, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 199, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 83377, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 358, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:50.002 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 39, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 11774, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 30, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 39, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 39, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.236995977, 2024-09-21T07:23:50.003 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.006076819 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 39, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 61 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 39, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 0, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 39, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-09-21T07:23:50.004 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 0, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 3, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 7, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 6, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 0, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-09-21T07:23:50.005 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-21T07:23:50.006 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 94, 2024-09-21T07:23:50.007 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 10, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 9, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 9, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 14, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 1 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:23:50.008 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:50.009 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:50.010 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T07:23:50.010 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:50.010 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 882, 2024-09-21T07:23:50.010 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1275358, 2024-09-21T07:23:50.010 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:50.010 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 882, 2024-09-21T07:23:50.010 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:50.011 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:50.011 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 882, 2024-09-21T07:23:50.011 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1275358, 2024-09-21T07:23:50.011 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:50.011 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:50.011 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:50.011 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:50.011 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:50.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.012 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-21T07:23:50.012 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:50.012 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T07:23:50.012 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:50.012 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:50.012 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:50.012 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:50.012 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:50.013 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 39, 2024-09-21T07:23:50.013 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 11774, 2024-09-21T07:23:50.013 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 39, 2024-09-21T07:23:50.013 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 11774, 2024-09-21T07:23:50.013 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:50.013 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:50.013 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:50.013 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:50.014 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:50.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.014 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-21T07:23:50.014 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:50.014 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-21T07:23:50.014 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:50.014 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:50.014 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:50.015 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:50.015 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:50.015 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 39, 2024-09-21T07:23:50.015 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 39, 2024-09-21T07:23:50.015 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 39, 2024-09-21T07:23:50.015 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 39, 2024-09-21T07:23:50.015 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:50.016 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:50.016 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:50.016 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:50.016 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:50.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.016 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:23:50.016 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:50.016 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T07:23:50.017 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:50.017 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:50.017 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:50.017 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:50.017 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:50.017 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:50.017 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:50.017 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-21T07:23:50.018 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-21T07:23:50.018 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:50.018 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:50.018 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:50.018 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:50.018 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:50.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.018 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x557f826a3450": { 2024-09-21T07:23:50.018 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:50.019 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T07:23:50.019 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:50.019 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 4, 2024-09-21T07:23:50.019 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1472, 2024-09-21T07:23:50.019 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:50.019 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 4, 2024-09-21T07:23:50.019 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3, 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1472, 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 31 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:50.020 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-21T07:23:50.892 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T07:23:50.892 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T07:23:50.892 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-21T07:23:50.892 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=14 2024-09-21T07:23:50.892 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-21T07:23:50.892 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-21T07:23:50.892 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T07:23:50.892 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T07:23:50.893 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T07:23:51.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:50 smithi169 ceph-mon[33705]: pgmap v670: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:23:51.183 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:23:51.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:50 smithi175 ceph-mon[34064]: pgmap v670: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:23:51.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:50 smithi092 ceph-mon[30987]: pgmap v670: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:23:51.694 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-21T07:23:51.694 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:51.694 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 320, 2024-09-21T07:23:51.694 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 332, 2024-09-21T07:23:51.694 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1219239, 2024-09-21T07:23:51.694 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 209616, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 13, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.061136262, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.023835627, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.045245661, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.001376009, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 330, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.028144091, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000085285 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 62, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000023935, 2024-09-21T07:23:51.695 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000386 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1212128, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 142464 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 549, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 754, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 162503, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 575529, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 7, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.097118794, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.054636773, 2024-09-21T07:23:51.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.037268904, 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.004462885, 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 754, 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.053527429, 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000070991 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1097, 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000276562, 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000252 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 362672 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.697 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 46, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 48, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 8741, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 382952, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 36, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.018147916, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.001729215, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.014743804, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000614184, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 46, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.019471651, 2024-09-21T07:23:51.698 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000423296 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 30, 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000002727, 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000090 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-21T07:23:51.699 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 51, 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001914846, 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000037546 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000020417, 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000010208 2024-09-21T07:23:51.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 4, 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 3, 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001860884, 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000620294 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 1, 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-21T07:23:51.701 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 16, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 16, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 13, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 4, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 2, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 2, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 3, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 24, 2024-09-21T07:23:51.702 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 17, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 6, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:23:51.703 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:23:51.704 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 2, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 2, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 1 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 14, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 9, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 10, 2024-09-21T07:23:51.705 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 4, 2024-09-21T07:23:51.706 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 27, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_started": 0, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_succeeded": 0, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_write_failed": 0 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 5, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-21T07:23:51.707 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 5, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 2, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4195917, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-21T07:23:51.708 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.006981719, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001745429 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 20, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 22, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 2, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 19, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 22, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 3, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 16, 2024-09-21T07:23:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 20, 2024-09-21T07:23:51.710 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 4, 2024-09-21T07:23:51.710 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 2, 2024-09-21T07:23:51.710 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 3, 2024-09-21T07:23:51.710 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 1, 2024-09-21T07:23:51.710 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 119164, 2024-09-21T07:23:51.710 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 325857280 2024-09-21T07:23:51.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.710 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-21T07:23:51.711 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 8, 2024-09-21T07:23:51.711 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-21T07:23:51.711 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 4, 2024-09-21T07:23:51.711 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 13, 2024-09-21T07:23:51.711 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 1, 2024-09-21T07:23:51.711 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-21T07:23:51.711 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.712 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.712 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.712 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-21T07:23:51.712 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2024-09-21T07:23:51.712 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001860884, 2024-09-21T07:23:51.712 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000620294 2024-09-21T07:23:51.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.713 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-21T07:23:51.713 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.713 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.713 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.714 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-21T07:23:51.714 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.714 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.714 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.714 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-21T07:23:51.714 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.715 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.715 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.715 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-21T07:23:51.715 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.715 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.715 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.716 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-21T07:23:51.716 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.716 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.716 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.717 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-21T07:23:51.717 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.717 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.717 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.717 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-21T07:23:51.718 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.718 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.718 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.718 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-21T07:23:51.718 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.719 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.719 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.719 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-21T07:23:51.719 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.719 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.720 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.721 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-21T07:23:51.721 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.721 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.721 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.721 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-21T07:23:51.722 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.722 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.722 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.722 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-21T07:23:51.723 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.723 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.723 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.723 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-21T07:23:51.723 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.724 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.724 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.724 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-21T07:23:51.724 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.724 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.725 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.725 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-21T07:23:51.725 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.725 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.726 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.726 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-21T07:23:51.726 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.726 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.726 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.727 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-21T07:23:51.727 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.727 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.727 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.728 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-21T07:23:51.728 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.728 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.728 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.728 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-21T07:23:51.728 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.729 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.729 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.729 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-21T07:23:51.729 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.729 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.729 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.730 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-21T07:23:51.730 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.730 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.730 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.730 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-21T07:23:51.731 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.731 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.731 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.731 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-21T07:23:51.731 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.732 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.732 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.732 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-21T07:23:51.732 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.732 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.733 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.733 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-21T07:23:51.733 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.733 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.733 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.734 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-21T07:23:51.734 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.734 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.734 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.734 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:23:51.735 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-21T07:23:51.736 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.736 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.736 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:51.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.736 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-21T07:23:51.736 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-09-21T07:23:51.737 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 2, 2024-09-21T07:23:51.737 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2024-09-21T07:23:51.737 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-09-21T07:23:51.737 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-21T07:23:51.737 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 2, 2024-09-21T07:23:51.737 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 2, 2024-09-21T07:23:51.737 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 630, 2024-09-21T07:23:51.738 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-21T07:23:51.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.738 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-21T07:23:51.738 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:51.738 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:51.738 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:51.739 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:51.740 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:51.741 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:51.741 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:51.741 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:51.741 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:51.741 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:51.741 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:51.742 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:51.743 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:51.743 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-21T07:23:51.743 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:51.743 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:51.743 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:51.744 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:51.744 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 246311, 2024-09-21T07:23:51.744 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 80, 2024-09-21T07:23:51.744 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:51.744 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:51.744 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-21T07:23:51.745 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-21T07:23:51.745 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:51.745 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:51.745 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:51.745 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:51.745 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 9832, 2024-09-21T07:23:51.746 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 199, 2024-09-21T07:23:51.746 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:51.746 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:51.746 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:51.746 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-21T07:23:51.746 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 84097, 2024-09-21T07:23:51.747 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 372, 2024-09-21T07:23:51.747 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:51.747 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-21T07:23:51.747 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:51.747 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-21T07:23:51.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.748 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-21T07:23:51.748 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-21T07:23:51.748 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-21T07:23:51.748 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 41, 2024-09-21T07:23:51.748 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 12070, 2024-09-21T07:23:51.748 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2024-09-21T07:23:51.749 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 41, 2024-09-21T07:23:51.749 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-21T07:23:51.749 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 41, 2024-09-21T07:23:51.749 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.231996091, 2024-09-21T07:23:51.749 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005658441 2024-09-21T07:23:51.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.750 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-21T07:23:51.750 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-21T07:23:51.750 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 41, 2024-09-21T07:23:51.750 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 64 2024-09-21T07:23:51.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.750 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 41, 2024-09-21T07:23:51.750 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 0, 2024-09-21T07:23:51.751 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 41, 2024-09-21T07:23:51.751 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-21T07:23:51.751 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-21T07:23:51.751 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-09-21T07:23:51.751 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-09-21T07:23:51.751 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 0, 2024-09-21T07:23:51.751 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 4, 2024-09-21T07:23:51.751 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 7, 2024-09-21T07:23:51.751 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-21T07:23:51.753 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-21T07:23:51.753 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-21T07:23:51.754 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-21T07:23:51.754 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 6, 2024-09-21T07:23:51.754 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-21T07:23:51.754 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-21T07:23:51.754 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-21T07:23:51.754 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 0, 2024-09-21T07:23:51.754 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-09-21T07:23:51.754 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:23:51.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-21T07:23:51.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:23:51.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-21T07:23:51.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-21T07:23:51.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-21T07:23:51.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:23:51.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-21T07:23:51.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:23:51.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-21T07:23:51.756 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 94, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 10, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 9, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 9, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 16, 2024-09-21T07:23:51.757 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 1 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-21T07:23:51.758 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 911, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1291185, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 911, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 911, 2024-09-21T07:23:51.759 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1291185, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 41, 2024-09-21T07:23:51.760 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 12070, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 41, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 12070, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:51.761 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 41, 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 41, 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 41, 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 41, 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:51.762 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.763 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x5571d939b450": { 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 5, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1613, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 5, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:51.764 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4, 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1613, 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 31 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:51.765 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-21T07:23:52.509 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T07:23:52.509 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T07:23:52.509 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-21T07:23:52.509 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=14 2024-09-21T07:23:52.509 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-21T07:23:52.509 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-21T07:23:52.509 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T07:23:52.509 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T07:23:52.510 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T07:23:52.755 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:23:53.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:52 smithi169 ceph-mon[33705]: pgmap v671: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:23:53.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:52 smithi175 ceph-mon[34064]: pgmap v671: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:23:53.303 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-21T07:23:53.303 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:53.303 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 3770, 2024-09-21T07:23:53.303 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2578, 2024-09-21T07:23:53.304 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1406411, 2024-09-21T07:23:53.304 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1994012, 2024-09-21T07:23:53.304 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 32, 2024-09-21T07:23:53.304 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 8, 2024-09-21T07:23:53.304 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.458470140, 2024-09-21T07:23:53.304 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.153028520, 2024-09-21T07:23:53.304 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.162638091, 2024-09-21T07:23:53.304 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.129810969, 2024-09-21T07:23:53.304 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2570, 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.963075664, 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000374737 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3106, 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000647517, 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000208 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 360656, 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 119120 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.305 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 2362, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2291, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1933266, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1077905, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 24, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.246455884, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.104180075, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.121231753, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.040145685, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2294, 2024-09-21T07:23:53.306 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.181753681, 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000079230 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1106, 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000278853, 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000252 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1227968, 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 159424 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 2661, 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2641, 2024-09-21T07:23:53.307 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 904256, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 3007891, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 152, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 8, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.324401522, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.132635876, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.155048904, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.043931614, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2642, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.422404254, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000159880 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:53.308 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2457, 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000561506, 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000228 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 40800, 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 381392 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T07:23:53.309 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 775, 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.196117542, 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000253054 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2876, 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.093584459, 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000032539 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.310 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 183, 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 183, 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 183, 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 26.120305934, 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.142733912 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 123, 2024-09-21T07:23:53.311 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 36, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 9, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 27, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 17, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 3, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 3, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 2, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 349, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 322, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-09-21T07:23:53.312 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 167, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-09-21T07:23:53.313 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 167, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 107, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 14, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 93, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 60, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 39, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 76, 2024-09-21T07:23:53.314 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 104, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 60, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 5, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 32 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 20, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-09-21T07:23:53.315 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 40, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 2, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 5, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 3, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 4, 2024-09-21T07:23:53.316 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 54, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 14, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_started": 0, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_succeeded": 0, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_write_failed": 0 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 220, 2024-09-21T07:23:53.317 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 173, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 173, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 47, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 5, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 22, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 21, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 21, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 1, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 1, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 1, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4952327, 2024-09-21T07:23:53.318 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4996020, 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 186, 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.425529280, 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002287791 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 28, 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 45, 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 17, 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 20, 2024-09-21T07:23:53.319 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 20, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 0, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 36, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 39, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 3, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 3, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 21, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 18, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 126456, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 338440192 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 245, 2024-09-21T07:23:53.320 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 1, 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 183, 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 31, 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 2, 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 7, 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.010891559, 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001555937 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 108, 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.020689274, 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000191567 2024-09-21T07:23:53.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 14, 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.009142737, 2024-09-21T07:23:53.322 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000653052 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-21T07:23:53.323 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.325 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-21T07:23:53.325 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 10, 2024-09-21T07:23:53.325 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001295688, 2024-09-21T07:23:53.325 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000129568 2024-09-21T07:23:53.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 8, 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.014507461, 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001813432 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.326 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 10, 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.053822631, 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005382263 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001644930, 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000822465 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.327 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.002214356, 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001107178 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-21T07:23:53.328 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.019536504, 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.009768252 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4, 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.019223582, 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.004805895 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.329 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001321493, 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000660746 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.330 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-21T07:23:53.331 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 11, 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.027455711, 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002495973 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2024-09-21T07:23:53.332 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 25.938560008, 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 8.646186669 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-21T07:23:53.333 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 5, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 3, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 27, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 13, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 611, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:53.334 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:53.335 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:53.336 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 319321, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 116, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-21T07:23:53.337 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 9832, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 199, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 140804, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 1211, 2024-09-21T07:23:53.338 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 4272, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 1053442, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 37, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 4272, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4272, 2024-09-21T07:23:53.339 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 40.413324551, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.009460047 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4272, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 4600 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 4272, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 198, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 4074, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 103, 2024-09-21T07:23:53.340 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 40, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 17, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 189, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 70, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 3587, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 181, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 73, 2024-09-21T07:23:53.341 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-21T07:23:53.342 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 94, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-21T07:23:53.343 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 18, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 314, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 26 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-21T07:23:53.344 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 2561, 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 1, 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 3075, 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 3, 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:53.345 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 8789, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 3391643, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 8789, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 8789, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3391643, 2024-09-21T07:23:53.346 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:53.347 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 4272, 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 1053793, 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4272, 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1053793, 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:53.348 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 4272, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 4272, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4272, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 4272, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.349 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 3, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 351, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 3, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3, 2024-09-21T07:23:53.350 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 351, 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55f1aa185450": { 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 220, 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 801716, 2024-09-21T07:23:53.351 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 220, 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 186, 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 801716, 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 64 2024-09-21T07:23:53.352 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:53.353 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-21T07:23:53.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:52 smithi092 ceph-mon[30987]: pgmap v671: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-21T07:23:54.009 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-21T07:23:54.010 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-21T07:23:54.010 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=20 2024-09-21T07:23:54.010 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2024-09-21T07:23:54.010 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T07:23:54.010 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=10 2024-09-21T07:23:54.010 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=4 2024-09-21T07:23:54.011 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T07:23:54.011 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T07:23:54.259 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 306, 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 308, 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1205513, 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 204886, 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 12, 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.060868055, 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.024105748, 2024-09-21T07:23:54.771 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.046044978, 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000358045, 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 307, 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.025084628, 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000081708 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 38, 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000010950, 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000288 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1199440, 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 143136 2024-09-21T07:23:54.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 23, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 204, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 5305, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 400803, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 9, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.018590247, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.011727518, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.004713334, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000369649, 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:54.773 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 202, 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.026210664, 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000129755 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 32, 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000008371, 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000261 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 370160 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 572, 2024-09-21T07:23:54.774 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 621, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 169476, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 656058, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 34, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.097320933, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.044505963, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.049918952, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.004161795, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 620, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.044257661, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000071383 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:23:54.775 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1104, 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000282548, 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000255 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 35, 2024-09-21T07:23:54.776 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.002334010, 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000066686 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000023957, 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000011978 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 1, 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-21T07:23:54.777 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 1, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 16, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-21T07:23:54.778 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 16, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 13, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 4, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 3, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 18, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 13, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 1, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 4, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-21T07:23:54.779 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:23:54.780 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-09-21T07:23:54.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 14, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 9, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 10, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-21T07:23:54.782 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 4, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 27, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0, 2024-09-21T07:23:54.783 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_started": 0, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_succeeded": 0, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "uninline_write_failed": 0 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 4, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 4, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 2, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-21T07:23:54.784 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4195776, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.005227154, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001742384 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.785 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 20, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 22, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 2, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 19, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 23, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 4, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 16, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 20, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 4, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 120112, 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 325861376 2024-09-21T07:23:54.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 1, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 1, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 17, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.788 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.789 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.790 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-21T07:23:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-21T07:23:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.791 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-21T07:23:54.792 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.794 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-21T07:23:54.795 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.796 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.797 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-09-21T07:23:54.798 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 2, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 0, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 613, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:23:54.799 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-21T07:23:54.800 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-21T07:23:54.801 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 238359, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 79, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-21T07:23:54.802 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 9832, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 199, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 83401, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 361, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-21T07:23:54.803 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 39, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 11774, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 39, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 39, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.218996279, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005615289 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 39, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 61 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.804 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 39, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 0, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 39, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 0, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 3, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 7, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 6, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-21T07:23:54.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-21T07:23:54.806 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-21T07:23:54.807 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 94, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 10, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 8, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 8, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 14, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 1 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-21T07:23:54.808 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:23:54.809 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 897, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1282155, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 897, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 897, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1282155, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 39, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 11774, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 39, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 11774, 2024-09-21T07:23:54.811 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 39, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 39, 2024-09-21T07:23:54.812 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 39, 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 39, 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-21T07:23:54.813 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55bfd5ab3450": { 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-21T07:23:54.814 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 4, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1472, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 4, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1472, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-21T07:23:54.815 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-09-21T07:23:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 31 2024-09-21T07:23:54.816 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-21T07:23:54.816 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-21T07:23:55.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:54 smithi175 ceph-mon[34064]: pgmap v672: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:23:55.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:54 smithi169 ceph-mon[33705]: pgmap v672: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:23:55.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:54 smithi092 ceph-mon[30987]: pgmap v672: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:23:55.611 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-21T07:23:55.611 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-21T07:23:55.611 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-21T07:23:55.611 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=14 2024-09-21T07:23:55.611 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=6 2024-09-21T07:23:55.611 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-21T07:23:55.611 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T07:23:55.612 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T07:23:55.629 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T07:23:55.629 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:23:55.629 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:55.650 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:23:55.650 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:55.709 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T07:23:56.001 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:56.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.518+0000 7f9666c39640 1 -- 172.21.15.92:0/3707094577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96601083a0 msgr2=0x7f96601087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:56.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.518+0000 7f9666c39640 1 --2- 172.21.15.92:0/3707094577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96601083a0 0x7f96601087b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f964c009900 tx=0x7f964c02a410 comp rx=0 tx=0).stop 2024-09-21T07:23:56.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.518+0000 7f9666c39640 1 -- 172.21.15.92:0/3707094577 shutdown_connections 2024-09-21T07:23:56.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.518+0000 7f9666c39640 1 --2- 172.21.15.92:0/3707094577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9660108cf0 0x7f966010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:56.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.518+0000 7f9666c39640 1 --2- 172.21.15.92:0/3707094577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96601083a0 0x7f96601087b0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.518+0000 7f9666c39640 1 --2- 172.21.15.92:0/3707094577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660102a60 0x7f9660102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.518+0000 7f9666c39640 1 -- 172.21.15.92:0/3707094577 >> 172.21.15.92:0/3707094577 conn(0x7f9660079730 msgr2=0x7f9660079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.518+0000 7f9666c39640 1 -- 172.21.15.92:0/3707094577 shutdown_connections 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.518+0000 7f9666c39640 1 -- 172.21.15.92:0/3707094577 wait complete. 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f9666c39640 1 Processor -- start 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f9666c39640 1 -- start start 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f9666c39640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9660102a60 0x7f966010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f9666c39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96601083a0 0x7f96601104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f9666c39640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660108cf0 0x7f9660110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f9666c39640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9660113950 con 0x7f96601083a0 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f9666c39640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f96601137d0 con 0x7f9660108cf0 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f9666c39640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9660113ad0 con 0x7f9660102a60 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f965ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96601083a0 0x7f96601104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f965ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96601083a0 0x7f96601104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53550/0 (socket says 172.21.15.92:53550) 2024-09-21T07:23:56.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.519+0000 7f965ffff640 1 -- 172.21.15.92:0/1991717177 learned_addr learned my addr 172.21.15.92:0/1991717177 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f96649d5640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9660102a60 0x7f966010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f96651d6640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660108cf0 0x7f9660110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f965ffff640 1 -- 172.21.15.92:0/1991717177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9660102a60 msgr2=0x7f966010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f965ffff640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9660102a60 0x7f966010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f965ffff640 1 -- 172.21.15.92:0/1991717177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660108cf0 msgr2=0x7f9660110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f965ffff640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660108cf0 0x7f9660110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f965ffff640 1 -- 172.21.15.92:0/1991717177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96601a8630 con 0x7f96601083a0 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f96651d6640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660108cf0 0x7f9660110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f965ffff640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96601083a0 0x7f96601104f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f964c005940 tx=0x7f964c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f965dffb640 1 -- 172.21.15.92:0/1991717177 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c03f030 con 0x7f96601083a0 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f9666c39640 1 -- 172.21.15.92:0/1991717177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96601a88c0 con 0x7f96601083a0 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f965dffb640 1 -- 172.21.15.92:0/1991717177 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f964c003c90 con 0x7f96601083a0 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f965dffb640 1 -- 172.21.15.92:0/1991717177 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c035070 con 0x7f96601083a0 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.520+0000 7f9666c39640 1 -- 172.21.15.92:0/1991717177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96601a8e20 con 0x7f96601083a0 2024-09-21T07:23:56.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.521+0000 7f9666c39640 1 -- 172.21.15.92:0/1991717177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9660102e70 con 0x7f96601083a0 2024-09-21T07:23:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.523+0000 7f965dffb640 1 -- 172.21.15.92:0/1991717177 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f964c042030 con 0x7f96601083a0 2024-09-21T07:23:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.524+0000 7f965dffb640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f96500b6680 0x7f96500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.524+0000 7f96649d5640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f96500b6680 0x7f96500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.524+0000 7f965dffb640 1 -- 172.21.15.92:0/1991717177 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f964c108650 con 0x7f96601083a0 2024-09-21T07:23:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.524+0000 7f96649d5640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f96500b6680 0x7f96500b8b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9660111a00 tx=0x7f9654008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:56.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.527+0000 7f965dffb640 1 -- 172.21.15.92:0/1991717177 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f964c0ce7a0 con 0x7f96601083a0 2024-09-21T07:23:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.721+0000 7f9666c39640 1 -- 172.21.15.92:0/1991717177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f96601112b0 con 0x7f96601083a0 2024-09-21T07:23:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.721+0000 7f965dffb640 1 -- 172.21.15.92:0/1991717177 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v94) ==== 81+0+880 (secure 0 0 0) 0x7f964c0d2b80 con 0x7f96601083a0 2024-09-21T07:23:56.723 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3394957298 2024-09-22T07:04:13.495486+0000 2024-09-21T07:23:56.723 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2875922154 2024-09-22T07:04:13.495486+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/55970926 2024-09-22T07:03:15.831617+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/587317102 2024-09-22T07:04:13.495486+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/4259087529 2024-09-22T07:02:51.153241+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/4259087529 2024-09-22T07:02:51.153241+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1080149377 2024-09-22T07:03:15.831617+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/360775984 2024-09-22T07:03:15.831617+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3362034077 2024-09-22T07:02:51.153241+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/55970926 2024-09-22T07:03:15.831617+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3955243221 2024-09-22T07:02:51.153241+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/750676858 2024-09-22T07:03:15.831617+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2534333723 2024-09-22T07:04:13.495486+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3806081909 2024-09-22T07:02:51.153241+0000 2024-09-21T07:23:56.724 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/587317102 2024-09-22T07:04:13.495486+0000 2024-09-21T07:23:56.725 INFO:teuthology.orchestra.run.smithi092.stderr:listed 15 entries 2024-09-21T07:23:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 -- 172.21.15.92:0/1991717177 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f96500b6680 msgr2=0x7f96500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f96500b6680 0x7f96500b8b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9660111a00 tx=0x7f9654008040 comp rx=0 tx=0).stop 2024-09-21T07:23:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 -- 172.21.15.92:0/1991717177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96601083a0 msgr2=0x7f96601104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96601083a0 0x7f96601104f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f964c005940 tx=0x7f964c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:23:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 -- 172.21.15.92:0/1991717177 shutdown_connections 2024-09-21T07:23:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f96500b6680 0x7f96500b8b90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9660108cf0 0x7f9660110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96601083a0 0x7f96601104f0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:56.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 --2- 172.21.15.92:0/1991717177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9660102a60 0x7f966010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 -- 172.21.15.92:0/1991717177 >> 172.21.15.92:0/1991717177 conn(0x7f9660079730 msgr2=0x7f9660105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 -- 172.21.15.92:0/1991717177 shutdown_connections 2024-09-21T07:23:56.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:56.724+0000 7f9666c39640 1 -- 172.21.15.92:0/1991717177 wait complete. 2024-09-21T07:23:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:56 smithi092 ceph-mon[30987]: pgmap v673: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:23:57.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:56 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1991717177' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:23:57.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:56 smithi169 ceph-mon[33705]: pgmap v673: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:23:57.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:56 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1991717177' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:23:57.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:56 smithi175 ceph-mon[34064]: pgmap v673: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T07:23:57.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:56 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1991717177' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:23:57.414 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-21T07:23:57.414 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:23:57.431 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T07:23:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.251+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3963651511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac8076080 msgr2=0x7f1ac810fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.251+0000 7f1ace2f1640 1 --2- 172.21.15.92:0/3963651511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac8076080 0x7f1ac810fcd0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009900 tx=0x7f1abc02a410 comp rx=0 tx=0).stop 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.251+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3963651511 shutdown_connections 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.251+0000 7f1ace2f1640 1 --2- 172.21.15.92:0/3963651511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ac8110210 0x7f1ac8112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.251+0000 7f1ace2f1640 1 --2- 172.21.15.92:0/3963651511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac8076080 0x7f1ac810fcd0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.251+0000 7f1ace2f1640 1 --2- 172.21.15.92:0/3963651511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac8075730 0x7f1ac8075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.251+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3963651511 >> 172.21.15.92:0/3963651511 conn(0x7f1ac807b8d0 msgr2=0x7f1ac807bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.251+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3963651511 shutdown_connections 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.251+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3963651511 wait complete. 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.252+0000 7f1ace2f1640 1 Processor -- start 2024-09-21T07:23:58.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.252+0000 7f1ace2f1640 1 -- start start 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ace2f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac8075730 0x7f1ac819c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ace2f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ac8076080 0x7f1ac819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ace2f1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac8110210 0x7f1ac81a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ace2f1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac8115b20 con 0x7f1ac8110210 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ace2f1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac81159a0 con 0x7f1ac8076080 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ace2f1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac8115ca0 con 0x7f1ac8075730 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1acc88e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac8110210 0x7f1ac81a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1acc88e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac8110210 0x7f1ac81a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53564/0 (socket says 172.21.15.92:53564) 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1acc88e640 1 -- 172.21.15.92:0/3707258454 learned_addr learned my addr 172.21.15.92:0/3707258454 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ac7fff640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac8075730 0x7f1ac819c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ac77fe640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ac8076080 0x7f1ac819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1acc88e640 1 -- 172.21.15.92:0/3707258454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac8075730 msgr2=0x7f1ac819c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:58.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1acc88e640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac8075730 0x7f1ac819c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1acc88e640 1 -- 172.21.15.92:0/3707258454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ac8076080 msgr2=0x7f1ac819cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1acc88e640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ac8076080 0x7f1ac819cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1acc88e640 1 -- 172.21.15.92:0/3707258454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac81a24e0 con 0x7f1ac8110210 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1acc88e640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac8110210 0x7f1ac81a1db0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000eaa0 tx=0x7f1ac000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ac57fa640 1 -- 172.21.15.92:0/3707258454 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac000cdb0 con 0x7f1ac8110210 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ac57fa640 1 -- 172.21.15.92:0/3707258454 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ac0005020 con 0x7f1ac8110210 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3707258454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac81a27d0 con 0x7f1ac8110210 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.253+0000 7f1ac57fa640 1 -- 172.21.15.92:0/3707258454 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00116d0 con 0x7f1ac8110210 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.254+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3707258454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac81a8f30 con 0x7f1ac8110210 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.254+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3707258454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac8075b40 con 0x7f1ac8110210 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.257+0000 7f1ac57fa640 1 -- 172.21.15.92:0/3707258454 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f1ac00051d0 con 0x7f1ac8110210 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.257+0000 7f1ac57fa640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ab00b6700 0x7f1ab00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.258+0000 7f1ac7fff640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ab00b6700 0x7f1ab00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.258+0000 7f1ac57fa640 1 -- 172.21.15.92:0/3707258454 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f1ac00e7fd0 con 0x7f1ac8110210 2024-09-21T07:23:58.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.258+0000 7f1ac7fff640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ab00b6700 0x7f1ab00b8c10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800bbe0 tx=0x7f1ab800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:23:58.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.261+0000 7f1ac57fa640 1 -- 172.21.15.92:0/3707258454 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ac0016030 con 0x7f1ac8110210 2024-09-21T07:23:58.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.452+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3707258454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1ac819d6a0 con 0x7f1ac8110210 2024-09-21T07:23:58.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.453+0000 7f1ac57fa640 1 -- 172.21.15.92:0/3707258454 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v94) ==== 81+0+880 (secure 0 0 0) 0x7f1ac819d6a0 con 0x7f1ac8110210 2024-09-21T07:23:58.456 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3394957298 2024-09-22T07:04:13.495486+0000 2024-09-21T07:23:58.456 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2875922154 2024-09-22T07:04:13.495486+0000 2024-09-21T07:23:58.456 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/55970926 2024-09-22T07:03:15.831617+0000 2024-09-21T07:23:58.456 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/587317102 2024-09-22T07:04:13.495486+0000 2024-09-21T07:23:58.456 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/4259087529 2024-09-22T07:02:51.153241+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/4259087529 2024-09-22T07:02:51.153241+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1080149377 2024-09-22T07:03:15.831617+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/360775984 2024-09-22T07:03:15.831617+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3362034077 2024-09-22T07:02:51.153241+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/55970926 2024-09-22T07:03:15.831617+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3955243221 2024-09-22T07:02:51.153241+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/750676858 2024-09-22T07:03:15.831617+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2534333723 2024-09-22T07:04:13.495486+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3806081909 2024-09-22T07:02:51.153241+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/587317102 2024-09-22T07:04:13.495486+0000 2024-09-21T07:23:58.457 INFO:teuthology.orchestra.run.smithi092.stderr:listed 15 entries 2024-09-21T07:23:58.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.455+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3707258454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ab00b6700 msgr2=0x7f1ab00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:58.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.455+0000 7f1ace2f1640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ab00b6700 0x7f1ab00b8c10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800bbe0 tx=0x7f1ab800b390 comp rx=0 tx=0).stop 2024-09-21T07:23:58.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.455+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3707258454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac8110210 msgr2=0x7f1ac81a1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:23:58.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.455+0000 7f1ace2f1640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac8110210 0x7f1ac81a1db0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000eaa0 tx=0x7f1ac000ef60 comp rx=0 tx=0).stop 2024-09-21T07:23:58.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.455+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3707258454 shutdown_connections 2024-09-21T07:23:58.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.455+0000 7f1ace2f1640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f1ab00b6700 0x7f1ab00b8c10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:58.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.455+0000 7f1ace2f1640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac8110210 0x7f1ac81a1db0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:58.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.455+0000 7f1ace2f1640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ac8076080 0x7f1ac819cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:58.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.455+0000 7f1ace2f1640 1 --2- 172.21.15.92:0/3707258454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac8075730 0x7f1ac819c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:23:58.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.455+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3707258454 >> 172.21.15.92:0/3707258454 conn(0x7f1ac807b8d0 msgr2=0x7f1ac8108ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:23:58.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.456+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3707258454 shutdown_connections 2024-09-21T07:23:58.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:23:58.456+0000 7f1ace2f1640 1 -- 172.21.15.92:0/3707258454 wait complete. 2024-09-21T07:23:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:58 smithi092 ceph-mon[30987]: pgmap v674: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:23:59.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:23:58 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3707258454' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:23:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:58 smithi169 ceph-mon[33705]: pgmap v674: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:23:59.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:23:58 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3707258454' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:23:59.155 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi092.front.sepia.ceph.com... 2024-09-21T07:23:59.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:23:59.156 DEBUG:teuthology.orchestra.run.smithi092:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-21T07:23:59.182 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:23:59.183 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi092.stderr:ceph-fuse[86257]: fuse finished with error 0 and tester_r 0 2024-09-21T07:23:59.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:58 smithi175 ceph-mon[34064]: pgmap v674: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:23:59.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:23:58 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3707258454' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:24:01.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:00 smithi169 ceph-mon[33705]: pgmap v675: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T07:24:01.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:00 smithi175 ceph-mon[34064]: pgmap v675: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T07:24:01.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:00 smithi092 ceph-mon[30987]: pgmap v675: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T07:24:02.948 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:02 smithi169 ceph-mon[33705]: pgmap v676: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:24:03.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:02 smithi175 ceph-mon[34064]: pgmap v676: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:24:03.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:02 smithi092 ceph-mon[30987]: pgmap v676: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:24:05.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:04 smithi175 ceph-mon[34064]: pgmap v677: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-21T07:24:05.284 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T07:24:05.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:24:05.284 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:24:05.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:24:05.304 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-21T07:24:05.362 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:24:05.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:24:05.362 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:24:05.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:04 smithi092 ceph-mon[30987]: pgmap v677: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-21T07:24:05.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:04 smithi169 ceph-mon[33705]: pgmap v677: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-21T07:24:05.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:24:05.430 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-09-21T07:24:05.545 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T07:24:05.556 INFO:tasks.cephadm:Teardown begin 2024-09-21T07:24:05.557 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:24:05.557 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:24:05.822 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:24:06.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:24:06.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:05 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:24:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:05 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.338+0000 7f693036a640 1 -- 172.21.15.92:0/2213166846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6928109df0 msgr2=0x7f6928110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:06.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.338+0000 7f693036a640 1 --2- 172.21.15.92:0/2213166846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6928109df0 0x7f6928110620 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f6920009ca0 tx=0x7f692002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:24:06.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.338+0000 7f693036a640 1 -- 172.21.15.92:0/2213166846 shutdown_connections 2024-09-21T07:24:06.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.338+0000 7f693036a640 1 --2- 172.21.15.92:0/2213166846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6928109df0 0x7f6928110620 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:06.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.338+0000 7f693036a640 1 --2- 172.21.15.92:0/2213166846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69281094a0 0x7f69281098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:06.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.338+0000 7f693036a640 1 --2- 172.21.15.92:0/2213166846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6928103b60 0x7f6928103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:06.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.338+0000 7f693036a640 1 -- 172.21.15.92:0/2213166846 >> 172.21.15.92:0/2213166846 conn(0x7f692807b850 msgr2=0x7f692807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.338+0000 7f693036a640 1 -- 172.21.15.92:0/2213166846 shutdown_connections 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.338+0000 7f693036a640 1 -- 172.21.15.92:0/2213166846 wait complete. 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.338+0000 7f693036a640 1 Processor -- start 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f693036a640 1 -- start start 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f693036a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6928103b60 0x7f692819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f693036a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69281094a0 0x7f692819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f693036a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6928109df0 0x7f692819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f693036a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f69281139b0 con 0x7f6928103b60 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f693036a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6928113830 con 0x7f69281094a0 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f693036a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6928113b30 con 0x7f6928109df0 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f692e106640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6928103b60 0x7f692819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f692e106640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6928103b60 0x7f692819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43900/0 (socket says 172.21.15.92:43900) 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f692e106640 1 -- 172.21.15.92:0/1403402748 learned_addr learned my addr 172.21.15.92:0/1403402748 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:24:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f692e907640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6928109df0 0x7f692819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f692d905640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69281094a0 0x7f692819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f692e106640 1 -- 172.21.15.92:0/1403402748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6928109df0 msgr2=0x7f692819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f692e106640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6928109df0 0x7f692819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f692e106640 1 -- 172.21.15.92:0/1403402748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69281094a0 msgr2=0x7f692819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f692e106640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69281094a0 0x7f692819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.339+0000 7f692e106640 1 -- 172.21.15.92:0/1403402748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69281a0430 con 0x7f6928103b60 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.340+0000 7f692e106640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6928103b60 0x7f692819a4c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f692400d950 tx=0x7f692400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.340+0000 7f691f7fe640 1 -- 172.21.15.92:0/1403402748 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924017070 con 0x7f6928103b60 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.340+0000 7f693036a640 1 -- 172.21.15.92:0/1403402748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69281a0720 con 0x7f6928103b60 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.340+0000 7f691f7fe640 1 -- 172.21.15.92:0/1403402748 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6924009c30 con 0x7f6928103b60 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.340+0000 7f691f7fe640 1 -- 172.21.15.92:0/1403402748 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692400f620 con 0x7f6928103b60 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.340+0000 7f693036a640 1 -- 172.21.15.92:0/1403402748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69281a6e80 con 0x7f6928103b60 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.341+0000 7f693036a640 1 -- 172.21.15.92:0/1403402748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6928103f70 con 0x7f6928103b60 2024-09-21T07:24:06.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.343+0000 7f691f7fe640 1 -- 172.21.15.92:0/1403402748 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f6924005030 con 0x7f6928103b60 2024-09-21T07:24:06.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.344+0000 7f691f7fe640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69140b6680 0x7f69140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:06.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.344+0000 7f692d905640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69140b6680 0x7f69140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:06.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.344+0000 7f691f7fe640 1 -- 172.21.15.92:0/1403402748 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f69240e7650 con 0x7f6928103b60 2024-09-21T07:24:06.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.344+0000 7f692d905640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69140b6680 0x7f69140b8b90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6928109220 tx=0x7f691800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:06.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.347+0000 7f691f7fe640 1 -- 172.21.15.92:0/1403402748 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6924009de0 con 0x7f6928103b60 2024-09-21T07:24:06.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:24:06.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.395 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:05 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:06.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.562+0000 7f693036a640 1 -- 172.21.15.92:0/1403402748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f692819b5f0 con 0x7f6928103b60 2024-09-21T07:24:06.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.563+0000 7f691f7fe640 1 -- 172.21.15.92:0/1403402748 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f69240b1b80 con 0x7f6928103b60 2024-09-21T07:24:06.565 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:24:06.565 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:24:06.565 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:24:06.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 -- 172.21.15.92:0/1403402748 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69140b6680 msgr2=0x7f69140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:06.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69140b6680 0x7f69140b8b90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6928109220 tx=0x7f691800b390 comp rx=0 tx=0).stop 2024-09-21T07:24:06.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 -- 172.21.15.92:0/1403402748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6928103b60 msgr2=0x7f692819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:06.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6928103b60 0x7f692819a4c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f692400d950 tx=0x7f692400de10 comp rx=0 tx=0).stop 2024-09-21T07:24:06.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 -- 172.21.15.92:0/1403402748 shutdown_connections 2024-09-21T07:24:06.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f69140b6680 0x7f69140b8b90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:06.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6928109df0 0x7f692819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:06.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69281094a0 0x7f692819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:06.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 --2- 172.21.15.92:0/1403402748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6928103b60 0x7f692819a4c0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:06.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 -- 172.21.15.92:0/1403402748 >> 172.21.15.92:0/1403402748 conn(0x7f692807b850 msgr2=0x7f6928107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:06.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 -- 172.21.15.92:0/1403402748 shutdown_connections 2024-09-21T07:24:06.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:06.565+0000 7f693036a640 1 -- 172.21.15.92:0/1403402748 wait complete. 2024-09-21T07:24:07.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:06 smithi175 ceph-mon[34064]: pgmap v678: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T07:24:07.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:24:07.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:24:07.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:06 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:07.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:06 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/1403402748' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:24:07.306 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:06 smithi092 ceph-mon[30987]: pgmap v678: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T07:24:07.306 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:24:07.306 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:24:07.306 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:06 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:07.307 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:06 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/1403402748' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:24:07.334 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:24:07.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:06 smithi169 ceph-mon[33705]: pgmap v678: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T07:24:07.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:24:07.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:24:07.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:06 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' 2024-09-21T07:24:07.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:06 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/1403402748' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:24:07.582 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:24:08.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.054+0000 7f85d2ab4640 1 -- 172.21.15.92:0/1367991053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85cc102b10 msgr2=0x7f85cc102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:08.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.054+0000 7f85d2ab4640 1 --2- 172.21.15.92:0/1367991053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85cc102b10 0x7f85cc102f20 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009900 tx=0x7f85c402a410 comp rx=0 tx=0).stop 2024-09-21T07:24:08.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.054+0000 7f85d2ab4640 1 -- 172.21.15.92:0/1367991053 shutdown_connections 2024-09-21T07:24:08.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.054+0000 7f85d2ab4640 1 --2- 172.21.15.92:0/1367991053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85cc108da0 0x7f85cc10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:08.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.054+0000 7f85d2ab4640 1 --2- 172.21.15.92:0/1367991053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc108450 0x7f85cc108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:08.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.054+0000 7f85d2ab4640 1 --2- 172.21.15.92:0/1367991053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85cc102b10 0x7f85cc102f20 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.054+0000 7f85d2ab4640 1 -- 172.21.15.92:0/1367991053 >> 172.21.15.92:0/1367991053 conn(0x7f85cc0796d0 msgr2=0x7f85cc079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.054+0000 7f85d2ab4640 1 -- 172.21.15.92:0/1367991053 shutdown_connections 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.054+0000 7f85d2ab4640 1 -- 172.21.15.92:0/1367991053 wait complete. 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d2ab4640 1 Processor -- start 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d2ab4640 1 -- start start 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d2ab4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85cc102b10 0x7f85cc19b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d2ab4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85cc108450 0x7f85cc19b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d2ab4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc108da0 0x7f85cc19bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d2ab4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85cc112910 con 0x7f85cc102b10 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d2ab4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85cc112790 con 0x7f85cc108450 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d2ab4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85cc112a90 con 0x7f85cc108da0 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d0850640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85cc102b10 0x7f85cc19b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d0850640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85cc102b10 0x7f85cc19b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43908/0 (socket says 172.21.15.92:43908) 2024-09-21T07:24:08.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85d0850640 1 -- 172.21.15.92:0/98440428 learned_addr learned my addr 172.21.15.92:0/98440428 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.055+0000 7f85cbfff640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85cc108450 0x7f85cc19b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85d1051640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc108da0 0x7f85cc19bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85d0850640 1 -- 172.21.15.92:0/98440428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc108da0 msgr2=0x7f85cc19bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85d0850640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc108da0 0x7f85cc19bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85d0850640 1 -- 172.21.15.92:0/98440428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85cc108450 msgr2=0x7f85cc19b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85d0850640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85cc108450 0x7f85cc19b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85d0850640 1 -- 172.21.15.92:0/98440428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85cc1a6590 con 0x7f85cc102b10 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85cbfff640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85cc108450 0x7f85cc19b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85d1051640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc108da0 0x7f85cc19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85d0850640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85cc102b10 0x7f85cc19b280 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009230 tx=0x7f85c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85c9ffb640 1 -- 172.21.15.92:0/98440428 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c403f030 con 0x7f85cc102b10 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85c9ffb640 1 -- 172.21.15.92:0/98440428 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85c4003a80 con 0x7f85cc102b10 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85d2ab4640 1 -- 172.21.15.92:0/98440428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85cc1a6820 con 0x7f85cc102b10 2024-09-21T07:24:08.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85c9ffb640 1 -- 172.21.15.92:0/98440428 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4035070 con 0x7f85cc102b10 2024-09-21T07:24:08.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.056+0000 7f85d2ab4640 1 -- 172.21.15.92:0/98440428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85cc1a6d50 con 0x7f85cc102b10 2024-09-21T07:24:08.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.057+0000 7f85d2ab4640 1 -- 172.21.15.92:0/98440428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85cc102f20 con 0x7f85cc102b10 2024-09-21T07:24:08.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.059+0000 7f85c9ffb640 1 -- 172.21.15.92:0/98440428 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f85c4042030 con 0x7f85cc102b10 2024-09-21T07:24:08.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.059+0000 7f85c9ffb640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85b80b6700 0x7f85b80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:08.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.060+0000 7f85cbfff640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85b80b6700 0x7f85b80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:08.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.060+0000 7f85c9ffb640 1 -- 172.21.15.92:0/98440428 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7f85c4108770 con 0x7f85cc102b10 2024-09-21T07:24:08.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.060+0000 7f85cbfff640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85b80b6700 0x7f85b80b8c10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f85cc105550 tx=0x7f85bc009970 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:08.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.063+0000 7f85c9ffb640 1 -- 172.21.15.92:0/98440428 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85c40ce8c0 con 0x7f85cc102b10 2024-09-21T07:24:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.277+0000 7f85d2ab4640 1 -- 172.21.15.92:0/98440428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85cc06bfd0 con 0x7f85cc102b10 2024-09-21T07:24:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.278+0000 7f85c9ffb640 1 -- 172.21.15.92:0/98440428 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f85c40d2ca0 con 0x7f85cc102b10 2024-09-21T07:24:08.280 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:24:08.280 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"btime":"2024-09-21T07:13:18:712468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14790,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4146602671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4146602671},{"type":"v1","addr":"172.21.15.92:6835","nonce":4146602671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/445790137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":445790137},{"type":"v1","addr":"172.21.15.92:6837","nonce":445790137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:10:54.236729+0000","modified":"2024-09-21T07:13:18.148048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24649,"mds_1":24625,"mds_2":24608,"mds_3":24583,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14841":{"gid":14841,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/2116680832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":2116680832},{"type":"v1","addr":"172.21.15.169:6837","nonce":2116680832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14859":{"gid":14859,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1835760933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1835760933},{"type":"v1","addr":"172.21.15.92:6839","nonce":1835760933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14871":{"gid":14871,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/752270354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":752270354},{"type":"v1","addr":"172.21.15.92:6841","nonce":752270354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6833/3784592006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3784592006},{"type":"v1","addr":"172.21.15.169:6833","nonce":3784592006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/1770920559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1770920559},{"type":"v1","addr":"172.21.15.169:6835","nonce":1770920559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6837/1654191634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1654191634},{"type":"v1","addr":"172.21.15.175:6837","nonce":1654191634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.175:6833/2860278829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2860278829},{"type":"v1","addr":"172.21.15.175:6833","nonce":2860278829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.169:6839/44894739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":44894739},{"type":"v1","addr":"172.21.15.169:6839","nonce":44894739}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":1,"incarnation":20,"state":"up:active","state_seq":17,"addr":"172.21.15.175:6835/2445062283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2445062283},{"type":"v1","addr":"172.21.15.175:6835","nonce":2445062283}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/3839014225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3839014225},{"type":"v1","addr":"172.21.15.175:6839","nonce":3839014225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24649,"qdb_cluster":[24566,24583,24608,24625,24649]},"id":1}]} 2024-09-21T07:24:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 -- 172.21.15.92:0/98440428 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85b80b6700 msgr2=0x7f85b80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85b80b6700 0x7f85b80b8c10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f85cc105550 tx=0x7f85bc009970 comp rx=0 tx=0).stop 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 -- 172.21.15.92:0/98440428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85cc102b10 msgr2=0x7f85cc19b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85cc102b10 0x7f85cc19b280 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009230 tx=0x7f85c4004270 comp rx=0 tx=0).stop 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 -- 172.21.15.92:0/98440428 shutdown_connections 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f85b80b6700 0x7f85b80b8c10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85cc108da0 0x7f85cc19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85cc108450 0x7f85cc19b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 --2- 172.21.15.92:0/98440428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85cc102b10 0x7f85cc19b280 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 -- 172.21.15.92:0/98440428 >> 172.21.15.92:0/98440428 conn(0x7f85cc0796d0 msgr2=0x7f85cc1065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 -- 172.21.15.92:0/98440428 shutdown_connections 2024-09-21T07:24:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:08.281+0000 7f85d2ab4640 1 -- 172.21.15.92:0/98440428 wait complete. 2024-09-21T07:24:09.081 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:08 smithi092 ceph-mon[30987]: pgmap v679: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-09-21T07:24:09.081 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:08 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/98440428' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:24:09.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:24:09.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:08 smithi175 ceph-mon[34064]: pgmap v679: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-09-21T07:24:09.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:08 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/98440428' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:24:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:24:09.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:08 smithi169 ceph-mon[33705]: pgmap v679: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-09-21T07:24:09.393 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:08 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/98440428' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.807+0000 7ff2b0e39640 1 -- 172.21.15.92:0/3581289491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac1094a0 msgr2=0x7ff2ac1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.807+0000 7ff2b0e39640 1 --2- 172.21.15.92:0/3581289491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac1094a0 0x7ff2ac1098b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009900 tx=0x7ff29c02a410 comp rx=0 tx=0).stop 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.807+0000 7ff2b0e39640 1 -- 172.21.15.92:0/3581289491 shutdown_connections 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.807+0000 7ff2b0e39640 1 --2- 172.21.15.92:0/3581289491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2ac109df0 0x7ff2ac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.807+0000 7ff2b0e39640 1 --2- 172.21.15.92:0/3581289491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac1094a0 0x7ff2ac1098b0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.807+0000 7ff2b0e39640 1 --2- 172.21.15.92:0/3581289491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ac103b60 0x7ff2ac103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.807+0000 7ff2b0e39640 1 -- 172.21.15.92:0/3581289491 >> 172.21.15.92:0/3581289491 conn(0x7ff2ac07b850 msgr2=0x7ff2ac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.807+0000 7ff2b0e39640 1 -- 172.21.15.92:0/3581289491 shutdown_connections 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.807+0000 7ff2b0e39640 1 -- 172.21.15.92:0/3581289491 wait complete. 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.808+0000 7ff2b0e39640 1 Processor -- start 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.808+0000 7ff2b0e39640 1 -- start start 2024-09-21T07:24:09.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2b0e39640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ac103b60 0x7ff2ac19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2b0e39640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2ac1094a0 0x7ff2ac19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2b0e39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac109df0 0x7ff2ac19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2b0e39640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac113960 con 0x7ff2ac109df0 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2b0e39640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac1137e0 con 0x7ff2ac1094a0 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2b0e39640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac113ae0 con 0x7ff2ac103b60 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2aad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac109df0 0x7ff2ac19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2aad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac109df0 0x7ff2ac19fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43930/0 (socket says 172.21.15.92:43930) 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2aad9d640 1 -- 172.21.15.92:0/2501149148 learned_addr learned my addr 172.21.15.92:0/2501149148 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2aa59c640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ac103b60 0x7ff2ac19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2a9d9b640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2ac1094a0 0x7ff2ac19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2aad9d640 1 -- 172.21.15.92:0/2501149148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ac103b60 msgr2=0x7ff2ac19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2aad9d640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ac103b60 0x7ff2ac19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2aad9d640 1 -- 172.21.15.92:0/2501149148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2ac1094a0 msgr2=0x7ff2ac19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2aad9d640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2ac1094a0 0x7ff2ac19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:09.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2aad9d640 1 -- 172.21.15.92:0/2501149148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ac1a0340 con 0x7ff2ac109df0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2aad9d640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac109df0 0x7ff2ac19fc10 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400d750 tx=0x7ff2a400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff29b7fe640 1 -- 172.21.15.92:0/2501149148 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4017070 con 0x7ff2ac109df0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff2b0e39640 1 -- 172.21.15.92:0/2501149148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ac1a0630 con 0x7ff2ac109df0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.809+0000 7ff29b7fe640 1 -- 172.21.15.92:0/2501149148 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2a40054b0 con 0x7ff2ac109df0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.810+0000 7ff29b7fe640 1 -- 172.21.15.92:0/2501149148 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4004b90 con 0x7ff2ac109df0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.810+0000 7ff2b0e39640 1 -- 172.21.15.92:0/2501149148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ac1a6d90 con 0x7ff2ac109df0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.810+0000 7ff2b0e39640 1 -- 172.21.15.92:0/2501149148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ac103f70 con 0x7ff2ac109df0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.813+0000 7ff29b7fe640 1 -- 172.21.15.92:0/2501149148 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7ff2a4004d30 con 0x7ff2ac109df0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.814+0000 7ff29b7fe640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff2940b6680 0x7ff2940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.814+0000 7ff2aa59c640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff2940b6680 0x7ff2940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.814+0000 7ff29b7fe640 1 -- 172.21.15.92:0/2501149148 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9540+0+0 (secure 0 0 0) 0x7ff2a40e79a0 con 0x7ff2ac109df0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.814+0000 7ff2aa59c640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff2940b6680 0x7ff2940b8b90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0005fd0 tx=0x7ff2a0009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:09.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:09.817+0000 7ff29b7fe640 1 -- 172.21.15.92:0/2501149148 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2a40ada90 con 0x7ff2ac109df0 2024-09-21T07:24:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.024+0000 7ff2b0e39640 1 -- 172.21.15.92:0/2501149148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2ac02e640 con 0x7ff2ac109df0 2024-09-21T07:24:10.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.025+0000 7ff29b7fe640 1 -- 172.21.15.92:0/2501149148 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25581 (secure 0 0 0) 0x7ff2a40b1e70 con 0x7ff2ac109df0 2024-09-21T07:24:10.027 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-21T07:24:10.027 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":95,"fsid":"4e9565c0-77e7-11ef-baf5-efdc52797490","created":"2024-09-21T07:02:28.951051+0000","modified":"2024-09-21T07:24:09.901110+0000","last_up_change":"2024-09-21T07:10:01.708776+0000","last_in_change":"2024-09-21T07:09:39.030775+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:06:11.822418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:50.128666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:52.137256+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:10:58.524238+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f883948-e8ec-4370-9f8d-6ce7095732ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6803","nonce":2549923251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6805","nonce":2549923251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6809","nonce":2549923251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2549923251},{"type":"v1","addr":"172.21.15.92:6807","nonce":2549923251}]},"public_addr":"172.21.15.92:6803/2549923251","cluster_addr":"172.21.15.92:6805/2549923251","heartbeat_back_addr":"172.21.15.92:6809/2549923251","heartbeat_front_addr":"172.21.15.92:6807/2549923251","state":["exists","up"]},{"osd":1,"uuid":"517c0676-0dfb-4f27-b98b-bf86a8e5d788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6801","nonce":340343580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6803","nonce":340343580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6807","nonce":340343580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":340343580},{"type":"v1","addr":"172.21.15.169:6805","nonce":340343580}]},"public_addr":"172.21.15.169:6801/340343580","cluster_addr":"172.21.15.169:6803/340343580","heartbeat_back_addr":"172.21.15.169:6807/340343580","heartbeat_front_addr":"172.21.15.169:6805/340343580","state":["exists","up"]},{"osd":2,"uuid":"71eb34bc-7d93-40d7-aa32-140aa96d10cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6801","nonce":3936276912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6803","nonce":3936276912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6807","nonce":3936276912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3936276912},{"type":"v1","addr":"172.21.15.175:6805","nonce":3936276912}]},"public_addr":"172.21.15.175:6801/3936276912","cluster_addr":"172.21.15.175:6803/3936276912","heartbeat_back_addr":"172.21.15.175:6807/3936276912","heartbeat_front_addr":"172.21.15.175:6805/3936276912","state":["exists","up"]},{"osd":3,"uuid":"fa947193-b87b-4ce9-a59f-5277dfefbbae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6811","nonce":2450473708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6813","nonce":2450473708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6817","nonce":2450473708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2450473708},{"type":"v1","addr":"172.21.15.92:6815","nonce":2450473708}]},"public_addr":"172.21.15.92:6811/2450473708","cluster_addr":"172.21.15.92:6813/2450473708","heartbeat_back_addr":"172.21.15.92:6817/2450473708","heartbeat_front_addr":"172.21.15.92:6815/2450473708","state":["exists","up"]},{"osd":4,"uuid":"0b727711-c462-405e-b7dd-4cef2e5ee2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6809","nonce":3000296749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6811","nonce":3000296749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6815","nonce":3000296749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3000296749},{"type":"v1","addr":"172.21.15.169:6813","nonce":3000296749}]},"public_addr":"172.21.15.169:6809/3000296749","cluster_addr":"172.21.15.169:6811/3000296749","heartbeat_back_addr":"172.21.15.169:6815/3000296749","heartbeat_front_addr":"172.21.15.169:6813/3000296749","state":["exists","up"]},{"osd":5,"uuid":"6cf6db63-2a94-4ed6-aac9-40f5d0ffb8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6809","nonce":1466838289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6811","nonce":1466838289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6815","nonce":1466838289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1466838289},{"type":"v1","addr":"172.21.15.175:6813","nonce":1466838289}]},"public_addr":"172.21.15.175:6809/1466838289","cluster_addr":"172.21.15.175:6811/1466838289","heartbeat_back_addr":"172.21.15.175:6815/1466838289","heartbeat_front_addr":"172.21.15.175:6813/1466838289","state":["exists","up"]},{"osd":6,"uuid":"3f91ad74-d901-41cc-bda8-b038fb38b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6819","nonce":2465826731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6821","nonce":2465826731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6825","nonce":2465826731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2465826731},{"type":"v1","addr":"172.21.15.92:6823","nonce":2465826731}]},"public_addr":"172.21.15.92:6819/2465826731","cluster_addr":"172.21.15.92:6821/2465826731","heartbeat_back_addr":"172.21.15.92:6825/2465826731","heartbeat_front_addr":"172.21.15.92:6823/2465826731","state":["exists","up"]},{"osd":7,"uuid":"f073d2c0-5006-4331-ba84-7c1b91fc70ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6817","nonce":3631528886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6819","nonce":3631528886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6823","nonce":3631528886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3631528886},{"type":"v1","addr":"172.21.15.169:6821","nonce":3631528886}]},"public_addr":"172.21.15.169:6817/3631528886","cluster_addr":"172.21.15.169:6819/3631528886","heartbeat_back_addr":"172.21.15.169:6823/3631528886","heartbeat_front_addr":"172.21.15.169:6821/3631528886","state":["exists","up"]},{"osd":8,"uuid":"84dbd9fc-2024-44fc-9cb4-82ccdbcb34db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6817","nonce":1197596525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6819","nonce":1197596525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6823","nonce":1197596525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1197596525},{"type":"v1","addr":"172.21.15.175:6821","nonce":1197596525}]},"public_addr":"172.21.15.175:6817/1197596525","cluster_addr":"172.21.15.175:6819/1197596525","heartbeat_back_addr":"172.21.15.175:6823/1197596525","heartbeat_front_addr":"172.21.15.175:6821/1197596525","state":["exists","up"]},{"osd":9,"uuid":"62fc48a5-f735-4d12-80bd-e79e4ca6ab1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6827","nonce":1564956774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6829","nonce":1564956774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6833","nonce":1564956774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1564956774},{"type":"v1","addr":"172.21.15.92:6831","nonce":1564956774}]},"public_addr":"172.21.15.92:6827/1564956774","cluster_addr":"172.21.15.92:6829/1564956774","heartbeat_back_addr":"172.21.15.92:6833/1564956774","heartbeat_front_addr":"172.21.15.92:6831/1564956774","state":["exists","up"]},{"osd":10,"uuid":"5d002dc8-64fa-44f0-96aa-6161922b449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6825","nonce":3327763720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6827","nonce":3327763720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6831","nonce":3327763720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3327763720},{"type":"v1","addr":"172.21.15.169:6829","nonce":3327763720}]},"public_addr":"172.21.15.169:6825/3327763720","cluster_addr":"172.21.15.169:6827/3327763720","heartbeat_back_addr":"172.21.15.169:6831/3327763720","heartbeat_front_addr":"172.21.15.169:6829/3327763720","state":["exists","up"]},{"osd":11,"uuid":"825d45a4-6d88-45ce-ade4-5fd417f751d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6825","nonce":3032208508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6827","nonce":3032208508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6831","nonce":3032208508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3032208508},{"type":"v1","addr":"172.21.15.175:6829","nonce":3032208508}]},"public_addr":"172.21.15.175:6825/3032208508","cluster_addr":"172.21.15.175:6827/3032208508","heartbeat_back_addr":"172.21.15.175:6831/3032208508","heartbeat_front_addr":"172.21.15.175:6829/3032208508","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:20.197166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:44.244811+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:10.328754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:35.647782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:01.270310+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:26.994527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:07:53.349080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:18.354629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:08:44.305777+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:09.894051+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:09:35.363031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:00.129143+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/3394957298":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/2875922154":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6801/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:6800/587317102":"2024-09-22T07:04:13.495486+0000","172.21.15.92:6800/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/4259087529":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/1080149377":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/360775984":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3362034077":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6800/55970926":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/3955243221":"2024-09-22T07:02:51.153241+0000","172.21.15.92:0/750676858":"2024-09-22T07:03:15.831617+0000","172.21.15.92:0/2534333723":"2024-09-22T07:04:13.495486+0000","172.21.15.92:0/3806081909":"2024-09-22T07:02:51.153241+0000","172.21.15.92:6801/587317102":"2024-09-22T07:04:13.495486+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:24:10.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.027+0000 7ff2b0e39640 1 -- 172.21.15.92:0/2501149148 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff2940b6680 msgr2=0x7ff2940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:10.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.027+0000 7ff2b0e39640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff2940b6680 0x7ff2940b8b90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0005fd0 tx=0x7ff2a0009680 comp rx=0 tx=0).stop 2024-09-21T07:24:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.027+0000 7ff2b0e39640 1 -- 172.21.15.92:0/2501149148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac109df0 msgr2=0x7ff2ac19fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.027+0000 7ff2b0e39640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac109df0 0x7ff2ac19fc10 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400d750 tx=0x7ff2a400dc10 comp rx=0 tx=0).stop 2024-09-21T07:24:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.028+0000 7ff2b0e39640 1 -- 172.21.15.92:0/2501149148 shutdown_connections 2024-09-21T07:24:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.028+0000 7ff2b0e39640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7ff2940b6680 0x7ff2940b8b90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.028+0000 7ff2b0e39640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac109df0 0x7ff2ac19fc10 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.028+0000 7ff2b0e39640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2ac1094a0 0x7ff2ac19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.028+0000 7ff2b0e39640 1 --2- 172.21.15.92:0/2501149148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ac103b60 0x7ff2ac19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.028+0000 7ff2b0e39640 1 -- 172.21.15.92:0/2501149148 >> 172.21.15.92:0/2501149148 conn(0x7ff2ac07b850 msgr2=0x7ff2ac1075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.028+0000 7ff2b0e39640 1 -- 172.21.15.92:0/2501149148 shutdown_connections 2024-09-21T07:24:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:10.028+0000 7ff2b0e39640 1 -- 172.21.15.92:0/2501149148 wait complete. 2024-09-21T07:24:10.863 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T07:24:11.111 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:24:11.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:10 smithi092 ceph-mon[30987]: pgmap v680: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T07:24:11.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:10 smithi092 ceph-mon[30987]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T07:24:11.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:10 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2501149148' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:24:11.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:10 smithi175 ceph-mon[34064]: pgmap v680: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T07:24:11.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:10 smithi175 ceph-mon[34064]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T07:24:11.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:10 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2501149148' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:24:11.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:10 smithi169 ceph-mon[33705]: pgmap v680: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T07:24:11.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:10 smithi169 ceph-mon[33705]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T07:24:11.394 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:10 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2501149148' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:24:11.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.567+0000 7f8cbdf03640 1 -- 172.21.15.92:0/1440018857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8105380 msgr2=0x7f8cb810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.567+0000 7f8cbdf03640 1 --2- 172.21.15.92:0/1440018857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8105380 0x7f8cb810d8d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009900 tx=0x7f8ca002a410 comp rx=0 tx=0).stop 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.567+0000 7f8cbdf03640 1 -- 172.21.15.92:0/1440018857 shutdown_connections 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.567+0000 7f8cbdf03640 1 --2- 172.21.15.92:0/1440018857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb810de60 0x7f8cb8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.567+0000 7f8cbdf03640 1 --2- 172.21.15.92:0/1440018857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8105380 0x7f8cb810d8d0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.567+0000 7f8cbdf03640 1 --2- 172.21.15.92:0/1440018857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cb8104a30 0x7f8cb8104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.567+0000 7f8cbdf03640 1 -- 172.21.15.92:0/1440018857 >> 172.21.15.92:0/1440018857 conn(0x7f8cb80797b0 msgr2=0x7f8cb8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.567+0000 7f8cbdf03640 1 -- 172.21.15.92:0/1440018857 shutdown_connections 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.567+0000 7f8cbdf03640 1 -- 172.21.15.92:0/1440018857 wait complete. 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cbdf03640 1 Processor -- start 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cbdf03640 1 -- start start 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cbdf03640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8104a30 0x7f8cb8102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cbdf03640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cb8105380 0x7f8cb8102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cbdf03640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb810de60 0x7f8cb81031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:11.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cbdf03640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb8113950 con 0x7f8cb8104a30 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cbdf03640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb81137d0 con 0x7f8cb8105380 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cbdf03640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb8113ad0 con 0x7f8cb810de60 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8104a30 0x7f8cb8102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8104a30 0x7f8cb8102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55032/0 (socket says 172.21.15.92:55032) 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.568+0000 7f8cb77fe640 1 -- 172.21.15.92:0/728738854 learned_addr learned my addr 172.21.15.92:0/728738854 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cb7fff640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb810de60 0x7f8cb81031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8caeffd640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cb8105380 0x7f8cb8102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cb77fe640 1 -- 172.21.15.92:0/728738854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb810de60 msgr2=0x7f8cb81031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cb77fe640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb810de60 0x7f8cb81031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cb77fe640 1 -- 172.21.15.92:0/728738854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cb8105380 msgr2=0x7f8cb8102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cb77fe640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cb8105380 0x7f8cb8102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cb77fe640 1 -- 172.21.15.92:0/728738854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb81a8570 con 0x7f8cb8104a30 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cb77fe640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8104a30 0x7f8cb8102770 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800c920 tx=0x7f8ca800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cb57fa640 1 -- 172.21.15.92:0/728738854 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8007c70 con 0x7f8cb8104a30 2024-09-21T07:24:11.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cb57fa640 1 -- 172.21.15.92:0/728738854 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ca8007e10 con 0x7f8cb8104a30 2024-09-21T07:24:11.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cbdf03640 1 -- 172.21.15.92:0/728738854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb81a8860 con 0x7f8cb8104a30 2024-09-21T07:24:11.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cb57fa640 1 -- 172.21.15.92:0/728738854 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8018710 con 0x7f8cb8104a30 2024-09-21T07:24:11.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.569+0000 7f8cbdf03640 1 -- 172.21.15.92:0/728738854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb81a8dc0 con 0x7f8cb8104a30 2024-09-21T07:24:11.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.570+0000 7f8cbdf03640 1 -- 172.21.15.92:0/728738854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb8104e40 con 0x7f8cb8104a30 2024-09-21T07:24:11.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.572+0000 7f8cb57fa640 1 -- 172.21.15.92:0/728738854 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f8ca800f450 con 0x7f8cb8104a30 2024-09-21T07:24:11.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.572+0000 7f8cb57fa640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8ca40b6700 0x7f8ca40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:11.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.573+0000 7f8caeffd640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8ca40b6700 0x7f8ca40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:11.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.573+0000 7f8cb57fa640 1 -- 172.21.15.92:0/728738854 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9628+0+0 (secure 0 0 0) 0x7f8ca80e7e80 con 0x7f8cb8104a30 2024-09-21T07:24:11.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.573+0000 7f8caeffd640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8ca40b6700 0x7f8ca40b8c10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0005940 tx=0x7f8ca00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:11.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.576+0000 7f8cb57fa640 1 -- 172.21.15.92:0/728738854 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ca8014030 con 0x7f8cb8104a30 2024-09-21T07:24:11.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.793+0000 7f8cbdf03640 1 -- 172.21.15.92:0/728738854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8cb8103a70 con 0x7f8cb8104a30 2024-09-21T07:24:11.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.796+0000 7f8cb57fa640 1 -- 172.21.15.92:0/728738854 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f8cb8103a70 con 0x7f8cb8104a30 2024-09-21T07:24:11.798 INFO:teuthology.orchestra.run.smithi092.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:24:11.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.799+0000 7f8cbdf03640 1 -- 172.21.15.92:0/728738854 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8ca40b6700 msgr2=0x7f8ca40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:11.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.799+0000 7f8cbdf03640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8ca40b6700 0x7f8ca40b8c10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0005940 tx=0x7f8ca00058d0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.799+0000 7f8cbdf03640 1 -- 172.21.15.92:0/728738854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8104a30 msgr2=0x7f8cb8102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:11.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.799+0000 7f8cbdf03640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8104a30 0x7f8cb8102770 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800c920 tx=0x7f8ca800cde0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.800+0000 7f8cbdf03640 1 -- 172.21.15.92:0/728738854 shutdown_connections 2024-09-21T07:24:11.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.800+0000 7f8cbdf03640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8ca40b6700 0x7f8ca40b8c10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.800+0000 7f8cbdf03640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cb810de60 0x7f8cb81031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.800+0000 7f8cbdf03640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cb8105380 0x7f8cb8102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.800+0000 7f8cbdf03640 1 --2- 172.21.15.92:0/728738854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8104a30 0x7f8cb8102770 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:11.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.800+0000 7f8cbdf03640 1 -- 172.21.15.92:0/728738854 >> 172.21.15.92:0/728738854 conn(0x7f8cb80797b0 msgr2=0x7f8cb80ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:11.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.800+0000 7f8cbdf03640 1 -- 172.21.15.92:0/728738854 shutdown_connections 2024-09-21T07:24:11.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:11.800+0000 7f8cbdf03640 1 -- 172.21.15.92:0/728738854 wait complete. 2024-09-21T07:24:11.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a[30983]: 2024-09-21T07:24:11.794+0000 7fc957b1c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:24:12.143 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k[62177]: ignoring --setuser ceph since I am not root 2024-09-21T07:24:12.143 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k[62177]: ignoring --setgroup ceph since I am not root 2024-09-21T07:24:12.143 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k[62177]: starting mds.k at 2024-09-21T07:24:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/728738854' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T07:24:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-mon[33705]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T07:24:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-mon[33705]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:24:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/728738854' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T07:24:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-mon[33705]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T07:24:12.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-mon[33705]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T07:24:12.144 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e[62462]: ignoring --setuser ceph since I am not root 2024-09-21T07:24:12.144 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e[62462]: ignoring --setgroup ceph since I am not root 2024-09-21T07:24:12.144 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-mds[62466]: -- 172.21.15.169:0/206965285 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559342729860 con 0x5593468d1180 2024-09-21T07:24:12.144 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e[62462]: starting mds.e at 2024-09-21T07:24:12.145 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h[62737]: ignoring --setuser ceph since I am not root 2024-09-21T07:24:12.145 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h[62737]: ignoring --setgroup ceph since I am not root 2024-09-21T07:24:12.145 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-mds[62741]: -- 172.21.15.169:0/3606142594 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555c79c75860 con 0x555c7de1d180 2024-09-21T07:24:12.145 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h[62737]: starting mds.h at 2024-09-21T07:24:12.145 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b[63008]: ignoring --setuser ceph since I am not root 2024-09-21T07:24:12.145 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b[63008]: ignoring --setgroup ceph since I am not root 2024-09-21T07:24:12.145 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-mds[63012]: -- 172.21.15.169:0/477568636 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555fb6563860 con 0x555fba70b600 2024-09-21T07:24:12.145 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:24:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b[63008]: starting mds.b at 2024-09-21T07:24:12.182 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/728738854' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T07:24:12.183 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-mon[30987]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T07:24:12.183 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-mon[30987]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:24:12.183 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/728738854' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T07:24:12.183 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-mon[30987]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T07:24:12.183 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-mon[30987]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T07:24:12.183 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g[72669]: ignoring --setuser ceph since I am not root 2024-09-21T07:24:12.183 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g[72669]: ignoring --setgroup ceph since I am not root 2024-09-21T07:24:12.183 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-mds[72685]: -- 172.21.15.92:0/3759823125 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649a651d860 con 0x5649aa6c5a80 2024-09-21T07:24:12.183 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:24:11 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g[72669]: starting mds.g at 2024-09-21T07:24:12.268 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: ignoring --setuser ceph since I am not root 2024-09-21T07:24:12.268 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: ignoring --setgroup ceph since I am not root 2024-09-21T07:24:12.268 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-mds[62747]: -- 172.21.15.175:0/369972502 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f6371b860 con 0x557f678c3600 2024-09-21T07:24:12.268 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: starting mds.i at 2024-09-21T07:24:12.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/728738854' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T07:24:12.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-mon[34064]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T07:24:12.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-mon[34064]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:24:12.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/728738854' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T07:24:12.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-mon[34064]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T07:24:12.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-mon[34064]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T07:24:12.269 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c[62472]: ignoring --setuser ceph since I am not root 2024-09-21T07:24:12.269 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c[62472]: ignoring --setgroup ceph since I am not root 2024-09-21T07:24:12.269 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-mds[62478]: -- 172.21.15.175:0/1436588508 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56130aebb860 con 0x56130f063180 2024-09-21T07:24:12.269 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c[62472]: starting mds.c at 2024-09-21T07:24:12.269 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f[62194]: ignoring --setuser ceph since I am not root 2024-09-21T07:24:12.269 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f[62194]: ignoring --setgroup ceph since I am not root 2024-09-21T07:24:12.270 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-mds[62198]: -- 172.21.15.175:0/4029331476 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ec63a6f860 con 0x55ec67c17600 2024-09-21T07:24:12.270 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f[62194]: starting mds.f at 2024-09-21T07:24:12.270 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l[61924]: ignoring --setuser ceph since I am not root 2024-09-21T07:24:12.270 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l[61924]: ignoring --setgroup ceph since I am not root 2024-09-21T07:24:12.270 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-mds[61928]: -- 172.21.15.175:0/346585896 <== mon.2 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d82cc45860 con 0x55d830ded180 2024-09-21T07:24:12.270 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:24:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l[61924]: starting mds.l at 2024-09-21T07:24:12.614 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:24:12.865 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:24:13.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 -- 172.21.15.92:0/70697845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c38109df0 msgr2=0x7f8c38110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:13.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 --2- 172.21.15.92:0/70697845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c38109df0 0x7f8c38110620 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009900 tx=0x7f8c3002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 -- 172.21.15.92:0/70697845 shutdown_connections 2024-09-21T07:24:13.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 --2- 172.21.15.92:0/70697845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c38109df0 0x7f8c38110620 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 --2- 172.21.15.92:0/70697845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c381094a0 0x7f8c381098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 --2- 172.21.15.92:0/70697845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c38103b60 0x7f8c38103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 -- 172.21.15.92:0/70697845 >> 172.21.15.92:0/70697845 conn(0x7f8c3807b850 msgr2=0x7f8c3807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 -- 172.21.15.92:0/70697845 shutdown_connections 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 -- 172.21.15.92:0/70697845 wait complete. 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 Processor -- start 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.326+0000 7f8c3db67640 1 -- start start 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c3db67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c38103b60 0x7f8c3819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c3db67640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c381094a0 0x7f8c3819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c3db67640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c38109df0 0x7f8c3819faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c3db67640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8c38113960 con 0x7f8c38103b60 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c3db67640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8c381137e0 con 0x7f8c38109df0 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c3db67640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8c38113ae0 con 0x7f8c381094a0 2024-09-21T07:24:13.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c377fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c38103b60 0x7f8c3819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c377fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c38103b60 0x7f8c3819a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55086/0 (socket says 172.21.15.92:55086) 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c377fe640 1 -- 172.21.15.92:0/3089174291 learned_addr learned my addr 172.21.15.92:0/3089174291 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c36ffd640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c381094a0 0x7f8c3819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c37fff640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c38109df0 0x7f8c3819faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c377fe640 1 -- 172.21.15.92:0/3089174291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c381094a0 msgr2=0x7f8c3819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c377fe640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c381094a0 0x7f8c3819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c377fe640 1 -- 172.21.15.92:0/3089174291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c38109df0 msgr2=0x7f8c3819faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c377fe640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c38109df0 0x7f8c3819faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c377fe640 1 -- 172.21.15.92:0/3089174291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c381a0160 con 0x7f8c38103b60 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.327+0000 7f8c377fe640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c38103b60 0x7f8c3819a2b0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c920 tx=0x7f8c2800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.328+0000 7f8c34ff9640 1 -- 172.21.15.92:0/3089174291 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28007c70 con 0x7f8c38103b60 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.328+0000 7f8c3db67640 1 -- 172.21.15.92:0/3089174291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c381a0450 con 0x7f8c38103b60 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.328+0000 7f8c34ff9640 1 -- 172.21.15.92:0/3089174291 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c28007e10 con 0x7f8c38103b60 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.328+0000 7f8c34ff9640 1 -- 172.21.15.92:0/3089174291 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c280186f0 con 0x7f8c38103b60 2024-09-21T07:24:13.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.328+0000 7f8c3db67640 1 -- 172.21.15.92:0/3089174291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c381a6c70 con 0x7f8c38103b60 2024-09-21T07:24:13.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.329+0000 7f8c3db67640 1 -- 172.21.15.92:0/3089174291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c38103f70 con 0x7f8c38103b60 2024-09-21T07:24:13.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.331+0000 7f8c34ff9640 1 -- 172.21.15.92:0/3089174291 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f8c2800f450 con 0x7f8c38103b60 2024-09-21T07:24:13.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.331+0000 7f8c34ff9640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c200b66b0 0x7f8c200b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:13.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.331+0000 7f8c36ffd640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c200b66b0 0x7f8c200b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:13.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.331+0000 7f8c34ff9640 1 -- 172.21.15.92:0/3089174291 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9970+0+0 (secure 0 0 0) 0x7f8c280e81a0 con 0x7f8c38103b60 2024-09-21T07:24:13.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.332+0000 7f8c36ffd640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c200b66b0 0x7f8c200b8bc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c007350 tx=0x7f8c2c0072e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:13.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.335+0000 7f8c34ff9640 1 -- 172.21.15.92:0/3089174291 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c28014030 con 0x7f8c38103b60 2024-09-21T07:24:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.551+0000 7f8c3db67640 1 -- 172.21.15.92:0/3089174291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8c3802e640 con 0x7f8c38103b60 2024-09-21T07:24:13.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.809+0000 7f8c34ff9640 1 -- 172.21.15.92:0/3089174291 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f8c280ae1d0 con 0x7f8c38103b60 2024-09-21T07:24:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 -- 172.21.15.92:0/3089174291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c200b66b0 msgr2=0x7f8c200b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c200b66b0 0x7f8c200b8bc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c007350 tx=0x7f8c2c0072e0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 -- 172.21.15.92:0/3089174291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c38103b60 msgr2=0x7f8c3819a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c38103b60 0x7f8c3819a2b0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c920 tx=0x7f8c2800cde0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 -- 172.21.15.92:0/3089174291 shutdown_connections 2024-09-21T07:24:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f8c200b66b0 0x7f8c200b8bc0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c38109df0 0x7f8c3819faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c381094a0 0x7f8c3819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 --2- 172.21.15.92:0/3089174291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c38103b60 0x7f8c3819a2b0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 -- 172.21.15.92:0/3089174291 >> 172.21.15.92:0/3089174291 conn(0x7f8c3807b850 msgr2=0x7f8c38107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:13.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 -- 172.21.15.92:0/3089174291 shutdown_connections 2024-09-21T07:24:13.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:13.812+0000 7f8c3db67640 1 -- 172.21.15.92:0/3089174291 wait complete. 2024-09-21T07:24:14.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: pgmap v683: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T07:24:14.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.169:6833/2405689632,v1:172.21.15.169:6834/2405689632] up:boot 2024-09-21T07:24:14.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6832/3815143595,v1:172.21.15.175:6833/3815143595] up:boot 2024-09-21T07:24:14.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.169:6832/1162627498,v1:172.21.15.169:6835/1162627498] up:boot 2024-09-21T07:24:14.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.169:6836/1140137181,v1:172.21.15.169:6837/1140137181] up:boot 2024-09-21T07:24:14.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6834/4003621498,v1:172.21.15.175:6835/4003621498] up:boot 2024-09-21T07:24:14.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.169:6838/3007124809,v1:172.21.15.169:6839/3007124809] up:boot 2024-09-21T07:24:14.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.92:6838/1063317353,v1:172.21.15.92:6840/1063317353] up:boot 2024-09-21T07:24:14.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.92:6839/2578795425,v1:172.21.15.92:6841/2578795425] up:boot 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6836/3945588177,v1:172.21.15.175:6837/3945588177] up:boot 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: mds.? [v2:172.21.15.175:6838/2442469578,v1:172.21.15.175:6839/2442469578] up:boot 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:24:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:24:14.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:13 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3089174291' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:24:14.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: pgmap v683: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.169:6833/2405689632,v1:172.21.15.169:6834/2405689632] up:boot 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6832/3815143595,v1:172.21.15.175:6833/3815143595] up:boot 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.169:6832/1162627498,v1:172.21.15.169:6835/1162627498] up:boot 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.169:6836/1140137181,v1:172.21.15.169:6837/1140137181] up:boot 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6834/4003621498,v1:172.21.15.175:6835/4003621498] up:boot 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.169:6838/3007124809,v1:172.21.15.169:6839/3007124809] up:boot 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.92:6838/1063317353,v1:172.21.15.92:6840/1063317353] up:boot 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.92:6839/2578795425,v1:172.21.15.92:6841/2578795425] up:boot 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6836/3945588177,v1:172.21.15.175:6837/3945588177] up:boot 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: mds.? [v2:172.21.15.175:6838/2442469578,v1:172.21.15.175:6839/2442469578] up:boot 2024-09-21T07:24:14.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:24:14.145 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:13 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3089174291' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:24:14.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: pgmap v683: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T07:24:14.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.169:6833/2405689632,v1:172.21.15.169:6834/2405689632] up:boot 2024-09-21T07:24:14.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6832/3815143595,v1:172.21.15.175:6833/3815143595] up:boot 2024-09-21T07:24:14.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.169:6832/1162627498,v1:172.21.15.169:6835/1162627498] up:boot 2024-09-21T07:24:14.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.169:6836/1140137181,v1:172.21.15.169:6837/1140137181] up:boot 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6834/4003621498,v1:172.21.15.175:6835/4003621498] up:boot 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.169:6838/3007124809,v1:172.21.15.169:6839/3007124809] up:boot 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.92:6838/1063317353,v1:172.21.15.92:6840/1063317353] up:boot 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.92:6839/2578795425,v1:172.21.15.92:6841/2578795425] up:boot 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6836/3945588177,v1:172.21.15.175:6837/3945588177] up:boot 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: mds.? [v2:172.21.15.175:6838/2442469578,v1:172.21.15.175:6839/2442469578] up:boot 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:24:14.269 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:24:14.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:24:14.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:24:14.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='mgr.14223 172.21.15.92:0/3624312390' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:24:14.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:13 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3089174291' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:24:14.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:24:14.849 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:24:14.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:14 smithi092 ceph-mon[30987]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T07:24:14.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:14 smithi092 ceph-mon[30987]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T07:24:14.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:14 smithi092 ceph-mon[30987]: Cluster is now healthy 2024-09-21T07:24:14.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:14 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/3089174291' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:24:14.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:14 smithi092 ceph-mon[30987]: fsmap 12 up:standby 2024-09-21T07:24:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:14 smithi169 ceph-mon[33705]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T07:24:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:14 smithi169 ceph-mon[33705]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T07:24:15.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:14 smithi169 ceph-mon[33705]: Cluster is now healthy 2024-09-21T07:24:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:14 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/3089174291' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:24:15.144 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:14 smithi169 ceph-mon[33705]: fsmap 12 up:standby 2024-09-21T07:24:15.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:14 smithi175 ceph-mon[34064]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T07:24:15.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:14 smithi175 ceph-mon[34064]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T07:24:15.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:14 smithi175 ceph-mon[34064]: Cluster is now healthy 2024-09-21T07:24:15.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:14 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/3089174291' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:24:15.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:14 smithi175 ceph-mon[34064]: fsmap 12 up:standby 2024-09-21T07:24:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.328+0000 7f029583e640 1 -- 172.21.15.92:0/1802184975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0290103230 msgr2=0x7f0290103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.328+0000 7f029583e640 1 --2- 172.21.15.92:0/1802184975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0290103230 0x7f0290103640 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f0280009ca0 tx=0x7f028002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.329+0000 7f029583e640 1 -- 172.21.15.92:0/1802184975 shutdown_connections 2024-09-21T07:24:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.329+0000 7f029583e640 1 --2- 172.21.15.92:0/1802184975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0290108db0 0x7f029010f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.329+0000 7f029583e640 1 --2- 172.21.15.92:0/1802184975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0290108460 0x7f0290108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.329+0000 7f029583e640 1 --2- 172.21.15.92:0/1802184975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0290103230 0x7f0290103640 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.329+0000 7f029583e640 1 -- 172.21.15.92:0/1802184975 >> 172.21.15.92:0/1802184975 conn(0x7f0290079ec0 msgr2=0x7f029007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.329+0000 7f029583e640 1 -- 172.21.15.92:0/1802184975 shutdown_connections 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.329+0000 7f029583e640 1 -- 172.21.15.92:0/1802184975 wait complete. 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.329+0000 7f029583e640 1 Processor -- start 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f029583e640 1 -- start start 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f029583e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0290103230 0x7f0290199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f029583e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0290108460 0x7f0290199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f029583e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0290108db0 0x7f029019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f029583e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0290112970 con 0x7f0290103230 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f029583e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02901127f0 con 0x7f0290108db0 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f029583e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0290112af0 con 0x7f0290108460 2024-09-21T07:24:15.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0290103230 0x7f0290199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0290103230 0x7f0290199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55100/0 (socket says 172.21.15.92:55100) 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028effd640 1 -- 172.21.15.92:0/2386817255 learned_addr learned my addr 172.21.15.92:0/2386817255 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028e7fc640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0290108460 0x7f0290199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028f7fe640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0290108db0 0x7f029019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028effd640 1 -- 172.21.15.92:0/2386817255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0290108460 msgr2=0x7f0290199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028effd640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0290108460 0x7f0290199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028effd640 1 -- 172.21.15.92:0/2386817255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0290108db0 msgr2=0x7f029019ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028effd640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0290108db0 0x7f029019ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028effd640 1 -- 172.21.15.92:0/2386817255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029019f2f0 con 0x7f0290103230 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.330+0000 7f028f7fe640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0290108db0 0x7f029019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.331+0000 7f028effd640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0290103230 0x7f0290199380 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0280009dc0 tx=0x7f0280032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.331+0000 7f029483c640 1 -- 172.21.15.92:0/2386817255 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280004040 con 0x7f0290103230 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.331+0000 7f029483c640 1 -- 172.21.15.92:0/2386817255 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0280004670 con 0x7f0290103230 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.331+0000 7f029583e640 1 -- 172.21.15.92:0/2386817255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029019f580 con 0x7f0290103230 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.331+0000 7f029483c640 1 -- 172.21.15.92:0/2386817255 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280030c80 con 0x7f0290103230 2024-09-21T07:24:15.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.331+0000 7f029583e640 1 -- 172.21.15.92:0/2386817255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02901a5d40 con 0x7f0290103230 2024-09-21T07:24:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.332+0000 7f029583e640 1 -- 172.21.15.92:0/2386817255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0290103640 con 0x7f0290103230 2024-09-21T07:24:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.333+0000 7f029483c640 1 -- 172.21.15.92:0/2386817255 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f02800041e0 con 0x7f0290103230 2024-09-21T07:24:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.334+0000 7f029483c640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f02780b6680 0x7f02780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.334+0000 7f028e7fc640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f02780b6680 0x7f02780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.334+0000 7f029483c640 1 -- 172.21.15.92:0/2386817255 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9970+0+0 (secure 0 0 0) 0x7f0280109000 con 0x7f0290103230 2024-09-21T07:24:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.334+0000 7f028e7fc640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f02780b6680 0x7f02780b8b90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0284005fd0 tx=0x7f0284005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.338+0000 7f029483c640 1 -- 172.21.15.92:0/2386817255 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02800cefa0 con 0x7f0290103230 2024-09-21T07:24:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.515+0000 7f029583e640 1 -- 172.21.15.92:0/2386817255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f029010abe0 con 0x7f0290103230 2024-09-21T07:24:15.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.812+0000 7f029483c640 1 -- 172.21.15.92:0/2386817255 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) ==== 181+0+0 (secure 0 0 0) 0x7f0280004820 con 0x7f0290103230 2024-09-21T07:24:15.814 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:24:15.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.814+0000 7f029583e640 1 -- 172.21.15.92:0/2386817255 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f02780b6680 msgr2=0x7f02780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:15.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.814+0000 7f029583e640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f02780b6680 0x7f02780b8b90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0284005fd0 tx=0x7f0284005850 comp rx=0 tx=0).stop 2024-09-21T07:24:15.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.814+0000 7f029583e640 1 -- 172.21.15.92:0/2386817255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0290103230 msgr2=0x7f0290199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:15.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.814+0000 7f029583e640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0290103230 0x7f0290199380 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0280009dc0 tx=0x7f0280032bc0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.815+0000 7f029583e640 1 -- 172.21.15.92:0/2386817255 shutdown_connections 2024-09-21T07:24:15.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.815+0000 7f029583e640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f02780b6680 0x7f02780b8b90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.815+0000 7f029583e640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0290108db0 0x7f029019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.815+0000 7f029583e640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0290108460 0x7f0290199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.815+0000 7f029583e640 1 --2- 172.21.15.92:0/2386817255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0290103230 0x7f0290199380 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:15.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.815+0000 7f029583e640 1 -- 172.21.15.92:0/2386817255 >> 172.21.15.92:0/2386817255 conn(0x7f0290079ec0 msgr2=0x7f02901064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:15.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.816+0000 7f029583e640 1 -- 172.21.15.92:0/2386817255 shutdown_connections 2024-09-21T07:24:15.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:15.816+0000 7f029583e640 1 -- 172.21.15.92:0/2386817255 wait complete. 2024-09-21T07:24:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:15 smithi092 ceph-mon[30987]: pgmap v684: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:24:16.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:15 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2386817255' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:24:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:15 smithi169 ceph-mon[33705]: pgmap v684: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:24:16.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:15 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2386817255' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:24:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:15 smithi175 ceph-mon[34064]: pgmap v684: 129 pgs: 129 active+clean; 2.1 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:24:16.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:15 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2386817255' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:24:16.652 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:24:16.902 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:24:17.023 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:16 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2386817255' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:24:17.023 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:16 smithi092 ceph-mon[30987]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T07:24:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:16 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2386817255' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:24:17.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:16 smithi169 ceph-mon[33705]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T07:24:17.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:16 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2386817255' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:24:17.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:16 smithi175 ceph-mon[34064]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T07:24:17.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.363+0000 7f911a0ca640 1 -- 172.21.15.92:0/2898618615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9114102a60 msgr2=0x7f9114102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:17.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.363+0000 7f911a0ca640 1 --2- 172.21.15.92:0/2898618615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9114102a60 0x7f9114102e70 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f9104009ca0 tx=0x7f910402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.363+0000 7f911a0ca640 1 -- 172.21.15.92:0/2898618615 shutdown_connections 2024-09-21T07:24:17.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.363+0000 7f911a0ca640 1 --2- 172.21.15.92:0/2898618615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9114108cf0 0x7f911410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.363+0000 7f911a0ca640 1 --2- 172.21.15.92:0/2898618615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91141083a0 0x7f91141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.363+0000 7f911a0ca640 1 --2- 172.21.15.92:0/2898618615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9114102a60 0x7f9114102e70 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.363+0000 7f911a0ca640 1 -- 172.21.15.92:0/2898618615 >> 172.21.15.92:0/2898618615 conn(0x7f9114079730 msgr2=0x7f9114079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:17.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.363+0000 7f911a0ca640 1 -- 172.21.15.92:0/2898618615 shutdown_connections 2024-09-21T07:24:17.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.363+0000 7f911a0ca640 1 -- 172.21.15.92:0/2898618615 wait complete. 2024-09-21T07:24:17.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.364+0000 7f911a0ca640 1 Processor -- start 2024-09-21T07:24:17.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.364+0000 7f911a0ca640 1 -- start start 2024-09-21T07:24:17.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.364+0000 7f911a0ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9114102a60 0x7f911419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.364+0000 7f911a0ca640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91141083a0 0x7f911419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.364+0000 7f911a0ca640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9114108cf0 0x7f911419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.364+0000 7f911a0ca640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9114113960 con 0x7f9114102a60 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.364+0000 7f911a0ca640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91141137e0 con 0x7f91141083a0 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.364+0000 7f911a0ca640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9114113ae0 con 0x7f9114108cf0 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f91137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9114102a60 0x7f911419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f91137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9114102a60 0x7f911419a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55118/0 (socket says 172.21.15.92:55118) 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f91137fe640 1 -- 172.21.15.92:0/2139721201 learned_addr learned my addr 172.21.15.92:0/2139721201 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f9113fff640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9114108cf0 0x7f911419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f9112ffd640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91141083a0 0x7f911419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f91137fe640 1 -- 172.21.15.92:0/2139721201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9114108cf0 msgr2=0x7f911419fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f91137fe640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9114108cf0 0x7f911419fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f91137fe640 1 -- 172.21.15.92:0/2139721201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91141083a0 msgr2=0x7f911419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:17.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f91137fe640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91141083a0 0x7f911419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f91137fe640 1 -- 172.21.15.92:0/2139721201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91141a0320 con 0x7f9114102a60 2024-09-21T07:24:17.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f91137fe640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9114102a60 0x7f911419a3b0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f9104006010 tx=0x7f9104032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:17.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f9110ff9640 1 -- 172.21.15.92:0/2139721201 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104004040 con 0x7f9114102a60 2024-09-21T07:24:17.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f9110ff9640 1 -- 172.21.15.92:0/2139721201 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9104004670 con 0x7f9114102a60 2024-09-21T07:24:17.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f911a0ca640 1 -- 172.21.15.92:0/2139721201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91141a05b0 con 0x7f9114102a60 2024-09-21T07:24:17.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f9110ff9640 1 -- 172.21.15.92:0/2139721201 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104030da0 con 0x7f9114102a60 2024-09-21T07:24:17.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.365+0000 7f911a0ca640 1 -- 172.21.15.92:0/2139721201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91141a6d70 con 0x7f9114102a60 2024-09-21T07:24:17.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.366+0000 7f911a0ca640 1 -- 172.21.15.92:0/2139721201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9114102e70 con 0x7f9114102a60 2024-09-21T07:24:17.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.369+0000 7f9110ff9640 1 -- 172.21.15.92:0/2139721201 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7f91040305c0 con 0x7f9114102a60 2024-09-21T07:24:17.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.369+0000 7f9110ff9640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f90fc0b6680 0x7f90fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:17.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.370+0000 7f9112ffd640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f90fc0b6680 0x7f90fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:17.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.370+0000 7f9110ff9640 1 -- 172.21.15.92:0/2139721201 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9445+0+0 (secure 0 0 0) 0x7f9104109090 con 0x7f9114102a60 2024-09-21T07:24:17.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.370+0000 7f9112ffd640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f90fc0b6680 0x7f90fc0b8b90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9114100cc0 tx=0x7f910800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:17.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.373+0000 7f9110ff9640 1 -- 172.21.15.92:0/2139721201 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9104004820 con 0x7f9114102a60 2024-09-21T07:24:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.550+0000 7f911a0ca640 1 -- 172.21.15.92:0/2139721201 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f911419b4e0 con 0x7f9114102a60 2024-09-21T07:24:17.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.827+0000 7f9110ff9640 1 -- 172.21.15.92:0/2139721201 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) ==== 169+0+0 (secure 0 0 0) 0x7f91040cf240 con 0x7f9114102a60 2024-09-21T07:24:17.830 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' removed 2024-09-21T07:24:17.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 -- 172.21.15.92:0/2139721201 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f90fc0b6680 msgr2=0x7f90fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:17.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f90fc0b6680 0x7f90fc0b8b90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9114100cc0 tx=0x7f910800a2d0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 -- 172.21.15.92:0/2139721201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9114102a60 msgr2=0x7f911419a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:17.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9114102a60 0x7f911419a3b0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f9104006010 tx=0x7f9104032bc0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 -- 172.21.15.92:0/2139721201 shutdown_connections 2024-09-21T07:24:17.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7f90fc0b6680 0x7f90fc0b8b90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9114108cf0 0x7f911419fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91141083a0 0x7f911419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 --2- 172.21.15.92:0/2139721201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9114102a60 0x7f911419a3b0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:17.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 -- 172.21.15.92:0/2139721201 >> 172.21.15.92:0/2139721201 conn(0x7f9114079730 msgr2=0x7f91141014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:17.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 -- 172.21.15.92:0/2139721201 shutdown_connections 2024-09-21T07:24:17.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:17.830+0000 7f911a0ca640 1 -- 172.21.15.92:0/2139721201 wait complete. 2024-09-21T07:24:18.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:17 smithi092 ceph-mon[30987]: pgmap v686: 97 pgs: 97 active+clean; 577 KiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:24:18.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:17 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2139721201' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:24:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:17 smithi169 ceph-mon[33705]: pgmap v686: 97 pgs: 97 active+clean; 577 KiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:24:18.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:17 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2139721201' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:24:18.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:17 smithi175 ceph-mon[34064]: pgmap v686: 97 pgs: 97 active+clean; 577 KiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:24:18.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:17 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2139721201' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:24:18.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T07:24:18.934 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:24:19.055 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:18 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/2139721201' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:24:19.055 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:18 smithi092 ceph-mon[30987]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T07:24:19.055 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:18 smithi092 ceph-mon[30987]: pgmap v688: 33 pgs: 33 active+clean; 577 KiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:24:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:18 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/2139721201' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:24:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:18 smithi169 ceph-mon[33705]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T07:24:19.143 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:18 smithi169 ceph-mon[33705]: pgmap v688: 33 pgs: 33 active+clean; 577 KiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:24:19.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:18 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/2139721201' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:24:19.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:18 smithi175 ceph-mon[34064]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T07:24:19.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:18 smithi175 ceph-mon[34064]: pgmap v688: 33 pgs: 33 active+clean; 577 KiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:24:19.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.439+0000 7fa9dd777640 1 -- 172.21.15.92:0/2036744329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d81083a0 msgr2=0x7fa9d81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:19.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.439+0000 7fa9dd777640 1 --2- 172.21.15.92:0/2036744329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d81083a0 0x7fa9d81087b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009900 tx=0x7fa9c002a410 comp rx=0 tx=0).stop 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.439+0000 7fa9dd777640 1 -- 172.21.15.92:0/2036744329 shutdown_connections 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.439+0000 7fa9dd777640 1 --2- 172.21.15.92:0/2036744329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d8108cf0 0x7fa9d810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.439+0000 7fa9dd777640 1 --2- 172.21.15.92:0/2036744329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d81083a0 0x7fa9d81087b0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.439+0000 7fa9dd777640 1 --2- 172.21.15.92:0/2036744329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9d8102a60 0x7fa9d8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.439+0000 7fa9dd777640 1 -- 172.21.15.92:0/2036744329 >> 172.21.15.92:0/2036744329 conn(0x7fa9d8079730 msgr2=0x7fa9d8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.439+0000 7fa9dd777640 1 -- 172.21.15.92:0/2036744329 shutdown_connections 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.439+0000 7fa9dd777640 1 -- 172.21.15.92:0/2036744329 wait complete. 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.439+0000 7fa9dd777640 1 Processor -- start 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9dd777640 1 -- start start 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9dd777640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102a60 0x7fa9d819b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9dd777640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d81083a0 0x7fa9d819b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9dd777640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9d8108cf0 0x7fa9d819bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9dd777640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d8112810 con 0x7fa9d8102a60 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9dd777640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d8112690 con 0x7fa9d8108cf0 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9dd777640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d8112990 con 0x7fa9d81083a0 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9d6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102a60 0x7fa9d819b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9d6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102a60 0x7fa9d819b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55140/0 (socket says 172.21.15.92:55140) 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9d6ffd640 1 -- 172.21.15.92:0/927156981 learned_addr learned my addr 172.21.15.92:0/927156981 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9d77fe640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9d8108cf0 0x7fa9d819bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9d67fc640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d81083a0 0x7fa9d819b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9d6ffd640 1 -- 172.21.15.92:0/927156981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d81083a0 msgr2=0x7fa9d819b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9d6ffd640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d81083a0 0x7fa9d819b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9d6ffd640 1 -- 172.21.15.92:0/927156981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9d8108cf0 msgr2=0x7fa9d819bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:19.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9d6ffd640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9d8108cf0 0x7fa9d819bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.440+0000 7fa9d6ffd640 1 -- 172.21.15.92:0/927156981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d81a64e0 con 0x7fa9d8102a60 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.441+0000 7fa9d6ffd640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102a60 0x7fa9d819b220 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800eab0 tx=0x7fa9c800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.441+0000 7fa9cffff640 1 -- 172.21.15.92:0/927156981 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800ce40 con 0x7fa9d8102a60 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.441+0000 7fa9cffff640 1 -- 172.21.15.92:0/927156981 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9c8011900 con 0x7fa9d8102a60 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.441+0000 7fa9dd777640 1 -- 172.21.15.92:0/927156981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d81a67d0 con 0x7fa9d8102a60 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.441+0000 7fa9cffff640 1 -- 172.21.15.92:0/927156981 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8010990 con 0x7fa9d8102a60 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.441+0000 7fa9dd777640 1 -- 172.21.15.92:0/927156981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d81a6ce0 con 0x7fa9d8102a60 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.442+0000 7fa9dd777640 1 -- 172.21.15.92:0/927156981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d8102e70 con 0x7fa9d8102a60 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.443+0000 7fa9cffff640 1 -- 172.21.15.92:0/927156981 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 26) ==== 154643+0+0 (secure 0 0 0) 0x7fa9c8011470 con 0x7fa9d8102a60 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.444+0000 7fa9cffff640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9c40b6680 0x7fa9c40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.444+0000 7fa9d67fc640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9c40b6680 0x7fa9c40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.445+0000 7fa9cffff640 1 -- 172.21.15.92:0/927156981 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8799+0+0 (secure 0 0 0) 0x7fa9c80e7ea0 con 0x7fa9d8102a60 2024-09-21T07:24:19.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.445+0000 7fa9d67fc640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9c40b6680 0x7fa9c40b8b90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0006010 tx=0x7fa9c0032ba0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:24:19.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.448+0000 7fa9cffff640 1 -- 172.21.15.92:0/927156981 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9c8016030 con 0x7fa9d8102a60 2024-09-21T07:24:19.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:19.633+0000 7fa9dd777640 1 -- 172.21.15.92:0/927156981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa9d806b290 con 0x7fa9d8102a60 2024-09-21T07:24:20.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.490+0000 7fa9cffff640 1 -- 172.21.15.92:0/927156981 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v100) ==== 178+0+0 (secure 0 0 0) 0x7fa9c80ae280 con 0x7fa9d8102a60 2024-09-21T07:24:20.492 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data_ec' removed 2024-09-21T07:24:20.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.493+0000 7fa9dd777640 1 -- 172.21.15.92:0/927156981 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9c40b6680 msgr2=0x7fa9c40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:20.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.493+0000 7fa9dd777640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9c40b6680 0x7fa9c40b8b90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0006010 tx=0x7fa9c0032ba0 comp rx=0 tx=0).stop 2024-09-21T07:24:20.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.493+0000 7fa9dd777640 1 -- 172.21.15.92:0/927156981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102a60 msgr2=0x7fa9d819b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:24:20.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.493+0000 7fa9dd777640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102a60 0x7fa9d819b220 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800eab0 tx=0x7fa9c800ef70 comp rx=0 tx=0).stop 2024-09-21T07:24:20.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.494+0000 7fa9dd777640 1 -- 172.21.15.92:0/927156981 shutdown_connections 2024-09-21T07:24:20.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.494+0000 7fa9dd777640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.92:6800/3526511181,v1:172.21.15.92:6801/3526511181] conn(0x7fa9c40b6680 0x7fa9c40b8b90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:20.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.494+0000 7fa9dd777640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9d8108cf0 0x7fa9d819bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:20.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.494+0000 7fa9dd777640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d81083a0 0x7fa9d819b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:20.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.494+0000 7fa9dd777640 1 --2- 172.21.15.92:0/927156981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102a60 0x7fa9d819b220 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:24:20.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.494+0000 7fa9dd777640 1 -- 172.21.15.92:0/927156981 >> 172.21.15.92:0/927156981 conn(0x7fa9d8079730 msgr2=0x7fa9d8104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:24:20.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.495+0000 7fa9dd777640 1 -- 172.21.15.92:0/927156981 shutdown_connections 2024-09-21T07:24:20.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-21T07:24:20.495+0000 7fa9dd777640 1 -- 172.21.15.92:0/927156981 wait complete. 2024-09-21T07:24:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:20 smithi175 ceph-mon[34064]: osdmap e99: 12 total, 12 up, 12 in 2024-09-21T07:24:20.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:20 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/927156981' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:24:20.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:20 smithi092 ceph-mon[30987]: osdmap e99: 12 total, 12 up, 12 in 2024-09-21T07:24:20.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:20 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/927156981' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:24:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:20 smithi169 ceph-mon[33705]: osdmap e99: 12 total, 12 up, 12 in 2024-09-21T07:24:20.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:20 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/927156981' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:24:21.183 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:24:21.209 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:24:21.240 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:24:21.272 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T07:24:21.272 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:24:21.288 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:24:21.304 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:24:21.330 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T07:24:21.330 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T07:24:21.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.a 2024-09-21T07:24:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:21 smithi092 systemd[1]: Stopping Ceph mon.a for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:24:21.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:21 smithi175 ceph-mon[34064]: pgmap v690: 33 pgs: 33 active+clean; 577 KiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:24:21.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:21 smithi175 ceph-mon[34064]: from='client.? 172.21.15.92:0/927156981' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:24:21.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:21 smithi175 ceph-mon[34064]: osdmap e100: 12 total, 12 up, 12 in 2024-09-21T07:24:21.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:21 smithi092 ceph-mon[30987]: pgmap v690: 33 pgs: 33 active+clean; 577 KiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:24:21.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:21 smithi092 ceph-mon[30987]: from='client.? 172.21.15.92:0/927156981' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:24:21.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:21 smithi092 ceph-mon[30987]: osdmap e100: 12 total, 12 up, 12 in 2024-09-21T07:24:21.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:21 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a[30983]: 2024-09-21T07:24:21.639+0000 7fc95d327640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:21.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:21 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a[30983]: 2024-09-21T07:24:21.639+0000 7fc95d327640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T07:24:21.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:21 smithi169 ceph-mon[33705]: pgmap v690: 33 pgs: 33 active+clean; 577 KiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:24:21.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:21 smithi169 ceph-mon[33705]: from='client.? 172.21.15.92:0/927156981' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:24:21.893 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:21 smithi169 ceph-mon[33705]: osdmap e100: 12 total, 12 up, 12 in 2024-09-21T07:24:22.067 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:21 smithi092 podman[112866]: 2024-09-21 07:24:21.753341808 +0000 UTC m=+0.233603234 container died a452205d9dca1fc95cf76ebe1064e6ef8940b953eb3303ac93afb3ed367da69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T07:24:22.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:22 smithi092 podman[112866]: 2024-09-21 07:24:22.165491082 +0000 UTC m=+0.645752509 container cleanup a452205d9dca1fc95cf76ebe1064e6ef8940b953eb3303ac93afb3ed367da69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T07:24:22.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:22 smithi092 bash[112866]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a 2024-09-21T07:24:22.637 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T07:24:22.659 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:22 smithi092 podman[112880]: 2024-09-21 07:24:22.400597535 +0000 UTC m=+0.649713692 container remove a452205d9dca1fc95cf76ebe1064e6ef8940b953eb3303ac93afb3ed367da69e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T07:24:22.659 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:22 smithi092 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T07:24:22.659 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:22 smithi092 systemd[1]: Stopped Ceph mon.a for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:24:22.659 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 21 07:24:22 smithi092 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.a.service: Consumed 21.555s CPU time. 2024-09-21T07:24:22.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:22.681 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T07:24:22.681 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T07:24:22.681 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.b 2024-09-21T07:24:23.003 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:22 smithi169 systemd[1]: Stopping Ceph mon.b for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:24:23.312 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:23 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-b[33701]: 2024-09-21T07:24:23.001+0000 7f8e37777640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:23.312 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:23 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-b[33701]: 2024-09-21T07:24:23.001+0000 7f8e37777640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T07:24:23.312 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:23 smithi169 podman[66501]: 2024-09-21 07:24:23.053006776 +0000 UTC m=+0.176402995 container died 20f3cdf1dfe80ec0de622a7cb06fb544dce3f27e6b37837fc69ca23fe61587ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-b, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T07:24:23.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:23 smithi169 podman[66501]: 2024-09-21 07:24:23.410260438 +0000 UTC m=+0.533656661 container cleanup 20f3cdf1dfe80ec0de622a7cb06fb544dce3f27e6b37837fc69ca23fe61587ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T07:24:23.643 INFO:journalctl@ceph.mon.b.smithi169.stdout:Sep 21 07:24:23 smithi169 bash[66501]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-b 2024-09-21T07:24:23.873 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T07:24:23.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:23.915 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T07:24:23.915 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T07:24:23.916 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.c 2024-09-21T07:24:24.259 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:23 smithi175 systemd[1]: Stopping Ceph mon.c for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:24:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:24 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-c[34060]: 2024-09-21T07:24:24.257+0000 7f1bb0780640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:24 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-c[34060]: 2024-09-21T07:24:24.257+0000 7f1bb0780640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T07:24:24.518 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:24 smithi175 podman[66107]: 2024-09-21 07:24:24.38058158 +0000 UTC m=+0.256166129 container died 03a4403fc4cc71279b2ff4fc4c3f86314c33d26be3acbc325adf501a91ce3f46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T07:24:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:24 smithi175 podman[66107]: 2024-09-21 07:24:24.8336256 +0000 UTC m=+0.709210138 container cleanup 03a4403fc4cc71279b2ff4fc4c3f86314c33d26be3acbc325adf501a91ce3f46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-21T07:24:25.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:24 smithi175 bash[66107]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-c 2024-09-21T07:24:25.311 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T07:24:25.333 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:25 smithi175 podman[66119]: 2024-09-21 07:24:25.069037139 +0000 UTC m=+0.690235692 container remove 03a4403fc4cc71279b2ff4fc4c3f86314c33d26be3acbc325adf501a91ce3f46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T07:24:25.334 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:25 smithi175 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.c.service: Deactivated successfully. 2024-09-21T07:24:25.334 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:25 smithi175 systemd[1]: Stopped Ceph mon.c for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:24:25.334 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 21 07:24:25 smithi175 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mon.c.service: Consumed 13.580s CPU time. 2024-09-21T07:24:25.363 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:25.363 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T07:24:25.363 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T07:24:25.363 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.x 2024-09-21T07:24:25.672 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:24:25 smithi092 systemd[1]: Stopping Ceph mgr.x for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:24:25.989 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:24:25 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x[31219]: 2024-09-21T07:24:25.669+0000 7fc7ed077640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:25.989 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:24:25 smithi092 podman[112988]: 2024-09-21 07:24:25.711091993 +0000 UTC m=+0.158994626 container died 91da80ed985b8752eb172b43fffdf870e43711d2c1893cc6844687b374f6b16a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T07:24:26.357 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:24:26 smithi092 podman[112988]: 2024-09-21 07:24:26.087336526 +0000 UTC m=+0.535239149 container cleanup 91da80ed985b8752eb172b43fffdf870e43711d2c1893cc6844687b374f6b16a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:24:26.357 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 21 07:24:26 smithi092 bash[112988]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-x 2024-09-21T07:24:26.509 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T07:24:26.544 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:26.544 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T07:24:26.544 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T07:24:26.545 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.y 2024-09-21T07:24:26.878 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:24:26 smithi169 systemd[1]: Stopping Ceph mgr.y for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:24:27.143 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:24:26 smithi169 podman[66623]: 2024-09-21 07:24:26.877442571 +0000 UTC m=+0.139005651 container died 1d315b83ec9111c03215a4cb38fc7bcbdbf4ba17e035888cce57db40eb6a1d82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T07:24:27.535 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:24:27 smithi169 podman[66623]: 2024-09-21 07:24:27.290737295 +0000 UTC m=+0.552300377 container cleanup 1d315b83ec9111c03215a4cb38fc7bcbdbf4ba17e035888cce57db40eb6a1d82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T07:24:27.535 INFO:journalctl@ceph.mgr.y.smithi169.stdout:Sep 21 07:24:27 smithi169 bash[66623]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-y 2024-09-21T07:24:27.708 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T07:24:27.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:27.744 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T07:24:27.744 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T07:24:27.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.z 2024-09-21T07:24:28.178 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:24:27 smithi175 systemd[1]: Stopping Ceph mgr.z for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:24:28.474 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:24:28 smithi175 podman[66227]: 2024-09-21 07:24:28.176546941 +0000 UTC m=+0.237290721 container died aab098ccbcb889459806ff20ebfc877d59ff131abd8b7e3833997c3788802fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-z, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T07:24:28.768 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:24:28 smithi175 podman[66227]: 2024-09-21 07:24:28.573071398 +0000 UTC m=+0.633815178 container cleanup aab098ccbcb889459806ff20ebfc877d59ff131abd8b7e3833997c3788802fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-z, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T07:24:28.768 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 21 07:24:28 smithi175 bash[66227]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mgr-z 2024-09-21T07:24:29.034 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T07:24:29.068 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:29.068 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T07:24:29.068 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T07:24:29.068 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.0 2024-09-21T07:24:29.362 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:29 smithi092 systemd[1]: Stopping Ceph osd.0 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:24:29.862 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:29 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0[47459]: 2024-09-21T07:24:29.383+0000 7f4e63d48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:29.862 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:29 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0[47459]: 2024-09-21T07:24:29.383+0000 7f4e63d48640 -1 osd.0 100 *** Got signal Terminated *** 2024-09-21T07:24:29.863 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:29 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0[47459]: 2024-09-21T07:24:29.383+0000 7f4e63d48640 -1 osd.0 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:24:35.078 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:34 smithi092 podman[113110]: 2024-09-21 07:24:34.794641108 +0000 UTC m=+5.535451920 container died e1181f18ffcf5c7d5c94b7b6979d92338b2779d11408c8cc3c5a5557101188d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T07:24:35.362 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:35 smithi092 podman[113110]: 2024-09-21 07:24:35.167400207 +0000 UTC m=+5.908211018 container cleanup e1181f18ffcf5c7d5c94b7b6979d92338b2779d11408c8cc3c5a5557101188d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:24:35.362 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:35 smithi092 bash[113110]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0 2024-09-21T07:24:35.788 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:35 smithi092 podman[113125]: 2024-09-21 07:24:35.452429193 +0000 UTC m=+0.657133105 container remove e1181f18ffcf5c7d5c94b7b6979d92338b2779d11408c8cc3c5a5557101188d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T07:24:36.065 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:35 smithi092 podman[113214]: 2024-09-21 07:24:35.689765226 +0000 UTC m=+0.016347411 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:24:36.065 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:35 smithi092 podman[113214]: 2024-09-21 07:24:35.803234978 +0000 UTC m=+0.129817150 container create 2efe13562a4d8c656f7bc24b8495c93e39c4bb53265ffc7364cbf88186ba9604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:24:36.065 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:36 smithi092 podman[113214]: 2024-09-21 07:24:36.064502844 +0000 UTC m=+0.391085016 container init 2efe13562a4d8c656f7bc24b8495c93e39c4bb53265ffc7364cbf88186ba9604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:24:36.362 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:36 smithi092 podman[113214]: 2024-09-21 07:24:36.067914711 +0000 UTC m=+0.394496889 container start 2efe13562a4d8c656f7bc24b8495c93e39c4bb53265ffc7364cbf88186ba9604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T07:24:36.363 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:36 smithi092 podman[113214]: 2024-09-21 07:24:36.164618629 +0000 UTC m=+0.491200817 container attach 2efe13562a4d8c656f7bc24b8495c93e39c4bb53265ffc7364cbf88186ba9604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T07:24:36.363 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 21 07:24:36 smithi092 podman[113214]: 2024-09-21 07:24:36.257031342 +0000 UTC m=+0.583613524 container died 2efe13562a4d8c656f7bc24b8495c93e39c4bb53265ffc7364cbf88186ba9604 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T07:24:37.146 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T07:24:37.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:37.193 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T07:24:37.193 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T07:24:37.193 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.1 2024-09-21T07:24:37.513 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:37 smithi169 systemd[1]: Stopping Ceph osd.1 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:24:37.893 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:37 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1[38434]: 2024-09-21T07:24:37.511+0000 7fb85a424640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:37.893 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:37 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1[38434]: 2024-09-21T07:24:37.511+0000 7fb85a424640 -1 osd.1 100 *** Got signal Terminated *** 2024-09-21T07:24:37.893 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:37 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1[38434]: 2024-09-21T07:24:37.511+0000 7fb85a424640 -1 osd.1 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:24:43.394 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:43 smithi169 podman[66748]: 2024-09-21 07:24:43.067643545 +0000 UTC m=+5.680002305 container died ed630779088f38f9675fc28ab10498b6c70363874129f6da58b35f838609f1b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:24:43.715 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:43 smithi169 podman[66748]: 2024-09-21 07:24:43.496195541 +0000 UTC m=+6.108554291 container cleanup ed630779088f38f9675fc28ab10498b6c70363874129f6da58b35f838609f1b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:24:43.715 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:43 smithi169 bash[66748]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1 2024-09-21T07:24:44.119 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:43 smithi169 podman[66765]: 2024-09-21 07:24:43.714498501 +0000 UTC m=+0.647369429 container remove ed630779088f38f9675fc28ab10498b6c70363874129f6da58b35f838609f1b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:24:44.393 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:44 smithi169 podman[66851]: 2024-09-21 07:24:44.021308866 +0000 UTC m=+0.015817480 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:24:44.393 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:44 smithi169 podman[66851]: 2024-09-21 07:24:44.132079466 +0000 UTC m=+0.126588130 container create a06e3d4e038c6a9b3009d3a70342ffe1e981a289afe93520bf9f4d89ed6bd6eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T07:24:44.893 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:44 smithi169 podman[66851]: 2024-09-21 07:24:44.428615859 +0000 UTC m=+0.423124480 container init a06e3d4e038c6a9b3009d3a70342ffe1e981a289afe93520bf9f4d89ed6bd6eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T07:24:44.893 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:44 smithi169 podman[66851]: 2024-09-21 07:24:44.432070594 +0000 UTC m=+0.426579214 container start a06e3d4e038c6a9b3009d3a70342ffe1e981a289afe93520bf9f4d89ed6bd6eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:24:44.893 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:44 smithi169 podman[66851]: 2024-09-21 07:24:44.543650621 +0000 UTC m=+0.538159246 container attach a06e3d4e038c6a9b3009d3a70342ffe1e981a289afe93520bf9f4d89ed6bd6eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:24:44.893 INFO:journalctl@ceph.osd.1.smithi169.stdout:Sep 21 07:24:44 smithi169 podman[66851]: 2024-09-21 07:24:44.617234208 +0000 UTC m=+0.611742830 container died a06e3d4e038c6a9b3009d3a70342ffe1e981a289afe93520bf9f4d89ed6bd6eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T07:24:45.281 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T07:24:45.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:45.323 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T07:24:45.324 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T07:24:45.324 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.2 2024-09-21T07:24:45.654 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:45 smithi175 systemd[1]: Stopping Ceph osd.2 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:24:46.018 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2[39174]: 2024-09-21T07:24:45.650+0000 7f990d64d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:46.018 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2[39174]: 2024-09-21T07:24:45.650+0000 7f990d64d640 -1 osd.2 100 *** Got signal Terminated *** 2024-09-21T07:24:46.018 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2[39174]: 2024-09-21T07:24:45.650+0000 7f990d64d640 -1 osd.2 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:24:51.512 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:51 smithi175 podman[66364]: 2024-09-21 07:24:51.139360071 +0000 UTC m=+5.609777732 container died a89fd8286cf8a2f1c37aa408723391c2f790b7552f511284a1f5fcfe9cf38825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T07:24:51.768 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:51 smithi175 podman[66364]: 2024-09-21 07:24:51.610984005 +0000 UTC m=+6.081401700 container cleanup a89fd8286cf8a2f1c37aa408723391c2f790b7552f511284a1f5fcfe9cf38825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T07:24:51.768 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:51 smithi175 bash[66364]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2 2024-09-21T07:24:52.230 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:51 smithi175 podman[66381]: 2024-09-21 07:24:51.90422061 +0000 UTC m=+0.757453382 container remove a89fd8286cf8a2f1c37aa408723391c2f790b7552f511284a1f5fcfe9cf38825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:24:52.518 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:52 smithi175 podman[66471]: 2024-09-21 07:24:52.131952406 +0000 UTC m=+0.016070639 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:24:52.518 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:52 smithi175 podman[66471]: 2024-09-21 07:24:52.255324585 +0000 UTC m=+0.139442864 container create b94c580682d87b7c58232e9ee26e9d6ce6dac55e14087ef7a7cc7ff6fc36c539 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T07:24:53.018 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:52 smithi175 podman[66471]: 2024-09-21 07:24:52.538232658 +0000 UTC m=+0.422350897 container init b94c580682d87b7c58232e9ee26e9d6ce6dac55e14087ef7a7cc7ff6fc36c539 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:24:53.019 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:52 smithi175 podman[66471]: 2024-09-21 07:24:52.541605931 +0000 UTC m=+0.425724168 container start b94c580682d87b7c58232e9ee26e9d6ce6dac55e14087ef7a7cc7ff6fc36c539 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T07:24:53.019 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:52 smithi175 podman[66471]: 2024-09-21 07:24:52.641625725 +0000 UTC m=+0.525743979 container attach b94c580682d87b7c58232e9ee26e9d6ce6dac55e14087ef7a7cc7ff6fc36c539 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T07:24:53.019 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 21 07:24:52 smithi175 podman[66471]: 2024-09-21 07:24:52.730469372 +0000 UTC m=+0.614587608 container died b94c580682d87b7c58232e9ee26e9d6ce6dac55e14087ef7a7cc7ff6fc36c539 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:24:53.443 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T07:24:53.486 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:53.486 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T07:24:53.486 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T07:24:53.486 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.3 2024-09-21T07:24:53.812 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:53 smithi092 systemd[1]: Stopping Ceph osd.3 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:24:54.112 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:53 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3[53549]: 2024-09-21T07:24:53.810+0000 7fb1fa3fb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:54.112 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:53 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3[53549]: 2024-09-21T07:24:53.810+0000 7fb1fa3fb640 -1 osd.3 100 *** Got signal Terminated *** 2024-09-21T07:24:54.112 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:53 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3[53549]: 2024-09-21T07:24:53.810+0000 7fb1fa3fb640 -1 osd.3 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:24:56.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:24:56 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:24:56.031+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:24:56.612 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3[53549]: 2024-09-21T07:24:56.281+0000 7fb1f29de640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.715957+0000 front 2024-09-21T07:24:33.716011+0000 (oldest deadline 2024-09-21T07:24:55.416084+0000) 2024-09-21T07:24:57.114 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:24:56 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:24:56.683+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:24:57.517 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:24:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:24:57.074+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:24:57.612 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:57 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3[53549]: 2024-09-21T07:24:57.294+0000 7fb1f29de640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.715957+0000 front 2024-09-21T07:24:33.716011+0000 (oldest deadline 2024-09-21T07:24:55.416084+0000) 2024-09-21T07:24:58.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:24:57 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:24:57.644+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:24:58.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:24:58 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:24:58.104+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:24:58.612 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:58 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3[53549]: 2024-09-21T07:24:58.296+0000 7fb1f29de640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.715957+0000 front 2024-09-21T07:24:33.716011+0000 (oldest deadline 2024-09-21T07:24:55.416084+0000) 2024-09-21T07:24:59.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:24:58 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:24:58.619+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:24:59.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:24:58 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:24:58.654+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:24:59.517 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:24:59 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:24:59.144+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:24:59.612 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:59 smithi092 podman[113320]: 2024-09-21 07:24:59.231631398 +0000 UTC m=+5.553979070 container died 4ac82081db8949c24da06b1cb3cf2a0ab01f8844dc747aee4277c17a7a148849 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T07:25:00.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:24:59 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:24:59.661+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:00.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:24:59 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:24:59.701+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:00.113 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:59 smithi092 podman[113320]: 2024-09-21 07:24:59.627506185 +0000 UTC m=+5.949853853 container cleanup 4ac82081db8949c24da06b1cb3cf2a0ab01f8844dc747aee4277c17a7a148849 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:25:00.113 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:59 smithi092 bash[113320]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3 2024-09-21T07:25:00.114 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:24:59 smithi092 podman[113335]: 2024-09-21 07:24:59.862428253 +0000 UTC m=+0.628821149 container remove 4ac82081db8949c24da06b1cb3cf2a0ab01f8844dc747aee4277c17a7a148849 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:25:00.433 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:25:00 smithi092 podman[113423]: 2024-09-21 07:25:00.196547978 +0000 UTC m=+0.106987664 container create 2993390518eb45b78c79effa0aec4471a0e8b658864b1f8c62c428fb3873588f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T07:25:00.433 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:25:00 smithi092 podman[113423]: 2024-09-21 07:25:00.105374054 +0000 UTC m=+0.015813704 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:25:00.433 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:00 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:00.123+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:00.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:00.152+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:00.749 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:25:00 smithi092 podman[113423]: 2024-09-21 07:25:00.432209736 +0000 UTC m=+0.342649386 container init 2993390518eb45b78c79effa0aec4471a0e8b658864b1f8c62c428fb3873588f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T07:25:00.749 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:25:00 smithi092 podman[113423]: 2024-09-21 07:25:00.435667226 +0000 UTC m=+0.346106870 container start 2993390518eb45b78c79effa0aec4471a0e8b658864b1f8c62c428fb3873588f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T07:25:00.749 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:25:00 smithi092 podman[113423]: 2024-09-21 07:25:00.515892406 +0000 UTC m=+0.426332050 container attach 2993390518eb45b78c79effa0aec4471a0e8b658864b1f8c62c428fb3873588f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T07:25:00.749 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 21 07:25:00 smithi092 podman[113423]: 2024-09-21 07:25:00.619680134 +0000 UTC m=+0.530119789 container died 2993390518eb45b78c79effa0aec4471a0e8b658864b1f8c62c428fb3873588f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T07:25:01.003 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:00 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:00.747+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:01.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:00.653+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:01.362 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:01 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:01.161+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:01.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T07:25:01.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:25:01.454 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T07:25:01.454 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T07:25:01.454 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.4 2024-09-21T07:25:01.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:01 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:01.175+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:01.811 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:01 smithi169 systemd[1]: Stopping Ceph osd.4 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:25:02.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:01 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:01.640+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:02.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:01 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:01.746+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:02.143 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:01 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4[44952]: 2024-09-21T07:25:01.808+0000 7fae93be9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:25:02.143 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:01 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4[44952]: 2024-09-21T07:25:01.808+0000 7fae93be9640 -1 osd.4 100 *** Got signal Terminated *** 2024-09-21T07:25:02.143 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:01 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4[44952]: 2024-09-21T07:25:01.808+0000 7fae93be9640 -1 osd.4 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:25:02.517 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:02 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:02.176+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:02.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:02 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:02.169+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:03.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:02 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:02.600+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:03.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:02 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:02.716+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:03.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:03 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:03.184+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:03.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:03 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:03.148+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:03.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:03 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:03.477+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:04.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:03 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:03.575+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:04.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:03 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:03.667+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:04.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:04 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:04.137+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:04.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:04 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:04.137+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:04.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:04 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:04.141+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:04.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:04 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:04.462+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:05.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:04 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:04.606+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:05.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:04 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:04.635+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:05.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:05 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:05.105+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:05.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:05 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:05.112+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:05.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:05 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:05.112+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:05.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:05 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:05.181+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:05.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:05 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:05.512+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:06.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:05 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:05.635+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:06.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:05 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:05.641+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:06.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:06 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:06.144+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:06.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:06 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:06.103+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:06.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:06 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:06.103+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:06.604 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:06 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:06.171+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:06.604 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:06 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:06.171+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:06.794 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:06 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:06.541+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:06.795 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:06 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4[44952]: 2024-09-21T07:25:06.590+0000 7fae901d4640 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.436514+0000 front 2024-09-21T07:24:40.436542+0000 (oldest deadline 2024-09-21T07:25:06.336698+0000) 2024-09-21T07:25:06.862 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:06 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:06.603+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:06.862 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:06 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:06.603+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:07.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:06 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:06.610+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:07.393 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:07 smithi169 podman[66966]: 2024-09-21 07:25:07.143668872 +0000 UTC m=+5.494638910 container died 890813c3a09e63f79523384ee2a848570988e3792c6750d909cfba1c80e4a173 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:25:07.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:07 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:07.173+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:07.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:07 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:07.132+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:07.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:07 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:07.132+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:07.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:07 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:07.212+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:07.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:07 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:07.212+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:07.812 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:07 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:07.497+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:07.812 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:07 smithi169 podman[66966]: 2024-09-21 07:25:07.551000351 +0000 UTC m=+5.901970373 container cleanup 890813c3a09e63f79523384ee2a848570988e3792c6750d909cfba1c80e4a173 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T07:25:07.812 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:07 smithi169 bash[66966]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4 2024-09-21T07:25:08.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:07 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:07.619+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:08.076 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:07 smithi169 podman[66982]: 2024-09-21 07:25:07.810915176 +0000 UTC m=+0.659818695 container remove 890813c3a09e63f79523384ee2a848570988e3792c6750d909cfba1c80e4a173 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:25:08.076 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:07 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:07.898+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:08.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:07 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:07.652+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:08.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:07 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:07.652+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:08.393 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:08 smithi169 podman[67080]: 2024-09-21 07:25:08.026488538 +0000 UTC m=+0.016020029 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:25:08.393 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:08 smithi169 podman[67080]: 2024-09-21 07:25:08.170489767 +0000 UTC m=+0.160021239 container create 8a4058ed5295eb1a9579290d7757561077285efa43d7ea3facb276f1f337e063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T07:25:08.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:08 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:08.167+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:08.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:08 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:08.098+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:08.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:08 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:08.098+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:08.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:08 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:08.243+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:08.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:08 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:08.243+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:08.861 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:08 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:08.503+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:08.861 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:08 smithi169 podman[67080]: 2024-09-21 07:25:08.41475332 +0000 UTC m=+0.404284804 container init 8a4058ed5295eb1a9579290d7757561077285efa43d7ea3facb276f1f337e063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T07:25:08.862 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:08 smithi169 podman[67080]: 2024-09-21 07:25:08.418125936 +0000 UTC m=+0.407657412 container start 8a4058ed5295eb1a9579290d7757561077285efa43d7ea3facb276f1f337e063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:25:08.862 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:08 smithi169 podman[67080]: 2024-09-21 07:25:08.548518953 +0000 UTC m=+0.538050455 container attach 8a4058ed5295eb1a9579290d7757561077285efa43d7ea3facb276f1f337e063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T07:25:08.862 INFO:journalctl@ceph.osd.4.smithi169.stdout:Sep 21 07:25:08 smithi169 podman[67080]: 2024-09-21 07:25:08.608169577 +0000 UTC m=+0.597701069 container died 8a4058ed5295eb1a9579290d7757561077285efa43d7ea3facb276f1f337e063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T07:25:09.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:08 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:08.648+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:09.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:08 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:08.656+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:09.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:08 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:08.656+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:09.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:08 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:08.859+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:09.315 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T07:25:09.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:25:09.355 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T07:25:09.355 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T07:25:09.356 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.5 2024-09-21T07:25:09.383 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:09 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:09.162+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:09.384 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:09 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:09.076+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:09.384 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:09 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:09.076+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:09.613 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:09 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:09.225+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:09.613 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:09 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:09.225+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:09.675 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:09 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:09.614+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:09.675 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:09 smithi175 systemd[1]: Stopping Ceph osd.5 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:25:09.675 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:09 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:09.673+0000 7fd72d91e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:25:09.676 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:09 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:09.673+0000 7fd72d91e640 -1 osd.5 100 *** Got signal Terminated *** 2024-09-21T07:25:09.676 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:09 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:09.673+0000 7fd72d91e640 -1 osd.5 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:25:09.823 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:09 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:09.550+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:10.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:09 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:09.627+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:10.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:09 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:09.627+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:10.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:09 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:09.822+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:10.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:10 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:10.162+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:10.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:10 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:10.047+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:10.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:10 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:10.047+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:10.604 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:10 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:10.267+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:10.604 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:10 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:10.267+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:10.862 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:10 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:10.602+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:10.862 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:10 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:10.602+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:10.893 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:10 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:10.782+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:10.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:10 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:10.577+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:11.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:10 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:10.591+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:11.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:11.193+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:11.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:11.075+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:11.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:11.075+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:11.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:11 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:11.302+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:11.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:11 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:11.302+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:11.893 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:11.737+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:11.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:11 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:11.553+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:12.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:11 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:11.635+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:12.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:11 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:11.622+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:12.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:11 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:11.622+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:12.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:12 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:12.233+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:12.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:12 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:12.059+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:12.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:12 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:12.059+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:12.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:12 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:12.059+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:46.094713+0000 front 2024-09-21T07:24:46.094693+0000 (oldest deadline 2024-09-21T07:25:11.994811+0000) 2024-09-21T07:25:12.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:12 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:12.298+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:12.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:12 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:12.298+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:12.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:12 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:12.298+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:12.893 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:12 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:12.742+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:12.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:12 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:12.530+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:13.012 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:12 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:12.665+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:13.012 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:12 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:12.665+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:13.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:12 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:12.660+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:13.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:12 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:12.660+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:13.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:12 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:12.660+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:13.268 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:13 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:13.236+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:13.268 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:13 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:13.010+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:13.268 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:13 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:13.010+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:13.268 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:13 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:13.010+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:46.094713+0000 front 2024-09-21T07:24:46.094693+0000 (oldest deadline 2024-09-21T07:25:11.994811+0000) 2024-09-21T07:25:13.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:13 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:13.282+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:13.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:13 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:13.282+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:13.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:13 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:13.282+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:13.786 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:13 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:13.491+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:14.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:13 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:13.622+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:14.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:13 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:13.622+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:14.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:13 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:13.655+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:14.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:13 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:13.655+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:14.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:13 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:13.655+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:14.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:13 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:13.785+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:14.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:13 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:13.785+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:14.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:14 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:14.240+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:14.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:14 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:14.036+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:31.091469+0000 front 2024-09-21T07:24:31.091427+0000 (oldest deadline 2024-09-21T07:24:55.092178+0000) 2024-09-21T07:25:14.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:14 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:14.036+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:42.094249+0000 front 2024-09-21T07:24:42.094031+0000 (oldest deadline 2024-09-21T07:25:03.193947+0000) 2024-09-21T07:25:14.518 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:14 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5[45314]: 2024-09-21T07:25:14.036+0000 7fd725f01640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:46.094713+0000 front 2024-09-21T07:24:46.094693+0000 (oldest deadline 2024-09-21T07:25:11.994811+0000) 2024-09-21T07:25:14.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:14 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:14.245+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:14.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:14 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:14.245+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:14.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:14 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:14.245+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:14.816 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:14 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:14.488+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:15.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:14 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:14.650+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:15.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:14 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:14.650+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:15.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:14 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:14.654+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:15.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:14 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:14.654+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:15.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:14 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:14.654+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:15.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:14 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:14.815+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:15.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:14 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:14.815+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:15.428 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:15 smithi175 podman[66586]: 2024-09-21 07:25:15.127872225 +0000 UTC m=+5.573189898 container died ec7f2a5d5674c3513dff18d431bd88afd043902d5abda643fdf89a536cde3679 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T07:25:15.428 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:15 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:15.215+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:15.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:15 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:15.231+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:15.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:15 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:15.231+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:15.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:15 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:15.231+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:15.768 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:15 smithi175 podman[66586]: 2024-09-21 07:25:15.52381275 +0000 UTC m=+5.969130430 container cleanup ec7f2a5d5674c3513dff18d431bd88afd043902d5abda643fdf89a536cde3679 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T07:25:15.768 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:15 smithi175 bash[66586]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5 2024-09-21T07:25:15.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:15 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:15.630+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:15.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:15 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:15.630+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:15.840 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:15 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:15.500+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:16.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:15 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:15.638+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:16.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:15 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:15.638+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:16.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:15 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:15.638+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:16.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:15 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:15.838+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:16.170 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:15 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:15.838+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:16.191 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:15 smithi175 podman[66603]: 2024-09-21 07:25:15.775258653 +0000 UTC m=+0.642315383 container remove ec7f2a5d5674c3513dff18d431bd88afd043902d5abda643fdf89a536cde3679 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T07:25:16.488 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:16 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:16.262+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:16.488 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:16 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:16.262+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:16.488 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:16 smithi175 podman[66695]: 2024-09-21 07:25:16.093123661 +0000 UTC m=+0.016120029 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:25:16.488 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:16 smithi175 podman[66695]: 2024-09-21 07:25:16.217828406 +0000 UTC m=+0.140824765 container create f1db59f27d3fbb17d253f74056813abcdc8877eef3a9fd47fbbe67507f814c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T07:25:16.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:16.248+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:16.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:16.248+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:16.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:16.248+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:16.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:16 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:16.609+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:16.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:16 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:16.609+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:16.768 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:16 smithi175 podman[66695]: 2024-09-21 07:25:16.487003375 +0000 UTC m=+0.409999735 container init f1db59f27d3fbb17d253f74056813abcdc8877eef3a9fd47fbbe67507f814c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T07:25:16.768 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:16 smithi175 podman[66695]: 2024-09-21 07:25:16.490661582 +0000 UTC m=+0.413657942 container start f1db59f27d3fbb17d253f74056813abcdc8877eef3a9fd47fbbe67507f814c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T07:25:16.768 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:16 smithi175 podman[66695]: 2024-09-21 07:25:16.57038941 +0000 UTC m=+0.493385778 container attach f1db59f27d3fbb17d253f74056813abcdc8877eef3a9fd47fbbe67507f814c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T07:25:16.768 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 21 07:25:16 smithi175 podman[66695]: 2024-09-21 07:25:16.682077246 +0000 UTC m=+0.605073609 container died f1db59f27d3fbb17d253f74056813abcdc8877eef3a9fd47fbbe67507f814c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T07:25:16.862 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:16 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:16.529+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:16.862 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:16 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:16.529+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:17.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:16.626+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:17.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:16.626+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:17.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:16.626+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:17.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:16 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:16.860+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:17.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:16 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:16.860+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:17.267 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:17 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:17.234+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:17.268 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:17 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:17.234+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:17.314 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T07:25:17.393 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:25:17.393 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T07:25:17.393 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T07:25:17.393 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.6 2024-09-21T07:25:17.596 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:17 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:17.594+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:17.596 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:17 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:17.594+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:17.612 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:17 smithi092 systemd[1]: Stopping Ceph osd.6 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:25:17.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:17 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:17.220+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:17.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:17 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:17.220+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:17.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:17 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:17.220+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:17.868 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:17 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:17.512+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:17.869 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:17 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:17.512+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:18.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:17 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:17.611+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:18.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:17 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:17.611+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:18.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:17 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:17.611+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:18.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:17 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:17.729+0000 7fc1b4314640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:25:18.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:17 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:17.729+0000 7fc1b4314640 -1 osd.6 100 *** Got signal Terminated *** 2024-09-21T07:25:18.113 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:17 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:17.729+0000 7fc1b4314640 -1 osd.6 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:25:18.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:17 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:17.866+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:18.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:17 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:17.866+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:18.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:18 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:18.235+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:18.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:18 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:18.235+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:18.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:18 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:18.249+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:18.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:18 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:18.249+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:18.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:18 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:18.249+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:18.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:18 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:18.503+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:18.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:18 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:18.503+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:19.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:18 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:18.561+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:19.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:18 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:18.561+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:19.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:18 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:18.656+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:19.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:18 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:18.656+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:19.113 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:18 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:18.656+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:19.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:18 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:18.906+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:19.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:18 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:18.906+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:19.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:19 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:19.249+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:19.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:19 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:19.249+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:19.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:19.274+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:19.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:19.275+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:19.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:19.275+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:19.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:19 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:19.483+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:19.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:19 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:19.483+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:20.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:19 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:19.566+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:20.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:19 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:19.566+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:20.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:19.638+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:20.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:19.638+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:20.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:19 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:19.638+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:20.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:19 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:19.954+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:20.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:19 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:19.954+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:20.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:20 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:20.216+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:20.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:20 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:20.216+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:20.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:20 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:20.262+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:20.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:20 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:20.262+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:20.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:20 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:20.262+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:20.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:20 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:20.436+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:20.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:20 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:20.436+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:20.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:20 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:20.436+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:21.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:20 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:20.559+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:21.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:20 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:20.559+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:21.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:20 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:20.611+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:21.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:20 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:20.611+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:21.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:20 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:20.611+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:21.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:20 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:20.947+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:21.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:20 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:20.947+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:21.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:20 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:20.947+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:54.918024+0000 front 2024-09-21T07:24:54.918088+0000 (oldest deadline 2024-09-21T07:25:20.217841+0000) 2024-09-21T07:25:21.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:21 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:21.181+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:21.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:21 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:21.181+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:21.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:21 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:21.279+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:21.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:21 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:21.279+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:21.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:21 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:21.279+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:21.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:21 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:21.473+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:21.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:21 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:21.473+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:21.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:21 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:21.473+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:22.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:21 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:21.573+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:22.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:21 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:21.573+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:22.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:21 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:21.635+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:22.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:21 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:21.635+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:22.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:21 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:21.635+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:22.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:21 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:21.635+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:55.995530+0000 front 2024-09-21T07:24:55.995463+0000 (oldest deadline 2024-09-21T07:25:21.295589+0000) 2024-09-21T07:25:22.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:21 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:21.974+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:22.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:21 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:21.974+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:22.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:21 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:21.974+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:54.918024+0000 front 2024-09-21T07:24:54.918088+0000 (oldest deadline 2024-09-21T07:25:20.217841+0000) 2024-09-21T07:25:22.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:22 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:22.183+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:22.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:22 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:22.183+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:22.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:22 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:22.183+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:22.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:22 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:22.304+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:22.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:22 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:22.304+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:22.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:22 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:22.304+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:22.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:22 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:22.304+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:22.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:22 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:22.446+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:22.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:22 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:22.446+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:22.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:22 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:22.446+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:23.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:22 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:22.610+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:23.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:22 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:22.610+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:23.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:22 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:22.664+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.791684+0000 front 2024-09-21T07:24:29.791654+0000 (oldest deadline 2024-09-21T07:24:55.691783+0000) 2024-09-21T07:25:23.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:22 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:22.664+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.392886+0000 front 2024-09-21T07:24:40.392901+0000 (oldest deadline 2024-09-21T07:25:05.692642+0000) 2024-09-21T07:25:23.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:22 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:22.664+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.194901+0000 front 2024-09-21T07:24:50.194697+0000 (oldest deadline 2024-09-21T07:25:12.494598+0000) 2024-09-21T07:25:23.112 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:22 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6[59825]: 2024-09-21T07:25:22.664+0000 7fc1b08ff640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:55.995530+0000 front 2024-09-21T07:24:55.995463+0000 (oldest deadline 2024-09-21T07:25:21.295589+0000) 2024-09-21T07:25:23.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:23 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:23.012+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:23.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:23 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:23.012+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:23.394 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:23 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:23.012+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:54.918024+0000 front 2024-09-21T07:24:54.918088+0000 (oldest deadline 2024-09-21T07:25:20.217841+0000) 2024-09-21T07:25:23.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:23 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:23.160+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:23.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:23 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:23.160+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:23.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:23 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:23.160+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:23.556 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:23 smithi092 podman[113524]: 2024-09-21 07:25:23.268941731 +0000 UTC m=+5.673019798 container died d2d28fe2b5a13064204228ecbc412f0953d374cc00d00bb6d93be5059b32ec9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T07:25:23.556 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:23 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:23.321+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:23.556 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:23 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:23.321+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:23.556 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:23 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:23.321+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:23.556 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:23 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:23.321+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:23.862 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:23 smithi092 podman[113524]: 2024-09-21 07:25:23.729538774 +0000 UTC m=+6.133616907 container cleanup d2d28fe2b5a13064204228ecbc412f0953d374cc00d00bb6d93be5059b32ec9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:25:23.862 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:23 smithi092 bash[113524]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6 2024-09-21T07:25:23.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:23 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:23.465+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:23.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:23 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:23.465+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:23.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:23 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:23.465+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:24.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:23 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:23.636+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:24.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:23 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:23.636+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:24.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:23 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:23.636+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:24.307 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:23 smithi092 podman[113541]: 2024-09-21 07:25:23.99754482 +0000 UTC m=+0.725915340 container remove d2d28fe2b5a13064204228ecbc412f0953d374cc00d00bb6d93be5059b32ec9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T07:25:24.309 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:24 smithi092 podman[113628]: 2024-09-21 07:25:24.20939501 +0000 UTC m=+0.016460285 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:25:24.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:24 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:24.041+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:24.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:24 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:24.041+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:24.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:24 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:24.041+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:54.918024+0000 front 2024-09-21T07:24:54.918088+0000 (oldest deadline 2024-09-21T07:25:20.217841+0000) 2024-09-21T07:25:24.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:24 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:24.197+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:24.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:24 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:24.197+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:24.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:24 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:24.197+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:24.585 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:24 smithi092 podman[113628]: 2024-09-21 07:25:24.306603196 +0000 UTC m=+0.113668457 container create 7f772580439678c0948b9d8797ec59c2a69aa26e9b79373ffab04e7ea754ac15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:25:24.585 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:24 smithi092 podman[113628]: 2024-09-21 07:25:24.584247006 +0000 UTC m=+0.391312271 container init 7f772580439678c0948b9d8797ec59c2a69aa26e9b79373ffab04e7ea754ac15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T07:25:24.585 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:24 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:24.340+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:24.585 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:24 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:24.340+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:24.586 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:24 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:24.340+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:24.586 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:24 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:24.340+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:24.862 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:24 smithi092 podman[113628]: 2024-09-21 07:25:24.587642088 +0000 UTC m=+0.394707352 container start 7f772580439678c0948b9d8797ec59c2a69aa26e9b79373ffab04e7ea754ac15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T07:25:24.862 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:24 smithi092 podman[113628]: 2024-09-21 07:25:24.69254198 +0000 UTC m=+0.499607259 container attach 7f772580439678c0948b9d8797ec59c2a69aa26e9b79373ffab04e7ea754ac15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T07:25:24.862 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 21 07:25:24 smithi092 podman[113628]: 2024-09-21 07:25:24.777137411 +0000 UTC m=+0.584202672 container died 7f772580439678c0948b9d8797ec59c2a69aa26e9b79373ffab04e7ea754ac15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T07:25:24.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:24 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:24.464+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:24.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:24 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:24.464+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:24.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:24 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:24.464+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:25.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:24 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:24.616+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:25.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:24 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:24.616+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:25.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:24 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:24.616+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:25.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:25.007+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:25.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:25.007+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:25.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:25.007+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:54.918024+0000 front 2024-09-21T07:24:54.918088+0000 (oldest deadline 2024-09-21T07:25:20.217841+0000) 2024-09-21T07:25:25.429 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T07:25:25.465 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:25:25.466 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T07:25:25.466 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T07:25:25.466 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.7 2024-09-21T07:25:25.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:25 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:25.240+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:25.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:25 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:25.240+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:25.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:25 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:25.240+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:25.798 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:25 smithi169 systemd[1]: Stopping Ceph osd.7 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:25:25.798 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:25.510+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:25.798 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:25.510+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:25.798 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:25.510+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:25.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:25 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:25.386+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:25.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:25 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:25.386+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:25.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:25 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:25.386+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:25.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:25 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:25.386+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:26.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:25 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:25.571+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:26.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:25 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:25.571+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:26.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:25 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:25.571+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:26.143 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:25.796+0000 7fcc49cec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:25:26.144 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:25.796+0000 7fcc49cec640 -1 osd.7 100 *** Got signal Terminated *** 2024-09-21T07:25:26.144 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:25.796+0000 7fcc49cec640 -1 osd.7 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:25:26.144 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:25.965+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:26.144 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:25.965+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:26.144 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:25 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:25.965+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:54.918024+0000 front 2024-09-21T07:24:54.918088+0000 (oldest deadline 2024-09-21T07:25:20.217841+0000) 2024-09-21T07:25:26.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:26 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:26.224+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:26.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:26 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:26.224+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:26.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:26 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:26.224+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:26.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:26 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:26.431+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:26.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:26 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:26.431+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:26.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:26 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:26.431+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:26.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:26 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:26.431+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:26.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:26 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:26.538+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:26.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:26 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:26.538+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:26.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:26 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:26.538+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:27.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:26 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:26.543+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:27.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:26 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:26.543+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:27.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:26 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:26.543+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:27.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:26 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:26.944+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:27.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:26 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:26.944+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:27.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:26 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:26.944+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:54.918024+0000 front 2024-09-21T07:24:54.918088+0000 (oldest deadline 2024-09-21T07:25:20.217841+0000) 2024-09-21T07:25:27.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:27 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:27.196+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:27.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:27 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:27.196+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:27.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:27 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:27.196+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:27.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:27 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:27.469+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:27.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:27 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:27.469+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:27.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:27 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:27.469+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:27.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:27 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:27.469+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:27.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:27 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:27.500+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:27.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:27 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:27.500+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:27.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:27 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:27.500+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:28.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:27 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:27.549+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:28.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:27 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:27.549+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:28.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:27 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:27.549+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:28.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:27 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:27.943+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:28.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:27 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:27.943+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:28.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:27 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:27.943+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:54.918024+0000 front 2024-09-21T07:24:54.918088+0000 (oldest deadline 2024-09-21T07:25:20.217841+0000) 2024-09-21T07:25:28.394 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:27 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:27.943+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.320939+0000 front 2024-09-21T07:25:06.320751+0000 (oldest deadline 2024-09-21T07:25:27.420843+0000) 2024-09-21T07:25:28.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:28 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:28.179+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:28.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:28 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:28.179+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:28.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:28 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:28.179+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:28.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:28 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:28.458+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:28.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:28 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:28.458+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:28.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:28 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:28.458+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:28.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:28 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:28.458+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:28.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:28 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:28.458+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:28.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:28 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:28.540+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:28.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:28 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:28.540+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:28.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:28 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:28.540+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:28.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:28 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:28.540+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:29.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:28 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:28.585+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:29.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:28 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:28.585+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:29.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:28 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:28.585+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:29.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:28 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:28.585+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:29.295 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:29 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:29.191+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:29.295 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:29 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:29.191+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:29.295 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:29 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:29.191+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:29.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:28 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:28.965+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:29.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:28 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:28.965+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:29.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:28 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:28.965+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:54.918024+0000 front 2024-09-21T07:24:54.918088+0000 (oldest deadline 2024-09-21T07:25:20.217841+0000) 2024-09-21T07:25:29.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:28 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:28.965+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.320939+0000 front 2024-09-21T07:25:06.320751+0000 (oldest deadline 2024-09-21T07:25:27.420843+0000) 2024-09-21T07:25:29.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:29 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:29.453+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:29.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:29 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:29.453+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:29.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:29 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:29.453+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:29.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:29 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:29.453+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:29.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:29 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:29.453+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:29.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:29 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:29.569+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:29.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:29 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:29.569+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:29.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:29 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:29.569+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:29.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:29 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:29.569+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:30.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:29 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:29.562+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:30.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:29 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:29.562+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:30.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:29 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:29.562+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:30.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:29 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:29.562+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:30.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:29 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:29.944+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:41.416153+0000 front 2024-09-21T07:24:41.416192+0000 (oldest deadline 2024-09-21T07:25:07.316452+0000) 2024-09-21T07:25:30.393 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:29 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:29.944+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.317055+0000 front 2024-09-21T07:24:47.316997+0000 (oldest deadline 2024-09-21T07:25:13.217019+0000) 2024-09-21T07:25:30.394 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:29 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:29.944+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:54.918024+0000 front 2024-09-21T07:24:54.918088+0000 (oldest deadline 2024-09-21T07:25:20.217841+0000) 2024-09-21T07:25:30.394 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:29 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7[51379]: 2024-09-21T07:25:29.944+0000 7fcc462d7640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.320939+0000 front 2024-09-21T07:25:06.320751+0000 (oldest deadline 2024-09-21T07:25:27.420843+0000) 2024-09-21T07:25:30.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:30 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:30.186+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:30.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:30 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:30.186+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:30.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:30 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:30.186+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:30.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:30 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:30.415+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:30.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:30 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:30.415+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:30.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:30 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:30.415+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:30.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:30 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:30.415+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:30.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:30 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:30.415+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:30.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:30 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:30.605+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:30.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:30 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:30.605+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:30.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:30 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:30.605+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:30.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:30 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:30.605+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:31.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:30 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:30.581+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:31.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:30 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:30.581+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:31.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:30 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:30.581+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:31.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:30 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:30.581+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:31.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:31 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:31.223+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:31.587 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:31 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:31.223+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:31.588 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:31 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:31.223+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:31.590 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:31 smithi169 podman[67184]: 2024-09-21 07:25:31.28120481 +0000 UTC m=+5.620518838 container died 67de1579b5f9290c2714c78bfaf9b233b443f23aab8d26562aa5cd5f40884bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T07:25:31.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:31 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:31.464+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:31.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:31 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:31.464+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:31.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:31 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:31.464+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:31.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:31 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:31.464+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:31.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:31 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:31.464+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:31.893 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:31 smithi169 podman[67184]: 2024-09-21 07:25:31.688136864 +0000 UTC m=+6.027450889 container cleanup 67de1579b5f9290c2714c78bfaf9b233b443f23aab8d26562aa5cd5f40884bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T07:25:31.893 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:31 smithi169 bash[67184]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7 2024-09-21T07:25:31.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:31 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:31.605+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:31.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:31 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:31.605+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:31.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:31 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:31.605+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:31.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:31 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:31.605+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:32.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:31 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:31.553+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:32.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:31 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:31.553+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:32.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:31 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:31.553+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:32.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:31 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:31.553+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:32.291 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:31 smithi169 podman[67202]: 2024-09-21 07:25:31.964732523 +0000 UTC m=+0.683472547 container remove 67de1579b5f9290c2714c78bfaf9b233b443f23aab8d26562aa5cd5f40884bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T07:25:32.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:32 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:32.238+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:32.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:32 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:32.238+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:32.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:32 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:32.238+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:32.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:32 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:32.238+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:05.325340+0000 front 2024-09-21T07:25:05.325132+0000 (oldest deadline 2024-09-21T07:25:31.225205+0000) 2024-09-21T07:25:32.552 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:32 smithi169 podman[67287]: 2024-09-21 07:25:32.290372356 +0000 UTC m=+0.102742156 container create adbcf5533176caee1c838ac6cc19fbe72d58225eff2f4c369d798654c5efc02d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:25:32.552 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:32 smithi169 podman[67287]: 2024-09-21 07:25:32.203615537 +0000 UTC m=+0.015985351 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:25:32.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:32 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:32.468+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:32.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:32 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:32.468+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:32.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:32 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:32.468+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:32.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:32 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:32.468+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:32.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:32 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:32.468+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:32.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:32 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:32.652+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:32.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:32 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:32.652+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:32.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:32 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:32.652+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:32.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:32 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:32.652+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:32.894 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:32 smithi169 podman[67287]: 2024-09-21 07:25:32.551431844 +0000 UTC m=+0.363801645 container init adbcf5533176caee1c838ac6cc19fbe72d58225eff2f4c369d798654c5efc02d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T07:25:32.894 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:32 smithi169 podman[67287]: 2024-09-21 07:25:32.555204977 +0000 UTC m=+0.367574779 container start adbcf5533176caee1c838ac6cc19fbe72d58225eff2f4c369d798654c5efc02d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T07:25:32.894 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:32 smithi169 podman[67287]: 2024-09-21 07:25:32.651334144 +0000 UTC m=+0.463703958 container attach adbcf5533176caee1c838ac6cc19fbe72d58225eff2f4c369d798654c5efc02d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:25:32.894 INFO:journalctl@ceph.osd.7.smithi169.stdout:Sep 21 07:25:32 smithi169 podman[67287]: 2024-09-21 07:25:32.740636105 +0000 UTC m=+0.553005917 container died adbcf5533176caee1c838ac6cc19fbe72d58225eff2f4c369d798654c5efc02d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:25:33.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:32 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:32.547+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:33.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:32 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:32.547+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:33.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:32 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:32.547+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:33.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:32 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:32.547+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:33.420 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T07:25:33.461 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:25:33.461 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T07:25:33.461 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T07:25:33.462 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.8 2024-09-21T07:25:33.489 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:33.230+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:33.489 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:33.230+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:33.489 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:33.230+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:33.489 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:33.230+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:05.325340+0000 front 2024-09-21T07:25:05.325132+0000 (oldest deadline 2024-09-21T07:25:31.225205+0000) 2024-09-21T07:25:33.768 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:33 smithi175 systemd[1]: Stopping Ceph osd.8 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:25:33.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:33.547+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:33.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:33.547+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:33.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:33.547+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:33.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:33.547+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:33.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:33 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:33.515+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:33.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:33 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:33.515+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:33.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:33 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:33.515+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:33.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:33 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:33.515+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:33.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:33 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:33.515+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:34.143 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:33 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:33.660+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:34.143 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:33 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:33.660+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:34.143 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:33 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:33.660+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:34.143 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:33 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:33.660+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:34.200 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:33.809+0000 7fd837a4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:25:34.200 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:33.809+0000 7fd837a4f640 -1 osd.8 100 *** Got signal Terminated *** 2024-09-21T07:25:34.200 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:33 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:33.809+0000 7fd837a4f640 -1 osd.8 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:25:34.200 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:34 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:34.198+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:34.200 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:34 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:34.198+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:34.201 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:34 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:34.198+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:34.201 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:34 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:34.198+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:05.325340+0000 front 2024-09-21T07:25:05.325132+0000 (oldest deadline 2024-09-21T07:25:31.225205+0000) 2024-09-21T07:25:34.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:34 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:34.502+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:34.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:34 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:34.502+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:34.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:34 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:34.502+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:34.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:34 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:34.502+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:34.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:34 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:34.502+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:34.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:34 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:34.648+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:34.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:34 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:34.648+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:34.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:34 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:34.648+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:34.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:34 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:34.648+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:35.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:34 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:34.552+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:35.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:34 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:34.552+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:35.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:34 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:34.552+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:35.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:34 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:34.552+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:35.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:35.214+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:35.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:35.214+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:35.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:35.214+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:35.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:35.214+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:05.325340+0000 front 2024-09-21T07:25:05.325132+0000 (oldest deadline 2024-09-21T07:25:31.225205+0000) 2024-09-21T07:25:35.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:35 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:35.478+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:35.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:35 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:35.478+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:35.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:35 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:35.478+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:35.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:35 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:35.478+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:35.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:35 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:35.478+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:35.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:35 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:35.600+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:35.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:35 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:35.600+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:35.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:35 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:35.600+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:35.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:35 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:35.600+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:36.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:35.553+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:36.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:35.553+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:36.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:35.553+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:36.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:35 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:35.553+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:36.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:36 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:36.194+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:36.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:36 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:36.194+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:36.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:36 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:36.194+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:36.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:36 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:36.194+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:05.325340+0000 front 2024-09-21T07:25:05.325132+0000 (oldest deadline 2024-09-21T07:25:31.225205+0000) 2024-09-21T07:25:36.817 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:36 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:36.555+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:36.817 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:36 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:36.555+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:36.817 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:36 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:36.555+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:36.817 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:36 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:36.555+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:36.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:36 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:36.501+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:36.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:36 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:36.501+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:36.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:36 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:36.501+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:36.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:36 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:36.501+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:36.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:36 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:36.501+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:36.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:36 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:36.501+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:37.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:36 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:36.522+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:37.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:36 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:36.522+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:37.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:36 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:36.522+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:37.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:36 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:36.522+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:37.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:37.206+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:37.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:37.206+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:37.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:37.206+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:37.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:37.206+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:05.325340+0000 front 2024-09-21T07:25:05.325132+0000 (oldest deadline 2024-09-21T07:25:31.225205+0000) 2024-09-21T07:25:37.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:37.206+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:11.225526+0000 front 2024-09-21T07:25:11.225580+0000 (oldest deadline 2024-09-21T07:25:36.525658+0000) 2024-09-21T07:25:37.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:37 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:37.532+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:37.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:37 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:37.532+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:37.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:37 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:37.532+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:37.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:37 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:37.532+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:37.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:37 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:37.532+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:37.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:37 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:37.532+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:37.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:37 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:37.516+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:37.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:37 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:37.516+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:37.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:37 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:37.516+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:37.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:37 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:37.516+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:38.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:37.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:38.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:37.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:38.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:37.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:38.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:37.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:38.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:38 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:38.183+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.321423+0000 front 2024-09-21T07:24:40.321339+0000 (oldest deadline 2024-09-21T07:25:05.021271+0000) 2024-09-21T07:25:38.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:38 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:38.183+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:47.322201+0000 front 2024-09-21T07:24:47.322305+0000 (oldest deadline 2024-09-21T07:25:16.122866+0000) 2024-09-21T07:25:38.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:38 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:38.183+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.724259+0000 front 2024-09-21T07:24:57.724335+0000 (oldest deadline 2024-09-21T07:25:21.224115+0000) 2024-09-21T07:25:38.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:38 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:38.183+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:05.325340+0000 front 2024-09-21T07:25:05.325132+0000 (oldest deadline 2024-09-21T07:25:31.225205+0000) 2024-09-21T07:25:38.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:38 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8[51473]: 2024-09-21T07:25:38.183+0000 7fd830032640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:11.225526+0000 front 2024-09-21T07:25:11.225580+0000 (oldest deadline 2024-09-21T07:25:36.525658+0000) 2024-09-21T07:25:38.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:38 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:38.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:38.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:38 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:38.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:38.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:38 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:38.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:38.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:38 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:38.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:38.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:38 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:38.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:38.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:38 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:38.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:38.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:38 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:38.506+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:38.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:38 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:38.506+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:38.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:38 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:38.506+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:38.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:38 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:38.506+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:39.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:38 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:38.517+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:39.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:38 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:38.517+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:39.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:38 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:38.517+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:39.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:38 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:38.517+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:39.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:38 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:38.517+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:39.500 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:39 smithi175 podman[66811]: 2024-09-21 07:25:39.233697626 +0000 UTC m=+5.568959703 container died 6f2579e078c5d287ef1deb766d76d33a544f0c76434c11ca1e151a95363a87f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T07:25:39.761 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:39 smithi175 podman[66811]: 2024-09-21 07:25:39.592691484 +0000 UTC m=+5.927953561 container cleanup 6f2579e078c5d287ef1deb766d76d33a544f0c76434c11ca1e151a95363a87f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:25:39.761 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:39 smithi175 bash[66811]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8 2024-09-21T07:25:39.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:39 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:39.498+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:39.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:39 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:39.498+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:39.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:39 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:39.498+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:39.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:39 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:39.498+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:39.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:39 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:39.498+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:39.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:39 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:39.543+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:39.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:39 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:39.543+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:39.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:39 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:39.543+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:39.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:39 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:39.543+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:39.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:39 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:39.543+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:39.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:39 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:39.543+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:39.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:39 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:39.502+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:39.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:39 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:39.502+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:39.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:39 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:39.502+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:39.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:39 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:39.502+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:40.017 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:39 smithi175 podman[66827]: 2024-09-21 07:25:39.902858258 +0000 UTC m=+0.663499656 container remove 6f2579e078c5d287ef1deb766d76d33a544f0c76434c11ca1e151a95363a87f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T07:25:40.517 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:40 smithi175 podman[66920]: 2024-09-21 07:25:40.155190109 +0000 UTC m=+0.016112347 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:25:40.518 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:40 smithi175 podman[66920]: 2024-09-21 07:25:40.403814876 +0000 UTC m=+0.264737147 container create a4bf86362a875c11c738bfd7cf2084fcd071b13a09855c569b23d489bea5f00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T07:25:40.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:40 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:40.587+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:40.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:40 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:40.587+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:40.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:40 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:40.587+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:40.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:40 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:40.587+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:40.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:40 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:40.587+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:40.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:40 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:40.587+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:40.867 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:40 smithi175 podman[66920]: 2024-09-21 07:25:40.673112997 +0000 UTC m=+0.534035232 container init a4bf86362a875c11c738bfd7cf2084fcd071b13a09855c569b23d489bea5f00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T07:25:40.867 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:40 smithi175 podman[66920]: 2024-09-21 07:25:40.6765185 +0000 UTC m=+0.537440737 container start a4bf86362a875c11c738bfd7cf2084fcd071b13a09855c569b23d489bea5f00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T07:25:40.867 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:40 smithi175 podman[66920]: 2024-09-21 07:25:40.756142133 +0000 UTC m=+0.617064371 container attach a4bf86362a875c11c738bfd7cf2084fcd071b13a09855c569b23d489bea5f00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T07:25:40.867 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:40 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:40.545+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:40.867 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:40 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:40.545+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:40.867 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:40 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:40.545+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:40.867 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:40 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:40.545+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:40.867 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:40 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:40.545+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:40.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:40 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:40.464+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:40.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:40 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:40.464+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:40.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:40 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:40.464+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:40.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:40 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:40.464+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:40.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:40 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:40.464+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:41.152 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 21 07:25:40 smithi175 podman[66920]: 2024-09-21 07:25:40.866291306 +0000 UTC m=+0.727213539 container died a4bf86362a875c11c738bfd7cf2084fcd071b13a09855c569b23d489bea5f00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:25:41.485 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T07:25:41.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:25:41.565 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T07:25:41.565 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T07:25:41.565 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.9 2024-09-21T07:25:41.738 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:41 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:41.506+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:41.739 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:41 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:41.506+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:41.739 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:41 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:41.506+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:41.739 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:41 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:41.506+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:41.739 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:41 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:41.506+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:41.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:41 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:41.615+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:41.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:41 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:41.615+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:41.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:41 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:41.615+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:41.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:41 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:41.615+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:41.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:41 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:41.615+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:41.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:41 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:41.615+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:41.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:41 smithi092 systemd[1]: Stopping Ceph osd.9 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:25:41.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:41 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:41.439+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:41.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:41 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:41.439+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:41.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:41 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:41.439+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:41.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:41 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:41.439+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:41.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:41 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:41.439+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:42.362 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:41 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:41.887+0000 7fc33e57b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:25:42.362 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:41 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:41.887+0000 7fc33e57b640 -1 osd.9 100 *** Got signal Terminated *** 2024-09-21T07:25:42.362 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:41 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:41.887+0000 7fc33e57b640 -1 osd.9 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:25:42.767 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:42 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:42.499+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:42.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:42 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:42.499+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:42.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:42 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:42.499+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:42.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:42 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:42.499+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:42.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:42 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:42.499+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:42.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:42 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:42.589+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:42.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:42 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:42.589+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:42.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:42 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:42.589+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:42.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:42 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:42.589+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:42.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:42 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:42.589+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:42.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:42 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:42.589+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:42.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:42 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:42.435+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:42.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:42 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:42.435+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:42.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:42 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:42.435+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:42.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:42 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:42.435+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:42.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:42 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:42.435+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:43.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:43 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:43.503+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:43.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:43 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:43.503+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:43.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:43 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:43.503+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:43.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:43 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:43.503+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:43.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:43 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:43.503+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:43.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:43 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:43.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:43.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:43 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:43.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:43.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:43 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:43.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:43.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:43 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:43.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:43.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:43 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:43.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:43.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:43 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:43.567+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:43.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:43 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:43.476+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:43.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:43 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:43.476+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:43.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:43 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:43.476+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:43.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:43 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:43.476+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:43.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:43 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:43.476+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:44.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:44 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:44.461+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:44.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:44 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:44.461+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:44.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:44 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:44.461+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:44.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:44 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:44.461+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:44.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:44 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:44.461+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:44.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:44 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:44.560+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:44.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:44 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:44.560+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:44.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:44 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:44.560+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:44.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:44 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:44.560+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:44.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:44 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:44.560+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:44.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:44 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:44.560+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:44.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:44 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:44.442+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:44.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:44 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:44.442+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:44.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:44 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:44.442+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:44.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:44 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:44.442+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:44.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:44 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:44.442+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:44.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:44 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:44.442+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:45.767 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:45.456+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:45.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:45.456+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:45.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:45.456+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:45.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:45.456+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:45.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:45.456+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:45.781 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:45 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:45.513+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:45.781 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:45 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:45.513+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:45.781 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:45 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:45.513+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:45.781 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:45 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:45.513+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:45.781 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:45 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:45.513+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:45.781 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:45 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:45.513+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:45.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:45 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:45.456+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:45.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:45 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:45.456+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:45.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:45 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:45.456+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:45.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:45 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:45.456+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:45.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:45 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:45.456+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:45.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:45 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:45.456+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:46.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:46 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:46.424+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:46.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:46 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:46.424+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:46.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:46 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:46.424+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:46.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:46 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:46.424+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:46.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:46 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:46.424+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:46.846 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:46 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:46.504+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:46.847 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:46 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:46.504+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:46.847 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:46 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:46.504+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:46.847 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:46 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:46.504+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:46.847 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:46 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:46.504+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:46.847 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:46 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:46.504+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:46.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:46 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:46.488+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:29.485060+0000 front 2024-09-21T07:24:29.485083+0000 (oldest deadline 2024-09-21T07:25:00.085757+0000) 2024-09-21T07:25:46.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:46 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:46.488+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.086275+0000 front 2024-09-21T07:24:40.086467+0000 (oldest deadline 2024-09-21T07:25:05.386305+0000) 2024-09-21T07:25:46.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:46 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:46.488+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.787860+0000 front 2024-09-21T07:24:48.788072+0000 (oldest deadline 2024-09-21T07:25:12.287909+0000) 2024-09-21T07:25:46.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:46 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:46.488+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.588860+0000 front 2024-09-21T07:24:57.588898+0000 (oldest deadline 2024-09-21T07:25:22.288941+0000) 2024-09-21T07:25:46.862 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:46 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:46.488+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.289458+0000 front 2024-09-21T07:25:02.289361+0000 (oldest deadline 2024-09-21T07:25:27.489792+0000) 2024-09-21T07:25:46.863 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:46 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9[66442]: 2024-09-21T07:25:46.488+0000 7fc33ab66640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.391550+0000 front 2024-09-21T07:25:14.391677+0000 (oldest deadline 2024-09-21T07:25:35.491308+0000) 2024-09-21T07:25:47.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:47 smithi092 podman[113731]: 2024-09-21 07:25:47.342414999 +0000 UTC m=+5.576794385 container died f0d9d7a990be05ec77daaf0409c17b9b0ff4a113f463b275f7b5eaf2498885f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T07:25:47.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:47 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:47.454+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:47.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:47 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:47.454+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:47.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:47 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:47.454+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:47.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:47 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:47.454+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:47.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:47 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:47.454+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:47.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:47 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:47.508+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:47.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:47 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:47.508+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:47.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:47 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:47.508+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:47.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:47 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:47.508+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:47.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:47 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:47.508+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:47.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:47 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:47.508+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:48.057 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:47 smithi092 podman[113731]: 2024-09-21 07:25:47.829426112 +0000 UTC m=+6.063805543 container cleanup f0d9d7a990be05ec77daaf0409c17b9b0ff4a113f463b275f7b5eaf2498885f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T07:25:48.057 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:47 smithi092 bash[113731]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9 2024-09-21T07:25:48.362 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:48 smithi092 podman[113757]: 2024-09-21 07:25:48.055554469 +0000 UTC m=+0.708326676 container remove f0d9d7a990be05ec77daaf0409c17b9b0ff4a113f463b275f7b5eaf2498885f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:25:48.693 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:48 smithi092 podman[113846]: 2024-09-21 07:25:48.287272602 +0000 UTC m=+0.015661834 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:25:48.693 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:48 smithi092 podman[113846]: 2024-09-21 07:25:48.389698818 +0000 UTC m=+0.118088083 container create 801cb3ea4d2a8c3c799ad8a7706ef18eca235c5268a2117a3f59c75eae89acd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:25:48.693 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:48 smithi092 podman[113846]: 2024-09-21 07:25:48.609063155 +0000 UTC m=+0.337452386 container init 801cb3ea4d2a8c3c799ad8a7706ef18eca235c5268a2117a3f59c75eae89acd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T07:25:48.693 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:48 smithi092 podman[113846]: 2024-09-21 07:25:48.612367513 +0000 UTC m=+0.340756736 container start 801cb3ea4d2a8c3c799ad8a7706ef18eca235c5268a2117a3f59c75eae89acd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T07:25:48.694 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:48 smithi092 podman[113846]: 2024-09-21 07:25:48.692075162 +0000 UTC m=+0.420464393 container attach 801cb3ea4d2a8c3c799ad8a7706ef18eca235c5268a2117a3f59c75eae89acd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T07:25:48.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:48 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:48.448+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:48.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:48 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:48.448+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:48.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:48 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:48.448+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:48.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:48 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:48.448+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:48.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:48 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:48.448+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:48.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:48 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:48.499+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:48.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:48 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:48.499+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:48.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:48 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:48.499+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:48.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:48 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:48.499+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:48.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:48 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:48.499+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:48.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:48 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:48.499+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:49.096 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 21 07:25:48 smithi092 podman[113846]: 2024-09-21 07:25:48.801165283 +0000 UTC m=+0.529554520 container died 801cb3ea4d2a8c3c799ad8a7706ef18eca235c5268a2117a3f59c75eae89acd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:25:49.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T07:25:49.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:25:49.506 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T07:25:49.506 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T07:25:49.506 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.10 2024-09-21T07:25:49.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:49 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:49.415+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:49.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:49 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:49.415+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:49.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:49 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:49.415+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:49.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:49 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:49.415+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:49.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:49 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:49.415+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:49.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:49 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:49.415+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:49.836 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:49 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:49.506+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:49.836 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:49 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:49.506+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:49.836 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:49 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:49.506+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:49.836 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:49 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:49.506+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:49.837 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:49 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:49.506+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:49.837 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:49 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:49.506+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:49.837 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:49 smithi169 systemd[1]: Stopping Ceph osd.10 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:25:49.837 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:49 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:49.834+0000 7fc1119a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:25:50.143 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:49 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:49.834+0000 7fc1119a9640 -1 osd.10 100 *** Got signal Terminated *** 2024-09-21T07:25:50.143 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:49 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:49.834+0000 7fc1119a9640 -1 osd.10 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:25:50.767 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:50 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:50.443+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:50.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:50 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:50.443+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:50.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:50 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:50.443+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:50.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:50 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:50.443+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:50.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:50 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:50.443+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:50.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:50 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:50.443+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:50.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:50 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:50.468+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:50.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:50 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:50.469+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:50.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:50 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:50.469+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:50.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:50 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:50.469+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:50.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:50 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:50.469+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:50.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:50 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:50.469+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:51.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:51 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:51.460+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:51.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:51 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:51.460+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:51.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:51 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:51.460+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:51.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:51 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:51.460+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:51.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:51 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:51.460+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:51.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:51 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:51.460+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:51.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:51 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:51.518+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:51.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:51 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:51.518+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:51.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:51 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:51.518+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:51.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:51 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:51.518+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:51.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:51 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:51.518+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:51.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:51 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:51.518+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:52.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:52 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:52.501+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:52.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:52 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:52.501+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:52.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:52 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:52.501+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:52.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:52 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:52.501+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:52.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:52 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:52.501+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:52.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:52 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:52.501+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:52.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:52 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:52.561+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:52.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:52 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:52.561+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:52.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:52 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:52.561+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:52.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:52 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:52.561+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:52.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:52 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:52.561+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:52.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:52 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:52.561+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:52.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:52 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:52.561+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:27.698638+0000 front 2024-09-21T07:25:27.698730+0000 (oldest deadline 2024-09-21T07:25:51.798669+0000) 2024-09-21T07:25:53.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:53 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:53.490+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:53.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:53 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:53.490+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:53.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:53 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:53.490+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:53.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:53 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:53.490+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:53.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:53 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:53.490+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:53.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:53 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:53.490+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:53.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:53 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:53.610+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:53.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:53 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:53.610+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:53.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:53 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:53.610+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:53.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:53 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:53.610+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:53.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:53 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:53.610+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:53.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:53 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:53.610+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:53.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:53 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:53.610+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:27.698638+0000 front 2024-09-21T07:25:27.698730+0000 (oldest deadline 2024-09-21T07:25:51.798669+0000) 2024-09-21T07:25:54.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:54 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:54.593+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6804 osd.1 since back 2024-09-21T07:24:40.890074+0000 front 2024-09-21T07:24:40.889983+0000 (oldest deadline 2024-09-21T07:25:03.190347+0000) 2024-09-21T07:25:54.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:54 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:54.593+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:50.191988+0000 front 2024-09-21T07:24:50.191805+0000 (oldest deadline 2024-09-21T07:25:16.091786+0000) 2024-09-21T07:25:54.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:54 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:54.593+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:56.092493+0000 front 2024-09-21T07:24:56.092349+0000 (oldest deadline 2024-09-21T07:25:19.592294+0000) 2024-09-21T07:25:54.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:54 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:54.593+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:06.593820+0000 front 2024-09-21T07:25:06.593854+0000 (oldest deadline 2024-09-21T07:25:27.693921+0000) 2024-09-21T07:25:54.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:54 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:54.593+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:14.396542+0000 front 2024-09-21T07:25:14.396694+0000 (oldest deadline 2024-09-21T07:25:39.696496+0000) 2024-09-21T07:25:54.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:54 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:54.593+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:21.397602+0000 front 2024-09-21T07:25:21.397651+0000 (oldest deadline 2024-09-21T07:25:43.598012+0000) 2024-09-21T07:25:54.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:54 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10[57722]: 2024-09-21T07:25:54.593+0000 7fc109f8c640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:27.698638+0000 front 2024-09-21T07:25:27.698730+0000 (oldest deadline 2024-09-21T07:25:51.798669+0000) 2024-09-21T07:25:55.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:54 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:54.525+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:55.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:54 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:54.525+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:55.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:54 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:54.525+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:55.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:54 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:54.525+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:55.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:54 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:54.525+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:55.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:54 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:54.525+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:55.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:54 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:54.525+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:29.347311+0000 front 2024-09-21T07:25:29.347414+0000 (oldest deadline 2024-09-21T07:25:54.047152+0000) 2024-09-21T07:25:55.633 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:55 smithi169 podman[67403]: 2024-09-21 07:25:55.300698438 +0000 UTC m=+5.606189190 container died 004422d9502b7e6c5758d867dd3ee2df8a1f1eb1af34169b47c9e866092cbb01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:25:55.633 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:55 smithi169 podman[67403]: 2024-09-21 07:25:55.632032198 +0000 UTC m=+5.937522941 container cleanup 004422d9502b7e6c5758d867dd3ee2df8a1f1eb1af34169b47c9e866092cbb01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T07:25:55.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:55 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:55.514+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:55.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:55 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:55.514+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:55.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:55 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:55.514+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:55.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:55 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:55.514+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:55.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:55 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:55.514+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:55.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:55 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:55.514+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:55.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:55 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:55.514+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:29.347311+0000 front 2024-09-21T07:25:29.347414+0000 (oldest deadline 2024-09-21T07:25:54.047152+0000) 2024-09-21T07:25:55.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:55 smithi169 bash[67403]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10 2024-09-21T07:25:55.894 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:55 smithi169 podman[67419]: 2024-09-21 07:25:55.842027699 +0000 UTC m=+0.537508259 container remove 004422d9502b7e6c5758d867dd3ee2df8a1f1eb1af34169b47c9e866092cbb01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T07:25:56.554 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:56 smithi169 podman[67507]: 2024-09-21 07:25:56.160732647 +0000 UTC m=+0.016172846 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:25:56.554 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:56 smithi169 podman[67507]: 2024-09-21 07:25:56.267895606 +0000 UTC m=+0.123335848 container create 4c2e59d92dd297f0bc4d3a946fb1cf5dd5a2296544d23e37bfebbb4d512012fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T07:25:56.554 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:56 smithi169 podman[67507]: 2024-09-21 07:25:56.48669579 +0000 UTC m=+0.342135993 container init 4c2e59d92dd297f0bc4d3a946fb1cf5dd5a2296544d23e37bfebbb4d512012fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T07:25:56.555 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:56 smithi169 podman[67507]: 2024-09-21 07:25:56.48981316 +0000 UTC m=+0.345253364 container start 4c2e59d92dd297f0bc4d3a946fb1cf5dd5a2296544d23e37bfebbb4d512012fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T07:25:56.555 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:56 smithi169 podman[67507]: 2024-09-21 07:25:56.553343678 +0000 UTC m=+0.408783880 container attach 4c2e59d92dd297f0bc4d3a946fb1cf5dd5a2296544d23e37bfebbb4d512012fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T07:25:56.893 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:56 smithi169 podman[67507]: 2024-09-21 07:25:56.677486212 +0000 UTC m=+0.532926416 container died 4c2e59d92dd297f0bc4d3a946fb1cf5dd5a2296544d23e37bfebbb4d512012fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T07:25:57.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:56 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:56.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:57.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:56 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:56.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:57.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:56 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:56.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:57.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:56 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:56.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:57.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:56 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:56.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:57.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:56 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:56.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:57.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:56 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:56.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:29.347311+0000 front 2024-09-21T07:25:29.347414+0000 (oldest deadline 2024-09-21T07:25:54.047152+0000) 2024-09-21T07:25:57.217 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T07:25:57.242 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:57 smithi169 podman[67530]: 2024-09-21 07:25:57.198130006 +0000 UTC m=+0.512515041 container remove 4c2e59d92dd297f0bc4d3a946fb1cf5dd5a2296544d23e37bfebbb4d512012fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T07:25:57.242 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:57 smithi169 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.10.service: Deactivated successfully. 2024-09-21T07:25:57.242 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:57 smithi169 systemd[1]: Stopped Ceph osd.10 for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:25:57.242 INFO:journalctl@ceph.osd.10.smithi169.stdout:Sep 21 07:25:57 smithi169 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.10.service: Consumed 32.740s CPU time. 2024-09-21T07:25:57.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:25:57.255 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T07:25:57.255 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T07:25:57.255 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.11 2024-09-21T07:25:57.571 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 systemd[1]: Stopping Ceph osd.11 for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:25:58.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:57.569+0000 7f63293a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:25:58.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:57.569+0000 7f63293a9640 -1 osd.11 100 *** Got signal Terminated *** 2024-09-21T07:25:58.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:57.569+0000 7f63293a9640 -1 osd.11 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:25:58.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:57.574+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:58.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:57.574+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:58.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:57.574+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:58.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:57.574+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:58.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:57.574+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:58.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:57.574+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:58.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:57 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:57.574+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:29.347311+0000 front 2024-09-21T07:25:29.347414+0000 (oldest deadline 2024-09-21T07:25:54.047152+0000) 2024-09-21T07:25:59.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:58 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:58.557+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:59.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:58 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:58.557+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:59.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:58 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:58.557+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:59.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:58 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:58.557+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:59.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:58 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:58.557+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:59.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:58 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:58.557+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:59.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:58 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:58.557+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:29.347311+0000 front 2024-09-21T07:25:29.347414+0000 (oldest deadline 2024-09-21T07:25:54.047152+0000) 2024-09-21T07:25:59.919 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:59 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:59.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:25:59.919 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:59 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:59.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:25:59.919 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:59 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:59.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:25:59.919 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:59 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:59.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:25:59.919 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:59 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:59.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:25:59.919 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:59 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:59.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:25:59.920 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:25:59 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:25:59.548+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:29.347311+0000 front 2024-09-21T07:25:29.347414+0000 (oldest deadline 2024-09-21T07:25:54.047152+0000) 2024-09-21T07:26:01.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:00.532+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:26:01.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:00.532+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:26:01.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:00.532+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:26:01.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:00.532+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:26:01.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:00.532+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:26:01.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:00.532+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:26:01.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:00 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:00.532+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:29.347311+0000 front 2024-09-21T07:25:29.347414+0000 (oldest deadline 2024-09-21T07:25:54.047152+0000) 2024-09-21T07:26:02.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:01 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:01.521+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:26:02.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:01 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:01.521+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:26:02.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:01 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:01.521+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:26:02.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:01 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:01.521+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:26:02.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:01 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:01.521+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:26:02.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:01 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:01.521+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:26:02.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:01 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:01.521+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:29.347311+0000 front 2024-09-21T07:25:29.347414+0000 (oldest deadline 2024-09-21T07:25:54.047152+0000) 2024-09-21T07:26:03.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:02 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:02.526+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-21T07:24:33.040405+0000 front 2024-09-21T07:24:33.040348+0000 (oldest deadline 2024-09-21T07:24:57.740530+0000) 2024-09-21T07:26:03.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:02 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:02.526+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-21T07:24:48.342010+0000 front 2024-09-21T07:24:48.342045+0000 (oldest deadline 2024-09-21T07:25:11.842170+0000) 2024-09-21T07:26:03.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:02 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:02.526+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-21T07:24:57.043757+0000 front 2024-09-21T07:24:57.043618+0000 (oldest deadline 2024-09-21T07:25:22.943507+0000) 2024-09-21T07:26:03.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:02 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:02.526+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6812 osd.4 since back 2024-09-21T07:25:02.943992+0000 front 2024-09-21T07:25:02.944081+0000 (oldest deadline 2024-09-21T07:25:27.644027+0000) 2024-09-21T07:26:03.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:02 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:02.526+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-21T07:25:13.544887+0000 front 2024-09-21T07:25:13.544902+0000 (oldest deadline 2024-09-21T07:25:38.245029+0000) 2024-09-21T07:26:03.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:02 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:02.526+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-21T07:25:18.245671+0000 front 2024-09-21T07:25:18.245626+0000 (oldest deadline 2024-09-21T07:25:48.846229+0000) 2024-09-21T07:26:03.018 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:02 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11[57829]: 2024-09-21T07:26:02.526+0000 7f6325994640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.169:6820 osd.7 since back 2024-09-21T07:25:29.347311+0000 front 2024-09-21T07:25:29.347414+0000 (oldest deadline 2024-09-21T07:25:54.047152+0000) 2024-09-21T07:26:03.412 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:03 smithi175 podman[67034]: 2024-09-21 07:26:03.10035018 +0000 UTC m=+5.643130973 container died 08574e9f387cbb368cef0e69f89a33baa151ab3908da21905834653070fe32f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T07:26:03.738 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:03 smithi175 podman[67034]: 2024-09-21 07:26:03.511187796 +0000 UTC m=+6.053968590 container cleanup 08574e9f387cbb368cef0e69f89a33baa151ab3908da21905834653070fe32f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T07:26:03.738 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:03 smithi175 bash[67034]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11 2024-09-21T07:26:04.017 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:03 smithi175 podman[67051]: 2024-09-21 07:26:03.737358788 +0000 UTC m=+0.632558256 container remove 08574e9f387cbb368cef0e69f89a33baa151ab3908da21905834653070fe32f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T07:26:04.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:04 smithi175 podman[67142]: 2024-09-21 07:26:03.978552668 +0000 UTC m=+0.015977824 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:26:04.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:04 smithi175 podman[67142]: 2024-09-21 07:26:04.113478971 +0000 UTC m=+0.150904114 container create 739c45c42932d204202e70fc9f3b181e874a71a6433a01df2e0aaf74ea81d78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:26:04.350 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:04 smithi175 podman[67142]: 2024-09-21 07:26:04.349366386 +0000 UTC m=+0.386791541 container init 739c45c42932d204202e70fc9f3b181e874a71a6433a01df2e0aaf74ea81d78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T07:26:04.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:04 smithi175 podman[67142]: 2024-09-21 07:26:04.35267602 +0000 UTC m=+0.390101166 container start 739c45c42932d204202e70fc9f3b181e874a71a6433a01df2e0aaf74ea81d78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:26:04.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:04 smithi175 podman[67142]: 2024-09-21 07:26:04.432584169 +0000 UTC m=+0.470009315 container attach 739c45c42932d204202e70fc9f3b181e874a71a6433a01df2e0aaf74ea81d78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T07:26:04.768 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 21 07:26:04 smithi175 podman[67142]: 2024-09-21 07:26:04.537667105 +0000 UTC m=+0.575092249 container died 739c45c42932d204202e70fc9f3b181e874a71a6433a01df2e0aaf74ea81d78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:26:05.185 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T07:26:05.224 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:05.225 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T07:26:05.225 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T07:26:05.225 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.a 2024-09-21T07:26:05.514 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 21 07:26:05 smithi092 systemd[1]: Stopping Ceph mds.a for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:05.862 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 21 07:26:05 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-a[73032]: 2024-09-21T07:26:05.512+0000 7ff830fe1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:05.862 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 21 07:26:05 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-a[73032]: 2024-09-21T07:26:05.512+0000 7ff830fe1640 -1 mds.a *** got signal Terminated *** 2024-09-21T07:26:08.163 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 21 07:26:07 smithi092 podman[113949]: 2024-09-21 07:26:07.907417127 +0000 UTC m=+2.495551384 container died 1068d396bab30a8b11f6be68361c348864f58401d01997752acb947b61846f42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T07:26:08.539 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 21 07:26:08 smithi092 podman[113949]: 2024-09-21 07:26:08.337010914 +0000 UTC m=+2.925145157 container cleanup 1068d396bab30a8b11f6be68361c348864f58401d01997752acb947b61846f42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T07:26:08.539 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 21 07:26:08 smithi092 bash[113949]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-a 2024-09-21T07:26:08.772 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T07:26:08.793 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 21 07:26:08 smithi092 podman[113961]: 2024-09-21 07:26:08.538272875 +0000 UTC m=+0.631427311 container remove 1068d396bab30a8b11f6be68361c348864f58401d01997752acb947b61846f42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T07:26:08.793 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 21 07:26:08 smithi092 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.a.service: Deactivated successfully. 2024-09-21T07:26:08.793 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 21 07:26:08 smithi092 systemd[1]: Stopped Ceph mds.a for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:26:08.793 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 21 07:26:08 smithi092 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.a.service: Consumed 2.133s CPU time. 2024-09-21T07:26:08.805 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:08.805 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T07:26:08.805 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T07:26:08.805 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.d 2024-09-21T07:26:09.112 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:26:08 smithi092 systemd[1]: Stopping Ceph mds.d for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:09.612 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:26:09 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-d[71908]: 2024-09-21T07:26:09.132+0000 7f4b46649640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:09.612 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:26:09 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-d[71908]: 2024-09-21T07:26:09.132+0000 7f4b46649640 -1 mds.d *** got signal Terminated *** 2024-09-21T07:26:13.417 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:26:13 smithi092 podman[114071]: 2024-09-21 07:26:13.138930109 +0000 UTC m=+4.113659011 container died 5c4964628a8ce963d4c35466cad11d2e9c8120870531bd7c98199a3953255b58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-d, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:26:13.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:26:13 smithi092 podman[114071]: 2024-09-21 07:26:13.49037615 +0000 UTC m=+4.465105051 container cleanup 5c4964628a8ce963d4c35466cad11d2e9c8120870531bd7c98199a3953255b58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-d, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:26:13.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 21 07:26:13 smithi092 bash[114071]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-d 2024-09-21T07:26:13.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T07:26:13.950 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:13.951 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T07:26:13.951 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T07:26:13.951 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.g 2024-09-21T07:26:14.262 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:26:14 smithi092 systemd[1]: Stopping Ceph mds.g for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:14.262 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:26:14 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g[72669]: 2024-09-21T07:26:14.260+0000 7f1711432640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:14.262 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:26:14 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g[72669]: 2024-09-21T07:26:14.260+0000 7f1711432640 -1 mds.g *** got signal Terminated *** 2024-09-21T07:26:16.162 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:26:15 smithi092 podman[114190]: 2024-09-21 07:26:15.900068967 +0000 UTC m=+1.732967389 container died ee112da5b2b713ba4e39615459ce537f48c026dd2e5a9972d1b3d4271ef25e3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:26:16.512 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:26:16 smithi092 podman[114190]: 2024-09-21 07:26:16.26051712 +0000 UTC m=+2.093415552 container cleanup ee112da5b2b713ba4e39615459ce537f48c026dd2e5a9972d1b3d4271ef25e3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:26:16.512 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 21 07:26:16 smithi092 bash[114190]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-g 2024-09-21T07:26:16.656 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T07:26:16.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:16.688 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T07:26:16.688 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T07:26:16.688 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.j 2024-09-21T07:26:17.112 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:26:16 smithi092 systemd[1]: Stopping Ceph mds.j for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:17.112 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:26:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-j[71542]: 2024-09-21T07:26:16.988+0000 7f9ef0a63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:17.112 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:26:16 smithi092 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-j[71542]: 2024-09-21T07:26:16.988+0000 7f9ef0a63640 -1 mds.j *** got signal Terminated *** 2024-09-21T07:26:18.431 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:26:18 smithi092 podman[114310]: 2024-09-21 07:26:18.115646288 +0000 UTC m=+1.213460453 container died c66e82f8f177fe0be3b0cd88404de6a4bcb7100a77f0be98837bf02f8664e1d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T07:26:18.698 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:26:18 smithi092 podman[114310]: 2024-09-21 07:26:18.572566157 +0000 UTC m=+1.670380325 container cleanup c66e82f8f177fe0be3b0cd88404de6a4bcb7100a77f0be98837bf02f8664e1d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:26:18.698 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:26:18 smithi092 bash[114310]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-j 2024-09-21T07:26:19.053 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 21 07:26:18 smithi092 podman[114322]: 2024-09-21 07:26:18.882190269 +0000 UTC m=+0.757986973 container remove c66e82f8f177fe0be3b0cd88404de6a4bcb7100a77f0be98837bf02f8664e1d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:26:19.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T07:26:19.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:19.109 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T07:26:19.109 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T07:26:19.109 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.b 2024-09-21T07:26:19.393 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:26:19 smithi169 systemd[1]: Stopping Ceph mds.b for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:19.740 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:26:19 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b[63008]: 2024-09-21T07:26:19.415+0000 7f13e7ebd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:19.741 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:26:19 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b[63008]: 2024-09-21T07:26:19.415+0000 7f13e7ebd640 -1 mds.b *** got signal Terminated *** 2024-09-21T07:26:23.743 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:26:23 smithi169 podman[67609]: 2024-09-21 07:26:23.425721965 +0000 UTC m=+4.121649710 container died 9c04609fae8d10caf9bb01d32200819d36af67074bc4835ba02018a48bff392c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T07:26:24.092 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:26:23 smithi169 podman[67609]: 2024-09-21 07:26:23.823228341 +0000 UTC m=+4.519156087 container cleanup 9c04609fae8d10caf9bb01d32200819d36af67074bc4835ba02018a48bff392c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T07:26:24.092 INFO:journalctl@ceph.mds.b.smithi169.stdout:Sep 21 07:26:23 smithi169 bash[67609]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-b 2024-09-21T07:26:24.268 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T07:26:24.305 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:24.306 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T07:26:24.306 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T07:26:24.306 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.e 2024-09-21T07:26:24.643 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:26:24 smithi169 systemd[1]: Stopping Ceph mds.e for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:25.143 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:26:24 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e[62462]: 2024-09-21T07:26:24.687+0000 7f91465a7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:25.143 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:26:24 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e[62462]: 2024-09-21T07:26:24.687+0000 7f91465a7640 -1 mds.e *** got signal Terminated *** 2024-09-21T07:26:28.195 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:26:27 smithi169 podman[67740]: 2024-09-21 07:26:27.90441572 +0000 UTC m=+3.370893442 container died 032f8a71257016f644555be47eca4a0d994a1833d6f584b6b0cd6514f347b7b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:26:28.545 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:26:28 smithi169 podman[67740]: 2024-09-21 07:26:28.293315914 +0000 UTC m=+3.759793637 container cleanup 032f8a71257016f644555be47eca4a0d994a1833d6f584b6b0cd6514f347b7b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T07:26:28.546 INFO:journalctl@ceph.mds.e.smithi169.stdout:Sep 21 07:26:28 smithi169 bash[67740]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-e 2024-09-21T07:26:28.721 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T07:26:28.755 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:28.755 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T07:26:28.756 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T07:26:28.756 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.h 2024-09-21T07:26:29.082 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:26:28 smithi169 systemd[1]: Stopping Ceph mds.h for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:29.393 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:26:29 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h[62737]: 2024-09-21T07:26:29.080+0000 7f6c614c8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:29.393 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:26:29 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h[62737]: 2024-09-21T07:26:29.080+0000 7f6c614c8640 -1 mds.h *** got signal Terminated *** 2024-09-21T07:26:32.207 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:26:31 smithi169 podman[67864]: 2024-09-21 07:26:31.895223168 +0000 UTC m=+2.925164144 container died 5ca148c1383d0df514ddf508498f51243aeda14db09d873703e1678b1718ada2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T07:26:32.550 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:26:32 smithi169 podman[67864]: 2024-09-21 07:26:32.305978957 +0000 UTC m=+3.335919924 container cleanup 5ca148c1383d0df514ddf508498f51243aeda14db09d873703e1678b1718ada2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T07:26:32.550 INFO:journalctl@ceph.mds.h.smithi169.stdout:Sep 21 07:26:32 smithi169 bash[67864]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-h 2024-09-21T07:26:32.699 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T07:26:32.732 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:32.732 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T07:26:32.732 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T07:26:32.732 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.k 2024-09-21T07:26:33.143 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:26:32 smithi169 systemd[1]: Stopping Ceph mds.k for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:33.143 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:26:33 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k[62177]: 2024-09-21T07:26:33.059+0000 7fc57f9dd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:33.143 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:26:33 smithi169 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k[62177]: 2024-09-21T07:26:33.059+0000 7fc57f9dd640 -1 mds.k *** got signal Terminated *** 2024-09-21T07:26:36.169 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:26:35 smithi169 podman[67982]: 2024-09-21 07:26:35.897095146 +0000 UTC m=+2.948191797 container died df9288155f364184ddd3b6fedc79aefe7e2f50c1f865aaa853aeea010c9ba705 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T07:26:36.536 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:26:36 smithi169 podman[67982]: 2024-09-21 07:26:36.267549129 +0000 UTC m=+3.318645789 container cleanup df9288155f364184ddd3b6fedc79aefe7e2f50c1f865aaa853aeea010c9ba705 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T07:26:36.536 INFO:journalctl@ceph.mds.k.smithi169.stdout:Sep 21 07:26:36 smithi169 bash[67982]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-k 2024-09-21T07:26:36.686 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T07:26:36.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:36.718 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T07:26:36.719 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T07:26:36.719 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.c 2024-09-21T07:26:37.011 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:26:36 smithi175 systemd[1]: Stopping Ceph mds.c for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:37.267 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:26:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c[62472]: 2024-09-21T07:26:37.009+0000 7f5ab98dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:37.268 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:26:37 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c[62472]: 2024-09-21T07:26:37.009+0000 7f5ab98dc640 -1 mds.c *** got signal Terminated *** 2024-09-21T07:26:40.268 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:26:39 smithi175 podman[67243]: 2024-09-21 07:26:39.918449111 +0000 UTC m=+3.009310903 container died e8af9bae0688bc561ff12096db9518ae37e61d296fd25bc2a951e4aafc21d868 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:26:40.661 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:26:40 smithi175 podman[67243]: 2024-09-21 07:26:40.367472665 +0000 UTC m=+3.458334450 container cleanup e8af9bae0688bc561ff12096db9518ae37e61d296fd25bc2a951e4aafc21d868 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T07:26:40.661 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 21 07:26:40 smithi175 bash[67243]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-c 2024-09-21T07:26:40.810 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T07:26:40.845 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:40.845 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T07:26:40.845 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T07:26:40.845 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.f 2024-09-21T07:26:41.268 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:26:40 smithi175 systemd[1]: Stopping Ceph mds.f for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:41.268 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:26:41 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f[62194]: 2024-09-21T07:26:41.154+0000 7fcb8958e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:41.268 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:26:41 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f[62194]: 2024-09-21T07:26:41.154+0000 7fcb8958e640 -1 mds.f *** got signal Terminated *** 2024-09-21T07:26:44.206 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:26:43 smithi175 podman[67376]: 2024-09-21 07:26:43.896938208 +0000 UTC m=+2.841904040 container died 9488da2c92efc2b160bde579ba3f0982b3302ccca1682ef2ef5116ecf8945dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T07:26:44.517 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:26:44 smithi175 podman[67376]: 2024-09-21 07:26:44.270954213 +0000 UTC m=+3.215920031 container cleanup 9488da2c92efc2b160bde579ba3f0982b3302ccca1682ef2ef5116ecf8945dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T07:26:44.518 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 21 07:26:44 smithi175 bash[67376]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-f 2024-09-21T07:26:44.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T07:26:44.737 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:44.737 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T07:26:44.737 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T07:26:44.737 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.i 2024-09-21T07:26:45.059 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:26:44 smithi175 systemd[1]: Stopping Ceph mds.i for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:45.517 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:26:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: 2024-09-21T07:26:45.056+0000 7fdd681a0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:45.518 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:26:45 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i[62743]: 2024-09-21T07:26:45.056+0000 7fdd681a0640 -1 mds.i *** got signal Terminated *** 2024-09-21T07:26:48.018 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:26:47 smithi175 podman[67497]: 2024-09-21 07:26:47.895262755 +0000 UTC m=+2.942580341 container died af83965619687978edfc7c0a49b5b719e38d9903c49ea44b6311ddd5e312c161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T07:26:48.835 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:26:48 smithi175 podman[67497]: 2024-09-21 07:26:48.549839655 +0000 UTC m=+3.597157241 container cleanup af83965619687978edfc7c0a49b5b719e38d9903c49ea44b6311ddd5e312c161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:26:48.835 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 21 07:26:48 smithi175 bash[67497]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-i 2024-09-21T07:26:48.971 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T07:26:49.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:49.004 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T07:26:49.004 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T07:26:49.004 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.l 2024-09-21T07:26:49.517 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:26:49 smithi175 systemd[1]: Stopping Ceph mds.l for 4e9565c0-77e7-11ef-baf5-efdc52797490... 2024-09-21T07:26:49.518 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:26:49 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l[61924]: 2024-09-21T07:26:49.328+0000 7fa3219de640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:26:49.518 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:26:49 smithi175 ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l[61924]: 2024-09-21T07:26:49.328+0000 7fa3219de640 -1 mds.l *** got signal Terminated *** 2024-09-21T07:26:52.251 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:26:51 smithi175 podman[67618]: 2024-09-21 07:26:51.919488371 +0000 UTC m=+2.694898301 container died 4a49adc8976f36babffb0b1ba2006c740be56a1ec053bdfce54825cb389f6ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:26:52.518 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:26:52 smithi175 podman[67618]: 2024-09-21 07:26:52.336729667 +0000 UTC m=+3.112139596 container cleanup 4a49adc8976f36babffb0b1ba2006c740be56a1ec053bdfce54825cb389f6ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:26:52.518 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:26:52 smithi175 bash[67618]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l 2024-09-21T07:26:52.809 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T07:26:52.830 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:26:52 smithi175 podman[67630]: 2024-09-21 07:26:52.571076897 +0000 UTC m=+0.653296052 container remove 4a49adc8976f36babffb0b1ba2006c740be56a1ec053bdfce54825cb389f6ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4e9565c0-77e7-11ef-baf5-efdc52797490-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T07:26:52.831 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:26:52 smithi175 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.l.service: Deactivated successfully. 2024-09-21T07:26:52.831 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:26:52 smithi175 systemd[1]: Stopped Ceph mds.l for 4e9565c0-77e7-11ef-baf5-efdc52797490. 2024-09-21T07:26:52.831 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 21 07:26:52 smithi175 systemd[1]: ceph-4e9565c0-77e7-11ef-baf5-efdc52797490@mds.l.service: Consumed 2.002s CPU time. 2024-09-21T07:26:52.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:26:52.842 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T07:26:52.842 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T07:26:53.053 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:26:55.451 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T07:26:55.656 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:26:58.120 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T07:26:58.324 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:27:00.761 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:27:00.793 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:27:00.825 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:27:00.852 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T07:27:00.854 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578/remote/smithi092/crash 2024-09-21T07:27:00.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/crash -- . 2024-09-21T07:27:00.891 INFO:teuthology.orchestra.run.smithi092.stderr:tar: /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T07:27:00.892 INFO:teuthology.orchestra.run.smithi092.stderr:tar: Error is not recoverable: exiting now 2024-09-21T07:27:00.894 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578/remote/smithi169/crash 2024-09-21T07:27:00.895 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/crash -- . 2024-09-21T07:27:00.938 INFO:teuthology.orchestra.run.smithi169.stderr:tar: /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T07:27:00.938 INFO:teuthology.orchestra.run.smithi169.stderr:tar: Error is not recoverable: exiting now 2024-09-21T07:27:00.940 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578/remote/smithi175/crash 2024-09-21T07:27:00.941 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/crash -- . 2024-09-21T07:27:00.975 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T07:27:00.976 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now 2024-09-21T07:27:00.977 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T07:27:00.977 DEBUG:teuthology.orchestra.run.smithi092:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T07:27:01.014 INFO:tasks.cephadm:Compressing logs... 2024-09-21T07:27:01.015 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:27:01.057 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:27:01.060 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:27:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-21T07:27:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:: No such file or directory 2024-09-21T07:27:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T07:27:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T07:27:01.085 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.log: /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T07:27:01.085 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T07:27:01.085 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T07:27:01.085 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T07:27:01.085 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T07:27:01.085 INFO:teuthology.orchestra.run.smithi092.stderr: /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T07:27:01.086 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T07:27:01.086 INFO:teuthology.orchestra.run.smithi092.stderr: 84.3%/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mon.a.log: -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T07:27:01.086 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T07:27:01.086 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.log 2024-09-21T07:27:01.089 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T07:27:01.089 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T07:27:01.092 INFO:teuthology.orchestra.run.smithi169.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T07:27:01.092 INFO:teuthology.orchestra.run.smithi169.stderr:: No such file or directory 2024-09-21T07:27:01.092 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T07:27:01.092 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T07:27:01.092 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T07:27:01.092 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T07:27:01.092 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T07:27:01.092 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T07:27:01.093 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T07:27:01.093 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T07:27:01.096 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.log: 87.0% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T07:27:01.097 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T07:27:01.098 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T07:27:01.098 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T07:27:01.098 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.cephadm.log: 81.6% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T07:27:01.098 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.log 2024-09-21T07:27:01.099 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T07:27:01.099 INFO:teuthology.orchestra.run.smithi175.stderr:: No such file or directory 2024-09-21T07:27:01.099 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T07:27:01.099 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T07:27:01.099 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T07:27:01.099 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T07:27:01.099 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T07:27:01.099 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T07:27:01.099 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.11.log: 81.6%gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T07:27:01.100 INFO:teuthology.orchestra.run.smithi175.stderr: -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T07:27:01.100 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.log 2024-09-21T07:27:01.100 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T07:27:01.100 INFO:teuthology.orchestra.run.smithi175.stderr: 90.2% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T07:27:01.100 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.log: 87.0% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T07:27:01.100 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T07:27:01.100 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T07:27:01.100 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.8.log: /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.l.log: 90.9% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T07:27:01.101 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.d.log: 95.1% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T07:27:01.101 INFO:teuthology.orchestra.run.smithi092.stderr: 91.1% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T07:27:01.102 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T07:27:01.102 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T07:27:01.103 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mgr.y.log: 91.0% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T07:27:01.103 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T07:27:01.104 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T07:27:01.105 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.log: 92.5% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T07:27:01.105 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T07:27:01.105 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.h.log: 87.0% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T07:27:01.107 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T07:27:01.107 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.j.log: 95.1% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T07:27:01.107 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-21T07:27:01.110 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mgr.z.log: 92.7% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T07:27:01.114 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T07:27:01.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T07:27:01.119 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T07:27:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T07:27:01.131 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T07:27:01.139 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T07:27:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T07:27:01.169 INFO:teuthology.orchestra.run.smithi092.stderr: 94.3% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T07:27:01.169 INFO:teuthology.orchestra.run.smithi092.stderr: 94.3% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T07:27:01.173 INFO:teuthology.orchestra.run.smithi169.stderr: 93.0% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T07:27:01.175 INFO:teuthology.orchestra.run.smithi169.stderr: 94.5% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T07:27:01.190 INFO:teuthology.orchestra.run.smithi169.stderr: 94.4% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T07:27:01.193 INFO:teuthology.orchestra.run.smithi175.stderr: 93.1% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T07:27:01.206 INFO:teuthology.orchestra.run.smithi175.stderr: 93.1% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T07:27:01.227 INFO:teuthology.orchestra.run.smithi175.stderr: 93.1% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T07:27:01.252 INFO:teuthology.orchestra.run.smithi169.stderr: 93.5% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T07:27:01.401 INFO:teuthology.orchestra.run.smithi175.stderr: 91.7% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T07:27:01.472 INFO:teuthology.orchestra.run.smithi092.stderr: 90.3% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T07:27:01.537 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T07:27:01.585 INFO:teuthology.orchestra.run.smithi175.stderr: 93.0% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T07:27:02.404 INFO:teuthology.orchestra.run.smithi092.stderr: 90.4% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T07:27:05.560 INFO:teuthology.orchestra.run.smithi175.stderr: 93.0% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T07:27:05.704 INFO:teuthology.orchestra.run.smithi175.stderr: 92.9% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T07:27:06.512 INFO:teuthology.orchestra.run.smithi169.stderr: 92.9% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T07:27:07.080 INFO:teuthology.orchestra.run.smithi169.stderr: 92.9% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T07:27:07.154 INFO:teuthology.orchestra.run.smithi092.stderr: 93.0% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T07:27:07.162 INFO:teuthology.orchestra.run.smithi175.stderr: 92.8% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T07:27:07.701 INFO:teuthology.orchestra.run.smithi169.stderr: 92.9% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T07:27:08.416 INFO:teuthology.orchestra.run.smithi169.stderr: 92.8% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T07:27:08.418 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-21T07:27:08.418 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m7.343s 2024-09-21T07:27:08.418 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m25.226s 2024-09-21T07:27:08.418 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m0.908s 2024-09-21T07:27:08.632 INFO:teuthology.orchestra.run.smithi092.stderr: 93.0% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T07:27:09.198 INFO:teuthology.orchestra.run.smithi092.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T07:27:09.886 INFO:teuthology.orchestra.run.smithi175.stderr: 92.9% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T07:27:09.945 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-09-21T07:27:09.945 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m8.813s 2024-09-21T07:27:09.946 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m24.160s 2024-09-21T07:27:09.946 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m0.856s 2024-09-21T07:27:09.958 INFO:teuthology.orchestra.run.smithi092.stderr: 92.8% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T07:27:11.327 INFO:teuthology.orchestra.run.smithi092.stderr: 92.8% -- replaced with /var/log/ceph/4e9565c0-77e7-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T07:27:11.329 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-21T07:27:11.329 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m10.259s 2024-09-21T07:27:11.329 INFO:teuthology.orchestra.run.smithi092.stderr:user 0m41.127s 2024-09-21T07:27:11.329 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m1.464s 2024-09-21T07:27:11.330 INFO:tasks.cephadm:Archiving logs... 2024-09-21T07:27:11.330 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578/remote/smithi092/log 2024-09-21T07:27:11.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:27:16.814 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578/remote/smithi169/log 2024-09-21T07:27:16.814 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:27:21.012 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578/remote/smithi175/log 2024-09-21T07:27:21.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:27:24.730 INFO:tasks.cephadm:Removing cluster... 2024-09-21T07:27:24.731 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 --force 2024-09-21T07:27:24.931 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:27:25.233 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 --force 2024-09-21T07:27:25.436 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:27:25.820 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e9565c0-77e7-11ef-baf5-efdc52797490 --force 2024-09-21T07:27:26.026 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 4e9565c0-77e7-11ef-baf5-efdc52797490 2024-09-21T07:27:26.318 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T07:27:26.319 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T07:27:26.337 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T07:27:26.355 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T07:27:26.371 INFO:tasks.cephadm:Teardown complete 2024-09-21T07:27:26.371 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T07:27:26.382 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T07:27:26.383 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:27:26.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:27:26.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:27:26.504 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T07:27:26.514 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T07:27:26.514 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:27:26.517 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:27:26.520 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:27:26.531 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:27:26.532 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:27:26.534 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:27:26.536 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:27:26.536 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-21T07:27:26.536 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +33us[ +41us] +/- 52ms 2024-09-21T07:27:26.536 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 -175us[ -168us] +/- 62ms 2024-09-21T07:27:26.536 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 55 +162us[ +170us] +/- 67ms 2024-09-21T07:27:26.536 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:27:26.537 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:27:26.537 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-21T07:27:26.538 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +44us[ +46us] +/- 52ms 2024-09-21T07:27:26.538 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -177us[ -176us] +/- 62ms 2024-09-21T07:27:26.538 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +145us[ +146us] +/- 67ms 2024-09-21T07:27:26.538 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:27:26.539 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:27:26.539 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-21T07:27:26.539 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +36us[ +63us] +/- 52ms 2024-09-21T07:27:26.539 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -175us[ -148us] +/- 62ms 2024-09-21T07:27:26.539 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +153us[ +180us] +/- 67ms 2024-09-21T07:27:26.539 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:27:26.539 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T07:27:26.551 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T07:27:26.551 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T07:27:26.561 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:27:26.662 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:27:26.727 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:27:26.792 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:27:26.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:27:26.822 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:27:26.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:27:26.850 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:27:26.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:27:26.879 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T07:27:26.896 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T07:27:26.931 INFO:teuthology.task.internal:Duration was 1904.243671 seconds 2024-09-21T07:27:26.931 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T07:27:26.970 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T07:27:26.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:27:26.973 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:27:26.975 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:27:27.010 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:27:27.012 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:27:27.014 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:27:27.435 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T07:27:27.435 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2024-09-21T07:27:27.435 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:27:27.455 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-09-21T07:27:27.456 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:27:27.499 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-09-21T07:27:27.499 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:27:27.524 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T07:27:27.525 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:27:27.527 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:27:27.542 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:27:27.591 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T07:27:27.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:27:27.594 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:27:27.609 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:27:28.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T07:27:28.878 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T07:27:28.879 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:27:28.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:27:28.933 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:27:28.962 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T07:27:28.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:27:28.978 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:27:28.981 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:27:28.998 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2024-09-21T07:27:29.007 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-09-21T07:27:29.026 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-09-21T07:27:29.184 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:27:29.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:27:29.198 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:27:29.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:27:29.240 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:27:29.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:27:29.257 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T07:27:29.270 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T07:27:29.270 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578/remote/smithi092 2024-09-21T07:27:29.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:27:29.337 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578/remote/smithi169 2024-09-21T07:27:29.337 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:27:29.380 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913578/remote/smithi175 2024-09-21T07:27:29.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:27:29.418 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T07:27:29.418 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:27:29.421 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:27:29.423 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:27:29.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T07:27:29.484 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T07:27:29.484 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T07:27:29.499 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T07:27:29.499 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:27:29.502 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:27:29.505 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:27:29.514 INFO:teuthology.orchestra.run.smithi092.stdout: 265972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:27 /home/ubuntu/cephtest 2024-09-21T07:27:29.519 INFO:teuthology.orchestra.run.smithi169.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:27 /home/ubuntu/cephtest 2024-09-21T07:27:29.525 INFO:teuthology.orchestra.run.smithi175.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:27 /home/ubuntu/cephtest 2024-09-21T07:27:29.527 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T07:27:29.539 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T07:27:29.573 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iozone}} duration: 1904.2436711788177 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T07:27:29.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:27:29.652 INFO:teuthology.run:pass